I am trying to learn about Apache Oozie, so i wanted to figure out how to use it in Cloudera 4.4.0 VM. When you go to the Oozie web console it shows a message saying that the Console is disabled. In order to enable the console i had to follow these steps
- Go to your Cloudera Manager, in that i went to the oozie configuration screen and i did check the
Enable Oozie Server Web Console
screen like this. As you can see in the description it says install ExtJS2.2 in /usr/lib/oozie/libext
- Next i did go to
/usr/lib/oozie/libext
directory and executed following command to download the ext-2.2.zip.
wget 'http://extjs.com/deploy/ext-2.2.zip'
Since i am using CDH 4.4 i had to execute unzip ext-2.2.zip
to unzip the ext-2.2.zip
-
Last step was to restart the oozie service and now i could see the Oozie web console
Executing oozie examples
After the Oozie console was enabled i wanted to execute oozie example to test out my installation so i followed these steps
- First thing for me was to find the
oozie-examples.tar.gz
file on my vm
find / -name oozie-examples.tar.gz
I found it under /usr/share/doc/oozie-3.3.2+92/
directory. So i did untar it using
tar xvf oozie-examples.tar.gz
-
Then i had to make change in the job.properties to change value of namenode and jobTracker from localhost to localhost.localdomain get rid of
Error: E0901 : E0901: Namenode [localhost:8020] not allowed, not in Oozies whitelist
error.
nameNode=hdfs://localhost.localdomain:8020
jobTracker=localhost.localdomain:8021
queueName=default
examplesRoot=examples
oozie.wf.application.path=${nameNode}/user/${user.name}/${examplesRoot}/apps/map-reduce
outputDir=map-reduce
- After making changes in job.properties i did upload the examples folder to HDFS using following command
hdfs dfs -put examples examples
- The last step in the process was to actually run the mapreduce job in oozie by executing following command
oozie job -oozie http://localhost:11000/oozie -config examples/apps/map-reduce/job.properties -run
- Once the job was started i could see the progress using Oozie web console like this
Thanks for info....
ReplyDeleteWebsite development in Bangalore
I hope to see more post from you. Thank you for sharing this post. Your blog posts are more interesting and impressive
ReplyDeleteSnack Video App | Snack Video APK
Your blog is filled with unique good articles! I was impressed how well you express your thoughts.
ReplyDeleteNESFB | NESFB Net Banking |NESFB Net Banking Registrationa and Login
This information is very useful and attractive. For those who need this information, it's very informative and understandable for those all. In Extern Labs, we have professional Web designers for intuitive website designs. Extern Labs is also a website design company.You can hire a dedicated Web designer to design an interactive website with innovative ideas. Thanks for this information. website design company
ReplyDeleteThank you for sharingg
ReplyDelete