Saturday, April 12, 2014

Configure and run Hadoop 2 mapreduce job history server

#1 - Create the yarn pid dir
<HADOOP_YARN_HOME>/work/pids

#2 - Enable log aggregation
 <property>
        <name>yarn.log-aggregation-enable</name>
        <value>true</value>
 </property>

#3 - Add defult yarn pid dir to the yarnenv.sh

# default pid directory 
if [ "$YARN_PID_DIR" = "" ]; then
  YARN_LOG_DIR="$HADOOP_YARN_HOME/work/pids"
fi

#4 - After you start your dfs (<HADOOP_HOME>/sbin/start-dfs.sh) and yarn (<HADOOP_HOME>/sbin/start-yarn.sh) start your yarn mapreduce history server
[hduser@hostname sbin]$ ./mr-jobhistory-daemon.sh start historyserver
starting historyserver, logging to <HADOOP_HOME>/logs/mapred-hduser-historyserver-step-cca-sjc-lnx-lab9.out
[hduser@hostname sbin]$ 

For a nice hadoop 2 multi cluster quick installation click here

13 comments:

sundara rami reddy said...

Thank for sharing this great Hadoop tutorials Blog post. I will use your command when upgrade hadoop.
Hadoop Training in hyderabad

Stephen said...

Thank you so much for sharing this great information. Today I stand as a successful hadoop certified professional. Thanks to Big Data Course in Chennai

Dinju Thomas said...

Oracle Training in chennai | Oracle D2K Training In chennai
This information is impressive; I am inspired with your post writing style & how continuously you describe this topic. After reading your post, thanks for taking the time to discuss this, I feel happy about it and I love learning more about this topic..

Dinju Thomas said...

Thanks for Information Oracle Apps Technical is a collection of a bunch of collected applications like accounts payables, purchasing, inventory, accounts receivables, human resources, order management, general ledger and fixed assets, etc which have its own functionality for serving the business
Oracle Apps Training In Chennai

Dinju Thomas said...

This information is impressive; I am inspired with your post writing style & how continuously you describe this topic. After reading your post, thanks for taking the time to discuss this, I feel happy about it and I love learning more about this topic..
Selenium Training in Chennai | QTP Training in Chennai

Diya Patel said...

Best SQL Query Tuning Training Center In Chennai This information is impressive; I am inspired with your post writing style & how continuously you describe this topic. After reading your post, thanks for taking the time to discuss this, I feel happy about it and I love learning more about this topic..

sunitha vishnu said...

It is amazing and wonderful to visit your site.Thanks for sharing this information,this is useful to me...
Android Training in Chennai
Ios Training in Chennai

sri krishna kumar said...

A very interesting case study
Sap MM Training In Chennai | Mainframe Training In Chennai | Hadoop Training In Chennai

kevingeorge said...

I simply wanted to write down a quick word to say thanks to you for those wonderful tips and hints you are showing on this site.

Best Java Training Institute Chennai


Java Training Institute Bangalore

CIIT Noida said...

Ciitnoida provides Core and java training institute in noida. We have a team of experienced Java professionals who help our students learn Java with the help of Live Base Projects. The object-oriented, java training in noida , class-based build of Java has made it one of most popular programming languages and the demand of professionals with certification in Advance Java training is at an all-time high not just in India but foreign countries too.

By helping our students understand the fundamentals and Advance concepts of Java, we prepare them for a successful programming career. With over 13 years of sound experience, we have successfully trained hundreds of students in Noida and have been able to turn ourselves into an institute for best Java training in Noida.

java training institute in noida
java training in noida
best java training institute in noida
java coaching in noida
java institute in noida

Sumaya Manzoor said...

Selenium Training in Chennai
selenium testing training in chennai
iOS Training in Chennai
Digital Marketing Training in Chennai
Future of testing professional
French Training in Chennai
French Training Chennai
French Course in Adyar

ajay prakash said...

Very good information provided, Thanks a lot for sharing such useful information.
best aviation academy in Chennai
Air Hostess Training Institute in Chennai
Airline Courses in Chennai
airport ground staff training in Chennai
Aviation Academy in Chennai
air hostess training in Chennai
airport management courses in Chennai
ground staff training in Chennai

unknown said...

Informative post indeed, I’ve being in and out reading posts regularly and I see alot of engaging people sharing things and majority of the shared information is very valuable and so, here’s my fine read.
click here
visit here
check it out
visit for more
website