Saturday, April 12, 2014

Configure and run Hadoop 2 mapreduce job history server

#1 - Create the yarn pid dir
<HADOOP_YARN_HOME>/work/pids

#2 - Enable log aggregation
 <property>
        <name>yarn.log-aggregation-enable</name>
        <value>true</value>
 </property>

#3 - Add defult yarn pid dir to the yarnenv.sh

# default pid directory 
if [ "$YARN_PID_DIR" = "" ]; then
  YARN_LOG_DIR="$HADOOP_YARN_HOME/work/pids"
fi

#4 - After you start your dfs (<HADOOP_HOME>/sbin/start-dfs.sh) and yarn (<HADOOP_HOME>/sbin/start-yarn.sh) start your yarn mapreduce history server
[hduser@hostname sbin]$ ./mr-jobhistory-daemon.sh start historyserver
starting historyserver, logging to <HADOOP_HOME>/logs/mapred-hduser-historyserver-step-cca-sjc-lnx-lab9.out
[hduser@hostname sbin]$ 

For a nice hadoop 2 multi cluster quick installation click here

8 comments:

mareddyonline said...

Thank for sharing this great Hadoop tutorials Blog post. I will use your command when upgrade hadoop.
Hadoop Training in hyderabad

Stephen said...

Thank you so much for sharing this great information. Today I stand as a successful hadoop certified professional. Thanks to Big Data Course in Chennai

ciitnoida said...

Ciitnoida provides Core and java training institute in noida. We have a team of experienced Java professionals who help our students learn Java with the help of Live Base Projects. The object-oriented, java training in noida , class-based build of Java has made it one of most popular programming languages and the demand of professionals with certification in Advance Java training is at an all-time high not just in India but foreign countries too.

By helping our students understand the fundamentals and Advance concepts of Java, we prepare them for a successful programming career. With over 13 years of sound experience, we have successfully trained hundreds of students in Noida and have been able to turn ourselves into an institute for best Java training in Noida.

java training institute in noida
java training in noida
best java training institute in noida
java coaching in noida
java institute in noida

Sumaya Manzoor said...

Selenium Training in Chennai
selenium testing training in chennai
iOS Training in Chennai
Digital Marketing Training in Chennai
Future of testing professional
French Training in Chennai
French Training Chennai
French Course in Adyar

saran said...

"It is amazing.
.
Digital Marketing Training Course in Chennai | Digital Marketing Training Course in Anna Nagar | Digital Marketing Training Course in OMR | Digital Marketing Training Course in Porur | Digital Marketing Training Course in Tambaram | Digital Marketing Training Course in Velachery

"

cathrine juliet said...

thanks for sharing such a nice info.I hope you will share more information like this. please keep on sharing!

Big Data Hadoop Training In Chennai | Big Data Hadoop Training In anna nagar | Big Data Hadoop Training In omr | Big Data Hadoop Training In porur | Big Data Hadoop Training In tambaram | Big Data Hadoop Training In velachery

deiva said...

This information is impressive; I am inspired with your post writing style & how continuously you describe this topic. After reading your post, thanks for taking the time to discuss this, I feel happy about it and I love learning more about this topic..
angular js training in chennai

angular js training in omr

full stack training in chennai

full stack training in omr

php training in chennai

php training in omr

photoshop training in chennai

photoshop training in omr

Mrbk30 said...

Very Informative blog thank you for sharing. Keep sharing.

Best software training institute in Chennai. Make your career development the best by learning software courses.

blue prism training chennai
android course in chennai
power bi training in chennai
Docker Training in Chennai