Saturday, April 12, 2014

Configure and run Hadoop 2 mapreduce job history server

#1 - Create the yarn pid dir

#2 - Enable log aggregation

#3 - Add defult yarn pid dir to the

# default pid directory 
if [ "$YARN_PID_DIR" = "" ]; then

#4 - After you start your dfs (<HADOOP_HOME>/sbin/ and yarn (<HADOOP_HOME>/sbin/ start your yarn mapreduce history server
[hduser@hostname sbin]$ ./ start historyserver
starting historyserver, logging to <HADOOP_HOME>/logs/mapred-hduser-historyserver-step-cca-sjc-lnx-lab9.out
[hduser@hostname sbin]$ 

For a nice hadoop 2 multi cluster quick installation click here