Thursday, June 26, 2014

How to cleanup hdfs /tmp space

my jobs are getting /tmp no space left issue. has anyone used this? https://github.com/mag-/hdfs-cleanup

Monday, March 10, 2014

How to run a simple mapreduce job to verify the cluster health?


Many times you want to check if cluster is in good shape... run this command that does not require much setup...

$ hadoop jar /usr/lib/gphd/hadoop-mapreduce/hadoop-mapreduce-examples-*.jar pi 10 1000