my jobs are getting /tmp no space left issue.
has anyone used this?
https://github.com/mag-/hdfs-cleanup
Tips and Tricks to build a Hadoop eco system. References to good articles on Hadoop based solutions. Topics include: Hadoop architecture, Hive, SQL on Hadoop, Compression, Metadata.
Thursday, June 26, 2014
Saturday, June 21, 2014
Monday, May 5, 2014
Sunday, April 13, 2014
Tuesday, April 8, 2014
Hortonworks HDP - Hive and Pig interface
Hortonworks Hcatalog interface is pretty useful for quick ingest and query. Also check out quick start slides on how to start the sandbox vm.
http://hortonworks.com/hadoop-tutorial/hello-world-an-introduction-to-hadoop-hcatalog-hive-and-pig/#loading
http://hortonworks.com/hadoop-tutorial/hello-world-an-introduction-to-hadoop-hcatalog-hive-and-pig/#loading
Friday, March 14, 2014
Monday, March 10, 2014
How to run a simple mapreduce job to verify the cluster health?
Many times you want to check if cluster is in good shape... run this command that does not require much setup...
$ hadoop jar /usr/lib/gphd/hadoop-mapreduce/hadoop-mapreduce-examples-*.jar pi 10 1000
Subscribe to:
Posts (Atom)