Your SlideShare is downloading. ×
0
2: Running a Hadoop ApplicationZubair Nabizubair.nabi@itu.edu.pkApril 18, 2013Zubair Nabi 2: Running a Hadoop Application ...
Running HadoopThe first order of the day is to format the Hadoop DFSZubair Nabi 2: Running a Hadoop Application April 18, 2...
Running HadoopThe first order of the day is to format the Hadoop DFSJump to the Hadoop directory and execute: bin/hadoopnam...
Running HadoopThe first order of the day is to format the Hadoop DFSJump to the Hadoop directory and execute: bin/hadoopnam...
Running HadoopThe first order of the day is to format the Hadoop DFSJump to the Hadoop directory and execute: bin/hadoopnam...
Generating a datasetCreate a temporary directory to hold the data: mkdir/tmp/gutenbergZubair Nabi 2: Running a Hadoop Appl...
Generating a datasetCreate a temporary directory to hold the data: mkdir/tmp/gutenbergJump to it: cd /tmp/gutenbergZubair ...
Generating a datasetCreate a temporary directory to hold the data: mkdir/tmp/gutenbergJump to it: cd /tmp/gutenbergDownloa...
Copying the dataset to the HDFSJump to the Hadoop directory and execute: bin/hadoop dfs-copyFromLocal /tmp/gutenberg /ccw/...
Running WordcountExecute: bin/hadoop jar hadoop-examples-1.0.4.jarwordcount /ccw/gutenberg /ccw/gutenberg-outputZubair Nab...
Retrieving results from the HDFSCopy to the local FS: bin/hadoop dfs -getmerge/ccw/gutenberg-output /tmp/gutenberg-outputZ...
Accessing the web interfaceJobTracker: http://localhost:50030Zubair Nabi 2: Running a Hadoop Application April 18, 2013 7 ...
Accessing the web interfaceJobTracker: http://localhost:50030TaskTracker: http://localhost:50060Zubair Nabi 2: Running a H...
Reference(s)Running Hadoop on Ubuntu Linux (Single-Node Cluster):http://www.michael-noll.com/tutorials/running-hadoop-on-u...
Upcoming SlideShare
Loading in...5
×

Lab 2: Running a Hadoop Application

482

Published on

Cloud Computing Workshop 2013, ITU

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
482
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
61
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Lab 2: Running a Hadoop Application"

  1. 1. 2: Running a Hadoop ApplicationZubair Nabizubair.nabi@itu.edu.pkApril 18, 2013Zubair Nabi 2: Running a Hadoop Application April 18, 2013 1 / 8
  2. 2. Running HadoopThe first order of the day is to format the Hadoop DFSZubair Nabi 2: Running a Hadoop Application April 18, 2013 2 / 8
  3. 3. Running HadoopThe first order of the day is to format the Hadoop DFSJump to the Hadoop directory and execute: bin/hadoopnamenode -formatZubair Nabi 2: Running a Hadoop Application April 18, 2013 2 / 8
  4. 4. Running HadoopThe first order of the day is to format the Hadoop DFSJump to the Hadoop directory and execute: bin/hadoopnamenode -formatTo run Hadoop and HDFS: bin/start-all.shZubair Nabi 2: Running a Hadoop Application April 18, 2013 2 / 8
  5. 5. Running HadoopThe first order of the day is to format the Hadoop DFSJump to the Hadoop directory and execute: bin/hadoopnamenode -formatTo run Hadoop and HDFS: bin/start-all.shTo terminate them: bin/stop-all.shZubair Nabi 2: Running a Hadoop Application April 18, 2013 2 / 8
  6. 6. Generating a datasetCreate a temporary directory to hold the data: mkdir/tmp/gutenbergZubair Nabi 2: Running a Hadoop Application April 18, 2013 3 / 8
  7. 7. Generating a datasetCreate a temporary directory to hold the data: mkdir/tmp/gutenbergJump to it: cd /tmp/gutenbergZubair Nabi 2: Running a Hadoop Application April 18, 2013 3 / 8
  8. 8. Generating a datasetCreate a temporary directory to hold the data: mkdir/tmp/gutenbergJump to it: cd /tmp/gutenbergDownload text files:wget www.gutenberg.org/etext/20417wget www.gutenberg.org/etext/5000wget www.gutenberg.org/etext/4300Zubair Nabi 2: Running a Hadoop Application April 18, 2013 3 / 8
  9. 9. Copying the dataset to the HDFSJump to the Hadoop directory and execute: bin/hadoop dfs-copyFromLocal /tmp/gutenberg /ccw/gutenbergZubair Nabi 2: Running a Hadoop Application April 18, 2013 4 / 8
  10. 10. Running WordcountExecute: bin/hadoop jar hadoop-examples-1.0.4.jarwordcount /ccw/gutenberg /ccw/gutenberg-outputZubair Nabi 2: Running a Hadoop Application April 18, 2013 5 / 8
  11. 11. Retrieving results from the HDFSCopy to the local FS: bin/hadoop dfs -getmerge/ccw/gutenberg-output /tmp/gutenberg-outputZubair Nabi 2: Running a Hadoop Application April 18, 2013 6 / 8
  12. 12. Accessing the web interfaceJobTracker: http://localhost:50030Zubair Nabi 2: Running a Hadoop Application April 18, 2013 7 / 8
  13. 13. Accessing the web interfaceJobTracker: http://localhost:50030TaskTracker: http://localhost:50060Zubair Nabi 2: Running a Hadoop Application April 18, 2013 7 / 8
  14. 14. Reference(s)Running Hadoop on Ubuntu Linux (Single-Node Cluster):http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-clusteZubair Nabi 2: Running a Hadoop Application April 18, 2013 8 / 8
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×