HadoopEdit by Cassell Hsu                      2013.04.19
Hadoop              SlaveMaster        Slave              Slave
Hadoop• Master • NameNode • JobTracker • SecondaryNameNode
NameNode• Where is NameNode? • Master • HDFS(Hadoop Distributed File System)• What is NameNode? • 資料之位置資訊 ?? • 資料之屬性
NameNode• 位置資訊 ? • 所有資料皆存放在 – DataNode
DataNode• What is DataNode • 存放資料• Where is DataNode • HDFS • Slaves (and Master)
DataNodeUser        NameNode                      DataNode                  A      A128             64Mb   64MbMb         ...
Hadoop                          Slaves      Master                         DataNodeNameNode   DataNode                    ...
Hadoop• Master • NameNode • JobTracker • SecondaryNameNode
JobTracker• What is JobTracker? • 排程工作 誰來工作?• Where is JobTracker? • Master
JobTracker & TaskTracker          JobTracker   TaskTracker  Where     Master        Slaves  What     排程工作         執行工作
Hadoop                             Slaves      Master                              DataNode                             Ta...
Hadoop• Master • NameNode • JobTracker • SecondaryNameNode
SecondaryNameNode• What is SecondaryNameNode? • NameNode 發生錯誤時補救• Where is SecondaryNameNode? • Master
Hadoop                             Slaves      Master                              DataNode                             Ta...
MapReduce                NameNode   Reduce                           Slave1     A1         HDFS              Final Result ...
MapReduce• 檔案切割 • Hadoop 上區塊切割   • 程式指定
Upcoming SlideShare
Loading in...5
×

Hadoop

3,206

Published on

Introduce Apache Hadoop basic knowledge.

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,206
On Slideshare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
230
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Hadoop

  1. 1. HadoopEdit by Cassell Hsu 2013.04.19
  2. 2. Hadoop SlaveMaster Slave Slave
  3. 3. Hadoop• Master • NameNode • JobTracker • SecondaryNameNode
  4. 4. NameNode• Where is NameNode? • Master • HDFS(Hadoop Distributed File System)• What is NameNode? • 資料之位置資訊 ?? • 資料之屬性
  5. 5. NameNode• 位置資訊 ? • 所有資料皆存放在 – DataNode
  6. 6. DataNode• What is DataNode • 存放資料• Where is DataNode • HDFS • Slaves (and Master)
  7. 7. DataNodeUser NameNode DataNode A A128 64Mb 64MbMb B B 64Mb 64Mb DataNode Check hdfs-site.xml
  8. 8. Hadoop Slaves Master DataNodeNameNode DataNode DataNode DataNode
  9. 9. Hadoop• Master • NameNode • JobTracker • SecondaryNameNode
  10. 10. JobTracker• What is JobTracker? • 排程工作 誰來工作?• Where is JobTracker? • Master
  11. 11. JobTracker & TaskTracker JobTracker TaskTracker Where Master Slaves What 排程工作 執行工作
  12. 12. Hadoop Slaves Master DataNode TaskTrackerNameNode DataNode JobTracker
  13. 13. Hadoop• Master • NameNode • JobTracker • SecondaryNameNode
  14. 14. SecondaryNameNode• What is SecondaryNameNode? • NameNode 發生錯誤時補救• Where is SecondaryNameNode? • Master
  15. 15. Hadoop Slaves Master DataNode TaskTrackerNameNode DataNode JobTracker SecondaryNode
  16. 16. MapReduce NameNode Reduce Slave1 A1 HDFS Final Result Result1User Master Result2 Task Task A Slave2 A2
  17. 17. MapReduce• 檔案切割 • Hadoop 上區塊切割 • 程式指定
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×