Download to read offline
Uploaded byNitish Bhardwaj
Hadoop 130419075715-phpapp02(1)
This document provides an overview of the Hadoop framework. It describes the key components of Hadoop including the NameNode, DataNodes, JobTracker, TaskTracker, and SecondaryNameNode. The NameNode manages file metadata and location information stored across DataNodes. The JobTracker schedules jobs on TaskTrackers running on slave nodes. The SecondaryNameNode provides backup support to the NameNode in case of failure. Hadoop uses a master-slave architecture with the NameNode and JobTracker running on the master and DataNodes and TaskTrackers running on slave nodes.
Hadoop 130419075715-phpapp02(1)
- 1. Hadoop Edit by CassellHsu 2013.04.19
- 2.
- 3. Hadoop • Master • NameNode •JobTracker • SecondaryNameNode
- 4. NameNode • Where isNameNode? • Master • HDFS(Hadoop Distributed File System) • What is NameNode? • 資料之位置資訊 • 資料之屬性 ？？
- 5. NameNode • 位置資訊 ? •所有資料皆存放在 – DataNode
- 6. DataNode • What isDataNode • 存放資料 • Where is DataNode • HDFS • Slaves (and Master)
- 7.
- 8.
- 9. Hadoop • Master • NameNode •JobTracker • SecondaryNameNode
- 10. JobTracker • What isJobTracker? • 排程工作 • Where is JobTracker? • Master 誰來工作？
- 11. JobTracker & TaskTracker JobTrackerTaskTracker Where Master Slaves What 排程工作 執行工作
- 12.
- 13. Hadoop • Master • NameNode •JobTracker • SecondaryNameNode
- 14. SecondaryNameNode • What isSecondaryNameNode? • NameNode 發生錯誤時補救 • Where is SecondaryNameNode? • Master
- 15.
- 16.
- 17. MapReduce • 案切割檔 • Hadoop上區塊切割 • 程式指定