Hadoop
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Hadoop

on

  • 3,098 views

Introduce Apache Hadoop basic knowledge.

Introduce Apache Hadoop basic knowledge.

Statistics

Views

Total Views
3,098
Views on SlideShare
3,075
Embed Views
23

Actions

Likes
2
Downloads
220
Comments
0

3 Embeds 23

http://www.skillschool.co.in 12
http://skillschool.co.in 9
http://192.168.6.56 2

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Hadoop Presentation Transcript

  • 1. HadoopEdit by Cassell Hsu 2013.04.19
  • 2. Hadoop SlaveMaster Slave Slave
  • 3. Hadoop• Master • NameNode • JobTracker • SecondaryNameNode
  • 4. NameNode• Where is NameNode? • Master • HDFS(Hadoop Distributed File System)• What is NameNode? • 資料之位置資訊 ?? • 資料之屬性
  • 5. NameNode• 位置資訊 ? • 所有資料皆存放在 – DataNode
  • 6. DataNode• What is DataNode • 存放資料• Where is DataNode • HDFS • Slaves (and Master)
  • 7. DataNodeUser NameNode DataNode A A128 64Mb 64MbMb B B 64Mb 64Mb DataNode Check hdfs-site.xml
  • 8. Hadoop Slaves Master DataNodeNameNode DataNode DataNode DataNode
  • 9. Hadoop• Master • NameNode • JobTracker • SecondaryNameNode
  • 10. JobTracker• What is JobTracker? • 排程工作 誰來工作?• Where is JobTracker? • Master
  • 11. JobTracker & TaskTracker JobTracker TaskTracker Where Master Slaves What 排程工作 執行工作
  • 12. Hadoop Slaves Master DataNode TaskTrackerNameNode DataNode JobTracker
  • 13. Hadoop• Master • NameNode • JobTracker • SecondaryNameNode
  • 14. SecondaryNameNode• What is SecondaryNameNode? • NameNode 發生錯誤時補救• Where is SecondaryNameNode? • Master
  • 15. Hadoop Slaves Master DataNode TaskTrackerNameNode DataNode JobTracker SecondaryNode
  • 16. MapReduce NameNode Reduce Slave1 A1 HDFS Final Result Result1User Master Result2 Task Task A Slave2 A2
  • 17. MapReduce• 檔案切割 • Hadoop 上區塊切割 • 程式指定