第一回Hadoop会at tenjin 20100625

3,748 views
3,658 views

Published on

第一回Hadoop会 at Tenjinのスライド

Published in: Technology, Business
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
3,748
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
68
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

第一回Hadoop会at tenjin 20100625

  1. 1. Hadoop Tenjin 2010 06 25 2010 6 27
  2. 2. 2010 6 27
  3. 3. 3 2010 6 27
  4. 4. 4 2010 6 27
  5. 5. 5 2010 6 27
  6. 6. MPI MPI=Message Passing Interface 6 2010 6 27
  7. 7. Hadoop 2010 6 27
  8. 8. OSS Hadoop 8 2010 6 27
  9. 9. Hadoop 9 2010 6 27
  10. 10. Hadoop JDK OS 10 2010 6 27
  11. 11. Hadoop Master Slave job task tracker tracker Slave task tracker 11 2010 6 27
  12. 12. Hadoop Hadoop Zookeeper Chukwa Pig Hive Mahout HBase MapReduce Avro HDFS 12 2010 6 27
  13. 13. Hadoop 2010 6 27
  14. 14. Hadoop WikiPedia KeyValueStore NoSQL 14 2010 6 27
  15. 15. Hadoop 15 2010 6 27
  16. 16. MapReduce 2010 6 27
  17. 17. MapReduce Hadoop 17 2010 6 27
  18. 18. MapReduce MapReduce input Map Reduce hoge, hoge, hoge, fuga, fuga [hoge, [1, 1, 1]] [fuga, [1, 1]] [hoge, 1] [hoge, 1] [hoge, 1] [hoge, [1, 1, 1]] [hoge, 3] [fuga, 1] [fuga, [1, 1]] [fuga, 2] output [fuga, 1] Shuffle & Sort key value 18 2010 6 27
  19. 19. MapReduce HDFS Key Value MapReduce Map XML CSV TextInputFormat Key Value Reduce Key Value TextOutputFormat 19 2010 6 27
  20. 20. MapReduce 2010 6 27
  21. 21. MapReduce MapReduce Input Job1 Job2 Map Reduce KeyValue Map Reduce Output 21 2010 6 27
  22. 22. Grep Hadoop Grep $ hadoop jar hadoop-example.jar grep [ ][ ][ ] grep-serch Job grep-sort Job Map Map Key Value Reduce Reduce 22 2010 6 27
  23. 23. Grep Hadoop Grep 23 2010 6 27
  24. 24. MapReduce 2010 6 27
  25. 25. Wikipedia 2010 6 27
  26. 26. Wikipedia Wikipedia Wik-IE Wik-IE Map ID D/L Reduce Map KeyValue 26 2010 6 27
  27. 27. Hadoop 2010 6 27
  28. 28. add Hadoop OUTPUT 28 2010 6 27
  29. 29. Hadoop Application vision of Hadoop-based Application 29 2010 6 27
  30. 30. Hadoop 2010 6 27
  31. 31. Hadoop 31 2010 6 27
  32. 32. Hadoop 32 2010 6 27
  33. 33. Hadoop Hadooper Hadoop 33 2010 6 27

×