LDeNA 峠とログ収集・集計の話
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

LDeNA 峠とログ収集・集計の話

on

  • 4,947 views

 

Statistics

Views

Total Views
4,947
Views on SlideShare
2,865
Embed Views
2,082

Actions

Likes
10
Downloads
25
Comments
0

4 Embeds 2,082

http://d.hatena.ne.jp 2069
http://hatenatunnel.appspot.com 6
http://a0.twimg.com 4
http://webcache.googleusercontent.com 3

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

LDeNA 峠とログ収集・集計の話 Presentation Transcript

  • 1. 12 1 30
  • 2. 12 1 30
  • 3. 12 1 30
  • 4. ( )12 1 30
  • 5. ( )12 1 30
  • 6. 12 1 30
  • 7. 12 1 30
  • 8. 12 1 30
  • 9. 12 1 30
  • 10. 12 1 30
  • 11. 12 1 30
  • 12. 12 1 30
  • 13. 12 1 30
  • 14. 12 1 30
  • 15. 12 1 30
  • 16. 12 1 30
  • 17. 12 1 30
  • 18. 12 1 30
  • 19. (2000 2011) 1. scp /URL (bot/ PV ) 2. 1 3. gluster fs (gluster)12 1 30
  • 20. 12 1 30
  • 21. 12 1 30
  • 22. 12 1 30
  • 23. 12 1 30
  • 24. (2011) 1. scribe push ( ) (scribed) 2. HDFS 3. parse Shib Hadoop Hadoop Hadoop Hive (scribed) Hadoop Cluster Hadoop Cluster Hadoop RAID Cluster Hadoop (scribed) Cluster Cluster RAID Cluster 4.12 1 30
  • 25. …12 1 30
  • 26. ………12 1 30
  • 27. 12 1 30
  • 28. 12 1 30
  • 29. 12 1 30
  • 30. (NOW!) (scribed) (scribed) RAID (scribed) (scribed) RAID Fluentd Hadoop Hadoop Hadoop Hadoop Hadoop Hadoop Shib Cluster Hadoop Cluster Hadoop Cluster Hadoop Cluster Fluentd Cluster Hadoop Cluster Hadoop Hadoop Hive Cluster Cluster Cluster Cluster Cluster Cluster HDFS12 1 30
  • 31. Shirahne -> Shib (scribed) (scribed) RAID (scribed) (scribed) RAID Hadoop Hadoop Hadoop Hadoop Hadoop Hadoop Shib Cluster Hadoop Cluster Hadoop Cluster Hadoop Cluster Fluentd Cluster Hadoop Cluster Hadoop Hadoop Hive Cluster Cluster Cluster Cluster Cluster Cluster Shirahne12 1 30
  • 32. 12 1 30
  • 33. Yahoo! HTTP parse Fluentd IRC12 1 30
  • 34. 12 1 30
  • 35. 12 1 30