Your SlideShare is downloading. ×
0
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Ironfan: Build a Hadoop Cluster in 20 minutes
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Ironfan: Build a Hadoop Cluster in 20 minutes

2,407

Published on

The slides from our talk at ChefConf 2012

The slides from our talk at ChefConf 2012

Published in: Business, Technology
0 Comments
7 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
2,407
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
31
Comments
0
Likes
7
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Ironfan: Build a Hadoop Cluster in 20 Minutes Dhruv Bansal Nathaniel Eliot @dhruvbansal @temujin9Saturday, May 19, 2012
  • 2. Saturday, May 19, 2012
  • 3. OutlineSaturday, May 19, 2012
  • 4. Why Ironfan? Outline • Why we love Chef • Why we don’t • Why we wrote IronfanSaturday, May 19, 2012
  • 5. Why Ironfan? Outline • Why we love Chef • Why we don’t • Why we wrote Ironfan Ironfan in Action • Build a Hadoop cluster • Run a Hadoop job • Put that cluster awaySaturday, May 19, 2012
  • 6. Why Ironfan? Outline • Why we love Chef • Why we don’t • Why we wrote Ironfan Ironfan in Action • Build a Hadoop cluster • Run a Hadoop job • Put that cluster away Ironfan roadmap • Better environments • Cloud agnosticism • Continuous integration • StacksSaturday, May 19, 2012
  • 7. Why we love Chef Infrastructure as code: Version control Testable Shareable RecapitulableSaturday, May 19, 2012
  • 8. Why we love Chef Modular, composable units: MySQL Nginx SOLR My ApplicationSaturday, May 19, 2012
  • 9. Why we love ChefSaturday, May 19, 2012
  • 10. Why we don’t love Chef Anything is possible Nothing is simple And there’s much repetition (not DRY)Saturday, May 19, 2012
  • 11. Why we don’t love Chef Write Upload Compile Converge Development Machine Managed Server Hard Coded Dynamic Too much is hard-coded at development/upload time!Saturday, May 19, 2012
  • 12. Why we don’t love Chef How do we make @server_ips dynamic?Saturday, May 19, 2012
  • 13. Enter Ironfan We wrote Ironfan toSaturday, May 19, 2012
  • 14. Enter Ironfan We wrote Ironfan to • Simplify, unify, and standardize our usage of the Chef toolsetSaturday, May 19, 2012
  • 15. Enter Ironfan We wrote Ironfan to • Simplify, unify, and standardize our usage of the Chef toolset • Build further abstractions on top of ChefSaturday, May 19, 2012
  • 16. Enter Ironfan We wrote Ironfan to • Simplify, unify, and standardize our usage of the Chef toolset • Build further abstractions on top of Chef • Give us superpowers that Chef doesn’t have yetSaturday, May 19, 2012
  • 17. Enter Ironfan We wrote Ironfan to • Simplify, unify, and standardize our usage of the Chef toolset • Build further abstractions on top of Chef • Give us superpowers that Chef doesn’t have yet http://github.com/infochimps-labs/ironfanSaturday, May 19, 2012
  • 18. What does Ironfan do?Saturday, May 19, 2012
  • 19. What does Ironfan do? ChefSaturday, May 19, 2012
  • 20. What does Ironfan do? Ironfan Simple helpers in the silverware cookbook abstract common Chef patterns and keep things DRY ChefSaturday, May 19, 2012
  • 21. What does Ironfan do?Saturday, May 19, 2012
  • 22. What does Ironfan do? Dynamic service discovery:Saturday, May 19, 2012
  • 23. What does Ironfan do? Dynamic service discovery:Saturday, May 19, 2012
  • 24. What does Ironfan do?Saturday, May 19, 2012
  • 25. What does Ironfan do? A simple DSL for defining clusters of machinesSaturday, May 19, 2012
  • 26. DEMO TIME!Saturday, May 19, 2012
  • 27. Thanks for coming! Learn more about what Ironfan and Infochimps can sales@infochimps.com do for you. Come work at a fast- growing, cutting-edge careers@infochimps.com technology company based in Austin, TX. http://github.com/infochimps-labs/ironfan http://github.com/infochimps-labs/wukongSaturday, May 19, 2012

×