Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

SXSWi Workshop: DevOps - Infrastructure as Code

1,244 views

Published on

Configuring, deploying, and managing Big Data infrastructure, Hadoop in particular, is time consuming and expensive. Infochimps’ Ironfan is an open source systems configuration suite for the cloud, quickly and easily orchestrating an entire Big Data stack including data ingestion, scraping, storage, computation, and monitoring. With Ironfan, you can spin up clusters when you need them and turn them off when you don’t, enabling you to spend your time, money, and engineering focus on finding insights and creating value, not getting your machines ready. These are the slides from the SXSWi workshop, where individuals learned how to go from a single development machine to a full-stack cloud deployment.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

SXSWi Workshop: DevOps - Infrastructure as Code

  1. 1. DevOps: Empowering Developers with Infrastructure SXSW 2 0 1 3 – Tu e s d a y, M a r c h 1 2 Go here: http://infochim.ps/15INnv8 Nathan Eliot - @temujin9 Ryan Miller - @rmiller107 Amanda McGuckin-Hager - @shoogie Tim Gasper - @timgasper3/12/2013 #ironfan #devops #sxsw #bigdata #chef 1
  2. 2. Agenda http://infochim.ps/15INnv81. Intros - Housekeeping (15 min – 15 total)2. Initial Setup (30 min – 45 total)3. Debug Initial Set Up (30-45 min – 1:15 total)4. Standing Up a Simple Cluster (30-60 min – 2:15 total)5. Hadoop! (30-60 min – 3:15 total)6. General Q&A (30-60 min – 4:00 total)3/12/2013 #ironfan #devops #sxsw #bigdata #chef 2
  3. 3. Key Ironfan Contributors• Flip Kromer, @mrflip – CTO of Infochimps• Nathaniel Eliot, @temujin9 – Ops Engineer of Infochimps• Chris Howe – System Architect at Civitas Learning
  4. 4. Infochimps Enterprise Cloud for Big Data CUSTOMER APPLICATIONS Custom Applications Business Intelligence Packaged Apps (Java, Python, etc.) (Cognos, BOBJ, Microstrategy) (ERP, CRM, etc.)3/12/2013 #ironfan #devops #sxsw #bigdata #chef 4
  5. 5. Why We Love Chef• Infrastructure as Code – Version Control – Shareable – Testable – Recapitulable3/12/2013 #ironfan #devops #sxsw #bigdata #chef 5
  6. 6. Why We Love Chef MySQL Nginx SOLR My Application3/12/2013 #ironfan #devops #sxsw #bigdata #chef 6
  7. 7. Why We Love Chef3/12/2013 #ironfan #devops #sxsw #bigdata #chef 7
  8. 8. Why We Don’t Love Chef• Anything is possible• Nothing is simple• There’s not much repetition (not DRY)
  9. 9. Why We Don’t Love Chef Too much is hard-coded at development/upload time!3/12/2013 #ironfan #devops #sxsw #bigdata #chef 9
  10. 10. Why We Don’t Love Chef How do we make @server_ips dynamic?3/12/2013 #ironfan #devops #sxsw #bigdata #chef 10
  11. 11. Why We Wrote Ironfan• Simplify, unify, and standardize our usage of the Chef toolset• Build further abstractions on top of Chef• Give us superpowers that Chef doesn’t have yet http://github.com/infochimps-labs/ironfan3/12/2013 #ironfan #devops #sxsw #bigdata #chef 11
  12. 12. What Does Ironfan Do Ironfan Simple helpers in the silverware cookbook abstract common Chef patterns and keep things DRY. Chef
  13. 13. What Does Ironfan DoDynamic service discovery:3/12/2013 #ironfan #devops #sxsw #bigdata #chef 13
  14. 14. What Does Ironfan Do A simple DSL for defining clusters of machines.3/12/2013 #ironfan #devops #sxsw #bigdata #chef 14
  15. 15. Big Data for Chimps May 20133/12/2013 #ironfan #devops #sxsw #bigdata #chef 15
  16. 16. As we walk through Ironfan…• Shortlink: http://infochim.ps/15INnv8FYI• We are hiring! (we have offices in Austin & SF) – careers@infochimps.com – infochimps.com/careers• Learn more about our enterprise product: – sales@infochimps.com3/12/2013 #ironfan #devops #sxsw #bigdata #chef 16

×