AWS re:Invent 2016: Datapipe Open Source: Image Development Pipeline (ARC319)

128 views

Published on

For an IT organization to be successful in rapid cloud assessment or iterative migration of their infrastructure and applications to AWS, they need to effectively plan and execute on a strategic cloud strategy that focuses not only on cloud, but also big data, DevOps, and security. Session sponsored by Datapipe.

AWS Competency Partner

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
128
On SlideShare
0
From Embeds
0
Number of Embeds
9
Actions
Shares
0
Downloads
27
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

AWS re:Invent 2016: Datapipe Open Source: Image Development Pipeline (ARC319)

  1. 1. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Patrick McClory, VP Public Cloud & Professional Services - Datapipe Thursday, December 1st, 2016 Machines At The Scale Of…Machines Datapipe Open Source: Amazon Machine Image Builder Toolset
  2. 2. What to Expect from the Session • Overview of Amazon Machine Image (AMI) application • Deep-dive into hands-on learnings from working at scale • Walkthrough of Bakery toolset • Simple Demo (install to first build) • Complex Scenario Walkthrough
  3. 3. Design Overview
  4. 4. Requirements Convergence MANAGED SERVICES Consistency Volume Over Time DEV OPS Delivery Speed Volume in Service PROGRAMMATIC & SCALABLE SOLUTION
  5. 5. How Much Do I Bake In? Base AMI Fully Immutable
  6. 6. No-bake • Flexibility achieved via library of user data and configuration management scripts • ‘Pay-per-install’  Bandwidth & time • ‘Pretty consistent deploys over time’  Package versions, etc. • Always the latest version Comparing Approaches – Per Instance Launch: Fully-baked • Flexibility achieved via a library of AMI’s. • Pay for engineering & storage  Pre-work, EBS Snapshots • Absolutely consistent deploys time after time • Always the version you built
  7. 7. How Much Do I Bake In?
  8. 8. Patterns and Mechanics
  9. 9. BASE AMI OS CONFIGURATION APPLICATION INSTALLATION TESTING/ VALIDATION IMAGE CAPTURE Packer Provided by AWS Configuration Management Testing What does it take to build an image?
  10. 10. Bakery Walkthrough
  11. 11. • Our toolset intends to solving a problem in a specific context. • We very much want to get feedback and involvement from the community, but want to be straightforward:  Pull Requests for technical issues are VERY welcome  Feedback on the design via Pull Requests to the design documentation is welcome and we want to engage in a conversation from there. Feedback is Welcome!
  12. 12. Aligning to CI/CD Pipeline SOURCE CONTROL CONTINUOUS INTEGRATION TEST/QA CONTINUOUS DELIVERY RUNTIME OPERATIONS
  13. 13. Bakery Workflow Start Ready to go NAMING AND DESCRIPTIVE DETAILS CONFIGURATION MANAGEMENT CI TOOLING CHOICE AWS TARGET(S) CONFIGURATION(S) INITIALIZE REPO LOCALLY
  14. 14. YO Bakery!
  15. 15. YO Bakery – Project Setup
  16. 16. YO Bakery – Configuration Management
  17. 17. YO Bakery – Continuous Intergration
  18. 18. YO Bakery – AWS Setup
  19. 19. YO Bakery – Region Selection
  20. 20. Simple Walkthrough
  21. 21. Installation npm install -g generator-bakery
  22. 22. Complex Usecase
  23. 23. Roadmap & Collaboration
  24. 24. Thank you!
  25. 25. Remember to complete your evaluations!

×