Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Zero To Cloud (OSCon 2014)

This tutorial provides a detailed hands-on experience to bring up the necessary components to run the @NetflixOSS stack. This includes priming your Amazon account (IAM Profiles, Security Groups, etc) and setting up Asgard and Aminator. Together they can be used, time permitting, to launch many more @NetflixOSS services, like Edda, Eureka and Ice.

  • Be the first to comment

Zero To Cloud (OSCon 2014)

  1. 1. Zero to Cloud with @NetflixOSS Justin Ryan (@quidryan)
  2. 2. Who We Are • Justin Ryan • Michael Tripoli • Various other Netflix Employees in the Audience #netflixoss
  3. 3. #netflixoss Netflix is the world's leading Internet television network with over 48 million members in more than 40 countries enjoying more than one billion hours of TV shows and movies per month, including original series. For a low monthly price, Netflix members can watch as much as they want, anytime, anywhere, on nearly any Internet-connected screen. Members can play, pause and resume watching, all without commercials or commitments. (Credit: ir.netflix.com)
  4. 4. Tutorial Format • 30 Minutes of Lecture • 30 Minutes on Console • 30 Minutes on Jumphost • 30 Minutes deploying Asgard • 30 Minutes Edda and Eureka • 30 Minutes Karyon #netflixoss
  5. 5. Tutorial Purpose • Help adoption of @NetflixOSS components • Answer questions along the way • Less trail blazing for us #netflixoss
  6. 6. Assumptions • Stay Local (using us-west-2) • Non-destructive operations • Follow instructions closely • Security through obscurity • Not a “developing for the cloud” tutorial • This will cost money #netflixoss
  7. 7. #netflixoss http://nflx.it/zerotocloud
  8. 8. #netflixoss Step 1 - Sign Up for AWS
  9. 9. Network #netflixoss Jumphost Laptop Asgard InstanceInstanceInstances InstanceInstanceInstances Elastic Load Balancer Elastic Load Balancer SSH HTTP
  10. 10. #netflixoss Step 2 - AWS Console
  11. 11. #netflixoss Step 3 - Key Pair
  12. 12. #netflixoss Step 4 - Create Jumphost
  13. 13. #netflixoss Step 5 - Create Role
  14. 14. #netflixoss Step 6 - Create User
  15. 15. Cloud Deployment Model #netflixoss Auto Scaling Group Elastic Load Balancer Launch Configuration Security Group Amazon Machine Image Configuration Runtime InstanceInstanceInstances
  16. 16. #netflixoss Step 7 - Security Group
  17. 17. Immutable Infrastructure • Simplifies Operations • Baking with Aminator #netflixoss Foundation Base AMI Application
  18. 18. #netflixoss Step 8 - Foundation AMI
  19. 19. #netflixoss Step 9 - Setup Jumphost
  20. 20. #netflixoss Step 10 - Credentials
  21. 21. Building • Bake a system package (RPM, DEB) • Use ospackage plugin to generate #netflixoss Foundation Base AMI Application WAR DEB Java Python
  22. 22. #netflixoss Step 11 - Base AMI
  23. 23. netflix.github.io #netflixoss
  24. 24. @netflixoss #netflixoss
  25. 25. Who • Platform Infrastructure • Cloud Database Engineering • Cloud Solutions Engineering Tools • Cloud and Platform Engineering • (Anyone with code that’s not a competitive advantage) #netflixoss
  26. 26. What • Infrastructure • Caching • Database • Cloud • Building • Deployment ! #netflixoss • Testing • Monitoring • Networking • Robustness • Security • Configuration
  27. 27. Not • Streaming • Encoding • Merchandising • Movie metadata • Recommendations • 10’ UI #netflixoss
  28. 28. Open source infrastructure • Github • Cloudbees for Builds • http://techblog.netflix.com/ • http://twitter.com/netflixoss • Apache 2.0 license (when possible) • Meetups - Season 2 going on right now! #netflixoss
  29. 29. #netflixoss Step 12 - Bake Asgard
  30. 30. Islands of Applications #netflixoss Search Auto-complete Ratings Signup API Streaming Starts
  31. 31. Islands of Applications #netflixoss Search Auto-complete Ratings Signup API Streaming Starts Application Application Application Application Application Application
  32. 32. Inventing the Application • Problem - Application is not an Amazon concept • Solution - Create an Application domain in SimpleDB - Enforce naming conventions on Amazon objects #netflixoss
  33. 33. Red/Black Deploy #netflixoss Elastic Load Balancer InstanceInstanceInstances api-usprod-v007 InstanceInstanceInstances api-usprod-v008
  34. 34. Fast Rollback #netflixoss Elastic Load Balancer InstanceInstanceInstances api-usprod-v007 InstanceInstanceInstances api-usprod-v008
  35. 35. Inventing the Cluster • Problem - Two ASGs on purpose - Different names • Solution - Maintain same prefix - Append version - Derive Cluster from ASG names #netflixoss
  36. 36. Asgard vs Console • Asgard - Provide Application and Cluster - Simplifies object construction - Introduce workflow - Tightly couple with internal systems • Console - Access to all objects #netflixoss
  37. 37. #netflixoss Step 13 - Asgard/Asgard
  38. 38. #netflixoss Step 14 - Deploy Edda
  39. 39. Mid-tier Calling #netflixoss Eureka Data Plane Control Plane InstanceInstanceApp A InstanceInstanceApp B
  40. 40. #netflixoss Step 14 - Deploy Eureka
  41. 41. #netflixoss Extra - Karyon
  42. 42. Gift Cards #netflixoss Thanks, Amazon!
  43. 43. Thanks! Justin Ryan (@quidryan) slideshare.net/quidryan

    Be the first to comment

    Login to see the comments

  • justinleeschmidtmn

    Apr. 6, 2015

This tutorial provides a detailed hands-on experience to bring up the necessary components to run the @NetflixOSS stack. This includes priming your Amazon account (IAM Profiles, Security Groups, etc) and setting up Asgard and Aminator. Together they can be used, time permitting, to launch many more @NetflixOSS services, like Edda, Eureka and Ice.

Views

Total views

1,401

On Slideshare

0

From embeds

0

Number of embeds

64

Actions

Downloads

17

Shares

0

Comments

0

Likes

1

×