Building Cloud Tools for Netflix                  @joesondow #netflixcloudSunday, September 25, 2011
Note takers, take note         http://www.slideshare.net/joesondow                  @joesondow #netflixcloudSunday, Septemb...
Agenda                  @joesondow #netflixcloudSunday, September 25, 2011
Agenda         Who am I?                  @joesondow #netflixcloudSunday, September 25, 2011
Agenda         Who am I?         Why am I here?                  @joesondow #netflixcloudSunday, September 25, 2011
Agenda         Who am I?         Why am I here?         Cloud deployment model                  @joesondow #netflixcloudSun...
Agenda         Who am I?         Why am I here?         Cloud deployment model         Netflix Application Console         ...
Agenda         Who am I?         Why am I here?         Cloud deployment model         Netflix Application Console         ...
Who am I?                  @joesondowSunday, September 25, 2011
Who am I?                  @joesondowSunday, September 25, 2011
Who am I?              Joe Sondow                  @joesondowSunday, September 25, 2011
Who am I?              Joe Sondow              New York City                  @joesondowSunday, September 25, 2011
Who am I?              Joe Sondow              New York City              Netflix since 2010                  @joesondowSun...
Who am I?              Joe Sondow              New York City              Netflix since 2010                  @joesondowSun...
Who am I?              Joe Sondow              New York City              Netflix since 2010              Cloud Tools      ...
Who am I?              Joe Sondow              New York City              Netflix since 2010              Cloud Tools      ...
Who am I?              Joe Sondow              New York City              Netflix since 2010              Cloud Tools      ...
Why am I here?Sunday, September 25, 2011
Why am I here?Sunday, September 25, 2011
Why am I here?              Sell you somethingSunday, September 25, 2011
Why am I here?              Sell you something              Discuss business plansSunday, September 25, 2011
Why am I here?              Sell you something              Discuss business plans              Answer technical questions...
Why am I here?              Sell you something              Discuss business plans              Answer technical questions...
Why am I here?              Sell you something              Discuss business plans              Answer technical questions...
Cloud deployment modelSunday, September 25, 2011
Cloud deployment model         Applications         ClustersSunday, September 25, 2011
Cloud deployment modelSunday, September 25, 2011
Cloud deployment model                             Auto Scaling                                GroupSunday, September 25, ...
Cloud deployment model                             Auto Scaling                                Group                      ...
Cloud deployment model                                            Elastic Load                                            ...
Cloud deployment model                                             Elastic Load                                           ...
Cloud deployment model                                             Elastic Load                                           ...
Cloud deployment model                                             Elastic Load                                           ...
Cloud deployment model                                             Elastic Load                                           ...
Cloud deployment model                                             Elastic Load                                           ...
Cloud deployment model                                             Elastic Load                                           ...
Cloud deployment modelSunday, September 25, 2011
Cloud deployment model                             SearchSunday, September 25, 2011
Cloud deployment model                             API   SearchSunday, September 25, 2011
Cloud deployment model                                    Ratings                             API   SearchSunday, Septembe...
Cloud deployment model         Streaming Starts                                    Ratings                             API...
Cloud deployment model         Streaming Starts                                    Ratings                             API...
Cloud deployment model                             Sign Up         Streaming Starts                                       ...
Cloud deployment model                                   Sign Up         Streaming Starts                                 ...
Inventing the ApplicationSunday, September 25, 2011
Inventing the Application              Problem:              Application is not an Amazon conceptSunday, September 25, 2011
Inventing the Application              Problem:              Application is not an Amazon concept              Solution:  ...
Fast RollbackSunday, September 25, 2011
Fast Rollback              Optimism causes outagesSunday, September 25, 2011
Fast Rollback              Optimism causes outages              Production traffic is uniqueSunday, September 25, 2011
Fast Rollback              Optimism causes outages              Production traffic is unique              Keep old version ...
Fast Rollback              Optimism causes outages              Production traffic is unique              Keep old version ...
Fast Rollback              Optimism causes outages              Production traffic is unique              Keep old version ...
Fast Rollback              Optimism causes outages              Production traffic is unique              Keep old version ...
Fast RollbackSunday, September 25, 2011
Fast Rollback                                               api-frontend                             api-usprod-v007Sunday...
Fast Rollback                                               api-frontend                             api-usprod-v007      ...
Fast Rollback                                               api-frontend                             api-usprod-v007      ...
Fast Rollback                                               api-frontend                             api-usprod-v007      ...
Fast Rollback                                               api-frontend                             api-usprod-v007      ...
Fast Rollback                             api-frontend                                            api-usprod-v008Sunday, S...
Fast RollbackSunday, September 25, 2011
Fast Rollback                                               api-frontend                             api-usprod-v007Sunday...
Fast Rollback                                               api-frontend                             api-usprod-v007      ...
Fast Rollback                                               api-frontend                             api-usprod-v007      ...
Fast Rollback                                               api-frontend                             api-usprod-v007      ...
Fast Rollback                                               api-frontend                             api-usprod-v007Sunday...
Inventing the ClusterSunday, September 25, 2011
Inventing the Cluster              Problem:              Two ASGs with one function but different namesSunday, September 2...
Inventing the Cluster              Problem:              Two ASGs with one function but different names              Solut...
Netflix Application ConsoleSunday, September 25, 2011
Netflix Application Console         Cloud interfaceSunday, September 25, 2011
Sunday, September 25, 2011
Sunday, September 25, 2011
Sunday, September 25, 2011
Sunday, September 25, 2011
Sunday, September 25, 2011
Sunday, September 25, 2011
Sunday, September 25, 2011
Sunday, September 25, 2011
Sunday, September 25, 2011
Sunday, September 25, 2011
Sunday, September 25, 2011
Sunday, September 25, 2011
Sunday, September 25, 2011
Sunday, September 25, 2011
REST API is easy in GrailsSunday, September 25, 2011
REST API is easy in GrailsSunday, September 25, 2011
REST API is easy in GrailsSunday, September 25, 2011
REST API is easy in Grails  ApplicationController.groovySunday, September 25, 2011
Why not the AWS console?Sunday, September 25, 2011
Why not the AWS console?         No, not to keep me busySunday, September 25, 2011
Why not the AWS console?Sunday, September 25, 2011
Why not the AWS console?Sunday, September 25, 2011
Why not the AWS console?              Hide keysSunday, September 25, 2011
Why not the AWS console?              Hide keys              Customize modelSunday, September 25, 2011
Why not the AWS console?              Hide keys              Customize model              Automate workflowSunday, Septembe...
Why not the AWS console?              Hide keys              Customize model              Automate workflow              En...
Why not the AWS console?              Hide keys              Customize model              Automate workflow              En...
Why not the AWS console?              Hide keys              Customize model              Automate workflow              En...
Why not the AWS console?              Hide keys              Customize model              Automate workflow              En...
Thank you            @joesondow         http://www.slideshare.net/joesondowSunday, September 25, 2011
Thank you         Questions?            @joesondow         http://www.slideshare.net/joesondowSunday, September 25, 2011
Upcoming SlideShare
Loading in...5
×

Building Cloud Tools for Netflix

10,774

Published on

Using the Amazon cloud requires a lot of moving parts like AMIs, ASGs, and ELBs. See how a small Netflix team developed web-based tools to abstract and clarify these cloudy components for use by hundreds of engineers.

Presented at "Talk Cloudy to Me II" hosted by the Silicon Valley Cloud Computing Group in 2011.

Apple Keynote version with animations is on Google Docs at http://bit.ly/netflixcloudtools

Published in: Technology, Business
4 Comments
25 Likes
Statistics
Notes
  • Video of this presentation from the conference 'Talk Cloudy to Me II' hosted by the Silicon Valley Cloud Computing Group in 2011:
    http://blip.tv/silicon-valley-cloud-computing-group/building-cloud-tools-for-netflix-5754984

    Animated slides in Apple Keynote format:
    http://bit.ly/netflixcloudtools
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • To see more about Netflix in the Amazon Cloud, Jenkins, and Artifactory, sign up to visit Netflix headquarters for a 'Devops in the Cloud' meetup Thurs, Dec 15, 2011 from 5:30pm to 8:30pm in Los Gatos, CA.
    http://devopsinthecloud.eventbrite.com
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • you're famous!
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • I’ll be doing this presentation again at 11:15am Saturday, October 8, 2011 at http://www.siliconvalley-codecamp.com in Los Altos Hills, CA
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total Views
10,774
On Slideshare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
305
Comments
4
Likes
25
Embeds 0
No embeds

No notes for slide

Building Cloud Tools for Netflix

  1. 1. Building Cloud Tools for Netflix @joesondow #netflixcloudSunday, September 25, 2011
  2. 2. Note takers, take note http://www.slideshare.net/joesondow @joesondow #netflixcloudSunday, September 25, 2011
  3. 3. Agenda @joesondow #netflixcloudSunday, September 25, 2011
  4. 4. Agenda Who am I? @joesondow #netflixcloudSunday, September 25, 2011
  5. 5. Agenda Who am I? Why am I here? @joesondow #netflixcloudSunday, September 25, 2011
  6. 6. Agenda Who am I? Why am I here? Cloud deployment model @joesondow #netflixcloudSunday, September 25, 2011
  7. 7. Agenda Who am I? Why am I here? Cloud deployment model Netflix Application Console @joesondow #netflixcloudSunday, September 25, 2011
  8. 8. Agenda Who am I? Why am I here? Cloud deployment model Netflix Application Console Why not the AWS Console? @joesondow #netflixcloudSunday, September 25, 2011
  9. 9. Who am I? @joesondowSunday, September 25, 2011
  10. 10. Who am I? @joesondowSunday, September 25, 2011
  11. 11. Who am I? Joe Sondow @joesondowSunday, September 25, 2011
  12. 12. Who am I? Joe Sondow New York City @joesondowSunday, September 25, 2011
  13. 13. Who am I? Joe Sondow New York City Netflix since 2010 @joesondowSunday, September 25, 2011
  14. 14. Who am I? Joe Sondow New York City Netflix since 2010 @joesondowSunday, September 25, 2011
  15. 15. Who am I? Joe Sondow New York City Netflix since 2010 Cloud Tools @joesondowSunday, September 25, 2011
  16. 16. Who am I? Joe Sondow New York City Netflix since 2010 Cloud Tools Grails @joesondowSunday, September 25, 2011
  17. 17. Who am I? Joe Sondow New York City Netflix since 2010 Cloud Tools Grails jQuery @joesondowSunday, September 25, 2011
  18. 18. Why am I here?Sunday, September 25, 2011
  19. 19. Why am I here?Sunday, September 25, 2011
  20. 20. Why am I here? Sell you somethingSunday, September 25, 2011
  21. 21. Why am I here? Sell you something Discuss business plansSunday, September 25, 2011
  22. 22. Why am I here? Sell you something Discuss business plans Answer technical questionsSunday, September 25, 2011
  23. 23. Why am I here? Sell you something Discuss business plans Answer technical questions Be a smaller fish in AWSSunday, September 25, 2011
  24. 24. Why am I here? Sell you something Discuss business plans Answer technical questions Be a smaller fish in AWS Steal your engineersSunday, September 25, 2011
  25. 25. Cloud deployment modelSunday, September 25, 2011
  26. 26. Cloud deployment model Applications ClustersSunday, September 25, 2011
  27. 27. Cloud deployment modelSunday, September 25, 2011
  28. 28. Cloud deployment model Auto Scaling GroupSunday, September 25, 2011
  29. 29. Cloud deployment model Auto Scaling Group Launch ConfigurationSunday, September 25, 2011
  30. 30. Cloud deployment model Elastic Load Balancer Auto Scaling Group Launch ConfigurationSunday, September 25, 2011
  31. 31. Cloud deployment model Elastic Load Balancer Auto Scaling Group Launch Configuration Amazon Machine ImageSunday, September 25, 2011
  32. 32. Cloud deployment model Elastic Load Balancer Auto Scaling Group Security Group Launch Configuration Amazon Machine ImageSunday, September 25, 2011
  33. 33. Cloud deployment model Elastic Load Balancer Auto Scaling Group Security Instances Group Launch Configuration Amazon Machine ImageSunday, September 25, 2011
  34. 34. Cloud deployment model Elastic Load Balancer Auto Scaling Group Security Instances Group Launch Configuration Amazon Machine ImageSunday, September 25, 2011
  35. 35. Cloud deployment model Elastic Load Balancer Auto Scaling Group Security Instances Group Launch Configuration Amazon Machine ImageSunday, September 25, 2011
  36. 36. Cloud deployment model Elastic Load Balancer Auto Scaling Group Security Instances Group Launch Configuration Amazon Machine ImageSunday, September 25, 2011
  37. 37. Cloud deployment modelSunday, September 25, 2011
  38. 38. Cloud deployment model SearchSunday, September 25, 2011
  39. 39. Cloud deployment model API SearchSunday, September 25, 2011
  40. 40. Cloud deployment model Ratings API SearchSunday, September 25, 2011
  41. 41. Cloud deployment model Streaming Starts Ratings API SearchSunday, September 25, 2011
  42. 42. Cloud deployment model Streaming Starts Ratings API Search AutocompleteSunday, September 25, 2011
  43. 43. Cloud deployment model Sign Up Streaming Starts Ratings API Search AutocompleteSunday, September 25, 2011
  44. 44. Cloud deployment model Sign Up Streaming Starts Ratings Application Application Application API Search Autocomplete Application Application ApplicationSunday, September 25, 2011
  45. 45. Inventing the ApplicationSunday, September 25, 2011
  46. 46. Inventing the Application Problem: Application is not an Amazon conceptSunday, September 25, 2011
  47. 47. Inventing the Application Problem: Application is not an Amazon concept Solution: Create an Application domain in SimpleDB Enforce naming conventions on Amazon objectsSunday, September 25, 2011
  48. 48. Fast RollbackSunday, September 25, 2011
  49. 49. Fast Rollback Optimism causes outagesSunday, September 25, 2011
  50. 50. Fast Rollback Optimism causes outages Production traffic is uniqueSunday, September 25, 2011
  51. 51. Fast Rollback Optimism causes outages Production traffic is unique Keep old version runningSunday, September 25, 2011
  52. 52. Fast Rollback Optimism causes outages Production traffic is unique Keep old version running Switch traffic to new versionSunday, September 25, 2011
  53. 53. Fast Rollback Optimism causes outages Production traffic is unique Keep old version running Switch traffic to new version Monitor resultsSunday, September 25, 2011
  54. 54. Fast Rollback Optimism causes outages Production traffic is unique Keep old version running Switch traffic to new version Monitor results Revert traffic quicklySunday, September 25, 2011
  55. 55. Fast RollbackSunday, September 25, 2011
  56. 56. Fast Rollback api-frontend api-usprod-v007Sunday, September 25, 2011
  57. 57. Fast Rollback api-frontend api-usprod-v007 api-usprod-v008Sunday, September 25, 2011
  58. 58. Fast Rollback api-frontend api-usprod-v007 api-usprod-v008Sunday, September 25, 2011
  59. 59. Fast Rollback api-frontend api-usprod-v007 api-usprod-v008Sunday, September 25, 2011
  60. 60. Fast Rollback api-frontend api-usprod-v007 api-usprod-v008Sunday, September 25, 2011
  61. 61. Fast Rollback api-frontend api-usprod-v008Sunday, September 25, 2011
  62. 62. Fast RollbackSunday, September 25, 2011
  63. 63. Fast Rollback api-frontend api-usprod-v007Sunday, September 25, 2011
  64. 64. Fast Rollback api-frontend api-usprod-v007 api-usprod-v008Sunday, September 25, 2011
  65. 65. Fast Rollback api-frontend api-usprod-v007 api-usprod-v008Sunday, September 25, 2011
  66. 66. Fast Rollback api-frontend api-usprod-v007 api-usprod-v008Sunday, September 25, 2011
  67. 67. Fast Rollback api-frontend api-usprod-v007Sunday, September 25, 2011
  68. 68. Inventing the ClusterSunday, September 25, 2011
  69. 69. Inventing the Cluster Problem: Two ASGs with one function but different namesSunday, September 25, 2011
  70. 70. Inventing the Cluster Problem: Two ASGs with one function but different names Solution: Append version number in reserved format Parse ASG name to determine long-term “cluster”Sunday, September 25, 2011
  71. 71. Netflix Application ConsoleSunday, September 25, 2011
  72. 72. Netflix Application Console Cloud interfaceSunday, September 25, 2011
  73. 73. Sunday, September 25, 2011
  74. 74. Sunday, September 25, 2011
  75. 75. Sunday, September 25, 2011
  76. 76. Sunday, September 25, 2011
  77. 77. Sunday, September 25, 2011
  78. 78. Sunday, September 25, 2011
  79. 79. Sunday, September 25, 2011
  80. 80. Sunday, September 25, 2011
  81. 81. Sunday, September 25, 2011
  82. 82. Sunday, September 25, 2011
  83. 83. Sunday, September 25, 2011
  84. 84. Sunday, September 25, 2011
  85. 85. Sunday, September 25, 2011
  86. 86. Sunday, September 25, 2011
  87. 87. REST API is easy in GrailsSunday, September 25, 2011
  88. 88. REST API is easy in GrailsSunday, September 25, 2011
  89. 89. REST API is easy in GrailsSunday, September 25, 2011
  90. 90. REST API is easy in Grails ApplicationController.groovySunday, September 25, 2011
  91. 91. Why not the AWS console?Sunday, September 25, 2011
  92. 92. Why not the AWS console? No, not to keep me busySunday, September 25, 2011
  93. 93. Why not the AWS console?Sunday, September 25, 2011
  94. 94. Why not the AWS console?Sunday, September 25, 2011
  95. 95. Why not the AWS console? Hide keysSunday, September 25, 2011
  96. 96. Why not the AWS console? Hide keys Customize modelSunday, September 25, 2011
  97. 97. Why not the AWS console? Hide keys Customize model Automate workflowSunday, September 25, 2011
  98. 98. Why not the AWS console? Hide keys Customize model Automate workflow Enforce conventionsSunday, September 25, 2011
  99. 99. Why not the AWS console? Hide keys Customize model Automate workflow Enforce conventions Log changesSunday, September 25, 2011
  100. 100. Why not the AWS console? Hide keys Customize model Automate workflow Enforce conventions Log changes Integrate systemsSunday, September 25, 2011
  101. 101. Why not the AWS console? Hide keys Customize model Automate workflow Enforce conventions Log changes Integrate systems Create REST APISunday, September 25, 2011
  102. 102. Thank you @joesondow http://www.slideshare.net/joesondowSunday, September 25, 2011
  103. 103. Thank you Questions? @joesondow http://www.slideshare.net/joesondowSunday, September 25, 2011
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×