Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Containers at Netflix - An Evolving Story Sangeeta Narayanan Engineering Manager @Netflix @sangeetan
InfoQ.com: News & Community Site • 750,000 unique visitors/month • Published in 4 languages (English, Chinese, Japanese an...
Purpose of QCon - to empower software development by facilitating the spread of knowledge and innovation Strategy - practi...
Going Global Recent Launches: Italy, Spain, Portugal Early 2016: Korea, Hong Kong, Taiwan, Singapore
Growing BIGGER
Winning Moments of Truth
Getting BETTER
Jan Apr Jul O ct 2015
Jan Apr Jul O ct 2015
Jan Apr Jul O ct 2015 A/B Tests New features
Jan Apr Jul O ct 2015 A/B Tests New features Device Launches
Going FASTER
Cloud Native Architecture
Automation & Tooling
Culture
New Considerations Diversity - Users, Tech stacks, Workloads Dev Ex - Dev iterations, Debugging, Packaging Rapid Delivery ...
Dev-centric packaging & reproducibility Infrastructure abstraction Faster dev iterations Resource sharing Why Docker?
Docker @Netflix - Use Cases Algorithms Engineering Data Pipeline Edge Engineering
Docker @Netflix - Use Cases Algorithms Engineering Data Pipeline Edge Engineering
Algorithms Engineering R&D of algorithmic components for product
Precompute Online Services Model Trainer New data available
Infrastructure abstraction Polyglot support & Local Dev Ex Dynamic resource allocation & distributed job scheduling Requir...
Model Trainer Online Services Precompute New data available Distributed scheduler +
Distributed Scheduling & Task Management Model Trainer Spinnaker Other Apps Fenzo
Infrastructure abstraction Polyglot + Local Dev Distributed Scheduling Num of Containers
Docker @Netflix - Use Cases Algorithms Engineering Data Pipeline Edge Engineering
Data Pipeline Publish, Collect, Process, Move Data
Local Dev Ex Infrastructure abstraction Fine-grained resource management Requirements
Job
Infrastructure abstraction Local Dev Ex Fine grained resource Management Num of Containers
Docker @Netflix - Use Cases Algorithms Engineering Data Pipeline Edge Engineering
Edge Engineering Entry point to Netflix for all device traffic
Automation & Tools
Automation & Tools Node.js Html, JS
Infrastructure abstraction Local dev, Polyglot - Java, Groovy, Node.js Fine-grained resource management Requirements
Ops Tooling Networking, IPC Security Insights Failure Testing Performance And more… Requirements++ Long running Services v...
Ops Tooling Networking, IPC Security Insights Failure Testing Performance And more… Requirements++ Long running Services v...
Local Dev Test/ Debug Open PR CI Build/Test AMI Bakery Deploy Spinnaker Dist Job Sched
Gradle docker plugin to generate Dockerfile Spinnaker CloudProvider provides abstraction Bakery support for image generatio...
Dev Ex Wins Faster dev iterations Run prod image locally; attach debugger Multiple branch/config variations Hot reloading o...
ONNot There Yet!
‘PaaS-like' Dev Experience Production scale/Operational readiness Optimized resource utilization
Infrastructure Abstraction Dev Ex Production ready Online Services Polyglot env, Packaging
Thank You @sangeetan
The Netflix Algorithms Engineering & Data Pipeline teams Acknowledgements Photo Creditshttps://goo.gl/sP5T4X https://goo.g...
Watch the video with slide synchronization on InfoQ.com! http://www.infoq.com/presentations/netflix- containers
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Containers at Netflx - An Evolving Story
Upcoming SlideShare
Loading in …5
×

Containers at Netflx - An Evolving Story

15,889 views

Published on

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1Rz8Uys.

Sangeeta Narayanan looks at the role of containers in simplifying and increasing the reliability of the process of releasing and operating the Netflix software. Filmed at qconsf.com.

Sangeeta Narayanan leads the Edge Infrastructure & Delivery team at Netflix. Among other things, her team develops the infrastructure that enables the Netflix API service to be updated on-demand, without adversely impacting the user experience for millions of customers worldwide. Sangeeta has held different roles at various software companies, large and small.

Published in: Software, Technology
no profile picture user
  • Work at home: https://saidbenrida.blogspot.com/ https://saidbenrida-best.blogspot.com/ https://saidbenrida-opp.blogspot.com/ https://saidbenrida-recommended.blogspot.com/ https://saidbenrida-trusted.blogspot.com/ https://trusted-saidbenrida.blogspot.com/ http://www.saidbenrida.ws/ https://ewallet-worldwide.tumblr.com/ https://concsaid.blogspot.com/ https://copsaid.blogspot.com/ https://domasaid.blogspot.com/ https://hostsaid.blogspot.com/ https://paysaid.blogspot.com/ https://wsmoney.blogspot.com/
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • my neighbor's ex wife makes 75 each hour on the internet, she's been out of work for 4 months.. last month her payment was 16673 just working on the internet a few hours every week, check this....................................................................................www.Work75.com
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • I've just forwarded you an email I received from Bet365 moments ago saying they're limiting my➤➤ http://t.cn/A6vAxKsh
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Start working at home with Google! Just work for few hours and have more time with friends and family. I earn up to $4500 per week. It's a great work at home opportunity. I can't believe how easy it was once I tried it out........................................................................................................................ ..................................................................................................................................................... Visit for more details☛☛☛☛☛☛☛ https://bit.ly/2Tg9Yk9 ...................................................................................................................................... Visit for more details☛☛☛☛☛☛☛ https://bit.ly/2Tg9Yk9 ...................................................................................................................................... Visit for more details☛☛☛☛☛☛☛ https://bit.ly/2Tg9Yk9 ...................................................................................................................................... Visit for more details☛☛☛☛☛☛☛ https://bit.ly/2Tg9Yk9 ...................................................................................................................................... Visit for more details☛☛☛☛☛☛☛ https://bit.ly/2Tg9Yk9 ...................................................................................................................................... Visit for more details☛☛☛☛☛☛☛ https://bit.ly/2Tg9Yk9 ......................................................................................................................... ......................................................................................................................... ...................................................................................................................................
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • What if you had a printing press that could spit out hundred dollar bills on demand? Do you think that would change your life? ▲▲▲ http://t.cn/AisJWzdm
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
Show More
Show More

Containers at Netflx - An Evolving Story

  1. 1. Containers at Netflix - An Evolving Story Sangeeta Narayanan Engineering Manager @Netflix @sangeetan
  2. 2. InfoQ.com: News & Community Site • 750,000 unique visitors/month • Published in 4 languages (English, Chinese, Japanese and Brazilian Portuguese) • Post content from our QCon conferences • News 15-20 / week • Articles 3-4 / week • Presentations (videos) 12-15 / week • Interviews 2-3 / week • Books 1 / month Watch the video with slide synchronization on InfoQ.com! http://www.infoq.com/presentations /netflix-containers
  3. 3. Purpose of QCon - to empower software development by facilitating the spread of knowledge and innovation Strategy - practitioner-driven conference designed for YOU: influencers of change and innovation in your teams - speakers and topics driving the evolution and innovation - connecting and catalyzing the influencers and innovators Highlights - attended by more than 12,000 delegates since 2007 - held in 9 cities worldwide Presented at QCon San Francisco www.qconsf.com
  4. 4. Going Global Recent Launches: Italy, Spain, Portugal Early 2016: Korea, Hong Kong, Taiwan, Singapore
  5. 5. Growing BIGGER
  6. 6. Winning Moments of Truth
  7. 7. Getting BETTER
  8. 8. Jan Apr Jul O ct 2015
  9. 9. Jan Apr Jul O ct 2015
  10. 10. Jan Apr Jul O ct 2015 A/B Tests New features
  11. 11. Jan Apr Jul O ct 2015 A/B Tests New features Device Launches
  12. 12. Going FASTER
  13. 13. Cloud Native Architecture
  14. 14. Automation & Tooling
  15. 15. Culture
  16. 16. New Considerations Diversity - Users, Tech stacks, Workloads Dev Ex - Dev iterations, Debugging, Packaging Rapid Delivery Resource Sharing
  17. 17. Dev-centric packaging & reproducibility Infrastructure abstraction Faster dev iterations Resource sharing Why Docker?
  18. 18. Docker @Netflix - Use Cases Algorithms Engineering Data Pipeline Edge Engineering
  19. 19. Docker @Netflix - Use Cases Algorithms Engineering Data Pipeline Edge Engineering
  20. 20. Algorithms Engineering R&D of algorithmic components for product
  21. 21. Precompute Online Services Model Trainer New data available
  22. 22. Infrastructure abstraction Polyglot support & Local Dev Ex Dynamic resource allocation & distributed job scheduling Requirements
  23. 23. Model Trainer Online Services Precompute New data available Distributed scheduler +
  24. 24. Distributed Scheduling & Task Management Model Trainer Spinnaker Other Apps Fenzo
  25. 25. Infrastructure abstraction Polyglot + Local Dev Distributed Scheduling Num of Containers
  26. 26. Docker @Netflix - Use Cases Algorithms Engineering Data Pipeline Edge Engineering
  27. 27. Data Pipeline Publish, Collect, Process, Move Data
  28. 28. Local Dev Ex Infrastructure abstraction Fine-grained resource management Requirements
  29. 29. Job
  30. 30. Infrastructure abstraction Local Dev Ex Fine grained resource Management Num of Containers
  31. 31. Docker @Netflix - Use Cases Algorithms Engineering Data Pipeline Edge Engineering
  32. 32. Edge Engineering Entry point to Netflix for all device traffic
  33. 33. Automation & Tools
  34. 34. Automation & Tools Node.js Html, JS
  35. 35. Infrastructure abstraction Local dev, Polyglot - Java, Groovy, Node.js Fine-grained resource management Requirements
  36. 36. Ops Tooling Networking, IPC Security Insights Failure Testing Performance And more… Requirements++ Long running Services vs. Batch Jobs
  37. 37. Ops Tooling Networking, IPC Security Insights Failure Testing Performance And more… Requirements++ Long running Services vs. Batch Jobs
  38. 38. Local Dev Test/ Debug Open PR CI Build/Test AMI Bakery Deploy Spinnaker Dist Job Sched
  39. 39. Gradle docker plugin to generate Dockerfile Spinnaker CloudProvider provides abstraction Bakery support for image generation Docker registry for internal images libnetwork plugin for addressable IP Building out the pieces
  40. 40. Dev Ex Wins Faster dev iterations Run prod image locally; attach debugger Multiple branch/config variations Hot reloading of files ‘Roman Riding’ with AMIs
  41. 41. ONNot There Yet!
  42. 42. ‘PaaS-like' Dev Experience Production scale/Operational readiness Optimized resource utilization
  43. 43. Infrastructure Abstraction Dev Ex Production ready Online Services Polyglot env, Packaging
  44. 44. Thank You @sangeetan
  45. 45. The Netflix Algorithms Engineering & Data Pipeline teams Acknowledgements Photo Creditshttps://goo.gl/sP5T4X https://goo.gl/JaNlyf https://goo.gl/rZXws1 http://goo.gl/V4UFmR https://goo.gl/R08GPQ http://tastyk.deviantart.com/art/Evolution-149719618 https://goo.gl/W2UKv0 https://goo.gl/fRcpPN https://goo.gl/tF199H https://goo.gl/K1OH9T wildflowers https://goo.gl/KSaL5s roadmap https://goo.gl/8JCDQy odometer https://goo.gl/c4RuSR takeaway box
  46. 46. Watch the video with slide synchronization on InfoQ.com! http://www.infoq.com/presentations/netflix- containers

×