@JoeSondow
Netflix Open Source Software
Who, what, where, when, why, how
Who am I?
@JoeSondow
Who am I?
@JoeSondow
Who am I?
Joe Sondow
@JoeSondow
Who am I?
Joe Sondow
Netflix since 2010
@JoeSondow
Who am I?
Joe Sondow
Netflix since 2010
Asgard lead
@JoeSondow
Who am I?
Joe Sondow
Netflix since 2010
Asgard lead
Grails
@JoeSondow
Who am I?
Joe Sondow
Netflix since 2010
Asgard lead
Grails
jQuery
@JoeSondow
Open Sourcing Netflix
Software
Open Sourcing Netflix
Software
Give it away, give it away, give it away now
Open Sourcing Netflix Apps
Who
What
Where
When
Why
How
Netflix is the world’s leading Internet television network
with nearly 38 million members in 40 countries enjoying
more tha...
Who
Who
You, maybe?
Who
Who
Platform Infrastructure
Who
Platform Infrastructure
Cloud Database Engineering
Who
Platform Infrastructure
Cloud Database Engineering
Cloud Solutions
Who
Platform Infrastructure
Cloud Database Engineering
Cloud Solutions
Engineering Tools
Who
Platform Infrastructure
Cloud Database Engineering
Cloud Solutions
Engineering Tools
Cloud and Platform Engineering
Who
Platform Infrastructure
Cloud Database Engineering
Cloud Solutions
Engineering Tools
Cloud and Platform Engineering
An...
What
What
Undifferentiated heavy lifting
What
What
What
Infrastructure
What
Infrastructure
Caching
What
Infrastructure
Caching
Database
What
Infrastructure
Caching
Database
Cloud
What
Infrastructure
Caching
Database
Cloud
Building
What
Infrastructure
Caching
Database
Cloud
Building
Deployment
What
Infrastructure
Caching
Database
Cloud
Building
Deployment
Configuration
What
Infrastructure
Caching
Database
Cloud
Building
Deployment
Configuration
Testing
What
Infrastructure
Caching
Database
Cloud
Building
Deployment
Configuration
Testing
Monitoring
What
Infrastructure
Caching
Database
Cloud
Building
Deployment
Configuration
Testing
Monitoring
Networking
What
Infrastructure
Caching
Database
Cloud
Building
Deployment
Configuration
Testing
Monitoring
Networking
Robustness
What
Infrastructure
Caching
Database
Cloud
Building
Deployment
Configuration
Testing
Monitoring
Networking
Robustness
Secur...
Not
Not
Streaming
Encoding
Merchandising
Movie metadata
Recommendations
10’ UI
What
What
If it’s about streaming
video, keep it closed
If it’s about computing,
open source it
When possible, extract
an open ...
Examples
Asgard
Web interface for application deployment and
cloud management in Amazon Web Services
Ice
Bird’s-eye view of AWS usage and cost
Simian Army
Keeps your cloud operating well. Chaos Monkey,
Janitor Monkey, Conformity Monkey…
Hystrix and Turbine
Circuit breakers protect from downstream service
failures, and enable dashboard monitoring
Where
Where
Take a guess
Where
http://netflix.github.io
https://github.com/Netflix
https://netflixoss.ci.cloudbees.com/
http://techblog.netflix.com
htt...
When
When
Soon
When
Average so far: 1.5 new OSS projects per month
AstyanaxServo
Priam
CassJM
eterExhibitor
ArchaiusAsgard
Chaos
M
onkeyE...
When
Monitoring/Graphing
Deployment canary
analyzer
Web notification widget
Asgard client library
Other things getting
drea...
When
Roll-out schedules
Dependencies
Best practices
Tooling
Guest speakers
Legal
Internal OSS meeting every two weeks
Why
Why
Why
Give back to Apache	license OSS community
Why
Give back to Apache	license OSS community
Motivate, retain, hire top engineers (Did I mention…?)
Why
Give back to Apache	license OSS community
Motivate, retain, hire top engineers (Did I mention…?)
“Peer pressure” code ...
Why
Give back to Apache	license OSS community
Motivate, retain, hire top engineers (Did I mention…?)
“Peer pressure” code ...
Why
Give back to Apache	license OSS community
Motivate, retain, hire top engineers (Did I mention…?)
“Peer pressure” code ...
Why
Give back to Apache	license OSS community
Motivate, retain, hire top engineers (Did I mention…?)
“Peer pressure” code ...
Help your career
Help your career
Statistically, you will probably change jobs in <10 years
Help your career
Statistically, you will probably change jobs in <10 years
LinkedIn = resume
Help your career
Statistically, you will probably change jobs in <10 years
LinkedIn = resume
GitHub = portfolio
Help your career
Statistically, you will probably change jobs in <10 years
LinkedIn = resume
GitHub = portfolio
Speak at t...
Help your career
Statistically, you will probably change jobs in <10 years
LinkedIn = resume
GitHub = portfolio
Speak at t...
Help your career
Statistically, you will probably change jobs in <10 years
LinkedIn = resume
GitHub = portfolio
Speak at t...
Help your career
Statistically, you will probably change jobs in <10 years
LinkedIn = resume
GitHub = portfolio
Speak at t...
Why free as in beer?
Why free as in beer?
No significant commitments to external customers
Why free as in beer?
No significant commitments to external customers
Avoid distracting complications of charging money
Why free as in beer?
No significant commitments to external customers
Avoid distracting complications of charging money
Foc...
Why free as in beer?
No significant commitments to external customers
Avoid distracting complications of charging money
Foc...
How
How
How
Internal OSS mailing list
How
Internal OSS mailing list
Edit internal OSS wiki
How
Internal OSS mailing list
Edit internal OSS wiki
Attend OSS meetings
How
Internal OSS mailing list
Edit internal OSS wiki
Attend OSS meetings
Make private GitHub
repo in Netflix org
How
Internal OSS mailing list
Edit internal OSS wiki
Attend OSS meetings
Make private GitHub
repo in Netflix org
Soften dep...
How
Internal OSS mailing list
Edit internal OSS wiki
Attend OSS meetings
Make private GitHub
repo in Netflix org
Soften dep...
How
Internal OSS mailing list
Edit internal OSS wiki
Attend OSS meetings
Make private GitHub
repo in Netflix org
Soften dep...
How
Internal OSS mailing list
Edit internal OSS wiki
Attend OSS meetings
Make private GitHub
repo in Netflix org
Soften dep...
How
Internal OSS mailing list
Edit internal OSS wiki
Attend OSS meetings
Make private GitHub
repo in Netflix org
Soften dep...
How
Internal OSS mailing list
Edit internal OSS wiki
Attend OSS meetings
Make private GitHub
repo in Netflix org
Soften dep...
How
Internal OSS mailing list
Edit internal OSS wiki
Attend OSS meetings
Make private GitHub
repo in Netflix org
Soften dep...
How
Internal OSS mailing list
Edit internal OSS wiki
Attend OSS meetings
Make private GitHub
repo in Netflix org
Soften dep...
How
Internal OSS mailing list
Edit internal OSS wiki
Attend OSS meetings
Make private GitHub
repo in Netflix org
Soften dep...
How
Internal OSS mailing list
Edit internal OSS wiki
Attend OSS meetings
Make private GitHub
repo in Netflix org
Soften dep...
External Config
External Config
Externalize Netflix-specific values
External Config
Externalize Netflix-specific values
Turn off soft dependencies by default
External Config
Externalize Netflix-specific values
Turn off soft dependencies by default
Make extension points for plugins a...
External Config
Externalize Netflix-specific values
Turn off soft dependencies by default
Make extension points for plugins a...
External Config
Externalize Netflix-specific values
Turn off soft dependencies by default
Make extension points for plugins a...
External Config
Externalize Netflix-specific values
Turn off soft dependencies by default
Make extension points for plugins a...
Code Review on GitHub
Code Review on GitHub
Learn Git
Code Review on GitHub
Learn Git
GitHub projects are owned by Netflix on master branch
Code Review on GitHub
Learn Git
GitHub projects are owned by Netflix on master branch
Fork your project
Code Review on GitHub
Learn Git
GitHub projects are owned by Netflix on master branch
Fork your project
Commit into a featu...
Code Review on GitHub
Learn Git
GitHub projects are owned by Netflix on master branch
Fork your project
Commit into a featu...
Code Review on GitHub
Learn Git
GitHub projects are owned by Netflix on master branch
Fork your project
Commit into a featu...
Code Review on GitHub
Learn Git
GitHub projects are owned by Netflix on master branch
Fork your project
Commit into a featu...
Thank you
@JoeSondow
@NetflixOSS
Thank you
Questions?
@JoeSondow
@NetflixOSS
Netflix Open Source Software: Who What Where When Why How
Netflix Open Source Software: Who What Where When Why How
Netflix Open Source Software: Who What Where When Why How
Netflix Open Source Software: Who What Where When Why How
Netflix Open Source Software: Who What Where When Why How
Netflix Open Source Software: Who What Where When Why How
Netflix Open Source Software: Who What Where When Why How
Netflix Open Source Software: Who What Where When Why How
Netflix Open Source Software: Who What Where When Why How
Netflix Open Source Software: Who What Where When Why How
Upcoming SlideShare
Loading in...5
×

Netflix Open Source Software: Who What Where When Why How

6,413

Published on

Since 2011, Netflix has been releasing more and more components of their cloud platform and utilities as free and open source software. This session will answer questions about NetflixOSS, including who makes the software, what does it do, where can you get it and learn about it, when is more coming, why does Netflix do this, and how can you do something like this at your company?

Apple Keynote version with animations:
https://docs.google.com/file/d/0B4baN-arrqbJUHRZbE1HbmQ3azA/edit?usp=sharing

Published in: Technology
1 Comment
4 Likes
Statistics
Notes
  • Netflix opensource tools come in more handy when classified on the basis of application. they are even powerful when used together and the list goes long on the broader classification of Availability, Cloud Management, Big Data, persistence to Build and Deploy. (Netflix opensource tools glossary http://flux7.com/blogs/tag/netflix/ )
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total Views
6,413
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
141
Comments
1
Likes
4
Embeds 0
No embeds

No notes for slide

Netflix Open Source Software: Who What Where When Why How

  1. 1. @JoeSondow Netflix Open Source Software Who, what, where, when, why, how
  2. 2. Who am I? @JoeSondow
  3. 3. Who am I? @JoeSondow
  4. 4. Who am I? Joe Sondow @JoeSondow
  5. 5. Who am I? Joe Sondow Netflix since 2010 @JoeSondow
  6. 6. Who am I? Joe Sondow Netflix since 2010 Asgard lead @JoeSondow
  7. 7. Who am I? Joe Sondow Netflix since 2010 Asgard lead Grails @JoeSondow
  8. 8. Who am I? Joe Sondow Netflix since 2010 Asgard lead Grails jQuery @JoeSondow
  9. 9. Open Sourcing Netflix Software
  10. 10. Open Sourcing Netflix Software Give it away, give it away, give it away now
  11. 11. Open Sourcing Netflix Apps Who What Where When Why How
  12. 12. Netflix is the world’s leading Internet television network with nearly 38 million members in 40 countries enjoying more than one billion hours of TV shows and movies per month, including original series. (from http://ir.netflix.com)
  13. 13. Who
  14. 14. Who You, maybe?
  15. 15. Who
  16. 16. Who Platform Infrastructure
  17. 17. Who Platform Infrastructure Cloud Database Engineering
  18. 18. Who Platform Infrastructure Cloud Database Engineering Cloud Solutions
  19. 19. Who Platform Infrastructure Cloud Database Engineering Cloud Solutions Engineering Tools
  20. 20. Who Platform Infrastructure Cloud Database Engineering Cloud Solutions Engineering Tools Cloud and Platform Engineering
  21. 21. Who Platform Infrastructure Cloud Database Engineering Cloud Solutions Engineering Tools Cloud and Platform Engineering Anyone with code that’s not a competitive advantage
  22. 22. What
  23. 23. What Undifferentiated heavy lifting
  24. 24. What
  25. 25. What
  26. 26. What Infrastructure
  27. 27. What Infrastructure Caching
  28. 28. What Infrastructure Caching Database
  29. 29. What Infrastructure Caching Database Cloud
  30. 30. What Infrastructure Caching Database Cloud Building
  31. 31. What Infrastructure Caching Database Cloud Building Deployment
  32. 32. What Infrastructure Caching Database Cloud Building Deployment Configuration
  33. 33. What Infrastructure Caching Database Cloud Building Deployment Configuration Testing
  34. 34. What Infrastructure Caching Database Cloud Building Deployment Configuration Testing Monitoring
  35. 35. What Infrastructure Caching Database Cloud Building Deployment Configuration Testing Monitoring Networking
  36. 36. What Infrastructure Caching Database Cloud Building Deployment Configuration Testing Monitoring Networking Robustness
  37. 37. What Infrastructure Caching Database Cloud Building Deployment Configuration Testing Monitoring Networking Robustness Security
  38. 38. Not
  39. 39. Not Streaming Encoding Merchandising Movie metadata Recommendations 10’ UI
  40. 40. What
  41. 41. What If it’s about streaming video, keep it closed If it’s about computing, open source it When possible, extract an open computation system from a closed Netflix system Be pragmatic
  42. 42. Examples
  43. 43. Asgard Web interface for application deployment and cloud management in Amazon Web Services
  44. 44. Ice Bird’s-eye view of AWS usage and cost
  45. 45. Simian Army Keeps your cloud operating well. Chaos Monkey, Janitor Monkey, Conformity Monkey…
  46. 46. Hystrix and Turbine Circuit breakers protect from downstream service failures, and enable dashboard monitoring
  47. 47. Where
  48. 48. Where Take a guess
  49. 49. Where http://netflix.github.io https://github.com/Netflix https://netflixoss.ci.cloudbees.com/ http://techblog.netflix.com https://twitter.com/NetflixOSS http://meetup.com/Netflix-Open-Source-Platform/ https://youtube.com/NetflixOpenSource
  50. 50. When
  51. 51. When Soon
  52. 52. When Average so far: 1.5 new OSS projects per month AstyanaxServo Priam CassJM eterExhibitor ArchaiusAsgard Chaos M onkeyEureka G overnator EddaBlitz4j Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec 2012 HystrixTurbine Ribbon NetflixG raph JanitorM onkey EVCache RxJavaKaryon Denom inator RSS Reader Conform ity M onkey gcviz Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec 2013 Isthm us Pytheas Curator Nov Dec 2011 G enie NfW ebCrypto G listen Ice Zuul Am inator Lipstick
  53. 53. When Monitoring/Graphing Deployment canary analyzer Web notification widget Asgard client library Other things getting dreamed up Future Possibilities
  54. 54. When Roll-out schedules Dependencies Best practices Tooling Guest speakers Legal Internal OSS meeting every two weeks
  55. 55. Why
  56. 56. Why
  57. 57. Why Give back to Apache license OSS community
  58. 58. Why Give back to Apache license OSS community Motivate, retain, hire top engineers (Did I mention…?)
  59. 59. Why Give back to Apache license OSS community Motivate, retain, hire top engineers (Did I mention…?) “Peer pressure” code clean up & documentation
  60. 60. Why Give back to Apache license OSS community Motivate, retain, hire top engineers (Did I mention…?) “Peer pressure” code clean up & documentation External contributions
  61. 61. Why Give back to Apache license OSS community Motivate, retain, hire top engineers (Did I mention…?) “Peer pressure” code clean up & documentation External contributions Good public relations, more good, less evil
  62. 62. Why Give back to Apache license OSS community Motivate, retain, hire top engineers (Did I mention…?) “Peer pressure” code clean up & documentation External contributions Good public relations, more good, less evil Make Netflix solutions into common standards
  63. 63. Help your career
  64. 64. Help your career Statistically, you will probably change jobs in <10 years
  65. 65. Help your career Statistically, you will probably change jobs in <10 years LinkedIn = resume
  66. 66. Help your career Statistically, you will probably change jobs in <10 years LinkedIn = resume GitHub = portfolio
  67. 67. Help your career Statistically, you will probably change jobs in <10 years LinkedIn = resume GitHub = portfolio Speak at tech events
  68. 68. Help your career Statistically, you will probably change jobs in <10 years LinkedIn = resume GitHub = portfolio Speak at tech events Write blog posts
  69. 69. Help your career Statistically, you will probably change jobs in <10 years LinkedIn = resume GitHub = portfolio Speak at tech events Write blog posts Tweet
  70. 70. Help your career Statistically, you will probably change jobs in <10 years LinkedIn = resume GitHub = portfolio Speak at tech events Write blog posts Tweet Be googleable
  71. 71. Why free as in beer?
  72. 72. Why free as in beer? No significant commitments to external customers
  73. 73. Why free as in beer? No significant commitments to external customers Avoid distracting complications of charging money
  74. 74. Why free as in beer? No significant commitments to external customers Avoid distracting complications of charging money Focus on accomplishing the company’s mission
  75. 75. Why free as in beer? No significant commitments to external customers Avoid distracting complications of charging money Focus on accomplishing the company’s mission The benefits of free exceed the benefits of charging
  76. 76. How
  77. 77. How
  78. 78. How Internal OSS mailing list
  79. 79. How Internal OSS mailing list Edit internal OSS wiki
  80. 80. How Internal OSS mailing list Edit internal OSS wiki Attend OSS meetings
  81. 81. How Internal OSS mailing list Edit internal OSS wiki Attend OSS meetings Make private GitHub repo in Netflix org
  82. 82. How Internal OSS mailing list Edit internal OSS wiki Attend OSS meetings Make private GitHub repo in Netflix org Soften dependencies
  83. 83. How Internal OSS mailing list Edit internal OSS wiki Attend OSS meetings Make private GitHub repo in Netflix org Soften dependencies Externalize configuration
  84. 84. How Internal OSS mailing list Edit internal OSS wiki Attend OSS meetings Make private GitHub repo in Netflix org Soften dependencies Externalize configuration Clean up
  85. 85. How Internal OSS mailing list Edit internal OSS wiki Attend OSS meetings Make private GitHub repo in Netflix org Soften dependencies Externalize configuration Clean up Document
  86. 86. How Internal OSS mailing list Edit internal OSS wiki Attend OSS meetings Make private GitHub repo in Netflix org Soften dependencies Externalize configuration Clean up Document Licensing and attribution
  87. 87. How Internal OSS mailing list Edit internal OSS wiki Attend OSS meetings Make private GitHub repo in Netflix org Soften dependencies Externalize configuration Clean up Document Licensing and attribution Remove infringement
  88. 88. How Internal OSS mailing list Edit internal OSS wiki Attend OSS meetings Make private GitHub repo in Netflix org Soften dependencies Externalize configuration Clean up Document Licensing and attribution Remove infringement Write tech blog post
  89. 89. How Internal OSS mailing list Edit internal OSS wiki Attend OSS meetings Make private GitHub repo in Netflix org Soften dependencies Externalize configuration Clean up Document Licensing and attribution Remove infringement Write tech blog post Make repo public
  90. 90. How Internal OSS mailing list Edit internal OSS wiki Attend OSS meetings Make private GitHub repo in Netflix org Soften dependencies Externalize configuration Clean up Document Licensing and attribution Remove infringement Write tech blog post Make repo public Tweet on @NetflixOSS
  91. 91. How Internal OSS mailing list Edit internal OSS wiki Attend OSS meetings Make private GitHub repo in Netflix org Soften dependencies Externalize configuration Clean up Document Licensing and attribution Remove infringement Write tech blog post Make repo public Tweet on @NetflixOSS Support the community
  92. 92. External Config
  93. 93. External Config Externalize Netflix-specific values
  94. 94. External Config Externalize Netflix-specific values Turn off soft dependencies by default
  95. 95. External Config Externalize Netflix-specific values Turn off soft dependencies by default Make extension points for plugins as needed
  96. 96. External Config Externalize Netflix-specific values Turn off soft dependencies by default Make extension points for plugins as needed Put Netflix config in internal SCM (Perforce or Atlassian Stash)
  97. 97. External Config Externalize Netflix-specific values Turn off soft dependencies by default Make extension points for plugins as needed Put Netflix config in internal SCM (Perforce or Atlassian Stash) Jenkins build for open release
  98. 98. External Config Externalize Netflix-specific values Turn off soft dependencies by default Make extension points for plugins as needed Put Netflix config in internal SCM (Perforce or Atlassian Stash) Jenkins build for open release Jenkins build for Netflix release
  99. 99. Code Review on GitHub
  100. 100. Code Review on GitHub Learn Git
  101. 101. Code Review on GitHub Learn Git GitHub projects are owned by Netflix on master branch
  102. 102. Code Review on GitHub Learn Git GitHub projects are owned by Netflix on master branch Fork your project
  103. 103. Code Review on GitHub Learn Git GitHub projects are owned by Netflix on master branch Fork your project Commit into a feature branch
  104. 104. Code Review on GitHub Learn Git GitHub projects are owned by Netflix on master branch Fork your project Commit into a feature branch Push commits to your fork
  105. 105. Code Review on GitHub Learn Git GitHub projects are owned by Netflix on master branch Fork your project Commit into a feature branch Push commits to your fork Create a pull request
  106. 106. Code Review on GitHub Learn Git GitHub projects are owned by Netflix on master branch Fork your project Commit into a feature branch Push commits to your fork Create a pull request Get comments, add commits
  107. 107. Thank you @JoeSondow @NetflixOSS
  108. 108. Thank you Questions? @JoeSondow @NetflixOSS
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×