Download as PDF, PPTX
More Related Content
Mesos at OpenTable
- 1. MESOS @ Feedback/questions@samsalisbury
- 2. WHO AM I? • Engineer at OpenTable for 1 year • New to Mesos • Mostly working in Go • @samsalisbury on twitter/github
- 3.
- 4.
- 5. ! +Canada " +Mexico # $
- 7. A HUGE ASP.NETAPP Prior to 2012
- 8. VM A HUGEASP.NET APP Prior to 2012
- 9. DATACENTRE VM AHUGE ASP.NET APP VM A HUGE ASP.NET APP VM A HUGE ASP.NET APP VM A HUGE ASP.NET APP Prior to 2012
- 10. DATACENTRE VM AHUGE ASP.NET APP VM A HUGE ASP.NET APP VM A HUGE ASP.NET APP VM A HUGE ASP.NET APP Prior to 2012
- 11. DATACENTRE VM AHUGE ASP.NET APP VM A HUGE ASP.NET APP VM A HUGE ASP.NET APP VM A HUGE ASP.NET APP VM A HUGE ASP.NET APP VM A HUGE ASP.NET APP VM A HUGE ASP.NET APP VM A HUGE ASP.NET PriorA tPoP 2012
- 12. DATACENTRE “Fortnightly” VM big VM bang deployments. VM A HUGE A HUGE A HUGE Tech ASP.constrained NET ASP.NET ASP.NET APP APP to single APP platform. One VM defect blocks VM all progress. VM A HUGE A HUGE A HUGE Difficult ASP.NET to experiment ASP.NET with ASP.NET APP APP APP features. VM A HUGE ASP.NET APP Not much fun. VM A HUGE ASP.NET APP
- 13. DATACENTRE “Fortnightly” VM VM release cycle. VM A HUGE A HUGE A HUGE ASP.Big NET bang ASP.deployments. NET ASP.NET APP APP APP One VM defect blocks VM all progress. VM A HUGE A HUGE A HUGE Difficult ASP.NET to experiment ASP.NET with ASP.NET APP APP APP features. VM A HUGE ASP.NET APP Not much fun. VM A HUGE ASP.NET APP Early 2012
- 14. SOA all thethings!
- 15. CODE BASE AHUGE ASP.NET APP Prior to 2012
- 16. CODE BASE EXTERNAL API SEARCH REVIEWS EMAILS WHITE LABEL REST. PROFILES RESERV-ATION API PHOTO SERVICE REST. A P I PERSON API HOME PAGE WIDGETS CONTENT F RONT SERVICE DOOR SVC MENU AP I FEEDBACK AVAI LAB-I LEGACY FORM L I T Y A P I API Now
- 17. CODE BASE ReleaseEXTERNAL whenever API SEARCH a feature REVIEWS is ready. Use whatever EMAILS tech WHITE REST. LABEL is most PROFILES appropriate. RESERV-ATION PHOTO No one API defect SERVICE blocks all REST. progress. A P I PERSON HOME Easy API to experiment PAGE with WIDGETS features. CONTENT F RONT SERVICE DOOR MENU AP I Much more SVC fun! FEEDBACK AVAI LAB-I LEGACY FORM L I T Y A P I API Now
- 18. CODE BASE EXTERNAL API SEARCH REVIEWS EMAILS WHITE LABEL REST. PROFILES RESERV-ATION API PHOTO SERVICE REST. A P I PERSON API However. HOME PAGE WIDGETS CONTENT F RONT SERVICE DOOR SVC MENU AP I FEEDBACK AVAI LAB-I LEGACY FORM L I T Y A P I API Now
- 19. DATACENTRE VM EXTERNAL API VM SEARCH VM REVIEWS VM EMAILS VM RESERVAT-ION API VM VM WHITE LABEL VM REST. PROFILES VM PHOTO SERVICE VM REST. A P I VM VM
- 20. DATACENTRE VM EXTERNAL API VM SEARCH VM REVIEWS VM EMAILS VM RESERVAT-ION API VM VM WHITE LABEL VM REST. PROFILES VM PHOTO SERVICE VM REST. A P I VM VM
- 21. DATACENTRE VM SEARCH VVMM VVMM VVMM VM REVIEWS VM EMAILS VVMM VVMM RESERVAT-ION API VVMM VVMM WHITE LABEL VVMM VVMM REST. PROFILES VVMM VVMM PHOTO SERVICE VM REST. A P I VM EXTERNAL API
- 22. DATACENTRE VM SEARCH VVMM VVMM VVMM VM REVIEWS VM EMAILS VVMM VVMM RESERVAT-ION API VVMM VVMM WHITE LABEL VVMM VVMM REST. PROFILES VVMM VVMM PHOTO SERVICE VM REST. A P I VM EXTERNAL API 1,231 servers, and rising (source: Puppetboard)
- 23. DATACENTRE VM SEARCH VVMM VVMM VVMM VM REVIEWS VM EMAILS VVMM VVMM RESERVAT-ION API VVMM VVMM WHITE LABEL VVMM VVMM REST. PROFILES VVMM VVMM PHOTO SERVICE VM REST. A P I VM EXTERNAL API 1,231 servers, and rising (source: Puppetboard) This is expensive.
- 24. DATACENTRE VM SEARCH VVMM VVMM VVMM VM REVIEWS VM EMAILS VVMM VVMM RESERVAT-ION API VVMM VVMM WHITE LABEL VVMM VVMM REST. PROFILES VVMM VVMM PHOTO SERVICE VM REST. A P I VM EXTERNAL API 1,231 servers, and rising (source: Puppetboard) This is expensive. And hard to manage.
- 25. DATACENTRE VM SEARCH VVMM VVMM VVMM VM REVIEWS VM EMAILS VVMM VVMM RESERVAT-ION API VVMM VVMM WHITE LABEL VVMM VVMM REST. PROFILES VVMM VVMM PHOTO SERVICE VM REST. A P I VM EXTERNAL API WDWDN?
- 26. Puppetise all thethings! everything. Mid 2013
- 27.
- 28. Puppetise everything. Thishelped a lot. Mid 2013
- 29. Puppetise everything. Thishelped a lot. However… Mid 2013
- 30. Puppetise everything. Infrastructurestill very complex. And expensive.
- 31.
- 32.
- 33. AWS US ProdEU Prod QA Now
- 34. MARATHON CHRONOS SPARK SINGULARITY
- 35. MARATHON DISCOVERY OAUTH SERVER RESTAURANT REPORTING AVAI LABI L ITY COMPONENTS NEW BLOG MENU API … https://github.com/mesosphere/marathon
- 36. CHRONOS UPDATING PERSISTENTCACHES COORDINATING LARGE INTERDEPENDENT DATA PROCESSING JOBS https://github.com/airbnb/chronos
- 38. SPARK DATA SCIENCEMAGIC http://spark.apache.org
- 39.
- 40. Mesos seems reallycool so far.
- 41. Of course, nowwe have a new set of problems.
- 42. Where is myapp running?!
- 43. Where is myapp running?! There are 2 basic approaches to this problem.
- 44.
- 45. DISCOVERY SERVER (USESETCD) APP 1 APP 2 APP 3 Announce Announce Announce State State State Data Data Data
- 46.
- 47.
- 48. Enter Mesoshub… Aweb UI over HAProxy. Integrated with Marathon. https://github.com/opentable/mesoshub
- 49. MESOSHUB (USES HAPROXY) APP 1 APP 2 APP 3 Data Data Data http://app1.ot.com http://app2.ot.com http://app3.ot.com Data Data Data
- 50. Enter Mesoshub… Mesoshubis open source. We would love contributions! https://github.com/opentable/mesoshub
- 51. Use both togetherfor maximum flexibility!
- 52.
- 53. + = ? Configuring Mesos clusters with Puppet?
- 54.
- 55.