Download as PDF, PPTX
Uploaded bySteve Hoffman
Enabling Microservices @Orbitz - DockerCon 2015
The document details Orbitz's transition from a monolithic architecture to microservices using Docker, highlighting the automation of deployment pipelines and various techniques for continuous delivery. Key aspects involve the use of multiple sub-services, a shared deployment platform, and a focus on taking humans out of the release process for efficiency. It concludes by outlining configuration management strategies to accommodate changes and external dependencies.
More Related Content
Similar to Enabling Microservices @Orbitz - DockerCon 2015
Enabling Microservices @Orbitz - DockerCon 2015
- 1. Enabling Microservices @Orbitz SteveHoffman @bacoboy Rick Fast @tortiepoint Senior Principal Engineers
- 5. Agenda • Brief ArchitectureOverview/History • From Monolithic to Services to Microservices with Docker • Automated Pipelines • Questions
- 6.
- 7.
- 8. #dockercon 2000 Yes, we areSTILL hiring!
- 9. #dockercon 2000 Yes, we areSTILL hiring! @OrbitzTalent
- 10.
- 11.
- 12.
- 13.
- 14.
- 15.
- 16.
- 17.
- 18.
- 19.
- 20.
- 21.
- 22.
- 23.
- 24.
- 25. #dockercon 2012 • Multiple Brands •Websites • Webservices • Multiple Backends • 500+ apps / thousands of instances • Deployments Daily (sometimes more)
- 26. #dockercon • Multiple Brands •Websites • Webservices • Multiple Backends • 500+ apps / thousands of instances • Deployments Daily (sometimes more) 2015
- 27.
- 28.
- 29. #dockercon Different Provisioning Tools DEVOPS Application Platform!=
- 30. #dockercon A New Experiment •Microservices? • Decompose single “service” into the actual 40+ sub-services - Any change to sub-service was a deployment of many • Could it be a simple Spring Boot App in Docker (12 factor?) • Backward compatible with existing service infrastructure. • Code to Production w/o help from other Humans
- 31. #dockercon The Docker Slave aka“The Rickbot”
- 32. #dockercon The Docker Slave aka“The Rickbot” App App App
- 33.
- 34.
- 35.
- 36.
- 37.
- 38.
- 39.
- 40.
- 41.
- 42.
- 43.
- 44.
- 45.
- 46.
- 47.
- 48.
- 49.
- 50.
- 51.
- 52.
- 53.
- 54.
- 55.
- 56.
- 57.
- 58.
- 59.
- 60.
- 61.
- 62.
- 63.
- 64.
- 65.
- 66. A Little MoreBackground
- 67.
- 68.
- 69. #dockercon Editorial Module • AContinuously Deployed Microservice • www.orbitz.com - (scroll down)
- 70.
- 71.
- 72.
- 73.
- 74. #dockercon Pre-Continuous Delivery 1.2-‐BETA-‐20150401-‐113002 Test Discard TestDiscard 1.2-‐BETA-‐20150402-‐093002 Build Build And so on…
- 75. #dockercon Pre-Continuous Delivery 1.2-‐BETA-‐20150401-‐113002 Test Discard TestDiscard 1.2-‐BETA-‐20150402-‐093002 Build Build Test Deploy 1.2 Build
- 76. Continuous Delivery withJenkins, Docker, and Ansible (And then Marathon)
- 77. #dockercon Yo rfast-mbp:git rfast$ yomicroservice _-----_ | | .--------------------------. |--(o)--| | Welcome to the kickass | `---------´ | Microservice | ( _´U`_ ) | generator! | /___A___ '--------------------------' | ~ | __'.___.'__ ´ ` |° ´ Y ` ? Enter the name of your service. (E.G. "my-service")
- 78.
- 79.
- 80.
- 81.
- 82.
- 83.
- 84.
- 85.
- 86. #dockercon Build if(…) { x ++; } 1.2 Merge 1.2. editorial-module.jar ./gradlewbuild {BUILD_NUMBER}
- 87.
- 88. #dockercon Build 1.2 Merge editorial-module.jar FROM orbitz/java-8 ADD build/editorial-module.jar/opt/orbitz CWD /opt/orbitz CMD java -jar editorial-module.jar if(…) { x ++; } 171.2.
- 89.
- 90.
- 91. #dockercon Deploy - hosts: dev -tasks: - name: find previous images docker_facts: image=orbitz/{{application}} register: previous - name: deploy new image docker: image=orbitz/{{application}}:{{version}} … - name: wait for service wait_for: port={{port}} … - name: check health endpoint uri: url="http://{{fqdn}}:{{port}}/health" … - name: kill old image docker: {{previous}} git pull playbook.yml (abridged)
- 92. #dockercon host-001 host-002 host-003host-004 host-005 - hosts: dev
- 93.
- 94.
- 95.
- 96.
- 97.
- 98.
- 99.
- 100.
- 101.
- 102. #dockercon How to handlefailure?
- 103. #dockercon What happens whena VM is moved?
- 104. #dockercon What if Ineed to add capacity?
- 105. #dockercon Deploy (Second Attempt) -hosts: dev - tasks: - name: find previous images docker_facts: image=orbitz/{{application}} register: previous - name: deploy new image docker: image=orbitz/{{application}}:{{version}} … - name: wait for service wait_for: port={{port}} … - name: check health endpoint uri: url="http://{{fqdn}}:{{port}}/health" … - name: kill old image docker: {{previous}} git pull playbook.yml (abridged)
- 106. #dockercon Deploy (Second Attempt) -hosts: dev - tasks: - name: find previous images docker_facts: image=orbitz/{{application}} register: previous - name: deploy new image docker: image=orbitz/{{application}}:{{version}} … - name: wait for service wait_for: port={{port}} … - name: check health endpoint uri: url="http://{{fqdn}}:{{port}}/health" … - name: kill old image git pull playbook.yml (abridged) - hosts: localhost - tasks: - name: marathon deploy marathon: image=orbitz/{{application}}:{{version}} instances=3
- 107. #dockercon Deploy (Second Attempt) gitpull playbook.yml (abridged) - hosts: localhost - tasks: - name: marathon deploy marathon: image=orbitz/{{application}}:{{version}} instances=3
- 108. #dockercon Deploy (Second Attempt) Newhost setup
- 109. #dockercon Deploy (Second Attempt) MesosAgent New host setup 1.2.16
- 110. #dockercon Deploy (Second Attempt) -tasks: marathon: … playbook.yml 1.2.16 1.2.16 1.2.16
- 111. #dockercon Deploy (Second Attempt) -tasks: marathon: … 1.2.16 1.2.16 1.2.16
- 112. #dockercon Deploy (Second Attempt) -tasks: marathon: … 1.2.16 1.2.16 1.2.16
- 113. #dockercon Deploy (Second Attempt) -tasks: marathon: … PUT /apps/editorial-module { “image”: “orbitz/editorial-module:1.2.17” … } 1.2.16 1.2.16 1.2.16
- 114. #dockercon Deploy (Second Attempt) PUT/apps/editorial-module { “image”: “orbitz/editorial-module:1.2.17” … } - tasks: marathon: … 1.2.16 1.2.16 1.2.16 app = GET /v2/apps/editorial-module if not app then deploy_id = POST /v2/apps { “image”: “orbitz/editorial-module:1.2.17”, “id”: “editorial-module” } else deploy_id = PUT /v2/apps/editorial-module { “image”: “orbitz/editorial-module:1.2.17” } end if while GET /v2/deployments contains deploy_id // still deploying end // deploy complete
- 115. #dockercon Deploy (Second Attempt) -tasks: marathon: … PUT /apps/editorial-module { “image”: “orbitz/editorial-module:1.2.17” … } 1.2.16 1.2.16 1.2.16
- 116. #dockercon Deploy (Second Attempt) -tasks: marathon: … 1.2.16 1.2.16 1.2.16
- 117. #dockercon Deploy (Second Attempt) -tasks: marathon: … 1.2.16 1.2.16 1.2.16 1.2.17 1.2.17 1.2.17
- 118. #dockercon Deploy (Second Attempt) -tasks: marathon: … /health 1.2.16 1.2.16 1.2.16 1.2.17 1.2.17 1.2.17
- 119. #dockercon Deploy (Second Attempt) -tasks: marathon: … /health 200 OK 200 OK 200 OK 1.2.16 1.2.16 1.2.16 1.2.17 1.2.17 1.2.17
- 120. #dockercon - tasks: marathon: … 1.2.171.2.17 1.2.17
- 121. #dockercon And off tothe next environment… 1.2.17 1.2.17 1.2.17
- 122.
- 123.
- 124.
- 125.
- 126.
- 127.
- 128.
- 129.
- 130.
- 131.
- 132.
- 133. #dockercon What’s inside thecontainers? • Spring Boot • Dropwizard Metrics (formerly Coda Hale, Yammer) • Consul Registration/Discovery • Logstash + Logback • Swagger • Hystrix • Retrofit + Consul OrbitzWorldwide/consul-client
- 134. #dockercon –You “Why didn’t youuse {{.x}}?”
- 135. #dockercon Keeping an eyeon… Kubernetes Amazon Elastic Container Service Docker Swarm
- 136. #dockercon Summary • Create ashared platform for docker deployments using shared and app-specific “localhost” helpers — this was ours, yours SHOULD look different — adapt to change, don’t fight it. • Take people out of the release process - Docker - repeatable applications - Chef - repeatable infrastructure — Environment aware - Jenkins - repeatable releases • Delineate configuration concerns: - Known at Compile time — Bake into Docker image - Known at Boot time — Bake into Playbook/Launcher - parameter to Docker run - Changes Anytime — Externalize (consul K/V, etcd, zookeeper)
- 137.