Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

DockerCon SF 2015: Beyond CI to Production Scale PaaS with Docker

3,593 views

Published on

Talk Description:
What a difference a year makes. Last year Paypal presented on scaling a CI infrastructure with Docker, Mesos and Jenkins. Over the past year we worked on integrating Docker to the core of our PaaS ecosystem. We are Dockerizing the entire PayPal application ecosystem consisting of polyglot Java, Node.js, Scala, C++ and Python frameworks. In this journey we have introduced HA Docker Registry with ElasticSearch search plugin using both OpenStack Swift and Cinder storage, cross-data center ATS server smart image caching along with a developer-friendly boot2docker fig/compose workflow for Kraken (open source nodeJS) stack. This we believe has the potential to become one of the largest financial services production deployment of Docker.

Published in: Technology
  • Sex in your area is here: ❶❶❶ http://bit.ly/369VOVb ❶❶❶
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Dating for everyone is here: ❶❶❶ http://bit.ly/369VOVb ❶❶❶
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • ★★ How Long Does She Want You to Last? ★★ A recent study proved that the average man lasts just 2-5 minutes in bed (during intercourse). The study also showed that many women need at least 7-10 minutes of intercourse to reach "The Big O" - and, worse still... 30% of women never get there during intercourse. Clearly, most men are NOT fulfilling there women's needs in bed. Now, as I've said many times - how long you can last is no guarantee of being a GREAT LOVER. But, not being able to last 20, 30 minutes or more, is definitely a sign that you're not going to "set your woman's world on fire" between the sheets. Question is: "What can you do to last longer?" Well, one of the best recommendations I can give you today is to read THIS report. In it, you'll discover a detailed guide to an Ancient Taoist Thrusting Technique that can help any man to last much longer in bed. I can vouch 100% for the technique because my husband has been using it for years :) Here's the link to the report ➤➤ http://ishbv.com/rockhardx/pdf
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • ➤➤ How Long Does She Want You to Last? Here's the link to the FREE report ●●● http://ishbv.com/rockhardx/pdf
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

DockerCon SF 2015: Beyond CI to Production Scale PaaS with Docker

  1. 1. Beyond CI to Production Scale PaaS with Docker
  2. 2. Platform Engineering @ PayPal ➢ Several thousand OpenStack servers across multiple data centers ➢ More than 3000 PayPal developers supported ➢ Thousands of application deployments performed every day ➢ 165 Million active PayPal customer accounts ➢ Presence in 203 markets and 100 currencies ➢ $235 Billion payment volume ➢ 12.5 million payment transactions every day Boost developer productivity Support ever increasing scale of operations
  3. 3. Last year at DockerCon 2014… ➢ Thousands of VMs dedicated to run Jenkins! ➢ Utilization is less than 5% ☹ ➢ VMs idle most of time (no one runs CI builds frequently) VM sprawl and poor resource utilization ➢ Polyglot application stacks (Java, C++, Node.js, Python, Scala) ➢ Different OS flavors (Ubuntu & RHEL) ➢ Software version conflicts ➢ Special hardware requirements Build slave management and maintenance is a nightmare
  4. 4. How PaaS Orchestrates The Docker PDLC
  5. 5. Building & Storing Docker Images
  6. 6. Docker Registry HA Setup ➢ Supervisord as the process manager ➢ Logrotate for registry and nginx logs ➢ Elasticsearch plugin for indexing ➢ Swift plugin for storage ➢ Basic authentication ➢ Ansible playbook for setting up the registry ➢ HA running behind F5 load balancer ➢ Docker load used to deploy the registry for the first time ➢ Swift auto-sync between data centers Features
  7. 7. Docker Image Index Challenges ➢ Production firewalls block multicast clustering protocol ➢ ES sniffing timeout issues when ES nodes were unavailable ➢ ES split-brain problems with clustering Solutions ➢ ES indexing plugin for the Docker Registry ➢ Zookeeper transport plugin for ES Python client ➢ Persisting ES index data using OpenStack Cinder
  8. 8. Cross-datacenter View
  9. 9. Deploying Docker Images In Production ➢ DNS-based ATS discovery per DC ➢ Header rewrite plugin ➢ Custom Cache rules ➢ Custom SSL certs ➢ ATS Ansible deployment Features
  10. 10. Dockerized Development Environments ➢ Building an application stack should be simple, but it’s not! ➢ Development environments are snow-flakes ➢ Development environments should be self-contained
  11. 11. Container with Dev configuration
  12. 12. Container with Stage configuration
  13. 13. Demo
  14. 14. Thank you Ashish Hunnargikar Software Engineer @hunnarg Mohit Soni Software Engineer @mosoni #dockercon

×