Download as PDF, PPTX
![SENZA: DEFINITION YAML
SenzaInfo:
StackName: hello-world
Parameters:
- ImageVersion:
Description: "Docker image version of Hello World."
SenzaComponents:
- Configuration:
Type: Senza::StupsAutoConfiguration # auto-detect network setup
- AppServer: # will create a launch configuration and ASG with scaling triggers
Type: Senza::TaupageAutoScalingGroup
InstanceType: t2.micro
SecurityGroups: [app-hello-world]
ElasticLoadBalancer: AppLoadBalancer
TaupageConfig:
runtime: Docker
source: "stups/hello-world:{{Arguments.ImageVersion}}"
ports:
8080: 8080](https://image.slidesharecdn.com/2016-06-07docker-meetup-dortmund-160613100102/85/Powering-Radical-Agility-with-Docker-17-320.jpg)
Uploaded byZalando Technology
Powering Radical Agility with Docker
The document discusses Zalando's use of Docker technology as part of its robust platform for managing over 18 million active customers across Europe. It outlines the architecture involving AWS, immutable stacks, and the development of an open-source OAuth2 provider, highlighting the importance of resilience, scalability, and monitoring metrics. Various tools and methodologies used by Zalando's engineering teams, such as GOCD and ZMON for CI/CD and monitoring, are also emphasized.
More Related Content
Similar to Powering Radical Agility with Docker
![5G Explained! A High Level Overview [Introduction]](https://cdn.slidesharecdn.com/ss_thumbnails/5gexplainedahighleveloverview-260119165306-cc137a3e-thumbnail.jpg?width=640&height=640&fit=bounds)
Powering Radical Agility with Docker
- 1. Docker - PoweringRA at Zalando Docker Meetup - Dortmund 7.6.2016 | jan.mussler@zalando.de | @JanMussler
- 2. 15 countries 3 fulfillmentcenters 18+ million active customers 3.0+ billion € revenue 135+ million visits per month 1.000+ employees in tech Europe's Leading Fashion Platform Visit us: tech.zalando.com
- 3.
- 4. Platform 80+ Engineering teams Platformteam deploy Server needs Storage requests
- 6.
- 7.
- 8.
- 9. AWS STUPS DOCKER DEPLOY SSH ACCESS AUDIT REPORTS FULL AWS ACCESS STUPS: APLATFORM ON TOP OF AMAZON WEB SERVICES
- 10.
- 11. Internet *.abc.example.org *.xyz.example.org Team ABCTeam XYZ ISOLATED AWS ACCOUNTS EC2EC2 ELBELB EC2
- 12.
- 13. IMMUTABLE STACKS ELB myapp-1 myapp.example.org EC2 +Docker EC2 + Docker EC2 + Docker
- 14. IMMUTABLE STACKS ELB myapp-1 EC2 +Docker EC2 + Docker EC2 + Docker ELB myapp-2 EC2 + Docker EC2 + Docker myapp.example.org
- 15. ● Immutable AMI ●YAML user data ● Docker runtime ● Application logging: LogEntries, Scalyr, CloudWatch Logs ● Prometheus Node Agent for metrics ● KMS encrypted env vars TAUPAGE AMI
- 16.
- 17. SENZA: DEFINITION YAML SenzaInfo: StackName:hello-world Parameters: - ImageVersion: Description: "Docker image version of Hello World." SenzaComponents: - Configuration: Type: Senza::StupsAutoConfiguration # auto-detect network setup - AppServer: # will create a launch configuration and ASG with scaling triggers Type: Senza::TaupageAutoScalingGroup InstanceType: t2.micro SecurityGroups: [app-hello-world] ElasticLoadBalancer: AppLoadBalancer TaupageConfig: runtime: Docker source: "stups/hello-world:{{Arguments.ImageVersion}}" ports: 8080: 8080
- 18. SENZA: STACK DEPLOYMENT $senza create hello-world.yaml 1 0.2 Generating Cloud Formation template.. OK Creating Cloud Formation stack hello-world-1.. OK $ senza events hello-world.yaml 1 Stack Name│Ver.│Resource Type │Resource ID │Status │Status Reason │Event Time hello-world 1 CloudFormation::Stack hello-world-1 CREATE_IN_PROGRESS User Initiated 10m ago ... hello-world 1 CloudFormation::Stack hello-world-1 CREATE_COMPLETE 6m ago
- 19.
- 20.
- 21. SSH ACCESS: TIME-LIMITEDACCESS TO ANY TEAM SERVER
- 22.
- 24.
- 25. Thoughtwork’s GOCD inaction
- 26. GOCD - Pipelineexample - configuration overlay
- 27.
- 28. The OAuth 2.0 authorizationframework enables a third-party application to obtain limited access to an HTTP service. - oauth.net OAUTH 2.0?
- 29. ● Robustness &resilience ⇒ Cassandra, no SPOF ● Low latency for token validation ⇒ Token Info next to application ● Horizontal scalability ⇒ Cassandra, “stateless” Token Info PLAN B: GOALS - Build open source Oauth2 Provider
- 30. PLAN B: COMPLETEPICTURE bobalice create token Token Info validate Provider credential storage Revocation poll public keys poll revocation listsS3 call with Bearer token
- 31. Written in Go ~16MB Docker image Stateless application CPU bound, Go 1.6 ~40x speedup for EC verify EC2 instance start to healthy: 45sec Scaling Token Info example
- 32.
- 33. Flexible and extendable:Checks & Alerts in Python Integrate: REST APIs, OAUTH2, AWS Auto Discovery Fully configurable via UI / API: no restarts required! Great for teams: team dashboards, alerts inheritance Fast/scaling metrics: Redis, KairosDB + Grafana3 Hackweek 2015 - iOS app and Android app ;-) ZMON - High Lights ;-)
- 37.
- 38. Instance Metrics ● Memoryusage ● Disk space usage ● CPU usage ● Application logs ● Application metrics Monitoring instances on AWS Scalyr Agent Log shipping Prometheus Node Agent :9100/metrics Taupage AMI (Ubuntu base) Application Container Go / Spring Boot / Cassandra Docker run time :8080 -> app :7979 -> metrics
- 39. Annotated Metric Datain Grafana
- 40. Annotated Metric Datain Grafana
- 41. Running same DockerImage everywhere
- 42.
- 43. CoreOS’ Clair withPierOne - Static vulnerability analysis of images
- 46.
- 47. ● AWS terminologyand behavior ● OAuth2 + Security + Security Groups ● Ops can be hard -> SaaS? ● CF deployment takes time ● DNS load balancing and switching :-( ○ Remember timeout config …!! ○ ELB soso ... ● Great flexibility and power though A lot of input to cover ...
- 48. Zalando on Github: https://github.com/zalando STUPSonline: https://stups.io ZMON Demo: https://demo.zmon.io Zalando Tech: https://tech.zalando.com