Download as PDF, PPTX
![Tools can enable change
in behavior and
eventually change
culture
‘
[patrick debois]](https://image.slidesharecdn.com/cloud-lighttablev3-160229055424/85/DOCKER-CLOUD-ENABLERS-For-DEVOPS-21-320.jpg)
Uploaded byACA IT-Solutions
'DOCKER' & CLOUD: ENABLERS For DEVOPS
The document discusses the benefits of cloud computing and the integration of Docker within DevOps practices, emphasizing its role in enhancing business agility and maximizing customer value. Key advantages of cloud solutions include elastic capacity, reduced capital expenditure, and enabling faster software development cycles. The document also outlines how containers streamline application deployment processes and improve resource utilization.
More Related Content
Similar to 'DOCKER' & CLOUD: ENABLERS For DEVOPS
'DOCKER' & CLOUD: ENABLERS For DEVOPS
- 2. ACA IT-SOLUTIONS |© 2015 Stijn Wijndaele stijn.wijndaele@aca-it.be @stijnwijndaele Introduction? Your Hosts For Today Business Development Manager Cloud & Mobile Solutions ACA IT-SOLUTIONS | © 2016 Stijn Van den Enden stijn.vandenenden@aca-it.be @stieno CTO
- 5. Wants to bethe greatest IT service provider by being fanatic about maximising customer value
- 6. 'DOCKER' & CLOUD: ENABLERSFor DEVOPS
- 7. DevOps DevOps is gerichtop het tot stand brengen van een cultuur binnen organisaties waardoor het ontwikkelen, valideren en releasen van software sneller, meer betrouwbaar en frequenter kan verlopen
- 8.
- 9. Why the Cloud? • Elastic Capacity • Business Agility • CapEx becomes OpEx • Enabler for DevOps
- 10. Why the Cloud? • Elastic Capacity • Business Agility • CapEx becomes OpEx • Enabler for DevOps
- 11. Elastic Capacity Traditional: RigidCloud: Elastic Capacity Demand Capacity Excess Capacity Wasted $ Demand Un-met Demand
- 12. Why the Cloud? • Elastic Capacity • Business Agility • CapEx becomes OpEx • Enabler for DevOps
- 13. Business Agility Add NewDev Environment Add New Prod Environment Add New Environment in Japan Add 1,000 Servers Remove 1,000 servers Deploy 2 PB Data warehouse Shut down 2 PB Data warehouse IAAS/PAAS: Infrastructure in Minutes Old World: Infrastructure in Weeks Everything changes with this kind of agility + weeks Service Request
- 14. Why the Cloud? • Elastic Capacity • Business Agility • CapEx becomes OpEx • Enabler for DevOps
- 15. Capex becomes Opex •no initial investments • no termination fees • no (real) commitments • clear pricing model
- 16. Why the Cloud? • Elastic Capacity • Business Agility • CapEx becomes OpEx • Enabler for DevOps
- 17. Enabler for devops •Automation - Less repetitive tasks • Better management tools • no need to build from scratch - reuse • Focus on what matters - your business
- 18. Netflix in 2015 •69,2 million users • 42,5 billion streaming hours • 45GB bandwidth user/month Source : DMR January 2016
- 19. Netflix in 2015 •10x Customers • 100x Traffic • 5x Devs • 2x Cost of IT infrastructure Source : DMR January 2016 in 2008
- 20. Infrastructure as Code FromAPI accessible xAAS services to automated deployment
- 21. Tools can enablechange in behavior and eventually change culture ‘ [patrick debois]
- 22. AMI, VMX, OVF,… Cloud Provider Continuous Integration Build, test and integrate applications Configuration Management Configure and setup an existing machine Orchestration Tools Provision Infrastructure and services based on a configuration template heat base image additional packages application code-artefact-765
- 23. 'DOCKER' & CLOUD: ENABLERSFor DEVOPS
- 24. Docker • What isdocker ? • What’s more ?
- 25. Docker • What isdocker ? • What’s more ?
- 26. Docker IT works onmy System
- 27. Supply Matrix -From Hell!
- 29. IT Matrix FromHell!
- 30. One Size -Fits All
- 31.
- 32. Compute, Storage, Network HostOS Hypervisor VM1 MicroService Guest OS JVM VM2 MicroService Guest OS JVM Compute, Storage, Network Host OS container1 container2 container3 container4 JVM JVM JVM MicroService MicroService MicroService JVM MicroService Containers have own isolated resources Performance Comparison: http://ibm.co/V55Otq VM’s abstract underlying hardware, but limits resource utilisation
- 33.
- 34. Docker - Layering •Container = Writeable layer • Image = Static layers • Containers = Share the kernel
- 35. docker build -ttest/a . FROM aca—base-ubuntu:1.1 RUN apt-get update RUN apt-get install -y apache2 RUN touch /opt/a.txt Let’s build Webserver A! Our Dockerfile
- 36. docker build -ttest/a . FROM aca—base-apache:2.1 RUN touch /opt/a.txt Or even better….
- 37. docker history test/a IMAGECREATED CREATED BY SIZE 4dc359259700 About a minute ago /bin/sh -c touch /opt/a.txt 8 B 9977b78fbad7 About a minute ago /bin/sh -c apt-get install -y apache2 54.17 MB e83b3bf07b42 2 minutes ago /bin/sh -c apt-get update 20.67 MB 9cd978db300e 3 months ago /bin/sh -c #(nop) ADD precise.tar.xz in / 204.4 MB 6170bb7b0ad1 3 months ago /bin/sh -c #(nop) MAINTAINER Tianon Gravi <ad 0 B 511136ea3c5a 10 months ago 0 B What is in Webserver A?
- 38. docker build -ttest/b . Let’s build Webserver B! FROM aca—base-ubuntu:1.1 RUN apt-get update RUN apt-get install -y apache2 RUN touch /opt/b.txt Our Dockerfile
- 39. docker history test/b IMAGECREATED CREATED BY SIZE c0daf4bw2ed4 5 seconds ago /bin/sh -c touch /opt/b.txt 8 B 9977b78fbad7 About a minute ago /bin/sh -c apt-get install -y apache2 54.17 MB e83b3bf07b42 2 minutes ago /bin/sh -c apt-get update 20.67 MB 9cd978db300e 3 months ago /bin/sh -c #(nop) ADD precise.tar.xz in / 204.4 MB 6170bb7b0ad1 3 months ago /bin/sh -c #(nop) MAINTAINER Tianon Gravi <ad 0 B 511136ea3c5a 10 months ago 0 B What is in Webserver B?
- 43. Containers are hereto stay! The Open Container Initiative (OCI) is a collaborative project hosted under the Linux Foundation designed to establish common standards for containers.
- 44. Docker • What isdocker ? • What’s more ?
- 45. Docker Hub -Public Library
- 46. Docker Registry -Private Library
- 47. Docker Registry -Private Library • Tightly control where your images are being stored • Fully own your images distribution pipeline • Integrate image storage and distribution tightly into your in-house development workflow • Collaborate with your colleagues
- 48. Docker Hub • DockerHUB = Docker Registry - As A Service • Zero Maintenance • Additional Functionality to increase collaboration • Alternative Providers : Google / AWS / CoreOS
- 51. /preference-service Repository DockerFile Continuous Integration Infrastructure Container ImageRepository Compute, Storage, Network Host OS daemon container1 JVM MicroService pull push build provision container1 JVM MicroService Source Control System
- 52. The real valueof Docker is not technology It’s getting people to agree on something
- 53. Shipping Applications Beyond asingle container
- 54.
- 58. Minimal OS Docker Virtual Machine Hardware kubelet Pod Container proxy NodeMaster scheduler controllermanager (replication controller, etc.) API endpoint distributed configuration storage kubectl (client command line tool)
- 59. K/V K/V K/V K/V K/V /etc distributed raft - leaderelection //Adding a value $ curl http://127.0.0.1:2379/v2/keys/message -XPUT -d value="Hello world” //Quering $ curl http://127.0.0.1:2379/v2/keys/message { "action": "get", "node": { "createdIndex": 2, "key": "/message", "modifiedIndex": 2, "value": "Hello world" } } //Delete $ curl http://127.0.0.1:2379/v2/keys/message -XDELETE Operations
- 60. apiVersion: v1 kind: ReplicationController metadata: name:es-data labels: component: elasticsearch role: data visualize: "true" spec: replicas: 2 selector: component: elasticsearch role: data template: metadata: labels: name: es-data component: elasticsearch role: data visualize: "true" spec: serviceAccount: elasticsearch containers: - name: es-data securityContext: capabilities: add: - IPC_LOCK image: quay.io/pires/docker-elasticsearch-kubernetes:1.7.2 es-data-rc.yaml Pod Container
- 61. es-data-rc.yaml metadata: labels: name: es-data component: elasticsearch role:data visualize: "true" spec: serviceAccount: elasticsearch containers: - name: es-data securityContext: capabilities: add: - IPC_LOCK image: quay.io/pires/docker-elasticsearch-kubernetes:1.7.2 env: - name: NAMESPACE valueFrom: fieldRef: fieldPath: metadata.namespace … ports: - containerPort: 9300 name: transport protocol: TCP volumeMounts: - mountPath: /data name: storage volumes: - name: storage persistentVolumeClaim: claimName: elasticsearch-storage-claim kind: PersistentVolumeClaim apiVersion: v1 metadata: name: elasticsearch-storage-claim spec: accessModes: - ReadWriteOnce resources: requests: storage: 100Gi es-claim.yaml Pod Container
- 62. Minimal OS Docker Virtual Machine Hardware kubelet proxy Node Pod Container kind:PersistentVolumeClaim apiVersion: v1 metadata: name: elasticsearch-storage-claim spec: accessModes: - ReadWriteOnce resources: requests: storage: 100Gi es-claim.yaml apiVersion: "v1" kind: "PersistentVolume" metadata: name: “ebs-volume-1“ spec: capacity: storage: "100Gi" accessModes: - "ReadWriteOnce" awsElasticBlockStore: fsType: "ext4" volumeID: "vol-f331a05cc" ebs-volume-1.yaml /data scheduler Amazon EBS
- 63. service apiVersion: v1 kind: Service metadata: name:elasticsearch labels: component: elasticsearch role: client visualize: "true" spec: type: LoadBalancer selector: component: elasticsearch role: client ports: - name: rest port: 9200 protocol: TCP - name: transport port: 9300 protocol: TCP es-svc.yaml Minimal OS Docker Virtual Machine Hardware kubelet Pod Container proxy Node (replication controller, etc.)
- 64. Minimal OS Docker Virtual Machine Hardware kubelet proxy NodeMaster scheduler controllermanager (replication controller, etc.) API endpoint distributed configuration storage kubectl (client command line tool) Pod Container • cluster topology design • operational cluster management • cluster upgrade and maintenance • application • declarative resource specification DevOps • container image standardisation • deployment processes
- 65. Elastic LoadBalancer Node service Minimal OS Docker VirtualMachine Hardware kubelet proxy Master scheduler controller manager (replication controller, etc.) API endpoint distributed configuration storage kubectl (client command line tool) Pod Container ServerGroup
- 66. Open Source Commerciallysupported
- 67.
- 68.
- 69. Minimal OS Docker Virtual Machine Hardware ManagerNode Container swarm manager swarm agent swarm agent distributed configuration storage docker remote API overlay network
- 70.
- 71. Docker Task Container Instance Amazon ECS Container ECS Agent ELB Internet ELB User/ Scheduler API Cluster Management Engine Task Container Docker Task Container Instance Container ECS Agent Task Container Docker Task Container Instance Container ECS Agent Task Container AZ 1 AZ 2 Key/Value Store Agent Communication Service * slide from Deepak Singh, General Manager, Amazon EC2 Container Service
- 73. Slave Master framework Virtual Pool ofResources (CPU, RAM, …)
- 74. • Set upin seconds, integrates in the AWS stack (ELB, CloudWatch, ECR) and yes, specific to Amazon WebServices • Basic capabilities out of the box (no Discovery, …) but extensible • Ideal for simple containerised workloads • Opinionated declarative cluster management solution • Runs on a single machine (in Docker) and on a large datacenter setup • Rich API for cluster management • Support for Secrets, Quota, Volumes, … • Provider agnostic (docker, rkt, amazon, gce, …) • Abstracts a cluster behind the Docker Remote API • Networking and scheduling support • Open plugin points for discovery, networking, … • Docker only • Lacks (being out of the box) service load balancing support • Essentially a resource abstraction • Scales to +10K nodes • Job agnostic (more than containers alone) • Support Kubernetes as one of the many frameworks
- 75. + Container declarative specification ofoperational needs Cluster continuous deployment pipeline includes quality gates: automated tests ops compliance security tests manual steps …
- 76.
- 77. Container Image preference-service- artefact-765 Blue Green ContentBased Router Blue/Green deployments Container Image preference-service- artefact-765 Container Image preference-service- artefact-123 production traffictest traffic
- 78. Container Image preference-service- artefact-765 Stage 1Stage 2 Stage 3 Content Based Router Canary staged deployment
- 79. 2 Container ecosystemis maturing rapidly and cAAS provides the abstraction sweet spot 1 Cloud services are a true enabler for business agility 3 Leverage Continuous Deployment as competitive advantage (as long as it lasts)
- 80. ACA IT-SOLUTIONS |© 2015 Stijn Wijndaele stijn.wijndaele@aca-it.be @stijnwijndaele Questions? Your Hosts For Today Business Development Manager Cloud & Mobile Solutions ACA IT-SOLUTIONS | © 2016 Stijn Van den Enden stijn.vandenenden@aca-it.be @stieno CTO