Downloaded 59 times
Uploaded byTravis Wright
Microsoft Ignite 2017 - SQL Server on Kubernetes, Swarm, and Open Shift
This document discusses containers and container technologies like Docker. It provides examples of real world uses of containers at Microsoft including for automated testing of SQL Server on Linux with hundreds of containers running tests simultaneously. It also covers container networking and how containers connect within and across hosts. Persistent storage options for containers using technologies like NFS, Ceph, Azure Blob storage are presented. Secret management in containers using an encrypted distributed store is also summarized.
More Related Content
![[OpenStack Day in Korea 2015] Keynote 5 - The evolution of OpenStack Networking](https://cdn.slidesharecdn.com/ss_thumbnails/05-150213034012-conversion-gate02-thumbnail.jpg?width=640&height=640&fit=bounds)
Similar to Microsoft Ignite 2017 - SQL Server on Kubernetes, Swarm, and Open Shift
![[OpenInfra Days Vietnam 2019] Innovation with open sources and app modernizat...](https://cdn.slidesharecdn.com/ss_thumbnails/innovationwithopensourcesandappmodernizationfordevelopers-dist-190824044544-thumbnail.jpg?width=640&height=640&fit=bounds)
![5G Explained! A High Level Overview [Introduction]](https://cdn.slidesharecdn.com/ss_thumbnails/5gexplainedahighleveloverview-260119165306-cc137a3e-thumbnail.jpg?width=640&height=640&fit=bounds)
Microsoft Ignite 2017 - SQL Server on Kubernetes, Swarm, and Open Shift
- 3. The New Reality 3 Dataand Agility are the only hope of survival
- 4.
- 5.
- 6. Nature of SoftwareDelivery Has Changed
- 7. DevOps Principles inFocus 7
- 8.
- 9. Container Benefits 9 This isnot a fad!
- 10.
- 11. Docker Databases 11 Most ofthe most popular images are databases Postgres: 10M+ pulls Mysql: 10M+ pulls Redis: 10M+ pulls Mongo: 10M+ pulls SQL Server on Linux has had ~2M+ pulls in the first 10 months
- 12. Persisting Storage 12 Mount avolume to the host Local storage Remote storage Mount a container volume docker run … -v /my/host/dir:/my/container/dir … docker create -v /mydata --name mydatacontainer … docker run --volumes-from mydatacontainer … Read this! https://docs.docker.com/engine/tutorials/dockervolumes/
- 13. Build & TestLocally in Dev Environment 13 Build locally on Windows, Linux, or macOS Windows Linux Docker containers using Docker for Windows Windows containers on Windows 10 Anniversary Edition+ macOS Linux Docker containers using Docker for Mac Linux Use Docker Engine natively There are other container engines like LXC Use for demo today
- 14. Application Deployment Patterns UsingContainers 14 SQL Server App 1 App 2 SQL Server App 1 SQL Server + App 1 Centralized SQL Server Docker Compose Monolithic App or Microservice
- 18. Real World Example– SQL Server Team 18 SQL Server Engineering Team uses Kubernetes in Azure VMs for automated testing of SQL Server on Linux Automated build process creates the container image Extended existing test system to handle provisioning and test execution/targeting ~700 containers per test run, usually once per day 150 VM hosts in Azure; 128 GB/8 cores 20+ containers/VM in some cases High density, each SQL Server container listens on a different
- 19. Real World Example– DV01 https://customers.microsoft.com/en-us/story/dv01
- 23.
- 24. Container to Containeron the Same Host 2 4 OVS PACKET FLOW NODE POD 1 veth0 10.1.15.2/24 br0 10.1.15.1/24 192.168.0.100 eth0 POD 2 veth1 10.1.15.3/24 vxlan0
- 25. NODE 2 NODE 1 2 5 OVSPACKET FLOW POD 1 veth0 10.1.15.2/24 br0 10.1.15.1/24 vxlan0 POD 2 veth0 10.1.20.2/24 br0 10.1.20.1/24 vxlan0 192.168.0.100 eth0 192.168.0.200 eth0 Container to Container on the Different Hosts
- 26. Container Connects toExternal Host Container to Container on Different Hosts 2 6 OVS PACKET FLOW NODE 1 POD 1 veth0 10.1.15.2/24 br0 10.1.15.1/24 tun0 192.168.0.100 External Host eth0
- 27. SERVICE POD POD ROUTER POD EXTERNAL TRAFFIC INTERNALTRAFFIC ROUTE EXPOSES SERVICES EXTERNALLY
- 28. ROUTE SPLIT TRAFFIC SERVICEA App A App A SERVICE B App B App B ROUTE 10% traffic 90% traffic Split Traffic Between Multiple Services For A/B Testing, Blue/Green and Canary Deployments
- 30. “For which workloadsor application use caseshave you used/do you anticipate touse containers?” DataApps 77% CloudApps 71% Systems of Engagement 62% Systems of Record 62% Web andCommerce Software 57% MobileApps 52% SocialApps 46% Scalable, Cost Effective, Distributed Storage for Containers
- 31. ● Persistent Volumeare tied to a piece of network storage ● Provisioned by an administrator either statically or dynamically ● Allows admins to describe storage and users to request storage PERSISTENT STORAGE NFS GlusterFS OpenStack Cinder Ceph RBD Azure Blob Fibre Channel Azure File Azure Disk iSCSI
- 32. PROJECT POOL OF PERSISTENTVOLUMES PERSISTENT STORAGE NFS PV iSCS I PV NFS PV Admin User register PV create claim NFS PV GlusterFS PV Pod claim Pod claim Pod claim Ceph RBD PV
- 33. 3 3 DYNAMIC VOLUME PROVISIONING Admin User defineStorageClass create claim: Fastest Slow Azure-Disk Fast AWS-SSD Fastest NetApp-Flash NetApp Provisioner AWS Provisioner Pod claim PV OpenShift PV Controller provision Azure Provisioner bound
- 34. NODENODENODE CONTAINER-NATIVE STORAGE NODE POD PODPOD POD POD POD POD POD POD POD RHG S RHG S RHG S POD POD POD MASTER
- 36. NODE MASTER ● Secure mechanismfor holding sensitive data e.g. ○ Passwords and credentials ○ SSH Keys ○ Certificates ● Secrets are made available as ○ Environment variables ○ Volume mounts ○ Interaction with external systems ● Encrypted in transit ● Never rest on the nodes 3 6 SECRET MANAGEMENT Container Distributed Store Container
- 37.
- 43. https://hub.docker.com/r/microsoft/mssql-server-linux/ https://www.openshift.com/dedicated/test-drive.html https://github.com/twright-msft/example-voting-app https://github.com/twright-msft/mssql-server-rhel https://github.com/twright-msft/contoso-u https://github.com/twright-msft/contoso-u DevOps: CI/CDwith Microsoft SQL Server 2017 Tomorrow at 12:30 – 1:45, Hyatt International
- 45. Key Docker Terminologyand Commands 45 Image – A definition. Defines what software is included and how it runs. Container – A running instance based on the image. docker pull – download an image from a Docker respository docker run – create a container from an image docker ps – list all locally running containers docker images – list all locally cached images You do not “install” a Docker container!
- 46.
Editor's Notes
- #28 A route exposes a service at a host name, like www.example.com, so that external clients can reach it by name. DNS resolution for a host name is handled separately from routing. Admin may have configured a DNS wildcard entry that will resolve to the node that is running the OpenShift Container Platform router Pods running on OpenShift, don’t need to go through the routing layer and can interact with each other directly through the services.
- #32 OpenShift Container Platform leverages the Kubernetes persistent volume (PV) framework to allow administrators to provision persistent storage for a cluster. Using persistent volume claims (PVCs), developers can request PV resources without having specific knowledge of the underlying storage infrastructure. OpenShift Container Platform supports a growing list of storage plugins for using various storage solutions. Note that high-availability of storage in the infrastructure is left to the underlying storage provider.
- #33 Administrators define a pool of Persistent Volumes (PV) which are backed by network storage solutions like NFS, iSCSO, AWS EBS, etc and make them globally available in the OpenShift cluster. Users within their projects can create a Persistent Volume Claim (PVC) in order to request a PV to be available within their pods. In the pod definition, a developer can refer to the PVC and mount the requested persistent volume inside the pod at an arbitrary path. If a pod gets restarted, OpenShift mounts the same persistent volume into the pod again so that the pod data is available. PVs outlive the containers that were using them.
- #34 Dynamic provisioning allows provisioning persistent volumes on-demand when users request it rather than admins predefining them in advance StorageClass is a blueprint of how to provision persistent volumes on a network storage. OpenShift provides a set of provisioners that determine what volume plugins should be used for provisioning the volumes. OpenShift also supports third-party plugins that are not part of Kubernetes, such as NetApp Trident Admins creates a catalog of StorageClasses available in the OpenShift cluster. StorageClass names are arbitrary names to communicate their characteristics Users can create a Persistent Volume Claim and specify the name of a StorageClass to instruct OpenShift on the type of persistent volume that should be provisioned for the them
- #35 The goal of container-native storage (CNS) is to provide a solution that runs Red Hat Gluster Storage software as containers inside OpenShift as Kubernetes pods. CNS enables OpenShift users to add reliable, safe, and shared persistent storage to their projects. It allows OpenShift administrators to deploy and manage their GlusterFS storage clusters quickly and easily. OpenShift administrators can easily create GlusterFS volumes using Heketi, a GlusterFS multicluster volume manager, and then register the volume availability with OpenShift by submitting a persistent volume claim (PVC). GlusterFS also supports dynamic provisioning of persistent volumes and removes the need for administrators to define and create PVs in OpenShift upfront and have them created on-demand instead when users request a PV. OpenShift users can take advantage of these GlusterFS volumes by submitting an OpenShift PVC, which is then bound to an appropriate persistent volume. When users employ their claim, OpenShift invokes the GlusterFS volume plug-in that mounts the appropriate GlusterFS volume from the node running the pod to enable the container referenced in the claim to access the desired volume. The solution supports collocating other OpenShift (Kubernetes) application pods on the same OpenShift nodes as the Red Hat Gluster Storage pods, in a “hyper-converged” configuration. Red Hat Gluster Storage pods can be deployed on any OpenShift nodes within the cluster that have one or more block devices with many logical volumes defined which are used as the bricks for volumes provided by Red Hat Gluster Storage pods.
- #37 Having an easy-to-use, secure-by-default secret distribution mechanism is exactly what developers and ops need to solve the secrets management problem once and for all Because secret objects can be created independently of the pods that use them, there is less risk of the secret being exposed during the workflow of creating, viewing, and editing pods. A secret is only sent to a node if a pod on that node requires it. It is not written to disk. It is stored in a temporary file-storage facilities (tmpfs). It is deleted once the pod that depends on it is deleted. Secrets are stored as plaintext in etcd however the etcd storage can be encrypted to remove the security risk