WWCode Dallas - Kubernetes: Learning from Zero to Production
•
0 likes•361 views
The document discusses various Kubernetes concepts and tools including: - Using Minikube to deploy a local Kubernetes cluster for learning. - Using kops to deploy a Kubernetes cluster on cloud infrastructure like AWS. - Key Kubernetes objects like pods, deployments, services, ingress controllers, daemonsets, statefulsets and jobs. - Cluster operations such as logging/metrics, autoscaling, upgrades, backups and testing. - Security practices including secrets management, vulnerability scanning and network policies.
Recommended
More Related Content
What's hot
What's hot (20)
Similar to WWCode Dallas - Kubernetes: Learning from Zero to Production
Similar to WWCode Dallas - Kubernetes: Learning from Zero to Production (20)
Recently uploaded
Recently uploaded (20)
WWCode Dallas - Kubernetes: Learning from Zero to Production
- 2. 2 🍩 🐵 https://www.slideshare.net/RosemaryWang/10-basic-sysadmin-commands-for-developers-operators
- 4. Use AWS (existing skills & compliance). Use Kubernetes (cross-cloud). Use ??? since EKS was not GA at the time. 4
- 6. 6
- 8. 8
- 9. Questions? Please wait until the end! Want the slides? Check Meetup & Twitter! 9
- 10. Prologue 10
- 11. 11
- 12. 12
- 13. How do we manage these containers? a. Group them. b. Write some code to schedule them on resources. c. Build some connectivity to bridge them all together. d. Identify them in a human-friendly way. 13
- 14. How do we manage these containers? a. Group them. b. Write some code to schedule them on resources. c. Build some connectivity to bridge them all together. d. Identify them in a human-friendly way. e. All of the above! 14
- 15. Master Node 1 Node 2 Node N kube-apiserver etcd kube-scheduler kube-controller-manager https://kubernetes.io/docs/concepts/overview/components/#master-components kubelet kube-proxy container runtime (docker) 15
- 16. Start with a local tutorial. (Minikube) 16
- 17. What is Minikube? a. A fun-size microcontroller distributed on Halloween. b. A tool to deploy a local Kubernetes cluster. c. A packing cube that compresses garments. d. An alias for famous hip-hop star, Lil Kube. 17
- 18. What is Minikube? a. A fun-size microcontroller distributed on Halloween. b. A tool to deploy a local Kubernetes cluster. c. A packing cube that compresses garments. d. An alias for famous hip-hop star, Lil Kube. 18
- 20. What does it do? (Deployments) 20
- 21. Pods xyz :123 abc :456 PodSpec I want container xyz on port 123 & container abc with ports 456. Smallest unit of service Groups of containers and/or volumes Shared storage / network https://kubernetes.io/docs/tutorials/k8s101/ https://kubernetes.io/docs/concepts/workloads/controllers/deployment/ 21
- 22. Deployments (Our) commonly used construct Consists of pods Reconciliation loop (always maintain desired state) xyz :123 abc :456 xyz :123 abc :456 Deployment And I want 2 pods. https://kubernetes.io/docs/tutorials/k8s101/ https://kubernetes.io/docs/concepts/workloads/controllers/deployment/ 22
- 23. Put it on the cloud. (kops) 23
- 24. What to use? https://kubernetes.io/docs/setup/pick-right-solution/#table-of-solutions 24 47 on the list (as of January 2019)
- 29. illusion of managed services Source code 29
- 30. Somehow, reach my application. (Service Ingress) 30
- 31. https://github.com/kubernetes/kops Node 1 Node 2 Node N kube-apiserver Service I want to reach my app at helloworld on Port 80 31
- 32. Cluster Load Balancer DNS Alias DNS Alias Load Balancer Ingress Controller /hello helloworld.com mycluster.com/hello ClusterCluster helloworld.default Type: ClusterIP Type: LoadBalancer Ingress Controller 32 helloworld.default helloworld.default
- 33. Should we go for an ingress controller? a. Yes! It’s a standard for microservices. b. Yes! We need a reverse proxy. c. Not now, will add complexity (and scale isn’t a concern). d. I searched it and it’s an augmented reality game…? 33
- 34. Should we go for an ingress controller? a. Yes! It’s a standard for microservices. b. Yes! We need a reverse proxy. c. Not now, will add complexity (and scale isn’t a concern). d. I searched it and it’s an augmented reality game…? 34
- 35. Manage logging & metrics. (DaemonSets) 35
- 36. Pull the Metrics! Application Logging System 36
- 38. Metrics Node Pod Agent PodApp Scrapes metrics endpoint (Prometheus-formatted) Autodiscovery annotations: prometheus.io/scrape: 'true' prometheus.io/port: "8080" prometheus.io/path: "/metrics" Forwards m etrics to m etrics backend 38
- 39. Logging Node Pod Agent PodApp Tails logs /var/log/containers/*.log Kubelet writes stdout and stderr to log files Forwards logs to logging backend 39
- 40. Manage clusters like Consul. (StatefulSets) 40
- 41. What do statefulsets allow that deployments don’t? a. Storage of more metadata. b. Rolling upgrades. c. Persistent storage. d. Sticky identities for pods 41
- 42. What do statefulsets allow that deployments don’t? a. Storage of more metadata. b. Rolling upgrades. c. Persistent storage. d. Sticky identities for pods. 42
- 43. Deployment Deployments Can Have Persistence Pod 43
- 44. Pod Identity Can Be Important Member-1 Member-2 Member-3 Replication Replication Leader Forwarding Leader Forwarding 44
- 45. Statefulsets Make Persistence Easier Member-1 Member-2 Member-3 Replication Replication Leader Forwarding Leader Forwarding 45
- 47. We need more resources! (Autoscaling) 47
- 48. Cluster Autoscaling https://github.com/kubernetes/autoscaler “Let me add more.” “Schedule me!” 48
- 51. Cluster Autoscaling https://github.com/kubernetes/autoscaler “I’ll scale up by 1.” Caution: Possibly conflicting permissions with backup... 51
- 53. Why don’t my queue consumers scale up? a. Cookie monster is consuming my queue consumers. b. They don’t process messages fast enough. c. They are broken. d. They pull one message at a time from the queue. 53
- 54. Why don’t my queue consumers scale up? a. Cookie monster is consuming my queue consumers. b. They don’t process messages fast enough. c. They are broken. d. They pull one message at a time from the queue. https://github.com/uswitch/sqs-autoscaler-controller https://kubernetes.io/docs/tasks/run-application/horizontal-pod-autoscale/#support-for-metrics-APIs 54
- 55. Testing, testing. 1, 2, 3. (Jobs) 55
- 58. How do you test? CI Server Load Balancer k8s API server My App 58
- 59. We tried... 59
- 60. How do you test? CI Server Load Balancer k8s API server My App 60
- 61. How do you test? CI Server Load Balancer k8s API server My App Test Job 61
- 62. “Good Enough” Security. (Secrets & More) 62
- 65. KMS + Parameter Store Secrets Management 65
- 68. The cluster needs to be upgraded. (Cluster Rolling Upgrade) 68
- 69. How it works 69
- 76. How it works 76
- 77. DIY! Cordon Drain Delete Validate 77 end-to-end tests!
- 79. Goodbye, cluster! (Backup & Restore) 79
- 80. Problem 80
- 81. Solutions 81
- 82. Cluster Backups https://github.com/kubernetes/autoscaler k8s API server ark 1. “What’s running in the cluster?” 2. Stores the api objects in s3 82
- 83. Cluster Restores https://github.com/kubernetes/autoscaler k8s API server ark CI Server 1. “Restore from latest backup” 2. “Give me latest backup” 3. “Recreate these api objects” 83
- 84. What’s still in backlog? 84
- 85. Which of the following would NOT give us more security? a. Ephemeral VMs (Bastions, Masters, and Nodes) b. Cats on a Turntable c. PodSecurityPolicy d. NetworkPolicy 85
- 86. Which of the following would NOT give us more security? a. Ephemeral VMs (Bastions, Masters, and Nodes) b. Cats on a Turntable c. PodSecurityPolicy d. NetworkPolicy 86
- 87. Which of the following would NOT give us more security? a. Ephemeral VMs (Bastions, Masters, and Nodes) b. Cats on a Turntable c. PodSecurityPolicy d. NetworkPolicy 87
- 89. Managed Kubernetes? Some struggles went away… ● ● ● Questions don’t! ● ● ● ● 89 https://www.slideshare.net/try_except_/running-kubernetes-in-producti
- 91. Did we learn enough? 91
- 93. The good news: made it 93
- 96. 96 Thank you!