Download as PDF, PPTX
Uploaded byHungWei Chiu
Head First to Container&Kubernetes
The document discusses containers and Kubernetes, covering their definition, advantages over virtual machines, and how they integrate into IT processes. It details how to work with Docker, including image preparation, container creation, storage management, networking, and the orchestration provided by Kubernetes. The text also highlights Kubernetes architecture, deployment concepts, and networking challenges that users may face.
More Related Content
Similar to Head First to Container&Kubernetes
Head First to Container&Kubernetes
- 1.
- 2. hung-wei chiu Microsoft MVP Devops@ Thundertoken Co-organizer of SDNDS-TW Co-organizer of CNTUUG Network/Kubernetes/SDN https://blog.hwchiu.com
- 4.
- 5.
- 6.
- 7.
- 8.
- 9.
- 10.
- 11.
- 12. Relationship between VMs/Containers ✖ContainersAre More Agile then VMs ✖Containers Enable Hybrid and Multi- Cloud Adoption ✖Integrate Containers with Your Existing IT Process ✖Containers Save on VM Licensing ✖What About Bare Metal ✖What About Security https://blog.docker.com/2018/08/containers-replacing- virtual-machines/
- 13.
- 14. How Docker Works ✖Mountnamespaces ✖IPC namespaces ✖PID namespaces ✖Network namespace ✖User namespaces ✖UTS namespaces
- 15. How to start ✖Preparedocker image ○ Pull from internet ○ Build by yourself ✖Create container based on image.
- 16. How to start ✖Preparedocker image ○ Pull from internet ○ Build by yourself ✖Create container based on image.
- 17.
- 18. Docker run ✖docker run-d --name ubuntu hwchiu/netutils ✖docker run -d -p 6379:6379 --name redis redis:5.0 ✖ sudo bash kubeDemo/docker/run.sh
- 19. Docker exec ✖sudo dockerexec –it ubuntu bash ✖Process ○ Ps auxw ✖Mount ○ Mount ✖Network ○ Ifconfig
- 20. Connect to othercontainer. ✖ping 172.18.0.3 ✖Ping 172.18.0.2 ✖Ping 172.18.0.1 ✖redis-cli -h 172.18.0.2 ○ Connect to container directly ✖redis-cli -h 172.18.0.1 ○ Connect to host and forward by iptables
- 21. Storage ✖Mount data fromoutside ○ -v source:dest ✖ sudo docker run -d --name test -v ~/kubeDemo/:/kubeDemo hwchiu/netutils ✖sudo docker exec –it test bash ○ ls /kubeDemo
- 22. How to usedocker ✖Prepare the image you want ✖Run container from the image ✖Connect to container by network ✖Mount directory/file
- 23.
- 24. OS Docker BusyBox b1 Docker run --nameb1 hwchiu/netutils OS Docker BusyBox b2 touch … apk add … empty Docker run --name b2 hwchiu/netutils
- 25. We Need ToKnow How Container Works First
- 26. Image, series ofread-only layers
- 27. DockerFile Image RUN APKadd …. COPY RUN Yarn … a1b2c3d3xxxxx a1b2c3d3xxxxx a1b2c3d3xxxxx
- 28. Image Container 902b87aaaec9 4dcef5c50d60 c34ce3c1fcc0c 9a61b6b1315e Read Only 902b87aaaec9 4dcef5c50d60 c34ce3c1fcc0c 9a61b6b1315e https://docs.docker.com/glossary/?term=Union%20file %20system ContainerLayer Read Write Storage Driver Storage Driver Storage Driver Storage Driver
- 29. Container https://docs.docker.com/glossary/?term=Union%20file %20system Container Layer Container Container Layer Container ContainerLayer Read Write Read Write Read Write Read Only 902b87aaaec9 4dcef5c50d60 c34ce3c1fcc0c 9a61b6b1315e
- 30. When the containeris deleted, the writable layer is also deleted.
- 31. The underlying imageremains unchanged
- 32.
- 33.
- 34. Docker volume createvol Docker run –d –v vol:/app nginx Docker run –d -v /home/nginx:/app nginx
- 35. How about advancestorage functions ?
- 36. Storage feature ✖Snapshot ? ✖Dedup(de duplicated) ✖Replica ✖Redundant (RAID?) ✖FileSystem (EXT4/BTRFS/ZFS?) ✖Read/Write Cache ? ✖LVM ?
- 37.
- 38. Container -> WAN WAN-> Container Container -> Container
- 39.
- 40. Docker Use BridgeNetwork To Provide Network Connectivity by default.
- 41.
- 42. br0 br0 br0br0br0 Container vth1 vth1vth1 Linux HostLinux Host Linux Host Linux HostLinux HostLinux Host ContainerContainerContainer vth0vth0vth0
- 43. Network namespace demo nsns eth0eth0 br0vth0 vth0 1.2.3.4 1.2.3.1 1.2.3.5
- 44. Docker run –p6379:6379 nginx
- 45. ✖Sudo iptables-save –tnat | grep DOCKER
- 46. How About AdvancedNetworking Features?
- 47. Docker provides thebasic functionality of storage/network
- 48.
- 49. Docker compose ✖Use aYAML to configure your application’s services. ✖Running multi-container applications. ✖Friendly for VCS/CI/CD
- 50. Docker-compose up version: '3' services: app: image:hwchiu/netutils:latest networks: - redis-net depends_on: - redis redis: image: redis:5.0 hostname: redis networks: - redis-net networks: redis-net:
- 51.
- 52.
- 53.
- 54.
- 55.
- 56. Access Control Service Discovery ComputingResources (CPU/GPU) Service Mesh Container Deployment ……
- 57.
- 58.
- 59. Kubernetes is becomingthe Linux of the cloud Jim Zemlin, Linux Foundation
- 60. Before kubernetes ✖Google hasbeen running containerized workloads in production. ○ Virtually everything runs as a container. ✖Borg: The predecessor to Kubernetes ○ Long-rumored internal container- oriented cluster-management system. ○ Pod ○ Services ○ Label https://kubernetes.io/blog/2015/04/borg-predecessor-to- kubernetes/
- 61. Kubernetes architecture Users ControlPlane Nodes https://www.flaticon.com/free-icon/boy_145867 API Server Scheduler Controller Node (VM) Node (Bare Metal) Node (Container) CLI DISPATCH
- 62. Kubernetes architecture Users ControlPlane Nodes https://www.flaticon.com/free-icon/boy_145867 API Server Scheduler Controller Node (VM) Node (Bare Metal) Node (Container) CLI DISPATCH I want to deploy a container
- 63. Kubernetes architecture Users ControlPlane Nodes https://www.flaticon.com/free-icon/boy_145867 API Server Scheduler Controller Node (VM) Node (Bare Metal) Node (Container) CLI DISPATCH Find a target node
- 64. Kubernetes architecture Users ControlPlane Nodes https://www.flaticon.com/free-icon/boy_145867 API Server Scheduler Controller Node (VM) Node (Bare Metal) Node (Container) CLI DISPATCH Dispatch Container
- 65. Kubernetes architecture Users ControlPlane Nodes https://www.flaticon.com/free-icon/boy_145867 API Server Scheduler Controller Node (VM) Node (Bare Metal) Node (Container) CLI DISPATCH Running Container
- 66.
- 67. Host 1 Host 2 Host3 Host 4 Host 5 Host 6 Host 7 Host 1 Host 2 Host 3 Host 4 Host 5 Host 6 Host 7 Host 2 Host 3 Host 4 Host 5 Host 6 Host 6 Predicate Priority Select
- 68.
- 69.
- 70.
- 71. Workloads ✖Pod ✖Deployment ✖Daemon Set ✖Job ✖Cron Job ✖StatefulSet ✖Replica Set
- 72. pod ✖A single instancesof application in Kubernetes ✖Group of containers ✖Those containers shares ○ IP address ○ File System ○ Network namespace
- 73.
- 74. Pod ✖cd kubeDemo/services/application ✖kubectl apply–f ubuntu.yml ✖kubectl get pods –o wide ○ Get the IP address of that pod. ✖kubectl describe pod ubuntu ○ Show pod detail ✖kubectl exec –it ubuntu bash ○ Like `docker exec …` ✖kubectl delete pod ubuntu ○ kubectl get pods
- 75. replica Set ✖Maintain astable set of replica Pods running at any given time. ✖Guarantee the availability of a specified number of identical Pods.
- 76. Replica Set replica=3 Node NodeNode Node Pod Pod Pod
- 77. deployment ✖Rollouts as aService ✖Update ○ Rolling update ○ Recreate ✖Manage Replica Set and Pod
- 78. Deployment - replicas: 3 -version: v1 Replica Set replica=3 Pod Pod Pod Deployment
- 79. Deployment - replicas: 3 -version: v1 Replica Set replica=3 Pod Pod Pod Deployment Deployment - replicas: 0 - version: v2 Replica Set replica=0 Deployment
- 80. Deployment - replicas: 3 -version: v1 Replica Set replica=3 Pod Pod Pod Deployment Deployment - replicas: 1 - version: v2 Replica Set replica=1 Pod Deployment
- 81. Deployment - replicas: 2 -version: v1 Replica Set replica=2 Pod Pod Deployment Deployment - replicas: 1 - version: v2 Replica Set replica=1 Pod Deployment
- 82. Deployment - replicas: 2 -version: v1 Replica Set replica=3 Pod Pod Deployment Deployment - replicas: 2 - version: v2 Replica Set replica=2 Pod Pod Deployment
- 83. Deployment - replicas: 1 -version: v1 Replica Set replica=1 Pod Deployment Deployment - replicas: 2 - version: v2 Replica Set replica=2 Pod Pod Deployment
- 84. Deployment - replicas: 1 -version: v1 Replica Set replica=1 Pod Deployment Deployment - replicas: 3 - version: v2 Replica Set replica=3 Pod Pod Pod Deployment
- 85. Deployment - replicas: 0 -version: v1 Replica Set replica=0 Deployment Deployment - replicas: 3 - version: v2 Replica Set replica=3 Pod Pod Pod Deployment
- 86. Deployment ✖cd kubeDemo/services/deployment ✖kubectl apply–f redis.yml ✖kubectl get pods –o wide ○ Get the IP address of all pod. ✖kubectl exec –it redis-xxx bash ○ Like `docker exec …` ✖kubectl delete pod redis-xxxx ○ kubectl get pods ✖kubectl get pods –o wide ○ Get the IP address of all pod.
- 87.
- 88. network ✖Network Connectivity ○ Containerto Container (Same Node) ○ Container to Container (Cross Node) ✖Service ○ Wan to Container ✖Ingress ○ Wan to Container ✖Network Policy
- 89. Network connectivity ✖Container NetworkPlugin (CNI) ✖Container to Container (Same Node) ○ Simplest approach is bridge mode ○ Same as Docker default network ✖Container to Container (Cross Node) ○ Overlay Network (VXLAN/GRE) ○ L3 Routing ○ … etc
- 90. Pod network ✖Group ofContainers share same network environment ✖Communicate by localhost ○ Use same IP address ○ Port conflict ✖How does it works ?
- 91.
- 92.
- 93. Pod infrastructure Pod 172.17.17.2 PID/Network/UTC Namespace Container Pause eth0 Container Nginx Container Redis All user-definedcontainers are attached to Pause container.
- 94.
- 95.
- 96. Before We TalkAbout Service, We Must Know Why Service Exist.
- 97. Deployment Node1 Nginx Node2 Nginx Node3 Nginx Kubernetes Cluster ✖Deployment: ○ Ngnix ○Replica: 3 10.123.234.56 10.123.234.57 10.123.234.58
- 98. Access ✖How does applicationaccess those Nginx servers? ✖IP address ○ 10.123.234.56:80 ○ 10.123.234.57:80 ○ 10.123.234.58:80
- 99. Deployment Node1 Nginx Node2 Nginx Node3 Nginx Kubernetes Cluster ✖Deployment: ○ Ngnix ○Replica: 3 10.123.234.56 10.123.234.57 10.123.234.58
- 100. Deployment Node1 Nginx Node2 Nginx Node3 Nginx Kubernetes Cluster ✖Deployment: ○ Ngnix ○Replica: 3 10.123.234.56 10.123.234.57 10.123.234.75
- 101. That’s Why WeNeed Service
- 102. Service Node1 Nginx Node2 Nginx Node3 Nginx Kubernetes Cluster 10.123.234.56 10.123.234.5710.123.234.58 App Service Nginx
- 103. Service ✖Application to Service ○We use the DNS to access the service. ○ $(service).$(namespace).cluster.local ✖Service to Pods ○ Service maintains all IP addresses of all Pods. ○ We call it endpoints
- 104. services ✖cd kubeDemo/services/service ✖kubectl apply–f redis-cluster ✖kubectl get svc ○ Get service detail ✖kubectl exec –it ubuntu bash ○ Like `docker exec …` ○ nslookup redis-cluster
- 105. summary ✖Kubernetes use CNIto provide the basic network function for Pods ✖Service provide a DNS entry for all backend servers
- 106.
- 107. Ask Yourself BeforeUsing it
- 108. Do I ReallyNeed Kubernetes ?
- 109.
- 110. Flexible Infrastructure ✖Plugin Based ○Container Runtime Interface ○ Device Plugin ○ Container Storage Interface ○ Container Network Interface ✖Developing life cycle ✖Support by third-party
- 111.
- 112.
- 113. CRI ✖Is container omniscient? ✖Containerlized applications ○ Dockerfile ? ○ Refactor? ✖Treat container as Virtual Machine ✖Micro Service ?
- 114. Device Plugin ✖Third-party plugin ○Nvidia GPU ○ RDMA ○ SRIOV ○ AMD GPU ○ Intel GPU/FPGA/Quick-Assist ✖Are those plugin production-ready ? ○ Stable?
- 115. GPU ✖GPU Device Plugin ✖GPUvirtualization ✖GPU Dispatches ○ Node1: 1 ○ Node2: 1 ○ Node3: 0 ✖Pod require 2 GPU ○ ? ✖Two Pods use 1 GPU in Node 1 ○ ?
- 116.
- 117. Storage ✖Container Storage Interface ✖Connectto storage provider ✖Can kubernetes handle all storage issues ?
- 118. Storage ✖FileSystem ○ Zfs/ext4/btrfs/…etc ✖Block Device ✖DistributedFS ○ Ceph/GlusterFS/BeeGFS ✖RAID/LVM ✖Read/Write Cache
- 120. Summary ✖Kubernetes doesn’t provideany storage function. ✖It rely on backend storage provider. ✖Choose a proper storage to meet your requirement ✖Learn the concept/knowledge about storage
- 121. Network ✖Container Container Interface ✖Abinary to setup the networking function ✖Can kubernetes handle all networking issues ?
- 122. Network ✖Network Topology ○ Fat-Tree,Leaf-Spine, ○ LAG, MC-LAG, Bonding ✖Routing related ○ BGP, OSPF, DSR, RIP ○ ECMP ✖Network protocol ○ IPv4/IPv6/Multicast/Broadcast/TCP/UDP /MPTCP/STCP/QUIC ✖Network tools ○ Iptables/tun/tap
- 123. Network ✖SDN concept ○ Switch ○Controller ✖Logical Network ○ VLAN/VXLAN/GRE/NVGRE ✖High Performance Network ○ DPDK/RDMA/Smart NIC
- 124. What you want? ✖IPv4Address ○ Multiple addresses? ✖Connect to Host ○ Veth ○ Host-local ○ SRIOV ? ✖Routing ○ Static/Dynamic ✖Overlay network
- 125. summary ✖CNI provide thenetwork connectivity ✖Service/Ingress may conflict with CNI ✖Need experience to debug networking issues
- 127. summary ✖Know what youwant first ✖Evaluation ✖Check third-party solution ○ Production Ready? ○ Testing? ✖Check your resources
- 128.