1. © 2022 Akamai | Confidential
1
MyNOG 14th June
2023 : Kubernetes
autoscaling and
load balancing
Yin Loong CHAO
Akamai

2. © 2022 Akamai | Confidential
2
Purpose of talk
● Kubernetes and containers defacto cloud operating
system
● Network operators increasingly using K8S for their
workloads like netops, AIOps, 5G functions
● Take advantage of the native scaling flexibility and load
balancing capabilities of kubernetes

3. © 2022 Akamai | Confidential
3
Agenda
● Kubernetes Intro
● Setting up pod autoscaling + node auto scaling.
● Load balancing in Kubernetes pods
● Use cases

4. © 2022 Akamai | Confidential
4
Kubernetes

5. © 2022 Akamai | Confidential
5
Kubernetes networking model

6. © 2022 Akamai | Confidential
6
Kubernetes capacity planning
● Network capacity
● Network plugins
● Subnet size
● Cluster size
● Cluster pod size

7. © 2022 Akamai | Confidential
7
Kubernetes Horizontal Pod Autoscaler Intro

8. © 2022 Akamai | Confidential
8
Installing metrics server
● Install metrics server
● Once you install metrics server you can use top command

9. © 2022 Akamai | Confidential
9
Install Horizontal Pod Autoscaler Operator
● Install horizontal pod autoscaler operator for the application
deployment

10. © 2022 Akamai | Confidential
10
Kubernetes Node Autoscaler

11. © 2022 Akamai | Confidential
11
Enable node autoscaler

12. © 2022 Akamai | Confidential
12
Kubernetes Pods are ephemeral
● Each Pod has its own IP address
● IP address changes as Pods are destroyed and recreated
IP1 IP2 IP3

13. © 2022 Akamai | Confidential
13
Kubernetes Service
● Stable IP Address
● DNS name
● Load Balancing

14. © 2022 Akamai | Confidential
14
Kubernetes Service Type - Cluster IP

15. © 2022 Akamai | Confidential
15
Kubernetes Service Type - Node Port

16. © 2022 Akamai | Confidential
16
Kubernetes Service Type - Load Balancer
● For managed K8S like
LKE, CSP will spin up a
node balancer with an
external IP
● Linode Cloud Controller
Manager
https://github.com/linode/linode-cloud-controller-
manager

17. © 2022 Akamai | Confidential
17
Load Balancing within pods
● Kube-proxy updates iptables within nodes
● Iptables uses statistic method with probabilities

18. © 2022 Akamai | Confidential
18
Use case
● By using service Kubernetes resources, one can harness the
power of Kubernetes for both scalability and self-healing
enabling network operators to serve millions of customers at a
very high level of availability while minimizing cost
● E.g. of workload for Network Operator, include any sort of IT
workloads like websites, billing and even up to 5g Core
Functions on Kubernetes.

19. Q&A

20. Containers Intro