The document discusses running Kubernetes at scale across multiple cloud providers, highlighting the efficiency and performance advantages of container workloads compared to traditional virtual machines. It addresses the challenges associated with public cloud services, including vendor lock-in, and presents options for Kubernetes deployment, including DIY, managed services, and distributions. Further resources for learning about Kubernetes are also provided.

2. 16 – 17 November, SofiaISTACON.ORG
Running Kubernetes at Scale
Across Multiple Cloud Providers
by Iliyan Nenov, Krasimir Semerdzhiev
SAP

3. 16 – 17 November, SofiaISTACON.ORG
Kubernetes 101

4. 16 – 17 November, SofiaISTACON.ORG
Technology Continues to Evolve.
 Where Does Your Company Stand Today?
Containers
Cloud
Native
Open
Source
IaaS
PaaS
Open
Source
PaaS
Virtualiza-
tion
2000 2001 2006 2009 2010 2011
Non-
Virtualized
Hardware
2013 2015
IaaS

5. 16 – 17 November, SofiaISTACON.ORG
Run anywhere
Highly efficient
Lightweight
Standardized
delivery
Cloud ready
Easy to
assemble
Dynamically
managed
Kubernetes 101: The Container Promise

6. 16 – 17 November, SofiaISTACON.ORG
At the same runtime performance1:
containers are deployed
faster2 than regular VMs
1 Identical ScoreMark performance measured for Native + Docker + KVM
2 Start time: 50ms vs 30-45 sec; Stop time: 50ms vs 5-10 sec
Source: https://www.slideshare.net/Flux7Labs/performance-of-docker-vs-vms
900x
Kubernetes 101: The Container Promise

7. 16 – 17 November, SofiaISTACON.ORG
Kubernetes 101: The Container Promise
Running container workloads on a
container management platform
leads to increase1 in annual
CPU utilization
1 McKinsey & Co: Transforming global IT infrastructure to
capture immediate savings; 5-15% vs 70-85%
6x

8. 16 – 17 November, SofiaISTACON.ORG
Kubernetes 101: The Container Promise
All containers on a host
share the same IP address
Container management platforms
resolve that challenge: IP per
container
Host (10.10.10.5)
Proxy
WebApp
#1
WebApp
#2
:80
:80
:8080
:8081

9. 16 – 17 November, SofiaISTACON.ORG
Kubernetes 101: Overall Kubernetes Setup

10. 16 – 17 November, SofiaISTACON.ORG
The Public Cloud Dilemma

11. 16 – 17 November, SofiaISTACON.ORG
The Public Cloud Dilemma
 To Leverage or Not to Leverage
You can use the cloud or spend
your career catching up…

12. 16 – 17 November, SofiaISTACON.ORG
The Public Cloud Dilemma
 To Leverage or Not to Leverage
Microsoft, Google and AWS: Each is spending
more than $10bn a year in infrastructure1 and
is releasing features daily.
1 Datacenter Knowledge (Apr, 2017): Equinix spend analysis
Fact:
Half of the countries in the world have smaller GDP than these companies combined spend on cloud infras

13. 16 – 17 November, SofiaISTACON.ORG
The Public Cloud Dilemma
 Cloud Services Become a Commodity
Source: ilyas-it83.github.io/CloudComparer/
AWS annual new features
rundown

14. 16 – 17 November, SofiaISTACON.ORG
The Public Cloud Dilemma
 Managed Service: Running VMs
Experience: Running VM in AWS/Azure
Underlying XEN/Hyper-V is:
• Installed by AWS/Azure
• Managed by AWS/Azure
• Updated/Patched by AWS/Azure
You really do not want to mess with your hypervisor!

15. 16 – 17 November, SofiaISTACON.ORG
The Public Cloud Dilemma
 Managed Service: Running VMs
Call API to get a VM of the desired size and
use it.

16. 16 – 17 November, SofiaISTACON.ORG
The Public Cloud Dilemma
 Managed Service: AWS EC2
System requirement?
> curl https://ec2.amazonaws.com/?Action=RunInstances
&ImageId=ami-2ey653421sample
&MaxCount=5
&MinCount=2
&Placement.AvailabilityZone=us-east-1a
&Monitoring.Enabled=true
&AUTHPARAMS

17. 16 – 17 November, SofiaISTACON.ORG
System requirement?
> curl
The Public Cloud Dilemma
 Managed Service: MS Azure VMs
"storageProfile": {
"imageReference": {
"id":
"/SID/resourceGroups/providers/Microsoft.Compute/images/sample"
},
"osDisk": {
"name": "osdisk",
"osType": "<Windows or Linux>",
"createOption": "fromImage"
}
}

18. 16 – 17 November, SofiaISTACON.ORG
The Public Cloud Dilemma
 Next level: Containers & Functions
The next frontier of commoditization:

19. 16 – 17 November, SofiaISTACON.ORG
The Public Cloud Dilemma
 Major Issue: Lock-in (1/4)
The 3 stages of Cloud lock-in:
1
3
2
Choosing a platform and adding data
Programmatically connecting to the platform
Using advanced, proprietary features of the platform
Question: Is AWS/Azure/GCP
lock-in a bad thing?

20. 16 – 17 November, SofiaISTACON.ORG
The Public Cloud Dilemma
 Major Issue: Lock-in (2/4)
Question: Is AWS/Azure/GCP
lock-in a bad thing?

21. 16 – 17 November, SofiaISTACON.ORG
The Public Cloud Dilemma
 Major Issue: Lock-in (3/4)
Simple answer: It depends…

22. 16 – 17 November, SofiaISTACON.ORG
The Public Cloud Dilemma
 Major Issue: Lock-in (4/4)
Protect the assets that are really critical for the
company
Look at IaaS, PaaS as powerful value-add enablers. It is extremely
hard to compete with hyper-scaled vendors. Leverage them!
The crown jewels of an enterprise are its data and code base
(apps, algorithms, methodology) which drive differentiation from
competitors.

23. 16 – 17 November, SofiaISTACON.ORG
Options for
Cloud Delivery at Scale
with Kubernetes

24. 16 – 17 November, SofiaISTACON.ORG
Kubernetes Options:
 Many Choices
It’s all about portability – that’s the next “VM”.
Source: blog.kubernetes.io/2017/10

25. 16 – 17 November, SofiaISTACON.ORG
Kubernetes Options:
 #1 Do it Yourself
100% open source – low entry barrier!
Source: github.com/kelseyhightower/kubernetes-the-hard-way

26. 16 – 17 November, SofiaISTACON.ORG
Kubernetes Options:
 #2 Use a Kubernetes distribution
Few questions to consider:
• Open Source vs Proprietary
• Software vs Managed service
• Installed on your resources vs all-in-one
• Wide range of pricing models
Many options - try to choose among the certified
ones!

27. 16 – 17 November, SofiaISTACON.ORG
Kubernetes Options:
 #3 Managed Kubernetes Service (1/2)
Provided by Azure/Google vs 3rd party company
Pricing considerations:
• Control plane infrastructure
• Workers infrastructure
• Updates/Upgrades
• 24x7 Operations and Support
• Price (per month/cluster)
3rd party vendor
managed service
included
included
included
included
(may be) included?
included
Cost of VMs Cost of VMs Cost of VMs
Cost of min 3 VMs
Cost of VMs
+
$ 0
$ 0 $ 0
Cost of VMs
+
$ 0 / $ 109.50
(1-6 nodes is free)
Cost of VMs
+
$ varies
(models include
cores, memory, etc.)

28. 16 – 17 November, SofiaISTACON.ORG
Kubernetes Options:
 #3 Managed Kubernetes Service (2/2)
System requirements:
curl or the corresponding cloud CLI
$ az aks create –g aks –n mycluster
$ az aks get-credentials –g aks –n mycluster
Use kubectl to work with the
cluster
$ gcloud container clusters create mycluster
$ gcloud container clusters get-credentials mycluster
$ kubectl get nodes
NAME STATUS AGE VERSION
aks-agentpool1-125550043-0 Ready 10m v1.8.1
aks-agentpool1-125550043-1 Ready 10m v1.8.1
aks-agentpool1-125550043-2 Ready 10m v1.8.1

29. 16 – 17 November, SofiaISTACON.ORG
Kubernetes Options:
 Key Point: Focus on Portability
Kubernetes does not address every challenge:
• Deliver your software in containers
• Consider the end-to-end system setup
• On-premise connectivity
• Complex network setups
Kubernetes is the “new VM” w.r.t. cloud portability

30. 16 – 17 November, SofiaISTACON.ORG
Further Materials

31. 16 – 17 November, SofiaISTACON.ORG
Additional resources:
Introduction to Kubernetes (Free course)
www.cncf.io/announcement/2017/07/10/
linux-foundation-cncf-edx-org-announce-new-free-intro-kubernetes-course/
Kubernetes Fundamentals (LFS258)
https://training.linuxfoundation.org/
linux-courses/system-administration-training/kubernetes-fundamentals
Certified Kubernetes Administrator (CKA)
https://www.cncf.io/certification/expert/ Source: monster.com

32. 16 – 17 November, SofiaISTACON.ORG
Questions?
Iliyan Nenov
SAP Cloud Platform
@iliyan_nenov
Krasimir Semerdzhiev
SAP Hybris Cloud Services
@evilyeti