[Open infra] how to calculate the cloud system operating rate

How to Calculate
the Cloud System Operating Rate
1
Nalee Jang, Consultant of Red Hat Korea

2
About me
IT Expert on the Cloud!
I am a Consultant working with OpenStack and Cloud Platform of Red Hat Korea.
● My Name is NaleeJang.
● I am a Cloud Platform Consultant of Red Hat Korea.
● I was awarded HP Helion MVP(Most Valuable Professional, 2015.06.05) 7 years ago.
● I published 2 books. One of the book is "The Art of OpenStack", and other book is
"Easy Shell Script".
● I also have a patent for system and method for providing cloud market service for
sale contents base on software as a service 7 years ago (2015.09.25).
● I sometimes post my technical experience on my blog(http://naleejang.tistory.com)
● Also I usually use Facebook(http://www.facebook.com/naleejang)
● I was second leader of OpenStack Korea User Group. but I am just a member now.
(http://www.facebook.com/groups/openstack.kr/) (http://www.openstack.or.kr/)
OpenInfra Days Asia 2021
** The Art of OpenStack second edition / 20-May-2017 / Gilbut
*** Easy Shell Script / 1-February-2021 / Hanbit media

3
Motivation of this Session
Agenda
Cloud Virtualization Ratio
Cloud Operating Ratio

4
How to Calculate the Cloud System Operating Rate
➢ What is the Cloud?
➢ Cloud Services
➢ Red Hat Cloud Platforms
➢ Purpose of this Session

5
What is the Cloud?
Cloud Service
server
storage
network
vm
container
notebook
desktop
smart tv
smart phone
smart pad
Cloud service contains Infra services (IaaS),
platform services (PaaS) and software services
(SaaS). Infra service provides infrastructure such
as server, storage, and network through the
Internet. Platform service provides a
development environment such as a web servers
and databases. Software service provides
applications such as web or apps.
Cloud service can be accessed and used anytime,
anywhere as long as there is a smart device
capable of internet such as a smartphone, smart
pad, desktop, or notebook.

6
Cloud Services
Cloud technologies Cloud Services
Many companies are providing cloud services using cloud technologies like OpenStack and Kubernetes.

7
Red Hat Cloud Platforms
Many companies in Asia adopted Red Hat Cloud Platforms like OpenStack and OpenShift for building their cloud services.

8
Purpose of this Session
Let’s assume cloud system adoption in your company.
How do you calculate sizing when you adopt cloud system?
Do you know about cloud system building steps?

9
➢ OpenStack and Kubernetes
➢ Virtualization of Cloud Service
➢ Necessary Items
➢ Finding an Efficient
Virtualization Ratio

10
OpenStack and Kubernetes
VS
OpenStack Kubernetes

11
VS

12
VS
VM Container
VM VM Container
Container

13
VS
VM Container
VM VM Container
Container
OpenStack - Compute Service for providing Virtual Machine
Normally, OpenStack does not use all cloud resources.
It use some resources of host node by characteristic of created
vm. So for use virtual resources efficiently, resources like cpu set
hyperthread and use higher virtualization ratio.
Kubernetes - Container Service
Kubernetes is open source made by Google for managing
containers.
Container is lighter then vms and has good portability because
application is utilizing kernel of host node. Container can be used
on both bare metal or virtual machine if there is linux OS. So,
Container no consider virtualization. It use resources provides at
host.

14
Virtualization of Cloud Service
How can I use
resources efficiently
in OpenStack?

15
Necessary Items of Virtualization Ratio
Flavors
Flavor is a spec like cpu, memory, disk
for creating virtual machine.
HW Specs
It means here H/W is openstack
compute node. We need compute
node h/w spec.
Necessary items for finding
virtualization ratio are vm
flavors and compute node
h/w spec.

16
An Example of Virtualization Ratio
01 Compute1 Node H/W Spec
Available
Rate
CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
100 % 16 32 64 96 128 512
70 % 11 22 45 67 89 358
Available
Rate
CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
100 % 40 80 160 240 320 576
70 % 28 56 112 168 224 403
Let's assume hardware
with the following spec.
Compute1
- CPU 16 cores
- Memory 512 GB
Compute2
- CPU 40 cores
- Memory 576 GB
** Most data center keep 70% resource of system.

17
An Example for Virtualization Ratio
01 Standard Instance Type
Name CPU Memory
t2.nano 1 0.5
t2.micro 1 1
t2.small 1 2
t2.medium 2 4
t2.large 2 8
t2.xlarge 4 16
t2.2xlarge 8 32
02 Large Memory Instance Type
Name CPU Memory
m1.medium 1 8
m1.large 2 16
m1.xlarge 4 32
m1.2xlarge 8 64
m1.4xlarge 16 128
Flavor is vm spec.

18
Finding an Efficient Virtualization Ratio
01 Standard Flavor matrix for finding optimized virtualization ratio
Name CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
t2.nano 11 22 45 67 90 717
t2.micro 11 22 45 67 90 358
t2.small 11 22 45 67 90 179
t2.medium 6 11 22 34 45 90
t2.large 6 11 22 34 45 64
t2.xlarge 3 6 11 17 22 22
t2.2xlarge 1 3 6 8 11 11
Let's calculate the
standard flavor with
compute1
Compute1
- CPU 16 cores
- Memory 512 GB
t2.xlarge 4 16
Flavor
creatable vm count
= available cpu / flavor cpu
= available memory / flavor memory
(16 * 0.7) / 4 = 3
((16*2*4) * 0.7) / 4 = 22

19
02 Large Memory Flavor matrix for finding optimized virtualization ratio
Name CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
m1.medium 11.2 22.4 44.8 67.2 89.6 44.8
m1.large 5.6 11.2 22.4 33.6 44.8 22.4
m1.xlarge 2.8 5.6 11.2 16.8 22.4 11.2
m1.2xlarge 1.4 2.8 5.6 8.4 11.2 5.6
m1.4xlarge 0.7 1.4 2.8 4.2 5.6 2.8
m1.2xlarge 8 64
creatable vm count
Flavor
((16*2*2) * 0.7) / 8 = 5.6
(512 * 0.7) / 64 = 5.6
Let's calculate the large
memory flavor with
compute1
Compute1
- CPU 16 cores
- Memory 512 GB

20
01 Standard Flavor matrix for finding optimized virtualization ratio
Name CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
t2.nano 28 56 112 67 90 806
t2.micro 28 56 112 67 90 403
t2.small 28 56 112 67 90 202
t2.medium 14 28 56 34 45 101
t2.large 14 28 56 34 45 50
t2.xlarge 7 14 28 17 22 25
t2.2xlarge 3.5 7 14 8 11 13
Let's calculate the
standard flavor with
compute2
Compute2
- CPU 40 cores
- Memory 576 GB
((40*2*2) * 0.7) / 2 = 56
t2.large 2 8
Flavor
(576 * 0.7) / 8 = 50
creatable vm count

21
02 Large Memory Flavor matrix for finding optimized virtualization ratio
Name CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
m1.medium 28 56 112 168 224 50.4
m1.large 14 28 56 84 112 25.2
m1.xlarge 7 14 28 42 56 12.6
m1.2xlarge 3.5 7 14 21 28 6.3
m1.4xlarge 1.75 3.5 7 10.5 14 3.15
((40*2) * 0.7) / 8 = 7
m1.2xlarge 8 64
Flavor
(576 * 0.7) / 64 = 6.3
Let's calculate the large
memory flavor with
compute2
Compute2
- CPU 40 cores
- Memory 576 GB
creatable vm count

22
How to find cloud system operating ratio
Available
Rate
CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
100 % 16 32 64 96 128 512
70 % 11 22 45 67 89 358
Available
Rate
CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
100 % 40 80 160 240 320 576
70 % 28 56 112 168 224 403
How do I find cloud
system operating
ratio?

23
➢ Core Function
➢ Live Migration
➢ Core Items
➢ Finding Cloud System
Operating Ratio

24
Core Function
OpenStack Live Migration
Kubernetes Drain

25
What is Live Migration?
Live Migration is migrating live state of a virtual machine(power on state) to
specific other hosts. If we use live migration in OpenStack, shared storage must
use cinder backend like NFS, ISCSI, FC(Fiber Channel) or Ceph Storage.

26
Core Item for Cloud Operating Ratio
01 Operating ratio list of the example compute node
Rate CPU Cores CPU Hyperthread CPU Rate 2:1 Memory
100 % 40 80 160 576
70 % 28 56 112 403
60 % 24 48 96 346
50 % 20 40 80 288
40 % 18 36 72 259
Let's assume hardware
with the following spec.
Compute
- CPU 40 cores
- Memory 576 GB

27
Core Item for Cloud Operating Ratio
01 Host operating ratio 02 2 Computes migration case 03 3 Computes migration case 04 4 Computes migration case
100% 70% 60% 50% 45% 45% 45% 60% 60% 70% 70%
Let’s assume we want to migrate single node resources to other compute nodes in case we have 2, 3 ,4 compute nodes.

28
Finding Cloud System Operating Ratio
Compute count Resource Rate Migration Host Count
2 45 % 1
3 62 % 1
4 70 % 1
5 55 % 2
6 62 % 2
7 66 % 2
8 70 % 2
01 An Example about Cloud System Operating Ratio
Let's see the formula for calculating cloud system
operating ratio
Cloud Resource Rate =
100 - ((Migration Host Count / Total Compute Count * 100) + 5)
This table shows cloud system operating ratio calculated using above formula.
For example,
In the 2 compute node case, we need to keep 45% of compute resources.
because if problem happens, we can migrate 1 node resources to other 1 node.

29
Conclude
● OpenStack and Kubernetes have different technical background.
● We need vm flavors and compute node h/w spec for finding efficient virtualization ratio.
● When CPU uses hyperthread, 2:1, 3:1, 4:1 ratios can be achieved. And if we calculate how many vms of given flavor can be created,
you can find CPU virtualization ratio that uses memory efficiently.
● Live migration is core function for finding cloud operating ratio in OpenStack.
● To operate cloud resources efficiency, we need to consider how many compute nodes we will need in case of emergency.
● The formula for finding cloud operating ratio is below.
○ Cloud Resource Rate = 100 - ((Migration Host Count / Total Compute Count * 100) + 5)
Thank you for attending this event "OpenInfra Days Asia 2021"

openstack.kr
http://www.openstack.or.kr
http://bit.ly/openstack-kr-videos
h
30
Thank you
OpenStack is a cloud operating system that controls large
pools of compute, storage, and networking resources
throughout a datacenter, all managed and provisioned
through APIs with common authentication mechanisms.

[Open infra] how to calculate the cloud system operating rate

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to [Open infra] how to calculate the cloud system operating rate

Similar to [Open infra] how to calculate the cloud system operating rate (20)

More from Nalee Jang

More from Nalee Jang (20)

Recently uploaded

Recently uploaded (20)

[Open infra] how to calculate the cloud system operating rate