Packaging Strategy for Community Openstack and Implementation Reference | Hojin Kim

1. Packaging strategy for Community openstack
and Implementation reference
Hojin Kim
- Organizer in OpenStack Korea User Group
- Solution Architect in Open Source Consulting

2. Example.1 -5
SUMMARY

5. ü replace PCI adapter without downtime
ü X86 Hardware Architecture Limitations -
(Internal I/O path redundancy / self free path )
ü redundant BIOS (service processor card)
üFault Analysis Limitations in X86
(multi-vendor )
OR H 6B /
3 8 /
3 C 1 883 /
6 7 0 /
3 A613 13 /
E NI UG 6B /
13 0 0 80 3 /
0 3 83 B
M PD 6B /
3 /
The internal I/O subsystem
on the Power E870C and
Power E880C is connected
to the PCIe Controllers on
a POWER8 processor in
the system. Each
POWER8 processor
module has two buses
86 3 3 8013 3
3 0 1C
3B 0 0 0 8 83 0 13

6. storage
SAN
Network
infrastructure Management
AppS
storage
SAN
Different vendor
vendor-lockin
not scaleable
virtualizatrion
VM VM
virtualization
VM VM
Scale-up
Network
business/divison unit
load on thebbackbone
Vendor dependent API
Individual management
(server/storage/network)

7. CoreServices: OptionalServices:
Removed vendor dependency / Admin managed directly
User can change any configuration right away (within 10 minutes)
possible to zone according to their performance (old machines, new machines)
M
A
N
A
G
E
M
E
N
T
stora
ge
N
E
T
W
O
R
K
stora
ge
stora
ge
stora
ge
com
pute
com
pute
com
pute
com
pute
Netw
ork
Netw
ork
Netw
ork
Netw
ork
Cont
roller
컨트
롤러
노드
컨트
롤러
노드
Unification with
Low Cost
Hardware (X86)
Remove vendor
dependencies
API
Infinite
expansion at
the same cost
Only
HW L2
Switch plug-ins
ad
min

9. • Solutions created by the most of technology-oriented vendors
HP
19%
Mirantis
19%
Red Hat
18%
IBM
12%
*indepen
dent
10%
Rackspace
8%
Huawei
5%
Cisco…
Intel
3%
SUSE
3%
OPENSTACK CONTRIBUTION TO LIBERTY VERSION
Openstack community Platinum Members
OpenStack community Gold Members

11. pckaged
by Oracle
pckaged
by CICSO
pckaged
by RedHat
use
RedHat/SuSe
pkg
pckaged
by IBM
pckaged
by Mirantis
pckaged
by HP
pckaged
by Platform9
pckaged
by Suse
pckaged
by Easystack
pckaged
by Hawei
pckaged
by Rackspace

12. • consisting of projects with securing stability and maturity of 6 or higher
• Upstream community version of OpenStack is the most stable openstack version
•
•
•
• Good communication with the openstack community
• overall knowledge of internal structure of OpenStack

14. Example.1 – migration from Commercial OpenStack to
Community OpenStack

15. Changed all
componenets to
community Openstack
ability to upgrade with
own human resources
remove vendor lock-in
mitaka Queens
Zabbix + EFK Composition (Elasticsearch + Fluentd + Kibina)
Why?
Mirantis gave up the openstack
business in Korea -> no support
need to add new services

16. Changed manilla to highly available
(HA) architecture using pacemaker
Overcame SPOF by changing to
Active/Standby approach pacemaker
Zabbix + EFK Composition
(Elasticsearch + Fluentd + Kibina)
Build monitoring with 3 + Grafana
configuration
HA configuration with Haproxy and
Keepalived
VIP(Keepalived+haproxy+Pacemaker)

17. Example.2 - Building GPU server farm for Big Data
and AI analytics

18. GPU
Tesla V100(Volta)

20. Example.3 - Flexibility of infrastructure built in the cloud
(openstack <-> AWS) – cryptocurrency market
www.conizest.com

21. configuration map

22. instance type CPU
Memory
(GB)
On-Deman
d Cost per
Hour
On-Demand Cost per
Month
(Include Storage)
Mq.m5xlarge 4 16 0.708 $ 509.760
instance type CPU
Memory
(GB)
On-Deman
d Cost per
Hour
On-Demand Cost per
Month
m5xlarge 4 16 0.236 $ 169.920
Rabbit MQ selfmanaged (IaaS)
Amazon MQ (SaaS)
TCO
community
openstack

23. Example.4 – IOT platform (openstack <-> AWS)

25. number name tag model size cpu core memory spec disk path network
1-1 netgear net gs716t 1u 1g*16
1-2 dl160 server gen8 2 4core-8core 4G*4 10600R 200G 1g*2
1-3 paloalto net 1u 1g*16
2-1 netgear net gs716t 1u 1g*16
2-2 dl120 server gen6 1 4 2g*2 10600R 300G 1g*2
2-3 dl120 server gen6 1 4 2g*2 10600R 300G 1g*2
3-1 dl380 server gen8 2u 1 6core-10core 4G*4 10600R 500G*2/200G*1 1g*4
4-1 dl380 server gen7 2u 1 4core-6core 2G*6 10600R 500G*2 1g*4
4-2 paloalto net 1u 1g*16
4-3 dl380 server gen7 2u 1 4core-6core 2G*6 10600R 500G*2 1g*4
4-4 netgear net gs716t 1u 1g*16
5-1 dl360 server gen7 1u 1 146G*4 1g*4
5-2 dl160 server gen8 1u 2 4core-8core 4G*4 10600R 300G*2 1g*2
5-3 dl160 server gen8 1u 2 4core-8core 4G*4 10600R 1g*2
5-4 dl160 server gen8 1u 2 4core-8core 4G*4 10600R 300G*4 1g*2
6-1 dl380 server gen7 2u 1 4core-6core 4G*1 10600R 148G*8 6G/sas 1g*4
6-2 dl380 server gen7 2u 1 4core-6core 4G*1 10600R 148G*8 6G/sas 1g*4
6-3 dl360 server gen7 1u 1 4core-6core 146G*4 6G/sas 1g*4
6-4 dl360 server gen7 1u 1 4core-6core 146G*4 6G/sas 1g*4
7-1 dell server r620 1u 2 8G 12800R 500G*2 1g*4
8-1 dl160 server gen8 1u 2 4core-8core 4G*2 10600R 200G*1 1g*2
8-2 dl380 server gen7 2u 1 4core-6core 2G*6 10600R 500G*2 1g*4
8-3 netgear net gs716t 1u 1g*16
Needed purchase sum
dl380 gen8 socket 1
memory 416G
network 1G 2port 5
HDD 1TB*3
controller server
comput server
storage server
monitoring server

26. Example.5 – Map Information Open Platform
(www.vworld.kr)

27. Internet
web
firewall
Router
fireall HA
HA
L7 Switch
L2 Switch
L7 Switch
internet zone internal zone
HA L2 Switch
10G 망
vpn serer
#1
CDN
#1 ~ #3
VLAN100
VLAN300 VLAN500
VLAN100
IPMI
1G Network
10G Network
VLAN200 VLAN400
VLAN300 VLAN500
VLAN100 L2 1G Switch
L2 1G Switch
WEB SERVER VM GROUP
Portal WEB
#1 ~ #6
3D WEB
#1 ~ #6
Tile WEB
#1 ~ #3
WMS WEB
#1 ~ #3
WFS WEB
#1, #2
Vector Tile
WEB #1, #2
3D WAS
#1 ~ #6
Portal WAS
#1, #2
WMS WAS
#1 ~ #4
WFS WAS
#1 ~ #4
Vector Tile
WAS #1, #2
Tile WAS
#1 ~ #3
search
#1, #2
DB server
#1, #2
DB SERVER
VM GROUP
backup
#1
VLAN200
WAS SERVER VM GROUP
ceph storage monitoring
#1 ~ #3
VLAN100
VLAN500
ceph Storage
#1 ~ #20
VLAN100
VLAN500
VLAN400
Computing
#1 ~ #8
computing
(rendering-GPU)
#1, #2
Controller server
#1 ~ #3
VLAN200
VLAN100 VLAN300
VLAN500
VM VM VM VM
VM VM
VM
VM VM
VM
VM
VM
VM
VM
VM
VM VM
VM VM
VM VM
VM
VM VM
VM
VM VM
VM
VM VM
VM
VM VM
VM VM VM
VM
VM VM
VM VM VM
VM
VM VM
VM VM

28. § Cloud for map data service
containing 50TB of data in
5 billion files
§ Configured with IBM gpfs
as shared file system
§ Changed most applications to
open source equivalents
§ In parallel also migrated from
IBM AIX to Linux (unix-2-Linux)

29. summary

30. /
/ /
Community
OpenStack
Optimized for large
storage
AI / ML
Infrastructure
Big Data
platform
hybrid cloud
Infrastructure that can
accommodate various
infrastructure requests