Kakaocorp
Cloud
And DataCenter
But also Openstack
Andrew Yongjoon Kong
andrew.kong@kakaocorp.com
LTHlab
KakaocorpAndrew. Yongjoon kong
• Cloud	Technical	Advisory	for	Government	Broad	Cast	Agency
• Adjunct	Prof.	Ajou Univ
• Korea	Data	Base	Agency	Acting	Professor	for	Bigdata
• Member	of	National	Information	Agency	Bigdata Advisory	committee	
• KT	cloudware Tech	lead(ex)!
• Kakao à Daum Kakao à Kakaocorp,	Cloud	Computing	Cell	lead
Supervised,
Korean	
edition
Korean	Edition	
coming	soon.
KakaocorpOur vision.
KakaocorpF1 team
racer	==
developer
F1	car	==
Computing
resource
mechanic	==
engineer
KakaocorpF1 team : Strategy
Fast	Change	means
Successful	Race!
Those	Tires	are
Changed	within
Few	Seconds!
KakaocorpAgile Mith
KakaocorpWhat is Cloud?
• Cloud == “Programmable Resource Management”
• What is Programmable?
• What is Resource?
• What is Management?
• Cloud is the one of the ways of managing/deploying
resources
• Basically, It’s culture.
• Tech. can support this culture
• Our culture is “Automation”
KakaocorpWhat is Data Center?
A	data	center	is	a	facility	that	centralizes	an	organization’s	IT	
operations	and	equipment,	and	where	it	stores,	manages,	and	
disseminates	its	data.
KakaocorpWhat is Data Center? (Before Cloud)
A	data	center	is	a	facility that	centralizes	an	organization’s	IT	
operations	and	equipment,	and	where	it	stores,	manages,	and	
disseminates	its	data.
Tranditional Key	Concepts
KakaocorpWhat is Data Center? (After Cloud)
A	data	center	is	a	facility	that	centralizes an	organization’s	IT	
operations	and	equipment,	and	where	it	stores,	manages,	and	
disseminates	its	data.
New	Key	Concepts	
Centralized
Data
A
P
I
User
KakaocorpCloud Data Center’s Must-have function1 : Centralized CMDB
Centralized
CMDB
Network
Server
storage
ERP
Configuration
Automation
Asset	
Management
Data	Center
Kakaocorp
Data	Center
Cloud Data Center’s must-have function2 : Centralized Measuring
System
Centralized
Measuring
System
Network
Server
storage
billing
Autocaling
Alerting
Monitoroing
Kakaocorp
Data	Center
Cloud Data Center’s must-have function 3 : Central Deploying
System
User:
Defines	
resource
VM
Server
container
DB
Web
was
Queue
scheduler
manager
Centralized
Deploying
System
Resource	Pool
KakaocorpCloud Data Center – Center of Data Management
Centralized
CMDB
Centralized
Measuring
System
Centralized
Deploying
System
Data	Center	Control	Plane
DataCenter Data	plane	
(P.M	/	V.M.	/	Network	/	Cloud	/Container	)
KakaocorpSome Numbers
7xxx VMs is running.
We revealed this already last Feb. in Openstack Community Days, Korea
superuser.openstack.org
KakaocorpSome Numbers
964 tenants
455 pull request since 2014.9
136 VMs are created/deleted per day
KakaocorpSome information about kakao Openstack
openstack release from grizzly to Kilo
total 3Region
additional service Heat/Trove/Sahara
KakaocorpCloud, We do adopt devops culture : KField
KakaocorpCMDB based Configuration Automation
System
team
Network
teamCMDB API
New servers
New servers
New servers
New servers
toolbox
(baremetal
provisioner)
provisioned servers
provisioned servers
provisioned servers
provisioned server
Chef server
Our
Team
NSDB
Central
monitoring
tree
switches, router, vlans
KakaocorpCloud, we do have SDN, not have Openflow, No others
eth0
Compute node
nova-compute
neutron-
linuxbridge-
agent
neutron-dhcp-
agent
Gateway
10.10.100.1
linux bridge
vm
IP:10.10.100.2/32
Routing Table
1 10.10.100.2/32 via 192.1.1.201
BGP
192.1.1.202
BGP
Virtual Switch block
Process block
Neutron-l3-agent
vlan
vlan
Virtual Router
Service Route Table
1 10.10.100.2 via
10.10.100.1
Management Route Table
1
Practice	Frugality	to	Boost	Creativity
No	Subnet,
No	Openvswitch
No	tunnel
No	DPDK
192.1.1.201 Physical Router
KakaocorpIntegrated Information Service Bus & EIP : Code Name KEMI
Based on Opensource
Component
• Kafka
• Samza
• Camel
• Storm
• Gobblin
• Yarn
• HDFS
• Etcd
• OpenTSDB
• Hbase
• Tajo
• Grafana
KakaocorpIntegrated Information Service Bus & EIP : Code Name Kemi
Enterprise Integration
• Topic based Data ETL
• Can cover every computing
resource ( Physical Server,
Virtual instance, Container,
Public Cloud )
• Abstracting “Data Center
Information layer”
• Can make deep engineering
experience over every
resources.
Physical	
Servers
Virtual	
Instances
Containers
External	
Clouds
Others
(switches,	
logs)
monitoring
KEMI
IMS
(kakao CMDB	
API)
SB
Rule	
Engine
Notificati
on	
ETL	
Data Center Information abstraction layer
API	
predicting
scheduling
Openstack
Heat
Other	
Service	
API
Data	Center	(or	Service	)	Management	Activity
control
KakaocorpQ&A
Q&AP.S. We’re hiring, always!
http://www.kakaocorp.com/recruit

Cloud data center and openstack

  • 1.
    Kakaocorp Cloud And DataCenter But alsoOpenstack Andrew Yongjoon Kong andrew.kong@kakaocorp.com LTHlab
  • 2.
    KakaocorpAndrew. Yongjoon kong •Cloud Technical Advisory for Government Broad Cast Agency • Adjunct Prof. Ajou Univ • Korea Data Base Agency Acting Professor for Bigdata • Member of National Information Agency Bigdata Advisory committee • KT cloudware Tech lead(ex)! • Kakao à Daum Kakao à Kakaocorp, Cloud Computing Cell lead Supervised, Korean edition Korean Edition coming soon.
  • 3.
  • 4.
  • 5.
    KakaocorpF1 team :Strategy Fast Change means Successful Race! Those Tires are Changed within Few Seconds!
  • 6.
  • 7.
    KakaocorpWhat is Cloud? •Cloud == “Programmable Resource Management” • What is Programmable? • What is Resource? • What is Management? • Cloud is the one of the ways of managing/deploying resources • Basically, It’s culture. • Tech. can support this culture • Our culture is “Automation”
  • 8.
    KakaocorpWhat is DataCenter? A data center is a facility that centralizes an organization’s IT operations and equipment, and where it stores, manages, and disseminates its data.
  • 9.
    KakaocorpWhat is DataCenter? (Before Cloud) A data center is a facility that centralizes an organization’s IT operations and equipment, and where it stores, manages, and disseminates its data. Tranditional Key Concepts
  • 10.
    KakaocorpWhat is DataCenter? (After Cloud) A data center is a facility that centralizes an organization’s IT operations and equipment, and where it stores, manages, and disseminates its data. New Key Concepts Centralized Data A P I User
  • 11.
    KakaocorpCloud Data Center’sMust-have function1 : Centralized CMDB Centralized CMDB Network Server storage ERP Configuration Automation Asset Management Data Center
  • 12.
    Kakaocorp Data Center Cloud Data Center’smust-have function2 : Centralized Measuring System Centralized Measuring System Network Server storage billing Autocaling Alerting Monitoroing
  • 13.
    Kakaocorp Data Center Cloud Data Center’smust-have function 3 : Central Deploying System User: Defines resource VM Server container DB Web was Queue scheduler manager Centralized Deploying System Resource Pool
  • 14.
    KakaocorpCloud Data Center– Center of Data Management Centralized CMDB Centralized Measuring System Centralized Deploying System Data Center Control Plane DataCenter Data plane (P.M / V.M. / Network / Cloud /Container )
  • 15.
    KakaocorpSome Numbers 7xxx VMsis running. We revealed this already last Feb. in Openstack Community Days, Korea superuser.openstack.org
  • 16.
    KakaocorpSome Numbers 964 tenants 455pull request since 2014.9 136 VMs are created/deleted per day
  • 17.
    KakaocorpSome information aboutkakao Openstack openstack release from grizzly to Kilo total 3Region additional service Heat/Trove/Sahara
  • 18.
    KakaocorpCloud, We doadopt devops culture : KField
  • 19.
    KakaocorpCMDB based ConfigurationAutomation System team Network teamCMDB API New servers New servers New servers New servers toolbox (baremetal provisioner) provisioned servers provisioned servers provisioned servers provisioned server Chef server Our Team NSDB Central monitoring tree switches, router, vlans
  • 20.
    KakaocorpCloud, we dohave SDN, not have Openflow, No others eth0 Compute node nova-compute neutron- linuxbridge- agent neutron-dhcp- agent Gateway 10.10.100.1 linux bridge vm IP:10.10.100.2/32 Routing Table 1 10.10.100.2/32 via 192.1.1.201 BGP 192.1.1.202 BGP Virtual Switch block Process block Neutron-l3-agent vlan vlan Virtual Router Service Route Table 1 10.10.100.2 via 10.10.100.1 Management Route Table 1 Practice Frugality to Boost Creativity No Subnet, No Openvswitch No tunnel No DPDK 192.1.1.201 Physical Router
  • 21.
    KakaocorpIntegrated Information ServiceBus & EIP : Code Name KEMI Based on Opensource Component • Kafka • Samza • Camel • Storm • Gobblin • Yarn • HDFS • Etcd • OpenTSDB • Hbase • Tajo • Grafana
  • 22.
    KakaocorpIntegrated Information ServiceBus & EIP : Code Name Kemi Enterprise Integration • Topic based Data ETL • Can cover every computing resource ( Physical Server, Virtual instance, Container, Public Cloud ) • Abstracting “Data Center Information layer” • Can make deep engineering experience over every resources. Physical Servers Virtual Instances Containers External Clouds Others (switches, logs) monitoring KEMI IMS (kakao CMDB API) SB Rule Engine Notificati on ETL Data Center Information abstraction layer API predicting scheduling Openstack Heat Other Service API Data Center (or Service ) Management Activity control
  • 23.
    KakaocorpQ&A Q&AP.S. We’re hiring,always! http://www.kakaocorp.com/recruit