SlideShare a Scribd company logo
1
Okinawa OpenDays 2015
(スペシャルトラック:事例 2015/12/16)
(in Okinawa OpenLab)
Naoto	
  Gohko	
  <naoto-­‐gohko@gmo.jp>
IT	
  Architect	
  Enginner /	
  GMO	
  Internet	
  Inc.,
OpenStackのモデルの最適化と適用:
ConoHaとZ.comとGMOアプリクラウド
2
šHistory of our services using OpenStack in GMO
Internet Inc.,
šNova-network model and Diablo: Onamae.com VPS
šQuantum overlay network: ConoHa Grizzly cluster
šHigh performance network: GMO AppsCloud(Havana)
šJuno ConoHa: Regison, Domain, DNS and SDS
šJuno GMO AppsCloud: Ironic and copy offload Cinder
šSwift cluster (shared from each OpenStack)
# Agenda
3
About GMO Internet
http://gmo.jp/en
4
Infrastructure Business
5
Using OpenStack at GMO Internet
6
Public Clouds
We are offering four public cloud services.
7
Physical Servers
Running VMPhysical Server
1508
25294
Created VM
Running Infrastructure
137223
8
Swift  cluster
GMO Internet, Inc.: VPS and Cloud services
Onamae.com VPS (2012/03) :
http://www.onamae-server.com/
Forcus: global IPs; provided by simple "nova-network"
tenten VPS (2012/12)
http://www.tenten.vn/
Share of OSS by Group companies in Vietnam
ConoHa VPS (2013/07) :
http://www.conoha.jp/
Forcus: Quantam(Neutron) overlay tenant network
GMO AppsCloud (2014/04) : http://cloud.gmo.jp/
OpenStack Havana based 1st region
Enterprise grade IaaS with block storage, object storage,
LBaaS and baremetal compute was provided
Onamae.com Cloud (2014/11)
http://www.onamae-cloud.com/
Forcus: Low price VM instances, baremetal compute and object storage
ConoHa Cloud (2015/05/18) http://www.conoha.jp/
Forcus: ML2 vxlan overlay, LBaaS, block storage, DNSaaS(Designate)
and original services by keystone auth
OpenStack Diablo
on  CentOS 6.x
Nova
Keystone
Glance
Nova  network
Shared  codes
Quantam
OpenStack Glizzly
on  Ubuntu  12.04
Nova
Keystone
Glance
OpenStack Havana
on  CentOS 6.x
Keystone
Glance
Cinder
Swift
Swift
Shared  cluster
Shared  codes KeystoneGlance
Neutron
Nova Swift
Baremetal compute
Nova
Ceilometer
Baremetal compute
Neutron LBaaS
ovs +  gre tunnel  overlay
Ceilometer
Designate
SwiftOpenStack Juno
on  CentOS 7.x
NovaKeystone
Glance
Cinder
Ceilometer
Neutron
LBaaS
GMO AppsCloud (2015/09/27) : http://cloud.gmo.jp/
2nd region by OpenStack Juno based
Enterprise grade IaaS with High IOPS Ironic Compute and Neutron LBaaS
Upgrade  
Juno
GSLB
Swift
Keystone Glance
CinderCeilometer
Nova
Neutron
Ironic
LBaaS
9
OpenStack Diablo cluster:
• Onamae.com VPS
10
Oname.com VPS(Diablo)	
  
• Service	
  XaaS model:
– VPS	
  (KVM,	
  libvirt)
• Network:
– 1Gbps
• Network	
  model:	
  
– Flat-­‐VLAN	
  (Nova	
  Network),	
  without	
  flotingIP
– IPv4	
  only
• Public	
  API
– None	
  (only	
  web-­‐panel)
• Glance
– None
• Cinder
– None
• ObjectStorage
– None
OpenStack service:  Onamae.com VPS(Diablo)
11
12
Oname.com VPS(Diablo)	
  
• Nova	
  Network:	
  
– very	
  simple(LinuxBridge)
– Flat	
  networking	
  is	
  scalable.
• Only	
  1	
  NIC	
  per	
  VM.
• Only	
  1	
  Public	
  Network	
  IP
– MQ(rabbitmq)	
  dependency	
  is	
  little(sync.	
  API)
• More	
  scalable	
  than	
  Juno,	
  Kilo,	
  Liberty	
  and	
  Mitaka
• Cloud	
  ?
– Only	
  virtulization management
èBut	
  
There	
  is	
  no	
  added	
  value,	
  such	
  as	
  a	
  free	
  configuration	
  of	
  the	
  network
OpenStack service:  Onamae.com VPS(Diablo)
13
OpenStack service:  Onamae.com VPS(Diablo)  model
compute
vm
compute
NIC NIC
Vlan network
bridge
NIC	
  vlan vlan
tap
vNIC
Vlan network
14
OpenStack Grizzly cluster:
• ConoHa
15
ConoHa(Grizzly)
• Service	
  XaaS model:
– VPS	
  +	
  Private	
  networks	
  (KVM	
  +	
  libvirt)
• Network:
– 10Gbps	
  wired(10GBase-­‐T)
• Network	
  model:	
  
– Flat-­‐VLAN	
  +	
  Quantam ovs-­‐GRE	
  overlay
– IPv6/IPv4	
  dualstack
• Public	
  API
– None	
  (only	
  web-­‐panel)
• Glance
– None
• Cinder
– None
• ObjectStorage
– Swift	
  (After	
  Havana)
OpenStack service:  ConoHa(Grizzly)
16
ConoHa(Grizzly)
• Quantam Network:
– It	
  was	
  using	
  the	
  initial	
  version	
  of	
  the	
  Open	
  vSwitch full	
  
mesh	
  GRE-­‐vlan overlay	
  network	
  with	
  LinuxBridge Hybrid
èBut
When	
  the	
  scale	
  becomes	
  large,	
  
Localization	
  occurs	
  to	
  a	
  specific	
  node	
  
of	
  the	
  communication	
  of	
  the	
  GRE-­‐mesh-­‐tunnel
(with	
  under	
  cloud	
  network(L2)	
  problems)
(Broadcast	
  storm?)
OpenStack service:  ConoHa(Grizzly)
17
Grizzly  network:  LibvirtHybridOVSBridgeDriver
OpenStack Docmentより(Nakai san)
18
OpenStack Havana cluster:
• GMO AppsCloud
19
GMO	
  AppsCloud(Havana)
• Service	
  XaaS model:
– KVM	
  compute	
  +	
  Private	
  VLAN	
  networks	
  +	
  Cinder	
  +	
  Swift
• Network:
– 10Gbps	
  wired(10GBase	
  SFP+)
• Network	
  model:	
  
– IPv4	
  Flat-­‐VLAN	
  +	
  Neutron	
  LinuxBridge(not	
   ML2)	
  +	
  Brocade	
  ADX	
  L4-­‐LBaaS	
  original	
  driver
• Public	
  API
– Provided	
  the	
  public	
  API
• Ceilometer
• Glance
– Provided(GlusterFS)
• Cinder
– HP	
  3PAR(Active-­‐Active	
  Multipath	
  original)	
  +	
  NetApp
• ObjectStorage
– Swift	
  cluster	
  
• Bare-­‐Metal	
  Compute
– Modifiyed cobbler	
  bare-­‐metal	
  deploy	
  driver.
OpenStack service:  GMO  AppsCloud(Havana)
20
OpenStack service:  GMO  AppsCloud(Havana)  model
compute
vm
NIC
Vlan network
bridge
NIC	
  vlan
tap
vNIC
Vlan network
vNIC
bridge
vlan
tap
compute
NIC
bridge
NIC	
  vlan
bridge
vlan
public	
  network
Neutronだけどsimpleな
LinuxBridge model
(Context	
  Switchが少ない)
>>	
  Game配信など高速用途の
仮想化ネットワーク
それが、GMO	
  AppsCloud
21
GMO  AppsCloud(Havana)  public  API
22
GMO  AppsCloud(Havana)  public  API
Web	
  panel(httpd,	
  php)
API	
  wrapper	
  proxy
(httpd,	
  php
Framework:	
  fuel	
  php)
Havana
Nova	
  API
Customer	
  sys	
  API
Havana
Neutron API
Havana
Glance	
  API
OpenStack API
for input
validation
Customer DB
Havana
Keystone	
  API
OpenStack API
Havana
Cinder	
  API
Havana
Ceilometer	
  API
Endpoint	
  L7:reverse	
  proxy
Havana
Swift	
  Proxy
23
Havana:  baremetal compute  cobbler  driver
24
Havana:  baremetal compute  cobbler  driver
Baremetal net:
• Bonding	
  NIC
• Taged VLAN
• allowd VLAN	
  +	
  dhcp native	
  VLAN
25
Havana:  baremetal compute  Cisco  iOS  in  southbound
https://code.google.com/p/cisco-ios-cli-automation/
26
OpenStack Juno cluster:
• ConoHa (2)
• GMO AppsCloud (2)
27
Swift  cluster
GMO Internet, Inc.: VPS and Cloud services
Onamae.com VPS (2012/03) :
http://www.onamae-server.com/
Forcus: global IPs; provided by simple "nova-network"
tenten VPS (2012/12)
http://www.tenten.vn/
Share of OSS by Group companies in Vietnam
ConoHa VPS (2013/07) :
http://www.conoha.jp/
Forcus: Quantam(Neutron) overlay tenant network
GMO AppsCloud (2014/04) : http://cloud.gmo.jp/
OpenStack Havana based 1st region
Enterprise grade IaaS with block storage, object storage,
LBaaS and baremetal compute was provided
Onamae.com Cloud (2014/11)
http://www.onamae-cloud.com/
Forcus: Low price VM instances, baremetal compute and object storage
OpenStack Diablo
on  CentOS 6.x
Nova
Keystone
Glance
Nova  network
Shared  codes
Quantam
OpenStack Glizzly
on  Ubuntu  12.04
Nova
Keystone
Glance
OpenStack Havana
on  CentOS 6.x
Keystone
Glance
Cinder
Swift
Swift
Shared  cluster
Shared  codes KeystoneGlance
Neutron
Nova Swift
Baremetal compute
Nova
Ceilometer
Baremetal compute
Neutron LBaaS
ovs +  gre tunnel  overlay
Ceilometer
Upgrade  
Juno
28
OpenStack Juno cluster:
• ConoHa (2)
29
š Multi Region
š SSD Only
š Scalability
š API
š Simple and competitive pricing
# Newly Released ConoHa
30
In	
  ConoHa,	
  We	
  added	
  two	
  additional	
  features.
– Multi-­‐location	
  region
– Domain	
  Structure:	
  	
  Application	
  to	
  multi-­‐location	
  region	
  
structure
– 1	
  Domain	
  ==	
  1	
  OEM	
  service	
  or	
  Product	
  service
– Domain	
  on	
  API	
  validation	
  wrapper	
  proxy	
  
Multi-Location region and domain structures
31
The meaning of the word
• Domain
• Keystone domain
• With v2 API service (our cloud)
• != DNS Domain
• Location
• Different geographic locations on the Earth
• US(San Jose), JP(Tokyo), SG(Singapore)
• Region
• OpenStack region
• Location != Region
• Can setup up multiple Region
in one Location
32
Tokyo
Singapore Sanjose
# ConoHa has data centers in 3 Locations
33
CentOS 7.1 x86_64 Juno (RDO) Maria DB
Connect to Tokyo KeyStone from All regions.
Add each region endpoints to Tokyo KeyStone.
Did not need to modify OpenStack code.
š OS and OpenStack Versions
š Multi Region Setting
# Specs
34
Tokyo Singapole
User/tenant User/tenant
API	
  Management
Keystone API
API	
  Management
Keystone APIAPI	
  Management
Keystone API
Token Token
Tokyo SanJoseSingapore
API	
  Management
Keystone API
API	
  Management
Keystone API
READ/WRITEREAD READ
TokenToken Token
Do not
create/delete
users
Do not
create/delete
users
Our Customer base
User administration
# User-registration is possible in Japan only
DB Replication DB Replication
User/tenant User/tenantUser/tenant
R/W R/W
35
# Issues and Restrictions on Multi Region
š User-registration is possible in Japan only
š VPN performance issue
š Issues on replicating token table.
36
API	
  Management
Keystone API
KeystoneDB
Nova
Neutron Glance
Cinder
OpenStack Cluster
Nova Get/token Glance Get/token
Neutron Get/token Cinder Get/tokenVM Create !
Nova user token:001
Neutron Token:002
Glance Token:003
Cinder Token:004
VM Create !
VM Create !
Nova user token:002
Neutron Token:003
Glance Token:004
Cinder Token:005
Nova user token:006
Neutron Token:007
Glance Token:008
Cinder Token:009
# Bloat access tokens
š Too many tokens will be created from each components.
37
Setting example.conf
[keystone_authtoken]
token= 100 year expires token
[neutron_authtoken]
token= 100 year expires token
[glance_authtoken]
token= 100 year expires token
[cinder_authtoken]
token= 100 year expires token
# Issues on replicating token table.
š 100 year expires token
We fixed it so that any tokens can be used for each components.
38
OpenStack Authentication in Juno
(V2 keystone domains)
39
Why?
40
Swift  cluster
GMO Internet, Inc.: VPS and Cloud services
Onamae.com VPS (2012/03) :
http://www.onamae-server.com/
Forcus: global IPs; provided by simple "nova-network"
tenten VPS (2012/12)
http://www.tenten.vn/
Share of OSS by Group companies in Vietnam
ConoHa VPS (2013/07) :
http://www.conoha.jp/
Forcus: Quantam(Neutron) overlay tenant network
GMO AppsCloud (2014/04) : http://cloud.gmo.jp/
OpenStack Havana based 1st region
Enterprise grade IaaS with block storage, object storage,
LBaaS and baremetal compute was provided
Onamae.com Cloud (2014/11)
http://www.onamae-cloud.com/
Forcus: Low price VM instances, baremetal compute and object storage
ConoHa Cloud (2015/05/18) http://www.conoha.jp/
Forcus: ML2 vxlan overlay, LBaaS, block storage, DNSaaS(Designate)
and original services by keystone auth
OpenStack Diablo
on  CentOS 6.x
Nova
Keystone
Glance
Nova  network
Shared  codes
Quantam
OpenStack Glizzly
on  Ubuntu  12.04
Nova
Keystone
Glance
OpenStack Havana
on  CentOS 6.x
Keystone
Glance
Cinder
Swift
Swift
Shared  cluster
Shared  codes KeystoneGlance
Neutron
Nova Swift
Baremetal compute
Nova
Ceilometer
Baremetal compute
Neutron LBaaS
ovs +  gre tunnel  overlay
Ceilometer
Designate
SwiftOpenStack Juno
on  CentOS 7.x
NovaKeystone
Glance
Cinder
Ceilometer
Neutron
LBaaS
GMO AppsCloud (2015/09/27) : http://cloud.gmo.jp/
2nd region by OpenStack Juno based
Enterprise grade IaaS with High IOPS Ironic Compute and Neutron LBaaS
Upgrade  
Juno
GSLB
Swift
Keystone Glance
CinderCeilometer
Nova
Neutron
Ironic
LBaaS
41
• The	
  cost	
  to	
  operate	
  Multi	
  version	
  Openstack have	
  
increased
• It	
  is	
  difficult	
  to	
  upgrade	
  or	
  add	
  new	
  features
è Managing	
  multiple	
  sites	
  of	
  OpenStack is	
  a	
  headache.
What s the problems abount Multi-Cluster?
42
43
ConoHa: based on OpenStack Juno (IaaS)
• Multiple region openstack cluster
• Tokyo / Singapore / San Jose
• ... and so on
• Full SSD storage
• Multiple keystone service domain support
• ConoHa and Next service (now in development) ... OEM etc.
• LB as a Service: LVS-DSR (original)
• DNS as a service : OpenStack Designate
• OpenStack API and additional RESTful API
• Multiple Languages web panel support
• Japanese, ConoHa, English,
Korean, Mandarin Chinese
44
• Create	
  scope	
  in	
  the	
  domain
– Scoped	
  items
• Flavor
• Images
• Volume	
  type
– Shared	
  items
• Public	
  Networks
• Hypervisor
• Images	
  (Default	
  domain)
• Using	
  Keystone	
  API	
  v2.0
Motivation
45
• We	
  use	
  and	
  customize	
  the	
  code	
  that	
  is	
  in	
  Juno	
  Keystone	
  v3	
  domain
– Enable	
  Domain	
  ID	
  for	
  Juno	
  Keystone	
  V2	
  API
• SaaS	
  implementation	
  with	
  python-­‐keystoneclient	
  
– Process	
  related	
  Domain	
  ID	
  
and	
  Data	
  implementation
èDomain	
  ID	
  from	
  token	
  API
User:	
  
POST	
  /v2.0/token
Admin(service):	
  
GET	
  /v2.0/token/{id}
Juno Keystone V2 API : Does not support Domains
46
Keystone:	
  wrapper	
  proxy	
  at	
  domain	
  specific	
  keystone	
  endpoint
Domains and user prefix namespace
Domain Product Prefix
name	
  space
gnc ConoHa gnc
zjp JP	
  OEM-­‐1 zjp
zsg SG	
  OEM-­‐
1
zsg
...	
  ...	
   OEM-­‐n ...	
  ...
Exp) user: gnc0000348
Image name: gnc_centos7
47
We	
  released	
  2nd service	
  on	
  same	
  Juno	
  infra.	
  
(2015/10/20	
  ~)
Adding domain(2nd): cloud.z.com
48
Diferrent	
  API	
  endpoints	
  in	
  a	
  separate	
  Domain
Multi-Domains and Multi-endpoint
49
Endpoint configuration on keystone
50
OpenStack Juno:  2  service  cluster,  released
MikumoConoHa MikumoAnzu
Mikumo=	
  美雲 =	
  
Beautiful	
  cloud
New	
  Juno	
  region	
  released:	
  
10/26/2015
51
• Service	
  model:	
  Public	
  cloud	
  by	
  KVM
• Network:	
  10Gbps	
  wired(10GBase	
  SFP+)
• Network	
  model:	
  
– Flat-­‐VLAN	
  +	
  Neutron	
  ML2	
  ovs-­‐VXLAN	
  overlay	
  
+	
  ML2	
  LinuxBridge(SaaS	
  only)
– IPv6/IPv4	
  dualstack
• LBaaS:	
  LVS-­‐DSR(original)
• Public	
  API
– Provided	
  the	
  public	
  API	
  (v2	
  Domain)
• Compute	
  node:	
  ALL	
  SSD	
  for	
  booting	
  OS
– Without	
  Cinder	
  boot	
  
• Glance:	
  provided
• Cinder:	
  SSD	
  NexentaStore zfs (SDS)
• Swift	
  (shared	
  Juno	
  cluster)
• Cobbler	
  deplyon	
  under-­‐cloud
– Ansible configuration
• SaaS	
  original	
  service	
  with	
  keystone	
  auth
– Email,	
  web,	
  CPanel and	
  WordPress
OpenStack Juno:  2  service  cluster,  released
• Service	
  model:	
  Public	
  cloud	
  by	
  KVM
• Network:	
  10Gbps	
  wired(10GBase	
  SFP+)
• Network	
  model:	
  
– L4-­‐LB-­‐Nat	
  +	
  Neutron	
  ML2	
  LinuxBridge VLAN
– IPv4	
  only
• LBaaS:	
  Brocade	
  ADX	
  L4-­‐NAT-­‐LB(original)
• Public	
  API
– Provided	
  the	
  public	
  API
• Compute	
  node:	
  Flash	
  cached	
  or	
  SSD
• Glance:	
  provided	
  (NetApp	
  offload)
• Cinder:	
  NetApp	
  storage
• Swift	
  (shared	
  Juno	
  cluster)
• Ironic	
  on	
  under-­‐cloud
– Compute	
  server	
  deploy	
  with	
  Ansible config
• Ironic	
  baremetal compute
– Nexsus Cisco	
  for	
  Tagged	
  VLAN	
  module
– ioMemory configuration
52
OpenStack Designate DNSaaS:
ConoHa:
Z.com(OEM):
53
Designate  DNS:  ConoHa cloud(Juno)
Client API
DNS
Identify
Endpoint
Storage
DB
OpenStack
Keystone
Backend
DB
RabbitMQ
Central
Components	
  of	
  the	
  DNS	
  and	
  GSLB(original) back-­‐end	
  services
Application	
  of	
  Designate	
  DNS:
• DNS	
  as	
  a	
  service(tenant)
• Undercloud Infra-­‐network
• No	
  Keystone	
  auth config
54
OpenStack Cinder Block storage:
ConoHa: NexentaStor(SDS)
AppsCloud: NetApp
55
Compute  and  Cinder(zfs):  SSD
Toshiba	
  enterprise	
  SSD
• The	
  balance	
  of	
  cost	
  and	
  performance	
  we	
  have	
  taken.
• Excellent	
  IOPS	
  performance,	
  low	
  latency
Compute	
  local	
  SSD
The	
  benefits	
  of	
  SSD	
  of	
  Compute	
  of	
  local	
  storage
• The	
  provision	
  of	
  high-­‐speed	
  storage	
  
than	
  cinder	
  boot.
• It	
  is	
  easy	
  to	
  take	
  online	
  live	
  snapshot	
  of	
  vm instance.
• deployment	
  of	
  vm is	
  fast.
ConoHa:	
  Compute	
  option	
  was	
  modified:
• take	
  online	
  live	
  snapshot	
  of	
  vm instance.
http://toshiba.semicon-­‐storage.com/jp/product/storage-­‐
products/publicity/storage-­‐20150914.html
56
NexentaStor zfs cinder:  ConoHa cloud(Juno)
Compute	
  
57
NetApp  storage:  GMO  Appscloud(Juno)
If	
  you	
  are	
  using	
  the	
  same	
  Cluster	
  onTAPNetApp	
  a	
  
Glance	
  and	
  Cinder	
  storage,	
  it	
  is	
  possible	
  to	
  offload	
  
a	
  copy	
  of	
  the	
  inter-­‐service	
  of	
  OpenStack as	
  the	
  
processing	
  of	
  NetApp	
  side.	
  
• Create	
  volume	
  from	
  glance	
  image
((glance	
  the	
  image	
  is	
  converted	
  (ex:	
  qcow2	
  to	
  raw)	
  
required	
  that	
  does	
  not	
  cause	
  the	
  condition)
• Volume	
  QoS limit:	
  Important	
  function	
  of	
  multi-­‐
tenant	
  storage
• Uppper IOPS-­‐limit	
  by	
  volume
58
OpenStack Ironic:
Only AppsCloud:
• Undercloud Ironic deploy
• Multi-tenant Ironic deploy
59
Ironic  with  undercloud:  GMO  Appscloud(Juno)
For	
  Compute	
  server	
  deployment.
Kilo	
  Ironic	
  and	
  All-­‐in-­‐one
• Compute	
  server:	
  10G	
  boot
• Clout-­‐init:	
  network
• Compute	
  setup:	
  Ansible
Under-­‐cloud	
  Ironic(Kilo):
It	
  will	
  use	
  a	
  different	
  
network	
  and	
  Ironic	
  
Baremetal dhcp for	
  Service	
  
baremetal compute	
  
Ironic(Kilo).
(OOO	
  seed	
  server)
Trunk	
  allowed	
  vlan,	
  LACP
60
Ironic(Kilo)  baremetal:  GMO  Appscloud(Juno)
Boot	
  baremetal instance
• baremetal server
(with	
  Fusion	
  ioMemory SanDisk)
• 1G	
  x4	
  bonding	
  +	
  Tagged allowed VLAN
• Clout-­‐init:	
  network	
  +	
  lldp
• Network:	
  Nexsus Cisco
AllowdVLAN	
  security
Ironic	
  Kilo	
  +	
  Juno:	
  Fine
• Ironic	
  Python	
  driver
• Whole	
  Image	
  write
• Windows:	
  OK
61
Ironic  network  multi-‐‑‒tenant  separation
for	
  Mitaka
• https://wiki.openstack.org/wiki/Meetings/Ironic-­‐neutron
• Bare	
  metal	
  physical	
  connectivity	
  scenarios	
  -­‐ supported	
  and	
  unsupported	
  
https://docs.google.com/document/d/1a-­‐
DX4FQZoX1SdTOd9w_Ug6kCKdY1wfrDcR3SKVhWlcQ/view?usp=sharing
• サポートされるシナリオが図解されています(Libertyにおけるもの)
• RackspaceのonMetalの実装もLibertyでは特殊な例
• Neutronがtrunk	
  allowed	
  vlan(tagged)を表現できない(in	
  Liberty)
• Mitaka待ち https://etherpad.openstack.org/p/summit-­‐mitaka-­‐ironic
• ThinkITに解説を参照
https://thinkit.co.jp/article/8443
連載: OpenStack	
  Summit	
  Tokyo	
  レポート
Ironic最新動向:待望のマルチテナント対応が視野に。ストレージや運用自動化も進展(2015年11月26日(木))
重松 光浩(NTT	
  ソフトウェアイノベーションセンタ),	
  高田 唯子(NEC	
  BI統括ユニット)
62
Ironic  network  multi-‐‑‒tenant  separation:  model
• Ironic	
  neutron	
  ML2	
  driver	
  Integration
https://blueprints.launchpad.net/nova/+spec/ironic-­‐networks-­‐support
• Single	
  port
• LAG	
  port	
  (bonding)
• MLAG	
  port	
  (LACP)
• Trunk	
  and	
  multiple	
  tagged	
  VLAN	
  or	
  VXLAN(本気かどうか?)
• Only	
  support	
  ML2	
  VLAN	
  tunneling	
  network
• LinuxBridge ML2	
  VLAN	
  tunnel	
  compute
• ovs ML2	
  VLAN	
  tunnel	
  compute,	
  ovs ML2	
  VXLAN	
  tunnel
• GMO	
  AppsCloudのモデルでは、undercloud Ironic,	
  multi-­‐tenentIronicともに
• MLAG	
  port	
  (LACP)
• Trunk	
  and	
  multiple	
  tagged	
  VLAN	
  +	
  vlan allowed
• Vlan allowedがmulti-­‐tenantのセキュリティ設定の要
63
Ironic  network:  rackspace onMetal =  GMO  AppsCloud
for	
  Mitaka
• Vlan aware	
  VMs
• https://blueprints.launchpad.net/neutron/+spec/vlan-­‐aware-­‐vms
• VMの中にtagged	
  vlanが通る
• これと同じようにして、baremetalにもというらしいのだが
• Rackspace	
  OnMetal
• 現実的実装 :	
  https://github.com/rackerlabs/ironic-­‐neutron-­‐plugin
• 製品の説明 :	
  https://www.rackspace.com/knowledge_center/article/create-­‐onmetal-­‐
cloud-­‐servers
• ユーザ目線での情報:
https://major.io/2015/08/21/using-­‐systemd-­‐networkd-­‐with-­‐bonding-­‐on-­‐rackspaces-­‐
onmetal-­‐servers/
• Rackspaceも考えることは一緒だった <<	
  bonding	
  +	
  tagged	
  VLAN
• ほぼ、我々と同じような実装
64
• Service	
  model:	
  Public	
  cloud	
  by	
  KVM
• Network:	
  10Gbps	
  wired(10GBase	
  SFP+)
• Network	
  model:	
  
– Flat-­‐VLAN	
  +	
  Neutron	
  ML2	
  ovs-­‐VXLAN	
  overlay	
  
+	
  ML2	
  LinuxBridge(SaaS	
  only)
– IPv6/IPv4	
  dualstack
• LBaaS:	
  LVS-­‐DSR(original)
• Public	
  API
– Provided	
  the	
  public	
  API	
  (v2	
  Domain)
• Compute	
  node:	
  ALL	
  SSD	
  for	
  booting	
  OS
– Without	
  Cinder	
  boot	
  
• Glance:	
  provided
• Cinder:	
  SSD	
  NexentaStore zfs (SDS)
• Swift	
  (shared	
  Juno	
  cluster)
• Cobbler	
  deplyon	
  under-­‐cloud
– Ansible configuration
• SaaS	
  original	
  service	
  with	
  keystone	
  auth
– Email,	
  web,	
  CPanel and	
  WordPress
OpenStack Juno:  2  service  cluster,  released
• Service	
  model:	
  Public	
  cloud	
  by	
  KVM
• Network:	
  10Gbps	
  wired(10GBase	
  SFP+)
• Network	
  model:	
  
– L4-­‐LB-­‐Nat	
  +	
  Neutron	
  ML2	
  LinuxBridge VLAN
– IPv4	
  only
• LBaaS:	
  Brocade	
  ADX	
  L4-­‐NAT-­‐LB(original)
• Public	
  API
– Provided	
  the	
  public	
  API
• Compute	
  node:	
  Flash	
  cached	
  or	
  SSD
• Glance:	
  provided	
  (NetApp	
  offload)
• Cinder:	
  NetApp	
  storage
• Swift	
  (shared	
  Juno	
  cluster)
• Ironic	
  on	
  under-­‐cloud
– Compute	
  server	
  deploy	
  with	
  Ansible config
• Ironic	
  baremetal compute
– Nexsus Cisco	
  for	
  Tagged	
  VLAN	
  module
– ioMemory configuration
65
OpenStack Swift: shared cluster
66
Swift  cluster  (Havana  to  Juno  upgrade)
SSD	
  storage:
container/account	
  server	
  
at	
  every	
  zone	
  	
  
67
swift	
  proxy
keystone
OpenStack Swift cluster (5 zones, 3 copy)
swift	
  proxy
keystone
LVS-­‐DSrLVS-­‐DSR HAProxy(SSL)HAProxy(SSL)
Xeon	
  E3-­‐1230	
  3.3GHz
Memory	
  16GB
Xeon	
  E3-­‐1230	
  3.3GHz
Memory	
  16GB
Xeon	
  E5620	
  2.4GHz	
  x	
  2CPU
Memory	
  64GB
swift	
  objects
swift	
  objects
Xeon	
  E3-­‐1230	
  3.3GHz
swift	
  account
swift	
  container
Xeon	
  E5620	
  2.4GHz	
  x	
  2CPU
Memory	
  64GB,	
  SSD	
  x	
  2
swift	
  objects
swift	
  objects
Xeon	
  E3-­‐1230	
  3.3GHz
swift	
  account
swift	
  container
Xeon	
  E5620	
  2.4GHz	
  x	
  2CPU
Memory	
  64GB,	
  SSD	
  x	
  2
swift	
  objects
swift	
  objects
Xeon	
  E3-­‐1230	
  3.3GHz
swift	
  account
swift	
  container
Xeon	
  E5620	
  2.4GHz	
  x	
  2CPU
Memory	
  64GB,	
  SSD	
  x	
  2
swift	
  objects
swift	
  objects
Xeon	
  E3-­‐1230	
  3.3GHz
swift	
  account
swift	
  container
Xeon	
  E5620	
  2.4GHz	
  x	
  2CPU
Memory	
  64GB,	
  SSD	
  x	
  2
swift	
  objects
swift	
  objects
Xeon	
  E3-­‐1230	
  3.3GHz
swift	
  account
swift	
  container
Xeon	
  E5620	
  2.4GHz	
  x	
  2CPU
Memory	
  64GB,	
  SSD	
  x	
  2
68
swift	
  objects
swift	
  objects
swift	
  objects
swift	
  objects
swift	
  objects
swift	
  objects
swift	
  objects
swift	
  objects
swift	
  objects
swift	
  objects
swift	
  proxy keystone
Havana AppsCloud
swift	
  proxy keystone
Grizzly ConoHa
Havana
To
Juno
swift	
  account
swift	
  container
swift	
  account
swift	
  container
swift	
  account
swift	
  container
swift	
  account
swift	
  container
swift	
  account
swift	
  container
swift	
  proxy keystone
Juno ConoHa
swift	
  proxy keystone
Juno AppsCloud
Swift  cluster:  multi-‐‑‒auth and  multi-‐‑‒endpoint
swift	
  proxy keystone
Juno Z.com
69
ceilometer-­‐log	
  の一部 (request	
  count)
70
• Juno	
  release	
  swift	
  2.2	
  el6	
  (self	
  build:	
  なんとか作った)
Swift:  Havana  to  Juno  upgrade:  el6-‐‑‒RPMS  build
71
Swift:  Junoより先のupgrade
• Kilo以降の開発は確実に python 2.7以降の検証しかされてない
– >> python 2.6で動くかどうかは、確実に機能テストをしてから適用するべき
• Python 2.7 でパッケージ作成も検討
– >> 冗長片系づつ更新するので、問題なさそう (◎: 最有力)
– Python 3.4で動かす意義: asyncio thread (△: Swiftには反映されていない)
• go-lang swiftは?
– Hummingbird swift (go-lang)
– https://github.com/openstack/swift/tree/feature/hummingbird/go
– これまで、Plugin作ったもの>> go-langにする必要が出てくる (△: ここがつらい)
72
Finally:
The	
  GMO	
  AppsCloud	
  in	
  Juno	
  OpenStack	
  it	
  was	
  released	
  on	
  10/27/2015.
• Deployment	
  of	
  SanDisk	
  Fusion	
  ioMemory by	
  Kilo	
  Ironic	
  on	
  Juno	
  OpenSack I	
  can	
  also.
• Compute	
  server	
  was	
  deployed	
  by	
  Kilo	
  Ironic	
  with	
  under-­‐cloud	
  All-­‐in-­‐One	
  openstack.	
  	
  
Compute	
  server	
  configuration	
  was	
  deployed	
  by	
  Ansible.
• Cinder	
  and	
  Glance	
  was	
  proviedNetApp	
  copyoffload storage	
  mechanism.	
  
• LbaaS is	
  Brocade	
  ADX	
  NAT	
  mode	
  original	
  driver.
• Linux	
  Bridge	
  Neutron	
  mode	
  is	
  best	
  performance	
  without	
  L3	
  switch
On	
  the	
  otherhand;	
  	
  Juno	
  OpenStack ConoHareleased	
  on	
  05/18/2015.
• Designate	
  DNS	
  and	
  GSLB	
  service	
  was	
  started	
  on	
  ConoHa.
• Cinder	
  storage	
  is	
  SDS	
  provied NexentaStor zfs storage	
  for	
  single	
  volume	
  type.
• LBaaS is	
  LVS-­‐DSR	
  original	
  driver.
• ovs-­‐VXLAN	
  overlay	
  Neutron	
  mode	
  is	
  more	
  high	
  degree	
  of	
  freedom.
• And	
  Z.com OEM	
  openstack domain	
  was	
  living	
  together	
  in	
  ConoHa
73
Fin.
74
Develop  OpenStack related  tools
Tool  that  create  Docker host.
Golang
Develop	
  Vagrant	
  provider	
  for	
  ConoHa.
Fix	
  a	
  problem	
  and pull	
  request.
Docker Machine
https://github.com/hironobu-­‐s/vagrant-­‐conoha
75
CLI  tool  that  handle  ConoHa specific  APIs
Golang
Develop  plugin  that  enable  to  save  media  files  
to  Swift(Object  Store)
Develop  OpenStack related  tools
https://github.com/hironobu-­‐s/conoha-­‐iso
https://wordpress.org/plugins/conoha-­‐object-­‐sync/

More Related Content

What's hot

OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...
OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...
OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...
Masaaki Nakagawa
 
NTTドコモ様 導入事例 OpenStack Summit 2016 Barcelona 講演「Expanding and Deepening NTT D...
NTTドコモ様 導入事例 OpenStack Summit 2016 Barcelona 講演「Expanding and Deepening NTT D...NTTドコモ様 導入事例 OpenStack Summit 2016 Barcelona 講演「Expanding and Deepening NTT D...
NTTドコモ様 導入事例 OpenStack Summit 2016 Barcelona 講演「Expanding and Deepening NTT D...
VirtualTech Japan Inc.
 
[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...
[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...
[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...
OpenStack Korea Community
 
Automated Deployment & Benchmarking with Chef, Cobbler and Rally for OpenStack
Automated Deployment & Benchmarking with Chef, Cobbler and Rally for OpenStackAutomated Deployment & Benchmarking with Chef, Cobbler and Rally for OpenStack
Automated Deployment & Benchmarking with Chef, Cobbler and Rally for OpenStack
NTT Communications Technology Development
 
OpenStack networking-sfc flow 분석
OpenStack networking-sfc flow 분석OpenStack networking-sfc flow 분석
OpenStack networking-sfc flow 분석
Yongyoon Shin
 
OpenDaylight Integration with OpenStack Neutron: A Tutorial
OpenDaylight Integration with OpenStack Neutron: A TutorialOpenDaylight Integration with OpenStack Neutron: A Tutorial
OpenDaylight Integration with OpenStack Neutron: A Tutorial
mestery
 
How to operate containerized OpenStack
How to operate containerized OpenStackHow to operate containerized OpenStack
How to operate containerized OpenStack
Nalee Jang
 
OpenStack Data Processing ("Sahara") project update - December 2014
OpenStack Data Processing ("Sahara") project update - December 2014OpenStack Data Processing ("Sahara") project update - December 2014
OpenStack Data Processing ("Sahara") project update - December 2014
Sergey Lukjanov
 
How logging makes a private cloud a better cloud - OpenStack最新情報セミナー(2016年12月)
How logging makes a private cloud a better cloud - OpenStack最新情報セミナー(2016年12月)How logging makes a private cloud a better cloud - OpenStack最新情報セミナー(2016年12月)
How logging makes a private cloud a better cloud - OpenStack最新情報セミナー(2016年12月)
VirtualTech Japan Inc.
 
[Open infra] how to calculate the cloud system operating rate
[Open infra] how to calculate the cloud system operating rate[Open infra] how to calculate the cloud system operating rate
[Open infra] how to calculate the cloud system operating rate
Nalee Jang
 
Compute 101 - OpenStack Summit Vancouver 2015
Compute 101 - OpenStack Summit Vancouver 2015Compute 101 - OpenStack Summit Vancouver 2015
Compute 101 - OpenStack Summit Vancouver 2015
Stephen Gordon
 
Approaching hyperconvergedopenstack
Approaching hyperconvergedopenstackApproaching hyperconvergedopenstack
Approaching hyperconvergedopenstack
Ikuo Kumagai
 
Trove Updates - Kilo Edition
Trove Updates - Kilo EditionTrove Updates - Kilo Edition
Trove Updates - Kilo Edition
OpenStack Foundation
 
[OpenInfra Days Korea 2018] (Track 3) - CephFS with OpenStack Manila based on...
[OpenInfra Days Korea 2018] (Track 3) - CephFS with OpenStack Manila based on...[OpenInfra Days Korea 2018] (Track 3) - CephFS with OpenStack Manila based on...
[OpenInfra Days Korea 2018] (Track 3) - CephFS with OpenStack Manila based on...
OpenStack Korea Community
 
20121204 open technet_openstack_이틀만하면나처럼할수있다
20121204 open technet_openstack_이틀만하면나처럼할수있다20121204 open technet_openstack_이틀만하면나처럼할수있다
20121204 open technet_openstack_이틀만하면나처럼할수있다Nalee Jang
 
State of Containers in OpenStack
State of Containers in OpenStackState of Containers in OpenStack
State of Containers in OpenStack
openstackindia
 
How to master OpenStack in 2 hours
How to master OpenStack in 2 hoursHow to master OpenStack in 2 hours
How to master OpenStack in 2 hours
OpenCity Community
 
Nova: Openstack Compute-as-a-service
Nova: Openstack Compute-as-a-serviceNova: Openstack Compute-as-a-service
Nova: Openstack Compute-as-a-service
Pratik Bandarkar
 
SecurityPI - Hardening your IoT endpoints in Home.
SecurityPI - Hardening your IoT endpoints in Home. SecurityPI - Hardening your IoT endpoints in Home.
SecurityPI - Hardening your IoT endpoints in Home.
LinuxCon ContainerCon CloudOpen China
 
Running Docker with OpenStack | Docker workshop #1
Running Docker with OpenStack | Docker workshop #1Running Docker with OpenStack | Docker workshop #1
Running Docker with OpenStack | Docker workshop #1
dotCloud
 

What's hot (20)

OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...
OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...
OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...
 
NTTドコモ様 導入事例 OpenStack Summit 2016 Barcelona 講演「Expanding and Deepening NTT D...
NTTドコモ様 導入事例 OpenStack Summit 2016 Barcelona 講演「Expanding and Deepening NTT D...NTTドコモ様 導入事例 OpenStack Summit 2016 Barcelona 講演「Expanding and Deepening NTT D...
NTTドコモ様 導入事例 OpenStack Summit 2016 Barcelona 講演「Expanding and Deepening NTT D...
 
[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...
[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...
[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...
 
Automated Deployment & Benchmarking with Chef, Cobbler and Rally for OpenStack
Automated Deployment & Benchmarking with Chef, Cobbler and Rally for OpenStackAutomated Deployment & Benchmarking with Chef, Cobbler and Rally for OpenStack
Automated Deployment & Benchmarking with Chef, Cobbler and Rally for OpenStack
 
OpenStack networking-sfc flow 분석
OpenStack networking-sfc flow 분석OpenStack networking-sfc flow 분석
OpenStack networking-sfc flow 분석
 
OpenDaylight Integration with OpenStack Neutron: A Tutorial
OpenDaylight Integration with OpenStack Neutron: A TutorialOpenDaylight Integration with OpenStack Neutron: A Tutorial
OpenDaylight Integration with OpenStack Neutron: A Tutorial
 
How to operate containerized OpenStack
How to operate containerized OpenStackHow to operate containerized OpenStack
How to operate containerized OpenStack
 
OpenStack Data Processing ("Sahara") project update - December 2014
OpenStack Data Processing ("Sahara") project update - December 2014OpenStack Data Processing ("Sahara") project update - December 2014
OpenStack Data Processing ("Sahara") project update - December 2014
 
How logging makes a private cloud a better cloud - OpenStack最新情報セミナー(2016年12月)
How logging makes a private cloud a better cloud - OpenStack最新情報セミナー(2016年12月)How logging makes a private cloud a better cloud - OpenStack最新情報セミナー(2016年12月)
How logging makes a private cloud a better cloud - OpenStack最新情報セミナー(2016年12月)
 
[Open infra] how to calculate the cloud system operating rate
[Open infra] how to calculate the cloud system operating rate[Open infra] how to calculate the cloud system operating rate
[Open infra] how to calculate the cloud system operating rate
 
Compute 101 - OpenStack Summit Vancouver 2015
Compute 101 - OpenStack Summit Vancouver 2015Compute 101 - OpenStack Summit Vancouver 2015
Compute 101 - OpenStack Summit Vancouver 2015
 
Approaching hyperconvergedopenstack
Approaching hyperconvergedopenstackApproaching hyperconvergedopenstack
Approaching hyperconvergedopenstack
 
Trove Updates - Kilo Edition
Trove Updates - Kilo EditionTrove Updates - Kilo Edition
Trove Updates - Kilo Edition
 
[OpenInfra Days Korea 2018] (Track 3) - CephFS with OpenStack Manila based on...
[OpenInfra Days Korea 2018] (Track 3) - CephFS with OpenStack Manila based on...[OpenInfra Days Korea 2018] (Track 3) - CephFS with OpenStack Manila based on...
[OpenInfra Days Korea 2018] (Track 3) - CephFS with OpenStack Manila based on...
 
20121204 open technet_openstack_이틀만하면나처럼할수있다
20121204 open technet_openstack_이틀만하면나처럼할수있다20121204 open technet_openstack_이틀만하면나처럼할수있다
20121204 open technet_openstack_이틀만하면나처럼할수있다
 
State of Containers in OpenStack
State of Containers in OpenStackState of Containers in OpenStack
State of Containers in OpenStack
 
How to master OpenStack in 2 hours
How to master OpenStack in 2 hoursHow to master OpenStack in 2 hours
How to master OpenStack in 2 hours
 
Nova: Openstack Compute-as-a-service
Nova: Openstack Compute-as-a-serviceNova: Openstack Compute-as-a-service
Nova: Openstack Compute-as-a-service
 
SecurityPI - Hardening your IoT endpoints in Home.
SecurityPI - Hardening your IoT endpoints in Home. SecurityPI - Hardening your IoT endpoints in Home.
SecurityPI - Hardening your IoT endpoints in Home.
 
Running Docker with OpenStack | Docker workshop #1
Running Docker with OpenStack | Docker workshop #1Running Docker with OpenStack | Docker workshop #1
Running Docker with OpenStack | Docker workshop #1
 

Viewers also liked

OSunC Chiba LT Ubuntu 14.04 to 16.04.1 upgrade with ConfigDrive cloud image
OSunC Chiba LT Ubuntu 14.04 to 16.04.1 upgrade with ConfigDrive cloud imageOSunC Chiba LT Ubuntu 14.04 to 16.04.1 upgrade with ConfigDrive cloud image
OSunC Chiba LT Ubuntu 14.04 to 16.04.1 upgrade with ConfigDrive cloud image
Naoto Gohko
 
Openstack summit walk DNSaaS 2015-0713 Summit LT
Openstack summit walk DNSaaS 2015-0713 Summit LTOpenstack summit walk DNSaaS 2015-0713 Summit LT
Openstack summit walk DNSaaS 2015-0713 Summit LT
Naoto Gohko
 
2015 0807 ConoHa I am the bone of the OpenStack API CLI tool
2015 0807 ConoHa I am the bone of the OpenStack API CLI tool2015 0807 ConoHa I am the bone of the OpenStack API CLI tool
2015 0807 ConoHa I am the bone of the OpenStack API CLI tool
Naoto Gohko
 
1st OCDET Baremetal MTG OpenStack baremetal compute by GMO AppsCloud
1st OCDET Baremetal MTG OpenStack baremetal compute by GMO AppsCloud1st OCDET Baremetal MTG OpenStack baremetal compute by GMO AppsCloud
1st OCDET Baremetal MTG OpenStack baremetal compute by GMO AppsCloud
Naoto Gohko
 
2016 0626 ubuntu 1604 LTS party LT
2016 0626 ubuntu 1604 LTS party LT2016 0626 ubuntu 1604 LTS party LT
2016 0626 ubuntu 1604 LTS party LT
Naoto Gohko
 
Miracle Linux seminer Hatohol and ConoHa
Miracle Linux seminer Hatohol and ConoHaMiracle Linux seminer Hatohol and ConoHa
Miracle Linux seminer Hatohol and ConoHa
Naoto Gohko
 
2016 1214-dev-night-vol1-in-tanita
2016 1214-dev-night-vol1-in-tanita2016 1214-dev-night-vol1-in-tanita
2016 1214-dev-night-vol1-in-tanita
Naoto Gohko
 
2017 0306 Apache OpenWhisk starting
2017 0306 Apache OpenWhisk starting2017 0306 Apache OpenWhisk starting
2017 0306 Apache OpenWhisk starting
Naoto Gohko
 
GMOインターネット様 発表「OpenStackのモデルの最適化とConoHa, Z.comとGMOアプリクラウドへの適用」 - OpenStack最新情...
GMOインターネット様 発表「OpenStackのモデルの最適化とConoHa, Z.comとGMOアプリクラウドへの適用」 - OpenStack最新情...GMOインターネット様 発表「OpenStackのモデルの最適化とConoHa, Z.comとGMOアプリクラウドへの適用」 - OpenStack最新情...
GMOインターネット様 発表「OpenStackのモデルの最適化とConoHa, Z.comとGMOアプリクラウドへの適用」 - OpenStack最新情...
VirtualTech Japan Inc.
 
OpenStack ComputingはHyper-Convergedの夢を見るのか?
OpenStack ComputingはHyper-Convergedの夢を見るのか?OpenStack ComputingはHyper-Convergedの夢を見るのか?
OpenStack ComputingはHyper-Convergedの夢を見るのか?
Naoto Gohko
 
Janog36 ConoHa: Making GSLB - OpenStack Designate and PowerDNS
Janog36 ConoHa: Making GSLB - OpenStack Designate and PowerDNSJanog36 ConoHa: Making GSLB - OpenStack Designate and PowerDNS
Janog36 ConoHa: Making GSLB - OpenStack Designate and PowerDNS
Naoto Gohko
 
ベアメタルプロビジョニング(Ironic)について
ベアメタルプロビジョニング(Ironic)についてベアメタルプロビジョニング(Ironic)について
ベアメタルプロビジョニング(Ironic)について
Mitsuhiro SHIGEMATSU
 
OpenStack Infrastructure at any Scale - Simple is BEST!? - - OpenStack最新情報セミ...
OpenStack Infrastructure at any Scale - Simple is BEST!? -  - OpenStack最新情報セミ...OpenStack Infrastructure at any Scale - Simple is BEST!? -  - OpenStack最新情報セミ...
OpenStack Infrastructure at any Scale - Simple is BEST!? - - OpenStack最新情報セミ...
VirtualTech Japan Inc.
 
Pola Keselarasan Vokal1.
Pola Keselarasan Vokal1.Pola Keselarasan Vokal1.
Pola Keselarasan Vokal1.son goku
 
OpenStack Ironicによるベアメタルプロビジョニング
OpenStack IronicによるベアメタルプロビジョニングOpenStack Ironicによるベアメタルプロビジョニング
OpenStack Ironicによるベアメタルプロビジョニング
Yuuki Mori
 
OpenStackネットワーク実装の現状と運用 自動化開発の実際 第一部: OpenStackネットワーク実装の現状 – OpenStack最新情報セミナ...
OpenStackネットワーク実装の現状と運用 自動化開発の実際 第一部: OpenStackネットワーク実装の現状 – OpenStack最新情報セミナ...OpenStackネットワーク実装の現状と運用 自動化開発の実際 第一部: OpenStackネットワーク実装の現状 – OpenStack最新情報セミナ...
OpenStackネットワーク実装の現状と運用 自動化開発の実際 第一部: OpenStackネットワーク実装の現状 – OpenStack最新情報セミナ...
VirtualTech Japan Inc.
 
今さら聞けない人のためのDocker超入門 CentOS 7.2対応版
今さら聞けない人のためのDocker超入門 CentOS 7.2対応版今さら聞けない人のためのDocker超入門 CentOS 7.2対応版
今さら聞けない人のためのDocker超入門 CentOS 7.2対応版
VirtualTech Japan Inc.
 
【OpenStack共同検証ラボ】OpenStack監視・ログ分析基盤の作り方 - OpenStack最新情報セミナー(2016年7月)
【OpenStack共同検証ラボ】OpenStack監視・ログ分析基盤の作り方 - OpenStack最新情報セミナー(2016年7月)【OpenStack共同検証ラボ】OpenStack監視・ログ分析基盤の作り方 - OpenStack最新情報セミナー(2016年7月)
【OpenStack共同検証ラボ】OpenStack監視・ログ分析基盤の作り方 - OpenStack最新情報セミナー(2016年7月)
VirtualTech Japan Inc.
 
OpenStack-Ansibleで作るOpenStack HA環境 手順書解説 - OpenStack最新情報セミナー 2016年3月
OpenStack-Ansibleで作るOpenStack HA環境 手順書解説 - OpenStack最新情報セミナー 2016年3月OpenStack-Ansibleで作るOpenStack HA環境 手順書解説 - OpenStack最新情報セミナー 2016年3月
OpenStack-Ansibleで作るOpenStack HA環境 手順書解説 - OpenStack最新情報セミナー 2016年3月
VirtualTech Japan Inc.
 
201703 osc josug
201703 osc josug201703 osc josug
201703 osc josug
Akira Yoshiyama
 

Viewers also liked (20)

OSunC Chiba LT Ubuntu 14.04 to 16.04.1 upgrade with ConfigDrive cloud image
OSunC Chiba LT Ubuntu 14.04 to 16.04.1 upgrade with ConfigDrive cloud imageOSunC Chiba LT Ubuntu 14.04 to 16.04.1 upgrade with ConfigDrive cloud image
OSunC Chiba LT Ubuntu 14.04 to 16.04.1 upgrade with ConfigDrive cloud image
 
Openstack summit walk DNSaaS 2015-0713 Summit LT
Openstack summit walk DNSaaS 2015-0713 Summit LTOpenstack summit walk DNSaaS 2015-0713 Summit LT
Openstack summit walk DNSaaS 2015-0713 Summit LT
 
2015 0807 ConoHa I am the bone of the OpenStack API CLI tool
2015 0807 ConoHa I am the bone of the OpenStack API CLI tool2015 0807 ConoHa I am the bone of the OpenStack API CLI tool
2015 0807 ConoHa I am the bone of the OpenStack API CLI tool
 
1st OCDET Baremetal MTG OpenStack baremetal compute by GMO AppsCloud
1st OCDET Baremetal MTG OpenStack baremetal compute by GMO AppsCloud1st OCDET Baremetal MTG OpenStack baremetal compute by GMO AppsCloud
1st OCDET Baremetal MTG OpenStack baremetal compute by GMO AppsCloud
 
2016 0626 ubuntu 1604 LTS party LT
2016 0626 ubuntu 1604 LTS party LT2016 0626 ubuntu 1604 LTS party LT
2016 0626 ubuntu 1604 LTS party LT
 
Miracle Linux seminer Hatohol and ConoHa
Miracle Linux seminer Hatohol and ConoHaMiracle Linux seminer Hatohol and ConoHa
Miracle Linux seminer Hatohol and ConoHa
 
2016 1214-dev-night-vol1-in-tanita
2016 1214-dev-night-vol1-in-tanita2016 1214-dev-night-vol1-in-tanita
2016 1214-dev-night-vol1-in-tanita
 
2017 0306 Apache OpenWhisk starting
2017 0306 Apache OpenWhisk starting2017 0306 Apache OpenWhisk starting
2017 0306 Apache OpenWhisk starting
 
GMOインターネット様 発表「OpenStackのモデルの最適化とConoHa, Z.comとGMOアプリクラウドへの適用」 - OpenStack最新情...
GMOインターネット様 発表「OpenStackのモデルの最適化とConoHa, Z.comとGMOアプリクラウドへの適用」 - OpenStack最新情...GMOインターネット様 発表「OpenStackのモデルの最適化とConoHa, Z.comとGMOアプリクラウドへの適用」 - OpenStack最新情...
GMOインターネット様 発表「OpenStackのモデルの最適化とConoHa, Z.comとGMOアプリクラウドへの適用」 - OpenStack最新情...
 
OpenStack ComputingはHyper-Convergedの夢を見るのか?
OpenStack ComputingはHyper-Convergedの夢を見るのか?OpenStack ComputingはHyper-Convergedの夢を見るのか?
OpenStack ComputingはHyper-Convergedの夢を見るのか?
 
Janog36 ConoHa: Making GSLB - OpenStack Designate and PowerDNS
Janog36 ConoHa: Making GSLB - OpenStack Designate and PowerDNSJanog36 ConoHa: Making GSLB - OpenStack Designate and PowerDNS
Janog36 ConoHa: Making GSLB - OpenStack Designate and PowerDNS
 
ベアメタルプロビジョニング(Ironic)について
ベアメタルプロビジョニング(Ironic)についてベアメタルプロビジョニング(Ironic)について
ベアメタルプロビジョニング(Ironic)について
 
OpenStack Infrastructure at any Scale - Simple is BEST!? - - OpenStack最新情報セミ...
OpenStack Infrastructure at any Scale - Simple is BEST!? -  - OpenStack最新情報セミ...OpenStack Infrastructure at any Scale - Simple is BEST!? -  - OpenStack最新情報セミ...
OpenStack Infrastructure at any Scale - Simple is BEST!? - - OpenStack最新情報セミ...
 
Pola Keselarasan Vokal1.
Pola Keselarasan Vokal1.Pola Keselarasan Vokal1.
Pola Keselarasan Vokal1.
 
OpenStack Ironicによるベアメタルプロビジョニング
OpenStack IronicによるベアメタルプロビジョニングOpenStack Ironicによるベアメタルプロビジョニング
OpenStack Ironicによるベアメタルプロビジョニング
 
OpenStackネットワーク実装の現状と運用 自動化開発の実際 第一部: OpenStackネットワーク実装の現状 – OpenStack最新情報セミナ...
OpenStackネットワーク実装の現状と運用 自動化開発の実際 第一部: OpenStackネットワーク実装の現状 – OpenStack最新情報セミナ...OpenStackネットワーク実装の現状と運用 自動化開発の実際 第一部: OpenStackネットワーク実装の現状 – OpenStack最新情報セミナ...
OpenStackネットワーク実装の現状と運用 自動化開発の実際 第一部: OpenStackネットワーク実装の現状 – OpenStack最新情報セミナ...
 
今さら聞けない人のためのDocker超入門 CentOS 7.2対応版
今さら聞けない人のためのDocker超入門 CentOS 7.2対応版今さら聞けない人のためのDocker超入門 CentOS 7.2対応版
今さら聞けない人のためのDocker超入門 CentOS 7.2対応版
 
【OpenStack共同検証ラボ】OpenStack監視・ログ分析基盤の作り方 - OpenStack最新情報セミナー(2016年7月)
【OpenStack共同検証ラボ】OpenStack監視・ログ分析基盤の作り方 - OpenStack最新情報セミナー(2016年7月)【OpenStack共同検証ラボ】OpenStack監視・ログ分析基盤の作り方 - OpenStack最新情報セミナー(2016年7月)
【OpenStack共同検証ラボ】OpenStack監視・ログ分析基盤の作り方 - OpenStack最新情報セミナー(2016年7月)
 
OpenStack-Ansibleで作るOpenStack HA環境 手順書解説 - OpenStack最新情報セミナー 2016年3月
OpenStack-Ansibleで作るOpenStack HA環境 手順書解説 - OpenStack最新情報セミナー 2016年3月OpenStack-Ansibleで作るOpenStack HA環境 手順書解説 - OpenStack最新情報セミナー 2016年3月
OpenStack-Ansibleで作るOpenStack HA環境 手順書解説 - OpenStack最新情報セミナー 2016年3月
 
201703 osc josug
201703 osc josug201703 osc josug
201703 osc josug
 

Similar to OpenStack cloud for ConoHa, Z.com and GMO AppsCloud in okinawa opendays 2015 1216-01

OpenStack 2012 fall summit observation - Quantum/SDN
OpenStack 2012 fall summit observation - Quantum/SDNOpenStack 2012 fall summit observation - Quantum/SDN
OpenStack 2012 fall summit observation - Quantum/SDNTe-Yen Liu
 
Nvp deep dive_session_cee-day
Nvp deep dive_session_cee-dayNvp deep dive_session_cee-day
Nvp deep dive_session_cee-dayyfauser
 
ONUG Tutorial: Bridges and Tunnels Drive Through OpenStack Networking
ONUG Tutorial: Bridges and Tunnels Drive Through OpenStack NetworkingONUG Tutorial: Bridges and Tunnels Drive Through OpenStack Networking
ONUG Tutorial: Bridges and Tunnels Drive Through OpenStack Networking
markmcclain
 
State of the OpenDaylight Union
State of the OpenDaylight UnionState of the OpenDaylight Union
State of the OpenDaylight Union
Open Networking Summit
 
Dragonflow Austin Summit Talk
Dragonflow Austin Summit Talk Dragonflow Austin Summit Talk
Dragonflow Austin Summit Talk
Eran Gampel
 
Cloud computing OpenStack_discussion_2014-05
Cloud computing OpenStack_discussion_2014-05Cloud computing OpenStack_discussion_2014-05
Cloud computing OpenStack_discussion_2014-05
Le Cuong
 
VNG/IRD - Cloud computing & Openstack discussion 3/5/2014
VNG/IRD - Cloud computing & Openstack discussion 3/5/2014VNG/IRD - Cloud computing & Openstack discussion 3/5/2014
VNG/IRD - Cloud computing & Openstack discussion 3/5/2014
Tran Nhan
 
Quantum essex summary
Quantum essex summaryQuantum essex summary
Quantum essex summary
Dan Wendlandt
 
Support of containerized workloads in ONAP
Support of containerized workloads in ONAPSupport of containerized workloads in ONAP
Support of containerized workloads in ONAP
Victor Morales
 
Openstack Quantum yahoo meetup 1 23-13
Openstack Quantum yahoo meetup 1 23-13Openstack Quantum yahoo meetup 1 23-13
Openstack Quantum yahoo meetup 1 23-13Dan Wendlandt
 
Workday's Next Generation Private Cloud
Workday's Next Generation Private CloudWorkday's Next Generation Private Cloud
Workday's Next Generation Private Cloud
Silvano Buback
 
Scaling OpenStack Networking Beyond 4000 Nodes with Dragonflow - Eshed Gal-Or...
Scaling OpenStack Networking Beyond 4000 Nodes with Dragonflow - Eshed Gal-Or...Scaling OpenStack Networking Beyond 4000 Nodes with Dragonflow - Eshed Gal-Or...
Scaling OpenStack Networking Beyond 4000 Nodes with Dragonflow - Eshed Gal-Or...
Cloud Native Day Tel Aviv
 
Dragonflow 01 2016 TLV meetup
Dragonflow 01 2016 TLV meetup  Dragonflow 01 2016 TLV meetup
Dragonflow 01 2016 TLV meetup
Eran Gampel
 
OpenStack Quantum: Cloud Carrier Summit 2012
OpenStack Quantum: Cloud Carrier Summit 2012OpenStack Quantum: Cloud Carrier Summit 2012
OpenStack Quantum: Cloud Carrier Summit 2012
Dan Wendlandt
 
20141111_SOS3_Gallo
20141111_SOS3_Gallo20141111_SOS3_Gallo
20141111_SOS3_GalloAndrea Gallo
 
OpenStack Networking and Automation
OpenStack Networking and AutomationOpenStack Networking and Automation
OpenStack Networking and Automation
Adam Johnson
 
Quantum - Virtual networks for Openstack
Quantum - Virtual networks for OpenstackQuantum - Virtual networks for Openstack
Quantum - Virtual networks for Openstack
salv_orlando
 
Open stack networking_101_update_2014
Open stack networking_101_update_2014Open stack networking_101_update_2014
Open stack networking_101_update_2014
yfauser
 
Simplify Networking for Containers
Simplify Networking for ContainersSimplify Networking for Containers
Simplify Networking for Containers
LinuxCon ContainerCon CloudOpen China
 
La apuesta de Telefónica por la cloud privada
La apuesta de Telefónica por la cloud privadaLa apuesta de Telefónica por la cloud privada
La apuesta de Telefónica por la cloud privada
LibreCon
 

Similar to OpenStack cloud for ConoHa, Z.com and GMO AppsCloud in okinawa opendays 2015 1216-01 (20)

OpenStack 2012 fall summit observation - Quantum/SDN
OpenStack 2012 fall summit observation - Quantum/SDNOpenStack 2012 fall summit observation - Quantum/SDN
OpenStack 2012 fall summit observation - Quantum/SDN
 
Nvp deep dive_session_cee-day
Nvp deep dive_session_cee-dayNvp deep dive_session_cee-day
Nvp deep dive_session_cee-day
 
ONUG Tutorial: Bridges and Tunnels Drive Through OpenStack Networking
ONUG Tutorial: Bridges and Tunnels Drive Through OpenStack NetworkingONUG Tutorial: Bridges and Tunnels Drive Through OpenStack Networking
ONUG Tutorial: Bridges and Tunnels Drive Through OpenStack Networking
 
State of the OpenDaylight Union
State of the OpenDaylight UnionState of the OpenDaylight Union
State of the OpenDaylight Union
 
Dragonflow Austin Summit Talk
Dragonflow Austin Summit Talk Dragonflow Austin Summit Talk
Dragonflow Austin Summit Talk
 
Cloud computing OpenStack_discussion_2014-05
Cloud computing OpenStack_discussion_2014-05Cloud computing OpenStack_discussion_2014-05
Cloud computing OpenStack_discussion_2014-05
 
VNG/IRD - Cloud computing & Openstack discussion 3/5/2014
VNG/IRD - Cloud computing & Openstack discussion 3/5/2014VNG/IRD - Cloud computing & Openstack discussion 3/5/2014
VNG/IRD - Cloud computing & Openstack discussion 3/5/2014
 
Quantum essex summary
Quantum essex summaryQuantum essex summary
Quantum essex summary
 
Support of containerized workloads in ONAP
Support of containerized workloads in ONAPSupport of containerized workloads in ONAP
Support of containerized workloads in ONAP
 
Openstack Quantum yahoo meetup 1 23-13
Openstack Quantum yahoo meetup 1 23-13Openstack Quantum yahoo meetup 1 23-13
Openstack Quantum yahoo meetup 1 23-13
 
Workday's Next Generation Private Cloud
Workday's Next Generation Private CloudWorkday's Next Generation Private Cloud
Workday's Next Generation Private Cloud
 
Scaling OpenStack Networking Beyond 4000 Nodes with Dragonflow - Eshed Gal-Or...
Scaling OpenStack Networking Beyond 4000 Nodes with Dragonflow - Eshed Gal-Or...Scaling OpenStack Networking Beyond 4000 Nodes with Dragonflow - Eshed Gal-Or...
Scaling OpenStack Networking Beyond 4000 Nodes with Dragonflow - Eshed Gal-Or...
 
Dragonflow 01 2016 TLV meetup
Dragonflow 01 2016 TLV meetup  Dragonflow 01 2016 TLV meetup
Dragonflow 01 2016 TLV meetup
 
OpenStack Quantum: Cloud Carrier Summit 2012
OpenStack Quantum: Cloud Carrier Summit 2012OpenStack Quantum: Cloud Carrier Summit 2012
OpenStack Quantum: Cloud Carrier Summit 2012
 
20141111_SOS3_Gallo
20141111_SOS3_Gallo20141111_SOS3_Gallo
20141111_SOS3_Gallo
 
OpenStack Networking and Automation
OpenStack Networking and AutomationOpenStack Networking and Automation
OpenStack Networking and Automation
 
Quantum - Virtual networks for Openstack
Quantum - Virtual networks for OpenstackQuantum - Virtual networks for Openstack
Quantum - Virtual networks for Openstack
 
Open stack networking_101_update_2014
Open stack networking_101_update_2014Open stack networking_101_update_2014
Open stack networking_101_update_2014
 
Simplify Networking for Containers
Simplify Networking for ContainersSimplify Networking for Containers
Simplify Networking for Containers
 
La apuesta de Telefónica por la cloud privada
La apuesta de Telefónica por la cloud privadaLa apuesta de Telefónica por la cloud privada
La apuesta de Telefónica por la cloud privada
 

More from Naoto Gohko

ODC 2020 : "Rocky 8"
ODC 2020 : "Rocky 8"ODC 2020 : "Rocky 8"
ODC 2020 : "Rocky 8"
Naoto Gohko
 
2019 0704 about ConoHa VM migration from C1 to C2
2019 0704 about ConoHa VM migration from C1 to C22019 0704 about ConoHa VM migration from C1 to C2
2019 0704 about ConoHa VM migration from C1 to C2
Naoto Gohko
 
serverless openstack 101
serverless openstack 101serverless openstack 101
serverless openstack 101
Naoto Gohko
 
2018 04-14-cockroachdb-20-now-available
2018 04-14-cockroachdb-20-now-available2018 04-14-cockroachdb-20-now-available
2018 04-14-cockroachdb-20-now-available
Naoto Gohko
 
2017 0715 osc17do conoha cloud osclient
2017 0715 osc17do conoha cloud osclient2017 0715 osc17do conoha cloud osclient
2017 0715 osc17do conoha cloud osclient
Naoto Gohko
 
2015 0228 OpenStack swift; GMO Internet Services
2015 0228 OpenStack swift; GMO Internet Services2015 0228 OpenStack swift; GMO Internet Services
2015 0228 OpenStack swift; GMO Internet Services
Naoto Gohko
 
Open stack swift is too Enterprise? 2014/12/01 advent cal
Open stack swift is too Enterprise?  2014/12/01 advent calOpen stack swift is too Enterprise?  2014/12/01 advent cal
Open stack swift is too Enterprise? 2014/12/01 advent cal
Naoto Gohko
 
TechOYAJI 2014 tokyo summer LT; CentOS7 and RDO Icehouse OpenStack
TechOYAJI 2014 tokyo summer LT;  CentOS7 and RDO Icehouse OpenStackTechOYAJI 2014 tokyo summer LT;  CentOS7 and RDO Icehouse OpenStack
TechOYAJI 2014 tokyo summer LT; CentOS7 and RDO Icehouse OpenStack
Naoto Gohko
 
JOSUG2014 OpenStack 4th birthday party in Japan; the way of OpenStack API Dragon
JOSUG2014 OpenStack 4th birthday party in Japan; the way of OpenStack API DragonJOSUG2014 OpenStack 4th birthday party in Japan; the way of OpenStack API Dragon
JOSUG2014 OpenStack 4th birthday party in Japan; the way of OpenStack API Dragon
Naoto Gohko
 
OpenStack base public cloud service by GMO Internet Inc., at 2013/12/12 Okin...
OpenStack base public cloud service by GMO Internet Inc.,  at 2013/12/12 Okin...OpenStack base public cloud service by GMO Internet Inc.,  at 2013/12/12 Okin...
OpenStack base public cloud service by GMO Internet Inc., at 2013/12/12 Okin...
Naoto Gohko
 
OpenStack + KVM + IPv6 = oname.com; Next Folsom/Grizzly Service development s...
OpenStack + KVM + IPv6 = oname.com; Next Folsom/Grizzly Service development s...OpenStack + KVM + IPv6 = oname.com; Next Folsom/Grizzly Service development s...
OpenStack + KVM + IPv6 = oname.com; Next Folsom/Grizzly Service development s...Naoto Gohko
 
2012 OpenStack + KVM = onamae.com VPS #2 ~ vnc and snapshot ~
2012 OpenStack + KVM = onamae.com VPS #2 ~ vnc and snapshot ~2012 OpenStack + KVM = onamae.com VPS #2 ~ vnc and snapshot ~
2012 OpenStack + KVM = onamae.com VPS #2 ~ vnc and snapshot ~
Naoto Gohko
 
2012 OSC Kyoto / 2012 OSC Tokyo Fall - OpenStack vps kvm
2012 OSC Kyoto / 2012 OSC Tokyo Fall - OpenStack vps kvm2012 OSC Kyoto / 2012 OSC Tokyo Fall - OpenStack vps kvm
2012 OSC Kyoto / 2012 OSC Tokyo Fall - OpenStack vps kvm
Naoto Gohko
 

More from Naoto Gohko (13)

ODC 2020 : "Rocky 8"
ODC 2020 : "Rocky 8"ODC 2020 : "Rocky 8"
ODC 2020 : "Rocky 8"
 
2019 0704 about ConoHa VM migration from C1 to C2
2019 0704 about ConoHa VM migration from C1 to C22019 0704 about ConoHa VM migration from C1 to C2
2019 0704 about ConoHa VM migration from C1 to C2
 
serverless openstack 101
serverless openstack 101serverless openstack 101
serverless openstack 101
 
2018 04-14-cockroachdb-20-now-available
2018 04-14-cockroachdb-20-now-available2018 04-14-cockroachdb-20-now-available
2018 04-14-cockroachdb-20-now-available
 
2017 0715 osc17do conoha cloud osclient
2017 0715 osc17do conoha cloud osclient2017 0715 osc17do conoha cloud osclient
2017 0715 osc17do conoha cloud osclient
 
2015 0228 OpenStack swift; GMO Internet Services
2015 0228 OpenStack swift; GMO Internet Services2015 0228 OpenStack swift; GMO Internet Services
2015 0228 OpenStack swift; GMO Internet Services
 
Open stack swift is too Enterprise? 2014/12/01 advent cal
Open stack swift is too Enterprise?  2014/12/01 advent calOpen stack swift is too Enterprise?  2014/12/01 advent cal
Open stack swift is too Enterprise? 2014/12/01 advent cal
 
TechOYAJI 2014 tokyo summer LT; CentOS7 and RDO Icehouse OpenStack
TechOYAJI 2014 tokyo summer LT;  CentOS7 and RDO Icehouse OpenStackTechOYAJI 2014 tokyo summer LT;  CentOS7 and RDO Icehouse OpenStack
TechOYAJI 2014 tokyo summer LT; CentOS7 and RDO Icehouse OpenStack
 
JOSUG2014 OpenStack 4th birthday party in Japan; the way of OpenStack API Dragon
JOSUG2014 OpenStack 4th birthday party in Japan; the way of OpenStack API DragonJOSUG2014 OpenStack 4th birthday party in Japan; the way of OpenStack API Dragon
JOSUG2014 OpenStack 4th birthday party in Japan; the way of OpenStack API Dragon
 
OpenStack base public cloud service by GMO Internet Inc., at 2013/12/12 Okin...
OpenStack base public cloud service by GMO Internet Inc.,  at 2013/12/12 Okin...OpenStack base public cloud service by GMO Internet Inc.,  at 2013/12/12 Okin...
OpenStack base public cloud service by GMO Internet Inc., at 2013/12/12 Okin...
 
OpenStack + KVM + IPv6 = oname.com; Next Folsom/Grizzly Service development s...
OpenStack + KVM + IPv6 = oname.com; Next Folsom/Grizzly Service development s...OpenStack + KVM + IPv6 = oname.com; Next Folsom/Grizzly Service development s...
OpenStack + KVM + IPv6 = oname.com; Next Folsom/Grizzly Service development s...
 
2012 OpenStack + KVM = onamae.com VPS #2 ~ vnc and snapshot ~
2012 OpenStack + KVM = onamae.com VPS #2 ~ vnc and snapshot ~2012 OpenStack + KVM = onamae.com VPS #2 ~ vnc and snapshot ~
2012 OpenStack + KVM = onamae.com VPS #2 ~ vnc and snapshot ~
 
2012 OSC Kyoto / 2012 OSC Tokyo Fall - OpenStack vps kvm
2012 OSC Kyoto / 2012 OSC Tokyo Fall - OpenStack vps kvm2012 OSC Kyoto / 2012 OSC Tokyo Fall - OpenStack vps kvm
2012 OSC Kyoto / 2012 OSC Tokyo Fall - OpenStack vps kvm
 

Recently uploaded

H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
MLILAB
 
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdfAKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
SamSarthak3
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
Kamal Acharya
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
MdTanvirMahtab2
 
Cosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdfCosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdf
Kamal Acharya
 
Railway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdfRailway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdf
TeeVichai
 
CME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional ElectiveCME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional Elective
karthi keyan
 
Immunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary AttacksImmunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary Attacks
gerogepatton
 
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdfGoverning Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
WENKENLI1
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
R&R Consult
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Sreedhar Chowdam
 
ethical hacking in wireless-hacking1.ppt
ethical hacking in wireless-hacking1.pptethical hacking in wireless-hacking1.ppt
ethical hacking in wireless-hacking1.ppt
Jayaprasanna4
 
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
AJAYKUMARPUND1
 
English lab ppt no titlespecENG PPTt.pdf
English lab ppt no titlespecENG PPTt.pdfEnglish lab ppt no titlespecENG PPTt.pdf
English lab ppt no titlespecENG PPTt.pdf
BrazilAccount1
 
AP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specificAP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specific
BrazilAccount1
 
WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234
AafreenAbuthahir2
 
ML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptxML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptx
Vijay Dialani, PhD
 
MCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdfMCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdf
Osamah Alsalih
 
Planning Of Procurement o different goods and services
Planning Of Procurement o different goods and servicesPlanning Of Procurement o different goods and services
Planning Of Procurement o different goods and services
JoytuBarua2
 
power quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptxpower quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptx
ViniHema
 

Recently uploaded (20)

H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
 
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdfAKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
 
Cosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdfCosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdf
 
Railway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdfRailway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdf
 
CME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional ElectiveCME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional Elective
 
Immunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary AttacksImmunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary Attacks
 
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdfGoverning Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
 
ethical hacking in wireless-hacking1.ppt
ethical hacking in wireless-hacking1.pptethical hacking in wireless-hacking1.ppt
ethical hacking in wireless-hacking1.ppt
 
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
 
English lab ppt no titlespecENG PPTt.pdf
English lab ppt no titlespecENG PPTt.pdfEnglish lab ppt no titlespecENG PPTt.pdf
English lab ppt no titlespecENG PPTt.pdf
 
AP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specificAP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specific
 
WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234
 
ML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptxML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptx
 
MCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdfMCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdf
 
Planning Of Procurement o different goods and services
Planning Of Procurement o different goods and servicesPlanning Of Procurement o different goods and services
Planning Of Procurement o different goods and services
 
power quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptxpower quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptx
 

OpenStack cloud for ConoHa, Z.com and GMO AppsCloud in okinawa opendays 2015 1216-01

  • 1. 1 Okinawa OpenDays 2015 (スペシャルトラック:事例 2015/12/16) (in Okinawa OpenLab) Naoto  Gohko  <naoto-­‐gohko@gmo.jp> IT  Architect  Enginner /  GMO  Internet  Inc., OpenStackのモデルの最適化と適用: ConoHaとZ.comとGMOアプリクラウド
  • 2. 2 šHistory of our services using OpenStack in GMO Internet Inc., šNova-network model and Diablo: Onamae.com VPS šQuantum overlay network: ConoHa Grizzly cluster šHigh performance network: GMO AppsCloud(Havana) šJuno ConoHa: Regison, Domain, DNS and SDS šJuno GMO AppsCloud: Ironic and copy offload Cinder šSwift cluster (shared from each OpenStack) # Agenda
  • 5. 5 Using OpenStack at GMO Internet
  • 6. 6 Public Clouds We are offering four public cloud services.
  • 7. 7 Physical Servers Running VMPhysical Server 1508 25294 Created VM Running Infrastructure 137223
  • 8. 8 Swift  cluster GMO Internet, Inc.: VPS and Cloud services Onamae.com VPS (2012/03) : http://www.onamae-server.com/ Forcus: global IPs; provided by simple "nova-network" tenten VPS (2012/12) http://www.tenten.vn/ Share of OSS by Group companies in Vietnam ConoHa VPS (2013/07) : http://www.conoha.jp/ Forcus: Quantam(Neutron) overlay tenant network GMO AppsCloud (2014/04) : http://cloud.gmo.jp/ OpenStack Havana based 1st region Enterprise grade IaaS with block storage, object storage, LBaaS and baremetal compute was provided Onamae.com Cloud (2014/11) http://www.onamae-cloud.com/ Forcus: Low price VM instances, baremetal compute and object storage ConoHa Cloud (2015/05/18) http://www.conoha.jp/ Forcus: ML2 vxlan overlay, LBaaS, block storage, DNSaaS(Designate) and original services by keystone auth OpenStack Diablo on  CentOS 6.x Nova Keystone Glance Nova  network Shared  codes Quantam OpenStack Glizzly on  Ubuntu  12.04 Nova Keystone Glance OpenStack Havana on  CentOS 6.x Keystone Glance Cinder Swift Swift Shared  cluster Shared  codes KeystoneGlance Neutron Nova Swift Baremetal compute Nova Ceilometer Baremetal compute Neutron LBaaS ovs +  gre tunnel  overlay Ceilometer Designate SwiftOpenStack Juno on  CentOS 7.x NovaKeystone Glance Cinder Ceilometer Neutron LBaaS GMO AppsCloud (2015/09/27) : http://cloud.gmo.jp/ 2nd region by OpenStack Juno based Enterprise grade IaaS with High IOPS Ironic Compute and Neutron LBaaS Upgrade   Juno GSLB Swift Keystone Glance CinderCeilometer Nova Neutron Ironic LBaaS
  • 10. 10 Oname.com VPS(Diablo)   • Service  XaaS model: – VPS  (KVM,  libvirt) • Network: – 1Gbps • Network  model:   – Flat-­‐VLAN  (Nova  Network),  without  flotingIP – IPv4  only • Public  API – None  (only  web-­‐panel) • Glance – None • Cinder – None • ObjectStorage – None OpenStack service:  Onamae.com VPS(Diablo)
  • 11. 11
  • 12. 12 Oname.com VPS(Diablo)   • Nova  Network:   – very  simple(LinuxBridge) – Flat  networking  is  scalable. • Only  1  NIC  per  VM. • Only  1  Public  Network  IP – MQ(rabbitmq)  dependency  is  little(sync.  API) • More  scalable  than  Juno,  Kilo,  Liberty  and  Mitaka • Cloud  ? – Only  virtulization management èBut   There  is  no  added  value,  such  as  a  free  configuration  of  the  network OpenStack service:  Onamae.com VPS(Diablo)
  • 13. 13 OpenStack service:  Onamae.com VPS(Diablo)  model compute vm compute NIC NIC Vlan network bridge NIC  vlan vlan tap vNIC Vlan network
  • 15. 15 ConoHa(Grizzly) • Service  XaaS model: – VPS  +  Private  networks  (KVM  +  libvirt) • Network: – 10Gbps  wired(10GBase-­‐T) • Network  model:   – Flat-­‐VLAN  +  Quantam ovs-­‐GRE  overlay – IPv6/IPv4  dualstack • Public  API – None  (only  web-­‐panel) • Glance – None • Cinder – None • ObjectStorage – Swift  (After  Havana) OpenStack service:  ConoHa(Grizzly)
  • 16. 16 ConoHa(Grizzly) • Quantam Network: – It  was  using  the  initial  version  of  the  Open  vSwitch full   mesh  GRE-­‐vlan overlay  network  with  LinuxBridge Hybrid èBut When  the  scale  becomes  large,   Localization  occurs  to  a  specific  node   of  the  communication  of  the  GRE-­‐mesh-­‐tunnel (with  under  cloud  network(L2)  problems) (Broadcast  storm?) OpenStack service:  ConoHa(Grizzly)
  • 19. 19 GMO  AppsCloud(Havana) • Service  XaaS model: – KVM  compute  +  Private  VLAN  networks  +  Cinder  +  Swift • Network: – 10Gbps  wired(10GBase  SFP+) • Network  model:   – IPv4  Flat-­‐VLAN  +  Neutron  LinuxBridge(not   ML2)  +  Brocade  ADX  L4-­‐LBaaS  original  driver • Public  API – Provided  the  public  API • Ceilometer • Glance – Provided(GlusterFS) • Cinder – HP  3PAR(Active-­‐Active  Multipath  original)  +  NetApp • ObjectStorage – Swift  cluster   • Bare-­‐Metal  Compute – Modifiyed cobbler  bare-­‐metal  deploy  driver. OpenStack service:  GMO  AppsCloud(Havana)
  • 20. 20 OpenStack service:  GMO  AppsCloud(Havana)  model compute vm NIC Vlan network bridge NIC  vlan tap vNIC Vlan network vNIC bridge vlan tap compute NIC bridge NIC  vlan bridge vlan public  network Neutronだけどsimpleな LinuxBridge model (Context  Switchが少ない) >>  Game配信など高速用途の 仮想化ネットワーク それが、GMO  AppsCloud
  • 22. 22 GMO  AppsCloud(Havana)  public  API Web  panel(httpd,  php) API  wrapper  proxy (httpd,  php Framework:  fuel  php) Havana Nova  API Customer  sys  API Havana Neutron API Havana Glance  API OpenStack API for input validation Customer DB Havana Keystone  API OpenStack API Havana Cinder  API Havana Ceilometer  API Endpoint  L7:reverse  proxy Havana Swift  Proxy
  • 23. 23 Havana:  baremetal compute  cobbler  driver
  • 24. 24 Havana:  baremetal compute  cobbler  driver Baremetal net: • Bonding  NIC • Taged VLAN • allowd VLAN  +  dhcp native  VLAN
  • 25. 25 Havana:  baremetal compute  Cisco  iOS  in  southbound https://code.google.com/p/cisco-ios-cli-automation/
  • 26. 26 OpenStack Juno cluster: • ConoHa (2) • GMO AppsCloud (2)
  • 27. 27 Swift  cluster GMO Internet, Inc.: VPS and Cloud services Onamae.com VPS (2012/03) : http://www.onamae-server.com/ Forcus: global IPs; provided by simple "nova-network" tenten VPS (2012/12) http://www.tenten.vn/ Share of OSS by Group companies in Vietnam ConoHa VPS (2013/07) : http://www.conoha.jp/ Forcus: Quantam(Neutron) overlay tenant network GMO AppsCloud (2014/04) : http://cloud.gmo.jp/ OpenStack Havana based 1st region Enterprise grade IaaS with block storage, object storage, LBaaS and baremetal compute was provided Onamae.com Cloud (2014/11) http://www.onamae-cloud.com/ Forcus: Low price VM instances, baremetal compute and object storage OpenStack Diablo on  CentOS 6.x Nova Keystone Glance Nova  network Shared  codes Quantam OpenStack Glizzly on  Ubuntu  12.04 Nova Keystone Glance OpenStack Havana on  CentOS 6.x Keystone Glance Cinder Swift Swift Shared  cluster Shared  codes KeystoneGlance Neutron Nova Swift Baremetal compute Nova Ceilometer Baremetal compute Neutron LBaaS ovs +  gre tunnel  overlay Ceilometer Upgrade   Juno
  • 29. 29 š Multi Region š SSD Only š Scalability š API š Simple and competitive pricing # Newly Released ConoHa
  • 30. 30 In  ConoHa,  We  added  two  additional  features. – Multi-­‐location  region – Domain  Structure:    Application  to  multi-­‐location  region   structure – 1  Domain  ==  1  OEM  service  or  Product  service – Domain  on  API  validation  wrapper  proxy   Multi-Location region and domain structures
  • 31. 31 The meaning of the word • Domain • Keystone domain • With v2 API service (our cloud) • != DNS Domain • Location • Different geographic locations on the Earth • US(San Jose), JP(Tokyo), SG(Singapore) • Region • OpenStack region • Location != Region • Can setup up multiple Region in one Location
  • 32. 32 Tokyo Singapore Sanjose # ConoHa has data centers in 3 Locations
  • 33. 33 CentOS 7.1 x86_64 Juno (RDO) Maria DB Connect to Tokyo KeyStone from All regions. Add each region endpoints to Tokyo KeyStone. Did not need to modify OpenStack code. š OS and OpenStack Versions š Multi Region Setting # Specs
  • 34. 34 Tokyo Singapole User/tenant User/tenant API  Management Keystone API API  Management Keystone APIAPI  Management Keystone API Token Token Tokyo SanJoseSingapore API  Management Keystone API API  Management Keystone API READ/WRITEREAD READ TokenToken Token Do not create/delete users Do not create/delete users Our Customer base User administration # User-registration is possible in Japan only DB Replication DB Replication User/tenant User/tenantUser/tenant R/W R/W
  • 35. 35 # Issues and Restrictions on Multi Region š User-registration is possible in Japan only š VPN performance issue š Issues on replicating token table.
  • 36. 36 API  Management Keystone API KeystoneDB Nova Neutron Glance Cinder OpenStack Cluster Nova Get/token Glance Get/token Neutron Get/token Cinder Get/tokenVM Create ! Nova user token:001 Neutron Token:002 Glance Token:003 Cinder Token:004 VM Create ! VM Create ! Nova user token:002 Neutron Token:003 Glance Token:004 Cinder Token:005 Nova user token:006 Neutron Token:007 Glance Token:008 Cinder Token:009 # Bloat access tokens š Too many tokens will be created from each components.
  • 37. 37 Setting example.conf [keystone_authtoken] token= 100 year expires token [neutron_authtoken] token= 100 year expires token [glance_authtoken] token= 100 year expires token [cinder_authtoken] token= 100 year expires token # Issues on replicating token table. š 100 year expires token We fixed it so that any tokens can be used for each components.
  • 38. 38 OpenStack Authentication in Juno (V2 keystone domains)
  • 40. 40 Swift  cluster GMO Internet, Inc.: VPS and Cloud services Onamae.com VPS (2012/03) : http://www.onamae-server.com/ Forcus: global IPs; provided by simple "nova-network" tenten VPS (2012/12) http://www.tenten.vn/ Share of OSS by Group companies in Vietnam ConoHa VPS (2013/07) : http://www.conoha.jp/ Forcus: Quantam(Neutron) overlay tenant network GMO AppsCloud (2014/04) : http://cloud.gmo.jp/ OpenStack Havana based 1st region Enterprise grade IaaS with block storage, object storage, LBaaS and baremetal compute was provided Onamae.com Cloud (2014/11) http://www.onamae-cloud.com/ Forcus: Low price VM instances, baremetal compute and object storage ConoHa Cloud (2015/05/18) http://www.conoha.jp/ Forcus: ML2 vxlan overlay, LBaaS, block storage, DNSaaS(Designate) and original services by keystone auth OpenStack Diablo on  CentOS 6.x Nova Keystone Glance Nova  network Shared  codes Quantam OpenStack Glizzly on  Ubuntu  12.04 Nova Keystone Glance OpenStack Havana on  CentOS 6.x Keystone Glance Cinder Swift Swift Shared  cluster Shared  codes KeystoneGlance Neutron Nova Swift Baremetal compute Nova Ceilometer Baremetal compute Neutron LBaaS ovs +  gre tunnel  overlay Ceilometer Designate SwiftOpenStack Juno on  CentOS 7.x NovaKeystone Glance Cinder Ceilometer Neutron LBaaS GMO AppsCloud (2015/09/27) : http://cloud.gmo.jp/ 2nd region by OpenStack Juno based Enterprise grade IaaS with High IOPS Ironic Compute and Neutron LBaaS Upgrade   Juno GSLB Swift Keystone Glance CinderCeilometer Nova Neutron Ironic LBaaS
  • 41. 41 • The  cost  to  operate  Multi  version  Openstack have   increased • It  is  difficult  to  upgrade  or  add  new  features è Managing  multiple  sites  of  OpenStack is  a  headache. What s the problems abount Multi-Cluster?
  • 42. 42
  • 43. 43 ConoHa: based on OpenStack Juno (IaaS) • Multiple region openstack cluster • Tokyo / Singapore / San Jose • ... and so on • Full SSD storage • Multiple keystone service domain support • ConoHa and Next service (now in development) ... OEM etc. • LB as a Service: LVS-DSR (original) • DNS as a service : OpenStack Designate • OpenStack API and additional RESTful API • Multiple Languages web panel support • Japanese, ConoHa, English, Korean, Mandarin Chinese
  • 44. 44 • Create  scope  in  the  domain – Scoped  items • Flavor • Images • Volume  type – Shared  items • Public  Networks • Hypervisor • Images  (Default  domain) • Using  Keystone  API  v2.0 Motivation
  • 45. 45 • We  use  and  customize  the  code  that  is  in  Juno  Keystone  v3  domain – Enable  Domain  ID  for  Juno  Keystone  V2  API • SaaS  implementation  with  python-­‐keystoneclient   – Process  related  Domain  ID   and  Data  implementation èDomain  ID  from  token  API User:   POST  /v2.0/token Admin(service):   GET  /v2.0/token/{id} Juno Keystone V2 API : Does not support Domains
  • 46. 46 Keystone:  wrapper  proxy  at  domain  specific  keystone  endpoint Domains and user prefix namespace Domain Product Prefix name  space gnc ConoHa gnc zjp JP  OEM-­‐1 zjp zsg SG  OEM-­‐ 1 zsg ...  ...   OEM-­‐n ...  ... Exp) user: gnc0000348 Image name: gnc_centos7
  • 47. 47 We  released  2nd service  on  same  Juno  infra.   (2015/10/20  ~) Adding domain(2nd): cloud.z.com
  • 48. 48 Diferrent  API  endpoints  in  a  separate  Domain Multi-Domains and Multi-endpoint
  • 50. 50 OpenStack Juno:  2  service  cluster,  released MikumoConoHa MikumoAnzu Mikumo=  美雲 =   Beautiful  cloud New  Juno  region  released:   10/26/2015
  • 51. 51 • Service  model:  Public  cloud  by  KVM • Network:  10Gbps  wired(10GBase  SFP+) • Network  model:   – Flat-­‐VLAN  +  Neutron  ML2  ovs-­‐VXLAN  overlay   +  ML2  LinuxBridge(SaaS  only) – IPv6/IPv4  dualstack • LBaaS:  LVS-­‐DSR(original) • Public  API – Provided  the  public  API  (v2  Domain) • Compute  node:  ALL  SSD  for  booting  OS – Without  Cinder  boot   • Glance:  provided • Cinder:  SSD  NexentaStore zfs (SDS) • Swift  (shared  Juno  cluster) • Cobbler  deplyon  under-­‐cloud – Ansible configuration • SaaS  original  service  with  keystone  auth – Email,  web,  CPanel and  WordPress OpenStack Juno:  2  service  cluster,  released • Service  model:  Public  cloud  by  KVM • Network:  10Gbps  wired(10GBase  SFP+) • Network  model:   – L4-­‐LB-­‐Nat  +  Neutron  ML2  LinuxBridge VLAN – IPv4  only • LBaaS:  Brocade  ADX  L4-­‐NAT-­‐LB(original) • Public  API – Provided  the  public  API • Compute  node:  Flash  cached  or  SSD • Glance:  provided  (NetApp  offload) • Cinder:  NetApp  storage • Swift  (shared  Juno  cluster) • Ironic  on  under-­‐cloud – Compute  server  deploy  with  Ansible config • Ironic  baremetal compute – Nexsus Cisco  for  Tagged  VLAN  module – ioMemory configuration
  • 53. 53 Designate  DNS:  ConoHa cloud(Juno) Client API DNS Identify Endpoint Storage DB OpenStack Keystone Backend DB RabbitMQ Central Components  of  the  DNS  and  GSLB(original) back-­‐end  services Application  of  Designate  DNS: • DNS  as  a  service(tenant) • Undercloud Infra-­‐network • No  Keystone  auth config
  • 54. 54 OpenStack Cinder Block storage: ConoHa: NexentaStor(SDS) AppsCloud: NetApp
  • 55. 55 Compute  and  Cinder(zfs):  SSD Toshiba  enterprise  SSD • The  balance  of  cost  and  performance  we  have  taken. • Excellent  IOPS  performance,  low  latency Compute  local  SSD The  benefits  of  SSD  of  Compute  of  local  storage • The  provision  of  high-­‐speed  storage   than  cinder  boot. • It  is  easy  to  take  online  live  snapshot  of  vm instance. • deployment  of  vm is  fast. ConoHa:  Compute  option  was  modified: • take  online  live  snapshot  of  vm instance. http://toshiba.semicon-­‐storage.com/jp/product/storage-­‐ products/publicity/storage-­‐20150914.html
  • 56. 56 NexentaStor zfs cinder:  ConoHa cloud(Juno) Compute  
  • 57. 57 NetApp  storage:  GMO  Appscloud(Juno) If  you  are  using  the  same  Cluster  onTAPNetApp  a   Glance  and  Cinder  storage,  it  is  possible  to  offload   a  copy  of  the  inter-­‐service  of  OpenStack as  the   processing  of  NetApp  side.   • Create  volume  from  glance  image ((glance  the  image  is  converted  (ex:  qcow2  to  raw)   required  that  does  not  cause  the  condition) • Volume  QoS limit:  Important  function  of  multi-­‐ tenant  storage • Uppper IOPS-­‐limit  by  volume
  • 58. 58 OpenStack Ironic: Only AppsCloud: • Undercloud Ironic deploy • Multi-tenant Ironic deploy
  • 59. 59 Ironic  with  undercloud:  GMO  Appscloud(Juno) For  Compute  server  deployment. Kilo  Ironic  and  All-­‐in-­‐one • Compute  server:  10G  boot • Clout-­‐init:  network • Compute  setup:  Ansible Under-­‐cloud  Ironic(Kilo): It  will  use  a  different   network  and  Ironic   Baremetal dhcp for  Service   baremetal compute   Ironic(Kilo). (OOO  seed  server) Trunk  allowed  vlan,  LACP
  • 60. 60 Ironic(Kilo)  baremetal:  GMO  Appscloud(Juno) Boot  baremetal instance • baremetal server (with  Fusion  ioMemory SanDisk) • 1G  x4  bonding  +  Tagged allowed VLAN • Clout-­‐init:  network  +  lldp • Network:  Nexsus Cisco AllowdVLAN  security Ironic  Kilo  +  Juno:  Fine • Ironic  Python  driver • Whole  Image  write • Windows:  OK
  • 61. 61 Ironic  network  multi-‐‑‒tenant  separation for  Mitaka • https://wiki.openstack.org/wiki/Meetings/Ironic-­‐neutron • Bare  metal  physical  connectivity  scenarios  -­‐ supported  and  unsupported   https://docs.google.com/document/d/1a-­‐ DX4FQZoX1SdTOd9w_Ug6kCKdY1wfrDcR3SKVhWlcQ/view?usp=sharing • サポートされるシナリオが図解されています(Libertyにおけるもの) • RackspaceのonMetalの実装もLibertyでは特殊な例 • Neutronがtrunk  allowed  vlan(tagged)を表現できない(in  Liberty) • Mitaka待ち https://etherpad.openstack.org/p/summit-­‐mitaka-­‐ironic • ThinkITに解説を参照 https://thinkit.co.jp/article/8443 連載: OpenStack  Summit  Tokyo  レポート Ironic最新動向:待望のマルチテナント対応が視野に。ストレージや運用自動化も進展(2015年11月26日(木)) 重松 光浩(NTT  ソフトウェアイノベーションセンタ),  高田 唯子(NEC  BI統括ユニット)
  • 62. 62 Ironic  network  multi-‐‑‒tenant  separation:  model • Ironic  neutron  ML2  driver  Integration https://blueprints.launchpad.net/nova/+spec/ironic-­‐networks-­‐support • Single  port • LAG  port  (bonding) • MLAG  port  (LACP) • Trunk  and  multiple  tagged  VLAN  or  VXLAN(本気かどうか?) • Only  support  ML2  VLAN  tunneling  network • LinuxBridge ML2  VLAN  tunnel  compute • ovs ML2  VLAN  tunnel  compute,  ovs ML2  VXLAN  tunnel • GMO  AppsCloudのモデルでは、undercloud Ironic,  multi-­‐tenentIronicともに • MLAG  port  (LACP) • Trunk  and  multiple  tagged  VLAN  +  vlan allowed • Vlan allowedがmulti-­‐tenantのセキュリティ設定の要
  • 63. 63 Ironic  network:  rackspace onMetal =  GMO  AppsCloud for  Mitaka • Vlan aware  VMs • https://blueprints.launchpad.net/neutron/+spec/vlan-­‐aware-­‐vms • VMの中にtagged  vlanが通る • これと同じようにして、baremetalにもというらしいのだが • Rackspace  OnMetal • 現実的実装 :  https://github.com/rackerlabs/ironic-­‐neutron-­‐plugin • 製品の説明 :  https://www.rackspace.com/knowledge_center/article/create-­‐onmetal-­‐ cloud-­‐servers • ユーザ目線での情報: https://major.io/2015/08/21/using-­‐systemd-­‐networkd-­‐with-­‐bonding-­‐on-­‐rackspaces-­‐ onmetal-­‐servers/ • Rackspaceも考えることは一緒だった <<  bonding  +  tagged  VLAN • ほぼ、我々と同じような実装
  • 64. 64 • Service  model:  Public  cloud  by  KVM • Network:  10Gbps  wired(10GBase  SFP+) • Network  model:   – Flat-­‐VLAN  +  Neutron  ML2  ovs-­‐VXLAN  overlay   +  ML2  LinuxBridge(SaaS  only) – IPv6/IPv4  dualstack • LBaaS:  LVS-­‐DSR(original) • Public  API – Provided  the  public  API  (v2  Domain) • Compute  node:  ALL  SSD  for  booting  OS – Without  Cinder  boot   • Glance:  provided • Cinder:  SSD  NexentaStore zfs (SDS) • Swift  (shared  Juno  cluster) • Cobbler  deplyon  under-­‐cloud – Ansible configuration • SaaS  original  service  with  keystone  auth – Email,  web,  CPanel and  WordPress OpenStack Juno:  2  service  cluster,  released • Service  model:  Public  cloud  by  KVM • Network:  10Gbps  wired(10GBase  SFP+) • Network  model:   – L4-­‐LB-­‐Nat  +  Neutron  ML2  LinuxBridge VLAN – IPv4  only • LBaaS:  Brocade  ADX  L4-­‐NAT-­‐LB(original) • Public  API – Provided  the  public  API • Compute  node:  Flash  cached  or  SSD • Glance:  provided  (NetApp  offload) • Cinder:  NetApp  storage • Swift  (shared  Juno  cluster) • Ironic  on  under-­‐cloud – Compute  server  deploy  with  Ansible config • Ironic  baremetal compute – Nexsus Cisco  for  Tagged  VLAN  module – ioMemory configuration
  • 66. 66 Swift  cluster  (Havana  to  Juno  upgrade) SSD  storage: container/account  server   at  every  zone    
  • 67. 67 swift  proxy keystone OpenStack Swift cluster (5 zones, 3 copy) swift  proxy keystone LVS-­‐DSrLVS-­‐DSR HAProxy(SSL)HAProxy(SSL) Xeon  E3-­‐1230  3.3GHz Memory  16GB Xeon  E3-­‐1230  3.3GHz Memory  16GB Xeon  E5620  2.4GHz  x  2CPU Memory  64GB swift  objects swift  objects Xeon  E3-­‐1230  3.3GHz swift  account swift  container Xeon  E5620  2.4GHz  x  2CPU Memory  64GB,  SSD  x  2 swift  objects swift  objects Xeon  E3-­‐1230  3.3GHz swift  account swift  container Xeon  E5620  2.4GHz  x  2CPU Memory  64GB,  SSD  x  2 swift  objects swift  objects Xeon  E3-­‐1230  3.3GHz swift  account swift  container Xeon  E5620  2.4GHz  x  2CPU Memory  64GB,  SSD  x  2 swift  objects swift  objects Xeon  E3-­‐1230  3.3GHz swift  account swift  container Xeon  E5620  2.4GHz  x  2CPU Memory  64GB,  SSD  x  2 swift  objects swift  objects Xeon  E3-­‐1230  3.3GHz swift  account swift  container Xeon  E5620  2.4GHz  x  2CPU Memory  64GB,  SSD  x  2
  • 68. 68 swift  objects swift  objects swift  objects swift  objects swift  objects swift  objects swift  objects swift  objects swift  objects swift  objects swift  proxy keystone Havana AppsCloud swift  proxy keystone Grizzly ConoHa Havana To Juno swift  account swift  container swift  account swift  container swift  account swift  container swift  account swift  container swift  account swift  container swift  proxy keystone Juno ConoHa swift  proxy keystone Juno AppsCloud Swift  cluster:  multi-‐‑‒auth and  multi-‐‑‒endpoint swift  proxy keystone Juno Z.com
  • 70. 70 • Juno  release  swift  2.2  el6  (self  build:  なんとか作った) Swift:  Havana  to  Juno  upgrade:  el6-‐‑‒RPMS  build
  • 71. 71 Swift:  Junoより先のupgrade • Kilo以降の開発は確実に python 2.7以降の検証しかされてない – >> python 2.6で動くかどうかは、確実に機能テストをしてから適用するべき • Python 2.7 でパッケージ作成も検討 – >> 冗長片系づつ更新するので、問題なさそう (◎: 最有力) – Python 3.4で動かす意義: asyncio thread (△: Swiftには反映されていない) • go-lang swiftは? – Hummingbird swift (go-lang) – https://github.com/openstack/swift/tree/feature/hummingbird/go – これまで、Plugin作ったもの>> go-langにする必要が出てくる (△: ここがつらい)
  • 72. 72 Finally: The  GMO  AppsCloud  in  Juno  OpenStack  it  was  released  on  10/27/2015. • Deployment  of  SanDisk  Fusion  ioMemory by  Kilo  Ironic  on  Juno  OpenSack I  can  also. • Compute  server  was  deployed  by  Kilo  Ironic  with  under-­‐cloud  All-­‐in-­‐One  openstack.     Compute  server  configuration  was  deployed  by  Ansible. • Cinder  and  Glance  was  proviedNetApp  copyoffload storage  mechanism.   • LbaaS is  Brocade  ADX  NAT  mode  original  driver. • Linux  Bridge  Neutron  mode  is  best  performance  without  L3  switch On  the  otherhand;    Juno  OpenStack ConoHareleased  on  05/18/2015. • Designate  DNS  and  GSLB  service  was  started  on  ConoHa. • Cinder  storage  is  SDS  provied NexentaStor zfs storage  for  single  volume  type. • LBaaS is  LVS-­‐DSR  original  driver. • ovs-­‐VXLAN  overlay  Neutron  mode  is  more  high  degree  of  freedom. • And  Z.com OEM  openstack domain  was  living  together  in  ConoHa
  • 74. 74 Develop  OpenStack related  tools Tool  that  create  Docker host. Golang Develop  Vagrant  provider  for  ConoHa. Fix  a  problem  and pull  request. Docker Machine https://github.com/hironobu-­‐s/vagrant-­‐conoha
  • 75. 75 CLI  tool  that  handle  ConoHa specific  APIs Golang Develop  plugin  that  enable  to  save  media  files   to  Swift(Object  Store) Develop  OpenStack related  tools https://github.com/hironobu-­‐s/conoha-­‐iso https://wordpress.org/plugins/conoha-­‐object-­‐sync/