The Cloud Specialists
Building a Container
Solution on Top of Apache
Cloudstack
Paul Angus, VP Technology • @CloudyAngus
paul.angus@shapeblue.com
A n i n t r o d u c t i o n t o
Giles Sirett• @GilesSirett
Giles.sirett@shapeblue.com giles@apache.org
C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlue
W h e r e ’s P a u l
+ =+
W h e r e ’s W a l l y ?
C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlue
Paul Angus – VP Technology
• Global authority on CloudStack & cloud infrastructure design.
• 10+ years C-Level experience.
• Apache CloudStack project committer
• Specialising in deployment of CloudStack
and surrounding infrastructure
• USP, Georgian Ministry of Justice, Orange, TomTom,
PaddyPower, Ascenty, BSkyB
A b o u t m e
The Cloud Specialists
ShapeBlue.com @ShapeBlue
# W h o A m I ?
• PMC member & Committer -
Apache CloudStack
• Chairman – European CloudStack
user group
• CEO ShapeBlue
• Declaration: I’m a business guy
(Software Engineer in recovery)
• Also: Physicist, husband, runner,
Dad, rugby coach
The Cloud Specialists
ShapeBlue.com @ShapeBlue
“ShapeBlue are expert builders of public
& private clouds. They are the leading
independent global CloudStack services
company”
A b o u t S h a p e B l u e
C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlue
S h a p e B l u e c u s t o m e r s
O u r c u s t o m e r s
C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlue
S h a p e B l u e c u s t o m e r s
O u r c u s t o m e r s
C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlue
S h a p e B l u e c u s t o m e r s
O u r c u s t o m e r s
The Cloud Specialists
ShapeBlue.com @ShapeBlue
Introduction
Click to edit
The Cloud Specialists ShapeBlue.com @ShapeBlue
The container revolution
Click to edit
The Cloud Specialists
The container revolution
• Massive growth of cloud native
applications
Microservices architectures
• Containers are a key component
of cloud native applications
• Application level software delivery
• Lightweight (higher density vs VMs)
• Faster start-up time (vs VMs)
• Most users still overwhelmingly
consume VM’s
W h a t s d r i v i n g t h i s ?
Click to edit
The Cloud Specialists
The container revolution
• Market is fast moving and unsettled
• What do I pick for CaaS?
• Focus from most vendors is on
enterprise use
• Multi-tenancy is an afterthought
W h a t d o I d o ?
Click to edit
The Cloud Specialists
The container revolution
T h e V M i s d e a d , l o n g l i v e t h e V M
Click to edit
The Cloud Specialists
The challenges for service providers
• Consumers of IaaS are demanding a
container platform
• They want it in the same place
• IaaS is currently a VM based business
• What should the cloud service provider
sell ?
• Containers vs Virtual Machines?
• How should multi-tenancy be handled?
• Should the VM be removed ? How ?
• How can I orchestrate all of this ?
• Lots of emerging offerings focused on
the Enterprise market only
T h e c h a l l e n g e s
Click to edit
The Cloud Specialists
We couldn’t find the
answer so we went
and built that s**t
Click to edit
The Cloud Specialists
CloudStack Container Service
• Based on the model offered by Google and AWS
• CaaS offering within existing IaaS environments
• No disruption to user experience or business
• Users deploy and orchestrate containers within
their IaaS infrastructure
• Users pay for the underlying VM’s / infra.
• Built on established technologies
• Apache CloudStack
• Kubernetes
• CoreOS
T h e C l o u d s t a c k c o n t a i n e r s e r v i c e
Click to edit
The Cloud Specialists
CloudStack Container Service – what is it
• UI/API Plugin functionality for Cloudstack
• Orchestrates the deployment of Kubernetes within VM
clusters to manage containers
• Creates secure access to the
Kubernetes endpoint and dashboard
• Allows pass-through access to VMs
• Acts as a control plane
C l o u d s t a c k c o n t a i n e r s e r v i c e
The Cloud Specialists
ShapeBlue.com @ShapeBlue
Components
C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlue
1. Framework adds the concept of a group or cluster of
VMs into CloudStack and enables the creation and
management of those VMs as a group at the API level.
2. Deploy Kubernetes onto a group of VMs, configure
them as a Kubernetes cluster and query the Kubernetes
API to obtain and return state information.
3. UI to simplify interaction with the clusters once created.
C C S c o m p o n e n t s
C l i c k t o e d i t
The Cloud Specialists
@ShapeBlueShapeBlue.com
C C S c o m p o n e n t s
C l i c k t o e d i t
The Cloud Specialists
@ShapeBlueShapeBlue.com
C C S c o m p o n e n t s
The Cloud Specialists
ShapeBlue.com @ShapeBlue
Demonstration
C l i c k t o e d i t
The Cloud Specialists
@ShapeBlueShapeBlue.com
C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlue
• Created a Container Cluster
• Used the auto-deployed dashboard
• Deployed two HA containerised applications
• Created firewall and load-balancing rules to expose those
applications
• Accessed those applications
Summary
C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlue
New APIs
createContainerCluster
name : name of the cluster
description
zoneId: zone in which cluster to be launched. zone to be of 'advanced' zone
networkId: network of 'shared' type
nodeCount: number of node instances in the cluster used for launching the containers
serviceOfferingId: uuid of the computer offering that shall be used for launching nodes, and master k8s VMs
templateId: UUID of the template for creating the VMs
listContainerCluster
deleteContainerCluster
id: UUID of the cluster to be deleted
C C S c o m p o n e n t s
Click to edit
The Cloud Specialists
Technology Choices
• Apache CloudStack
• IaaS orchestration platform
• Drives many of the world’s largest public clouds
• Tightly defined scope
• Kubernetes
• Kubernetes is an open-source system for automating deployment,
operations, and scaling of containerised applications
• Open sourced by Google now at the CNCF under the Linux Foundation
• Set to become defacto. In use at Google,GKE, HP Helion, Redhat
Openshift, VMware Cloud, Windows Azure
Te c h n o l o g y c h o i c e s
Click to edit
The Cloud Specialists
Agnostic
• Uses Docker engine by default but can choose rkt by CoreOS
• Users can choose the container networking solution they want, the
current default is flannel
A g n o s t i c
Click to edit
The Cloud Specialists
Agnostic
• Currently implemented K8S, but framework can be used for other
cluster based platforms in the future:
Network Storage Compute
A g n o s t i c
C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlue
• Automate exposing services to public internet
• Support resizing of clusters
• Auto-scaling of clusters
• Upgrade of Kubernetes version
• Intelligent independent sizing of master node
• Optional HA for master nodes.
• Use of distributed etcd data store
• Optional use of anti-affinity groups
• Support for CloudStack volumes in Kubernetes for data persistency
• Support for baremetal deployments.
F e a t u r e r o a d m a p
C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlue
• Licensed version at GA July 2016
• Currently supported in Apache Cloudstack >4.5
• and today…….
Ti m e f r a m e s
C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlue
SHAPEBLUE CONTRIBUTES
NATIVE SUPPORT FOR
KUBERNETES AND DOCKER
TO APACHE CLOUDSTACK
(we’ve opensourced it)
The Cloud Specialists
ShapeBlue.com @ShapeBlue
Q u e s t i o n s
?
The Cloud Specialists
Building a Container
Solution on Top of Apache
Cloudstack
Paul Angus, VP Technology • @CloudyAngus
paul.angus@shapeblue.com
A n i n t r o d u c t i o n t o
Giles Sirett• @GilesSirett
Giles.sirett@shapeblue.com giles@apache.org

CloudStack Container Service

  • 1.
    The Cloud Specialists Buildinga Container Solution on Top of Apache Cloudstack Paul Angus, VP Technology • @CloudyAngus paul.angus@shapeblue.com A n i n t r o d u c t i o n t o Giles Sirett• @GilesSirett Giles.sirett@shapeblue.com giles@apache.org
  • 2.
    C l ic k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue W h e r e ’s P a u l + =+ W h e r e ’s W a l l y ?
  • 3.
    C l ic k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue Paul Angus – VP Technology • Global authority on CloudStack & cloud infrastructure design. • 10+ years C-Level experience. • Apache CloudStack project committer • Specialising in deployment of CloudStack and surrounding infrastructure • USP, Georgian Ministry of Justice, Orange, TomTom, PaddyPower, Ascenty, BSkyB A b o u t m e
  • 4.
    The Cloud Specialists ShapeBlue.com@ShapeBlue # W h o A m I ? • PMC member & Committer - Apache CloudStack • Chairman – European CloudStack user group • CEO ShapeBlue • Declaration: I’m a business guy (Software Engineer in recovery) • Also: Physicist, husband, runner, Dad, rugby coach
  • 5.
    The Cloud Specialists ShapeBlue.com@ShapeBlue “ShapeBlue are expert builders of public & private clouds. They are the leading independent global CloudStack services company” A b o u t S h a p e B l u e
  • 6.
    C l ic k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue S h a p e B l u e c u s t o m e r s O u r c u s t o m e r s
  • 7.
    C l ic k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue S h a p e B l u e c u s t o m e r s O u r c u s t o m e r s
  • 8.
    C l ic k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue S h a p e B l u e c u s t o m e r s O u r c u s t o m e r s
  • 9.
    The Cloud Specialists ShapeBlue.com@ShapeBlue Introduction
  • 10.
    Click to edit TheCloud Specialists ShapeBlue.com @ShapeBlue The container revolution
  • 11.
    Click to edit TheCloud Specialists The container revolution • Massive growth of cloud native applications Microservices architectures • Containers are a key component of cloud native applications • Application level software delivery • Lightweight (higher density vs VMs) • Faster start-up time (vs VMs) • Most users still overwhelmingly consume VM’s W h a t s d r i v i n g t h i s ?
  • 12.
    Click to edit TheCloud Specialists The container revolution • Market is fast moving and unsettled • What do I pick for CaaS? • Focus from most vendors is on enterprise use • Multi-tenancy is an afterthought W h a t d o I d o ?
  • 13.
    Click to edit TheCloud Specialists The container revolution T h e V M i s d e a d , l o n g l i v e t h e V M
  • 14.
    Click to edit TheCloud Specialists The challenges for service providers • Consumers of IaaS are demanding a container platform • They want it in the same place • IaaS is currently a VM based business • What should the cloud service provider sell ? • Containers vs Virtual Machines? • How should multi-tenancy be handled? • Should the VM be removed ? How ? • How can I orchestrate all of this ? • Lots of emerging offerings focused on the Enterprise market only T h e c h a l l e n g e s
  • 15.
    Click to edit TheCloud Specialists We couldn’t find the answer so we went and built that s**t
  • 16.
    Click to edit TheCloud Specialists CloudStack Container Service • Based on the model offered by Google and AWS • CaaS offering within existing IaaS environments • No disruption to user experience or business • Users deploy and orchestrate containers within their IaaS infrastructure • Users pay for the underlying VM’s / infra. • Built on established technologies • Apache CloudStack • Kubernetes • CoreOS T h e C l o u d s t a c k c o n t a i n e r s e r v i c e
  • 17.
    Click to edit TheCloud Specialists CloudStack Container Service – what is it • UI/API Plugin functionality for Cloudstack • Orchestrates the deployment of Kubernetes within VM clusters to manage containers • Creates secure access to the Kubernetes endpoint and dashboard • Allows pass-through access to VMs • Acts as a control plane C l o u d s t a c k c o n t a i n e r s e r v i c e
  • 18.
  • 19.
    C l ic k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue 1. Framework adds the concept of a group or cluster of VMs into CloudStack and enables the creation and management of those VMs as a group at the API level. 2. Deploy Kubernetes onto a group of VMs, configure them as a Kubernetes cluster and query the Kubernetes API to obtain and return state information. 3. UI to simplify interaction with the clusters once created. C C S c o m p o n e n t s
  • 20.
    C l ic k t o e d i t The Cloud Specialists @ShapeBlueShapeBlue.com C C S c o m p o n e n t s
  • 21.
    C l ic k t o e d i t The Cloud Specialists @ShapeBlueShapeBlue.com C C S c o m p o n e n t s
  • 22.
    The Cloud Specialists ShapeBlue.com@ShapeBlue Demonstration
  • 23.
    C l ic k t o e d i t The Cloud Specialists @ShapeBlueShapeBlue.com
  • 24.
    C l ic k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue • Created a Container Cluster • Used the auto-deployed dashboard • Deployed two HA containerised applications • Created firewall and load-balancing rules to expose those applications • Accessed those applications Summary
  • 25.
    C l ic k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue New APIs createContainerCluster name : name of the cluster description zoneId: zone in which cluster to be launched. zone to be of 'advanced' zone networkId: network of 'shared' type nodeCount: number of node instances in the cluster used for launching the containers serviceOfferingId: uuid of the computer offering that shall be used for launching nodes, and master k8s VMs templateId: UUID of the template for creating the VMs listContainerCluster deleteContainerCluster id: UUID of the cluster to be deleted C C S c o m p o n e n t s
  • 26.
    Click to edit TheCloud Specialists Technology Choices • Apache CloudStack • IaaS orchestration platform • Drives many of the world’s largest public clouds • Tightly defined scope • Kubernetes • Kubernetes is an open-source system for automating deployment, operations, and scaling of containerised applications • Open sourced by Google now at the CNCF under the Linux Foundation • Set to become defacto. In use at Google,GKE, HP Helion, Redhat Openshift, VMware Cloud, Windows Azure Te c h n o l o g y c h o i c e s
  • 27.
    Click to edit TheCloud Specialists Agnostic • Uses Docker engine by default but can choose rkt by CoreOS • Users can choose the container networking solution they want, the current default is flannel A g n o s t i c
  • 28.
    Click to edit TheCloud Specialists Agnostic • Currently implemented K8S, but framework can be used for other cluster based platforms in the future: Network Storage Compute A g n o s t i c
  • 29.
    C l ic k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue • Automate exposing services to public internet • Support resizing of clusters • Auto-scaling of clusters • Upgrade of Kubernetes version • Intelligent independent sizing of master node • Optional HA for master nodes. • Use of distributed etcd data store • Optional use of anti-affinity groups • Support for CloudStack volumes in Kubernetes for data persistency • Support for baremetal deployments. F e a t u r e r o a d m a p
  • 30.
    C l ic k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue • Licensed version at GA July 2016 • Currently supported in Apache Cloudstack >4.5 • and today……. Ti m e f r a m e s
  • 31.
    C l ic k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue SHAPEBLUE CONTRIBUTES NATIVE SUPPORT FOR KUBERNETES AND DOCKER TO APACHE CLOUDSTACK (we’ve opensourced it)
  • 32.
    The Cloud Specialists ShapeBlue.com@ShapeBlue Q u e s t i o n s ?
  • 33.
    The Cloud Specialists Buildinga Container Solution on Top of Apache Cloudstack Paul Angus, VP Technology • @CloudyAngus paul.angus@shapeblue.com A n i n t r o d u c t i o n t o Giles Sirett• @GilesSirett Giles.sirett@shapeblue.com giles@apache.org