ShapeBlue is a company that specializes in building public and private clouds using CloudStack. The document discusses several new features in CloudStack version 4.13 and 4.14 including constrained custom offerings, unmetered networks, OVA appliance support, zone-specific disk and compute offerings, hereditary tags on recurring snapshots, improved UI branding, and shared template support in the UI. It also outlines ShapeBlue's customers and provides an overview of backup and recovery functionality planned for CloudStack.
2. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
A b o u t m e
Cloud Architect @ ShapeBlue
From Belgrade, Serbia
Apache CloudStack Project Committer and PMC member
Involved with CloudStack since 4.0.0-incubating
Interested in:
Cloud infrastructure architecture and engineering.
Virtualization, Storage and SDxx
Downtime:
Father to 2 princesses
Music, gym and hobby electronic
3. The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
“ShapeBlue are expert builders of public
& private clouds. They are the leading
independent global CloudStack services
company”
A b o u t S h a p e B l u e
4. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
S h a p e B l u e c u s t o m e r s
5. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
S h a p e B l u e c u s t o m e r s
6. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
S h a p e B l u e c u s t o m e r s
9. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
• Ability to have constrained/bounded custom offerings
• Ability to have networks which aren’t charged for
• OVA Appliance support (extra data)
• Ability to Create a Storage compute, network, VPC Offering for specified
domain(s) and zone(s)
• Ability to set tags when creating a resource like a snap or a snap policy
• VMware 6.7 support
• Better support for UI branding
• DPDK Live migration & Offerings
• Multidisk OVA upload from local support
• ISO upload from local support
10. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
Or simply go to:
http://docs.cloudstack.apache.org/en/4.13.0.0/releasenotes/changes.html
11. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
Constrained custom offerings
12. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
Unmetered/system networks
• Useful for service networks such as
monitoring or backup networks which
you wouldn’t charge end users for.
13. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
OVA Appliance support (extraconfig)
14. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
OVA Appliance support (extraconfig)
• Cisco® ASAv
• Juniper® vSRX
• Cisco® vWAAS (wide-area-application-services)
• Riverbed® SteelHead CX
15. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
Zone or Domain specific disk,
compute, network & VPC Offerings
• i.e. roll out new storage hardware zone by
zone. Disk and compute offerings can be
created to leverage this hardware and
scoped to zones.
16. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
Hereditary tags on Recurring
Snapshots
• Allows tags to be set which will be applied
to future snapshots
17. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
18. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
19. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
• More flexible UI branding (simpler white labelling)
• Many UI tweaks and updates
• Shared template support in UI
• Allow live migration of DPDK enabled instances
• (some bugs!)
20. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
Shared template support in UI
• Hidden away in the API, now exposed
in the UI.
Option (global setting) to enumerate
accounts/projects for users to select
from.
22. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
• Backup and Recovery*
• KVM Rolling Maintenance
• KVM DRS
• VR Health-checks
• System VM Management API
• VM Ingestion
• Direct Download for systemVM template (KVM)
• Primary Storage Agnostic Direct Downloads (KVM)
• CloudStack Kubernetes Service and CloudStack
Kubernetes Provider
23. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
24. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
KVM Rolling Maintenance
• Select a zone, pod or cluster
• Supply upgrade/patching scripts to KVM hosts
• Instruct CloudStack to run scripts on the hosts one by one in a
cluster, evacuating a host and putting it into maintenance
mode where necessary
25. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
KVM DRS
(an enterprise feature, without the enterprise price tag ☺)
• Iterative migration of guest instances to either:
• Balance host
• Pack hosts (defragment anyone?)
• DRS process simplified by
• Calculating the most effect guest instance to move*
• Live migrating it
• Checking to see if DRS threshold has be satisfied
• If not, calculate the most effect guest instance to move now
26. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
VR Health-Checks
• Router periodically running self checks
• Management servers periodically polling to ensure checks
have run and receive results
• Configurable thresholds set to avoid false positives
• Alerts raised when checks fail
• Automatic VR restarts when specified checks fail (optional)
27. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
VR Health-Checks
• Basic connectivity from management server to virtual router
• Basic connectivity to virtual router interfaces' gateways
• Free disk space on virtual router's disk
• CPU and memory usage
• Basic VR Sanity checks:
• dnsmasq/strongswan/haproxy/etc service running
• DHCP/DNS config sanity check
• Advanced VR Sanity checks:
• DHCP/DNS configuration matches mgmt server DB
• IPtables rules match mgmt server DB records
• HAproxy config matches mgmt server DB records
• VM network sanity checks
28. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
System VM Management API
• Enables granular management over systemVM templates
• Register many, change the “active” one at any time
• Define systemVM template during zone deployment
• no more pre-seeding of the template required
• Decouple ACS upgrades from systemVM upgrade
• Allow for easy setup of new/customized systemVM template
• Security patches, port opening, other customizations
29. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
System VM Management API
30. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
System VM Management API
31. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
System VM Management API
32. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
VM ingestion
• Take existing VMs from vSphere and “import” them into CloudStack
Prerequisites
• vSphere datacentre linked to a CloudStack zone
• The clusters, hosts and related “Primary Storage” already added to
CloudStack
• Networks* (with the same VLAN ID) pre-created in CloudStack
33. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
VM ingestion
• listUnmanagedInstances API
• importUnmanagedInstance API
• discover_networks.py helper script
• Automatic vSphere to ACS network mapping based on VLAN ID
• Automatic IP assigning with VMware tools in place*
• Not handling IPv6
• Automatic volumes migration if compute/storage tags don’t match to the
selected Offering*
34. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
VM ingestion - DEMO
35. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
• CloudStack Kubernetes Service (CKS = matured CCS)
• A plugin to create and manage Kubernetes cluster
• CoreOS templates for nodes, kubeadm for cluster
provisioning
• Offline installation of k8s and docker binaries on cluster
nodes for selected k8s version via ISO (uploaded by admin)
• Gracefully scale up or scale down
• Access kube.config for cluster for accessing k8s dashboard
• Delete cluster while removing nodes and k8s service
CKS + CKP =
36. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
• Backup and Recovery
• almost there..
• for real this time…
• Seriously!
37. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
Vo l u m e s n a p s h o t s
• Not consistent across volumes
• A VM with separate disks for say; OS, logs and
data, will have each disk processed at different
times
• Only crash consistent within a volume
and they aren’t application aware
• A database will not be quiesced before snapshot is
taken
• Transaction logs won’t be processed
• VMware tools or XenTools may help with some
basics
38. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
Vo l u m e s n a p s h o t s
• They can be very slow.
• Data has to be transferred from primary storage to
secondary storage
• In the case of vSphere, this data must go via the
SSVM to be compressed into a OVA while being
moved to secondary storage.
• CloudStack locks out other actions while a
snapshot is taking place. Workarounds have their
own issues.
39. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
Vo l u m e s n a p s h o t s
• Restoration of a VM requires a number of steps
(and did I mention it’s slow)
• User must make a template from snapshot
(VM image copied via SSVM from one part of secondary
storage to another – 2x network transfers)
• User then creates VM from template
(VM image copied from secondary to primary to create
template on primary storage, then primary storage based
template copied to make actual VM. 2x network assuming
network based primary storage and 1x on-disk copy)
• To restore a VM ‘exactly as it was’ requires considerable
operator intervention
40. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
Specifically:
• Support for:
• Operator created ‘policy based’ backups (RPOs)
• Scheduled backups (similar to snapshot scheduling)
• Ad hoc backups
• Backups as first class citizens
• ‘In-place’ restoration of entire VM including data disks
• Restoration of VM backup after original VM is destroyed
• Restoration of individual VM volumes (can then be attached to another VM)
• Full integration into the CloudStack usage service, recording both protected and
on-disk data metrics
B a c k u p a n d R e c o v e r y
41. C l i c k t o e d i t
The Cloud Specialists
@ShapeBlueShapeBlue.comThe Cloud Specialists
B a c k u p a n d R e c o v e r y
‘Policy Based’ Backups
• listBackupPolices external=true
Returns ‘template’ jobs.
• importBackupPolicy Creates a policy (with
a name and description) in CloudStack
and maps it to a Veeam template job.
ie.
GOLD – 6hr RPO
SILVER – 24hr RPO
BRONZE – 7 day RPO
42. C l i c k t o e d i t
The Cloud Specialists
@ShapeBlueShapeBlue.comThe Cloud Specialists
B a c k u p a n d R e c o v e r y
‘Ad-hoc’ & Scheduled Backups
• CloudStack will send command to carry
out an ad-hoc run of the policy based job
or create one as required.
• Ad-hoc and scheduled jobs will be driven
by CloudStack
• One VM to one Veeam job mapping allows
for simpler accounting and unified
incremental backups
43. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists