Agenda
● Challenges of IT efficiency
● Ubuntu OpenStack
● Ubuntu 14.04 new features
Thought for the day:
Facebook took 10 years and several $100M to scale
to 1B users.
The next 2 web apps to scale to 1B users will do so in
under 3 years on seed funding with <100 employees
What do you think smart infrastructure looks like?
You Google
Efficiency?
PUE & DCiE: Efficiency of power
delivery
Silicon
efficiency:
Reduction of power bill
Space
efficiency:
Reduction of space bill
Efficiency
Automated scale out is the key to helping you be
more like Google
OpenStack: The kernel of “Linux at scale”
Applications
Memory
Disk
CPUs
Kernel
OpenStack: The kernel of “Linux at scale”
hundreds, or thousands, of servers
Applications
Memory
Disk
CPUs
OpenStack
Bare metal provisioning
Options:
● MAAS
● Ironic
● Razor
● Custom hacks with a lot of scripting
Challenge #1
Lets use MAAS to provision systems and build
an OpenStack cloud
Demo…...
1 2 3
Rapid provisioning at cloud scale
3-step provisioning process
Install MAAS
on first server
Discover
Nodes
Power on
Nodes
Automatically discover nodes
Enlist nodes via PXE boot
or manually enter MAC addresses
Hypervisor or OS
provisioned automatically
1
2
3
Hardware provisioning workflow
Enlistment
Commissionin
g
Provisioning
DHCP boot in an ephemeral environment
Register with cluster controller
Adds temporary IPMI MAAS credentials to BMC
Boot in a ephemeral environment
Hardware inventoried
Permanent IPMI MAAS credentials set in BMC
Other user-commissioning actions
(firmware configuration, smoke tests, etc.)
Happens when a node is requested
Installs requested Ubuntu version
MAAS Architecture is Highly Scalable
CLUSTER
CONTROLLER
TFTP
(PXE)
DHCP
CLUSTER
NODES
CLUSTER
CONTROLLER
TFTP
(PXE)
DHCP
CLUSTER
NODES
REGION
CONTROLLER
Highly available
WEB UI API
Cross data centres
provisioning and visibility
Controllers deployment
in HA mode
Supports cluster grouping constructs to
provide visibility into large pools of hardware
API and UI interfaces
Landscape Integration to deliver role-based
access controls, higher level view
Large Asian company building public cloud
1000+ nodes split across 3 availability zones
Ubuntu 12.04.1, Ubuntu 12.04.4
MAAS via IPMI and Intel AMT
Challenges with AMT using shared network interface
Extensive testing of backup/recovery of MAAS across availability zones
Ironic
Started May 2013
Development of nova barmetal driver
100% focused on baremetal provisioning for OpenStack
Uses Ironic API to talk to Nova
Ironic Conductor talks with Neutron, glance, cinder etc..
Ironic conductor talks to physical infrastructure
Supports 3 driver models today - PXE, IPMI, SSH
Lacking auto discovery atm.
Used by HP but little outside of that for time being.
Razor
Produced by Puppet labs and EMC
Auto discovery supported
tight integration with Puppet
image based deployment
Good docs on using with OpenStack
Most OpenStack clouds use Ubuntu
Source:
Official OpenStack Survey 2013
Infrastructure Plug-ins
OpenStack Abstraction Layer
Compute Networking Storage
OpenStack APIDashboard
(UI)
OpenStack
Common Services
Keystone
+
Glance
VM VM VM VM VM VM VM
VMVMVMVMVMVMVM
Integration with existing clouds
OpenStack Deployment vSphere Deployment
OpenStack
Nova
Official support for
ESXi connector
jointly delivered
with VMware
Nova Controller
for ESXi
View both OpenStack and vSphere
hosted guests on single pane of
glass using Landscape
OpenStack Interoperability Lab tested
Understanding interoperability and performance
Ubuntu OpenStack
Cloud Installer
Continuous
Integration
Ubuntu OpenStack
Cloud Archive
Interoperability
testing
Multiple Data Center Management
New York
Data Center
London
Data Center
Multiple datacenter coverage
Import workloads to OpenStack
Scale out
High Availability
Compliance & governance
Single Pane of Glass coverage
Web UI compatible with mobile
OpenStack-aware Management
Role based Access Controls
API Automation & 3rd-party integration
Ubuntu & Openstack Support in 14.04
12.04 12.10 13.04 13.10 14.04 14.10 15.04 15.10 16.04 16.10 17.04
Long Term
release support
Matching OpenStack
release support
Ubuntu 12.04 LTS
Ubuntu 14.04 LTS
Ubuntu 16.04 LTS
ESSEX
FOLSOM
GRIZZLY
HAVANA
ICEHOUSE
ICEHOUSE
M
...
5 yrs
5 yrs
18 mo
18 mo
18 mo
36 mo
5 yrs
5 yrs
18 mo
36 mo
5 yrs
5 yrs
...
18 moJ
K
L
M
18 mo
J 18 moOpenStack IceHouse on 14.04
Industry first 5 year supported
version of OpenStack
Icehouse will be supported in
12.04 as well
Supporting OpenStack
35% of our support workload relates to cloud
Currently 100s of tickets per month
Since Jan 1st - March 19
● 92 Bugs closed
● 99 New bugs opened
Note: Over 25% of support is hardcore server
Case Study - Large European Carrier
Building large self service app store for mid size
businesses
Using Ceph for Block and object storage
Using MAAS for hardware provisioning, Chef for config
Considering Juju but super strict security requirements
are challenging
Deploying services
Options:
● Juju
● Heat
● Cloudify
● more and more coming each day
Challenge #2
The best solution to orchestrate your services
Juju
Ease of provisioning
Pluggable provisioning backend, from
local machines to large clouds
Event-based
React to changes in environment,
self configuring
Scalable
Templates designed to scale
by adding more units
Language independance
Hooks can be written in any language
Bundle charms and instantly deploy these solutions
Charms package services
Service definition Instant deployment
Encapsulate application
configurations
Define service
scalability hooks
Define service
deployment
1
2
3
Deploy services
$ juju deploy wordpress
$ juju deploy mysql
Create relationships
$ juju add-relation wordpress mysql
Expose app to the outside world
$ juju expose wordpress
Scale the application
$ juju add-unit -n 5 wordpress
Hundreds of charms are available today
A growing Charm ecosystem
Charms are rated and reviewed
for quality assurance
Drag and drop Charms
to create services
Support for private and
mixed mode Charm store
Publicly available Charm Store
...
Juju GUI Store
Configure and manage your services
Configure your application
and deploy it on the platform of your choice
Baremetal
Linux
Containers
VMs on Private
or Public Clouds
VM
VM
LXC
LXC
Juju Architecture
Juju Client
(HTML5, UI, CLI)
Juju State Server (in HA mode)
Deployment Environment
Provisioning
Server
API Server
Provisioning
Server
API Server
Mongo Mongo
Compute Instance Compute
LXCWorkloadJuju Agent LXC
KVM
Juju Agent
Workload
Heat
Fast growing OpenStack only orchestration
Now part of OpenStack core
Uses AWS Cloudforms templates
Still some way to go from a stability POV
Cloudify
Cloud independent orchestration
● AWS, Azure, HP Cloud, Rackspace
Majors on monitoring
Now starting to push hard down the
OpenStack path
Ubuntu 14.04:
April 17th 2015
Ubuntu 14.04 new features
● 3.13 Kernel:
○ Intel Broadwell support (14nm)
○ Multi-queue block later for improved SSD
performance
○ NFTables (replacement to IPTables)
○ Linux power capping framework
Ubuntu 14.04 new features
● qemu 2.0
● libvirt 1.2
● MySQL 5.5
● PHP 5.5
● XFS support
● Ceph Firefly support
● Docker support in main
Mark Baker
Mark.baker@canonical.com

&lt;iframe src="http://video.yandex.ru/iframe/ya-events/0ro6nfi3fv.5216/" height="225" width="450">&lt;/iframe>

  • 2.
    Agenda ● Challenges ofIT efficiency ● Ubuntu OpenStack ● Ubuntu 14.04 new features
  • 3.
    Thought for theday: Facebook took 10 years and several $100M to scale to 1B users. The next 2 web apps to scale to 1B users will do so in under 3 years on seed funding with <100 employees What do you think smart infrastructure looks like?
  • 4.
  • 5.
    Efficiency? PUE & DCiE:Efficiency of power delivery Silicon efficiency: Reduction of power bill Space efficiency: Reduction of space bill
  • 6.
  • 7.
    Automated scale outis the key to helping you be more like Google
  • 8.
    OpenStack: The kernelof “Linux at scale” Applications Memory Disk CPUs Kernel
  • 9.
    OpenStack: The kernelof “Linux at scale” hundreds, or thousands, of servers Applications Memory Disk CPUs OpenStack
  • 10.
    Bare metal provisioning Options: ●MAAS ● Ironic ● Razor ● Custom hacks with a lot of scripting Challenge #1
  • 11.
    Lets use MAASto provision systems and build an OpenStack cloud Demo…...
  • 12.
    1 2 3 Rapidprovisioning at cloud scale 3-step provisioning process Install MAAS on first server Discover Nodes Power on Nodes Automatically discover nodes Enlist nodes via PXE boot or manually enter MAC addresses Hypervisor or OS provisioned automatically
  • 13.
    1 2 3 Hardware provisioning workflow Enlistment Commissionin g Provisioning DHCPboot in an ephemeral environment Register with cluster controller Adds temporary IPMI MAAS credentials to BMC Boot in a ephemeral environment Hardware inventoried Permanent IPMI MAAS credentials set in BMC Other user-commissioning actions (firmware configuration, smoke tests, etc.) Happens when a node is requested Installs requested Ubuntu version
  • 14.
    MAAS Architecture isHighly Scalable CLUSTER CONTROLLER TFTP (PXE) DHCP CLUSTER NODES CLUSTER CONTROLLER TFTP (PXE) DHCP CLUSTER NODES REGION CONTROLLER Highly available WEB UI API Cross data centres provisioning and visibility Controllers deployment in HA mode Supports cluster grouping constructs to provide visibility into large pools of hardware API and UI interfaces Landscape Integration to deliver role-based access controls, higher level view
  • 15.
    Large Asian companybuilding public cloud 1000+ nodes split across 3 availability zones Ubuntu 12.04.1, Ubuntu 12.04.4 MAAS via IPMI and Intel AMT Challenges with AMT using shared network interface Extensive testing of backup/recovery of MAAS across availability zones
  • 16.
    Ironic Started May 2013 Developmentof nova barmetal driver 100% focused on baremetal provisioning for OpenStack Uses Ironic API to talk to Nova Ironic Conductor talks with Neutron, glance, cinder etc.. Ironic conductor talks to physical infrastructure Supports 3 driver models today - PXE, IPMI, SSH Lacking auto discovery atm. Used by HP but little outside of that for time being.
  • 17.
    Razor Produced by Puppetlabs and EMC Auto discovery supported tight integration with Puppet image based deployment Good docs on using with OpenStack
  • 18.
    Most OpenStack cloudsuse Ubuntu Source: Official OpenStack Survey 2013
  • 19.
    Infrastructure Plug-ins OpenStack AbstractionLayer Compute Networking Storage OpenStack APIDashboard (UI) OpenStack Common Services Keystone + Glance VM VM VM VM VM VM VM VMVMVMVMVMVMVM
  • 20.
    Integration with existingclouds OpenStack Deployment vSphere Deployment OpenStack Nova Official support for ESXi connector jointly delivered with VMware Nova Controller for ESXi View both OpenStack and vSphere hosted guests on single pane of glass using Landscape
  • 21.
    OpenStack Interoperability Labtested Understanding interoperability and performance Ubuntu OpenStack Cloud Installer Continuous Integration Ubuntu OpenStack Cloud Archive Interoperability testing
  • 22.
    Multiple Data CenterManagement New York Data Center London Data Center Multiple datacenter coverage Import workloads to OpenStack Scale out High Availability Compliance & governance Single Pane of Glass coverage Web UI compatible with mobile OpenStack-aware Management Role based Access Controls API Automation & 3rd-party integration
  • 23.
    Ubuntu & OpenstackSupport in 14.04 12.04 12.10 13.04 13.10 14.04 14.10 15.04 15.10 16.04 16.10 17.04 Long Term release support Matching OpenStack release support Ubuntu 12.04 LTS Ubuntu 14.04 LTS Ubuntu 16.04 LTS ESSEX FOLSOM GRIZZLY HAVANA ICEHOUSE ICEHOUSE M ... 5 yrs 5 yrs 18 mo 18 mo 18 mo 36 mo 5 yrs 5 yrs 18 mo 36 mo 5 yrs 5 yrs ... 18 moJ K L M 18 mo J 18 moOpenStack IceHouse on 14.04 Industry first 5 year supported version of OpenStack Icehouse will be supported in 12.04 as well
  • 24.
    Supporting OpenStack 35% ofour support workload relates to cloud Currently 100s of tickets per month Since Jan 1st - March 19 ● 92 Bugs closed ● 99 New bugs opened Note: Over 25% of support is hardcore server
  • 25.
    Case Study -Large European Carrier Building large self service app store for mid size businesses Using Ceph for Block and object storage Using MAAS for hardware provisioning, Chef for config Considering Juju but super strict security requirements are challenging
  • 26.
    Deploying services Options: ● Juju ●Heat ● Cloudify ● more and more coming each day Challenge #2
  • 27.
    The best solutionto orchestrate your services Juju Ease of provisioning Pluggable provisioning backend, from local machines to large clouds Event-based React to changes in environment, self configuring Scalable Templates designed to scale by adding more units Language independance Hooks can be written in any language
  • 28.
    Bundle charms andinstantly deploy these solutions Charms package services Service definition Instant deployment Encapsulate application configurations Define service scalability hooks Define service deployment 1 2 3 Deploy services $ juju deploy wordpress $ juju deploy mysql Create relationships $ juju add-relation wordpress mysql Expose app to the outside world $ juju expose wordpress Scale the application $ juju add-unit -n 5 wordpress
  • 29.
    Hundreds of charmsare available today A growing Charm ecosystem Charms are rated and reviewed for quality assurance Drag and drop Charms to create services Support for private and mixed mode Charm store Publicly available Charm Store ...
  • 30.
    Juju GUI Store Configureand manage your services
  • 31.
    Configure your application anddeploy it on the platform of your choice Baremetal Linux Containers VMs on Private or Public Clouds VM VM LXC LXC
  • 32.
    Juju Architecture Juju Client (HTML5,UI, CLI) Juju State Server (in HA mode) Deployment Environment Provisioning Server API Server Provisioning Server API Server Mongo Mongo Compute Instance Compute LXCWorkloadJuju Agent LXC KVM Juju Agent Workload
  • 33.
    Heat Fast growing OpenStackonly orchestration Now part of OpenStack core Uses AWS Cloudforms templates Still some way to go from a stability POV
  • 34.
    Cloudify Cloud independent orchestration ●AWS, Azure, HP Cloud, Rackspace Majors on monitoring Now starting to push hard down the OpenStack path
  • 35.
  • 36.
    Ubuntu 14.04 newfeatures ● 3.13 Kernel: ○ Intel Broadwell support (14nm) ○ Multi-queue block later for improved SSD performance ○ NFTables (replacement to IPTables) ○ Linux power capping framework
  • 37.
    Ubuntu 14.04 newfeatures ● qemu 2.0 ● libvirt 1.2 ● MySQL 5.5 ● PHP 5.5 ● XFS support ● Ceph Firefly support ● Docker support in main
  • 38.