OpenStack Workshop
Intro Session
Affan A. Syed, Adnan Iqbal, Zaafar Ahmed, Muhammad Zaheer
Registration opened this Monday
more than 90 registrations in 3 days!
2
Amazing response
Private (IT) Private (telco) Govt
Distribution within Industry
Industry Academia
Response Distribution
PTA and MoIT: Dr. Ismail, Wasi ullah Khan
Awal Telecom: Akbar Shaukat
PLUMgrid
3
Sponsors and Enablers
Workshop Outline
◦ A view of the Cloud, from the clouds
◦ What is OpenStack? Why care?
◦ OpenStack: a 10,000 feet view
Outline
Cloud(ed) thinking!
debunking the myth of “Cloud”
How the Cloud Business Model started
Excess capacity/Under utilized servers
Machine & Network virtualization
Monetization opportunity through renting
7
8
Excess capacity
https://googleblog.blogspot.com/2012/10/googles-data-centers-inside-look.html
Src: “above the clouds …”, UC Berkeley tech report
OnlineGraduatePrograms.com
9
Machine and network virtualization
8GB 10TB
10TB
10TB
8GB
8GB
4 GB | 2 TB
4 GB | 8 TB
4 GB | 4 TB
2 GB | 2 TB
6 GB | 6 TB
2 GB | 4 TB
2 GB | 4 TB
Physical Virtual
Bridge
Router
LB
BridgeBridge
DHCP
FW
Bridge
DHCP
FW
10
Money through rental model
Rent me
2
Machines
Rent me
2 more
machines
Allow services to “scale out” on demand
Cloud provider Cloud user
Infrastructure-as-a-Service
Platform-as-a-Service
Software-as-a-Service
(lots of other XaaS)
11
Types of a cloud
12
Managing and (re)provisioning a DCN is difficult
Credit: Google
Build compute powers without vendor lock-in
Provide and build services, at lower cost
Facebook has 20,000 server per admin
Scale out easily by adding servers
go to public clouds when needed (Cloud bursting)
13
Enterprises and Private clouds
Give Me
2 Machines, Dual Core,
8GB RAM, L2
connectivity, and an SQL
DB over a firewall
What happens when using a cloud!
physical
virtual Dual Core | RAM 8GB
Dual Core | RAM 8GB
15
Private Cloud Management Systems
Apache CloudStack™
OpenStack: Motivation
and history
16
… and why OpenStack matters!
OpenStack Future (from its past!)
In 2012 Boris Renski (CMO) Mirantis made three
arguments for money in OpenStack
Cloud is BIG $$$
Cloud will be open (Google, facebook,
Rackspace back OpenStack)
OpenStack won the OpenCloud war (2012)
Average # of developers in an IRC channel as of 6/
Mirantis raised $100 million as pure-
play OpenStack in Aug 2015
Monetary Motivations (Enterprise and Entrepreneurs)
20
Job opportunity
“OpenStack continues to gain mindshare among enterprise CIOs …….. We continue to
see OpenStack becoming the de facto open source option for deploying private
clouds. However, this will accelerate only after more OpenStack-trained developers
enter the workforce…..” [The 451Research Take (https://451research.com/openstack)]
OpenStack engineers make 36%
more than other cloud engineers.
Src: http://www.datacenterdynamics.com/
21
Telecom Sector and NFV
Access network
(metro Ethernet) Core DC (Private cloud)
Internet
Classifier
Video acc
VoIP
??
Service chains
22
ETSI and Network Function Virtualization (NFV)
Replace hardware network
appliances with software
Deployable over
commodity machines
Cost savings and no
vendor lock-in vCPE Classifier
Video acc
VoIP
??
Service chains
Each service/network function now a VM
23
NFV architecture
Data-center/cloud infra
CMS (e.g. OpenStack)
OpenStack: A Brief History
NASA Launches Nebula
One of the first cloud computing
platforms built for Federal
Government Private Cloud
March 2010: Rackspace Open Sources
Cloud Files software, aka Swift
May 2010: NASA open sources compute
software, aka “Nova”
June 2010: OpenStack is formed
July 2010: The inaugural Design Summit
April 2012: OpenStack Foundation
nebula.nasa.gov
Independent body to protect, empower and promote
OpenStack software
Board of Directors (Platinum, Gold sponsors)
25
OpenStack® Foundation
Project Technical Leads
(PTL)
Project Technical Leads
(PTL)
Technical
Committee
User
Committee
Legal Affairs
Committee
26
OpenStack Release Cycles
Every 6 months, alphabetical release names
http://www.dcvcs.com/openstack-releases/
27
Platinum, Gold and Corporate members
Fastest Growing Global Open Source Community
May 15, 2015
29
Competitors….. Not there!
Src: http://www.qyjohn.net/?p=3801
Cloud tou buss …… Openstack!
OpenStack
CloudStack
Src: Bitergia
OpenStack: Managing
your Cloud!
OpenStack
Projects to control pools of compute, storage, and networking resource
Managed through API & dashboard
Open architecture, code, community!
Plugins (vendor specific)
OpenStack infrastructure
abstraction --- connect any vendor
Open Architecture --- connect
any tools with Open API
Open source (Apache license) software
accelerated innovation, community benefits
Plug-in architecture
no vendor lock-in (hypervisors, storage soln, SDN soln)
On demand control of large pools of compute,
network, storage
Enable IT automation
Multi-tenancy support with quotas and isolation
ability to control, monitor and monetize resources
32
Features/Benefit (high level)
OpenStack Core Services – the Spider web!
docs.openstack.org
OpenStack Core Services – Relationship diagram (2012)
docs.openstack.org
35
OpenStack as Layers (2014)
Incrementaldeployment/complexity
Nova, Glance, Keystone,
and Neutron
36
Provides a REST interface to:
Spawn, bootstrap, delete VMs
Built using a messaging arch
Supports multiple hypervisor
technologies
Supports multi-tenancy
37
Nova: Managing Compute (VM)
Nova API
Nova
scheduler
Nova
conductor
Messaging bus
Nova
compute
hypervisor
VM VM
Nova
compute
hypervisor
VM VM
Nova
compute
hypervisor
VM VM
Controller Node
Compute Nodes
Magnum (containers) and Ironic (Bare Metal)
Interface to manage images
Storage provided by drivers
Database to manage images
DB abstraction to match any driver
38
Glance: Managing images
Storage
Service
(File/Swift)
Glance
API
Controller
Glance
Registry
Metadata
Repository
Image
Repository
Tracking users and their permissions
Providing a catalog of available services
(with URLs)
New services first register with
keystone
Provides tokens for usage of any
service, using the RBAC model
39
Keystone: Managing identity
Identity Service
(Keystone)
Compute
Service
(Nova 8774)
Image
Service
(Glance 9292)
Storage
Service
(Swift 8080)
Network
Service
(Neutron
9696)
Credentials
Token & SC
(with TTL)
API Requests
with Token
Other ID
Backend
Token
Validation
API to create virtual networks
Software defined!
Modular and multi-tenant arch
API=service, implementation=vendor
Plugins make it technology agnostic
IPAM, load balancer, VPN …
Services provided by Network node
40
Neutron: Managing networks
Neutron Server
Core APIs API Extensions
Plugins
Messaging bus
Neutron
agent
L3 agent
Neutron
agent
L2 agent
VM VM
Controller Node
Compute Nodes
Neutron
agent
L2 agent
VM VM
Network Node
(optional)
Internet
Storage: Cinder and Swift
41
42
Cinder: Managing block storage
Persistent block storage for VM instances
lives through reboots and crashes
Can be used to create bootable volumes
No need for ephemeral storage!
Multiple volumes (disks) for a single VM
Can backup volumes, (perhaps) in swift!
A frontend to create and manage virtual disks and their VM association
Storage
Service
(File/Swift)
Glance
API
Controller
Glance
Registry
Metadata
Repository
Image
Repository
Object = files, persistent and HA
Flat name-space
Unstructured blobs, replicated in a ring
across different zones
Default to three replicas
Objects accessible with a URL
swift.example.com/v1/account/container/object
Massively scalable, but with eventually
consistent behavior
43
Swift: Managing object storage
https://julien.danjou.info/blog/2012/openstack-swift-consistency-analysis
Cloud Management and
Advanced Services
44
Telemetry: Ceilometer
Orchestration: Heat
Orchestration and setup
Test Suites: Rally/Tempest
Services to manage your IaaS
Database: Trove
Message Queue: Zaqar
Container Orchestration: Magnum
Container linking: Kuryr
47
Advanced Services
Workflow of Instance
creation
Evolved Core view (2015)
Understanding this requires lots of time and training
DevStack: the reference
installer
56
Questions?
https://twitter.com/openstack_isb
http://www.pta.gov.pk/openstackweb/index.html
https://www.facebook.com/OpenStackPakistan/

Openstack Pakistan Workshop (intro)

  • 1.
    OpenStack Workshop Intro Session AffanA. Syed, Adnan Iqbal, Zaafar Ahmed, Muhammad Zaheer
  • 2.
    Registration opened thisMonday more than 90 registrations in 3 days! 2 Amazing response Private (IT) Private (telco) Govt Distribution within Industry Industry Academia Response Distribution
  • 3.
    PTA and MoIT:Dr. Ismail, Wasi ullah Khan Awal Telecom: Akbar Shaukat PLUMgrid 3 Sponsors and Enablers
  • 4.
  • 5.
    ◦ A viewof the Cloud, from the clouds ◦ What is OpenStack? Why care? ◦ OpenStack: a 10,000 feet view Outline
  • 6.
  • 7.
    How the CloudBusiness Model started Excess capacity/Under utilized servers Machine & Network virtualization Monetization opportunity through renting 7
  • 8.
  • 9.
    9 Machine and networkvirtualization 8GB 10TB 10TB 10TB 8GB 8GB 4 GB | 2 TB 4 GB | 8 TB 4 GB | 4 TB 2 GB | 2 TB 6 GB | 6 TB 2 GB | 4 TB 2 GB | 4 TB Physical Virtual Bridge Router LB BridgeBridge DHCP FW Bridge DHCP FW
  • 10.
    10 Money through rentalmodel Rent me 2 Machines Rent me 2 more machines Allow services to “scale out” on demand Cloud provider Cloud user
  • 11.
  • 12.
    12 Managing and (re)provisioninga DCN is difficult Credit: Google
  • 13.
    Build compute powerswithout vendor lock-in Provide and build services, at lower cost Facebook has 20,000 server per admin Scale out easily by adding servers go to public clouds when needed (Cloud bursting) 13 Enterprises and Private clouds
  • 14.
    Give Me 2 Machines,Dual Core, 8GB RAM, L2 connectivity, and an SQL DB over a firewall What happens when using a cloud! physical virtual Dual Core | RAM 8GB Dual Core | RAM 8GB
  • 15.
    15 Private Cloud ManagementSystems Apache CloudStack™
  • 16.
    OpenStack: Motivation and history 16 …and why OpenStack matters!
  • 17.
    OpenStack Future (fromits past!) In 2012 Boris Renski (CMO) Mirantis made three arguments for money in OpenStack Cloud is BIG $$$ Cloud will be open (Google, facebook, Rackspace back OpenStack) OpenStack won the OpenCloud war (2012) Average # of developers in an IRC channel as of 6/ Mirantis raised $100 million as pure- play OpenStack in Aug 2015
  • 18.
  • 19.
    20 Job opportunity “OpenStack continuesto gain mindshare among enterprise CIOs …….. We continue to see OpenStack becoming the de facto open source option for deploying private clouds. However, this will accelerate only after more OpenStack-trained developers enter the workforce…..” [The 451Research Take (https://451research.com/openstack)] OpenStack engineers make 36% more than other cloud engineers. Src: http://www.datacenterdynamics.com/
  • 20.
    21 Telecom Sector andNFV Access network (metro Ethernet) Core DC (Private cloud) Internet Classifier Video acc VoIP ?? Service chains
  • 21.
    22 ETSI and NetworkFunction Virtualization (NFV) Replace hardware network appliances with software Deployable over commodity machines Cost savings and no vendor lock-in vCPE Classifier Video acc VoIP ?? Service chains Each service/network function now a VM
  • 22.
  • 23.
    OpenStack: A BriefHistory NASA Launches Nebula One of the first cloud computing platforms built for Federal Government Private Cloud March 2010: Rackspace Open Sources Cloud Files software, aka Swift May 2010: NASA open sources compute software, aka “Nova” June 2010: OpenStack is formed July 2010: The inaugural Design Summit April 2012: OpenStack Foundation nebula.nasa.gov
  • 24.
    Independent body toprotect, empower and promote OpenStack software Board of Directors (Platinum, Gold sponsors) 25 OpenStack® Foundation Project Technical Leads (PTL) Project Technical Leads (PTL) Technical Committee User Committee Legal Affairs Committee
  • 25.
    26 OpenStack Release Cycles Every6 months, alphabetical release names http://www.dcvcs.com/openstack-releases/
  • 26.
    27 Platinum, Gold andCorporate members
  • 27.
    Fastest Growing GlobalOpen Source Community May 15, 2015
  • 28.
    29 Competitors….. Not there! Src:http://www.qyjohn.net/?p=3801 Cloud tou buss …… Openstack! OpenStack CloudStack Src: Bitergia
  • 29.
  • 30.
    OpenStack Projects to controlpools of compute, storage, and networking resource Managed through API & dashboard Open architecture, code, community! Plugins (vendor specific) OpenStack infrastructure abstraction --- connect any vendor Open Architecture --- connect any tools with Open API
  • 31.
    Open source (Apachelicense) software accelerated innovation, community benefits Plug-in architecture no vendor lock-in (hypervisors, storage soln, SDN soln) On demand control of large pools of compute, network, storage Enable IT automation Multi-tenancy support with quotas and isolation ability to control, monitor and monetize resources 32 Features/Benefit (high level)
  • 32.
    OpenStack Core Services– the Spider web! docs.openstack.org
  • 33.
    OpenStack Core Services– Relationship diagram (2012) docs.openstack.org
  • 34.
    35 OpenStack as Layers(2014) Incrementaldeployment/complexity
  • 35.
  • 36.
    Provides a RESTinterface to: Spawn, bootstrap, delete VMs Built using a messaging arch Supports multiple hypervisor technologies Supports multi-tenancy 37 Nova: Managing Compute (VM) Nova API Nova scheduler Nova conductor Messaging bus Nova compute hypervisor VM VM Nova compute hypervisor VM VM Nova compute hypervisor VM VM Controller Node Compute Nodes Magnum (containers) and Ironic (Bare Metal)
  • 37.
    Interface to manageimages Storage provided by drivers Database to manage images DB abstraction to match any driver 38 Glance: Managing images Storage Service (File/Swift) Glance API Controller Glance Registry Metadata Repository Image Repository
  • 38.
    Tracking users andtheir permissions Providing a catalog of available services (with URLs) New services first register with keystone Provides tokens for usage of any service, using the RBAC model 39 Keystone: Managing identity Identity Service (Keystone) Compute Service (Nova 8774) Image Service (Glance 9292) Storage Service (Swift 8080) Network Service (Neutron 9696) Credentials Token & SC (with TTL) API Requests with Token Other ID Backend Token Validation
  • 39.
    API to createvirtual networks Software defined! Modular and multi-tenant arch API=service, implementation=vendor Plugins make it technology agnostic IPAM, load balancer, VPN … Services provided by Network node 40 Neutron: Managing networks Neutron Server Core APIs API Extensions Plugins Messaging bus Neutron agent L3 agent Neutron agent L2 agent VM VM Controller Node Compute Nodes Neutron agent L2 agent VM VM Network Node (optional) Internet
  • 40.
  • 41.
    42 Cinder: Managing blockstorage Persistent block storage for VM instances lives through reboots and crashes Can be used to create bootable volumes No need for ephemeral storage! Multiple volumes (disks) for a single VM Can backup volumes, (perhaps) in swift! A frontend to create and manage virtual disks and their VM association Storage Service (File/Swift) Glance API Controller Glance Registry Metadata Repository Image Repository
  • 42.
    Object = files,persistent and HA Flat name-space Unstructured blobs, replicated in a ring across different zones Default to three replicas Objects accessible with a URL swift.example.com/v1/account/container/object Massively scalable, but with eventually consistent behavior 43 Swift: Managing object storage https://julien.danjou.info/blog/2012/openstack-swift-consistency-analysis
  • 43.
  • 44.
    Telemetry: Ceilometer Orchestration: Heat Orchestrationand setup Test Suites: Rally/Tempest Services to manage your IaaS
  • 45.
    Database: Trove Message Queue:Zaqar Container Orchestration: Magnum Container linking: Kuryr 47 Advanced Services
  • 46.
  • 48.
    Evolved Core view(2015) Understanding this requires lots of time and training
  • 49.
  • 50.