OpenStack Awareness Session
Affan A. Syed
Director Engineering,
PLUMgrid Inc.
Pakistan Telecommunication Authority, Oct 20th, 2015
PLUMgrid’s Mission
Deliver comprehensive virtual networking solutions
that scale, secure, and simplify the modern cloud
data center
Any
Network
Any
Hardware
Any
Hypervisor
Any
Container
Any
Service
Pervasive Scale and Security
PLUMgrid Global Alliance Partners
Technical AllianceOpenStack Distro Channel Partners
Talk outline
◦ A view of the Cloud, from the clouds
◦ What is OpenStack? Why care?
◦ OpenStack: a 10,000 feet view
◦ Workshops and their content
<Break>
◦ Demo session by Dr. Adnan Iqbal (Namal University)
Outline
Cloud(ed) thinking!
debunking the myth of “Cloud”
How the Cloud Business Model started
Excess capacity/Under utilized servers
Machine & Network virtualization
Monetization opportunity through renting
7
8
Excess capacity
https://googleblog.blogspot.com/2012/10/googles-data-centers-inside-look.html
Src: “above the clouds …”, UC Berkeley tech report
OnlineGraduatePrograms.com
9
Machine and network virtualization
8GB 10TB
10TB
10TB
8GB
8GB
4 GB | 2 TB
4 GB | 8 TB
4 GB | 4 TB
2 GB | 2 TB
6 GB | 6 TB
2 GB | 4 TB
2 GB | 4 TB
Physical Virtual
Bridge
Router
LB
BridgeBridge
DHCP
FW
Bridge
DHCP
FW
10
Money through rental model
Rent me
2
Machines
Rent me
2 more
machines
Allow services to “scale out” on demand
Cloud provider Cloud user
Infrastructure-as-a-Service
Platform-as-a-Service
Software-as-a-Service
(lots of other XaaS)
11
Types of a cloud
Build compute powers without vendor lock-in
Provide and build services, at lower cost
Facebook has 20,000 server per admin
Scale out easily by adding servers
go to public clouds when needed (Cloud bursting)
12
Enterprises and Private clouds
Give Me
2 Machines, Dual Core,
8GB RAM, L2
connectivity, and an SQL
DB over a firewall
What happens when using a cloud!
physical
virtual Dual Core | RAM 8GB
Dual Core | RAM 8GB
14
Managing and (re)provisioning a DCN is difficult
Credit: Google
OpenStack: Motivation
and history
15
… and why OpenStack matters!
OpenStack Future (from its past!)
In 2012 Boris Renski (CMO) Mirantis made three
arguments for money in OpenStack
Cloud is BIG $$$
Cloud will be open (Google, facebook,
Rackspace back OpenStack)
OpenStack won the OpenCloud war (2012)
Average # of developers in an IRC channel as of 6/
Mirantis raised $100 million as pure-
play OpenStack in Aug 2015
Monetary Motivations
19
Job opportunity
“OpenStack continues to gain mindshare among enterprise CIOs …….. We continue to
see OpenStack becoming the de facto open source option for deploying private
clouds. However, this will accelerate only after more OpenStack-trained developers
enter the workforce…..” [The 451Research Take (https://451research.com/openstack)]
OpenStack engineers make 36%
more than other cloud engineers.
Src: http://www.datacenterdynamics.com/
OpenStack: A Brief History
NASA Launches Nebula
One of the first cloud computing
platforms built for Federal
Government Private Cloud
March 2010: Rackspace Open Sources
Cloud Files software, aka Swift
May 2010: NASA open sources compute
software, aka “Nova”
June 2010: OpenStack is formed
July 2010: The inaugural Design Summit
April 2012: OpenStack Foundation
nebula.nasa.gov
Independent body to protect, empower and promote
OpenStack software
Board of Directors (Platinum, Gold sponsors)
21
OpenStack® Foundation
Project Technical Leads
(PTL)
Project Technical Leads
(PTL)
Technical
Committee
User
Committee
Legal Affairs
Committee
22
Platinum, Gold and Corporate members
Fastest Growing Global Open Source Community
May 15, 2015
24
Competitors….. Not there!
Src: http://www.qyjohn.net/?p=3801
Cloud tou buss …… Openstack!
OpenStack
CloudStack
Src: Bitergia
OpenStack: Managing
your Cloud!
OpenStack
Interrelated Projects to control pools of compute, storage, and networking resources
Managed through API & dashboard that give administrators control and empower users to
provision their own resources
Plugins (vendor specific)
OpenStack infrastructure
abstraction --- connect any vendor
Open Architecture --- connect
any tools with Open API
Open source (Apache license) software
accelerated innovation, community benefits
Plug-in architecture
no vendor lock-in (hypervisors, storage soln, SDN soln)
On demand control of large pools of compute,
network, storage
Enable IT automation
Multi-tenancy support with quotas and isolation
ability to control, monitor and monetize resources
27
Features/Benefit (high level)
OpenStack Core Services – the Spider web!
docs.openstack.org
OpenStack Core Services – Relation ship diagram (2012)
docs.openstack.org
30
OpenStack as Layers (2014)
Incrementaldeployment/complexity
What we touch today!
Provides a REST interface to:
Spawn, bootstrap, delete VMs
Built using a messaging arch
Supports multiple hypervisor
technologies
Supports multi-tenancy
32
Nova: Managing Compute
Nova API
Nova
scheduler
Nova
conductor
Messaging bus
Nova
compute
hypervisor
VM VM
Nova
compute
hypervisor
VM VM
Nova
compute
hypervisor
VM VM
Controller Node
Compute Nodes
Interface to manage images
Storage provided by drivers
Database to manage images
DB abstraction to match any driver
33
Glance: Managing images
Storage
Service
(File/Swift)
Glance
API
Controller
Glance
Registry
Metadata
Repository
Image
Repository
Tracking users and their permissions
Providing a catalog of available services
(with URLs)
New services first register with
keystone
Provides tokens for usage of any
service, using the RBAC model
34
Keystone: Managing identity
Identity Service
(Keystone)
Compute
Service
(Nova 8774)
Image
Service
(Glance 9292)
Storage
Service
(Swift 8080)
Network
Service
(Neutron
9696)
Credentials
Token & SC
(with TTL)
API Requests
with Token
Other ID
Backend
Token
Validation
35
Cinder: Managing block storage
Persistent block storage for VM instances
lives through reboots and crashes
Can be used to create bootable volumes
No need for ephemeral storage!
Multiple volumes (disks) for a single VM
Can backup volumes, (perhaps) in swift!
A frontend to create and manage virtual disks and their VM association
Storage
Service
(File/Swift)
Glance
API
Controller
Glance
Registry
Metadata
Repository
Image
Repository
http://www.slideshare.net/avishaytraeger/cinder-havana
Object = files, persistent and HA
Flat name-space
Unstructured blobs, replicated in a ring
across different zones
Default to three replicas
Objects accessible with a URL
swift.example.com/v1/account/container/object
Massively scalable, but with eventually
consistent behavior
36
Swift: Managing object storage
https://julien.danjou.info/blog/2012/openstack-swift-consistency-analysis
37
Storate services: Comparison
docs.openstack.org
API to create virtual networks
Software defined!
Modular and multi-tenant arch
API=service, implementation=vendor
Plugins make it technology agnostic
IPAM, load balancer, VPN …
Services provided by Network node
38
Neutron: Managing networks
Neutron Server
Core APIs API Extensions
Plugins
Messaging bus
Neutron
agent
L3 agent
Neutron
agent
L2 agent
VM VM
Controller Node
Compute Nodes
Neutron
agent
L2 agent
VM VM
Network Node
(optional)
Internet
Evolved Core view (2015)
Understanding this requires lots of time and training
Workshops and their
vision
Cloud and DCN
Openstack Overview: Layer 1 and 2
Details Layer 1: Nova, Glance, Keystone
Details Layer 2: Neutron, Cinder, Swift
Details: Orchestration of a cloud
Details: Monitoring and Billing
Detail: High Availability
Workshops on each aspect
Lots of hands on work, content to be developed iteratively
Funding expected from Industry and ICTRDF
DevStack: the default
installer
47
Questions?
https://twitter.com/openstack_isb
http://pta.gov.pk/trg/pta_openstack_2015.php
http://docs.openstack.org/developer/devstack/

Openstack Pakistan intro

  • 1.
    OpenStack Awareness Session AffanA. Syed Director Engineering, PLUMgrid Inc. Pakistan Telecommunication Authority, Oct 20th, 2015
  • 2.
    PLUMgrid’s Mission Deliver comprehensivevirtual networking solutions that scale, secure, and simplify the modern cloud data center Any Network Any Hardware Any Hypervisor Any Container Any Service Pervasive Scale and Security
  • 3.
    PLUMgrid Global AlliancePartners Technical AllianceOpenStack Distro Channel Partners
  • 4.
  • 5.
    ◦ A viewof the Cloud, from the clouds ◦ What is OpenStack? Why care? ◦ OpenStack: a 10,000 feet view ◦ Workshops and their content <Break> ◦ Demo session by Dr. Adnan Iqbal (Namal University) Outline
  • 6.
  • 7.
    How the CloudBusiness Model started Excess capacity/Under utilized servers Machine & Network virtualization Monetization opportunity through renting 7
  • 8.
  • 9.
    9 Machine and networkvirtualization 8GB 10TB 10TB 10TB 8GB 8GB 4 GB | 2 TB 4 GB | 8 TB 4 GB | 4 TB 2 GB | 2 TB 6 GB | 6 TB 2 GB | 4 TB 2 GB | 4 TB Physical Virtual Bridge Router LB BridgeBridge DHCP FW Bridge DHCP FW
  • 10.
    10 Money through rentalmodel Rent me 2 Machines Rent me 2 more machines Allow services to “scale out” on demand Cloud provider Cloud user
  • 11.
  • 12.
    Build compute powerswithout vendor lock-in Provide and build services, at lower cost Facebook has 20,000 server per admin Scale out easily by adding servers go to public clouds when needed (Cloud bursting) 12 Enterprises and Private clouds
  • 13.
    Give Me 2 Machines,Dual Core, 8GB RAM, L2 connectivity, and an SQL DB over a firewall What happens when using a cloud! physical virtual Dual Core | RAM 8GB Dual Core | RAM 8GB
  • 14.
    14 Managing and (re)provisioninga DCN is difficult Credit: Google
  • 15.
    OpenStack: Motivation and history 15 …and why OpenStack matters!
  • 16.
    OpenStack Future (fromits past!) In 2012 Boris Renski (CMO) Mirantis made three arguments for money in OpenStack Cloud is BIG $$$ Cloud will be open (Google, facebook, Rackspace back OpenStack) OpenStack won the OpenCloud war (2012) Average # of developers in an IRC channel as of 6/ Mirantis raised $100 million as pure- play OpenStack in Aug 2015
  • 17.
  • 18.
    19 Job opportunity “OpenStack continuesto gain mindshare among enterprise CIOs …….. We continue to see OpenStack becoming the de facto open source option for deploying private clouds. However, this will accelerate only after more OpenStack-trained developers enter the workforce…..” [The 451Research Take (https://451research.com/openstack)] OpenStack engineers make 36% more than other cloud engineers. Src: http://www.datacenterdynamics.com/
  • 19.
    OpenStack: A BriefHistory NASA Launches Nebula One of the first cloud computing platforms built for Federal Government Private Cloud March 2010: Rackspace Open Sources Cloud Files software, aka Swift May 2010: NASA open sources compute software, aka “Nova” June 2010: OpenStack is formed July 2010: The inaugural Design Summit April 2012: OpenStack Foundation nebula.nasa.gov
  • 20.
    Independent body toprotect, empower and promote OpenStack software Board of Directors (Platinum, Gold sponsors) 21 OpenStack® Foundation Project Technical Leads (PTL) Project Technical Leads (PTL) Technical Committee User Committee Legal Affairs Committee
  • 21.
    22 Platinum, Gold andCorporate members
  • 22.
    Fastest Growing GlobalOpen Source Community May 15, 2015
  • 23.
    24 Competitors….. Not there! Src:http://www.qyjohn.net/?p=3801 Cloud tou buss …… Openstack! OpenStack CloudStack Src: Bitergia
  • 24.
  • 25.
    OpenStack Interrelated Projects tocontrol pools of compute, storage, and networking resources Managed through API & dashboard that give administrators control and empower users to provision their own resources Plugins (vendor specific) OpenStack infrastructure abstraction --- connect any vendor Open Architecture --- connect any tools with Open API
  • 26.
    Open source (Apachelicense) software accelerated innovation, community benefits Plug-in architecture no vendor lock-in (hypervisors, storage soln, SDN soln) On demand control of large pools of compute, network, storage Enable IT automation Multi-tenancy support with quotas and isolation ability to control, monitor and monetize resources 27 Features/Benefit (high level)
  • 27.
    OpenStack Core Services– the Spider web! docs.openstack.org
  • 28.
    OpenStack Core Services– Relation ship diagram (2012) docs.openstack.org
  • 29.
    30 OpenStack as Layers(2014) Incrementaldeployment/complexity What we touch today!
  • 30.
    Provides a RESTinterface to: Spawn, bootstrap, delete VMs Built using a messaging arch Supports multiple hypervisor technologies Supports multi-tenancy 32 Nova: Managing Compute Nova API Nova scheduler Nova conductor Messaging bus Nova compute hypervisor VM VM Nova compute hypervisor VM VM Nova compute hypervisor VM VM Controller Node Compute Nodes
  • 31.
    Interface to manageimages Storage provided by drivers Database to manage images DB abstraction to match any driver 33 Glance: Managing images Storage Service (File/Swift) Glance API Controller Glance Registry Metadata Repository Image Repository
  • 32.
    Tracking users andtheir permissions Providing a catalog of available services (with URLs) New services first register with keystone Provides tokens for usage of any service, using the RBAC model 34 Keystone: Managing identity Identity Service (Keystone) Compute Service (Nova 8774) Image Service (Glance 9292) Storage Service (Swift 8080) Network Service (Neutron 9696) Credentials Token & SC (with TTL) API Requests with Token Other ID Backend Token Validation
  • 33.
    35 Cinder: Managing blockstorage Persistent block storage for VM instances lives through reboots and crashes Can be used to create bootable volumes No need for ephemeral storage! Multiple volumes (disks) for a single VM Can backup volumes, (perhaps) in swift! A frontend to create and manage virtual disks and their VM association Storage Service (File/Swift) Glance API Controller Glance Registry Metadata Repository Image Repository http://www.slideshare.net/avishaytraeger/cinder-havana
  • 34.
    Object = files,persistent and HA Flat name-space Unstructured blobs, replicated in a ring across different zones Default to three replicas Objects accessible with a URL swift.example.com/v1/account/container/object Massively scalable, but with eventually consistent behavior 36 Swift: Managing object storage https://julien.danjou.info/blog/2012/openstack-swift-consistency-analysis
  • 35.
  • 36.
    API to createvirtual networks Software defined! Modular and multi-tenant arch API=service, implementation=vendor Plugins make it technology agnostic IPAM, load balancer, VPN … Services provided by Network node 38 Neutron: Managing networks Neutron Server Core APIs API Extensions Plugins Messaging bus Neutron agent L3 agent Neutron agent L2 agent VM VM Controller Node Compute Nodes Neutron agent L2 agent VM VM Network Node (optional) Internet
  • 37.
    Evolved Core view(2015) Understanding this requires lots of time and training
  • 38.
  • 39.
    Cloud and DCN OpenstackOverview: Layer 1 and 2 Details Layer 1: Nova, Glance, Keystone Details Layer 2: Neutron, Cinder, Swift Details: Orchestration of a cloud Details: Monitoring and Billing Detail: High Availability Workshops on each aspect Lots of hands on work, content to be developed iteratively Funding expected from Industry and ICTRDF
  • 40.
  • 41.