SlideShare a Scribd company logo
1 of 21
StratusLab: Darn Simple Cloud
Charles (Cal) Loomis (CNRS/LAL & SixSq Sàrl)
FOSDEM’13: Cloud Devroom (3 February 2013)
StratusLab


What is it?
  Complete Infrastructure as a Service (IaaS) cloud distribution
  Open source with Apache 2 license
  Solid IaaS for direct use and for PaaS/SaaS developers



Focus: Darn Simple Cloud
  Simple to install, using commodity hardware
  Simple to use, from (most) any client machine
  Scales down as well as up!




                                                                    2
Bridging the Chasm…


Users
  How to use virtual machines to get my work done?
  How to structure, store, access, and protect data?
  Realize shared infrastructures with customized env. are possible

Application Developers
  How to use cloud techniques to improve my applications?
  … and my development workflows?
  Applications can be services with pluses and minuses…

Data Centers
  Reuse existing (commodity) hardware investments
  Take advantage of (and train) existing system administrators
  How to manage/use a (private, community, public) cloud?

Significant benefits from cloud even without large scale elasticity!
                                                                       3
Where did it start?

Informal collaboration to investigate
running grid services on Amazon
EC2 (2007)
                  Identified need for open
                  source cloud distribution.




                    StratusLab Project (6/2010 to
                    5/2012) co-funded by EC with
                    6 partners from 5 countries

 Production dist. with academic
 & commercial deployments.


                                               Open collaboration
Website: http://stratuslab.eu                  to continue the
Twitter: @StratusLab                           development and support of
Support:support@stratuslab.eu
                                               the StratusLab software
Source: http://github.com/StratusLab
                                                                            4
StratusLab Services




                      5
Releases


Post-Project Releases
  V2.1 (16/10): Streamlined release with obsolete components removed
   Better support for virtio drivers to improve IO performance
  V2.1.1 (29/11): Bug fix release (storage upload feature) and better
   Windows support
  V13.02 (31/1): Support for CloudInit contextualization and bug fixes



Release Policy
  Quarterly timed releases (13.02, 13.05, …)
  Intermediate bug fix releases as needed
  Provide (6-month) roadmap for the StratusLab evolution


                                                                          6
Compute


Features
  Fast provisioning of virtual machines, with low latency start-up
  Availability of VM images of common operating systems

Contextualization
  HEPiX&OpenNebula CDROM contextualization by default
  CloudInit (disk based) also supported

Implementation
  API: XML-RPC interface of OpenNebula
  OpenNebula (C++, Ruby) with customized hooks
  Hooks primarily for caching, snapshots, and storage access
  CentOS, Ubuntu, OpenSuSE, Debian, Fedora, ScientificLinux images
   created and supported by StratusLab

                                                                      7
Storage


Features
  Volume abstraction for storage service
  Provide users with persistent storage for data
  Serves also as cache of images for VM instances
  (No file-based or object-based storage service)


Implementation
  API: Proprietary REST interface with CRUD actions
  Java-based service using MySQL database for state information
  Can use iSCSI or shared file system for physical storage
  Can use simple files or LVM volumes for disk content


                                                                   8
Network


Features
  Support3 specific use cases: public service (public),
   batch system (local), and BOINC-like worker (private)
  Dynamic configuration of network switches not needed
  Use standard services for (virtual) machine network configuration


Implementation
  No API: manual, static configuration of network
  Rec. configuration: VLAN for cloud services separate VLAN for VMs
  All classes of IP addresses are optional, can create other classes
  Uses DHCP for VM network configuration
  Users responsible for protecting their machines

                                                                        9
Marketplace & Image Handling


Priorities
  Mechanism for sharing and trusting images
  Possible to distribute fixed, read-only data sets as well
  Split the storage of image metadata and image contents
  Define roles for creator, user, administrator, and validator


Implementation
  Marketplace API: Proprietary REST API for create, read, search
  Marketplace acts as image registry and handles only metadata
  Image contents can be located on any public (web) server
  ‘Private’ images can also be held in cloud storage


                                                                    10
Image Handling Workflow




                          11
Tools


Command Line Client
  Administrator: simplifies StratusLab installation
  Users: access StratusLab cloud from anywhere

Administration
  Quarantine for stopped virtual machines
  Monitoring of cloud activity and resources

Authentication and Authorization
  Supports username/password, certificates, cert. proxies
  Specification in local file and/or LDAP




                                                             12
Tools


Information from Developers
  Web site documentation and support mailing list
  Live tutorials (usually 2-3 per year)
  Workshops (next week of 11 March 2013 in Paris)




                                                     13
StratusLab Deployments


Reference Cloud Services
  (~)Open infrastructures for using StratusLab and providing feedback
  Operated on a first-come, first-served, best-effort basis
  In production 2+ years, with 250+ registered users
  Two sites: LAL (Orsay, France) and GRNET (Athens, Greece)

Other deployments…
  Academic: France, Ireland, UK, Vietnam, South Africa, …
  Commercial: Atos, Helix Nebula, …

Building on top…
  SlipStream: cloud based systems deployment and testing
  Go-based CLI …


                                                                         14
Priorities for Evolution


Interfaces
  Provide Libcloud (python) driver for StratusLab
  Adopt CIMI as the standard interface to services
  Provide complete browser interface for all services
  Provide EC2 adaptor to REST interface

Simplicity, Scalability, & Robustness
  Direct use of libvirt as VM manager
  Distributed database (Cassandra, Couchbase) as information ‘bus’

Better services for system administrators
  Improved overview and monitoring of infrastructure
  Fine-grained accounts for all resources
  Migration control
                                                                      15
Direct Use of Libvirt


libvirt
  libvirt model fits very well with StratusLab
  Already using libvirt indirectly behind OpenNebula
  Will significantly simplify the distribution, esp. wrt storage volumes



Plan
  Develop ‘placement service’ to replace OpenNebula scheduler
  Bind current VM management code to libvirt directly
  Modify services to take advantage of libvirt storage pools




                                                                            16
Distributed Database


Use distributed database as coordination backbone
  Already have experience with Cassandra, looking at Couchbase also
  Will make it easy to scale both front-ends and hypervisor nodes
  Provides easy mechanism for reporting resource utilization
  Similarly for coordination between services



Plan
  Evaluate the pros/cons of the DB solutions
  Implement prototype service (probably monitoring) as POC
  Move other services to DB, starting with VM management



                                                                       17
CIMI


CIMI (DMTF DSP0263 http://dmtf.org/standards/cloud)
  Resource-Oriented API with reasonable mappings to JSON and XML
  IaaS-focused specification that will likely become international std.
  Defined mapping to OVF schema
  Full coverage of StratusLab services

Plan
  Migrate services individually
  Keep CLI and Libcloud working throughout migration
  Changes should be transparent to users
  Developers using API will see backward-incompatible changes

Aside: A working StratusLabplugin for rOCCI is available.

                                                                           18
Conclusions


StratusLab Cloud Distribution
  Supported, stable, and production-quality IaaS cloud distribution
  Used for reference cloud service for 2+ years
  Other academic and commercial deployments
  Defined, ambitious roadmap for the its continued evolution

StratusLab Collaboration
  New collaborators welcome! Developers and documenters!
  Weekly phone conference between developers
  Biannual StratusLab workshops (next week of 11 March 2013)



Try it and provide feedback on software, services, support, …

                                                                       19
Questions and Discussion

   Website: http://stratuslab.eu/
       Twitter: @StratusLab
  Support: support@stratuslab.eu
Source: http://github.com/StratusLab




                                       20
http://stratuslab.eu/



            Copyright © 2013, Members of the StratusLab collaboration.




This work is licensed under the Creative Commons Attribution 3.0
Unported License (http://creativecommons.org/licenses/by/3.0/).

More Related Content

What's hot

A Reference Architecture for a Federated Cloud for Research
A Reference Architecture for a Federated Cloud for ResearchA Reference Architecture for a Federated Cloud for Research
A Reference Architecture for a Federated Cloud for ResearchResearch Data Alliance
 
An operational view into docker registry with scalability, access control and...
An operational view into docker registry with scalability, access control and...An operational view into docker registry with scalability, access control and...
An operational view into docker registry with scalability, access control and...Conference Papers
 
Big Data 2107 for Ribbon
Big Data 2107 for RibbonBig Data 2107 for Ribbon
Big Data 2107 for RibbonSamuel Dratwa
 
Bringing Private Cloud Computing to HPC and Science - Berkeley Lab - July 2014
Bringing Private Cloud Computing to HPC and Science  - Berkeley Lab - July 2014 Bringing Private Cloud Computing to HPC and Science  - Berkeley Lab - July 2014
Bringing Private Cloud Computing to HPC and Science - Berkeley Lab - July 2014 OpenNebula Project
 
Open Stack Cloud Services
Open Stack Cloud ServicesOpen Stack Cloud Services
Open Stack Cloud ServicesSaurabh Gupta
 
The Why and How of HPC-Cloud Hybrids with OpenStack - Lev Lafayette, Universi...
The Why and How of HPC-Cloud Hybrids with OpenStack - Lev Lafayette, Universi...The Why and How of HPC-Cloud Hybrids with OpenStack - Lev Lafayette, Universi...
The Why and How of HPC-Cloud Hybrids with OpenStack - Lev Lafayette, Universi...OpenStack
 
e-Infrastructures for Science and Industry
e-Infrastructures for Science and Industrye-Infrastructures for Science and Industry
e-Infrastructures for Science and IndustryWolfgang Gentzsch
 
OpenStack at Xen summit Asia
OpenStack at Xen summit Asia OpenStack at Xen summit Asia
OpenStack at Xen summit Asia Jaesuk Ahn
 
LINBIT_HA_Business_Apr2016
LINBIT_HA_Business_Apr2016LINBIT_HA_Business_Apr2016
LINBIT_HA_Business_Apr2016Alexandre Huynh
 
Computer_Clustering_Technologies
Computer_Clustering_TechnologiesComputer_Clustering_Technologies
Computer_Clustering_TechnologiesManish Chopra
 
Achieving Cost & Resource Effeciencies through Trove Database As-A-Service (D...
Achieving Cost & Resource Effeciencies through Trove Database As-A-Service (D...Achieving Cost & Resource Effeciencies through Trove Database As-A-Service (D...
Achieving Cost & Resource Effeciencies through Trove Database As-A-Service (D...Dean Delamont
 
OSDC 2012 - OpenNebula: Open-source Solution for Data Center Virtualization
OSDC 2012 - OpenNebula: Open-source Solution for Data Center VirtualizationOSDC 2012 - OpenNebula: Open-source Solution for Data Center Virtualization
OSDC 2012 - OpenNebula: Open-source Solution for Data Center VirtualizationOpenNebula Project
 
Learning From Real Practice of Providing Highly Available Hybrid Cloud Servic...
Learning From Real Practice of Providing Highly Available Hybrid Cloud Servic...Learning From Real Practice of Providing Highly Available Hybrid Cloud Servic...
Learning From Real Practice of Providing Highly Available Hybrid Cloud Servic...LF Events
 
MongoDB Sharding
MongoDB ShardingMongoDB Sharding
MongoDB Shardinguzzal basak
 

What's hot (20)

A Reference Architecture for a Federated Cloud for Research
A Reference Architecture for a Federated Cloud for ResearchA Reference Architecture for a Federated Cloud for Research
A Reference Architecture for a Federated Cloud for Research
 
An operational view into docker registry with scalability, access control and...
An operational view into docker registry with scalability, access control and...An operational view into docker registry with scalability, access control and...
An operational view into docker registry with scalability, access control and...
 
Big Data 2107 for Ribbon
Big Data 2107 for RibbonBig Data 2107 for Ribbon
Big Data 2107 for Ribbon
 
Bringing Private Cloud Computing to HPC and Science - Berkeley Lab - July 2014
Bringing Private Cloud Computing to HPC and Science  - Berkeley Lab - July 2014 Bringing Private Cloud Computing to HPC and Science  - Berkeley Lab - July 2014
Bringing Private Cloud Computing to HPC and Science - Berkeley Lab - July 2014
 
Open Stack Cloud Services
Open Stack Cloud ServicesOpen Stack Cloud Services
Open Stack Cloud Services
 
The Why and How of HPC-Cloud Hybrids with OpenStack - Lev Lafayette, Universi...
The Why and How of HPC-Cloud Hybrids with OpenStack - Lev Lafayette, Universi...The Why and How of HPC-Cloud Hybrids with OpenStack - Lev Lafayette, Universi...
The Why and How of HPC-Cloud Hybrids with OpenStack - Lev Lafayette, Universi...
 
e-Infrastructures for Science and Industry
e-Infrastructures for Science and Industrye-Infrastructures for Science and Industry
e-Infrastructures for Science and Industry
 
Openstack
OpenstackOpenstack
Openstack
 
Cloud & Data Center Networking
Cloud & Data Center NetworkingCloud & Data Center Networking
Cloud & Data Center Networking
 
OpenStack at Xen summit Asia
OpenStack at Xen summit Asia OpenStack at Xen summit Asia
OpenStack at Xen summit Asia
 
LINBIT_HA_Business_Apr2016
LINBIT_HA_Business_Apr2016LINBIT_HA_Business_Apr2016
LINBIT_HA_Business_Apr2016
 
INDIGO-PaaS-overview
INDIGO-PaaS-overviewINDIGO-PaaS-overview
INDIGO-PaaS-overview
 
Computer_Clustering_Technologies
Computer_Clustering_TechnologiesComputer_Clustering_Technologies
Computer_Clustering_Technologies
 
HPC Compass 2016_17
HPC Compass 2016_17HPC Compass 2016_17
HPC Compass 2016_17
 
Cloud Computing
Cloud ComputingCloud Computing
Cloud Computing
 
Achieving Cost & Resource Effeciencies through Trove Database As-A-Service (D...
Achieving Cost & Resource Effeciencies through Trove Database As-A-Service (D...Achieving Cost & Resource Effeciencies through Trove Database As-A-Service (D...
Achieving Cost & Resource Effeciencies through Trove Database As-A-Service (D...
 
OSDC 2012 - OpenNebula: Open-source Solution for Data Center Virtualization
OSDC 2012 - OpenNebula: Open-source Solution for Data Center VirtualizationOSDC 2012 - OpenNebula: Open-source Solution for Data Center Virtualization
OSDC 2012 - OpenNebula: Open-source Solution for Data Center Virtualization
 
Big Data NoSQL 1017
Big Data NoSQL 1017Big Data NoSQL 1017
Big Data NoSQL 1017
 
Learning From Real Practice of Providing Highly Available Hybrid Cloud Servic...
Learning From Real Practice of Providing Highly Available Hybrid Cloud Servic...Learning From Real Practice of Providing Highly Available Hybrid Cloud Servic...
Learning From Real Practice of Providing Highly Available Hybrid Cloud Servic...
 
MongoDB Sharding
MongoDB ShardingMongoDB Sharding
MongoDB Sharding
 

Viewers also liked

2013 02-11 - leeds lab
2013 02-11 - leeds lab 2013 02-11 - leeds lab
2013 02-11 - leeds lab adrianfward
 
Also, wat is dat Internet?
Also, wat is dat Internet?Also, wat is dat Internet?
Also, wat is dat Internet?webfischerei
 
StratusLab: Darn Simple Cloud
StratusLab: Darn Simple CloudStratusLab: Darn Simple Cloud
StratusLab: Darn Simple Cloudstratuslab
 
Technowise 2.0 | 5 Powerful Payplan Combined into 1 brilliant opportunity.
Technowise 2.0 | 5 Powerful Payplan Combined into 1 brilliant opportunity.Technowise 2.0 | 5 Powerful Payplan Combined into 1 brilliant opportunity.
Technowise 2.0 | 5 Powerful Payplan Combined into 1 brilliant opportunity.Arkie Rivera
 
SALVEO ORGANIC BARLEY GRASS
SALVEO ORGANIC BARLEY GRASSSALVEO ORGANIC BARLEY GRASS
SALVEO ORGANIC BARLEY GRASSArkie Rivera
 
Providing Bioinformatics Services on Cloud
Providing Bioinformatics Services on CloudProviding Bioinformatics Services on Cloud
Providing Bioinformatics Services on Cloudstratuslab
 
Scientific Cloud Computing: Present & Future
Scientific Cloud Computing: Present & FutureScientific Cloud Computing: Present & Future
Scientific Cloud Computing: Present & Futurestratuslab
 
Website Design Process
Website Design ProcessWebsite Design Process
Website Design ProcessChris Drabsch
 

Viewers also liked (8)

2013 02-11 - leeds lab
2013 02-11 - leeds lab 2013 02-11 - leeds lab
2013 02-11 - leeds lab
 
Also, wat is dat Internet?
Also, wat is dat Internet?Also, wat is dat Internet?
Also, wat is dat Internet?
 
StratusLab: Darn Simple Cloud
StratusLab: Darn Simple CloudStratusLab: Darn Simple Cloud
StratusLab: Darn Simple Cloud
 
Technowise 2.0 | 5 Powerful Payplan Combined into 1 brilliant opportunity.
Technowise 2.0 | 5 Powerful Payplan Combined into 1 brilliant opportunity.Technowise 2.0 | 5 Powerful Payplan Combined into 1 brilliant opportunity.
Technowise 2.0 | 5 Powerful Payplan Combined into 1 brilliant opportunity.
 
SALVEO ORGANIC BARLEY GRASS
SALVEO ORGANIC BARLEY GRASSSALVEO ORGANIC BARLEY GRASS
SALVEO ORGANIC BARLEY GRASS
 
Providing Bioinformatics Services on Cloud
Providing Bioinformatics Services on CloudProviding Bioinformatics Services on Cloud
Providing Bioinformatics Services on Cloud
 
Scientific Cloud Computing: Present & Future
Scientific Cloud Computing: Present & FutureScientific Cloud Computing: Present & Future
Scientific Cloud Computing: Present & Future
 
Website Design Process
Website Design ProcessWebsite Design Process
Website Design Process
 

Similar to StratusLab at FOSDEM'13

Ignacio design and building of iaa s clouds
Ignacio design and building of iaa s cloudsIgnacio design and building of iaa s clouds
Ignacio design and building of iaa s cloudsEuroCloud
 
Ignacio design and building of iaa s clouds
Ignacio design and building of iaa s cloudsIgnacio design and building of iaa s clouds
Ignacio design and building of iaa s cloudsEuroCloud
 
Delivering IaaS with Open Source Software
Delivering IaaS with Open Source SoftwareDelivering IaaS with Open Source Software
Delivering IaaS with Open Source SoftwareMark Hinkle
 
CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018Krishna-Kumar
 
How to Think Multi-Cloud
How to Think Multi-CloudHow to Think Multi-Cloud
How to Think Multi-CloudRightScale
 
Horizontal scaling with Galaxy
Horizontal scaling with GalaxyHorizontal scaling with Galaxy
Horizontal scaling with GalaxyEnis Afgan
 
Openstack_administration
Openstack_administrationOpenstack_administration
Openstack_administrationAshish Sharma
 
OpenStack for VMware Administrators
OpenStack for VMware AdministratorsOpenStack for VMware Administrators
OpenStack for VMware AdministratorsTrevor Roberts Jr.
 
Why kubernetes for Serverless (FaaS)
Why kubernetes for Serverless (FaaS)Why kubernetes for Serverless (FaaS)
Why kubernetes for Serverless (FaaS)Krishna-Kumar
 
Kubernetes for Serverless - Serverless Summit 2017 - Krishna Kumar
Kubernetes for Serverless  - Serverless Summit 2017 - Krishna KumarKubernetes for Serverless  - Serverless Summit 2017 - Krishna Kumar
Kubernetes for Serverless - Serverless Summit 2017 - Krishna KumarCodeOps Technologies LLP
 
CloudStack DC Meetup - Apache CloudStack Overview and 4.1/4.2 Preview
CloudStack DC Meetup - Apache CloudStack Overview and 4.1/4.2 PreviewCloudStack DC Meetup - Apache CloudStack Overview and 4.1/4.2 Preview
CloudStack DC Meetup - Apache CloudStack Overview and 4.1/4.2 PreviewChip Childers
 
Cloud Strategies for a modern hybrid datacenter - Dec 2015
Cloud Strategies for a modern hybrid datacenter - Dec 2015Cloud Strategies for a modern hybrid datacenter - Dec 2015
Cloud Strategies for a modern hybrid datacenter - Dec 2015Miguel Pérez Colino
 
Vijay Oscon
Vijay OsconVijay Oscon
Vijay Osconvijayrvr
 
Java Web Programming Using Cloud Platform: Module 10
Java Web Programming Using Cloud Platform: Module 10Java Web Programming Using Cloud Platform: Module 10
Java Web Programming Using Cloud Platform: Module 10IMC Institute
 
Research Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and ScienceResearch Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and Scienceinventy
 
Cloud computing and OpenStack
Cloud computing and OpenStackCloud computing and OpenStack
Cloud computing and OpenStackEdgar Magana
 
OpenStack or CloudStack
OpenStack or CloudStackOpenStack or CloudStack
OpenStack or CloudStackAhmed Banafa
 
Pivotal Cloud Foundry and its usage in ecosystem
Pivotal Cloud Foundry and its usage in ecosystemPivotal Cloud Foundry and its usage in ecosystem
Pivotal Cloud Foundry and its usage in ecosystemKarthikeyanSambandam2
 

Similar to StratusLab at FOSDEM'13 (20)

Ignacio design and building of iaa s clouds
Ignacio design and building of iaa s cloudsIgnacio design and building of iaa s clouds
Ignacio design and building of iaa s clouds
 
Ignacio design and building of iaa s clouds
Ignacio design and building of iaa s cloudsIgnacio design and building of iaa s clouds
Ignacio design and building of iaa s clouds
 
Delivering IaaS with Open Source Software
Delivering IaaS with Open Source SoftwareDelivering IaaS with Open Source Software
Delivering IaaS with Open Source Software
 
CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018
 
How to Think Multi-Cloud
How to Think Multi-CloudHow to Think Multi-Cloud
How to Think Multi-Cloud
 
Horizontal scaling with Galaxy
Horizontal scaling with GalaxyHorizontal scaling with Galaxy
Horizontal scaling with Galaxy
 
PaaS Solutions Comparison
PaaS Solutions ComparisonPaaS Solutions Comparison
PaaS Solutions Comparison
 
Openstack_administration
Openstack_administrationOpenstack_administration
Openstack_administration
 
OpenStack for VMware Administrators
OpenStack for VMware AdministratorsOpenStack for VMware Administrators
OpenStack for VMware Administrators
 
Why kubernetes for Serverless (FaaS)
Why kubernetes for Serverless (FaaS)Why kubernetes for Serverless (FaaS)
Why kubernetes for Serverless (FaaS)
 
Kubernetes for Serverless - Serverless Summit 2017 - Krishna Kumar
Kubernetes for Serverless  - Serverless Summit 2017 - Krishna KumarKubernetes for Serverless  - Serverless Summit 2017 - Krishna Kumar
Kubernetes for Serverless - Serverless Summit 2017 - Krishna Kumar
 
CloudStack DC Meetup - Apache CloudStack Overview and 4.1/4.2 Preview
CloudStack DC Meetup - Apache CloudStack Overview and 4.1/4.2 PreviewCloudStack DC Meetup - Apache CloudStack Overview and 4.1/4.2 Preview
CloudStack DC Meetup - Apache CloudStack Overview and 4.1/4.2 Preview
 
Cloud Strategies for a modern hybrid datacenter - Dec 2015
Cloud Strategies for a modern hybrid datacenter - Dec 2015Cloud Strategies for a modern hybrid datacenter - Dec 2015
Cloud Strategies for a modern hybrid datacenter - Dec 2015
 
Vijay Oscon
Vijay OsconVijay Oscon
Vijay Oscon
 
Java Web Programming Using Cloud Platform: Module 10
Java Web Programming Using Cloud Platform: Module 10Java Web Programming Using Cloud Platform: Module 10
Java Web Programming Using Cloud Platform: Module 10
 
Research Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and ScienceResearch Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and Science
 
Cloud computing and OpenStack
Cloud computing and OpenStackCloud computing and OpenStack
Cloud computing and OpenStack
 
OpenStack or CloudStack
OpenStack or CloudStackOpenStack or CloudStack
OpenStack or CloudStack
 
Pivotal Cloud Foundry and its usage in ecosystem
Pivotal Cloud Foundry and its usage in ecosystemPivotal Cloud Foundry and its usage in ecosystem
Pivotal Cloud Foundry and its usage in ecosystem
 
Sharad openstack slides
Sharad openstack slidesSharad openstack slides
Sharad openstack slides
 

Recently uploaded

Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...ScyllaDB
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctBrainSell Technologies
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxFIDO Alliance
 
Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data SciencePaolo Missier
 
Microsoft BitLocker Bypass Attack Method.pdf
Microsoft BitLocker Bypass Attack Method.pdfMicrosoft BitLocker Bypass Attack Method.pdf
Microsoft BitLocker Bypass Attack Method.pdfOverkill Security
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptxFIDO Alliance
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightSafe Software
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxFIDO Alliance
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...ScyllaDB
 
Top 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTop 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTopCSSGallery
 
WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024Lorenzo Miniero
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...panagenda
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)Samir Dash
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMKumar Satyam
 
AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentationyogeshlabana357357
 
Navigating the Large Language Model choices_Ravi Daparthi
Navigating the Large Language Model choices_Ravi DaparthiNavigating the Large Language Model choices_Ravi Daparthi
Navigating the Large Language Model choices_Ravi DaparthiRaviKumarDaparthi
 
ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityVictorSzoltysek
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...FIDO Alliance
 
Simplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxSimplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxMarkSteadman7
 

Recently uploaded (20)

Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage Intacct
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptx
 
Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data Science
 
Microsoft BitLocker Bypass Attack Method.pdf
Microsoft BitLocker Bypass Attack Method.pdfMicrosoft BitLocker Bypass Attack Method.pdf
Microsoft BitLocker Bypass Attack Method.pdf
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptx
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
 
Top 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTop 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development Companies
 
WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentation
 
Navigating the Large Language Model choices_Ravi Daparthi
Navigating the Large Language Model choices_Ravi DaparthiNavigating the Large Language Model choices_Ravi Daparthi
Navigating the Large Language Model choices_Ravi Daparthi
 
ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps Productivity
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
 
Simplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxSimplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptx
 

StratusLab at FOSDEM'13

  • 1. StratusLab: Darn Simple Cloud Charles (Cal) Loomis (CNRS/LAL & SixSq Sàrl) FOSDEM’13: Cloud Devroom (3 February 2013)
  • 2. StratusLab What is it?  Complete Infrastructure as a Service (IaaS) cloud distribution  Open source with Apache 2 license  Solid IaaS for direct use and for PaaS/SaaS developers Focus: Darn Simple Cloud  Simple to install, using commodity hardware  Simple to use, from (most) any client machine  Scales down as well as up! 2
  • 3. Bridging the Chasm… Users  How to use virtual machines to get my work done?  How to structure, store, access, and protect data?  Realize shared infrastructures with customized env. are possible Application Developers  How to use cloud techniques to improve my applications?  … and my development workflows?  Applications can be services with pluses and minuses… Data Centers  Reuse existing (commodity) hardware investments  Take advantage of (and train) existing system administrators  How to manage/use a (private, community, public) cloud? Significant benefits from cloud even without large scale elasticity! 3
  • 4. Where did it start? Informal collaboration to investigate running grid services on Amazon EC2 (2007) Identified need for open source cloud distribution. StratusLab Project (6/2010 to 5/2012) co-funded by EC with 6 partners from 5 countries Production dist. with academic & commercial deployments. Open collaboration Website: http://stratuslab.eu to continue the Twitter: @StratusLab development and support of Support:support@stratuslab.eu the StratusLab software Source: http://github.com/StratusLab 4
  • 6. Releases Post-Project Releases  V2.1 (16/10): Streamlined release with obsolete components removed Better support for virtio drivers to improve IO performance  V2.1.1 (29/11): Bug fix release (storage upload feature) and better Windows support  V13.02 (31/1): Support for CloudInit contextualization and bug fixes Release Policy  Quarterly timed releases (13.02, 13.05, …)  Intermediate bug fix releases as needed  Provide (6-month) roadmap for the StratusLab evolution 6
  • 7. Compute Features  Fast provisioning of virtual machines, with low latency start-up  Availability of VM images of common operating systems Contextualization  HEPiX&OpenNebula CDROM contextualization by default  CloudInit (disk based) also supported Implementation  API: XML-RPC interface of OpenNebula  OpenNebula (C++, Ruby) with customized hooks  Hooks primarily for caching, snapshots, and storage access  CentOS, Ubuntu, OpenSuSE, Debian, Fedora, ScientificLinux images created and supported by StratusLab 7
  • 8. Storage Features  Volume abstraction for storage service  Provide users with persistent storage for data  Serves also as cache of images for VM instances  (No file-based or object-based storage service) Implementation  API: Proprietary REST interface with CRUD actions  Java-based service using MySQL database for state information  Can use iSCSI or shared file system for physical storage  Can use simple files or LVM volumes for disk content 8
  • 9. Network Features  Support3 specific use cases: public service (public), batch system (local), and BOINC-like worker (private)  Dynamic configuration of network switches not needed  Use standard services for (virtual) machine network configuration Implementation  No API: manual, static configuration of network  Rec. configuration: VLAN for cloud services separate VLAN for VMs  All classes of IP addresses are optional, can create other classes  Uses DHCP for VM network configuration  Users responsible for protecting their machines 9
  • 10. Marketplace & Image Handling Priorities  Mechanism for sharing and trusting images  Possible to distribute fixed, read-only data sets as well  Split the storage of image metadata and image contents  Define roles for creator, user, administrator, and validator Implementation  Marketplace API: Proprietary REST API for create, read, search  Marketplace acts as image registry and handles only metadata  Image contents can be located on any public (web) server  ‘Private’ images can also be held in cloud storage 10
  • 12. Tools Command Line Client  Administrator: simplifies StratusLab installation  Users: access StratusLab cloud from anywhere Administration  Quarantine for stopped virtual machines  Monitoring of cloud activity and resources Authentication and Authorization  Supports username/password, certificates, cert. proxies  Specification in local file and/or LDAP 12
  • 13. Tools Information from Developers  Web site documentation and support mailing list  Live tutorials (usually 2-3 per year)  Workshops (next week of 11 March 2013 in Paris) 13
  • 14. StratusLab Deployments Reference Cloud Services  (~)Open infrastructures for using StratusLab and providing feedback  Operated on a first-come, first-served, best-effort basis  In production 2+ years, with 250+ registered users  Two sites: LAL (Orsay, France) and GRNET (Athens, Greece) Other deployments…  Academic: France, Ireland, UK, Vietnam, South Africa, …  Commercial: Atos, Helix Nebula, … Building on top…  SlipStream: cloud based systems deployment and testing  Go-based CLI … 14
  • 15. Priorities for Evolution Interfaces  Provide Libcloud (python) driver for StratusLab  Adopt CIMI as the standard interface to services  Provide complete browser interface for all services  Provide EC2 adaptor to REST interface Simplicity, Scalability, & Robustness  Direct use of libvirt as VM manager  Distributed database (Cassandra, Couchbase) as information ‘bus’ Better services for system administrators  Improved overview and monitoring of infrastructure  Fine-grained accounts for all resources  Migration control 15
  • 16. Direct Use of Libvirt libvirt  libvirt model fits very well with StratusLab  Already using libvirt indirectly behind OpenNebula  Will significantly simplify the distribution, esp. wrt storage volumes Plan  Develop ‘placement service’ to replace OpenNebula scheduler  Bind current VM management code to libvirt directly  Modify services to take advantage of libvirt storage pools 16
  • 17. Distributed Database Use distributed database as coordination backbone  Already have experience with Cassandra, looking at Couchbase also  Will make it easy to scale both front-ends and hypervisor nodes  Provides easy mechanism for reporting resource utilization  Similarly for coordination between services Plan  Evaluate the pros/cons of the DB solutions  Implement prototype service (probably monitoring) as POC  Move other services to DB, starting with VM management 17
  • 18. CIMI CIMI (DMTF DSP0263 http://dmtf.org/standards/cloud)  Resource-Oriented API with reasonable mappings to JSON and XML  IaaS-focused specification that will likely become international std.  Defined mapping to OVF schema  Full coverage of StratusLab services Plan  Migrate services individually  Keep CLI and Libcloud working throughout migration  Changes should be transparent to users  Developers using API will see backward-incompatible changes Aside: A working StratusLabplugin for rOCCI is available. 18
  • 19. Conclusions StratusLab Cloud Distribution  Supported, stable, and production-quality IaaS cloud distribution  Used for reference cloud service for 2+ years  Other academic and commercial deployments  Defined, ambitious roadmap for the its continued evolution StratusLab Collaboration  New collaborators welcome! Developers and documenters!  Weekly phone conference between developers  Biannual StratusLab workshops (next week of 11 March 2013) Try it and provide feedback on software, services, support, … 19
  • 20. Questions and Discussion Website: http://stratuslab.eu/ Twitter: @StratusLab Support: support@stratuslab.eu Source: http://github.com/StratusLab 20
  • 21. http://stratuslab.eu/ Copyright © 2013, Members of the StratusLab collaboration. This work is licensed under the Creative Commons Attribution 3.0 Unported License (http://creativecommons.org/licenses/by/3.0/).