SlideShare a Scribd company logo
1 of 26
Download to read offline
StratusLab: Darn Simple Cloud
Charles (Cal) Loomis
CNRS/LAL & SixSq Sàrl
29 May 2013
2
What is it?
 Complete cloud distribution
 Open source (Apache 2 license)
 Works well for production
private and public IaaS clouds
Focus: Darn Simple Cloud
 Simple to install on commodity
hardware
 Simple to use, from any client
machine
 Scales down as well as up!
Infrastructure as a Service (IaaS)
+ Customized environment
+ Easy access to scalable
resources
− Variety of APIs and interfaces
− Image creation is tedious
− Geared towards single
machines not full services
StratusLab
3
State of the Art
Provider: Amazon Web Services (AWS)
 Leading and largest IaaS service provider
 Improving and adding new services at a phenomenal rate
 Almost all IaaS providers use AWS-like service semantics, but
differentiate based on price, SLAs, location, etc.
Commercial Cloud Distribution: VM-ware
 Extremely good and complete
 Very expensive, except for ESXi hypervisor (free)
Open Source Cloud Distributions: Many!
 Essentially none in 2007; now easily a dozen different distributions
 StratusLab, …, OpenStack, OpenNebula, CloudStack
 Very different levels of maturity, stability, scalability, etc.
4
Why are cloud technologies useful?
Users
 Custom environment: no more porting, revalidation of code
 Simple access: use of REST and RPC over HTTP(S)
 Reasonable cost: pay-as-you-go
Administrators
 Flexible management: separate mgt. of machines and services
 Separation of responsibilities: Hardware / Services / Platforms / Users
Resource Providers
 Better utilization of shared resources
 Federation (outsourcing) possible
5
Where did it start?
Informal collaboration to investigate
running grid services on Amazon
EC2 (2007)
StratusLab Project (6/2010 to
5/2012) co-funded by EC with
6 partners from 5 countries
Open collaboration
to continue the
development and support of
the StratusLab software
Website: http://stratuslab.eu
Twitter: @StratusLab
Support: support@stratuslab.eu
Source: http://github.com/StratusLab
Identified need for open
source cloud distribution.
Production dist. with academic
& commercial deployments.
6
Releases
Post-Project Releases
 V2.1 (16/10): Streamlined release; improved IO perf. with virtio drivers
 V2.1.1 (29/11): Bug fixes; storage upload; better Windows support
 V13.02 (31/1): Support for CloudInit contextualization and bug fixes
 V13.05 (6/1?): Initial steps towards new architecture
Release Policy
 Quarterly timed releases (13.02, 13.05, …)
 Intermediate bug fix releases as needed
 Roadmap (6-month) available describing the StratusLab evolution
Support Policy
 Best-effort support for all recent releases, emphasis on latest
7
StratusLab Services
8
StratusLab
Complete Infrastructure as a Service cloud distribution
 Developed within EU project, software maintained by partners
 Focus: Simple to install and simple to use
Services
 Compute: Virtual machine management (currently uses OpenNebula)
 Storage: Volume-based storage service
 Network: Simple configuration for public, local, and private VM access
 Image mgt.: Complete system for trusted sharing of VM images
 Tools (python CLI) and APIs (Libcloud) to facilitate use of cloud
 Tools to facilitate installation of services
9
Service Details
10
Compute
Features
 Fast provisioning of virtual machines, with low latency start-up
 Availability of VM images of common operating systems
Contextualization
 HEPiX & OpenNebula CDROM contextualization by default
 CloudInit (disk based) also supported
Implementation
 API: XML-RPC interface of OpenNebula
 OpenNebula (C++, Ruby) with customized hooks
 Hooks primarily for caching, snapshots, and storage access
 CentOS, Ubuntu, OpenSuSE, Debian, Fedora, ScientificLinux images
created and supported by StratusLab
11
Storage
Features
 Volume abstraction for storage service
 Provide users with persistent storage for data
 Serves also as cache of images for VM instances
 (No file-based or object-based storage service)
Implementation
 API: Proprietary REST interface with CRUD actions
 Java-based service using MySQL database for state information
 Can use iSCSI or shared file system for physical storage
 Can use simple files or LVM volumes for disk content
12
Network
Features
 Support 3 specific use cases: public service (public),
batch system (local), and BOINC-like worker (private)
 Dynamic configuration of network switches not needed
 Use standard services for (virtual) machine network configuration
Implementation
 No API: manual, static configuration of network
 Rec. configuration: VLAN for cloud services separate VLAN for VMs
 All classes of IP addresses are optional, can create other classes
 Uses DHCP for VM network configuration
 Users responsible for protecting their machines
13
Marketplace & Image Handling
Priorities
 Mechanism for sharing and trusting images
 Possible to distribute fixed, read-only data sets as well
 Split the storage of image metadata and image contents
 Define roles for creator, user, administrator, and validator
Implementation
 Marketplace API: Proprietary REST API for create, read, search
 Marketplace acts as image registry and handles only metadata
 Image contents can be located on any public (web) server
 ‘Private’ images can also be held in cloud storage
14
Image Handling Workflow
15
Tools
Command Line Client
 Administrator: simplifies StratusLab installation
 Users: access StratusLab cloud from anywhere
Administration
 Quarantine for stopped virtual machines
 Monitoring of cloud activity and resources
Authentication and Authorization
 Supports username/password, certificates, cert. proxies
 Specification in local file and/or LDAP
16
Tools
Information from Developers
 Web site documentation and support mailing list
 Live tutorials (usually 2-3 per year)
 Workshops
17
Priorities for Evolution
Interfaces
 Adopt CIMI as the standard interface to services
 Provide Libcloud (python) driver for StratusLab
 Provide complete browser interface for all services
 Provide EC2 adaptor to REST interface
Simplicity, Scalability, & Robustness
 Direct use of libvirt as VM manager
 Distributed database (Couchbase) as information ‘bus’
Better services for system administrators
 Improved overview and monitoring of infrastructure
 Fine-grained accounts for all resources
 Migration control
18
Running Clouds in Production
19
StratusLab Deployments
Reference Cloud Services
 (~)Open infrastructures for using StratusLab and providing feedback
 Operated on a first-come, first-serve, best-effort basis
 In production 2+ years, with 250+ registered users
 Two sites: LAL (Orsay, France) and GRNET (Athens, Greece)
Other deployments…
 Academic: France, Ireland, UK, Vietnam, South Africa, …
 Commercial: Atos, Helix Nebula, …
Building on top…
 SlipStream from SixSq: cloud based systems deployment and testing
20
Cloud Experience at LAL
Private cloud for laboratory services
 Works well, plan to migrate all services including grid worker nodes
and experiment-specific servers
 Services switched to VMs without users being aware of change
 Very different way of working, need to change administrator habits
 Have seen some stability issues related to SL6 kernel/virtualization
Public cloud open to university
 Very positive reaction to cloud; LAL resources nearly 100% used
 Fields: biology, software eng., stats, astrophysics, bioinformatics, …
 After initial introduction, users require only low level of support
 Other labs offering StratusLab training without our direct involvement
21
Federated Clouds
22
Federation Models
Transparent Federation
 Site operators “outsource” to other providers
 Completely transparent to end users
 Difficult to achieve in practice because of data protection concerns and
network access/performance
Brokered Federation
 Variety of different cloud infrastructures are visible to users
 Users choose to place virtual machines in particular locations
 Simple clients can handle federation if differences are small
 Orchestrators are needed for larger differences between clouds
Both Helix Nebula and EGI take the brokered approach
23
SlipStream
Cloud orchestrator and deployment engine
 Facilitates testing, deployment, and maintenance of complex systems
 Transparent access
to multiple cloud
infrastructures
 Allows automated
deployment of systems
in one or more clouds
24
Conclusions
StratusLab Cloud Distribution
 Supported, stable, and production-quality IaaS cloud distribution
 Used for reference cloud service for 2+ years
 Other academic and commercial deployments
 Defined, ambitious roadmap for the its continued evolution
 Frequent administrator and user tutorials and workshops
StratusLab Collaboration
 New collaborators welcome! Developers and documenters!
 Weekly phone conference between developers
 Biannual StratusLab workshops
25
Questions and Discussion
website http://stratuslab.eu
twitter @StratusLab
support support@stratuslab.eu
StratusLab source http://github.com/StratusLab
SlipStream source http://github.com/slipstream
http://stratuslab.eu/
Copyright © 2013, Members of the StratusLab collaboration.
This work is licensed under the Creative Commons Attribution 3.0
Unported License (http://creativecommons.org/licenses/by/3.0/).

More Related Content

What's hot

ISC Cloud 2013 - Cloud Architectures for HPC – Industry Case Studies
 ISC Cloud 2013 - Cloud Architectures for HPC – Industry Case Studies ISC Cloud 2013 - Cloud Architectures for HPC – Industry Case Studies
ISC Cloud 2013 - Cloud Architectures for HPC – Industry Case Studies
OpenNebula Project
 
HPC Cloud Computing with OpenNebula
HPC Cloud Computing with OpenNebulaHPC Cloud Computing with OpenNebula
HPC Cloud Computing with OpenNebula
Ignacio M. Llorente
 
OpenNebula Interoperability and Portability DMTF 2011
OpenNebula Interoperability and Portability  DMTF 2011OpenNebula Interoperability and Portability  DMTF 2011
OpenNebula Interoperability and Portability DMTF 2011
Ignacio M. Llorente
 
Open nebula leading innovation in cloud computing management
Open nebula   leading innovation in cloud computing managementOpen nebula   leading innovation in cloud computing management
Open nebula leading innovation in cloud computing management
Ignacio M. Llorente
 
Innovation in cloud computing architectures with open nebula
Innovation in cloud computing architectures with open nebulaInnovation in cloud computing architectures with open nebula
Innovation in cloud computing architectures with open nebula
Ignacio M. Llorente
 
003 vm ware_whitepaper_screen
003 vm ware_whitepaper_screen003 vm ware_whitepaper_screen
003 vm ware_whitepaper_screen
Paulo R
 
Creating the open_cloud_wp_web2
Creating the open_cloud_wp_web2Creating the open_cloud_wp_web2
Creating the open_cloud_wp_web2
Srikanth Minnam
 

What's hot (20)

ISC Cloud 2013 - Cloud Architectures for HPC – Industry Case Studies
 ISC Cloud 2013 - Cloud Architectures for HPC – Industry Case Studies ISC Cloud 2013 - Cloud Architectures for HPC – Industry Case Studies
ISC Cloud 2013 - Cloud Architectures for HPC – Industry Case Studies
 
HPC Cloud Computing with OpenNebula
HPC Cloud Computing with OpenNebulaHPC Cloud Computing with OpenNebula
HPC Cloud Computing with OpenNebula
 
OpenNebula Interoperability and Portability DMTF 2011
OpenNebula Interoperability and Portability  DMTF 2011OpenNebula Interoperability and Portability  DMTF 2011
OpenNebula Interoperability and Portability DMTF 2011
 
Federated Cloud Computing
Federated Cloud ComputingFederated Cloud Computing
Federated Cloud Computing
 
About Nimbus Concept
About Nimbus ConceptAbout Nimbus Concept
About Nimbus Concept
 
Open nebula leading innovation in cloud computing management
Open nebula   leading innovation in cloud computing managementOpen nebula   leading innovation in cloud computing management
Open nebula leading innovation in cloud computing management
 
Innovation in cloud computing architectures with open nebula
Innovation in cloud computing architectures with open nebulaInnovation in cloud computing architectures with open nebula
Innovation in cloud computing architectures with open nebula
 
Tech Days 2010
Tech  Days 2010Tech  Days 2010
Tech Days 2010
 
Eucalyptus, Nimbus & OpenNebula
Eucalyptus, Nimbus & OpenNebulaEucalyptus, Nimbus & OpenNebula
Eucalyptus, Nimbus & OpenNebula
 
OpenStack - An Overview
OpenStack - An OverviewOpenStack - An Overview
OpenStack - An Overview
 
Introduction to Cloud and Eucalyptus
Introduction to Cloud and EucalyptusIntroduction to Cloud and Eucalyptus
Introduction to Cloud and Eucalyptus
 
003 vm ware_whitepaper_screen
003 vm ware_whitepaper_screen003 vm ware_whitepaper_screen
003 vm ware_whitepaper_screen
 
Creating the open_cloud_wp_web2
Creating the open_cloud_wp_web2Creating the open_cloud_wp_web2
Creating the open_cloud_wp_web2
 
cloud computing
cloud computingcloud computing
cloud computing
 
Building Clouds with OpenNebula2.2
Building Clouds with OpenNebula2.2Building Clouds with OpenNebula2.2
Building Clouds with OpenNebula2.2
 
Mobility and federation of Cloud computing
Mobility and federation of Cloud computingMobility and federation of Cloud computing
Mobility and federation of Cloud computing
 
Cloud computing using Eucalyptus
Cloud computing using EucalyptusCloud computing using Eucalyptus
Cloud computing using Eucalyptus
 
Research Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and ScienceResearch Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and Science
 
OpenStack Cloud Administration Through Live Demonstration
OpenStack Cloud Administration Through Live DemonstrationOpenStack Cloud Administration Through Live Demonstration
OpenStack Cloud Administration Through Live Demonstration
 
What is cloud computing
What is cloud computingWhat is cloud computing
What is cloud computing
 

Similar to StratusLab: Darn Simple Cloud

Ignacio design and building of iaa s clouds
Ignacio design and building of iaa s cloudsIgnacio design and building of iaa s clouds
Ignacio design and building of iaa s clouds
EuroCloud
 
Multi-Tenant SOA Middleware for Cloud Computing
Multi-Tenant SOA Middleware for Cloud ComputingMulti-Tenant SOA Middleware for Cloud Computing
Multi-Tenant SOA Middleware for Cloud Computing
Srinath Perera
 
Open Stack Cloud Services
Open Stack Cloud ServicesOpen Stack Cloud Services
Open Stack Cloud Services
Saurabh Gupta
 
Chetanya Dabi CLOUD COMPUTING PPT.pptx
Chetanya Dabi CLOUD COMPUTING PPT.pptxChetanya Dabi CLOUD COMPUTING PPT.pptx
Chetanya Dabi CLOUD COMPUTING PPT.pptx
ChetanyaDabi
 
A clear strategy for moving your enterprise to the cloud
A clear strategy for moving your enterprise to the cloudA clear strategy for moving your enterprise to the cloud
A clear strategy for moving your enterprise to the cloud
WSO2
 
Successfully deploy build manage your cloud with cloud stack2
Successfully deploy build manage your cloud with cloud stack2Successfully deploy build manage your cloud with cloud stack2
Successfully deploy build manage your cloud with cloud stack2
ke4qqq
 

Similar to StratusLab: Darn Simple Cloud (20)

Ignacio design and building of iaa s clouds
Ignacio design and building of iaa s cloudsIgnacio design and building of iaa s clouds
Ignacio design and building of iaa s clouds
 
Scientific Cloud Computing: Present & Future
Scientific Cloud Computing: Present & FutureScientific Cloud Computing: Present & Future
Scientific Cloud Computing: Present & Future
 
Delivering IaaS with Open Source Software
Delivering IaaS with Open Source SoftwareDelivering IaaS with Open Source Software
Delivering IaaS with Open Source Software
 
Multi-Tenant SOA Middleware for Cloud Computing
Multi-Tenant SOA Middleware for Cloud ComputingMulti-Tenant SOA Middleware for Cloud Computing
Multi-Tenant SOA Middleware for Cloud Computing
 
Cloud computing
Cloud computingCloud computing
Cloud computing
 
LinuxTag 2013
LinuxTag 2013LinuxTag 2013
LinuxTag 2013
 
Cloud Computing Standards and Use Cases (Robert Grossman) 09-v8p
Cloud Computing Standards and Use Cases (Robert Grossman) 09-v8pCloud Computing Standards and Use Cases (Robert Grossman) 09-v8p
Cloud Computing Standards and Use Cases (Robert Grossman) 09-v8p
 
Hybridní cloud s F5 v prostředí kontejnerů
Hybridní cloud s F5 v prostředí kontejnerůHybridní cloud s F5 v prostředí kontejnerů
Hybridní cloud s F5 v prostředí kontejnerů
 
Understanding Platform as a Service
Understanding Platform as a ServiceUnderstanding Platform as a Service
Understanding Platform as a Service
 
OSDC 2012 | OpenNebula Open Source Toolkit for DataCenter Virtualization by C...
OSDC 2012 | OpenNebula Open Source Toolkit for DataCenter Virtualization by C...OSDC 2012 | OpenNebula Open Source Toolkit for DataCenter Virtualization by C...
OSDC 2012 | OpenNebula Open Source Toolkit for DataCenter Virtualization by C...
 
Open Stack Cloud Services
Open Stack Cloud ServicesOpen Stack Cloud Services
Open Stack Cloud Services
 
Chetanya Dabi CLOUD COMPUTING PPT.pptx
Chetanya Dabi CLOUD COMPUTING PPT.pptxChetanya Dabi CLOUD COMPUTING PPT.pptx
Chetanya Dabi CLOUD COMPUTING PPT.pptx
 
Eucalyptus: Open Source for Cloud Computing
Eucalyptus: Open Source for Cloud ComputingEucalyptus: Open Source for Cloud Computing
Eucalyptus: Open Source for Cloud Computing
 
A proposal for implementing cloud computing in newspaper company
A proposal for implementing cloud computing in newspaper companyA proposal for implementing cloud computing in newspaper company
A proposal for implementing cloud computing in newspaper company
 
A clear strategy for moving your enterprise to the cloud
A clear strategy for moving your enterprise to the cloudA clear strategy for moving your enterprise to the cloud
A clear strategy for moving your enterprise to the cloud
 
Containers Anywhere with OpenShift by Red Hat
Containers Anywhere with OpenShift by Red HatContainers Anywhere with OpenShift by Red Hat
Containers Anywhere with OpenShift by Red Hat
 
Cloud computing
Cloud computingCloud computing
Cloud computing
 
Successfully deploy build manage your cloud with cloud stack2
Successfully deploy build manage your cloud with cloud stack2Successfully deploy build manage your cloud with cloud stack2
Successfully deploy build manage your cloud with cloud stack2
 
How to Think Multi-Cloud
How to Think Multi-CloudHow to Think Multi-Cloud
How to Think Multi-Cloud
 
OpenNebula - Open-source Enterprise Cloud Simplified - CeBIT March 2014
OpenNebula - Open-source Enterprise Cloud Simplified - CeBIT March 2014OpenNebula - Open-source Enterprise Cloud Simplified - CeBIT March 2014
OpenNebula - Open-source Enterprise Cloud Simplified - CeBIT March 2014
 

Recently uploaded

Breaking Down the Flutterwave Scandal What You Need to Know.pdf
Breaking Down the Flutterwave Scandal What You Need to Know.pdfBreaking Down the Flutterwave Scandal What You Need to Know.pdf
Breaking Down the Flutterwave Scandal What You Need to Know.pdf
UK Journal
 

Recently uploaded (20)

Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandUsing IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & Ireland
 
Breaking Down the Flutterwave Scandal What You Need to Know.pdf
Breaking Down the Flutterwave Scandal What You Need to Know.pdfBreaking Down the Flutterwave Scandal What You Need to Know.pdf
Breaking Down the Flutterwave Scandal What You Need to Know.pdf
 
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
 
AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentation
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
A Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyA Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System Strategy
 
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
 
IESVE for Early Stage Design and Planning
IESVE for Early Stage Design and PlanningIESVE for Early Stage Design and Planning
IESVE for Early Stage Design and Planning
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
 
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfHow Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
 
Easier, Faster, and More Powerful – Notes Document Properties Reimagined
Easier, Faster, and More Powerful – Notes Document Properties ReimaginedEasier, Faster, and More Powerful – Notes Document Properties Reimagined
Easier, Faster, and More Powerful – Notes Document Properties Reimagined
 
Your enemies use GenAI too - staying ahead of fraud with Neo4j
Your enemies use GenAI too - staying ahead of fraud with Neo4jYour enemies use GenAI too - staying ahead of fraud with Neo4j
Your enemies use GenAI too - staying ahead of fraud with Neo4j
 
ECS 2024 Teams Premium - Pretty Secure
ECS 2024   Teams Premium - Pretty SecureECS 2024   Teams Premium - Pretty Secure
ECS 2024 Teams Premium - Pretty Secure
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
 
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
 
AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101
 
Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024
 
What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
 

StratusLab: Darn Simple Cloud

  • 1. StratusLab: Darn Simple Cloud Charles (Cal) Loomis CNRS/LAL & SixSq Sàrl 29 May 2013
  • 2. 2 What is it?  Complete cloud distribution  Open source (Apache 2 license)  Works well for production private and public IaaS clouds Focus: Darn Simple Cloud  Simple to install on commodity hardware  Simple to use, from any client machine  Scales down as well as up! Infrastructure as a Service (IaaS) + Customized environment + Easy access to scalable resources − Variety of APIs and interfaces − Image creation is tedious − Geared towards single machines not full services StratusLab
  • 3. 3 State of the Art Provider: Amazon Web Services (AWS)  Leading and largest IaaS service provider  Improving and adding new services at a phenomenal rate  Almost all IaaS providers use AWS-like service semantics, but differentiate based on price, SLAs, location, etc. Commercial Cloud Distribution: VM-ware  Extremely good and complete  Very expensive, except for ESXi hypervisor (free) Open Source Cloud Distributions: Many!  Essentially none in 2007; now easily a dozen different distributions  StratusLab, …, OpenStack, OpenNebula, CloudStack  Very different levels of maturity, stability, scalability, etc.
  • 4. 4 Why are cloud technologies useful? Users  Custom environment: no more porting, revalidation of code  Simple access: use of REST and RPC over HTTP(S)  Reasonable cost: pay-as-you-go Administrators  Flexible management: separate mgt. of machines and services  Separation of responsibilities: Hardware / Services / Platforms / Users Resource Providers  Better utilization of shared resources  Federation (outsourcing) possible
  • 5. 5 Where did it start? Informal collaboration to investigate running grid services on Amazon EC2 (2007) StratusLab Project (6/2010 to 5/2012) co-funded by EC with 6 partners from 5 countries Open collaboration to continue the development and support of the StratusLab software Website: http://stratuslab.eu Twitter: @StratusLab Support: support@stratuslab.eu Source: http://github.com/StratusLab Identified need for open source cloud distribution. Production dist. with academic & commercial deployments.
  • 6. 6 Releases Post-Project Releases  V2.1 (16/10): Streamlined release; improved IO perf. with virtio drivers  V2.1.1 (29/11): Bug fixes; storage upload; better Windows support  V13.02 (31/1): Support for CloudInit contextualization and bug fixes  V13.05 (6/1?): Initial steps towards new architecture Release Policy  Quarterly timed releases (13.02, 13.05, …)  Intermediate bug fix releases as needed  Roadmap (6-month) available describing the StratusLab evolution Support Policy  Best-effort support for all recent releases, emphasis on latest
  • 8. 8 StratusLab Complete Infrastructure as a Service cloud distribution  Developed within EU project, software maintained by partners  Focus: Simple to install and simple to use Services  Compute: Virtual machine management (currently uses OpenNebula)  Storage: Volume-based storage service  Network: Simple configuration for public, local, and private VM access  Image mgt.: Complete system for trusted sharing of VM images  Tools (python CLI) and APIs (Libcloud) to facilitate use of cloud  Tools to facilitate installation of services
  • 10. 10 Compute Features  Fast provisioning of virtual machines, with low latency start-up  Availability of VM images of common operating systems Contextualization  HEPiX & OpenNebula CDROM contextualization by default  CloudInit (disk based) also supported Implementation  API: XML-RPC interface of OpenNebula  OpenNebula (C++, Ruby) with customized hooks  Hooks primarily for caching, snapshots, and storage access  CentOS, Ubuntu, OpenSuSE, Debian, Fedora, ScientificLinux images created and supported by StratusLab
  • 11. 11 Storage Features  Volume abstraction for storage service  Provide users with persistent storage for data  Serves also as cache of images for VM instances  (No file-based or object-based storage service) Implementation  API: Proprietary REST interface with CRUD actions  Java-based service using MySQL database for state information  Can use iSCSI or shared file system for physical storage  Can use simple files or LVM volumes for disk content
  • 12. 12 Network Features  Support 3 specific use cases: public service (public), batch system (local), and BOINC-like worker (private)  Dynamic configuration of network switches not needed  Use standard services for (virtual) machine network configuration Implementation  No API: manual, static configuration of network  Rec. configuration: VLAN for cloud services separate VLAN for VMs  All classes of IP addresses are optional, can create other classes  Uses DHCP for VM network configuration  Users responsible for protecting their machines
  • 13. 13 Marketplace & Image Handling Priorities  Mechanism for sharing and trusting images  Possible to distribute fixed, read-only data sets as well  Split the storage of image metadata and image contents  Define roles for creator, user, administrator, and validator Implementation  Marketplace API: Proprietary REST API for create, read, search  Marketplace acts as image registry and handles only metadata  Image contents can be located on any public (web) server  ‘Private’ images can also be held in cloud storage
  • 15. 15 Tools Command Line Client  Administrator: simplifies StratusLab installation  Users: access StratusLab cloud from anywhere Administration  Quarantine for stopped virtual machines  Monitoring of cloud activity and resources Authentication and Authorization  Supports username/password, certificates, cert. proxies  Specification in local file and/or LDAP
  • 16. 16 Tools Information from Developers  Web site documentation and support mailing list  Live tutorials (usually 2-3 per year)  Workshops
  • 17. 17 Priorities for Evolution Interfaces  Adopt CIMI as the standard interface to services  Provide Libcloud (python) driver for StratusLab  Provide complete browser interface for all services  Provide EC2 adaptor to REST interface Simplicity, Scalability, & Robustness  Direct use of libvirt as VM manager  Distributed database (Couchbase) as information ‘bus’ Better services for system administrators  Improved overview and monitoring of infrastructure  Fine-grained accounts for all resources  Migration control
  • 18. 18 Running Clouds in Production
  • 19. 19 StratusLab Deployments Reference Cloud Services  (~)Open infrastructures for using StratusLab and providing feedback  Operated on a first-come, first-serve, best-effort basis  In production 2+ years, with 250+ registered users  Two sites: LAL (Orsay, France) and GRNET (Athens, Greece) Other deployments…  Academic: France, Ireland, UK, Vietnam, South Africa, …  Commercial: Atos, Helix Nebula, … Building on top…  SlipStream from SixSq: cloud based systems deployment and testing
  • 20. 20 Cloud Experience at LAL Private cloud for laboratory services  Works well, plan to migrate all services including grid worker nodes and experiment-specific servers  Services switched to VMs without users being aware of change  Very different way of working, need to change administrator habits  Have seen some stability issues related to SL6 kernel/virtualization Public cloud open to university  Very positive reaction to cloud; LAL resources nearly 100% used  Fields: biology, software eng., stats, astrophysics, bioinformatics, …  After initial introduction, users require only low level of support  Other labs offering StratusLab training without our direct involvement
  • 22. 22 Federation Models Transparent Federation  Site operators “outsource” to other providers  Completely transparent to end users  Difficult to achieve in practice because of data protection concerns and network access/performance Brokered Federation  Variety of different cloud infrastructures are visible to users  Users choose to place virtual machines in particular locations  Simple clients can handle federation if differences are small  Orchestrators are needed for larger differences between clouds Both Helix Nebula and EGI take the brokered approach
  • 23. 23 SlipStream Cloud orchestrator and deployment engine  Facilitates testing, deployment, and maintenance of complex systems  Transparent access to multiple cloud infrastructures  Allows automated deployment of systems in one or more clouds
  • 24. 24 Conclusions StratusLab Cloud Distribution  Supported, stable, and production-quality IaaS cloud distribution  Used for reference cloud service for 2+ years  Other academic and commercial deployments  Defined, ambitious roadmap for the its continued evolution  Frequent administrator and user tutorials and workshops StratusLab Collaboration  New collaborators welcome! Developers and documenters!  Weekly phone conference between developers  Biannual StratusLab workshops
  • 25. 25 Questions and Discussion website http://stratuslab.eu twitter @StratusLab support support@stratuslab.eu StratusLab source http://github.com/StratusLab SlipStream source http://github.com/slipstream
  • 26. http://stratuslab.eu/ Copyright © 2013, Members of the StratusLab collaboration. This work is licensed under the Creative Commons Attribution 3.0 Unported License (http://creativecommons.org/licenses/by/3.0/).