Grupos de Trabajo RedIRIS
                            Valladolid, November 29th, 2011




        Interoperabilidad en OpenNebula

                                         Daniel Molina Aranda
                                             Project Engineer




Acknowledgments
                            The research leading to these results has received funding from the Ministerio de Industria, Turismo y
                            Comercio of Spain through research grant MITyC Avanza TSI-020301-2009-30


© OpenNebula Project. Creative Commons Attribution-NonCommercial-ShareAlike License                                                  1/18
Contents
OpenNebula Interoperability and Portability!



● What is Cloud Computing?
● What is OpenNebula?
● Challenges for Portability and Interoperability?
● Our Approach for Interoperability and Portability
● Some Examples of Community Collaborations




OpenNebula Interoperability and Portability           2/18
What is Cloud Computing?
Types of Cloud Services for Provision of IT Capabilities as a Service!
                                                  What                       Who
                                               On-demand                   End-user
     Software as a Service
                                              access to any     (does not care about hw or sw)
                                               application



                                               Platform for               Developer
       Platform as a Service                   building and    (no managing of the underlying hw
                                              delivering web             & sw layers)
                                               applications




        Infrastructure as a                   Raw computer           System Administrator
                  ᄎ
              Service
                                              infrastructure     (complete management of the
                                                                    computer infrastructure)




        Physical Infrastructure

OpenNebula Interoperability and Portability                                                      3/18
What is Cloud Computing?
Provision of Virtualized Resources as a Service!



                                                               •  Raw infrastructure
                 •  Management Console                            resources
                 •  Simple REST API’s




                  Manage
                 Instances




                                              •  Pay-as-you-go & elastic capacity



OpenNebula Interoperability and Portability                                            4/18
What is OpenNebula?
IaaS Cloud Computing Tool for Managing a Data Center's Virtual Infrastructure!

                                                   Interfaces & API
                                              • CLI (local/remote)
                                              • API (java, ruby bindings)
                                              • Sunstone
                                              • Cloud (EC2, OCCI)

 VM Networking
 • VLANs                                                                    Image Repository of VM disks
 • Firewall hooks                                                           • ACLs (public + private)
 • User defined                                                             • OS and Data types (persistent)
                                                                            • Multiple storage backends
                                                       Users & Roles




         Hosts: Cluster worker nodes to run VMs.                                 Storage
                                                                                 • NAS
         • Multiple hypervisors defined per host
                                                                                 • SAN
         • Grouped in logical clusters
                                                                                 • Custom (bittorrent, ssh…)
         • Custom monitoring probes and technologies
OpenNebula Interoperability and Portability                                                                5/18
What is OpenNebula?
Building the Industry Standard Open Source Cloud Computing Tool!

                                                           Third party scalability
  •  evelop & innovate
   D                                                       tests: 16000 VMs
  •  upport the community
   S
  •  ollaborate
   C                                                                  Commercial Support


                      TP
                                v1.0             v1.2   v1.4        v2.0      v2.2 V3.0


2005              2008                        2009        2010             2011         2012
 dsa group doing
   research…


                                                                           4,000 downloads/
                                                                                month
                                 European Funding
OpenNebula Interoperability and Portability                                                    6/18
Who Use OpenNebula?
Organizations Building Clouds and Innovative Projects!

        Organizations Building Clouds for Development, Testing and Production




              Projects Building an Open Cloud Ecosystem Around OpenNebula




                               16,000 VMs!




OpenNebula Interoperability and Portability                                     7/18
The Challenges
Transparent Combination of Local Resources with Cloud Resources with No Changes!

   1. Management Interfaces                                   2. Management Interfaces
     for Virtual Workloads                                      for Data Elements



                         VM


                                   VM         VM                    VM      VM


                                                                            4. Contextualization


                                                       3. VM Image Description
        5. Management of Cross-site
           Networking
                                                   6. Common Execution Framework
                                                     (Instance Type, QoS and Security)
OpenNebula Interoperability and Portability                                                    8/18
Our Approach
Leveraging Existing Standards and Implementing Interoperation!


       Standardization
       ● Implement standards
       ● Integrate with standards




       Which Standard?
       ● Different de jure standards
       ● Several de facto standards




        Interoperation
         ● Implement adaptors
         ● Use transformers


OpenNebula Interoperability and Portability                      9/18
Our Approach
A Quickly Growing Ecosystem for Interoperability and Portability!


   Ecosystem


                                              OVF   CDMI




                                                           Ecosystem



    Ecosystem




New OpenNebula Working Group!
OpenNebula Interoperability and Portability                            10/18
Some Examples of Community Collaborations
OCCI & CDMI for OpenNebula by GWDG!
Development of OCCI 1.1 Framework for OpenNebula 3.0
● Advanced integration of CDMI into OpenNebula
● Participation in OGF OCCI WG and in DMTF CMWG

Upcoming features
● Rewrite in Ruby on Rails with focus on quality, scalability and extendibility
● Advanced authentication (X.509, Shibboleth, OpenID)
● Sync up with Contrail project to support OVF
● Support for SLAs based on SLA@SOI project




                              http://dev.opennebula.org/projects/ogf-occi
OpenNebula Interoperability and Portability                                   11/18
Some Examples of Community Collaborations
Contrail – Open Computing Infrastructure for Elastic Services!

Development of OVF 1.1.0 for OpenNebula 3.0
● The Contrail project aims to develop tools for
  creating and managing a federation of private
  and public clouds
● Contrail uses OVF for distributed applications
Contributions to OpenNebula
● OVF translation tool enabling deployment of
  applications over OpenNebula IaaS clouds




                        http://contrail-project.eu
OpenNebula Interoperability and Portability                      12/18
Some Examples of Community Collaborations
StratusLab - Enhancing Grid Infrastructures with Cloud Computing !

Using OCCI for Federation and Developing jclouds
● Simplify and optimize its use and operation, providing a more flexible,
  dynamic environment for scientists; and enhance existing computing
  infrastructures with “IaaS” paradigms




                                              www.stratuslab.org

                                               www.StratusLab.eu

OpenNebula Interoperability and Portability                                 13/18
Some Examples of Community Collaborations
CompatibleOne – Cloud Brokering Service!

Using OCCI for Federation




OpenNebula Interoperability and Portability   14/18
Some Examples of Community Collaborations
BonFIRE - Building Service Testbeds on FIRE!

Using OCCI for Federation
● Design, build and operate a multi-site cloud-based facility to support
  research across applications, services and systems targeting services
  research community on Future Internet




                                              www.BonFIRE-Project.eu
OpenNebula Interoperability and Portability                                15/18
Some Examples of Community Collaborations
MEGHA– Spanish R&E Intercloud Initiative !

Using OCCI for Federation
● Interoperable federated clouds platform to streamline the use of cloud
  technologies among R&E services centers and provide support to
  integrate new technologies and infrastructures over cloud
Infrastructure
● 3 OpenNebula geographical dispersed instances
● +300 distributed cores +25TB
● Network, security and identity support




                                 http://wiki.rediris.es/megha/MainPage
OpenNebula Interoperability and Portability                                16/18
Questions?
We Will Be Happy to Answer Any Question !




                                   The research leading to these results has received funding from the Ministerio de Industria, Turismo y
                                   Comercio of Spain through research grant MITyC Avanza TSI-020301-2009-30

OpenNebula Interoperability and Portability                                                                                             17/18

OpenNebula Interoperability

  • 1.
    Grupos de TrabajoRedIRIS Valladolid, November 29th, 2011 Interoperabilidad en OpenNebula Daniel Molina Aranda Project Engineer Acknowledgments The research leading to these results has received funding from the Ministerio de Industria, Turismo y Comercio of Spain through research grant MITyC Avanza TSI-020301-2009-30 © OpenNebula Project. Creative Commons Attribution-NonCommercial-ShareAlike License 1/18
  • 2.
    Contents OpenNebula Interoperability andPortability! ● What is Cloud Computing? ● What is OpenNebula? ● Challenges for Portability and Interoperability? ● Our Approach for Interoperability and Portability ● Some Examples of Community Collaborations OpenNebula Interoperability and Portability 2/18
  • 3.
    What is CloudComputing? Types of Cloud Services for Provision of IT Capabilities as a Service! What Who On-demand End-user Software as a Service access to any (does not care about hw or sw) application Platform for Developer Platform as a Service building and (no managing of the underlying hw delivering web & sw layers) applications Infrastructure as a Raw computer System Administrator ᄎ Service infrastructure (complete management of the computer infrastructure) Physical Infrastructure OpenNebula Interoperability and Portability 3/18
  • 4.
    What is CloudComputing? Provision of Virtualized Resources as a Service! •  Raw infrastructure •  Management Console resources •  Simple REST API’s Manage Instances •  Pay-as-you-go & elastic capacity OpenNebula Interoperability and Portability 4/18
  • 5.
    What is OpenNebula? IaaSCloud Computing Tool for Managing a Data Center's Virtual Infrastructure! Interfaces & API • CLI (local/remote) • API (java, ruby bindings) • Sunstone • Cloud (EC2, OCCI) VM Networking • VLANs Image Repository of VM disks • Firewall hooks • ACLs (public + private) • User defined • OS and Data types (persistent) • Multiple storage backends Users & Roles Hosts: Cluster worker nodes to run VMs. Storage • NAS • Multiple hypervisors defined per host • SAN • Grouped in logical clusters • Custom (bittorrent, ssh…) • Custom monitoring probes and technologies OpenNebula Interoperability and Portability 5/18
  • 6.
    What is OpenNebula? Buildingthe Industry Standard Open Source Cloud Computing Tool! Third party scalability •  evelop & innovate D tests: 16000 VMs •  upport the community S •  ollaborate C Commercial Support TP v1.0 v1.2 v1.4 v2.0 v2.2 V3.0 2005 2008 2009 2010 2011 2012 dsa group doing research… 4,000 downloads/ month European Funding OpenNebula Interoperability and Portability 6/18
  • 7.
    Who Use OpenNebula? OrganizationsBuilding Clouds and Innovative Projects! Organizations Building Clouds for Development, Testing and Production Projects Building an Open Cloud Ecosystem Around OpenNebula 16,000 VMs! OpenNebula Interoperability and Portability 7/18
  • 8.
    The Challenges Transparent Combinationof Local Resources with Cloud Resources with No Changes! 1. Management Interfaces 2. Management Interfaces for Virtual Workloads for Data Elements VM VM VM VM VM 4. Contextualization 3. VM Image Description 5. Management of Cross-site Networking 6. Common Execution Framework (Instance Type, QoS and Security) OpenNebula Interoperability and Portability 8/18
  • 9.
    Our Approach Leveraging ExistingStandards and Implementing Interoperation! Standardization ● Implement standards ● Integrate with standards Which Standard? ● Different de jure standards ● Several de facto standards Interoperation ● Implement adaptors ● Use transformers OpenNebula Interoperability and Portability 9/18
  • 10.
    Our Approach A QuicklyGrowing Ecosystem for Interoperability and Portability! Ecosystem OVF CDMI Ecosystem Ecosystem New OpenNebula Working Group! OpenNebula Interoperability and Portability 10/18
  • 11.
    Some Examples ofCommunity Collaborations OCCI & CDMI for OpenNebula by GWDG! Development of OCCI 1.1 Framework for OpenNebula 3.0 ● Advanced integration of CDMI into OpenNebula ● Participation in OGF OCCI WG and in DMTF CMWG Upcoming features ● Rewrite in Ruby on Rails with focus on quality, scalability and extendibility ● Advanced authentication (X.509, Shibboleth, OpenID) ● Sync up with Contrail project to support OVF ● Support for SLAs based on SLA@SOI project http://dev.opennebula.org/projects/ogf-occi OpenNebula Interoperability and Portability 11/18
  • 12.
    Some Examples ofCommunity Collaborations Contrail – Open Computing Infrastructure for Elastic Services! Development of OVF 1.1.0 for OpenNebula 3.0 ● The Contrail project aims to develop tools for creating and managing a federation of private and public clouds ● Contrail uses OVF for distributed applications Contributions to OpenNebula ● OVF translation tool enabling deployment of applications over OpenNebula IaaS clouds http://contrail-project.eu OpenNebula Interoperability and Portability 12/18
  • 13.
    Some Examples ofCommunity Collaborations StratusLab - Enhancing Grid Infrastructures with Cloud Computing ! Using OCCI for Federation and Developing jclouds ● Simplify and optimize its use and operation, providing a more flexible, dynamic environment for scientists; and enhance existing computing infrastructures with “IaaS” paradigms www.stratuslab.org www.StratusLab.eu OpenNebula Interoperability and Portability 13/18
  • 14.
    Some Examples ofCommunity Collaborations CompatibleOne – Cloud Brokering Service! Using OCCI for Federation OpenNebula Interoperability and Portability 14/18
  • 15.
    Some Examples ofCommunity Collaborations BonFIRE - Building Service Testbeds on FIRE! Using OCCI for Federation ● Design, build and operate a multi-site cloud-based facility to support research across applications, services and systems targeting services research community on Future Internet www.BonFIRE-Project.eu OpenNebula Interoperability and Portability 15/18
  • 16.
    Some Examples ofCommunity Collaborations MEGHA– Spanish R&E Intercloud Initiative ! Using OCCI for Federation ● Interoperable federated clouds platform to streamline the use of cloud technologies among R&E services centers and provide support to integrate new technologies and infrastructures over cloud Infrastructure ● 3 OpenNebula geographical dispersed instances ● +300 distributed cores +25TB ● Network, security and identity support http://wiki.rediris.es/megha/MainPage OpenNebula Interoperability and Portability 16/18
  • 17.
    Questions? We Will BeHappy to Answer Any Question ! The research leading to these results has received funding from the Ministerio de Industria, Turismo y Comercio of Spain through research grant MITyC Avanza TSI-020301-2009-30 OpenNebula Interoperability and Portability 17/18