This presentation discusses innovation in cloud computing architectures using OpenNebula. It provides an overview of OpenNebula's positioning in the cloud ecosystem as an infrastructure as a service (IaaS) solution. It then covers challenges from different perspectives including users, infrastructure managers, business managers, and system integrators. It discusses designing a cloud infrastructure based on requirements and building a cloud using OpenNebula's features to enable private, public, and hybrid clouds.
Federated Cloud Computing - The OpenNebula Experience v1.0sIgnacio M. Llorente
The talk mostly focuses on private cloud computing to support Science and High Performance Computing environments, the different architectures to federate cloud infrastructures, the existing challenges for cloud interoperability, and the OpenNebula's vision for the future of existing Grid infrastructures.
Federated Cloud Computing - The OpenNebula Experience v1.0sIgnacio M. Llorente
The talk mostly focuses on private cloud computing to support Science and High Performance Computing environments, the different architectures to federate cloud infrastructures, the existing challenges for cloud interoperability, and the OpenNebula's vision for the future of existing Grid infrastructures.
The presentation describes the different cloud federation scenarios, ranging from a federation built on commercial cloud providers that offer no real support for federation to one built on data centers of the same organization where the sites are completely dedicated to supporting all aspects of federation. The level of federation is defined based on the amount of information disclosed and how much control over the resources is provided across sites. The talk also presents the existing challenges for interoperability in federated and hybrid cloud computing scenarios, and ends with real-life examples of multi-cloud environments running OpenNebula.
Back that *aa s up – bridging multiple clouds for bursting and redundancyRightScale
Back that *aaS up – Bridging Multiple Clouds for Bursting and Redundancy
Peder Ulander, VP of Product Marketing, Cloud Platform Group, Citrix Systems
Bridging multiple cloud computing environments allows enterprises to plan for peak usage even while only building capacity for today’s needs. Using CloudStack, CloudBridge and RightScale can enable Enterprise IT to extend resource pools beyond physical datacenter boundaries and leverage additional private clouds or public clouds to meet peak usage requirements and smoothly manage planned or unplanned capacity spikes.
En dynamisk infrastruktur stiller krav om hybride løsninger med et centraliseret system management. Derfor udgør IBM System z et væsentligt element i en Cloud-løsning. Lær hvordan, man håndterer en dynamisk infrastruktur i skyen.
Læs mere her: bit.ly/softwaredagsystemz3
Bringing Private Cloud Computing to HPC and Science - Berkeley Lab - July 2014 OpenNebula Project
Berkeley Lab – Computing Sciences Seminar
HPC-optimized clouds provide access to flexible and elastic scientific and technical computing to solve complex problems and drive innovation. The talk will describe the most demanded features for building HPC and science clouds, and will illustrate using real-life case studies from leading research and industry organizations how OpenNebula effectively addresses these challenges of cloud usage, scheduling, security, networking and storage. The keynote will end with a view of private cloud's future in HPC and science, and grid as the foundation of cloud federation.
Cloud and Virtualization (Using Virtualization to form Clouds)Rubal Sagwal
-Cloud
-Underlying technology pieces from which cloud computing -Infrastructure is built
-Characteristics of Cloud
-Types of cloud services (SaaS, IaaS and PaaS)
-Cloud deployment models
-Virtualization
-Using Virtualization to form Clouds
This PPT covers the following topics...
Definition’s
CC in a Nutshell
Roots of CC
Layers and Types of Clouds
Desired Features of Cloud
Cloud Infrastructure Management
Infrastructure as a Service Providers
Platform as a Service Providers
Challenge and Risks
The presentation describes the different cloud federation scenarios, ranging from a federation built on commercial cloud providers that offer no real support for federation to one built on data centers of the same organization where the sites are completely dedicated to supporting all aspects of federation. The level of federation is defined based on the amount of information disclosed and how much control over the resources is provided across sites. The talk also presents the existing challenges for interoperability in federated and hybrid cloud computing scenarios, and ends with real-life examples of multi-cloud environments running OpenNebula.
Back that *aa s up – bridging multiple clouds for bursting and redundancyRightScale
Back that *aaS up – Bridging Multiple Clouds for Bursting and Redundancy
Peder Ulander, VP of Product Marketing, Cloud Platform Group, Citrix Systems
Bridging multiple cloud computing environments allows enterprises to plan for peak usage even while only building capacity for today’s needs. Using CloudStack, CloudBridge and RightScale can enable Enterprise IT to extend resource pools beyond physical datacenter boundaries and leverage additional private clouds or public clouds to meet peak usage requirements and smoothly manage planned or unplanned capacity spikes.
En dynamisk infrastruktur stiller krav om hybride løsninger med et centraliseret system management. Derfor udgør IBM System z et væsentligt element i en Cloud-løsning. Lær hvordan, man håndterer en dynamisk infrastruktur i skyen.
Læs mere her: bit.ly/softwaredagsystemz3
Bringing Private Cloud Computing to HPC and Science - Berkeley Lab - July 2014 OpenNebula Project
Berkeley Lab – Computing Sciences Seminar
HPC-optimized clouds provide access to flexible and elastic scientific and technical computing to solve complex problems and drive innovation. The talk will describe the most demanded features for building HPC and science clouds, and will illustrate using real-life case studies from leading research and industry organizations how OpenNebula effectively addresses these challenges of cloud usage, scheduling, security, networking and storage. The keynote will end with a view of private cloud's future in HPC and science, and grid as the foundation of cloud federation.
Cloud and Virtualization (Using Virtualization to form Clouds)Rubal Sagwal
-Cloud
-Underlying technology pieces from which cloud computing -Infrastructure is built
-Characteristics of Cloud
-Types of cloud services (SaaS, IaaS and PaaS)
-Cloud deployment models
-Virtualization
-Using Virtualization to form Clouds
This PPT covers the following topics...
Definition’s
CC in a Nutshell
Roots of CC
Layers and Types of Clouds
Desired Features of Cloud
Cloud Infrastructure Management
Infrastructure as a Service Providers
Platform as a Service Providers
Challenge and Risks
Cloud Computing Architecture with Open Nebula - HPC Cloud Use Cases - NASA A...Ignacio M. Llorente
OpenNebula is a fully open-source cloud management platform, with excellent performance and scalability to manage tens of thousands of virtual machines, and with the most advanced functionality for building virtualized enterprise data centers and private cloud infrastructures. OpenNebula is the result of many years of research and development in efficient and scalable management of virtual machines on large-scale distributed infrastructures. Its innovative features have been developed to address the requirements of business use cases from leading companies in the context of flagship international projects in cloud computing. OpenNebula is being used by many supercomputing and leading research centers to build HPC and science clouds for hosting virtualized computational environments, such as batch farms and computing clusters, or for providing users with new "HPC as a service" resource provisioning models. The talk describes how to design a cloud architecture with OpenNebula and its innovative features to enable the execution of flexible and elastic cluster and high performance computing services on demand while reducing the associated cost of building the datacenter infrastructure.
2. Position in the Cloud Ecosystem
Innovation in Cloud Computing Architectures with OpenNebula
What Who
Software as a Service
On-demand End-user
access to any (does not care about hw or sw)
application
Platform as a Service Platform for Developer
building and (no managing of the
delivering web underlying hw & swlayers)
applications
Infrastructure as a Raw computer System Administrator
ᄎ
Service infrastructure (complete management of the
computer infrastructure)
Innovative open, flexible and scalable
technology to configure your own
IT resources into a IaaS cloud
Physical Infrastructure
2/24
3. Transforming your IT Infrastructure into a Cloud
Innovation in Cloud Computing Architectures with OpenNebula
Commercial Cloud Provider
• Flexible and elastic capacity to meet dynamic
demands of service
• Ubiquitous network access
• Pay per use and on-demand access
Building your Own Cloud
• Optimize and Simplify Internal Operations
• Centralized management of all servers and services with dynamic
resizing of infrastructure and dynamic allocation of capacity
• Higher utilization and operational saving of existing resources
with server consolidation and removal of application silos
• Lower infrastructure expenses with combination of local and
remote Cloud resources
• Support new IT, scientific, or business Cloud services
3/24
4. Deployment Models
Innovation in Cloud Computing Architectures with OpenNebula
Model Definition Examples of Deployment
Infrastructure is owned • Optimize and simplify internal operation
Private
by a single organization • SaaS/PaaS support
and made available • IT consolidation within large organizations
only to the organization (Goverment Clouds, University Clouds…)
Infrastructure is owned • Commercial clouds providers
by a single organization • Special purpose clouds with dedicated
and made available to capabilities (HPC Clouds…)
Public
other organizations • Regional clouds to address regulatory or
latency issues
• Community public clouds (Science
Clouds…) to enable scientific and
educational projects to experiment with
cloud computing
Infrastructure is a • Cloudbursting to address peak demands
Hybrid
composition of two or • Cloud Federation to share infrastructure
more clouds with partners
• Cloud Aggregation to provide a larger
resource infrastructure
4/24
5. Contents
Innovation in Cloud Computing Architectures with OpenNebula
Challenges from Deployment and Usage Scenarios
User and Infrastructure Business System
Workloads Managers Managers Integrators
Designing a Cloud Infrastructure
Anatomy of a Cloud Architecture
Building a Cloud Infrastructure
OpenNebula as Cloud Enabler
5/24
6. Challenges: The User Perspective
Innovation in Cloud Computing Architectures with OpenNebula
Required Functionality
• Cloud interface and CLI to manage virtual machines, network and storage
• Support for popular interfaces (Amazon EC2)
Profile of Service Workloads
• Multi-tier service as basic management entity
• Compute, storage and network capacity
• Level of coupling between service instances
• Security constraints
• Variability of the demand
• Elasticity of the services
Service as Groups of VMs
• Service components in VMs
• Inter-connection relationship
• Placement constraints
6/24
7. Challenges: The Manager Perspective
Cloud Computing from an Institutional Perspective
Flexible, Efficient and Scalable Management of the Cloud
• Administration interface for the centralized management of the cloud
• Support for the definition of workload and resource-aware allocation policies
such as consolidation (energy efficiency), load balancing, affinity-aware,
capacity reservation, live migration…
• Support any storage, networking and virtualization infrastructure service
• Integration with existing processes and management tools in the data center
• Management of several clusters to address different workloads
Scalable back-end
• Virtualization
• Storage
Physical Infrastructure • Networking
7/24
8. Challenges: The Business Perspective
Innovation in Cloud Computing Architectures with OpenNebula
Hybrid Cloud Computing and Federation
• Cloudbursting at infrastructure layer, fully transparent to users
• Scale-out decisions are taken by infrastructure administrators according to
business policies
Two levels of Collaboration
• Extend the private cloud using both
partner and commercial clouds
• Create a federation of clouds
Nimbus
8/24
9. Challenges: The Integrator Perspective
Innovation in Cloud Computing Architectures with OpenNebula
Open Architecture, Interfaces and Code
• Integration with any product and service in the virtualization/cloud ecosystem
such as cloud providers, hypervisors, virtual image managers, service
managers, management tools, schedulers…
• Support to build any type of deployment: private, public, hybrid and
community clouds
• Easy to enhance to support new functionality
• Easy to embed into other Cloud applications and platforms
• Liberal open-source license
9/24
10. Designing a Cloud: A Design Driven by Requirements
Innovation in Cloud Computing Architectures with OpenNebula
Requirements from Use Cases and
Deployment Scenarios
“One solution does not fit all
requirements and constraints, a
properly architectured solution should
fully align with your Cloud strategy”
Constraints from Existing
Infrastructure and Processes in
the Organization
10/24
11. Designing a Cloud: Anatomy of a Cloud Architecture
Innovation in Cloud Computing Architectures with OpenNebula
Cloud User/
Service End-Users
Service Provider
VIRTUAL INFRASTRUCTURE Cloud
Interface
Adm Interface
Cloud Management System
Virtual Machine Managers
Schedluer
Physical Storage Physical Machines Physical Networking
PHYSICAL INFRASTRUCTURE
Hybrid
11/24
12. Designing a Cloud: Design Parameters for Components
Innovation in Cloud Computing Architectures with OpenNebula
Component Design Parameters Requirements of Use Cases and
Constraints from Infrastructure
Physical • Memory and CPU per server • Memory/CPU requirements of service
Machines • Number and scalability of servers instances
• Hardware virtualization support • Elasticity of services
Physical • Latency/bandwidth per network • Level of coupling between service instances
Network • Number and scalability of networks
Physical • Size, scalability, latency and • Live migration
Storage throughout • Scalability of the cluster
• Organization: DAS/SAN/NAS • Performance
Clusters • Number of clusters • Workloads with different execution profiles
• Scalability in one cluster
Virtual • Hypervisors • Overhead in service instances
Machine • Licensing
Manager
Interfaces • Administration interface • Required functionality
• Cloud interface • Compatibility with existing interfaces
Scheduler • Allocation Policies • Energy efficiency, load balancing, affinity-
aware, capacity reservation, live migration…
Hybrid • Cloudbursting • Fluctuating demands
• Federation • Security constraints
• Level of coupling between service instances
12/24
13. Designing a Cloud: Flexible Cloud Manager as Enabler
Innovation in Cloud Computing Architectures with OpenNebula
Cloud Manager to Orchestrate Cloud Infrastructure Complexity
• Management of network, computing, remote cloud and storage capacity
• Management of virtual network, machine and storage life-cycles
• Workload placement and management of VM images
• Management of information, accounting and security
• Interfacing with any infrastructure service
Virt.
Virt. Virt.
Virt.
Interfaces Schedulers
OpenNebula API
OpenNebula Core
Driver API
Virt.
Virt. Virt.
Virt. Virt.
Virt. Virt.
Virt.
Compute Storage Network Cloud
13/24
14. Building a Cloud: OpenNebula as Cloud Enabler
Innovation in Cloud Computing Architectures with OpenNebula
Innovations
Technology challenges in cloud computing management from
business use cases
Open-source Toolkit
OpenNebula v1.4
• Open and flexible tool to fit into any datacenter and
integrate with any ecosystem component
• Open-source released under Apache v2.0, and
VM
distributed in Ubuntu
VM • Most advanced solution to build private, public,
federated and hybrid clouds
VM
• Based on standards avoid vendor lock-in and to
enable interoperability
• Efficient and scalable management of the cloud
14/24
15. Building a Cloud: Features for Private Clouds
Innovation in Cloud Computing Architectures with OpenNebula
Admin Scheduler
OpenNebula
Physical Infrastructure
Feature Function
Internal Interface • Unix-like CLI for fully management of VM life-cycle and resources
• XML-RPC API and libvirt virtualization API
Scheduler • Requirement/rank matchmaker allowing the definition of workload
and resource-aware allocation policies
• Support for advance reservation of capacity through Haizea
Virtualization Management • Xen, KVM, and VMware
Image Management • General mechanisms to transfer and clone VM images
Network Management • Definition of isolated virtual networks to interconnect VMs
Service Management and • Support for multi-tier services consisting of groups of inter-
Contextualization connected VMs, and their auto-configuration at boot time
15/24
16. Building a Cloud: Features for Public Clouds
Innovation in Cloud Computing Architectures with OpenNebula
Infrastructure
Users
Cloud API
Feature Function
Cloud Interfaces for • Implementation of a subset of the EC2 Query API and OGF - OCCI
Users
Flexibility • The Cloud Service allows the implementation of new Cloud interfaces
16/24
17. Building a Cloud: Features for Hybrid Clouds
Innovation in Cloud Computing Architectures with OpenNebula
Admin Scheduler
OpenNebula
Physical Infrastructure
Feature Function
Cloud Plugins • Amazon EC2 and ElasticHosts connectors
Federation • Support for simultaneous access to several remote clouds
Flexibility • Modular approach to develop new connectors
17/24
18. Building a Cloud: Ecosystem
Innovation in Cloud Computing Architectures with OpenNebula
Open Community for Cloud Computing
• Haizea Lease Manager (University of Chicago): Advance reservation of
capacity and queuing of best effort requests
• Cloud Management Console (SARA Computing and Networking Services):
Web interface for OpenNebula
• Virtual Cluster Tool (CRS4 Distributed Computing Group): Atomic virtual
cluster management with versioning and multiple transport protocols.
• DeltaCloud Driver (DSA-Research@UCM)
• RESERVOIR Policy Engine (IBM Haifa/Elsag Datamat): Policy-driven
probabilistic admission control and dynamic placement optimization to satisfy
site level management policies
• VM Consolidation Scheduler (DSA-Research@UCM): Periodic re-placement
of VMs for server consolidation and suspension/resume of physical resources
• Claudia (Telefonica I+D): SLA-driven automatic service management
• Under Development: SUN Cloud API, vCloud API, VirtualBox plugin, dashboard
for infrastructure management, new schedulers, SLA and security framework,
Grid service manager, LVM and SAN support,…
18/24
19. Building a Cloud: Users
Innovation in Cloud Computing Architectures with OpenNebula
Users (Different Levels of Use: From Experimental to Production)
19/24
20. Building a Cloud: Innovative Projects
Innovation in Cloud Computing Architectures with OpenNebula
Innovative Projects on Cloud Computing
Resources and Services Virtualization without Barriers
EU grant agreement 215605 • Open source technology to enable deployment and
Service and Sw Architectures management of complex IT services across different
and Infrastructures administrative domains
(2008-2011)
Enhancing Grid Infrastructures with Cloud Computing
• Simplify and optimize its use and operation, providing a
more flexible, dynamic computing environment for
Proposal in negotiation
e-Infrastructure scientists.
(2010-2012) • Enhance existing computing infrastructures with “IaaS”
paradigms
Building Service Testbeds on FIRE
• Design, build and operate a multi-site cloud-based facility to
Proposal in negotiation
support research across applications, services and systems
New Infrastructure Paradigms targeting services research community on Future Internet
and Experimental Facilities
(2010-2013)
20/24
21. Building a Cloud: Innovative Projects
Innovation in Cloud Computing Architectures with OpenNebula
www.reservoir-fp7.eu
Telco Utility eGov SAP
Commercial Service Managers
Service Provider
Service Provider
Service Provider
SMI
Service Manager
AWS
VMI
VMI VEE Manager
VHI
Source: RESERVOIR Project
VEE Host
VEE Host
VEE Host
Commercial Infrastructure Provider
21/24
22. OpenNebula as Building Block within Future Clouds
Innovation in Cloud Computing Architectures with OpenNebula
IT Resources will be the Next Utility
• Future enterprise datacenters will look like private Clouds supporting a
flexible and agile execution of virtualized services, and combining local with
public Cloud-based infrastructure to enable highly scalable hosting
environments
• Growing number of domain specific and regional Cloud providers
implementing a utility computing business model by offering pay per use
resources on-demand
• Public Clouds will be supported by a network of geographically
distributed datacenters for high availability, end-user service proximity, legal
and policy issues…
• Public Clouds will be interconnected to meet fluctuating demands
• Grid sites will offer infrastructure cloud-like interfaces to address the new
resource access demands from the community
22/24
23. Thanks
Funding Agencies
• European Union: RESERVOIR 2008-2011, EU grant agreement 215605
• Ministry Science&Innovation: HPCcloud 2010-2012, MICINN
TIN2009-07146
• Community of Madrid: MEADIANET 2010-2013 CAM S2009/TIC-1468
The OpenNebula Community
• The OpenNebula Team: Ignacio M. Llorente, Ruben S. Montero, Tino Vazquez,
Javier Fontan, Jaime Melis, Carlos Martín, Rafael Moreno, Daniel Molina, and
Borja Sotomayor
• … and many value community contributors from several organizations
Your support and contribution are very much appreciated!
23/24
24. More Information
More info, downloads, mailing lists at
Research References
• B. Rochwerger, J. Caceres, R.S. Montero,D. Breitgand,E. Elmroth,A. Galis,E. Levy,I.M.
Llorente,K. Nagin,Y. Wolfsthal, “The RESERVOIR Model and Architecture for Open
Federated Cloud Computing”, IBM Systems Journal, Vol. 53, No. 4. (2009)
• B. Sotomayor, R. S. Montero, I. M. Llorente and I. Foster, “Virtual Infrastructure
Management in Private and Hybrid Clouds”, IEEE Internet Computing, September/
October 2009 (vol. 13 no. 5)
24/24