• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Challenges in hybrid and federated cloud computing
 

Challenges in hybrid and federated cloud computing

on

  • 4,595 views

The presentation describes the different cloud federation scenarios, ranging from a federation built on commercial cloud providers that offer no real support for federation to one built on data ...

The presentation describes the different cloud federation scenarios, ranging from a federation built on commercial cloud providers that offer no real support for federation to one built on data centers of the same organization where the sites are completely dedicated to supporting all aspects of federation. The level of federation is defined based on the amount of information disclosed and how much control over the resources is provided across sites. The talk also presents the existing challenges for interoperability in federated and hybrid cloud computing scenarios, and ends with real-life examples of multi-cloud environments running OpenNebula.

Statistics

Views

Total Views
4,595
Views on SlideShare
3,432
Embed Views
1,163

Actions

Likes
3
Downloads
198
Comments
0

6 Embeds 1,163

http://blog.cloudplan.org 1146
http://ignaciollorente.sys-con.com 12
http://cloudcomputing.sys-con.com 2
http://www.slideshare.net 1
http://www.netvibes.com 1
http://ignaciollorente.ulitzer.com 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Challenges in hybrid and federated cloud computing Challenges in hybrid and federated cloud computing Presentation Transcript

    • Challenges in Hybrid and Federated Cloud Computing Ignacio M. Llorente DSA-Research.org Distributed Systems Architecture Research Group Universidad Complutense de Madrid© OpenNebula Project. Creative Commons Attribution-NonCommercial-ShareAlike License 1/33
    • ContentsChallenges in Hybrid and Federated Cloud Computing!●  What is Cloud Computing?●  What is OpenNebula?●  The Future of Cloud Computing●  Levels of Coupling●  Common Architectures for Federation●  Challenges for Interoperability●  Cloud Federation in Grid InfrastructuresChallenges in Hybrid and Federated Cloud Computing 2/33
    • What is Cloud Computing?Provision of IT Capabilities as a Service! What Who On-demand End-user Software as a Service access to any (does not care about hw or sw) application Platform for Developer Platform as a Service building and (no managing of the underlying hw delivering web & swlayers) applications Infrastructure as a Raw computer System Administrator ᄎ Service infrastructure (complete management of the computer infrastructure) Physical InfrastructureChallenges in Hybrid and Federated Cloud Computing 3/33
    • What is Cloud Computing?Provision of Virtualized Resources as a Service! •  Raw infrastructure •  Management Console resources •  Simple REST API’s Manage Instances •  Pay-as-you-go & elastic capacityChallenges in Hybrid and Federated Cloud Computing 4/33
    • What is Cloud Computing?Different Models of Deployment! Model Definition Cloud Cases Infrastructure is owned by •  Optimize and simplify internal operation Private a single organization and •  SaaS/PaaS support made available only to the •  IT consolidation within large organizations organization (Goverment Clouds, University Clouds…) Infrastructure is owned by •  Low cost solutions with limited control/ a single organization and configuration and security/reliability good made available to other enough Public organizations over the •  Commercial cloud providers, mostly Internet hosting providers •  Science public clouds by ICT service centers to enable scientific and educational projects to experiment with cloud computing Infrastructure is owned by •  Premium solutions with additional control/ Private Virtual a single organization and configuration and security/reliability made available to other •  Telecom cloud providers organization over a dedicated private networkChallenges in Hybrid and Federated Cloud Computing 5/33
    • What is OpenNebula?Cloud as an Evolution of the Data Center! Constraints from Requirements from Existing Infrastructure Usage and Deployment and Processes Scenarios “One solution does not fit all requirements and constraints” OpenNebula makes cloud an evolution by leveraging existing IT assets, protecting your existing investments, and avoiding vendor lock-inChallenges in Hybrid and Federated Cloud Computing 6/33
    • What is OpenNebula?IaaS Cloud Computing Tool for Managing a Data Centers Virtual Infrastructure!Most Advanced and Flexible, Enterprise-grade IaaS Cloud ManagerAdaptable● Customizable and ExtensibleProven● Many Massive Scale Production DeploymentsPowerful● Most Advanced Enterprise-class FunctionalityNo Lock-in● Platform Independent and InteroperableInteroperable● Most popular cloud APIs and standard basedOpenness● Fully open-source● Apache licenseChallenges in Hybrid and Federated Cloud Computing 7/33
    • What is OpenNebula?The Internals of the Cloud! Interfaces & API •  CLI (local/remote) •  API (java, ruby bindings) •  Sunstone •  Cloud (EC2, OCCI) VM Networking •  VLANs Image Repository of VM disks •  Firewall hooks •  ACLs (public + private) •  User defined •  OS and Data types (persistent) •  Multiple storage backends User & Roles Hosts: Cluster workernodes to run VMs. Storage •  Multiple hypervisors defined per host •  NAS •  Grouped in logical clusters •  SAN •  Custom monitoring probes and technologies •  Custom (bittorrent, ssh…)Challenges in Hybrid and Federated Cloud Computing 8/33
    • What is OpenNebula?EU Success Story in Cloud Computing Research and Innovation! Flagship EU Project on Deployments with Cloud Computing Research 4,000 tens of thousands downloads/month of VMs Mature Wordwide engaged technology community started in 2005 Innovative Technology Spin-off Management Tool Innovation PlatformChallenges in Hybrid and Federated Cloud Computing 9/33
    • The Future of Cloud ComputingNext Step in the Evolution of an Utility! Utility Utility Generation Distribution Utility GridChallenges in Hybrid and Federated Cloud Computing 10/33
    • The Future of Cloud ComputingBenefits of Federation!Scalability● Cloudbursting to address peak demands● Sharing of infrastructure between partners● Infrastructure aggregation across sitesReliability● Fault tolerance architectures across sitesPerformance● Deployment of services closer to end usersCost● Dynamic placement to reduce the overall infrastructure costEnergy Consumption● Minimize energy consumptionChallenges in Hybrid and Federated Cloud Computing 11/33
    • The Future of Cloud ComputingThe Cluster Computing Use Case! Virtual Computing Cluster Flexibility •  Dynamic elasticity rules Cluster Users •  Dynamic provision of cluster configurations WorkernodesCompletely Transparent•  LRMS interface Front-end Simplify and Optimize Internal Operations •  Dynamic performance partitioning •  Consolidation •  Faster upgradesChallenges in Hybrid and Federated Cloud Computing •  Maintenance 12/33
    • The Future of Cloud ComputingThe Cluster Computing Use Case! Scalability Performance Cost Fault toleranceChallenges in Hybrid and Federated Cloud Computing 13/33
    • Levels of CouplingDifferent Levels of Control, Monitoring, Cross-site Functionality and Security! Private Cloud Partner Cloud Company Cloud Public CloudChallenges in Hybrid and Federated Cloud Computing 14/33
    • Levels of CouplingLoosely Coupled Federation!Federation with a Cloud without Interoperation Support •  Basic operations over VMs (start, shutdown, restart…) Control •  Different instance types Monitoring & •  Basic virtual resource monitoring (resource consumption…) Accounting Cross-site •  None Security •  Single account representing the organizationChallenges in Hybrid and Federated Cloud Computing 15/33
    • Levels of CouplingPartially Coupled Federation!Federation with a Cloud with Partial Interoperation Support •  Advanced operations over VMs (live migration…) Control •  VM location and affinity constraints Monitoring & •  Advanced virtual resource monitoring (energy consumption, Accounting VM placement…) •  Virtual networks Cross-site •  Virtual storage Security •  Framework agreementChallenges in Hybrid and Federated Cloud Computing 16/33
    • Levels of CouplingTightly Coupled Federation!Federation with a Cloud with Advanced Interoperation Support •  Placement on specific physical resources Control •  Same instance types Monitoring & •  Physical resource consumption Accounting •  Live migration Cross-site •  High availability Security •  User space sharingChallenges in Hybrid and Federated Cloud Computing 17/33
    • Common Architectures for Cloud FederationOrganization of Multi-site Cloud Environments!Challenges in Hybrid and Federated Cloud Computing 18/33
    • Common Architectures for Cloud FederationCloudbursting Architecture! Corporate cloud Cloud  OS   Public   Public   Cloud  1   Cloud  2   Local data center Aim •  Meet peak demands •  Public cloud by commercial provider Cloud Type •  VPC by telecom provider Coupling •  Loosely and partially coupledChallenges in Hybrid and Federated Cloud Computing 19/33
    • Common Architectures for Cloud FederationCloudbursting Architecture! Enhancing Grid Infrastructures with Cloud Computing EU grant agreement RI-261552 Simplify and optimize its use and operation, providing a more (2010-2012) e-Infrastructure flexible, dynamic environment for scientists; and enhance existing computing infrastructures with “IaaS” paradigms www.StratusLab.eu www.stratuslab.orgChallenges in Hybrid and Federated Cloud Computing 20/33
    • Common Architectures for Cloud FederationDynamic Combination of Local with Remote Cloud Resources! Service Level Agreement •  SLO 1: Average_CPU_Utilization > 75% •  Action: Execute remote WN Grid Services StratusLab StratusLabChallenges in Hybrid and Federated Cloud Computing 21/33
    • Common Architectures for Cloud FederationCloud Broker Architecture! Cloud  OS   (Broker)   Public   Public   Public   Cloud  1   Cloud  2   Cloud  3   Aim •  Cost, performance and reliability optimization Cloud Type •  Public clouds by commercial provider Coupling •  Loosely coupledChallenges in Hybrid and Federated Cloud Computing 22/33
    • Common Architectures for Cloud FederationCloud Broker Architecture! Building Service Testbeds on FIRE Agreement 257386 (2010-2013) Design, build and operate a multi-site cloud-based facility to New Infrastructure Paradigms support research across applications, services and systems and Experimental Facilities targeting services research community on Future Internet www.BonFIRE-Project.eu Source: BonFIRE ProjectChallenges in Hybrid and Federated Cloud Computing 23/33
    • Common Architectures for Cloud FederationAggregated Cloud Architecture! Corporate Corporate cloud 1 cloud 2 Cloud  OS   Cloud  OS   Local data center Local data center Aim •  Sharing of resources to meet peak demands Cloud Type •  Partner or company clouds Coupling •  Partially or tightly coupledChallenges in Hybrid and Federated Cloud Computing 24/33
    • Common Architectures for Cloud FederationAggregated Cloud Architecture! Resources and Services Virtualization without Barriers Agreement 215605 (2008-2011) Open source technology to enable deployment andService and Sw Architectures and management of complex IT services across different Infrastructures administrative domains www.reservoir-fp7.euChallenges in Hybrid and Federated Cloud Computing 25/33
    • Common Architectures for Cloud FederationMulti-tier Cloud Architecture! Corporate cloud Cloud  OS   Cloud Cloud site 1 site 2 Cloud  OS   Cloud  OS   Local data center Local data center •  Very large scale or geographically distributed Aim data centers Cloud Type •  Company clouds Coupling •  Tightly coupledChallenges in Hybrid and Federated Cloud Computing 26/33
    • Common Architectures for Cloud FederationMulti-tier Cloud Architecture! CloudFront •  Portal •  Cloud API (EC2, OCCI) User •  Global AuthN OpenNebula Zone OpenNebula Zone •  Multi-tenancy •  Multi-tier arch. •  Runs Instances •  Scalable •  Stores Images •  Isolation •  Networking •  Multiple-site •  Authorization supportChallenges in Hybrid and Federated Cloud Computing 27/33
    • Challenges for InteroperabilityLeveraging Existing Standards and Implementing Interoperation! Standardization ●  Implement standards ●  Integrate with standards Which Standard? ●  Different de jure standards ●  Several de facto standards Interoperation ●  Implement adaptors ●  Use transformersChallenges in Hybrid and Federated Cloud Computing 28/33
    • Challenges for InteroperabilityI Want to Combine My Private Cloud with a Remote Cloud without Changes!Transparent Combination of Local Resources with Cloud Resources 1. Management Interfaces 2. Management Interfaces for Virtual Workloads for Data Elements CDMI VM VM VM VM VM 4. Contextualization OVF 3. VM Image Description 5. Cross-site Networking and Instance Type and Latency OVFChallenges in Hybrid and Federated Cloud Computing 29/33
    • Cloud Federation in Grid InfrastructuresGrid and Cloud as Complementary Computing Models! Usage Grids Usage Clouds §  Job Processing §  Raw infrastructure §  Big Batch System §  Elasticity & Pay-per-use §  File Sharing Services §  Simple Web Interface Achievements Achievements §  Federation of Resources §  Agile Infrastructures §  VO Concept §  IT is another Utility But… But… §  User experience §  Interoperability §  Complexity §  Federation Resource Sharing Resource ManagementScientific Applications Customize Environments Uniform Security Flexibility & SimplicityChallenges in Hybrid and Federated Cloud Computing 30/33
    • Cloud Federation in Grid InfrastructuresThe StratusLab Vision!•  Batch Job Processing•  Custom Execution Environments 2 •  Industry Applications •  Other WMS (pilots) Access•  Grid Service Integration •  Complete Services (cluster) Grid Middleware IaaS Interface LRMS (LSF, PBS…) StratusLab Toolkit Service 1 Virtual CE, WN… Other (web, mail...) Raw machines Provision 3 Grid SitesChallenges in Hybrid and Federated Cloud Computing External Providers 31/33
    • Cloud Federation in Grid InfrastructuresThe StratusLab Architecture! Grid Services MarketPlace•  Federation facilities•  Security •  Sharing existing VM images•  Grid specific services •  Registry of metadata •  Image are kept elsewhere •  Supports trust Appliance Repo •  Storage VM images •  Distributed •  Multi-protocol Grid Services Cloud API Grid Services Cloud API Cloud/Grid Site Cloud/Grid SiteChallenges in Hybrid and Federated Cloud Computing 32/33
    • Questions?We Will Be Happy to Answer Any Question ! CloudPlan.org @imllorenteChallenges in Hybrid and Federated Cloud Computing 33/33