Eucalyptus: An Open-source Infrastructure for Cloud Computing


Published on

Published in: Technology, News & Politics
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Why has this uptake occurred?
  • Eucalyptus: An Open-source Infrastructure for Cloud Computing

    1. 1. Eucalyptus: An Open-source Infrastructure for Cloud Computing Rich Wolski Eucalyptus Systems Inc.
    2. 2. Exciting Weather Forecasts
    3. 3. Commercial Cloud Formation Eucalyptus - Confidential
    4. 4. What is a cloud? SLAs Web Services Virtualization
    5. 5. Cloudy issues <ul><li>Public clouds are opaque </li></ul><ul><ul><li>What applications will work well in a cloud? </li></ul></ul><ul><li>Many of the advantages offered by Public Clouds appear useful for “on premise” IT </li></ul><ul><ul><li>Self-service provisioning </li></ul></ul><ul><ul><li>Legacy support </li></ul></ul><ul><ul><li>Flexible resource allocation </li></ul></ul><ul><li>What extensions or modifications are required to support a wider variety of services and applications? </li></ul><ul><ul><li>Data assimilation </li></ul></ul><ul><ul><li>Multiplayer gaming </li></ul></ul><ul><ul><li>Mobile devices </li></ul></ul>
    6. 6. Open-source Cloud Infrastructure <ul><li>Idea : Develop an open-source, freely available cloud platform for commodity hardware and software environments </li></ul><ul><ul><li>Stimulate interest and build community knowledge </li></ul></ul><ul><ul><li>Quickly identify useful innovations </li></ul></ul><ul><ul><li>Act to dampen the “hype” </li></ul></ul><ul><li>First-principles cloud implementation </li></ul><ul><ul><li>Not a refactorization of previously developed technology </li></ul></ul><ul><li>Linux or Anti-Linux? </li></ul><ul><ul><li>Linux: open-source platform supporting all cloud applications changes the software stack in the data center </li></ul></ul><ul><ul><li>Anti-Linux: transparency of the platform makes it clear that clouds do not belong in the data center </li></ul></ul>
    7. 7. What’s in a name? <ul><li>E lastic U tility C omputing A rchitecture L inking Y our P rograms T o U seful S ystems </li></ul><ul><li>Web services based implementation of elastic/utility/cloud computing infrastructure </li></ul><ul><ul><li>Linux image hosting ala Amazon </li></ul></ul><ul><li>How do we know if it is a cloud? </li></ul><ul><ul><li>Try and emulate an existing cloud: Amazon AWS </li></ul></ul><ul><li>Functions as a software overlay </li></ul><ul><ul><li>Existing installation should not be violated (too much) </li></ul></ul><ul><li>Focus on installation and maintenance </li></ul><ul><ul><li>“ System Administrators are people too.” </li></ul></ul>
    8. 8. Goals for Eucalyptus <ul><li>Foster greater understanding and uptake of cloud computing </li></ul><ul><ul><li>Provide a vehicle for extending what is known about the utility model of computing </li></ul></ul><ul><li>Experimentation vehicle prior to buying commercial services </li></ul><ul><ul><li>Provide development, debugging, and “tech preview” platform for Public Clouds </li></ul></ul><ul><li>Homogenize local IT environment with Public Clouds </li></ul><ul><ul><li>AWS functionality locally makes moving using Amazon AWS easier, cheaper, and more sustainable </li></ul></ul><ul><li>Provide a basic software development platform for the open source community </li></ul><ul><ul><li>E.g. the “Linux Experience” </li></ul></ul><ul><li>Not designed as a replacement technology for AWS or any other Public Cloud service </li></ul>
    9. 9. Open-source Cloud Anatomy <ul><li>Extensibility </li></ul><ul><ul><li>Simple architecture and open internal APIs </li></ul></ul><ul><li>Client-side interface </li></ul><ul><ul><li>Amazon’s AWS interface and functionality (familiar and testable) </li></ul></ul><ul><li>Networking </li></ul><ul><ul><li>Virtual private network per cloud </li></ul></ul><ul><ul><li>Must function as an overlay => cannot supplant local networking </li></ul></ul><ul><li>Security </li></ul><ul><ul><li>Must be compatible with local security policies </li></ul></ul><ul><li>Packaging, installation, maintenance </li></ul><ul><ul><li>system administration staff is an important constituency for uptake </li></ul></ul>
    10. 10. Eucalyptus Infestation
    11. 11. The EC2 API <ul><li>Create and terminate virtual machines </li></ul><ul><ul><li>Create == provision and not boot </li></ul></ul><ul><ul><li>Terminate == destroy and not halt </li></ul></ul><ul><li>Image </li></ul><ul><ul><li>initial root file system </li></ul></ul><ul><li>Instance </li></ul><ul><ul><li>Image + kernel + ramdisk + ephemeral disk + private IP + public IP </li></ul></ul><ul><li>Create an image: upload a root file system </li></ul><ul><li>Run an instance: launch a VM with a specific </li></ul><ul><ul><li>Image that has been uploaded (into S3) </li></ul></ul><ul><ul><li>Kernel and ramdisk that Amazon provides </li></ul></ul><ul><ul><li>Ephemeral disk that gets created and attached </li></ul></ul>
    12. 12. The S3 API <ul><li>Bucket store: buckets and objects </li></ul><ul><ul><li>Bucket: container for objects </li></ul></ul><ul><ul><li>Object: unit of storage/retrieval </li></ul></ul><ul><ul><li>Buckets are Created and Destroyed </li></ul></ul><ul><ul><li>Object are either Put or Get </li></ul></ul><ul><li>Object storage is transactional </li></ul><ul><ul><li>Last write prevails </li></ul></ul><ul><li>Eventually consistent </li></ul><ul><ul><li>Object writes will eventually be propagated </li></ul></ul><ul><li>Buckets are access controlled </li></ul>
    13. 13. The EBS API <ul><li>Persistent Storage volumes that can be attached by VMs </li></ul><ul><ul><li>Raw block devices (must be formatted by owner/user) </li></ul></ul><ul><ul><li>Persist across VM creation and termination </li></ul></ul><ul><ul><li>Cannot be shared by multiple VMs simultaneously </li></ul></ul><ul><ul><li>Not accessible across “availability zones” (virtual data centers) </li></ul></ul><ul><li>Persistent virtual local disk </li></ul>
    14. 14. All Together Now REST/SOAP EC2 S3 EBS EBS Availability Zone Availability Zone VM VM VM VM VM -- Public IP -- Security Groups -- Put/Get storage -- Eventual consistency
    15. 15. RDMA and Cloud <ul><li>RDMA between hosted Virtual Machines </li></ul><ul><ul><li>Sockets are the only inter-VM IPC as of today </li></ul></ul><ul><ul><li>Requires virtualization support for RDMA for isolation </li></ul></ul><ul><ul><ul><li>Hypervisors </li></ul></ul></ul><ul><ul><ul><li>libvirt </li></ul></ul></ul><ul><li>RDMA in the cloud platform: EBS </li></ul><ul><ul><li>EBS performance and reliability is critical </li></ul></ul><ul><ul><li>Current connection is via iSCSI to SAN/JBOD </li></ul></ul><ul><ul><li>Requires authentication interface for RDMA </li></ul></ul><ul><ul><li>Also requires virtualization support </li></ul></ul><ul><li>Suggestion: RDMA support in virtIO and XCP </li></ul><ul><ul><li>Will speed adoption for on-premise clouds </li></ul></ul>
    16. 16. Thanks! <ul><li>Thanks to our original research sponsors… </li></ul><ul><li>… and to our new commercial friends </li></ul> 805-845-8000 [email_address]