Successfully reported this slideshow.

Eucalyptus: Our Story. Presented at LCA2011


Published on

This was presented at 2011 in Brisbane Australia as part of the Storage miniconf. It gives an introduction to Eucalyptus, and invites you to join the open source community.

Published in: Technology, Education
  • Be the first to comment

  • Be the first to like this

Eucalyptus: Our Story. Presented at LCA2011

  1. 1.   Our Story
  2. 2. The Scientists
  3. 3. <ul><li>Proceedings of the 9th IEEE International Symposium on Cluster Computing and the Grid: The Eucalyptus Open-Source Cloud-Computing System </li></ul>The Paper
  4. 4. EUCALYPTUS <ul><ul><li>Elastic </li></ul></ul><ul><ul><li>Utility </li></ul></ul><ul><ul><li>Computing </li></ul></ul><ul><ul><li>Architecture </li></ul></ul><ul><ul><li>Linking </li></ul></ul><ul><ul><li>Your </li></ul></ul><ul><ul><li>Programs </li></ul></ul><ul><ul><li>To </li></ul></ul><ul><ul><li>Useful </li></ul></ul><ul><ul><li>Systems </li></ul></ul>
  5. 5. Eucalyptus Systems, Inc
  6. 6. The architecture
  7. 7. WSDL components <ul><ul><li>Every component is a web service </li></ul></ul><ul><ul><li>WS-security is used between components </li></ul></ul><ul><ul><li>components have a well defined WSDL </li></ul></ul><ul><ul><li>WSDL may change at every release with the addition of new features </li></ul></ul><ul><ul><li>a component can thus be fully replaced provided it satisfy the WSDL </li></ul></ul>
  8. 8. Some Features <ul><ul><li>Open Source: GPL3 </li></ul></ul><ul><ul><li>Written in C & Java, multi-threaded </li></ul></ul><ul><ul><li>Linux hosted </li></ul></ul><ul><ul><li>Chose your own hypervisor: Xen, KVM, VMware, ... </li></ul></ul><ul><ul><li>AWS API </li></ul></ul><ul><ul><ul><li>EC2 (&quot;ECC&quot;) </li></ul></ul></ul><ul><ul><ul><li>S3 (&quot;Walrus&quot;) </li></ul></ul></ul><ul><ul><li>Your own Instance Types & Availability Zones </li></ul></ul>
  9. 9. Walrus Overview <ul><ul><li>Flat namespace </li></ul></ul><ul><ul><li>Unit of data is an object </li></ul></ul><ul><ul><ul><li>Objects are stored in &quot;buckets&quot; </li></ul></ul></ul><ul><ul><ul><li>Up to 5GB per bucket in S3 (customizable in Eucalyptus) </li></ul></ul></ul><ul><ul><li>Operations for manipulating buckets and objects </li></ul></ul><ul><ul><ul><li>Objects cannot be modified &quot;in place&quot; </li></ul></ul></ul><ul><ul><li>Shares credentials/user account information with Cloud Controller (EC2) </li></ul></ul><ul><ul><li>REST and SOAP API support </li></ul></ul><ul><ul><ul><li>REST is more popular </li></ul></ul></ul><ul><ul><ul><li>Ability to upload from web forms (POST) </li></ul></ul></ul><ul><ul><li>S3 API guide </li></ul></ul><ul><ul><ul><li> </li></ul></ul></ul>
  10. 10. How is Walrus used? <ul><ul><li>User facing </li></ul></ul><ul><ul><ul><li>Create/modify buckets, upload/modify/delete/copy objects </li></ul></ul></ul><ul><ul><li>Used to store user image templates </li></ul></ul><ul><ul><ul><li>Root partition, kernel, ramdisk </li></ul></ul></ul><ul><ul><ul><li>Encrypted and uploaded to Walrus </li></ul></ul></ul><ul><ul><ul><li>Walrus decrypts using user credentials </li></ul></ul></ul><ul><ul><ul><li>Node controller obtains decrypted image(s) from Walrus </li></ul></ul></ul><ul><ul><ul><li>Uses image files to create and run instance </li></ul></ul></ul><ul><ul><li>Used to store EBS snapshots </li></ul></ul><ul><ul><ul><li>Made available to storage controllers </li></ul></ul></ul><ul><ul><ul><li>Volumes are created from snapshots </li></ul></ul></ul>
  11. 11. Current Walrus Limitations <ul><ul><li>Uses file system as backend </li></ul></ul><ul><ul><ul><li>redundancy provided by storage system </li></ul></ul></ul><ul><ul><ul><li>not distributed (yet) </li></ul></ul></ul><ul><ul><li>Performance may be limited by the backend </li></ul></ul><ul><ul><li>Admin has to worry about sizing </li></ul></ul>
  12. 12. What is coming... <ul><ul><li>More AWS APIs </li></ul></ul><ul><ul><li>Improved API support </li></ul></ul><ul><ul><ul><li>Reduced Redundancy, Bucket Policies, Notifications (via SNS), MultiPart Upload, Large Object support, Streaming, ... </li></ul></ul></ul><ul><ul><li>Improved scalability, redundancy </li></ul></ul>
  13. 13. <ul><ul><li> </li></ul></ul><ul><ul><li>code </li></ul></ul><ul><ul><li>bugs </li></ul></ul><ul><ul><li>we push up every night </li></ul></ul>
  14. 14. <ul><ul><li>wiki </li></ul></ul><ul><ul><li>forums </li></ul></ul><ul><ul><li>documentation </li></ul></ul><ul><ul><li>concourse </li></ul></ul>
  15. 15. Be a contributor <ul><ul><li>CLA </li></ul></ul><ul><ul><li>patch against lp:eucalyptus/eucalyptus-devel </li></ul></ul><ul><ul><li>submit to our issue tracker (RT) </li></ul></ul><ul><li>  </li></ul><ul><ul><li>read & check RT </li></ul></ul><ul><ul><li>contributors can write to RT </li></ul></ul><ul><ul><li>others can use forum or email </li></ul></ul>