Open Cloud Consortium Overview (01-10-10 V6)

2,310 views

Published on

This is a brief overview of the Open Cloud Consortium.

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
2,310
On SlideShare
0
From Embeds
0
Number of Embeds
41
Actions
Shares
0
Downloads
70
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Open Cloud Consortium Overview (01-10-10 V6)

  1. 1. www.opencloudconsortium.org<br />Open Cloud Consortium: An Update<br />Robert GrossmanOpen Cloud Consortium<br />January 10, 2010<br />
  2. 2. Part 1. Overview of theOpen Cloud Consortium (OCC)<br />www.opencloudconsortium.org<br />2<br />
  3. 3. 501(3)(c) Not-for-profit corporation<br />Supports the development of standards, interoperability frameworks, and reference implementations.<br />Manages testbeds: Open Cloud Testbed and Intercloud Testbed.<br />Manages cloud computing infrastructure to support scientific research: Open Science Data Cloud.<br />Develops benchmarks.<br />3<br />www.opencloudconsortium.org<br />
  4. 4. OCC Members<br />Companies: Aerospace, Booz Allen Hamilton, Cisco, InfoBlox, Open Data Group, Raytheon, Yahoo<br />Universities: CalIT2, Johns Hopkins, MIT Lincoln Lab, Northwestern Univ., University of Illinois at Chicago, University of Chicago<br />Government agencies: NASA<br />Open Source Projects: Sector Project<br />4<br />
  5. 5. OCC Working Groups<br />Large Data Cloud Working Group<br />Open Cloud Testbed Working Group.<br />Intercloud Testbed Working Group<br />Open Science Data Cloud Working Group<br />
  6. 6. Applications<br />Apps<br />Compute Services<br />Data Services<br />IF-MAP (Metadata) Services<br />PaaS<br />Storage Services<br />Identity Manager<br />Virtual Machine Manager<br />Virtual Network Manager<br />IaaS<br />Network Transport<br />
  7. 7. Part 2. Intercloud Testbed<br />7<br />Cloud 2<br />Cloud 1<br />
  8. 8. We have several cloud standards…<br /><ul><li>Platform as a Service
  9. 9. Cloud Compute Services
  10. 10. Data/Table Cloud Services
  11. 11. Cloud Storage Services</li></ul>Large Data Cloud Interoperability Framework<br />SNIA Cloud Data Management Interface (CDMI)<br /><ul><li>Infrastructure as a Service
  12. 12. Virtual Data Centers (VDC)
  13. 13. Virtual Networks (VN)
  14. 14. Virtual Machines (VM)</li></ul>Open Cloud Computing Interface (OCCI)<br />Open Virtualization Format (OVF)<br />
  15. 15. Where are the Gaps?<br /><ul><li>Naming entities in IaaS & PaaS
  16. 16. Bridging IaaS & DaaS
  17. 17. Services that span multiple VMs, ….
  18. 18. Platform as a Service
  19. 19. Cloud Compute Services
  20. 20. Data as a Service</li></ul>Large Data Cloud Interoperability Framework<br />SNIA Cloud Data Management Interface (CDMI)<br /><ul><li>Infrastructure as a Service
  21. 21. Virtual Data Centers (VDC)
  22. 22. Virtual Networks (VN)
  23. 23. Virtual Machines (VM)
  24. 24. Physical Resources</li></ul>Open Cloud Computing Interface (OCCI)<br />Open Virtualization Format (OVF)<br />
  25. 25. Bridging the Gaps…A Small Step<br /><ul><li>Platform as a Service
  26. 26. Cloud Compute Services
  27. 27. Data as a Service</li></ul>Large Data Cloud Interoperability Framework<br />SNIA Cloud Data Management Interface (CDMI)<br />Metadata service linking IaaS and DaaS<br />Metadata service naming and linking entities in the IaaS layers<br /><ul><li>Infrastructure as a Service
  28. 28. Virtual Data Centers (VDC)
  29. 29. Virtual Networks (VN)
  30. 30. Virtual Machines (VM)
  31. 31. Physical Resources</li></ul>Open Cloud Computing Interface (OCCI)<br />Open Virtualization Format (OVF)<br />
  32. 32. Part 3. Large Data Cloud Working Group<br />11<br />Standards for integrating and interoperating large data cloud services such as those provided by Hadoop and similar systems.<br />
  33. 33. Focus of Working Group<br />12<br />App<br />App<br />App<br />App<br />App<br />Table-based Data Services<br />Relational-like Data Services<br />App<br />App<br />Cloud Compute Services (MapReduce, UDF, & other programming frameworks)<br />App<br />App<br />Cloud Storage Services<br />Developing APIs for this framework.<br />
  34. 34. Benchmarks for Large Data Clouds<br />Until recently, the only benchmark used was Terasort (sorting 10 billion 100 byte records)<br />Replaced by Gray Sort and Minute Sort<br />Gray Sort tries to maximize TB / min sorted on 100 TB or more of data.<br />Hadoop holds the current Gray Sort and Minute Sort records.<br />Problem: sort is just one of the types of work load for analytic applications<br />
  35. 35. MalStone<br />MalGen – generates synthetic data with realistic distributions.<br />MalStone A & B – “stylized” computations that can be used as benchmarks for architectures, software and systems for large data clouds.<br />Open source and available at malgen.googlecode.com<br />14<br />
  36. 36. Part 4. OCC Testbeds<br />
  37. 37. Condominium Clouds<br />In a condominium cloud, you buy your own rack or bunch of racks.<br />The racks are managed and operated by the condominium association, in this case the OCC.<br />If your rack is 120 TB, you get the rights to c. 40 TB of storage in the cloud. The rest is a shared resource. <br />The Open Cloud Testbed is a condo cloud managed by the OCC.<br />16<br />
  38. 38. Open Cloud Testbed<br />C-Wave<br />CENIC<br />Dragon<br />Phase 2<br />9 racks<br />250+ Nodes<br />1000+ Cores<br />10+ Gb/s <br /><ul><li>Hadoop
  39. 39. Sector/Sphere
  40. 40. Thrift
  41. 41. KVM VMs
  42. 42. Eucalyptus VMs</li></ul>MREN<br />17<br />
  43. 43. Part 5. Open Science Data Cloud Working Group<br />18<br />
  44. 44. Open Science Data Cloud<br />Astronomical data<br />Biological data (Bionimbus)<br />Networking data<br />19<br />
  45. 45. For More Information<br />info@opencloudconsortium.org<br />www.opencloudconsortium.org<br />

×