OCC Overview OMG Clouds Meeting 07-13-09 v3


Published on

This is an overview of the Open Cloud Consortium that was presented at the OMG Meeting on Cloud Computing Standards on July 13, 2009 in Arlington, VA.

Published in: Technology, Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

OCC Overview OMG Clouds Meeting 07-13-09 v3

  1. 1. www.opencloudconsortium.org<br />An Overview of the Open Cloud Consortium<br />Robert GrossmanOpen Cloud Consortium<br />OMG Cloud Computing Interoperability Workshop <br />July 13, 2009 <br />
  2. 2. This talk represents my personal opinions and does not necessarily represent a consensus position of the Open Cloud Consortium or positions of any of its members.<br />2<br />
  3. 3. Part 1. Introduction<br />3<br />
  4. 4. Two Types of Clouds<br />On-demand resources & services over a network at the scale of a data center<br />On-demand computing instances (IaaS)<br />IaaS: Amazon EC2, S3, etc.; Eucalyptus<br />supports many Web 2.0 applications/users<br />On-demand cloud services for large data cloud applications (Large Data PaaS)<br />GFS/MapReduce/Bigtable, Hadoop, Sector, …<br />Manage and compute with large data (say 100+ TB)<br />4<br />
  5. 5. Delivering On-Demand Computing Instances<br />5<br />App<br />App<br />App<br />App<br />App<br />Table-based Data (BigTable) Services<br />Relational Data Services (Pig, etc.)<br />App<br />App<br />…<br />Cloud Compute Services (MapReduce, Variants & Generalizations)<br />App<br />App<br />Cloud Storage Services<br />For both architectures, you are interested in filling a data center.<br />App<br />App<br />App<br />
  6. 6. Activities Currently Focused Around Five Use Cases<br />Moving an existing cloud application from Cloud 1 to Cloud 2 without changing the application.<br />Providing surge capacity for an application on Cloud 1 using any of the Clouds 2, 3, … (without changing the application).<br />Migrate / port<br />Surge / burst<br />Cloud 2<br />Cloud 1<br />
  7. 7. Large Data Cloud Use Cases<br />Moving a large data cloud application from one large data cloud storage service to another.<br />Moving a large data cloud application from one large data cloud compute service to another.<br />App 1<br />App 2<br />Large Data Cloud Compute Services <br />Large Data Cloud Storage Services <br />
  8. 8. Inter-Cloud Use Case<br />Inter-cloud communication between two HIPAA compliant clouds.<br />HIPPA Cloud 2<br />HIPAA Cloud 1<br />
  9. 9. Part 2. The Open Cloud Consortium (OCC)<br />www.opencloudconsortium.org<br />9<br />
  10. 10. www.opencloudconsortium.org<br />OCC is a member driven organization that:<br />Supports the development of standards.<br />Supports the development of benchmarks.<br />Supports reference implementations for cloud computing, preferably open source. <br />Sponsors workshops and other events related to cloud computing.<br />10<br />
  11. 11. OCC Members<br />Current Members<br />Aerospace, Cisco, MIT Lincoln Labs, Northwestern University, Open Data Group, Sector Project, University of Chicago, University of Illinois at Chicago and Yahoo.<br />Current Contributing Members & Partners<br />CalIT2, Johns Hopkins University, National Lambda Rail<br />
  12. 12. OCC Structure<br />OCC is a consortium operated by a not-for-profit.<br />OCC is member-driven. <br />OCC is oriented to companies and organizations, not individuals.<br />Governance structure is available from web site.<br />12<br />
  13. 13. OCC Working Groups<br />Members set up working groups.<br />Large Data Clouds Working Group<br />Open Cloud Testbed Working Group.<br />Standard Cloud Performance Measurement (SCPM)<br />- Working collaboratively with CCIF<br />Information Sharing and Security Working Group.<br />
  14. 14. Part 3. Large Data Clouds Benchmarks and Interoperability Working Group<br />14<br />*<br />*OCC is not affiliated with the Hadoop Project.<br />
  15. 15. Cloud Benchmarks<br />To help inform purchase decisions.<br />To help inform the design of cloud applications.<br />To help inform cloud architecture decisions.<br />
  16. 16. Benchmarks for Large Data Clouds<br />Until recently, the only benchmark used was Terasort (sorting 10 billion 100 byte records)<br />Replaced by Gray Sort and Minute Sort<br />Gray Sort tries to maximize TB / min sorted on 100 TB or more of data.<br />Hadoop holds the current Gray Sort and Minute Sort records.<br />Problem: sort is just one of the types of work load for analytic applications<br />
  17. 17. MalStone<br />MalGen – generates synthetic data with realistic distributions.<br />MalStone A & B – “stylized” computations that can be used as benchmarks for architectures, software and systems for large data clouds.<br />Open source and available at code.google.com/p/malgen<br />17<br />
  18. 18. MalStone B<br />18<br />entities<br />sites<br />dk-2<br />dk-1<br />dk<br />time<br />
  19. 19. MalStone B Benchmark<br />19<br />
  20. 20. ThriftStore<br />Cloud App 1<br />Cloud App 2<br />App n<br />…<br />ThriftStore<br />Hadoop DFS<br />KFS<br />Sector DFS<br />Each cloud application can access any of the large data cloud storage services without changing any of its APIs.<br />Based upon the open source Thrift project.<br />
  21. 21. Part 4. Standard Cloud Performance Measurement (SCPM) Working Group<br />21<br />
  22. 22. Establish Benchmarks Appropriate for Four Use Cases<br />Moving an application between two clouds.<br />Obtaining burst instances from multiple cloud service providers for a private/public hybrid application.<br />Moving a large data cloud application to another large data cloud storage service.<br />Moving a large data cloud application to another large data cloud compute service.<br />
  23. 23. Hierarchy of Benchmarks<br />Benchmarks for basic operations<br />Kernel Benchmarks<br />Basic functions and routines<br />Stripped down versions of programs<br />Full applications<br />Goal is to develop small suite of these benchmarks for four use cases.<br />
  24. 24. Please Get Involved…<br />The Standard Cloud Performance Measurement (SCPM) Working Group is just starting, please get involved.<br />
  25. 25. Part 5. OCC Sponsored Events<br />25<br />
  26. 26. OCC/CCIF Jointly Sponsored Events<br />International Summit on Governmental Cloud Computing<br />Ottawa&apos;s Westin Hotel on October 6, 2009<br />Cloud Computing and Its Applications 2009<br />Chicago on October 20-21, 2009<br />
  27. 27. We Welcome New Members<br />Companies and organizations are welcome to join the Open Cloud Consortium (OCC)<br />www.opencloudconsortium.org/membership.html<br />Join one of our working groups<br />Large Data Clouds Working Group<br />Standard Cloud Performance Measurement (SCPM) Working Group<br />Information Sharing & Security Working Group<br />
  28. 28. For More Information<br />info@opencloudconsortium.org<br />www.opencloudconsortium.org<br />