This document provides an overview of Bionimbus and the Open Cloud Consortium (OCC). Bionimbus is an open source cloud for biomedical research that provides services like elastic computing, databases, data transport and analysis pipelines. The OCC operates open clouds and develops standards to bridge private and public clouds. It runs an Open Cloud Testbed and is working to build an Open Science Data Cloud. The OCC aims to develop interoperable cloud architectures and operate infrastructure at data center scale to support open science.

1. An Overview of Bionimbus and the Open Cloud ConsortiumRobert GrossmanOpen Cloud Consortium Institute for Genomics & Systems BiologyUniversity of ChicagoLaboratory for Advanced ComputingUniversity of Illinois at Chicago

2. Part 1. Bionimbuswww.bionimbus.org

3. Web Portal & WidgetsElastic Cloud ServicesDatabase ServicesAnalysis Pipelines & Re-analysis ServicesScalable data transportLarge Data Cloud ServicesData Ingestion Services

4. Case Study 1: CistrackResource for cis-regulatory data.Integrates databases and large data clouds.Open source.Contains raw data, intermediate, and analyzed data from approximately 300 experiments from Agilent, Affy and Solexa platforms.

5. Flynet Provides Web 2.0 Access to Cistrack

6. Cube is an Elastic Cloud For Re-analysis

7. Case Study 271 rare, deleterious SNP genotypes were validated by Sequenom.SNP concordance:Alignment against gene models: 46%TopHat alignment: 91%Ran TopHat in Bionimbus using Cube-based VMs.Total time went from 25 days to 1 day.

8. Case Study 3sshmodENCODE Worm/Fly peak calling reanalysisVirtual MachinesWorking SpaceSimple Persistent Storage (glusterfs)ftpHypervisersAppAppAppRacks of HardwareOSOSOSPrivate cloud (Eucalyptus & Cube)

9. Hybrid Cloudsami-efa24c86Virtual MachinesBionimbus virtual machine images HypervisersAppAppAppHardware ClusterOSOSOSPublic cloudPrivate / Community cloud

10. Bionimbus Delivery MechanismsLogin and use the Bionimbus cloud.Use Bionimbus Virtual Machine Images in a) your private cloud; b) Bionimbus cloud; c) public clouds such as Amazon.Bionimbus is open source and you can build your own cloud (and interoperate with ours) (First release of integrated system 3Q 2010)Bionimbus data services for genomic data, even for large datasets

11. Elastic CloudsLarge Data CloudsGoal: Minimize cost of virtualized machines & provide on-demand. HPCGoal: Maximize data (with matching compute) and control cost.Goal: Minimize latency and control heat.

12. A successful cloud will…Web 2.0/3.0 user interfaceCompute services at the scale of a data center.High speed network to move & share the dataPersist & refresh data over the long term

13. Part 2. www.opencloudconsortium.org13

14. 501(c)(3) Not-for-profit corporationDevelops standards, interoperability frameworks, and reference implementations.Operates clouds.Develops benchmarks.One area of focus: bridge between private and public clouds.14www.opencloudconsortium.org

15. Operates Clouds500 nodes3000 cores1.5+ PBFour data centers10 GbpsTarget to refresh 1/3 each year.Open Cloud Testbed

16. Open Science Data Cloud

17. Cloud-based Disaster Relief ServicesOCC MembersCompanies: Yahoo, Cisco, Aerospace Corp., Booz Allen Hamilton, InfoBlox, Open Data Group, Raytheon Universities: CalIT2, Johns Hopkins, Northwestern University, University of Chicago, University of Illinois at ChicagoGovernment agencies: NASA16

18. Open Cloud Consortium PerspectiveVendor neutralOpen, interoperable architectureExperiment at scaleOperate infrastructure at the scale of a small data centerLong term point of view (think like a library not cloud service provider)Think public, private & hybrid clouds

19. Condo CloudsRaywulf rack

20. Open Cloud TestbedC-WaveCENICDragonPhase 29 racks250+ Nodes1000+ Cores10+ Gb/s Hadoop

21. Sector/Sphere

22. Thrift

23. KVM VMs

24. Eucalyptus

25. NovaMREN19

26. Open Science Data CloudAstronomical dataBiological data (Bionimbus)Networking dataImage processing for disaster relief20

27. ApplicationsAppsCompute ServicesCloudMetadata ServicesData ServicesPaaSStorage ServicesIdentity ManagerVirtual Machine ManagerVirtual Network ManagerIaaSNetwork Transport

28. StandardsPlatform as a Service

29. Cloud Compute Services

30. Data/Table Cloud Services

31. Cloud Storage ServicesLarge Data Cloud Interoperability FrameworkSNIA Cloud Data Management Interface (CDMI)Infrastructure as a Service

32. Virtual Data Centers (VDC)

33. Virtual Networks (VN)

34. Virtual Machines (VM)Open Cloud Computing Interface (OCCI)Open Virtualization Format (OVF)

35. OCC BenchmarksThere are surprises.

36. Acknowledgements

37. Thank YouFor more information:www.bionimbus.orgwww.opencloudconsortium.orgrgrossman.com (for research papers, etc.)