Enabling Automated HPC / Database Deployment via theAppScale Hybrid Cloud Platform    Chris Bunch      Chandra Krintz     ...
Cloud Computing• Three tiers of abstraction: • Infrastructure: Scalable hardware • Platform: Scalable APIs • Software: Sca...
HPC in the Cloud•   Easy access to vast resources•   Hard to automatically configure and deploy    libraries•   Requires in...
Solving these Problems• Need a solution that is automated • Minimize the amount of domain-specific    knowledge a scientist...
Cloud Computing• Infrastructure: Completely self-service• Platform: Automated access to  certain APIs• Software: Optimized...
APIs to Support• To support scientists, we need to support: • Web services • HPC codes • Databases• And it must be simple
Introducing AppScale• An open source implementation of the  Google App Engine APIs• Can run over Amazon EC2 or Eucalyptus•...
One Button      Deployment•appscale-run-instances• --max 32• --infrastructure ec2
AppScale + Neptune•   A domain-specific language for running HPC    codes•   Supports codes written in:    •   MPI, UPC, X1...
One Command     Deployment•neptune :type => :mpi,• :code => “/code/ring”,• :nodes_to_use => 32,• :output => “/output/ring”
Database Support• Support for a dozen datastores, including:• Neptune can also store to Amazon S3 • Or anything that uses ...
Hybrid Clouds• The utilization of more than one cloud• Fault tolerance: Run an app in multiple  clouds• Portability: Migra...
Open Hybrid Clouds• AppScale and Neptune both support  automated hybrid cloud  deployment  • Just provide your credentials...
Government Use Case• Compute anywhere, store only in a private,  trusted cloud       Cloud 1 - EC2 East Coast   Cloud 2 - ...
One DB in Each Cloud• Compute anywhere, store in the same cloud        Cloud 1 - EC2 East Coast   Cloud 2 - Private Eucaly...
Wrapping it Up• Thanks to the AppScale team, especially co-  lead Navraj Chohan and advisor Chandra  Krintz• AppScale 1.5 ...
Upcoming SlideShare
Loading in...5
×

AppScale + Neptune @ HPCDB

620

Published on

These slides are from my talk at HPCDB, co-located with Supercomputing 2011 in Seattle.

Published in: Education, Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
620
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
12
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

AppScale + Neptune @ HPCDB

  1. 1. Enabling Automated HPC / Database Deployment via theAppScale Hybrid Cloud Platform Chris Bunch Chandra Krintz HPCDB 2011 @ Seattle, WA November 18, 2011
  2. 2. Cloud Computing• Three tiers of abstraction: • Infrastructure: Scalable hardware • Platform: Scalable APIs • Software: Scalable application
  3. 3. HPC in the Cloud• Easy access to vast resources• Hard to automatically configure and deploy libraries• Requires in-depth knowledge of each technology involved• Hard to get high performance on opaque cloud• Wide range of APIs for similar services (e.g., compute, storage)
  4. 4. Solving these Problems• Need a solution that is automated • Minimize the amount of domain-specific knowledge a scientist has to learn• Need to automate configuration and deployment • Hard since the number of nodes used can be dynamic in the cloud
  5. 5. Cloud Computing• Infrastructure: Completely self-service• Platform: Automated access to certain APIs• Software: Optimized for one piece of software
  6. 6. APIs to Support• To support scientists, we need to support: • Web services • HPC codes • Databases• And it must be simple
  7. 7. Introducing AppScale• An open source implementation of the Google App Engine APIs• Can run over Amazon EC2 or Eucalyptus• Configures and deploys automatically • Scientist only needs to specify the number of nodes to run over
  8. 8. One Button Deployment•appscale-run-instances• --max 32• --infrastructure ec2
  9. 9. AppScale + Neptune• A domain-specific language for running HPC codes• Supports codes written in: • MPI, UPC, X10, and others• Configures and deploys automatically • Scientist only needs to specify the number of nodes to run over
  10. 10. One Command Deployment•neptune :type => :mpi,• :code => “/code/ring”,• :nodes_to_use => 32,• :output => “/output/ring”
  11. 11. Database Support• Support for a dozen datastores, including:• Neptune can also store to Amazon S3 • Or anything that uses the same APIs • Completely automated
  12. 12. Hybrid Clouds• The utilization of more than one cloud• Fault tolerance: Run an app in multiple clouds• Portability: Migrate an app from one cloud to another• Adds another layer of complexity
  13. 13. Open Hybrid Clouds• AppScale and Neptune both support automated hybrid cloud deployment • Just provide your credentials• Would like to expand both with capabilities for special use cases • Quantify the cost of each use case
  14. 14. Government Use Case• Compute anywhere, store only in a private, trusted cloud Cloud 1 - EC2 East Coast Cloud 2 - Private Eucalyptus Deployment App Server & DB Node Master App DB Node Server
  15. 15. One DB in Each Cloud• Compute anywhere, store in the same cloud Cloud 1 - EC2 East Coast Cloud 2 - Private Eucalyptus Deployment App App Server & Server Master DB Node DB Node
  16. 16. Wrapping it Up• Thanks to the AppScale team, especially co- lead Navraj Chohan and advisor Chandra Krintz• AppScale 1.5 released in August• Neptune 0.1.2 released last week• Visit us at http://appscale.cs.ucsb.edu• E-mail: cgb@cs.ucsb.edu
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×