Your SlideShare is downloading. ×
0
AppScale + Neptune @ HPCDB
AppScale + Neptune @ HPCDB
AppScale + Neptune @ HPCDB
AppScale + Neptune @ HPCDB
AppScale + Neptune @ HPCDB
AppScale + Neptune @ HPCDB
AppScale + Neptune @ HPCDB
AppScale + Neptune @ HPCDB
AppScale + Neptune @ HPCDB
AppScale + Neptune @ HPCDB
AppScale + Neptune @ HPCDB
AppScale + Neptune @ HPCDB
AppScale + Neptune @ HPCDB
AppScale + Neptune @ HPCDB
AppScale + Neptune @ HPCDB
AppScale + Neptune @ HPCDB
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

AppScale + Neptune @ HPCDB

597

Published on

These slides are from my talk at HPCDB, co-located with Supercomputing 2011 in Seattle.

These slides are from my talk at HPCDB, co-located with Supercomputing 2011 in Seattle.

Published in: Education, Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
597
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
12
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  1. Enabling Automated HPC / Database Deployment via theAppScale Hybrid Cloud Platform Chris Bunch Chandra Krintz HPCDB 2011 @ Seattle, WA November 18, 2011
  2. Cloud Computing• Three tiers of abstraction: • Infrastructure: Scalable hardware • Platform: Scalable APIs • Software: Scalable application
  3. HPC in the Cloud• Easy access to vast resources• Hard to automatically configure and deploy libraries• Requires in-depth knowledge of each technology involved• Hard to get high performance on opaque cloud• Wide range of APIs for similar services (e.g., compute, storage)
  4. Solving these Problems• Need a solution that is automated • Minimize the amount of domain-specific knowledge a scientist has to learn• Need to automate configuration and deployment • Hard since the number of nodes used can be dynamic in the cloud
  5. Cloud Computing• Infrastructure: Completely self-service• Platform: Automated access to certain APIs• Software: Optimized for one piece of software
  6. APIs to Support• To support scientists, we need to support: • Web services • HPC codes • Databases• And it must be simple
  7. Introducing AppScale• An open source implementation of the Google App Engine APIs• Can run over Amazon EC2 or Eucalyptus• Configures and deploys automatically • Scientist only needs to specify the number of nodes to run over
  8. One Button Deployment•appscale-run-instances• --max 32• --infrastructure ec2
  9. AppScale + Neptune• A domain-specific language for running HPC codes• Supports codes written in: • MPI, UPC, X10, and others• Configures and deploys automatically • Scientist only needs to specify the number of nodes to run over
  10. One Command Deployment•neptune :type => :mpi,• :code => “/code/ring”,• :nodes_to_use => 32,• :output => “/output/ring”
  11. Database Support• Support for a dozen datastores, including:• Neptune can also store to Amazon S3 • Or anything that uses the same APIs • Completely automated
  12. Hybrid Clouds• The utilization of more than one cloud• Fault tolerance: Run an app in multiple clouds• Portability: Migrate an app from one cloud to another• Adds another layer of complexity
  13. Open Hybrid Clouds• AppScale and Neptune both support automated hybrid cloud deployment • Just provide your credentials• Would like to expand both with capabilities for special use cases • Quantify the cost of each use case
  14. Government Use Case• Compute anywhere, store only in a private, trusted cloud Cloud 1 - EC2 East Coast Cloud 2 - Private Eucalyptus Deployment App Server & DB Node Master App DB Node Server
  15. One DB in Each Cloud• Compute anywhere, store in the same cloud Cloud 1 - EC2 East Coast Cloud 2 - Private Eucalyptus Deployment App App Server & Server Master DB Node DB Node
  16. Wrapping it Up• Thanks to the AppScale team, especially co- lead Navraj Chohan and advisor Chandra Krintz• AppScale 1.5 released in August• Neptune 0.1.2 released last week• Visit us at http://appscale.cs.ucsb.edu• E-mail: cgb@cs.ucsb.edu

×