AWS for scientific computing          jss 2011-05-12
TOC•   Overview: Cloud Eco System•   Amazon Web Services for scientific computing    •   EC2 Deployment    •   S3, EBS and ...
Cloud LayersSoftware as a Service - SaaS   running applicationsPlatform as a Service - PaaS    software environments and s...
Elastic Compute Cloud (EC2)•   Virtual Data Center•   Instance Types•   Regions•   Availability Zones•   Security Groups (...
EC2 Setup•   Management:    •   AWS web console    •   CLI: ec2-tools    •   Python: boto (check dev/src/tba)•   Use the s...
The DNS Problem•   Instances get new IP on boot•   Solutions:    •   use Virtual Private Cloud (Amazon VPC)    •   auto-up...
Storage•   Instance    fast, cleared on boot, no charges•   Elastic Block Storage (EBS)    fast, networked, instant snapsh...
Messaging•   Simple Queueing Service (Amazon SQS)•   AMQP / RabbitMQ (c.f. knk’s recent rocketcircus)•   Rolling your own ...
TLDRAWS for the occasional number crunch:      •   1/2 day to get basic setup running          (longer for robust setups) ...
Upcoming SlideShare
Loading in...5
×

AWS Quick Intro

498

Published on

AWS essentials for use in scientific computing

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
498
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

AWS Quick Intro

  1. 1. AWS for scientific computing jss 2011-05-12
  2. 2. TOC• Overview: Cloud Eco System• Amazon Web Services for scientific computing • EC2 Deployment • S3, EBS and local Storage • Queueing / Messaging
  3. 3. Cloud LayersSoftware as a Service - SaaS running applicationsPlatform as a Service - PaaS software environments and servicesInfrastructure as a Service - IaaS virtual machines and network
  4. 4. Elastic Compute Cloud (EC2)• Virtual Data Center• Instance Types• Regions• Availability Zones• Security Groups (Firewalling) Can go down just like anyone else• Amazon Machine Images (AMI)
  5. 5. EC2 Setup• Management: • AWS web console • CLI: ec2-tools • Python: boto (check dev/src/tba)• Use the setup script• Get SSH fingerprint from instance’s boot console• Use some form of parallel SSH for additional setup (Twisted conch works great, fabric for serial deployment)
  6. 6. The DNS Problem• Instances get new IP on boot• Solutions: • use Virtual Private Cloud (Amazon VPC) • auto-update hosts file • set up DNS server
  7. 7. Storage• Instance fast, cleared on boot, no charges• Elastic Block Storage (EBS) fast, networked, instant snapshot-able, N attachments per instance• Simple Storage Service (S3) HTTP access, CDN (CloudFront)
  8. 8. Messaging• Simple Queueing Service (Amazon SQS)• AMQP / RabbitMQ (c.f. knk’s recent rocketcircus)• Rolling your own (e.g. XML RPC) is fine, too
  9. 9. TLDRAWS for the occasional number crunch: • 1/2 day to get basic setup running (longer for robust setups) • profit
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×