Amazon’s Cloud Computing Efforts:  S3 and EC2 By:  Chris Sosa
Materials Provided By <ul><li>“ An Evaluation of Amazon’s Grid Computing Services: EC2, S3 and SQS” by Garfinkel </li></ul...
Motivation <ul><li>Producing a large accessible computing and storage infrastructure is expensive </li></ul><ul><ul><li>Ph...
Utility Computing <ul><li>Basically outsourcing infrastructure to the  big   guys </li></ul><ul><li>It’s all about economy...
Amazon’s Cloud Computing Overview <ul><li>Amazon’s Elastic Compute Cloud (EC2) </li></ul><ul><ul><li>Provides resizable / ...
Amazon’s Web Service Model <ul><li>Interface </li></ul><ul><ul><li>Web-based dashboard </li></ul></ul><ul><ul><li>REST API...
First Up – EC2 <ul><li>Amazon uses Linux-based Virtual Machines running on Xen </li></ul><ul><li>Actual resources are virt...
EC2 Cost Model <ul><li>Instances </li></ul><ul><ul><li>$0.10 - Small Instance (per hour) </li></ul></ul><ul><ul><ul><li>1....
The Good <ul><li>Only pay for what you need </li></ul><ul><li>“Guaranteed” to be 99.9% reliable (good enough?) (targets 99...
The Bad <ul><li>Still pay for computing you aren’t using but still running </li></ul><ul><li>No persistent storage </li></...
Second – S3 <ul><li>250 Mb/second network link </li></ul><ul><li>Objects stored in buckets </li></ul><ul><ul><li>Buckets h...
S3 Pricing <ul><li>Storage </li></ul><ul><ul><li>$0.15 per GB-Month of storage used  </li></ul></ul><ul><li>Data Transfer ...
The Pretty <ul><li>Available during 100% of tests </li></ul><ul><li>Performance </li></ul><ul><ul><li>Works well for large...
The Pretty Ugly <ul><li>No guarantee of persistence in data </li></ul><ul><ul><li>Will real companies buy into this? </li>...
Conclusion <ul><li>EC2 and S3 provide applications with the ability to allocate computing and storage resources on demand ...
Questions
Upcoming SlideShare
Loading in …5
×

Amazon’s Cloud Computing Efforts

1,278 views
1,213 views

Published on

My take on amazon's cloud computing efforts

Published in: Technology, Travel
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,278
On SlideShare
0
From Embeds
0
Number of Embeds
8
Actions
Shares
0
Downloads
78
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Amazon’s Cloud Computing Efforts

  1. 1. Amazon’s Cloud Computing Efforts: S3 and EC2 By: Chris Sosa
  2. 2. Materials Provided By <ul><li>“ An Evaluation of Amazon’s Grid Computing Services: EC2, S3 and SQS” by Garfinkel </li></ul><ul><ul><li>When I refer to tests, I mean from this paper </li></ul></ul><ul><li>Blogs </li></ul><ul><li>Miscellaneous articles </li></ul><ul><li>Amazon’s Web Services website </li></ul>
  3. 3. Motivation <ul><li>Producing a large accessible computing and storage infrastructure is expensive </li></ul><ul><ul><li>Physical Space, cooling, power, management </li></ul></ul><ul><ul><li>Money </li></ul></ul><ul><ul><li>Experience </li></ul></ul><ul><li>Large maintenance costs </li></ul><ul><ul><li>Never sure how much we actually need </li></ul></ul>
  4. 4. Utility Computing <ul><li>Basically outsourcing infrastructure to the big guys </li></ul><ul><li>It’s all about economy of scale </li></ul><ul><li>Goal to make web-scale computing easier </li></ul><ul><li>… how many buzz words does it take to fill a gallon jar? </li></ul>
  5. 5. Amazon’s Cloud Computing Overview <ul><li>Amazon’s Elastic Compute Cloud (EC2) </li></ul><ul><ul><li>Provides resizable / on-demand computing capacity </li></ul></ul><ul><li>Amazon’s Simple Storage Service (S3) </li></ul><ul><ul><li>Storage for the Internet </li></ul></ul><ul><ul><li>Provides web services interface to store and retrieve any amount of data at any time and from anywhere (for a price) </li></ul></ul>
  6. 6. Amazon’s Web Service Model <ul><li>Interface </li></ul><ul><ul><li>Web-based dashboard </li></ul></ul><ul><ul><li>REST API – standard HTTP(/s) GET, PUT, DELETE commands </li></ul></ul><ul><ul><li>Remote procedure calls through SOAP </li></ul></ul><ul><ul><li>Variety of tools that perform basic operations </li></ul></ul><ul><li>Security </li></ul><ul><ul><li>Each request is signed </li></ul></ul><ul><ul><ul><li>40-character secret key with HMAC </li></ul></ul></ul><ul><ul><ul><li>X.509 certificates either given to or created by Amazon </li></ul></ul></ul><ul><ul><li>Signed timestamps to prevent replay attacks </li></ul></ul><ul><ul><li>Can use TLS / SSL </li></ul></ul>
  7. 7. First Up – EC2 <ul><li>Amazon uses Linux-based Virtual Machines running on Xen </li></ul><ul><li>Actual resources are virtualized </li></ul><ul><ul><li>So much so that they are not even backed by real hardware </li></ul></ul><ul><ul><li>“ Predictably provided” </li></ul></ul><ul><li>Two security mechanisms </li></ul><ul><ul><li>Write ssh public key into the VM image </li></ul></ul><ul><ul><li>Firewall at the server side </li></ul></ul>
  8. 8. EC2 Cost Model <ul><li>Instances </li></ul><ul><ul><li>$0.10 - Small Instance (per hour) </li></ul></ul><ul><ul><ul><li>1.7 GB of memory, 1 EC2 Compute Unit (1 virtual core - 1.7 GHz processor), 160 GB of instance storage, 32-bit platform </li></ul></ul></ul><ul><ul><li>$0.40 - Large Instance (per hour) </li></ul></ul><ul><ul><ul><li>7.5 GB of memory, 4 EC2 Compute Units (2 virtual cores with 2 EC2 Compute Units each), 850 GB of instance storage, 64-bit platform </li></ul></ul></ul><ul><ul><li>$0.80 - Extra Large Instance (per hour) </li></ul></ul><ul><ul><ul><li>15 GB of memory, 8 EC2 Compute Units (4 virtual cores with 2 EC2 Compute Units each), 1690 GB of instance storage, 64-bit platform </li></ul></ul></ul><ul><li>Data Transfer </li></ul><ul><ul><li>$0.10 per GB - all data transfer in </li></ul></ul><ul><ul><li>$0.18 per GB - first 10 TB / month data transfer out </li></ul></ul><ul><ul><li>$0.16 per GB - next 40 TB / month data transfer out </li></ul></ul><ul><ul><li>$0.13 per GB - data transfer out / month over 50 TB </li></ul></ul>
  9. 9. The Good <ul><li>Only pay for what you need </li></ul><ul><li>“Guaranteed” to be 99.9% reliable (good enough?) (targets 99.99%) </li></ul><ul><li>Fast, responsive and reliable </li></ul><ul><li>Only takes a couple minutes to start a new instance </li></ul><ul><li>Data transfer free between S3 and EC2 </li></ul>
  10. 10. The Bad <ul><li>Still pay for computing you aren’t using but still running </li></ul><ul><li>No persistent storage </li></ul><ul><ul><li>Can use S3 </li></ul></ul><ul><ul><li>Writing to S3 slower and literally more expensive </li></ul></ul><ul><li>Poor termination clause </li></ul><ul><ul><li>Only given 60 day notice </li></ul></ul>
  11. 11. Second – S3 <ul><li>250 Mb/second network link </li></ul><ul><li>Objects stored in buckets </li></ul><ul><ul><li>Buckets have own namespace </li></ul></ul><ul><ul><li>Up to 100 buckets per account </li></ul></ul><ul><ul><li>Unlimited objects per bucket </li></ul></ul><ul><ul><li>5 GB limit on size of objects </li></ul></ul><ul><li>Computes MD5 checksum’s to check if transfers are correct </li></ul><ul><li>Up to application to retry </li></ul><ul><li>ACL’s by accounts / certificates allowed per object and per bucket (two-level) </li></ul><ul><li>Basic interface to read/write/create/delete/chmod etc </li></ul>
  12. 12. S3 Pricing <ul><li>Storage </li></ul><ul><ul><li>$0.15 per GB-Month of storage used </li></ul></ul><ul><li>Data Transfer </li></ul><ul><ul><li>$0.10 per GB - all data transfer in </li></ul></ul><ul><ul><li>$0.18 per GB - first 10 TB / month data transfer out </li></ul></ul><ul><ul><li>$0.16 per GB - next 40 TB / month data transfer out </li></ul></ul><ul><ul><li>$0.13 per GB - data transfer out / month over 50 TB </li></ul></ul><ul><li>Requests </li></ul><ul><ul><li>$0.01 per 1,000 PUT or LIST requests </li></ul></ul><ul><ul><li>$0.01 per 10,000 GET and all other requests* * No charge for delete requests </li></ul></ul>
  13. 13. The Pretty <ul><li>Available during 100% of tests </li></ul><ul><li>Performance </li></ul><ul><ul><li>Works well for large file sizes </li></ul></ul><ul><ul><li>Approaches maximum of 30 Mb/s with multiple threads (6) for test in paper </li></ul></ul><ul><ul><li>Performs at about 10 MB /s with one thread doing one large data push </li></ul></ul>
  14. 14. The Pretty Ugly <ul><li>No guarantee of persistence in data </li></ul><ul><ul><li>Will real companies buy into this? </li></ul></ul><ul><li>Claimed throughput only achievable with data transfers of 16MB or larger </li></ul><ul><ul><li>High transaction overhead </li></ul></ul><ul><ul><li>Amazon has declined to explain why! </li></ul></ul><ul><li>Same Service Level Agreement terms as EC2 </li></ul>
  15. 15. Conclusion <ul><li>EC2 and S3 provide applications with the ability to allocate computing and storage resources on demand </li></ul><ul><ul><li>This IS useful </li></ul></ul><ul><ul><li>Cheaper than the alternative for reasonably sized companies </li></ul></ul><ul><li>Most claims of service have been validated </li></ul><ul><ul><li>Issues with bandwidth claims for S3 </li></ul></ul><ul><li>Issues with its Service Level Terms may plague EC2 and S3 from becoming more utilized </li></ul>
  16. 16. Questions

×