Cloud changes everything

3,153
-1

Published on

How cloud computing and AWS change everything

Published in: Technology, Design, Business
0 Comments
9 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,153
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
95
Comments
0
Likes
9
Embeds 0
No embeds

No notes for slide
  • Legal right (Finland)
  • (war craft -> world of warcraft) (dropbox)
  • Ami id, owner, visibility, product code, Arch, Name, Platform: Root device: Virtualization: Hardware Virtual Machine (HVM)
  • smaller
  • larger
  • Linux only, us-east-1 only, 8 instances only Nasa jpl
  • Zynga 12,000 EC2, 10M/day, $ 50M/month Playfish 100+EC2, 10M/day $400M, 200man reddit: 200+EC2 Myspace: 800 EC2 m1.large -> 1M users, 77,000hps
  • 1851~1922 11M articles 4TB images (S3) 100 EC2s in 24hours 1.5TB pdf
  • Bucket and object 1B ~ 5TB, unique url REST ACL Multi-upload, range get Multi-region Versioning, rrs
  • Network transfer fee is aggregated throughout all services(except cloudfront)
  • Everyone can make for live
  • Cloud changes everything

    1. 1. Cloud Computing Changes Everything Hank Lin Sr. Engineer, TCloud Computing http://hanklin.com/
    2. 2. You Call This Cloud? http://www.flickr.com/photos/lennysan/4403695791/ http://creativecommons.org/licenses/by-nc-sa/2.0/deed.en
    3. 3. I Say This Is Cloud http://www.flickr.com/photos/7969902@N07/510672745/
    4. 4. Hype or Hope http://www.flickr.com/photos/horiavarlan/5047507694/ http://creativecommons.org/licenses/by/2.0/deed.en
    5. 5. Earth at Night http://apod.nasa.gov/apod/ap081005.html
    6. 6. Facebook Visualization http://www.facebook.com/notes/facebook-engineering/visualizing-friendships/469716398919
    7. 7. Broadband, Anywhere, Anytime http://www.flickr.com/photos/myklroventine/3816273335/ http://creativecommons.org/licenses/by/2.0/deed.en
    8. 8. Everything Is Online <ul><li>app -> web app </li></ul><ul><li>mail -> Gmail </li></ul><ul><li>game -> online game </li></ul><ul><li>storage -> online storage </li></ul><ul><li>machine -> VPS </li></ul>http://hanklin.com/
    9. 9. Everything Is a Service <ul><li>Software as a Service </li></ul><ul><li>Platform as a Service </li></ul><ul><li>Infrastructure as a Service </li></ul><ul><li>* as a Service </li></ul>http://hanklin.com/
    10. 10. Nothing New http://en.wikipedia.org/wiki/File:The_Earth_seen_from_Apollo_17.jpg
    11. 11. Nothing New <ul><li>Internet </li></ul><ul><li>Virtualization, VPS </li></ul><ul><li>Platform </li></ul><ul><li>ASP </li></ul><ul><li>Browser, RIA </li></ul><ul><li>NoSQL </li></ul><ul><li>Scaling Out/Up </li></ul>
    12. 12. Everything Changes http://en.wikipedia.org/wiki/File:Giantimpact.gif
    13. 13. Everything Changes <ul><li>APIs </li></ul><ul><li>On-Demand </li></ul><ul><li>Pay As You Go </li></ul><ul><li>Infinite Capacity </li></ul><ul><li>Lease Instead Of Provision </li></ul><ul><li>Reallocate Instead Of Recover </li></ul><ul><li>Scaling In/Down </li></ul>
    14. 14. Service Providers <ul><li>Amazon </li></ul><ul><li>Google </li></ul><ul><li>Microsoft </li></ul><ul><li>Rackspace Cloud </li></ul><ul><li>Salesforce </li></ul><ul><li>Linode </li></ul>
    15. 16. AWS Products http://www.flickr.com/photos/dunechaser/4785103816/ http://creativecommons.org/licenses/by-nc-sa/2.0/deed.en
    16. 17. AWS Products Function Products Compute EC2 、 EMR 、 Auto Scaling Storage S3 、 EBS 、 AWS Import/Export 、 Public Dataset Database SimpleDB 、 RDS Messaging SNS 、 SQS 、 SES CDN CloudFront Networking Route 53 、 VPC 、 ELB Monitoring CloudWatch Deployment Elastic Beanstalk 、 CloudFormation Payments FPS 、 DevPay Support Premium Support E-Commerce FWS 、 Mechanical Turk Web Traffic Alexa Top Sites 、 Alexa Web Information Service
    17. 18. EC2 http://opencompute.org/
    18. 19. EC2
    19. 20. AMI
    20. 21. 32-bit *EC2 Compute Unit (ECU) – equivalent of a 1.0-1.2 GHz 2007 Opteron or 2007 Xeon processor. Type CPU RAM Storage Arch. IO Name Small 1 ECU 1.7 GB 150 GB 32-bit Moderate m1.small Micro Max 2 ECUs 613 MB EBS only 32-bit or 64-bit Low t1.micro High-CPU Medium 5 ECUs 1.7 GB 340 GB 32-bit Moderate c1.medium
    21. 22. 64-bit Type CPU RAM Storage Arch. IO Name Large 4 ECUs 7.5 GB 840 GB 64-bit High m1.large Extra Large 8 ECUs 15 GB 1680 GB 64-bit High m1.xlarge High-CPU Extra Large 20 ECUs 7 GB 1680 GB 64-bit High c1.xlarge High-Memory Extra Large 6.5 ECUs 17.1 GB 420 GB 64-bit Moderate m2.xlarge High-Memory Double Extra Large 13 ECUs 34.2 GB 840 GB 64-bit High m2.2xlarge High-Memory Quadruple Extra Large 26 ECUs 68.4 GB 1680 GB 64-bit High m2.4xlarge
    22. 23. High Performance Computing *Tesla Fermi M2050 contains 448 cores and 3 GB of ECC RAM and are designed to deliver up to 515 gigaflops Type Processor RAM Storage Arch. IO Name Cluster Compute Quadruple Extra Large 33.5 ECUs ( 2 Intel Xeon X5570, quad-core Nehalem) 23 GB 1680 GB 64-bit Very high (10 Gbps Ethernet) cc1.4xlarge Cluster GPU Quadruple Extra Large  33.5 ECUs ( 2 Intel Xeon X5570, quad-core Nehalem), 2 NVIDIA Tesla M2050 Fermi GPUs 22 +1 GB 2 x 3 GB (on GPU ECC) 1680 GB 64-bit Very high (10 Gbps Ethernet) cg1.4xlarge
    23. 24. NASA JPL <ul><li>Processing 3.2 Giga-pixel Images In 2 Hours, 30 Instances. Improved an order of magnitude. </li></ul><ul><li>20 Gigaflops -> 1.3 Teraflops </li></ul>MATLAB team at MathWorks
    24. 25. Regions & Availability Zones
    25. 26. Pricing <ul><li>Type </li></ul><ul><li>Region </li></ul><ul><li>Platform </li></ul><ul><li>On-Demand/Reserved/Spot </li></ul><ul><li>Paid AMI </li></ul><ul><li>Instance-hours </li></ul><ul><li>EBS volumes/snapshots </li></ul>
    26. 27. Elasticity & Agility <ul><li>EBS </li></ul><ul><li>EIP </li></ul><ul><li>VPC </li></ul><ul><li>EMR </li></ul><ul><li>ELB </li></ul><ul><li>Auto Scaling </li></ul><ul><li>CloudWatch </li></ul><ul><li>Beanstalk </li></ul>
    27. 28. EC2 Customers <ul><li>Zynga </li></ul><ul><li>Playfish </li></ul><ul><li>Reddit </li></ul><ul><li>Myspace </li></ul><ul><li>Netflix </li></ul><ul><li>Justin.tv </li></ul><ul><li>Animoto </li></ul><ul><li>Heroku </li></ul>
    28. 29. TimesMachine
    29. 30. break;
    30. 31. S3 S ave a picture OK S ave a DVD disc OK S ave a Bluray disc OK
    31. 37. Serving from own domain or CloudFront
    32. 38. Pricing * Prices are calculated per GB ** Requests and Bandwidth also incur charges Storage us-east, eu-west, ap-se us-west ap-ne Standard RRS Standard RRS Standard RRS First 1 TB $0.140 $0.093 $0.154 $0.103 $0.150 $0.100 1~ 50 TB $0.125 $0.083 $0.139 $0.093 $0.135 $0.090 50 ~ 500 TB $0.110 $0.073 $0.124 $0.083 $0.120 $0.080 500 ~ 1000 TB $0.095 $0.063 $0.109 $0.073 $0.105 $0.070 1000 ~ 5000 TB $0.080 $0.053 $0.095 $0.063 $0.090 $0.060 5000+ TB $0.055 $0.037 $0.070 $0.047 $0.065 $0.044
    33. 39. Simple & Reliable <ul><li>Buckets & Objects </li></ul><ul><li>Capacity : ∞ </li></ul><ul><li>High Scalability, Availability, Durability </li></ul><ul><li>REST/SOAP/BT </li></ul><ul><li>ACL/metadata/RRS </li></ul><ul><li>Integrate with other AWS services </li></ul>
    34. 40. S3 Customers <ul><li>Amazon </li></ul><ul><li>Dropbox </li></ul><ul><li>Twitter </li></ul><ul><li>Smugmug </li></ul><ul><li>Yelp </li></ul><ul><li>Ubuntu One </li></ul><ul><li>Zmanda </li></ul><ul><li>Tumblr </li></ul>
    35. 41. Distinction <ul><li>Amazon.com’s Experiences </li></ul><ul><li>Real Developers’ Needs </li></ul><ul><li>Full IaaS Products </li></ul><ul><li>Enormous Developer Tools/Libraries </li></ul>
    36. 42. AWS Ecosystem <ul><li>End Users </li></ul><ul><li>Web Sites </li></ul><ul><li>ISVs </li></ul><ul><li>System Integrators </li></ul>
    37. 43. Demo
    38. 44. Alestic AMIs
    39. 45. EC2 Instance Initialization <ul><li>[hank@t400 ~]$ ec2-run-instances ami-7c423c2e -k sg-web -t m1.small -g www -z ap-southeast-1a </li></ul><ul><li>...... i-fd1fd5a8 ami-7c423c2e pending sg-web 0...... </li></ul><ul><li>[hank@t400 ~]$ ec2-describe-instances i-fd1fd5a8 </li></ul><ul><li>...... i-fd1fd5a8 ami-7c423c2e ec2-122-248-220-243.ap-southeast-1.compute.amazonaws.com ...... </li></ul><ul><li>[hank@t400 ~]$ ssh -i sg-web.pem ubuntu@122.248.220.243 </li></ul><ul><li>[ubuntu@ip-10-130-93-73 ~]$ sudo apt-get -y update && apt-get -y install apache2 php5 php5-curl </li></ul>
    40. 46. EC2 Instance Initialization <ul><li>[hank@t400 ~]$ ec2-run-instances ami-7c423c2e -k sg-web -t m1.small -g www -z ap-southeast-1a </li></ul><ul><li>...... i-fd1fd5a8 ami-7c423c2e pending sg-web 0...... </li></ul><ul><li>[hank@t400 ~]$ ec2-describe-instances i-fd1fd5a8 </li></ul><ul><li>...... i-fd1fd5a8 ami-7c423c2e ec2-122-248-220-243.ap-southeast-1.compute.amazonaws.com ...... </li></ul><ul><li>[hank@t400 ~]$ ssh -i sg-web.pem ubuntu@122.248.220.243 </li></ul><ul><li>[ubuntu@ip-10-130-93-73 ~]$ sudo apt-get -y update && apt-get -y install apache2 php5 php5-curl </li></ul>LAME! I Want Automatic Initialization
    41. 47. EC2 Instance Initialization <ul><li>#!/usr/bin/env bash </li></ul><ul><li>set -ex </li></ul><ul><li>sudo apt-get -y update </li></ul><ul><li>sudo apt-get -y install apache2 php5 php5-curl </li></ul><ul><li># install AWS SDK </li></ul><ul><li># install application code </li></ul><ul><li># get public-ipv4 from EC2 instance metadata </li></ul><ul><li>public_ipv4 = $(wget -qO- 169.254.169.254/latest/meta-data/public-ipv4) </li></ul><ul><li># do something useful with $public_ipv4 </li></ul><ul><li># more initializations ... </li></ul><ul><li>&quot;init-web.sh&quot; </li></ul>
    42. 48. EC2 Instance Initialization <ul><li>[hank@t400 ~]$ ec2-run-instances ami-7c423c2e -k sg-web -t m1.small -g www -z ap-southeast-1a -f init-web.sh </li></ul><ul><li>...... i-c10fc594 ami-7c423c2e pending sg-web 0...... </li></ul><ul><li>[hank@t400 ~]$ ec2-describe-instances i-c10fc594 </li></ul><ul><li>...... i-c10fc594 ami-7c423c2e ec2-122-248-221-187.ap-southeast-1.compute.amazonaws.com ...... </li></ul><ul><li>[hank@t400 ~]$ curl 122.248.221.187 </li></ul><ul><li><!doctype html> </li></ul><ul><li><html><head><meta http-equiv=&quot;content-type&quot; content=&quot;text/html; charset=UTF-8&quot;> </li></ul><ul><li><title>My Killer App</title> </li></ul><ul><li>...... </li></ul>
    43. 49. I Need More Computing Power, And I Need It NOW <ul><li>[hank@t400 ~]$ ec2-run-instances ami-12423c40 -k sg-web -t c1.xlarge -g www -z ap-southeast-1a -f init-web.sh -n 10 </li></ul><ul><li>...... i-320c424e ami-12423c40 pending sg-web 0...... </li></ul>
    44. 50. More Work <ul><li>Scheduled Back Up </li></ul><ul><li>Monitor And Alert </li></ul><ul><li>Notify LB, Controller, etc </li></ul><ul><li>Failover </li></ul><ul><li>Multi-AZ, Multi-Region </li></ul><ul><li>Automatically Scale In/Out </li></ul><ul><li>Ceil, Floor, Cool down </li></ul>
    45. 51. AWS Judgment Day
    46. 52. When The Sky Is Falling
    47. 53. AWS Free Usage Tier * Quota are calculated per month Product Quota (for new users, expired in 1 year) EC2 750 instance-hours. (t1.micro, Linux) EBS 10GB , 1M I/Os. (snapshot: 10GB , 10K GETs, 1K PUTs) ELB 750 LoadBalancer-hours, 15GB data processing S3 5GB standard storage, 20K GETs, 2K PUTs Network 15GB in and 15GB out. (except CloudFront) Product Quota (for all AWS users, does not expire) SimpleDB 25 Machine hours, 1GB storage SQS 100K requests SNS 100K requests. (notification: 100K HTTPs, 1K emails) SES 2K emails/day call from EC2 CloudWatch 1M requests, 10 alarms, 10 metrics Network 1GB in and 1GB out. (except CloudFront)
    48. 54. If I have seen further it is by standing on the shoulders of giants http://en.wikipedia.org/wiki/File:Orion_aveugle_cherchant_le_soleil.jpg
    49. 55. break;
    50. 56. My AWS Book ;) <ul><li>ISBN : 9789861992792 </li></ul>
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×