Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Measuring The Clouds

2,602 views

Published on

Presentation initially delivered to an IGT workshop, summarizing cloud infrastructure research as conducted and published on www.jackofallclouds.com.

  • Be the first to comment

Measuring The Clouds

  1. 1. Measuring the Clouds<br />Guy Rosen – Jack of all Clouds<br />Image credit: flickr/mugley<br />
  2. 2. Agenda<br />Introductions<br />Part I<br />Website Enumeration<br />Q&A<br />Part II<br />Resource ID Analysis<br />Rumors and Revelations<br />Q&A<br />Image credit: filckr/childofwar<br />
  3. 3. @guyro<br /><ul><li>Co-founder, cloud startup
  4. 4. Blogger, JackOfAllClouds.com</li></ul>You can take the guy out of development, but…<br />Image credit: flickr/helico<br />
  5. 5. What is Cloud Computing?<br />Image credit: flickr/ferran-jorda<br />
  6. 6. Part I: Website Enumeration<br />Image credit: flickr/skibler<br />
  7. 7. Is it in the cloud?<br />Given a site…<br />Reverse DNS<br />IP block / WHOIS<br />Image credit: flickr/pagedooley<br />
  8. 8. Reverse DNS<br />&gt; host mydrifts.com<br />mydrifts.com has address 75.101.155.188<br />&gt; host 75.101.155.188<br />188.155.101.75.in-addr.arpadomain name pointer ec2-75-101-155-188.compute-1.amazonaws.com.<br />Image credit: flickr/nico_<br />
  9. 9. WHOIS<br />&gt; host ohmygov.com<br />ohmygov.com has address 173.1.162.2<br />&gt; whois 173.1.162.2<br />GoGrid NET-173-1-160-0-1173.1.160.0 - 173.1.175.255<br />Image credit: flickr/brownspan<br />
  10. 10. Now we just need…<br />… a big list of sites!<br /> Quantcast top 500,000<br />Not covered:<br />WWW site not in the cloud<br />Backend / back office<br />Research & Development<br />etc.<br />
  11. 11. And the winner is…<br />Image credit: flickr/adelvinphotography<br />
  12. 12. And the winner is…<br />Image credit: flickr/adelvinphotography<br />
  13. 13. And the winner is…<br />Image credit: flickr/adelvinphotography<br />
  14. 14. So what’s next?<br />More providers<br />vCloud Express<br />Regional<br />More data sets<br />Global base<br />Definition of cloud?<br />
  15. 15. @guyro<br />guy@guyrosen.com<br />JackOfAllClouds.com<br />Image credit: flickr/laurakgibbs<br />
  16. 16. Part II: Resource ID Analysis<br />Image credit: Wikimedia/Galen Parks Smith<br />
  17. 17. Amazon EC2 Resource IDs<br />Instance i-31a74258<br />Reservation r-01764c79<br />Volume vol-d62bddbf<br />Snapshot snap-b9ab03d0<br />Image ami-11ca2d78<br />Image credit: flickr/malingering<br />
  18. 18. Is there a pattern?<br />Image credit: flickr/auntiep<br />
  19. 19. Is there a pattern?<br />Image credit: flickr/auntiep<br />
  20. 20. Is there a pattern?<br />Image credit: flickr/auntiep<br />
  21. 21. A few sleepless nights later…<br />Image credit: flickr/aaronjacobs<br />
  22. 22. Anatomy of an EC2 Resource ID<br />Image credit: Wikimedia / Lienhard Schulz<br />
  23. 23. Anatomy of an EC2 Resource ID<br />i-31a74258<br />Image credit: Wikimedia / Lienhard Schulz<br />
  24. 24. Anatomy of an EC2 Resource ID<br />Type Instance<br />i – instance<br />r – reservation<br />vol – EBS volume<br />snap – EBS snapshot<br />ami – Amazon machine image<br />i-31a74258<br />Image credit: Wikimedia / Lienhard Schulz<br />
  25. 25. Anatomy of an EC2 Resource ID<br />Type Instance<br />Inner Marker  Inner ID: 0258<br />XOR with 4000<br />i-31a74258<br />Image credit: Wikimedia / Lienhard Schulz<br />
  26. 26. Anatomy of an EC2 Resource ID<br />Type Instance<br />Inner Marker  Inner ID: 0258<br />Series Marker  Series ID: 00<br /> XOR with leftmost digits of Inner Marker<br /> (42) then XOR with e5<br />i-31a74258<br />Image credit: Wikimedia / Lienhard Schulz<br />
  27. 27. Anatomy of an EC2 Resource ID<br />Type Instance<br />Inner Marker  Inner ID: 0258<br />Series Marker  Series ID: 00<br />SuperseriesMarkerSuperseries ID: 00<br /> XOR with rightmost digits of Inner Marker<br /> (58) then XOR with 69<br />i-31a74258<br />Image credit: Wikimedia / Lienhard Schulz<br />
  28. 28. Anatomy of an EC2 Resource ID<br />Type Instance<br />Inner Marker  Inner ID: 0258<br />Series Marker  Series ID: 00<br />SuperseriesMarkerSuperseriesID: 00<br />Instance 00-00-0258<br />i-31a74258<br />Image credit: Wikimedia / Lienhard Schulz<br />
  29. 29. Quirks, Notes & Caveats<br />Instance IDs are always sometimes even<br />Reservation IDs too<br />Each EC2 region is entirely separate<br />Different constants<br />It’s all circumstantial!<br />Image credit: flickr/kubina<br />
  30. 30. Show us the results already!<br />Image credit: flickr/photocapy<br />
  31. 31. Show us the results already!<br />Image credit: flickr/photocapy<br />
  32. 32. Show us the results already!<br />Image credit: flickr/photocapy<br />
  33. 33. What do Amazon say?<br />Officially:<br /> Nothing.<br />Off the record:<br /> Plausible<br />Image credit: flickr/markgee6<br />
  34. 34. EC2 Rumors & Revelations<br />From Randy Bias (CloudScaling.com)<br />40,000 servers<br />16.25MW total power (servers only)<br />95,000 sq ft (servers only)<br />Target cost/server: $2,000-$2,500<br />Utilization rate was 70-75%<br />Image credit: flickr/takomabibelot<br />
  35. 35. EC2 Rumors & Revelations<br />Inferred Revenues:<br />$220M / year<br />Amazon Other Revenue for 6mo: $260M (+10% Y/Y)<br />Est. Cloud IaaS market:$400-600M, 10-20% Y/Y growth (during a downturn!)<br />Image credit: flickr/takomabibelot<br />
  36. 36. Conclusions?<br />Cloud infrastructure is growing – fast!<br />Amazon Web Services leads the pack<br />This is only the beginning…<br />Image credit: flickr/jphillipson<br />
  37. 37. Conclusions?<br />Image credit: flickr/jphillipson<br />
  38. 38. @guyro<br />guy@guyrosen.com<br />JackOfAllClouds.com<br />Image credit: flickr/kimberlyfaye<br />

×