Measuring The Clouds

  • 2,077 views
Uploaded on

Presentation initially delivered to an IGT workshop, summarizing cloud infrastructure research as conducted and published on www.jackofallclouds.com.

Presentation initially delivered to an IGT workshop, summarizing cloud infrastructure research as conducted and published on www.jackofallclouds.com.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
2,077
On Slideshare
0
From Embeds
0
Number of Embeds
2

Actions

Shares
Downloads
0
Comments
0
Likes
11

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Measuring the Clouds
    Guy Rosen – Jack of all Clouds
    Image credit: flickr/mugley
  • 2. Agenda
    Introductions
    Part I
    Website Enumeration
    Q&A
    Part II
    Resource ID Analysis
    Rumors and Revelations
    Q&A
    Image credit: filckr/childofwar
  • 3. @guyro
    • Co-founder, cloud startup
    • 4. Blogger, JackOfAllClouds.com
    You can take the guy out of development, but…
    Image credit: flickr/helico
  • 5. What is Cloud Computing?
    Image credit: flickr/ferran-jorda
  • 6. Part I: Website Enumeration
    Image credit: flickr/skibler
  • 7. Is it in the cloud?
    Given a site…
    Reverse DNS
    IP block / WHOIS
    Image credit: flickr/pagedooley
  • 8. Reverse DNS
    > host mydrifts.com
    mydrifts.com has address 75.101.155.188
    > host 75.101.155.188
    188.155.101.75.in-addr.arpadomain name pointer ec2-75-101-155-188.compute-1.amazonaws.com.
    Image credit: flickr/nico_
  • 9. WHOIS
    > host ohmygov.com
    ohmygov.com has address 173.1.162.2
    > whois 173.1.162.2
    GoGrid NET-173-1-160-0-1173.1.160.0 - 173.1.175.255
    Image credit: flickr/brownspan
  • 10. Now we just need…
    … a big list of sites!
     Quantcast top 500,000
    Not covered:
    WWW site not in the cloud
    Backend / back office
    Research & Development
    etc.
  • 11. And the winner is…
    Image credit: flickr/adelvinphotography
  • 12. And the winner is…
    Image credit: flickr/adelvinphotography
  • 13. And the winner is…
    Image credit: flickr/adelvinphotography
  • 14. So what’s next?
    More providers
    vCloud Express
    Regional
    More data sets
    Global base
    Definition of cloud?
  • 15. @guyro
    guy@guyrosen.com
    JackOfAllClouds.com
    Image credit: flickr/laurakgibbs
  • 16. Part II: Resource ID Analysis
    Image credit: Wikimedia/Galen Parks Smith
  • 17. Amazon EC2 Resource IDs
    Instance i-31a74258
    Reservation r-01764c79
    Volume vol-d62bddbf
    Snapshot snap-b9ab03d0
    Image ami-11ca2d78
    Image credit: flickr/malingering
  • 18. Is there a pattern?
    Image credit: flickr/auntiep
  • 19. Is there a pattern?
    Image credit: flickr/auntiep
  • 20. Is there a pattern?
    Image credit: flickr/auntiep
  • 21. A few sleepless nights later…
    Image credit: flickr/aaronjacobs
  • 22. Anatomy of an EC2 Resource ID
    Image credit: Wikimedia / Lienhard Schulz
  • 23. Anatomy of an EC2 Resource ID
    i-31a74258
    Image credit: Wikimedia / Lienhard Schulz
  • 24. Anatomy of an EC2 Resource ID
    Type Instance
    i – instance
    r – reservation
    vol – EBS volume
    snap – EBS snapshot
    ami – Amazon machine image
    i-31a74258
    Image credit: Wikimedia / Lienhard Schulz
  • 25. Anatomy of an EC2 Resource ID
    Type Instance
    Inner Marker  Inner ID: 0258
    XOR with 4000
    i-31a74258
    Image credit: Wikimedia / Lienhard Schulz
  • 26. Anatomy of an EC2 Resource ID
    Type Instance
    Inner Marker  Inner ID: 0258
    Series Marker  Series ID: 00
    XOR with leftmost digits of Inner Marker
    (42) then XOR with e5
    i-31a74258
    Image credit: Wikimedia / Lienhard Schulz
  • 27. Anatomy of an EC2 Resource ID
    Type Instance
    Inner Marker  Inner ID: 0258
    Series Marker  Series ID: 00
    SuperseriesMarkerSuperseries ID: 00
    XOR with rightmost digits of Inner Marker
    (58) then XOR with 69
    i-31a74258
    Image credit: Wikimedia / Lienhard Schulz
  • 28. Anatomy of an EC2 Resource ID
    Type Instance
    Inner Marker  Inner ID: 0258
    Series Marker  Series ID: 00
    SuperseriesMarkerSuperseriesID: 00
    Instance 00-00-0258
    i-31a74258
    Image credit: Wikimedia / Lienhard Schulz
  • 29. Quirks, Notes & Caveats
    Instance IDs are always sometimes even
    Reservation IDs too
    Each EC2 region is entirely separate
    Different constants
    It’s all circumstantial!
    Image credit: flickr/kubina
  • 30. Show us the results already!
    Image credit: flickr/photocapy
  • 31. Show us the results already!
    Image credit: flickr/photocapy
  • 32. Show us the results already!
    Image credit: flickr/photocapy
  • 33. What do Amazon say?
    Officially:
    Nothing.
    Off the record:
    Plausible
    Image credit: flickr/markgee6
  • 34. EC2 Rumors & Revelations
    From Randy Bias (CloudScaling.com)
    40,000 servers
    16.25MW total power (servers only)
    95,000 sq ft (servers only)
    Target cost/server: $2,000-$2,500
    Utilization rate was 70-75%
    Image credit: flickr/takomabibelot
  • 35. EC2 Rumors & Revelations
    Inferred Revenues:
    $220M / year
    Amazon Other Revenue for 6mo: $260M (+10% Y/Y)
    Est. Cloud IaaS market:$400-600M, 10-20% Y/Y growth (during a downturn!)
    Image credit: flickr/takomabibelot
  • 36. Conclusions?
    Cloud infrastructure is growing – fast!
    Amazon Web Services leads the pack
    This is only the beginning…
    Image credit: flickr/jphillipson
  • 37. Conclusions?
    Image credit: flickr/jphillipson
  • 38. @guyro
    guy@guyrosen.com
    JackOfAllClouds.com
    Image credit: flickr/kimberlyfaye