Measuring The Clouds

Measuring the Clouds
Guy Rosen – Jack of all Clouds
Image credit: flickr/mugley

Agenda
Introductions
Part I
Website Enumeration
Q&A
Part II
Resource ID Analysis
Rumors and Revelations
Q&A
Image credit: filckr/childofwar

@guyro

Co-founder, cloud startup
Blogger, JackOfAllClouds.com

You can take the guy out of development, but…
Image credit: flickr/helico

What is Cloud Computing?
Image credit: flickr/ferran-jorda

Part I: Website Enumeration
Image credit: flickr/skibler

Is it in the cloud?
Given a site…
Reverse DNS
IP block / WHOIS
Image credit: flickr/pagedooley

Reverse DNS
> host mydrifts.com
mydrifts.com has address 75.101.155.188
> host 75.101.155.188
188.155.101.75.in-addr.arpadomain name pointer ec2-75-101-155-188.compute-1.amazonaws.com.
Image credit: flickr/nico_

WHOIS
> host ohmygov.com
ohmygov.com has address 173.1.162.2
> whois 173.1.162.2
GoGrid NET-173-1-160-0-1173.1.160.0 - 173.1.175.255
Image credit: flickr/brownspan

Now we just need…
… a big list of sites!
 Quantcast top 500,000
Not covered:
WWW site not in the cloud
Backend / back office
Research & Development
etc.

And the winner is…
Image credit: flickr/adelvinphotography

So what’s next?
More providers
vCloud Express
Regional
More data sets
Global base
Definition of cloud?

@guyro
guy@guyrosen.com
JackOfAllClouds.com
Image credit: flickr/laurakgibbs

Part II: Resource ID Analysis
Image credit: Wikimedia/Galen Parks Smith

Amazon EC2 Resource IDs
Instance i-31a74258
Reservation r-01764c79
Volume vol-d62bddbf
Snapshot snap-b9ab03d0
Image ami-11ca2d78
Image credit: flickr/malingering

Is there a pattern?
Image credit: flickr/auntiep

A few sleepless nights later…
Image credit: flickr/aaronjacobs

Anatomy of an EC2 Resource ID
Image credit: Wikimedia / Lienhard Schulz

i-31a74258

Type Instance
i – instance
r – reservation
vol – EBS volume
snap – EBS snapshot
ami – Amazon machine image
i-31a74258

Type Instance
Inner Marker  Inner ID: 0258
XOR with 4000
i-31a74258

Type Instance
Series Marker  Series ID: 00
XOR with leftmost digits of Inner Marker
(42) then XOR with e5
i-31a74258

Type Instance
SuperseriesMarkerSuperseries ID: 00
XOR with rightmost digits of Inner Marker
(58) then XOR with 69
i-31a74258

Type Instance
SuperseriesMarkerSuperseriesID: 00
Instance 00-00-0258
i-31a74258

Quirks, Notes & Caveats
Instance IDs are always sometimes even
Reservation IDs too
Each EC2 region is entirely separate
Different constants
It’s all circumstantial!
Image credit: flickr/kubina

Show us the results already!
Image credit: flickr/photocapy

What do Amazon say?
Officially:
Nothing.
Off the record:
Plausible
Image credit: flickr/markgee6

EC2 Rumors & Revelations
From Randy Bias (CloudScaling.com)
40,000 servers
16.25MW total power (servers only)
95,000 sq ft (servers only)
Target cost/server: $2,000-$2,500
Utilization rate was 70-75%
Image credit: flickr/takomabibelot

EC2 Rumors & Revelations
Inferred Revenues:
$220M / year
Amazon Other Revenue for 6mo: $260M (+10% Y/Y)
Est. Cloud IaaS market:$400-600M, 10-20% Y/Y growth (during a downturn!)
Image credit: flickr/takomabibelot

Conclusions?
Cloud infrastructure is growing – fast!
Amazon Web Services leads the pack
This is only the beginning…
Image credit: flickr/jphillipson

Conclusions?
Image credit: flickr/jphillipson

@guyro
guy@guyrosen.com
JackOfAllClouds.com
Image credit: flickr/kimberlyfaye