This document summarizes a study of 250 companies' use of Amazon Web Services. It finds that many companies are underutilizing resources and not using reserved instances, which could save significant costs if used for at least three months. Specifically, only 33% of instances are reserved, but 94% could be. It also finds that medium instances have very low 12% utilization rates on average, and companies would save money by using small instances instead.
2. Study Goals
Web Browser Market Share
• Benchmark industry public cloud
costs and utilization
• Enable buyers to improve
operational efficiency based on
cloud utilization best practices
• Leverage previously unavailable
sources of Big Data to provide
market insights
THE BIG DATA GROUP 2
3. Study Data
Web Browser Market Share
• 250 companies
• 250,000 Amazon EC2 instances
• 7,543,955 instance hours
• 2.5PB of storage
• Measured Oct 1 - 31, 2012
THE BIG DATA GROUP 3
4. Key Findings
Web Browser Market Share
Public cloud buyers Many instances are underutilized. Significant storage goes unattached. Many
can achieve buyers are reluctant to purchase reserved instances, which can provide cost
significant savings savings when used for at least three months.
by optimizing usage
• 33% of instances are running as reserved
instances but some 94% should be
• 17% of storage is unattached (unused)
• Elastic Cloud compute resources account for
more spend (at 62% of total spend) than any
other resource type
THE BIG DATA GROUP 4
5. Instance Definitions
Web Browser Market Share
For the purposes of this study, instances were grouped into Small, Medium, Large,
and Huge instance types. The instances included in each type are shown below.
Type Instances
t1.micro, m1.small, c1.medium,
Small m1.medium
Medium m1.large, m2.xlarge
m1.xlarge, c1.xlarge,
Large m2.2xlarge, m2.4xlarge
cc1.4xlarge, cc2.8xlarge,
Huge hi1,4xlarge, cg1.4xlarge
THE BIG DATA GROUP 5
6. Launched Instances By Type
Web Browser Market Share
The majority of Small instances account for about 42% of launched instances, medium for about
launched instances 40%, large for just over 17%, and huge instances for under 1%.
are small and mid
sized.
0.44%
17%
42%
40%
Small Medium Large Huge
THE BIG DATA GROUP 6
7. Instance Runtime By Type
Web Browser Market Share
Small instances account for 53% of instance runtime hours while medium
instances account for 29%.
Huge
Large 1%
18%
Small
53%
Medium
29%
THE BIG DATA GROUP 7
8. Launched And Runtime Instances
Web Browser Market Share
Smaller instances Small instances account for 53% of instance runtime hours compared with 42% of
account for more launched instances. Medium instances account for 29% of instance runtime hours
hours run compared compared with 40% of launched instances.
with the number that
are launched
Launched Instances Runtime Instances
Third Quarter 2012 Third Quarter 2012
Huge
Large Huge Large 0.64%
17% 0.44% 18%
Small Small
42% 53%
Medium Medium
40% 29%
THE BIG DATA GROUP 8
9. Average Instance Utilization Rates
Web Browser Market Share
Most customers use Medium instances are only about 12% utilized while small instances are just under
medium instances 17% utilized. The low utilization rates of medium instances combined with medium
when they should instances accounting for some 40% of launched instances means that most
customers use medium instances when they should use small instances instead.
use small instances
16.7%
12.8%
11.9%
3.9%
Small Medium Large Huge
THE BIG DATA GROUP 9
10. Top Cloud Spend Categories
Web Browser Market Share
EC2 Instances Amazon Web Services customers in the sample group spend more on EC2
account for the instances than on any other type of resource.
majority of spend
EC2 Instances
64%
EBS Volumes
7%
RDS Databases
3%
S3 Estimated
26%
Note: S3 Data is based on a smaller set of randomly selected customers
THE BIG DATA GROUP 10
11. Deployment Size Breakdown
Web Browser Market Share
The majority of public Some 44% of customers operate 1 - 10 instances per month while 45% operate
cloud customers 11 - 100 instances per month.
operate between 1
and 100 instances
per month
44%
45% 1-10 instances/mo
11-100 instances/mo
101-500 instances/mo
501+ instances/mo
1%
10%
THE BIG DATA GROUP 11
12. Reserved And Unreserved Instances
Web Browser Market Share
Most customers Only 33% of instances are reserved today, while some 94% of instances, if
underutilize reserved converted to reserved instances, would result in expected cost savings.
instances, losing out
on significant cost Reserved and Unreserved Instances Reserved Instances - Actual and Recommended
savings Third Quarter 2012 Third Quarter 2012
94%
Reserved
33%
Unreserved 33%
67%
Actual Recommended
THE BIG DATA GROUP 12
13. Top Reasons Customers Avoid Reserved Instances
Web Browser Market Share
Many reasons buyers Many buyers are reluctant to purchase reserved instances, which provide significant cost
cite for not savings when used for between three and seven months. Projects typically last twice as
purchasing reserved long as buyers expect and buyers tend to stay with the same instance size for at least half
a year, making the purchase of reserved instances worthwhile.
instances prove
financially unsound
• Expect project to run only for a short
time
• Undecided about proper instance size
• Lack of time to purchase
• Fear of commitment to reserved
instances
THE BIG DATA GROUP 13
14. Emerging Trends
Web Browser Market Share
• Amazon RDS has not gained widespread adoption,
likely due to the difficulty of moving to and from RDS
databases and the inability to sync only specific
database tables
• Amazon Glacier, which is 10X cheaper than Simple
Storage Service (S3) but significantly slower, is
expected to replace a lot of S3 storage for digital
archiving
• The Reserved Instance Marketplace will need changes
to gain widespread adoption
The marketplace lacks significant volume today because it is
relatively new and because a company needs to have a US bank
account to use it. In the future, without changes, we do not expect
the marketplace to gain significant volume because prices tend to
go down over the reservation term, making the resale of reserved
instances at originally committed prices uncompetitive with lower
prices at the time of resale
THE BIG DATA GROUP 14
15. Recommendations For Buyers
Web Browser Market Share
Customers can
achieve significant
• Evaluate
cost savings through
proper public cloud • Applicability of reserved instances
management
• Any unattached storage
• Instance sizes relative to utilization
• Consider
• Smaller instances
• Reserved instances
• Retiring unattached storage
• Ensure total response time stays within
acceptable range (1.5 - 2.5 seconds)
THE BIG DATA GROUP 15
16. For More Information
Web Browser Market Share
David Feinleib
dave@thebigdatagroup.com
THE BIG DATA GROUP 16