Successfully reported this slideshow.
BIG DATA TRENDS:PUBLIC CLOUD COST BENCHMARK STUDY250 COMPANIES250,000 INSTANCES2.5PB OF STORAGETHIRD QUARTER 2012DAVID FEI...
Study Goals                     Web Browser Market Share                     • Benchmark industry public cloud            ...
Study Data                     Web Browser Market Share                     •   250 companies                     •   250,...
Key Findings                        Web Browser Market Share Public cloud buyers    Many instances are underutilized. Sign...
Instance Definitions                     Web Browser Market Share                     For the purposes of this study, insta...
Launched Instances By Type                        Web Browser Market Share      The majority of   Small instances account ...
Instance Runtime By Type                     Web Browser Market Share                     Small instances account for 53% ...
Launched And Runtime Instances                        Web Browser Market Share    Smaller instances   Small instances acco...
Average Instance Utilization Rates                        Web Browser Market Share Most customers use    Medium instances ...
Top Cloud Spend Categories                        Web Browser Market Share      EC2 Instances     Amazon Web Services cust...
Deployment Size Breakdown                         Web Browser Market ShareThe majority of public   Some 44% of customers o...
Reserved And Unreserved Instances                         Web Browser Market Share      Most customers     Only 33% of ins...
Top Reasons Customers Avoid Reserved Instances                           Web Browser Market ShareMany reasons buyers      ...
Emerging Trends                     Web Browser Market Share                     • Amazon RDS has not gained widespread ad...
Recommendations For Buyers                        Web Browser Market Share      Customers can  achieve significant        ...
For More Information                     Web Browser Market Share                      David Feinleib                     ...
Upcoming SlideShare
Loading in …5
×

Big Data Trends: Cloud Cost Benchmark Study

10,263 views

Published on

A study of 250 companies, 250,000 instances, and 2.5 petabytes of data. Key insights about use of reserved instances, the instance marketplace, and top spend categories.

Published in: Technology
  • 3.9% utlization on Large instances? Why do people use them at all? Do you have any insights on what kind of apps run on the instances you monitored? Any pattern on what is the best instance for a given type of app?
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Big Data Trends: Cloud Cost Benchmark Study

  1. 1. BIG DATA TRENDS:PUBLIC CLOUD COST BENCHMARK STUDY250 COMPANIES250,000 INSTANCES2.5PB OF STORAGETHIRD QUARTER 2012DAVID FEINLEIB SPONSORED BYTHE BIG DATA GROUP, LLCthebigdatagroup.com Copyright © 2012 The Big Data Group, LLC bigdatalandscape.com
  2. 2. Study Goals Web Browser Market Share • Benchmark industry public cloud costs and utilization • Enable buyers to improve operational efficiency based on cloud utilization best practices • Leverage previously unavailable sources of Big Data to provide market insightsTHE BIG DATA GROUP 2
  3. 3. Study Data Web Browser Market Share • 250 companies • 250,000 Amazon EC2 instances • 7,543,955 instance hours • 2.5PB of storage • Measured Oct 1 - 31, 2012THE BIG DATA GROUP 3
  4. 4. Key Findings Web Browser Market Share Public cloud buyers Many instances are underutilized. Significant storage goes unattached. Many can achieve buyers are reluctant to purchase reserved instances, which can provide cost significant savings savings when used for at least three months. by optimizing usage • 33% of instances are running as reserved instances but some 94% should be • 17% of storage is unattached (unused) • Elastic Cloud compute resources account for more spend (at 62% of total spend) than any other resource typeTHE BIG DATA GROUP 4
  5. 5. Instance Definitions Web Browser Market Share For the purposes of this study, instances were grouped into Small, Medium, Large, and Huge instance types. The instances included in each type are shown below. Type Instances t1.micro, m1.small, c1.medium, Small m1.medium Medium m1.large, m2.xlarge m1.xlarge, c1.xlarge, Large m2.2xlarge, m2.4xlarge cc1.4xlarge, cc2.8xlarge, Huge hi1,4xlarge, cg1.4xlargeTHE BIG DATA GROUP 5
  6. 6. Launched Instances By Type Web Browser Market Share The majority of Small instances account for about 42% of launched instances, medium for about launched instances 40%, large for just over 17%, and huge instances for under 1%. are small and mid sized. 0.44% 17% 42% 40% Small Medium Large HugeTHE BIG DATA GROUP 6
  7. 7. Instance Runtime By Type Web Browser Market Share Small instances account for 53% of instance runtime hours while medium instances account for 29%. Huge Large 1% 18% Small 53% Medium 29%THE BIG DATA GROUP 7
  8. 8. Launched And Runtime Instances Web Browser Market Share Smaller instances Small instances account for 53% of instance runtime hours compared with 42% of account for more launched instances. Medium instances account for 29% of instance runtime hours hours run compared compared with 40% of launched instances. with the number that are launched Launched Instances Runtime Instances Third Quarter 2012 Third Quarter 2012 Huge Large Huge Large 0.64% 17% 0.44% 18% Small Small 42% 53% Medium Medium 40% 29%THE BIG DATA GROUP 8
  9. 9. Average Instance Utilization Rates Web Browser Market Share Most customers use Medium instances are only about 12% utilized while small instances are just under medium instances 17% utilized. The low utilization rates of medium instances combined with medium when they should instances accounting for some 40% of launched instances means that most customers use medium instances when they should use small instances instead. use small instances 16.7% 12.8% 11.9% 3.9% Small Medium Large HugeTHE BIG DATA GROUP 9
  10. 10. Top Cloud Spend Categories Web Browser Market Share EC2 Instances Amazon Web Services customers in the sample group spend more on EC2 account for the instances than on any other type of resource. majority of spend EC2 Instances 64% EBS Volumes 7% RDS Databases 3% S3 Estimated 26% Note: S3 Data is based on a smaller set of randomly selected customersTHE BIG DATA GROUP 10
  11. 11. Deployment Size Breakdown Web Browser Market ShareThe majority of public Some 44% of customers operate 1 - 10 instances per month while 45% operate cloud customers 11 - 100 instances per month. operate between 1 and 100 instances per month 44% 45% 1-10 instances/mo 11-100 instances/mo 101-500 instances/mo 501+ instances/mo 1% 10%THE BIG DATA GROUP 11
  12. 12. Reserved And Unreserved Instances Web Browser Market Share Most customers Only 33% of instances are reserved today, while some 94% of instances, if underutilize reserved converted to reserved instances, would result in expected cost savings. instances, losing out on significant cost Reserved and Unreserved Instances Reserved Instances - Actual and Recommended savings Third Quarter 2012 Third Quarter 2012 94% Reserved 33% Unreserved 33% 67% Actual RecommendedTHE BIG DATA GROUP 12
  13. 13. Top Reasons Customers Avoid Reserved Instances Web Browser Market ShareMany reasons buyers Many buyers are reluctant to purchase reserved instances, which provide significant cost cite for not savings when used for between three and seven months. Projects typically last twice aspurchasing reserved long as buyers expect and buyers tend to stay with the same instance size for at least half a year, making the purchase of reserved instances worthwhile. instances prove financially unsound • Expect project to run only for a short time • Undecided about proper instance size • Lack of time to purchase • Fear of commitment to reserved instancesTHE BIG DATA GROUP 13
  14. 14. Emerging Trends Web Browser Market Share • Amazon RDS has not gained widespread adoption, likely due to the difficulty of moving to and from RDS databases and the inability to sync only specific database tables • Amazon Glacier, which is 10X cheaper than Simple Storage Service (S3) but significantly slower, is expected to replace a lot of S3 storage for digital archiving • The Reserved Instance Marketplace will need changes to gain widespread adoption The marketplace lacks significant volume today because it is relatively new and because a company needs to have a US bank account to use it. In the future, without changes, we do not expect the marketplace to gain significant volume because prices tend to go down over the reservation term, making the resale of reserved instances at originally committed prices uncompetitive with lower prices at the time of resaleTHE BIG DATA GROUP 14
  15. 15. Recommendations For Buyers Web Browser Market Share Customers can achieve significant • Evaluatecost savings through proper public cloud • Applicability of reserved instances management • Any unattached storage • Instance sizes relative to utilization • Consider • Smaller instances • Reserved instances • Retiring unattached storage • Ensure total response time stays within acceptable range (1.5 - 2.5 seconds)THE BIG DATA GROUP 15
  16. 16. For More Information Web Browser Market Share David Feinleib dave@thebigdatagroup.comTHE BIG DATA GROUP 16

×