WTIA Cloud Computing Series - Part II: Scaling into the Cloud with Amazon Web Services

Adam Selipsky Vice President Amazon Web Services

Amazon’s Core Businesses Retail Business Tens of millions of active customer accounts Seven countries: US, UK, Germany, Japan, France, Canada, China Seller Business Sell on Amazon websites Use Amazon technology for your own retail website Leverage Amazon’s massive fulfillment center network Developers & IT Professionals On-demand compute and storage infrastructure for hosting web-scale solutions Over 490,000 registered developers

How Did Amazon Get Into This?

Amazon is fundamentally a technology company

Years spent building a modular, loosely coupled infrastructure

Started experimenting with web services in 2002

Developers asked how Amazon could help with infrastructure pain

What Do Developers Want?

Design Principles Reliable Scalable Low-Latency Easy to Use Inexpensive

Amazon Web Services (AWS)

Amazon Simple Storage Service (S3)

Amazon Elastic Compute Cloud (EC2)

Amazon SimpleDB

Amazon CloudFront

Amazon Simple Queue Service (SQS)

Amazon Flexible Payments Service (FPS)

Amazon Mechanical Turk

What Were Our Biggest Surprises?

AWS Customer Momentum 490,000 Q4 2008 370,000 Q1 2008 240,000 Q1 2007 160,000 Q1 2006

AWS Usage Growth 2001 2002 2003 2004 2005 2006 2007 2008 Bandwidth consumed by Amazon Web Services Bandwidth consumed by Amazon’s global websites

Amazon S3 Momentum Peak Requests: 70,000 per second 200 Million 5 Billion 18 Billion 40 Billion

Diverse Use Cases

Web Site/ Application Hosting

Media Distribution

Storage, Backup, Disaster Recovery

Content Delivery

High-Performance Computing

Software Development/Testing

Diverse Customer Roster

Great Partner Momentum

Why Are People So Excited?

What You Want

Your Idea

Successful Product

Reality

Your Idea

Successful Product

Undifferentiated “Heavy Lifting”

Heavy Lifting = Price of Admission Server hosting Bandwidth management Contract negotiation Purchase decisions Moving facilities Scaling and managing physical growth Heterogeneous hardware Legacy software Coordinating large teams

It Gets Worse…

Improvement Loop

Your Idea

Successful Product

Undifferentiated “Heavy Lifting”

AWS Eliminates the Heavy Lifting On-Premise Infrastructure AWS Cloud-Based Infrastructure Your Business More Time to Focus on Your Business Managing All of the “Heavy Lifting” Configuring Your Cloud Assets The AWS cloud provides reliable and dependable on-demand infrastructure that frees time and expense for you to focus on innovating for your business. 30% 70% 30% 70%

Advantages of the AWS Cloud

Offloads Heavy Lifting

Eliminates time and hassle of configuring data centers

Lowers Costs

Eliminates up-front capital expenses and gives you low, pay-as-you-go pricing

Reduces Time to Market

Access capacity only when you need it; great for quick development and pilot projects

Trends We’re Seeing

Use of multiple services in one application

EC2, S3, and SQS usage is very common

Massive datasets & large-scale parallel processing

Hundreds of terabytes of data per application

Hadoop, Condor, MPI Blast

Enterprise adoption on the rise

Financial services, sales force automation, high performance computing, corporate websites

Increased need for support and transparency

Service Health Dashboard

Premium Developer Support

Running more sophisticated software

IBM, MySQL, Oracle, JBoss

Enterprise stacks and applications

But What About…

Security?

Availability?

Scalability?

Performance?

Quick Case Study:

Typical Dilemma: Predicting Infrastructure Needs Compute Power Time Predicted Usage Actual Usage Waste Customer Dissatisfaction

Animoto and Amazon EC2 Number of EC2 Instances 4/12/2008 Launch of Facebook modification. Amazon EC2 easily scaled to handle additional traffic Peak of 5000 instances 4/14/2008 4/15/2008 4/16/2008 4/18/2008 4/19/2008 4/20/2008 4/17/2008 4/13/2008 Steady state of ~40 instances

Thank You! For more information: aws.amazon.com