An insider view of some of the innovations that help make the AWS cloud unique. We will show examples of innovative service offerings and will continue to discuss data center, power, and networking innovations used across the AWS platform. Join this session and walk away with a deeper understanding of the underlying innovations powering the cloud.
8. Infrastructure!
Foundation
Services!
Regions
Availability Zones
Edge POPs
Compute
Storage
Networking &
Content Delivery
Security
& Access
Platform
Services!
Databases
Relational!
NoSQL!
Columnar!
Caching!
Analytics
Hadoop!
Real time!
Data
warehouse!
App Services
Queuing!
Orchestration!
App streaming!
Transcoding!
Email!
Search!
9. Infrastructure!
Foundation
Services!
Regions
Availability Zones
Edge POPs
Compute
Storage
Networking &
Content Delivery
Security
& Access
Platform
Services!
Databases
Relational!
NoSQL!
Columnar!
Caching!
Analytics
Hadoop!
Real time!
Data
warehouse!
App Services
Queuing!
Orchestration!
App streaming!
Transcoding!
Email!
Search!
Deployment & Management
Containers!
Dev/ops!
Templates!
10. Infrastructure!
Foundation
Services!
Regions
Availability Zones
Edge POPs
Compute
Storage
Networking &
Content Delivery
Security
& Access
Platform
Services!
Databases
Relational!
NoSQL!
Columnar!
Caching!
Analytics
Hadoop!
Real time!
Data
warehouse!
App Services
Queuing!
Orchestration!
App streaming!
Transcoding!
Email!
Search!
Deployment & Management
Containers!
Dev/ops!
Templates!
Mobile & Devices
Identity!
Sync!
Analytics!
Notifications!
11. Managed desktop computing service !
in the cloud!
Amazon WorkSpaces!
Delivering on the promise
of desktop virtualization !
Most successful preview, ever!
Infrastructure & admin tools!
End user desktop and mobile apps!
12. Fully managed, secure document storage
and sharing service for the Enterprise!
Amazon WorkDocs!
Secure!
Easy sharing!
Simple document!
feedback!
Access from !
any device!
Integrate your!
corporate directory!
Low cost!
13. Is secure email and calendaring made easy!
Amazon WorkMail!
Managed email and
calendaring solution!
Always available,
anytime, anywhere.!
Integrates with
Amazon WorkDocs!
14. Infrastructure!
Foundation
Services!
Regions
Availability Zones
CDN Points of Presence
Storage
(Object, Block and Archive)
Networking
Security &
Access Control
Platform
Services!
Databases
Relational!
NoSQL!
Columnar!
Caching!
Analytics
Hadoop!
Real-time!
Data
warehouse!
App Services
Queuing!
Orchestration!
App streaming!
Transcoding!
Email!
Search!
Deployment & Management
Containers!
Dev/ops Tools!
Resource
Templates!
Mobile & Devices
Identity!
Sync!
Mobile
Analytics!
Notifications!
Applications! Virtual Desktops
Collaboration and Sharing
Data
Workflows!
Usage
Tracking!
Monitoring
and Logs!
Compute
(VMs, Auto-scaling and Load Balancing)
15. 10 years of innovation!
What sets AWS apart from other providers?!
Breadth and Depth of Services!
16. 10 years of innovation!
What sets AWS apart from other providers?!
Breadth and Depth of Services
Relentless Focus on Cost Reduction!
17. The AWS Price Reduction Philosophy!
51 Price Reductions Since 2006!
Infrastructure
innovation!
Ecosystem!
Global Footprint!
New Features!
New Services!
19. 10 years of innovation!
What sets AWS apart from other providers?!
Breadth and Depth of Services
Relentless Focus on Cost Reduction
Customer Driven Innovation!
20. Small, autonomous teams!
Roadmap ownership!
Decoupled launch schedules!
Small, “Two Pizza”
Teams!
Get Core Functionality in the
Hands of Customers, Quickly!
Operational stability!
High scale!
Limited initial feature set!
Iterate Based on Customer Feedback!
23. Rapid pace of Innovation!
2008 2009 2010 2011 2012 2013 2014
280!
159!
82!
61!
48!
24!
516!
24. 10 years of innovation!
What sets AWS apart from other providers?!
Breadth and Depth of Services
Relentless Focus on Cost Reduction
Customer Driven Innovation
Innovation at Every Level of the Stack!
25. Every day, AWS adds enough new server capacity to
support all of Amazon’s global infrastructure when it was
a $7B annual revenue enterprise!
26. Get Networks Out of the Way!
Relative cost of networking increasing quickly!
• Server & storage prices falling fast!
• Network costs trending to dominate!
Networking frozen in time!
• Vertically integrated ecosystem!
• Indefensible profit margins !
AWS solution:!
• Custom net H/W & protocol stack!
• Private long haul links!
57%
8%
18%
13%
4%
Servers
Networking Equipment
Power Distribu-on & Cooling
Power
Other Infrastructure
Monthly Costs!
3yr server & 10 yr infrastructure amortization!
27.
28. Redundant paths to transit centers!
Transit centers connect to:!
• Private links to other AWS regions!
• Private links to AWS Direct Connect customers!
• Internet through peering & paid transit!
29. Redundant paths to transit centers!
Transit centers connect to:!
• Private links to other AWS regions!
• Private links to AWS Direct Connect customers!
• Internet through peering & paid transit!
82, 864 fiber strands in region!
AZs <2ms apart & usually <1ms!
25Tbps peak inter-AZs traffic!
30. Why Does AWS Offer AZs?!
Asynchronous replication between
distant data centers!
• Committing to an SSD order 1 to 2ms!
• But, LA to New York is 74ms round trip!
• You can’t wait 74ms to commit a transaction!
On failure, difficult & high skill decision:!
• Fail-over & lose transactions, or !
• Don’t fail-over & lose availability!
• Difficult choice!
• Use AZs for no-admin failover!
• Sync works when <2ms!
• Can be combined with regional replication for
very high availability!
!
74ms!
31. 1 of 33 availability zones world-wide!
All regions have 2 or more AZs!
Each AZ is 1 or more DC!
- No data center is in two AZs!
- Some AZs have as many as 6 DCs!
DCs in AZ less than ¼ ms apart!
Data centers & Availability zones!
32. Single DC typically over 50,000
servers & often over 80,000 !
• Larger DCs undesirable (blast
radius)!
• Diminishing returns on scale!
Up to 102Tbps provisioned in to
a single DC!
!
AWS custom network equipment:!
• Multi-ODM sourced!
• Amazon custom network protocol
stack!
33.
34. Remove the “virtualization tax”!
!
NIC supports Supports Single
Root I/O Virtualization!
Much lower latency & less latency jitter!
35. LogarithmicScale
tp0 tp50 tp99 tp99.9 tp00
>2x average
latency
reduction
>10x latency
variability
improvement
Previous
generation
Current
generation
36. OEM servers!
• Very general designs able to run wide variety of workloads!
• Vast, expensive, world-wide distribution network (30% of cost)
!
42. OEM servers!
• Very general designs able to run wide variety of workloads!
• Vast, expensive, world-wide distribution network (30% of cost)
!
43. OEM servers!
• Very general designs able to run wide variety of workloads!
• Vast, expensive, world-wide distribution network (30% of cost)
!
AWS custom servers & storage!
• Specialized servers optimized for a specific workload!
• Move hot software kernels to hardware implementations!
• Custom Intel processors beyond commercially available clock rates!
• DCs, servers, networking, storage designed to integrated specs!
Example Storage Rack
864 disks, 2,350lb
44.
45. Power Infrastructure!
Some DCs with custom power
sub-stations!
• Lower power cost & build more quickly!
• Negotiated power purchasing
agreements!
Custom switchgear firmware!
4 100% carbon neutral regions:!
• US West (Oregon)!
• AWS GovCloud (US)!
• EU (Frankfurt)!
• EU (Ireland)!