In this session, Vice President of AWS Infrastructure Jerry Hunter gives an insider view of some of the innovations that help make the AWS cloud unique. Jerry will show examples of data center, power, and networking innovations used across the AWS platform. Join this session and walk away with a deeper understanding of the underlying innovations powering the cloud.

1. © 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Jerry Hunter, VP of Infrastructure
October 7, 2015
AWS Infrastructure Innovation at Scale
Creating Capacity from Beginning to End
SPOT301

2. What Customers Want
StorageDatabasesServers

7. Tenets of AWS Capacity

8. Tenets of AWS Capacity: On-Demand
On-Demand Capacity

9. Tenets of AWS Capacity: Reliability
Reliability
On-Demand Capacity

10. Tenets of AWS Capacity: Low Cost
ReliabilityLow Cost
On-Demand Capacity

11. The Sweet Spot
On-Demand Capacity
ReliabilityLow Cost

12. 24
48 61
82
159
280
516
2008 2009 2010 2011 2012 2013 2014
516 Major New Features and
Services Launched in 2014

13. 2008 2009 2010 2011 2012 2013 2014
Over 1 Million Active Customers

14. ReliabilityLow Cost
On-Demand Capacity

15. Scale

16. Scale
Better
Capacity

17. Higher
Reliability
Scale
Better
Capacity

18. Lower
Cost
Higher
Reliability
Scale
Better
Capacity

19. Virtuous Cycle
Lower
Cost
Higher
Reliability
Scale
Better
Capacity

20. Not that Long Ago…

21. Not that Long Ago…
• 11-15% utilization

22. Not that Long Ago…
• 19% utilization

23. Not that Long Ago…
• 19% utilization
• 81% idle

24. Not that Long Ago…
• 19% utilization
• 81% idle
• Lots of meetings

25. Not that Long Ago…
• 19% utilization
• 81% idle
• Lots of meetings
• 3 to 9 months to
deploy apps

26. Partial reliability

27. Partial reliability
Unnecessary and
missing features

28. Partial reliability
Unnecessary and
missing features
Outages

29. Poor Utilization

30. Capacity not
Available

31. Vicious Cycle

32. So how does scale change things?

33. Capacity

34. Datacenters
Capacity

35. Step #1: Land

36. Step #2: Power

37. Step #2: Power

38. Power at Scale

39. Power Infrastructure
• Power generation facilities
• Negotiated PPAs
• Commitment to renewable
energy sources

40. Amazon Wind Farm (Fowler Ridge)
• Indiana
• January 2015
• Pattern Development
• 150 MW wind

41. Amazon Solar Farm US East
• East Virginia
• June 2015
• Community Energy
• 80 MW solar

42. Amazon Wind Farm US East
• North Carolina
• July 2015
• Iberdrola
• 208 MW wind

43. November 2014 Announce commitment to 100% renewable energy
April 2015
Achieved 25% renewable milestone
Announced 4.8 MWh battery pilot with Tesla
April 2015
Joined the American Council on Renewable Energy
(ACORE)
April 2015
Announced participation in the U.S. Partnership for
Renewable Energy Finance
End of 2016 Goal of 40% renewable energy for power consumed
AWS Renewable Energy Commitment

44. So how is this more efficient?

45. Cloud Efficiency
Average AWS Customer…
• Uses 77% fewer servers
• Uses 84% less power

46. Cloud Efficiency
NRDC 2014 assessment…
• Cloud companies at 65% utilization

47. Cloud Efficiency
NRDC 2014 assessment…
• Cloud companies at 65% utilization
• On premises at ~15% utilization

48. Cloud Efficiency
NRDC 2014 assessment…
• Cloud companies at 65% utilization
• On premises at ~15% utilization
• 15 ÷ 65 = 23%

49. Cloud Efficiency
Annual Uptime Institute survey…

50. Cloud Efficiency
Annual Uptime Institute survey…
• PUE of 1.7 = enterprise datacenter

51. Cloud Efficiency
Annual Uptime Institute survey…
• PUE of 1.7 = enterprise datacenter
• PUE of 1.07 to 1.15 = cloud datacenter

52. Cloud Efficiency
Annual Uptime Institute survey…
• PUE of 1.7 = enterprise datacenter
• PUE of 1.07 to 1.15 = cloud datacenter
• 1.2 ÷ 1.7 = 71%
• A 29% reduction in power pulled from the grid

53. Cloud Efficiency
What this means…
• 23% x 71% = 16%
• 84% reduction in power

54. Customer Benefit
• 60 million members
• 10 billion streaming hours

55. Customer Benefit
• 60 million members
• 10 billion streaming hours
• ~ 50% renewable

56. Customer Benefit
• 60 million members
• 10 billion streaming hours
• ~ 50% renewable
• Server utilization >50%
• Reduced server costs 85%

57. Step #3: Construction

58. Planning, Design & Construction

59. Planning, Design & Construction

60. Security

61. Security

62. Security

63. Security

64. Security

65. Security

66. Security

67. Step #4: Networks

68. Old World
Why it doesn’t work…
• Complex hardware / software
• Burdened with unnecessary features
• Buggy, slow to fix, slow to improve
• Complexity equals cost

69. Need for a Purpose Build Network
Advantages of purpose-built networks:
• Simple designs at each layer
• Hardware & software not burdened
with unnecessary features
• Simple software = less hardware
• Simplicity = lower cost

70. AZ
AZ
AZ AZ AZ
Purpose Built Network
• Each datacenter has a purpose built
network

71. AZ
AZ
AZ AZ AZ
Purpose Built Network

72. AZ
AZ
AZ AZ AZ
Purpose Built Network

73. AZ
AZ
AZ AZ AZ
Purpose Built Network
• Metro-area DWDM links between AZs
• 82,864 fiber strands in region
• AZs <2ms apart & usually <1ms
• 25+ Tbps inter-AZs peak capacity
• Each datacenter has a purpose built
network

74. AZ
AZ
AZ AZ AZ
Transit
Transit
• Redundant paths to transit centers
• Transit Centers connect to:
• Private links to other AWS regions
• Private links to AWS Direct Connect customers
• Internet through peering & paid transit
Purpose Build Network
• Metro-area DWDM links between AZs
• 82,864 fiber strands in region
• AZs <2ms apart & usually <1ms
• 25+ Tbps inter-AZs peak capacity
• Each datacenter has a purpose built
network

75. AWS Worldwide Network Backbone
• Provides full, direct control
• Reduces cost, complexity, jitter
• Increases performance & availability
• Better Quality of Service (QoS)
• Not over-subscribed and fully alarmed

76. Step #5: Servers

77. Need for Customization
Advantages of purpose-built servers:
• Work directly with component
manufacturers like memory, HDD, CPU
• Design optimized for specific workloads
• Hardware & software not burdened with
unnecessary features
• Highly utilized

78. Importance of Supply Chain

79. Importance of Supply Chain

80. Importance of Supply Chain

81. Importance of Supply Chain

82. Importance of Supply Chain

83. Importance of Supply Chain

84. Importance of Supply Chain

85. Retail Leverage

86. AWS Worldwide Locations

87. AWS Worldwide Locations
Q2 2016 – India
Q3 2016 - Ohio

88. Capacity

89. In Conclusion
• Unprecedented scale and pace of
innovation
• Need for customization at every layer
• Innovating on every dimension of
datacenters
• Value for AWS customers extends
beyond software

90. Thank You
#reInvent

91. Remember to complete
your evaluations!