AWS CloudSchool | London    March 2012
Hello
Thank you
Understand theservices, tools andpatterns for buildinghighly availableservices in the cloud
There Will Be Code
A brief history ofA prelude          AWS
Consumer    Sellerbusiness   business
Decades of experience Operations, management and             scale
Programmatic access
Unexpected innovation
Blinding flash of  the obvious
Five years young
Infrastructure services
Compute     Storage  Placeholder            ServicesDatabases            & Support
Idea   Results
Idea                   Results       Heavy lifting
ScaleRedundancy                               Orchestration               70% Idea                          Results       ...
30%Idea                    Results       Infrastructure
Idea         Results       AWS
Idea         Results       AWS
Five things I wishI’d known when Iwas gettingstarted.
1: Signing up
On the web
Free tier For new customers:aws.amazon.com/free
750 hours of compute10Gb network attached storage5Gb object storage750 hours of computeKey/value store, notifications,mess...
2: Interacting
API drivenHTTP, REST, SOAP
CLI
ec2-run-instances
SDKJava, Python, Ruby, .Net, PHP,       iOS and Android
Management  console
Linux
Certificate-based  root access
mza$ ssh -i web/us-east/aws-web.pem root@ec2-204-236-247-169.compute-1.amazonaws.comLast login: Wed Jun 22 11:15:20 2011fr...
Windows
Administrator  access
3: Storage options
Ephemeral storage
Included                with              computeEphemeral storage  Lost at                Not backedtermination          ...
When it’s gone,  it’s gone
Elastic Block Store
Network    Mount as attached    volumeElastic Block StoreSnapshot     Persistent
S3Hands-on
Highly                Highlydurable              available          S3       Tolerant to          two      simultaneou
99.999999999%    durability
Objects in S3Billions of objects                                                      762B                      500k peak ...
Charging model
Pay as you go
Gb/month
ECU/hour
No minimum
No subscriptions
Pricing tiers
Consolidated   billing
Options
On-demand
Reservedinstances
Spot MarketHands-on
Bandwidth
Free inbound
Import/Export
Pricing calculator
aws.amazon.com/calculator
5. Availability Zones
us-east-1  us-west-1  us-west-2us-gov-west-1  eu-west-1ap-southeast-1ap-northeast-1  sa-east-1
eu-west-1aeu-west-1b       eu-west-1c
Building blocksFoundational services
Compute
EC2Elastic Compute Cloud
Elastic compute   infrastructureHands-on
ECU:EC2 Compute UnitEquivalent to 1.0 - 1.2 GHz 2007 Opteron              or 2007 Xeon
Instance types
Micro   Cluster$0.02     $2.10
Standard (m1)  1 ECU. 1.7 Gb memory. 160 Gb ephemeral storage.
High memory (m2)Up to 26 ECU. 8 cores. 68.4 Gb memory.       1.69 Tb ephemeral storage.
High CPU (c1)Up to 20 ECU. 8 cores. 7 Gb memory.     1.69 Tb ephemeral storage.
Higher performance
Analytics workloads
Bandwidth intensive
CC:Cluster Compute
Placement groups
Full bisectional  bandwidth
November 2011
GPU computation
CloudWatchIncluded with all instances     and block storage
Custom metrics
Storage
S3Simple Storage Service
Files in directories
Objects in buckets
http://s3.amazonaws.com/bucketname/objectid http://bucketname.s3.amazonaws.com/objectid
https://s3.amazonaws.com/bucketname/objectidhttps://bucketname.s3.amazonaws.com/objectid
Large object support        5Tb
Parallel uploads
Import/Export
Managedencryption
Reducedredundancy storage    99.99% durability
EBSElastic Block Store
Flexible, off-instance block    storage
Scalable 1Gb to 1Tb
Attached to arunning instance  Exposed as a device
Snapshot to S3
Public Datasets
Databases
Databases on EC2
Oracle and MySQL
RDSRelational Database Service
ManagedMySQL/Oracle
Scalable storage
Instance type
Automatic backups
Point in time recovery
High availability
Read replicas
SimpleDBHigh scale. Highly available.    Key/attribute store
No server toprovision or manage
Messaging &notifications
Simple Queue       ServiceHands-on
Simple Notification     Service
Elasticity
Traditionalcapacity is static
Capacity           Predicted capacity                  Estimated                   demand                       Time
Capacity                                Infrastructure                                  Infrastructure                   I...
Capacity                    Infrastructure            Real           demand                                Time
Capacity            Elastic           capacity                 Real                demand                         Time
Businesses are constrained
Removingconstraints
Constrained by      static infrastructure
Unconstrained  by scale
30,000 cores
Unconstrained   by cost
Optimising for    price
On-demand
Reservedcapacity
Light utilisation 15 to 40% utilisationLower costs up to 33%      Use cases:DR, periodic processing
Medium utilisation       The “old” RI   41 to 79% utilisation  Lower costs up to 49%       Use cases:Web apps, heavy proce...
Heavy utilisation            80%+ utilisation         Lower costs up to 59%             Use cases:Databases, HPC, always-o...
Spot InstancesHands-on
On-demand+ Reserved+ Spot
“21st Centuryarchitectures”
Unconstrained   by timeUpcoming demo day, VC meeting, impatience, exploratory “spike”
1 instance    for100 hours
100 instances      for   1 hour
Automation
Application tierCode   Configuration
Application tier       Code                 Configuration                                                      Service tie...
Application tier        Code                    Configuration                                                         Serv...
Value baked into    each tier
Service tierConfiguration & optimisation   Technology choices
Infrastructure tier  Architecture. Configuration.
Automationmaximises this value
CloudFormationHands-on
Template
TemplateDefines a full infrastructure stack
Template   CloudFormation                            Provisioned                             resources
Auto-scaling                                      RDS  EC2        SNS                           SimpleDB  EBS             ...
Complete     definitionAtomic, idempotent provisioning.
BootstrapHands-on
Chef & Puppet
Ensuringsecurity
Sharedresponsibility
Requirementbased access
Certification
ISO 27001
SAS70 Type II
Service OrganisationControls (SOC 1)  SSAE 16 and ISAE 3702
FISMA Moderate
HIPAA
ITARAWS GovCloud (US)
Data access  control  Detailed logging
Data stays local
Identity & Access     ControlHands-on
Account
AccountDBA   Developer   Sys admin   Finance                                         Roles
AccountDBA   Developer   Sys admin   Finance                                         Roles      Sally      Robert         ...
Security credentials Multifactor authenticationManagement console access  Data read/write access     API level access
AccountDBA   Developer   Sys admin   Finance                                         Roles      Sally      Robert         ...
Networking controls
Virtual Private     Cloud
Virtual network    topology
IP address rangePublic and private subnetsRouting tablesNetwork gateways
Network access    control
Inbound ACLsOutbound ACLsIPsec VPN
Public subnetPublic facing website
Public subnet             Network ACLs + security groups                              Private subnetMulti-tier applications
Public subnet                          Private subnet            IPsec VPN                           On-premiseExtend your...
Private subnet            IPsec VPN                           On-premiseExtend your data centre
aws.amazon.com/security
End of Part One
AWS Cloud School | London - Part 1
AWS Cloud School | London - Part 1
AWS Cloud School | London - Part 1
AWS Cloud School | London - Part 1
AWS Cloud School | London - Part 1
AWS Cloud School | London - Part 1
AWS Cloud School | London - Part 1
AWS Cloud School | London - Part 1
AWS Cloud School | London - Part 1
AWS Cloud School | London - Part 1
AWS Cloud School | London - Part 1
AWS Cloud School | London - Part 1
Upcoming SlideShare
Loading in...5
×

AWS Cloud School | London - Part 1

1,246

Published on

Published in: Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,246
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
35
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

AWS Cloud School | London - Part 1

  1. 1. AWS CloudSchool | London March 2012
  2. 2. Hello
  3. 3. Thank you
  4. 4. Understand theservices, tools andpatterns for buildinghighly availableservices in the cloud
  5. 5. There Will Be Code
  6. 6. A brief history ofA prelude AWS
  7. 7. Consumer Sellerbusiness business
  8. 8. Decades of experience Operations, management and scale
  9. 9. Programmatic access
  10. 10. Unexpected innovation
  11. 11. Blinding flash of the obvious
  12. 12. Five years young
  13. 13. Infrastructure services
  14. 14. Compute Storage Placeholder ServicesDatabases & Support
  15. 15. Idea Results
  16. 16. Idea Results Heavy lifting
  17. 17. ScaleRedundancy Orchestration 70% Idea Results Heavy liftingCapacity Management Procurement
  18. 18. 30%Idea Results Infrastructure
  19. 19. Idea Results AWS
  20. 20. Idea Results AWS
  21. 21. Five things I wishI’d known when Iwas gettingstarted.
  22. 22. 1: Signing up
  23. 23. On the web
  24. 24. Free tier For new customers:aws.amazon.com/free
  25. 25. 750 hours of compute10Gb network attached storage5Gb object storage750 hours of computeKey/value store, notifications,messaging
  26. 26. 2: Interacting
  27. 27. API drivenHTTP, REST, SOAP
  28. 28. CLI
  29. 29. ec2-run-instances
  30. 30. SDKJava, Python, Ruby, .Net, PHP, iOS and Android
  31. 31. Management console
  32. 32. Linux
  33. 33. Certificate-based root access
  34. 34. mza$ ssh -i web/us-east/aws-web.pem root@ec2-204-236-247-169.compute-1.amazonaws.comLast login: Wed Jun 22 11:15:20 2011from 82.26.6.99 __| __|_ ) CentOS _| ( / v5.4___|___|___| HVMx64 Welcome to an EC2 Public Image)[root@ip-10-17-135-244 ~]#
  35. 35. Windows
  36. 36. Administrator access
  37. 37. 3: Storage options
  38. 38. Ephemeral storage
  39. 39. Included with computeEphemeral storage Lost at Not backedtermination up
  40. 40. When it’s gone, it’s gone
  41. 41. Elastic Block Store
  42. 42. Network Mount as attached volumeElastic Block StoreSnapshot Persistent
  43. 43. S3Hands-on
  44. 44. Highly Highlydurable available S3 Tolerant to two simultaneou
  45. 45. 99.999999999% durability
  46. 46. Objects in S3Billions of objects 762B 500k peak transactions per second
  47. 47. Charging model
  48. 48. Pay as you go
  49. 49. Gb/month
  50. 50. ECU/hour
  51. 51. No minimum
  52. 52. No subscriptions
  53. 53. Pricing tiers
  54. 54. Consolidated billing
  55. 55. Options
  56. 56. On-demand
  57. 57. Reservedinstances
  58. 58. Spot MarketHands-on
  59. 59. Bandwidth
  60. 60. Free inbound
  61. 61. Import/Export
  62. 62. Pricing calculator
  63. 63. aws.amazon.com/calculator
  64. 64. 5. Availability Zones
  65. 65. us-east-1 us-west-1 us-west-2us-gov-west-1 eu-west-1ap-southeast-1ap-northeast-1 sa-east-1
  66. 66. eu-west-1aeu-west-1b eu-west-1c
  67. 67. Building blocksFoundational services
  68. 68. Compute
  69. 69. EC2Elastic Compute Cloud
  70. 70. Elastic compute infrastructureHands-on
  71. 71. ECU:EC2 Compute UnitEquivalent to 1.0 - 1.2 GHz 2007 Opteron or 2007 Xeon
  72. 72. Instance types
  73. 73. Micro Cluster$0.02 $2.10
  74. 74. Standard (m1) 1 ECU. 1.7 Gb memory. 160 Gb ephemeral storage.
  75. 75. High memory (m2)Up to 26 ECU. 8 cores. 68.4 Gb memory. 1.69 Tb ephemeral storage.
  76. 76. High CPU (c1)Up to 20 ECU. 8 cores. 7 Gb memory. 1.69 Tb ephemeral storage.
  77. 77. Higher performance
  78. 78. Analytics workloads
  79. 79. Bandwidth intensive
  80. 80. CC:Cluster Compute
  81. 81. Placement groups
  82. 82. Full bisectional bandwidth
  83. 83. November 2011
  84. 84. GPU computation
  85. 85. CloudWatchIncluded with all instances and block storage
  86. 86. Custom metrics
  87. 87. Storage
  88. 88. S3Simple Storage Service
  89. 89. Files in directories
  90. 90. Objects in buckets
  91. 91. http://s3.amazonaws.com/bucketname/objectid http://bucketname.s3.amazonaws.com/objectid
  92. 92. https://s3.amazonaws.com/bucketname/objectidhttps://bucketname.s3.amazonaws.com/objectid
  93. 93. Large object support 5Tb
  94. 94. Parallel uploads
  95. 95. Import/Export
  96. 96. Managedencryption
  97. 97. Reducedredundancy storage 99.99% durability
  98. 98. EBSElastic Block Store
  99. 99. Flexible, off-instance block storage
  100. 100. Scalable 1Gb to 1Tb
  101. 101. Attached to arunning instance Exposed as a device
  102. 102. Snapshot to S3
  103. 103. Public Datasets
  104. 104. Databases
  105. 105. Databases on EC2
  106. 106. Oracle and MySQL
  107. 107. RDSRelational Database Service
  108. 108. ManagedMySQL/Oracle
  109. 109. Scalable storage
  110. 110. Instance type
  111. 111. Automatic backups
  112. 112. Point in time recovery
  113. 113. High availability
  114. 114. Read replicas
  115. 115. SimpleDBHigh scale. Highly available. Key/attribute store
  116. 116. No server toprovision or manage
  117. 117. Messaging &notifications
  118. 118. Simple Queue ServiceHands-on
  119. 119. Simple Notification Service
  120. 120. Elasticity
  121. 121. Traditionalcapacity is static
  122. 122. Capacity Predicted capacity Estimated demand Time
  123. 123. Capacity Infrastructure Infrastructure Investment Estimated demand Barrier to entry Time
  124. 124. Capacity Infrastructure Real demand Time
  125. 125. Capacity Elastic capacity Real demand Time
  126. 126. Businesses are constrained
  127. 127. Removingconstraints
  128. 128. Constrained by static infrastructure
  129. 129. Unconstrained by scale
  130. 130. 30,000 cores
  131. 131. Unconstrained by cost
  132. 132. Optimising for price
  133. 133. On-demand
  134. 134. Reservedcapacity
  135. 135. Light utilisation 15 to 40% utilisationLower costs up to 33% Use cases:DR, periodic processing
  136. 136. Medium utilisation The “old” RI 41 to 79% utilisation Lower costs up to 49% Use cases:Web apps, heavy processing
  137. 137. Heavy utilisation 80%+ utilisation Lower costs up to 59% Use cases:Databases, HPC, always-on infrastructure
  138. 138. Spot InstancesHands-on
  139. 139. On-demand+ Reserved+ Spot
  140. 140. “21st Centuryarchitectures”
  141. 141. Unconstrained by timeUpcoming demo day, VC meeting, impatience, exploratory “spike”
  142. 142. 1 instance for100 hours
  143. 143. 100 instances for 1 hour
  144. 144. Automation
  145. 145. Application tierCode Configuration
  146. 146. Application tier Code Configuration Service tier Integration Operating system settingsLaunch configuration Services + configuration
  147. 147. Application tier Code Configuration Service tier Integration Operating system settingsLaunch configuration Services + configuration Infrastructure tier AMIs Architecture Multi-AZScaling rules Security groups Middleware
  148. 148. Value baked into each tier
  149. 149. Service tierConfiguration & optimisation Technology choices
  150. 150. Infrastructure tier Architecture. Configuration.
  151. 151. Automationmaximises this value
  152. 152. CloudFormationHands-on
  153. 153. Template
  154. 154. TemplateDefines a full infrastructure stack
  155. 155. Template CloudFormation Provisioned resources
  156. 156. Auto-scaling RDS EC2 SNS SimpleDB EBS SQS ResourcesElastic Beanstalk CloudWatch Security groups Tags
  157. 157. Complete definitionAtomic, idempotent provisioning.
  158. 158. BootstrapHands-on
  159. 159. Chef & Puppet
  160. 160. Ensuringsecurity
  161. 161. Sharedresponsibility
  162. 162. Requirementbased access
  163. 163. Certification
  164. 164. ISO 27001
  165. 165. SAS70 Type II
  166. 166. Service OrganisationControls (SOC 1) SSAE 16 and ISAE 3702
  167. 167. FISMA Moderate
  168. 168. HIPAA
  169. 169. ITARAWS GovCloud (US)
  170. 170. Data access control Detailed logging
  171. 171. Data stays local
  172. 172. Identity & Access ControlHands-on
  173. 173. Account
  174. 174. AccountDBA Developer Sys admin Finance Roles
  175. 175. AccountDBA Developer Sys admin Finance Roles Sally Robert Users Chris
  176. 176. Security credentials Multifactor authenticationManagement console access Data read/write access API level access
  177. 177. AccountDBA Developer Sys admin Finance Roles Sally Robert Users Chris
  178. 178. Networking controls
  179. 179. Virtual Private Cloud
  180. 180. Virtual network topology
  181. 181. IP address rangePublic and private subnetsRouting tablesNetwork gateways
  182. 182. Network access control
  183. 183. Inbound ACLsOutbound ACLsIPsec VPN
  184. 184. Public subnetPublic facing website
  185. 185. Public subnet Network ACLs + security groups Private subnetMulti-tier applications
  186. 186. Public subnet Private subnet IPsec VPN On-premiseExtend your data centre
  187. 187. Private subnet IPsec VPN On-premiseExtend your data centre
  188. 188. aws.amazon.com/security
  189. 189. End of Part One

×