Download as PDF, PPTX
Uploaded byYan Cui
Serveless Design Patterns (Serverless Computing London)
The document discusses serverless design patterns, highlighting the benefits of serverless architecture, such as cost efficiency, scalability, and reduced operational responsibilities. It covers various AWS services like Lambda, API Gateway, and Kinesis, and emphasizes the importance of understanding patterns and constraints rather than solely following them. Additionally, it touches on event-driven architectures and best practices for implementing serverless solutions, including authentication, monitoring, and performance optimization.
More Related Content
Similar to Serveless Design Patterns (Serverless Computing London)
Serveless Design Patterns (Serverless Computing London)
- 1. @theburningmonk#aws #awslambda #serverless ServerlessDesign Patterns Yan Cui @theburningmonk
- 2.
- 3.
- 10. Gojko Adzic It isserverless the same way WiFi is wireless. http://bit.ly/2yQgwwb
- 11. Serverless means… don’t payfor it if no-one uses it don’t need to worry about scaling don’t need to provision and manage servers
- 12. “Function-as-a-Service” AWS Lambda Azure Functions GoogleCloud Functions Auth0 Webtask Spotinst Functions Kubeless IBM Cloud Functions
- 13.
- 14. AWS Lambda API GatewayIOT SNS Kinesis CloudWatch
- 15.
- 16.
- 17.
- 18. SERVERLESS WILL FUNDAMENTALLY CHANGEHOW WE BUILD BUSINESS AROUND TECHNOLOGY AND HOW YOU CODE. Simon Wardley
- 19. more Scalable (and scalesfaster!)
- 20. Cheaper (don’t pay foridle servers)
- 21. Resilience (built-in redundancy andmulti-AZ)
- 22. idea production choose language +framework master language + framework figure out deployment configure AMI configure ELB configure autoscaling capacity planning over-provision for launch are we doing microservices? configure CI/CD
- 23. idea production choose language +framework master language + framework figure out deployment configure AMI configure ELB configure autoscaling capacity planning over-provision for launch are we doing microservices? configure CI/CD
- 24. idea production greater Velocityfrom idea to product
- 25.
- 26. Less ops responsibilityon your shoulders
- 28.
- 29. events are anenabler for COMPOSABILITY
- 30.
- 32.
- 33.
- 34. DESIGN PATTERNS DONOT GUARANTEE SUCCESS
- 35. Pattern /pat(ə)n/ A pattern isthe repeated or regular way in which something happens or is done.
- 36.
- 37. there are nosilver bullets
- 38. UNDERSTAND YOUR PROBLEMS ANDCONSTRAINTS OVER FOLLOWING A PATTERN. me
- 39. Pattern /pat(ə)n/ A pattern isthe repeated or regular way in which something happens or is done.
- 40.
- 45. available in Austria,Switzerland, Germany, Japan, Canada, Italy and US
- 46. available on 30+platforms
- 47.
- 48. We’re hiring! Visit engineering.dazn.com tolearn more. follow @dazneng for updates about the engineering team
- 49. follow @dazneng for updatesabout the engineering team We’re hiring! Visit engineering.dazn.com to learn more. WE’RE HIRING!
- 50. AWS user since2009
- 51. AWS user since2009
- 52.
- 53.
- 55.
- 56.
- 57.
- 58.
- 61.
- 62.
- 63.
- 64. AWS Lambda CloudWatchLogs AWS Lambda
- 65.
- 66. AWS Lambda CloudWatchLogs CloudTrail
- 67.
- 70. AWS Lambda CloudWatchLogs CloudWatch Events CloudTrail AWS Lambda
- 71. AWS Lambda CloudWatchLogs CloudWatch Events CloudTrail AWS Lambda AWS Lambda
- 72. AWS Lambda CloudWatchLogs CloudWatch Events CloudTrail AWS Lambda AWS Lambda
- 73. auto-update CloudWatch retentionpolicy auto-create alarms for new APIs auto-create dashboards for new APIs alert on suspicious console logins alert on EC2 activities in unused regions …
- 74.
- 75.
- 76. API Gateway AWSLambda DynamoDBRoute53 CloudFront S3 Browser
- 77. API Gateway AWSLambda DynamoDBRoute53 CloudFront S3 Browser Cognito
- 78. Federated Identities Sync User Flows Registration Verify email/phone Securesign-in Forgotten password Change password Sign out Cognito User Pools
- 79. Federated Identities Sync Leading Practices Secure passwordhandling with SRP protocol Encrypt all data server-side Password policies Token-based authentication MFA Support CAPTCHA Cognito User Pools
- 80. Cognito Federated Identities Cognito User Pools FacebookTwitterGoogle … identity providers authenticate
- 81. Cognito Federated Identities Cognito User Pools FacebookTwitterGoogle … identity providers authenticate token
- 82. Cognito Federated Identities Cognito User Pools FacebookTwitterGoogle … identity providers authenticate token token
- 83. validate Cognito Federated Identities Cognito User Pools FacebookTwitterGoogle … identity providers authenticate token token
- 84. validate Cognito Federated Identities Cognito User Pools FacebookTwitterGoogle … identity providers authenticate token token IAM credential
- 85. validate Cognito Federated Identities Cognito User Pools FacebookTwitterGoogle … identity providers API Gateway S3 DynamoDB SNSIOT Kinesis authenticate token token IAM credential IAM credential
- 86. what about Multi-Regionsupport?
- 87.
- 88.
- 89. API Gateway AWSLambda DynamoDB Route53 CloudFront S3 Browser API Gateway AWS Lambda eu-west-1 us-east-1
- 90.
- 91.
- 92.
- 93.
- 94.
- 95.
- 96. S3 BucketsKinesis StreamsKinesis Firehose KMS MacieIAM
- 97. S3 BucketsKinesis Streams AWSLambda KMS MacieIAM Kinesis Firehose
- 98. S3 BucketsKinesis Streams AWSLambda KMS MacieIAM AWS Lambda Kinesis Firehose
- 99. S3 BucketsKinesis Streams AWSLambda AWS Lambda KMS MacieIAM AWS Lambda Kinesis Firehose
- 100. S3 BucketsKinesis Streams AWSLambda AWS Lambda KMS MacieIAM AWS Lambda DynamoDB ElasticSearch Kinesis Firehose
- 101. S3 BucketsKinesis Streams AWSLambda AWS Lambda KMS MacieIAM AWS Lambda Google BigQuery Kinesis Firehose
- 102. S3 BucketsKinesis Streams AWSLambda AWS Lambda Athena QuickSight KMS MacieIAM AWS Lambda Kinesis Firehose
- 103. S3 BucketsKinesis Streams AWSLambda AWS Lambda Athena QuickSight KMS MacieIAM AWS Lambda Kinesis Firehose
- 104.
- 105.
- 106.
- 107. Kinesis API Gateway AWSLambda API GatewayAWS Lambda service-A service-B
- 108. Kinesis API Gateway AWSLambda API GatewayAWS Lambda service-A service-B
- 109. Kinesis API Gateway AWSLambda API GatewayAWS Lambda service-A service-B AWS Lambda AWS Lambda AWS Lambda
- 110. Kinesis API Gateway AWSLambda API GatewayAWS Lambda service-A service-B AWS Lambda AWS Lambda AWS Lambda DynamoDBIOT
- 111. Kinesis API Gateway AWSLambda API GatewayAWS Lambda service-A service-B AWS Lambda AWS Lambda AWS Lambda DynamoDBIOT
- 112. Kinesis API Gateway AWSLambda API GatewayAWS Lambda service-A service-B AWS Lambda AWS Lambda AWS Lambda DynamoDBIOT AWS Lambda AWS Lambda
- 113.
- 114. service A serviceB service C service D bounded context bounded context
- 115. service A serviceB service C service D bounded context bounded context
- 116. service A serviceB service C service D
- 118. service A serviceB service C service D
- 119. service A serviceB service C service D
- 121. service A serviceB service C service Dbackward-compatible?
- 123. bounded context DON’T useevents to orchestrate workflows within the same bounded context
- 124. bounded context adds unnecessary complexityto logging, tracing, and end-to-end reporting
- 125. bounded context the workflowdoesn’t exist as a standalone concept, but as the sum of a series of loosely connected parts
- 126. Step Functions use StepFunctions instead
- 127. Step Functions don’t forgetto emit events from the workflow
- 128. Step Functions so otherscan react to state changes that happened as part of the workflow
- 129.
- 130. Decoupled Invocation How cana service handle normal request loads, peak request loads, and a continuous period of high load without failing?
- 131. business logic requiresexpensive processing
- 132. API Gateway max integrationtimeout is 29 seconds http://amzn.to/2BwW5Bx
- 133. downstream systems notas scalable
- 135. decouple reply fromthe initial request
- 136.
- 137.
- 138. workerAPIClient POST /do_something 202 /result_location GET/result_location 202 /result_location do work
- 139. workerAPIClient POST /do_something 202 /result_location GET/result_location 202 /result_location do work work done
- 140. workerAPIClient POST /do_something 202 /result_location GET/result_location 202 /result_location do work work done GET /result_location 200 OK
- 141.
- 143. allows fast responseback to caller whilst promises to finish work later
- 145. allows flexible retrystrategies by removing the urgency of having to reply to caller right away
- 146. DynamoDB API Gateway POST task idcreated at result xxx xxx <null> xxx xxx <null> … … … task results not ready PutItem
- 147. DynamoDB API Gateway POST task idcreated at result xxx xxx <null> xxx xxx <null> … … … task results not ready SQS
- 148. DynamoDB API Gateway 202 task idcreated at result xxx xxx <null> xxx xxx <null> … … … task results not ready SQS
- 149. use “created at”timestamp to timeout polling requests and avoid infinite retry
- 150. DynamoDBAPI Gateway GET task idcreated at result xxx xxx <null> xxx xxx <null> … … … task results not ready SQS
- 151. DynamoDBAPI Gateway 202 task idcreated at result xxx xxx <null> xxx xxx <null> … … … task results not ready SQS
- 152. DynamoDB task id createdat result xxx { … } xxx <null> … … task results done UpdateItem xxx xxx … SQS
- 153. DynamoDBAPI Gateway GET task idcreated at result xxx xxx { … } xxx xxx <null> … … … task results done
- 154.
- 155. control parallelism withLambda reserved concurrency setting
- 156. also consider usingKinesis Streams or DynamoDB Streams as queue
- 157. if you useSNS, make sure to enable maxReceivesPerSecond delivery policy (otherwise, invocation-per-message means no amortisation)
- 158.
- 159.
- 160. one message, manyconsumers
- 161. good for decouplingdata processing
- 162. independent failures partial failuresare easier to manage
- 163. SNS, Kinesis Streams,DynamoDB Streams, etc…
- 164.
- 165. 2 retries thenDLQ SNS
- 166. 2 retries thenDLQ invocation per msg SNS
- 167. 2 retries thenDLQ invocation per msg might run into throttling limits consider impact on downstream SNS
- 168. suffers from temporaryissues
- 169.
- 170.
- 171.
- 172.
- 173.
- 174. retried until success invocationper shard Kinesis
- 175. better handling oftemporary issues
- 176.
- 177.
- 178.
- 179. Kinesis Streams orDynamoDB Streams?
- 180. what is yoursource of truth?
- 181. limited to eventsfrom one table
- 182. records describe DynamoDBevents, not events from your domain
- 183. auto-scales no. ofshards
- 184. cannot extend dataretention beyond 24 hours
- 185. charged based onno. of requests ($0.02 per 100,000 read request units)
- 187. 1 msg/s fora month, 1KB per msg $0.47 1 x 60s x 60m x 24hr x 30days @ $0.014 per mil + 24hrs x 30days @ $0.015 per hr $10.836 1 x 60s x 60m x 24hr x 30days @ $0.5 per mil $1.296 DynamoDB StreamsSNSKinesis Streams 1 Write Capacity Unit @ $0.47 per unit
- 188. 1k msg/s fora month, 1KB per msg 1k x 60s x 60m x 24hr x 30days @ $0.014 per mil + 24hrs x 30days @ $0.015 per hr $47.088 1k x 60s x 60m x 24hr x 30days @ $0.5 per mil $1296.00 DynamoDB StreamsSNSKinesis Streams $470.00 1k Write Capacity Unit @ $0.47 per unit
- 189. DON’T take theseprojections at face value!
- 190.
- 191. no restriction on destinationtarget SNS
- 192. no restriction on destinationtarget need to handle partial failures & retries SNS
- 193.
- 194. pattern for managingfailures where each action has a compensating action for rollback
- 195.
- 196. Begin transaction Start bookhotel request End book hotel request Start book flight request End book flight request Start book car rental request End book car rental request End transaction
- 197. model actions andcompensating actions as Lambda functions
- 198.
- 199.
- 200. state machine inAWS Step Functions as the coordinator for the saga
- 201.
- 202.
- 206. source code availablehere: https://github.com/theburningmonk/lambda-saga-pattern
- 207. API Gateway andKinesis Authentication & authorisation (IAM, Cognito) Testing Running & Debugging functions locally Log aggregation Monitoring & Alerting X-Ray Correlation IDs CI/CD Performance and Cost optimisation Error Handling Configuration management VPC Security Leading practices (API Gateway, Kinesis, Lambda) Canary deployments http://bit.ly/prod-ready-serverless get 40% off with: ytcui
- 208. @theburningmonk theburningmonk.com github.com/theburningmonk API Gateway andKinesis Authentication & authorisation (IAM, Cognito) Testing Running & Debugging functions locally Log aggregation Monitoring & Alerting X-Ray Correlation IDs CI/CD Performance and Cost optimisation Error Handling Configuration management VPC Security Leading practices (API Gateway, Kinesis, Lambda) Canary deployments http://bit.ly/prod-ready-serverless get 40% off with: ytcui