Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to 7 things you should know before going serverless
Similar to 7 things you should know before going serverless (20)
Recently uploaded
Recently uploaded (20)
7 things you should know before going serverless
- 1. 7 Things you need to know before going serverless Erez Berkner, CEO & Co-Founder @erezberkner
- 2. 2 What gives us the right?
- 3. 3 Design Dev Test Deploy Monitor Trace Learn
- 4. 4 1. DESIGN
- 6. COLD STARTS Taken from: AWS re:Invent 2017: Become a Serverless Black Belt: Optimizing Your Serverless Appli (SRV401) https://www.youtube.com/watch?v=oQFORsso2go&feature=youtu.be&t=8m5s DESIGN a. Occurrence 0.2% (@chrismunns) b. Impact up to 15 sec (!) 6
- 7. COLD STARTS RECOMMENDATIONS DESIGN Is it relevant to you? 7 Monitor & Alert Remember new version impact Keep Lambdas warm: Reduce package size Prefer Python / Node / Go over Java / .NET Get Lambda out of VPC
- 8. DESIGN Is it relevant to you? Monitor 8 Remember new version impact Keep Lambdas warm: Reduce package size Prefer Python / Node / Go over Java / .NET Get Lambda out of VPC COLD STARTS RECOMMENDATIONS
- 9. DESIGN Is it relevant to you? Monitor & Alert New version impact 9 Keep Lambdas warm: Reduce package size Prefer Python / Node / Go over Java / .NET Get Lambda out of VPC COLD STARTS RECOMMENDATIONS
- 10. DESIGN Is it relevant to you? Monitor & Alert Remember new version impact Keep Lambdas warm https://www.npmjs.com/package/lambda-warmer by @jeremyDaly or https://github.com/FidelLimited/serverless-plugin-warmup 10 Reduce package size Prefer Python / Node / Go over Java / .NET Get Lambdas out of VPC COLD STARTS RECOMMENDATIONS
- 11. DESIGN Is it relevant to you? Monitor & Alert Remember new version impact Keep Lambdas warm: Reduce packages (use http://browserify.org/ or https://www.npmjs.com/package/serverless-plugin-optimize) 11 Prefer Python / Node / Go over Java / .NET Get Lambda out of VPC COLD STARTS RECOMMENDATIONS http://bit.ly/ColdStartResearch
- 12. DESIGN Is it relevant to you? Monitor & Alert Remember new version impact Keep Lambdas warm: Reduce package size Prefer Python / Node / Go over Java / .NET 12 Get Lambda our of VPC COLD STARTS RECOMMENDATIONS
- 13. DESIGN Is it relevant to you? Monitor & Alert New version impact Keep Lambdas warm: Reduce package size Prefer Python / Node / Go over Java / .NET Get Lambdas out of VPC 13 COLD STARTS RECOMMENDATIONS
- 14. DESIGN 14 Get Lambdas out of VPC Taken from: How to manage Lambda VPC cold starts and deal with that killer latency https://medium.freecodecamp.org/lambda-vpc-cold-starts-a-latency-killer- 5408323278dd
- 17. DESIGN LAMBDA CONCURRENCY How to estimate? Poll streamed-based Concurrency = average execution duration * number of streams Amazon Kinesis Data Streams Amazon DynamoDB Poll non-stream-based (SQS) Concurrency = average execution duration * Message batch non-poll-based (S3, API GW) Concurrency = average execution duration * invocations per second Amazon Simple Queue Service Amazon Simple Storage Service (S3) Amazon API Gateway 17
- 19. 2/14/2019 DESIGN LOAD TEST ! DON’T (In production) 19 CONCURRENCY RECOMMENDATIONS
- 21. DESIGN 21 CONCURRENCY RECOMMENDATIONS Need more Lambda concurrency? Ask AWS to increase limits Reduce duration Filter Lambda triggers Set limits
- 22. DESIGN 22 CONCURRENCY RECOMMENDATIONS Need more Lambda concurrency? Ask AWS to increase limits Reduce duration Filter Lambda triggers Set limits
- 23. DESIGN 23 CONCURRENCY RECOMMENDATIONS Need more Lambda concurrency? Ask AWS to increase limits Reduce duration Filter Lambda triggers Set limits
- 24. DESIGN 24 CONCURRENCY RECOMMENDATIONS Need more Lambda concurrency? Ask AWS to increase limits Reduce duration Filter Lambda triggers (Amazon SNS Message Filtering, S3 prefix/suffix filters) Set limits
- 25. 2/14/2019 2. DEV ENVIRONMENT 25 1. DESIGN
- 27. Maintain visual Map of the architecture https://cloudcraft.co/ DEV 27
- 28. 2/14/201928 2. DEV 1. DESIGN 3. TEST
- 29. TEST 29 Test in the cloud (not locally)
- 30. TWEAK YOUR FUNCTION’S COMPUTING POWER TEST https://www.jeremydaly.com/15-key-takeaways-from-the-serverless-talk-at-aws-startup-day/ 30
- 31. 2/14/201931 2. DEV 1. DESIGN 3. TEST 4. DEPLOY
- 32. DEPLOY 32 Use canary gradual deployment • API Gateway Canary Release • Use weighted aliases and CodeDeploy. • Beware of canary deployment of multiple functions
- 33. 2/14/201933 2. DEV 1. DESIGN 3. TEST 4. DEPLOY 5. MONITOR
- 34. Export your logs to something ELKish! MONITOR 34 (Logz.io – https://logz.io/blog/cloudwatch-lambda-shipper/)
- 36. 2/14/201936 2. DEV 1. DESIGN 3. TEST 4. DEPLOY 5. MONITOR 6. TRACE
- 37. TRACE 37
- 38. 38 2. DEV 1. DESIGN 3. TEST 4. DEPLOY 5. MONITOR 6. TRACE 7. LEARN
- 39. LEARN LEARN 39 Yan Cui @theburningmonk https://theburningmonk.com/ Chris Munns @chrismunns Principal Developer Advocate Paul Johnston @PaulDJohnston co-founders of ServerlessDays
- 40. ANNOUNCEMENT: ISRAEL’S BIG SERVERLESS SURVEY 40 http://bit.ly/ServerlessSurvey
- 41. THANK YOU erez@lumigo.io | @erezberkner
- 42. 7 Things you need to know before going serverless Erez Berkner, CEO & Co-Founder @erezberkner
Editor's Notes
- Load test! (and remember ENI limitations for Lambda’s within the VPC) Don’t load test in production! – set up a different account for dev and staging. Monitor your concurrent executions and set up alert thresholds (“Concurrentexecutions” and “UnreservedConcurrentExecutions” metrics in CW) Need more concurrency? Reduce Lambda duration (e.g. increase Lambda resources) Limit & Reserve the simultaneous execution of a specific Lambda Consider other regions with higher concurrency limits Open a ticket to AWS
- Use Serverless deployment tools (Stackery/SLS framework/ SAM/CF) – don’t deploy / write code with AWS console
- Use Serverless deployment tools (Stackery/SLS framework/ SAM/CF) – don’t deploy / write code with AWS console
- Use Serverless deployment tools (Stackery/SLS framework/ SAM/CF) – don’t deploy / write code with AWS console