This document discusses strategies for testing serverless applications both locally and in the cloud. It outlines pros and cons of each approach and recommends a hybrid strategy of testing certain services locally like API Gateway and Lambda functions for easy debugging and short deploy times while testing other services like DynamoDB and S3 in the cloud for a production-like environment. It also provides tips for effective testing such as using distributed tracing, load testing, and testing cold starts and function memory allocation.

1. Avishai Shafir
VP Product, Lumigo.io
Serverless Testing

2. UIUI
UnitUnit
ComponentComponent
Testing
Pyramid

3. UIUI
TextUnit
ComponentComponent
Component
Integration
API
Component
Stay the same
UI
Stay the same
Unit
Testing
SLS
Pyramid

4. Local VS. Cloud

5. 1. Serverless Framework
2. SAM (Lambda, APIGW, Step Functions)
3. Lambda-local
4. LocalStack
5. JawsLocalServer
6. https://github.com/sportarchive/aws-
lambda-python-local
7. https://github.com/lambci/docker-lambda
8. Azure Functions Core Tools
Local
Testing
Tools

6. 1. Fast
2. Cheap
3. Easier to debug
ProsLocal
Testing
1. Latest ?
2. Different configuration
3. Not everything can be mocked
Cons

7. 1. DynamoDB
2. S3
3. Kinesis
4. Cognito
Services – on CloudHybrid
1. API Gateway
2. Lambda
Functions – Local
Easy Debug, Short deploy time

8. • Production like
• Account per developer
• Cost
• Deploy time
Cloud
Testing

9. Test The
Limits

10. TWEAK YOUR FUNCTION’S COMPUTING POWER
TEST
https://www.jeremydaly.com/15-key-takeaways-from-the-serverless-talk-
at-aws-startup-day/

11. Correlation Between Components
When
There is
A Bug

12. TRACE Manually add trace-id

13. TRACE
Manually add trace-id
• https://opentracing.io/
• https://opencensus.io/
• https://www.jaegertracing.io/

14. Use distributed
tracing automation
platform like
Lumigo.io
TRACE

15. • Don’t test locally
• Large Packages – consider layers
• Load Test (serverless-artillery)
• Test cold warm start
• Split Test Dev Prod accounts
• Test functions memory allocation
Summery

16. Thank You
Avishai@Lumigo.io
@avshafir
https://lumigo.io
Design Dev Test Deploy Monitor Troubleshoot Learn