Lambda projects can grown really fast from a small POC using one or two functions, to huge projects, with dozens of functions, creating new and unique challenges to manage. This session will focus on the unique challenges with managing Lambda projects and integrating them into CI/CD pipelines.

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Boaz Ziniman, Technical Evangelist, AWS
CI/CD for AWS Lambda Projects
CTO Club JLM - May 2018
@ziniman
boaz.ziniman.aws

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
About me
• Technical Evangelist at AWS
• Events & Meetsup
• Webinars
• Blogs
• Com2bb.munity
• Social Media
• A long history of Web Development, IT and Operations
• AWS Customer since 2009

3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Agenda
- Intro
- Dev iteration loop
- Author (application and code)
- Test
- Debug
- Serverless Deployments

4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Serverless applications
ANYTHING
Changes in
data state
Requests to
endpoints
Changes in
resource state
EVENT SOURCE FUNCTION
Node.js
Python
Java
C#
Go

5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Serverless means…
No servers to provision
or manage
Scales with usage
Never pay for idle Availability and fault
tolerance built in

6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Web application
Data stored in
Amazon
DynamoDB
Dynamic content
in AWS Lambda
Amazon API
Gateway
Browser
Amazon
CloudFront
Amazon
S3
Amazon Cognito

7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Streaming data ingestion
Amazon CloudWatch:
Delivery metrics
Amazon S3:
Buffered files
Kinesis
Agent
Record
Producers Amazon Redshift:
Table loads
Amazon Elasticsearch Service:
Domain loads
Amazon S3:
Source record backup
AWS Lambda:
Transformations &
enrichment
Amazon DynamoDB:
Lookup tables
Raw records
Lookup
Transformed records
Transformed recordsRaw records
Amazon Kinesis Firehose:
Delivery stream

8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Operations Automation
RDP from
0.0.0.0/0
RDP from
0.0.0.0/0
CloudWatch Event Bus in
another AWS Account
New Security Group ingress rule Amazon CloudWatch Events:
Rule
AWS Lambda:
Remediate and alert
AWS SNS:
Email alert
Ingress rule deleted

9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
FINRA

10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ALM for serverless applications
Author Build Test DeployDebugTest
CI/CD
Source
Author/test/debug

11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Author/test/debug
Author Test Debug
Simple app
No team members
No code repo
What if:

12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
New and improved Lambda console
• Cloud9 editor within the Lambda console
• Function graph
• Persisted test events
• Monitoring view (jump to logs for any timeframe)
New

13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Author/Test/Debug cycle
Author
C o d e A p p l i c a t i o n
Test Debug

14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Meet
SAM!

15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Serverless Application Model (SAM)
• CloudFormation extension optimized for serverless
• New serverless resource types: functions, APIs, and tables
• Supports anything CloudFormation supports
• Open specification (Apache 2.0)

16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CloudFormation
• Provision and manage a collection of related AWS resources.
• Your application = CloudFormation stack
• Input .yaml file and output provisioned AWS resources

17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
C o d eA p p l i c a t i o n
Test Debug
Author/Test/Debug cycle
Wait, what about test
and debug?
AuthorAuthor

18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Testing serverless apps - challenges
- Test in an environment that resembles Lambda:
- OS
- Libraries
- Runtime
- Configured limits (memory, timeout)
- Mimic response and log outputs

19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Testing serverless apps - challenges
- Test events need to be:
- Syntactically accurate
- Different for each trigger

20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Introducing SAM Local
CLI tool for local testing of serverless apps
Leverages Docker images to mimic Lambda’s
execution environment
Emulates Lambda functions and APIs
Event generator to help you generate event
payload for common Lambda triggers
sam local generate-event s3 --bucket <bucket> --key <key>

21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Introducing SAM Local
Response object and function logs available on
your local machine
Supports live debugging
Currently supports Java, Node.js and Python
SAM Local is open source & accepting pull
requests!
https://github.com/awslabs/aws-sam-local
npm install –g aws-sam-local

22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Cloud9
• Cloud-based dev environment
• Write, test and debug with just a browser
• Optimized for serverless
New

23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Author
C o d eA p p l i c a t i o n
Test Debug
Author/Test/Debug cycle

24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
</>
GitHub
Amazon S3
AWS CodeCommit
AWS CodeBuild AWS CodeBuild
Third-party tools
AWS CloudFormation
Source Build Test Deploy
Deploying serverless applications

25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo App – RateMyTalk Chatbot
AWS LambdaAmazon Lex
Amazon DynamoDB
Amazon ES

26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo App – RateMyTalk Chatbot
AWS CodeDeployAWS CodeBuild
AWS CodePipeline

27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo App – RateMyTalk Chatbot
AWS
CodeDeploy
AWS
CodeBuild
AWS
CodePipeline
AWS CodeStar

28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo

29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
https://aws.amazon.com/serverless/developer-tools/

30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Feedback
Rate talk (CI/CD for AWS Lambda Projects)
boaz.ziniman.aws

31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thanks!
Boaz Ziniman, Technical Evangelist, AWS
@ziniman
boaz.ziniman.aws