Essential open source tools for serverless developers

ESSENTIAL
OPEN SOURCE
TOOLS FOR THE
#SERVERLESS
DEVELOPER

@theburningmonk theburningmonk.com

https://lumigo.io/blog/comparison-of-lambda-deployment-frameworks

don’t write your own deployment framework

no extensibility

great for infratructure
(VPCs, networking, etc.)
terribly unproductive for
constructing a serverless
application

DON’T automate what you don’t understandDON’T automate what you don’t understand

beware of vanity features

A brogrammer is a male programmer
with traits often associated with
fraternity brothers (bros) …
Brogrammers

“Python is not real code. Real programmers use Java.”

“…the c in iac is stand for code while in Serverless it’s stand for
conﬁguration because the serverless.yml is no really a code”

qualities you should care about IAC

syntactic correctness implies
semantic correctness
only one way to interpret things

concise

concise
interoperable

https://forrestbrazeal.com/2020/01/05/code-wise-cloud-foolish-avoiding-bad-technology-choices

https://acloud.guru/series/serverlessconf-nyc-2019/view/yaml-better

Picking a deployment framework because it lets you write Javascript is
like picking a car because it has red seats. Your priorities are WRONG!

Yan Cui
http://theburningmonk.com
@theburningmonk
AWS user for 10 years

Yan Cui
@theburningmonk
Developer Advocate @

Yan Cui
@theburningmonk
Independent Consultant
advisetraining delivery

https://theburningmonk.com/courses

https://serverless.com/plugins

https://github.com/functionalone/serverless-iam-roles-per-function

https://github.com/serverless-heaven/serverless-webpack

https://theburningmonk.com/2019/03/just-how-expensive-is-the-full-aws-sdk

https://github.com/dherault/serverless-offline

https://github.com/amplify-education/serverless-domain-manager

https://github.com/horike37/serverless-step-functions

API Gateway trigger
Events trigger
Schedule trigger

CloudWatch Alarms
CloudWatch Notiﬁcations

Validation
Blug-green deployment
Express Workﬂows

https://github.com/fernando-mc/serverless-finch

https://github.com/OlafConijn/AwsOrganizationFormation

https://github.com/OlafConijn/AwsOrganizationFormation
Accounts
Org Units
SCPs
Pwd Policies
Multi-Region
Pseudo-Funs
Init & Validate
CI/CD

https://github.com/lumigo-io/lumigo-cli

list lambda functions

analyze lambda costs

analyze lambda cold starts

tune lambda memory setting

tail DynamoDB stream

tail SQS queue

tail SNS topic

tail EventBridge bus & rule

replay SQS DLQ events

whoami & switch-profile

https://github.com/lambci/docker-lambda

https://github.com/middyjs/middy

secrets should NEVER be in plain text in env variables

SSM Parameter Store
Secret 1
Secret 2
IAM
Environment:
SECRET_1: …
SECRET_2: …
Environment:
SECRET_1: …
SECRET_2: …

SSM Parameter Store
Secret 1
Secret 2
IAM
Environment:
SECRET_1: …
SECRET_2: …
Environment:
SECRET_1: …
SECRET_2: …
yay!

SSM Parameter Store
Secret 1
Secret 2
IAM
fetch at cold start,
cache,
invalidate every x mins

SSM Parameter Store
Secret 1
Secret 2
IAM
switch to Higher
Throughput if you need
more than 40 ops/s

https://github.com/getndazn/dazn-lambda-powertools

use middleware to auto-capture incoming correlation IDs

extract correlation IDs from
invocation event, and store them in
the correlation-ids module
reset

intercepts and extracts correlation IDs

automatically include extracted correlation IDs

HTTP and AWS SDK clients to auto-forward correlation IDs on

context.awsRequestId
get-index

context.awsRequestId x-correlation-id
get-index

{
“headers”: {
“x-correlation-id”: “…”
},
…
}
get-index

{
“body”: null,
“resource”: “/restaurants”,
“headers”: {
“x-correlation-id”: “…”
},
…
}
get-index get-restaurants

get-restaurants
global.CONTEXT
global.CONTEXT
x-correlation-id = …
x-correlation-xxx = …
get-index
headers[“User-Agent”]
headers[“Debug-Log-Enabled”]
headers[“User-Agent”]
headers[“Debug-Log-Enabled”]
headers[“x-correlation-id”]
capture
forward
function
event
log.info(…)

CloudWatch Logs
$0.50 per GB ingested
$0.03 per GB archived per month

CloudWatch Logs
$0.50 per GB ingested
$0.03 per GB archived per month
1M invocation of a 128MB function =
$0.000000208 * 1M + $0.20 =
$0.408

DON’T leave debug logging ON in production

have to redeploy ALL the
functions along the call path to
collect all relevant debug logs

sampling decision is forwarded on
and followed by the entire call chain

SARServerless Application Repository

https://go.aws/2t3rQ7a

https://go.aws/2NZ8dUW

https://go.aws/38HAqYe

https://go.aws/2tyBjDH

https://go.aws/2TAQhno

https://go.aws/38KynD1

serverless-iam-roles-per-function
serverless-webpack
serverless-ofﬂine
serverless-domain-manager
serverless-step-functions
serverless-ﬁnch
org-formation
lumigo-cli
docker-lambda
middy
dazn-lambda-powertools
lambda-janitor
aws-lambda-power-tuning
s3-lambda-publisher-sns
auto-subscribe-log-group-to-arn
auto-set-log-group-retention
sfn-callback-urls

https://theburningmonk.com/hire-me
AdviseTraining Delivery
“Fundamentally, Yan has improved our team by increasing our
ability to derive value from AWS and Lambda in particular.”
Nick Blair
Tech Lead

https://theburningmonk.com/workshops
Amsterdam, March 19-20 Helsinki, May 4-5 Stockholm, May 14-15
Dublin, June 16-17 London, September 24-25 Berlin, October 8-9

Production-Ready Serverless

bit.ly/prod-ready-sls-stockholm-2020
20% off with
awscommday-0131

Essential open source tools for serverless developers

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Essential open source tools for serverless developers

Similar to Essential open source tools for serverless developers (20)

More from Yan Cui

More from Yan Cui (19)

Recently uploaded

Recently uploaded (20)

Essential open source tools for serverless developers