Getting started with Serverless on AWS

Serverless – walk the talk
Adrian Hornsby
Technical Evangelist @ AWS
@adhorn

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What is that serverless thing?
Customers actually use it! how?
Show us some demos!
Bag of tricks

AWS Serverless offerings
And more !!
Lambda DynamoDB S3 Kinesis

AWS Lambda

What is Lambda
Functions are the unit of deployment and scaling.

How does a Lambda function looks like?
def hello(event, context):
return {
"message": ”Hello World!",
"event": event
}
'use strict';
handlermodule.exports.hello = (event, context, cb) => cb(null,
{ message: ’Hello World!', event }
);

But what really *is* AWS Lambda?
• Linux containers as an implementation, not a programming or deployment
abstraction
– Process and network isolation, cgroups, seccomp, …
• Predictive capacity management
– Purpose-built, massively scaled language runtime delivery service
• Swagger interpreter (API Gateway)
• Cold vs Hot state

How Lambda works
S3 event
notifications
DynamoDB
Streams
Kinesis
events
Cognito
events
SNS
events
Custom
events
CloudTrail
events LambdaDynamoDB
Kinesis S3
Any custom
Redshift
SNS
CloudWatch
events

Continuous
scaling
No servers to
manage
Never pay for idle
– no cold servers
Benefits of AWS Lambda

Pay-per request
• Buy compute time in
100 ms increments
• Low request charge
• No hourly, daily, or
monthly minimums
• No per-device fees
Never pay for idle!
Free Tier
1 million requests and 400,000 GBs of compute
every month, every customer

Using AWS Lambda
Bring your own code
• Node.js, Java, Python, C#
• Bring your own libraries
(even native ones)
Simple resource model
• Select power rating from
128 MB to 1.5 GB
• CPU and network allocated
proportionately
• Reports actual usage
Flexible authorization
• Securely grant access to
resources, including VPCs
• Fine-grained control over
who can call your functions
Flexible use
• Call or send events
• Integrated with other AWS
services
• Build whole serverless
ecosystems

Using AWS Lambda
Programming model
• AWS SDK built in (Python
and Node.js)
• Lambda is the front end
• Use processes, threads,
/tmp, sockets normally
Stateless
• Persist data using Amazon
DynamoDB, S3, or
ElastiCache
• No affinity to infrastructure
(can’t “log in to the box”)
Authoring functions
• Author directly using the
console WYSIWYG editor
• Package code as a .zip and
upload to Lambda or S3
• Plugins for Eclipse and
Visual Studio
• Command line tools
Monitoring and logging
• Built-in metrics for requests,
errors, latency, and throttles
• Built-in logs in Amazon
CloudWatch Logs

Monitoring and debugging
Lambda Functions
• AWS Lambda console includes
a dashboard for functions
• Lists all Lambda functions
• Easy editing of resources, event
sources and other settings
• At-a-glance metrics
• Metrics automatically reported
to Amazon CloudWatch for each
Lambda function
• Requests
• Errors
• Latency
• Throttles
• Logs captured by Amazon
CloudWatch Logging service

Calling Lambda over the Internet – REST API
HTTP

Calling Lambda over the Internet using API Gateway
HTTP

Benefits of Amazon API Gateway
Create a unified API
front end for
multiple
microservices
DDoS protection
and throttling for
back-end systems
Authenticate and
authorize requests

Method and integration

Swagger support
• API definitions live in versioned source repository with the rest of the app.
• Can be used with other utilities in the Swagger toolset (for example,
documentation generation).
• API can be imported and deployed in build script.

Automating the workflow with Swagger

Environment variables for Lambda functions

C# and .NET Core
• Write Lambda functions
in C#
• netcoreapp 1.0 on
Amazon Linux
• Built-in logging and
metrics
• Supports common
AWS event types (S3,
SNS)

Easily create reliable end-to-end event processing solutions
• Sends all unprocessed events to your
SQS queue or SNS topic: 3 strikes rule
• Preserves events even if your code has
an issue or the call was throttled
• Per-function
• Works for all async invokes, including S3
and SNS events
Dead-letter queue for events
Amazon
SQS
Amazon
SNS
AWS
Lambda

• Attempt a function more than 3X
• Add callbacks to asynchronous functions
• Handle situations that require waiting
• Chain function execution (ABC)
• Supports long-running workflows
AWS Step Functions
Reliably orchestrate multiple Lambda functions

Lambda + Use Cases

Key scenarios
Data Triggers
Customize behavior
on data updates in
S3, SNS and DDB
Control systems
Customize responses and
response workflows to
state changes within AWS
Serverless
backends
Execute server side
backend logic in a
cross platform
fashion
Big data
Realtime processing
of streaming data
updates using
Kinesis

Lambda + Cloudwatch Events

Security and Conformity
• “Trust but verify” with high confidence via events.
• Deployments verified with every change.
• Lambda guarantees that each instance is in
compliance with defined security rules.
• Triggers shutdown of violations and notifications.
• Compliance and readiness rules can be validated
with every resource change.

Auto Tagging resources as they start

Lambda + Schedulers

Scheduled Event (CRON)
• Dev/QA Environments: Stop running instances
at 19:00 h and Start it again at 8:00 between
Monday to Friday.
• Log cleanup
• Batching up statistics
• Alarm clock
• Infrastructure automation
• Backup scheduler

Auto Start/Shutdown of Instances

Lambda + S3

Dynamic data ingestion using S3+Lambda
Amazon S3 AWS Lambda
processes
the object
Amazon S3
New object
uploaded
Amazon
DynamoDB

Customers running S3 + Lambda pipelines
AWS
Lambda
Indexing
tables or
notifications
Apply custom logic to process content being
uploaded into S3.
• Watermarking / thumbnailing
• Transcoding
• Indexing and deduplication
• Aggregation and filtering
• Pre processing
• Content validation
• WAF updates
Amazon S3
Bucket
Events
Processed
files

Demo: Auto Resize images to thumbnails
• Example: Amazon S3 bucket triggers
Amazon S3 bucket events
Original object
Compressed object
1
2
3
AWS Lambda

Lambda + Kinesis

Real time stream processing with Kinesis+Lambda
Amazon
Kinesis
AWS Lambda
processes
the stream
Amazon
CloudWatch Logs
Amazon SNS
New data
available

Customers using real-time processing pipelines
AWS
Lambda
Aggregate
statistics
Real-time
analytics
Kinesis Stream
Apply custom logic to process data
being uploaded through Kinesis stream
• Client activity tracking
• Metrics generation
• Data cleansing
• Log filtering
• Indexing and searching
• Log routing
• Live alarms and notifications

Real-Time Analytics

Lambda + DynamoDB

Triggers Workflow Using DynamoDB & Lambda
New data
available
Amazon DynamoDB AWS Lambda
Amazon
DynamoDB
Amazon
Redshift

Indexing DynamoDB content using ElasticSearch

Lambda + SNS

Real-Time Message Handling Workflow Using SNS & Lambda
New message
published
Amazon SNS AWS Lambda
Amazon SNS
Amazon Kinesis

Example workloads on SNS+Lambda
AWS
Lambda
Amazon SNS
“I want to run custom logic in response to
my CloudWatch Alarms”
“I want to customize messages before
publishing them to my target audience”
“I want to execute custom code when new
messages are posted on my (SNS)
message bus”
Amazon
CloudWatch
On-prem events
Customized
message

Lambda Powered APIs

An API Call Flow
Internet
Mobile Apps
Websites
Services
API
Gateway
AWS Lambda
functions
AWS
API Gateway
Cache
Endpoints on
Amazon EC2
Any other publicly
accessible endpoint
Amazon
CloudWatch
Monitoring
Amazon
CloudFront

Demo: Serverless URL Shortener

Lambda + Alexa

Alexa apps + Slack = serverless bots!
Alexa, tell Slack to
send, “I’m giving the
demo now.”
Message retrieval through scheduled polling
Kevin says,
“Break a leg!”
Message upload (via
Slack API)
Team
(channel users)
Slack

Developing Lambda How-to

Serverless (previously Jaws)
• http://serverless.com
• Supports Node.js, Python & Java.
• Manages the lifecycle of your serverless architecture (build, deploy, update,
delete).
• Safely deploy functions, events and their required resources together via
provider resource managers (e.g., AWS CloudFormation).
• Functions can be grouped ("serverless services") for easy management of
code, resources & processes, across large projects & teams.
• Built-in support for multiple stages.
• Logging support (serverless logs --function myfunction)

Chalice - Python Serverless Microframework for AWS
• Allows to quickly create and deploy applications
• It provides:
– A command line tool for creating, deploying, and managing your app
– A familiar and easy to use API for declaring views in python code
– Automatic IAM policy generation
– Logging support (chalice logs)

Python Serverless Microframework for AWS

Custom projects
• Bash scripts
– Create roles and policies
– Deploy functions & gateways
• Versioned with GIT
• Locally tests (emulambda)

CloudFormation
• All in one template
• Versioned with GIT

AWS Serverless Application Model (“SAM”)
• A common language for describing the contents of a
serverless app.
• CloudFormation now “speaks serverless” with native support
for SAM.
• New CloudFormation tools to package and deploy Lambda-
based apps.
• Export Lambda blueprints and functions in SAM
from the AWS Lambda console.

AWSTemplateFormatVersion: '2010-09-09’
Transform: AWS::Serverless-2016-10-31
Resources: GetHtmlFunction:
Type: AWS::Serverless::Function
Properties:
CodeUri: s3://flourish-demo-bucket/todo_list.zip
Handler: index.gethtml
Runtime: nodejs4.3
Policies: AmazonDynamoDBReadOnlyAccess
Events:
GetHtml: Type: Api
Properties: Path: /{proxy+} Method: ANY
ListTable: Type: AWS::Serverless::SimpleTable
Functions
APIs
Storage
AWS Serverless Application Model

AWSTemplateFormatVersion: '2010-09-09’
Transform: AWS::Serverless-2016-10-31
Resources: GetHtmlFunction:
Type: AWS::Serverless::Function
Properties:
CodeUri: s3://flourish-demo-bucket/todo_list.zip
Handler: index.gethtml
Runtime: nodejs4.3
Policies: AmazonDynamoDBReadOnlyAccess
Events:
GetHtml: Type: Api
Properties: Path: /{proxy+} Method: ANY
ListTable: Type: AWS::Serverless::SimpleTable
• AWSTemplateFormatVersion:
'2010-09-09'
• Resources:
• GetHtmlFunctionGetHtmlPermissio
nProd:
• Type: AWS::Lambda::Permission
• Properties:
• Action: lambda:invokeFunction
• Principal:
apigateway.amazonaws.com
• FunctionName:
• Ref: GetHtmlFunction
• SourceArn:
• Fn::Sub: arn:aws:execute-
api:${AWS::Region}:${AWS::Accou
ntId}:${ServerlessRestApi}/Prod/AN
Y/*
• ServerlessRestApiProdStage:
• Type: AWS::ApiGateway::Stage
• Properties:
• DeploymentId:
• Ref: ServerlessRestApiDeployment
• RestApiId:
• Ref: ServerlessRestApi
• StageName: Prod
• ListTable:
• Type: AWS::DynamoDB::Table
• Properties:
• ProvisionedThroughput:
• WriteCapacityUnits: 5
• ReadCapacityUnits: 5
• AttributeDefinitions:
• - AttributeName: id
• AttributeType: S
• KeySchema:
• - KeyType: HASH
• AttributeName: id
• GetHtmlFunction:
• Type: AWS::Lambda::Function
• Properties:
• Handler: index.gethtml
• Code:
• S3Bucket: flourish-demo-bucket
• S3Key: todo_list.zip
• Role:
• Fn::GetAtt:
• - GetHtmlFunctionRole
• - Arn
• Runtime: nodejs4.3
• GetHtmlFunctionRole:
• Type: AWS::IAM::Role
• Properties:
• ManagedPolicyArns:
• -
arn:aws:iam::aws:policy/AmazonDy
namoDBReadOnlyAccess
• - arn:aws:iam::aws:policy/service-
role/AWSLambdaBasicExecutionR
ole
• AssumeRolePolicyDocument:
• Version: '2012-10-17'
• Statement:
• - Action:
• - sts:AssumeRole
• Effect: Allow
• Principal:
• Service:
• - lambda.amazonaws.com
• ServerlessRestApiDeployment:
• Type:
AWS::ApiGateway::Deployment
• Properties:
• RestApiId:
• Ref: ServerlessRestApi
• Description: 'RestApi deployment
id:
127e3fb91142ab1ddc5f5446adb09
4442581a90d'
• StageName: Stage
• GetHtmlFunctionGetHtmlPermissio
nTest:
• Type: AWS::Lambda::Permission
• Properties:
• Action: lambda:invokeFunction
• Principal:
apigateway.amazonaws.com
• FunctionName:
• Ref: GetHtmlFunction
• SourceArn:
• Fn::Sub: arn:aws:execute-
api:${AWS::Region}:${AWS::Accou
ntId}:${ServerlessRestApi}/*/ANY/*
• ServerlessRestApi:
• Type: AWS::ApiGateway::RestApi
• Properties:
• Body:
• info:
• version: '1.0'
• title:
• Ref: AWS::StackName
• paths:
• "/{proxy+}":
• x-amazon-apigateway-any-method:
• x-amazon-apigateway-integration:
• httpMethod: ANY
• type: aws_proxy
• uri:
• Fn::Sub:
arn:aws:apigateway:${AWS::Regio
n}:lambda:path/2015-03-
• 31/functions/${GetHtmlFunction.Arn
}/invocations
• responses: {}
• swagger: '2.0'
AWS Serverless Application Model
REPLACES:

Emulambda - Python emulator for AWS Lambda
>> emulambda nanny.lambda_handler - -v < event_bedtime.json

lambda-local - NodeJS emulator for AWS Lambda
>> lambda-local -l index.js -h handler -e event-samples/s3-put.js

The serverless compute manifesto
• Functions are the unit of deployment and scaling.
• No machines, VMs, or containers visible in the programming model.
• Permanent storage lives elsewhere.
• Scales per request. Users cannot over- or under-provision capacity.
• Never pay for idle resources.
• Implicitly fault-tolerant because functions can run anywhere.
• BYOC – Bring your own code and ALWAYS package dependencies
• Metrics and logging are a universal right.
• Turn VPC on only if necessary.

Thanks!

Getting started with Serverless on AWS

Recommended

Recommended

More Related Content

What's hot

What's hot (19)

Viewers also liked

Viewers also liked (20)

Similar to Getting started with Serverless on AWS

Similar to Getting started with Serverless on AWS (20)

More from Adrian Hornsby

More from Adrian Hornsby (20)

Recently uploaded

Recently uploaded (20)

Getting started with Serverless on AWS

Editor's Notes