Going Serverless at AWS Startup Day Bangalore

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Madhusudan Shekar
@madhushekar23
AWS Startup Day
Going Serverless

We know this…

Owning Servers means…
Operations and management Scaling
Provisioning and utilization Availability and fault tolerance

Going Serverless…
Code is all you need Event driven scaling
Never pay for idle Availability and fault tolerance built in

Many different use cases
• Analytics
• Operational management
• Live Dashboards
• Data workflows
• Content management
• ETL workflows
• Interactive Backends
• Bots
• Webhooks
• Autonomous IT
• Policy engines
• Infrastructure management

AWS Serverless offerings
And more !!
Lambda DynamoDB S3 Kinesis

AWS Lambda

What is Lambda
Functions are the unit of deployment and scaling.

How Lambda works
S3 event
notifications
DynamoDB
Streams
Kinesis
events
Cognito
events
SNS
events
Custom
events
CloudTrail
events LambdaDynamoDB
Kinesis S3
Any custom
Redshift
SNS
CloudWatch
events

But what really *is* AWS Lambda?
• Linux containers as an implementation, not a programming or deployment
abstraction
– Process and network isolation, cgroups, seccomp, …
• Predictive capacity management
– Purpose-built, massively scaled language runtime delivery service
• Swagger interpreter (API Gateway)
• Cold vs Hot state

How does a Lambda function looks like?
def hello(event, context):
return {
"message": ”Hello World!",
"event": event
}
'use strict';
handlermodule.exports.hello = (event, context, cb) => cb(null,
{ message: ’Hello World!', event }
);

Continuous
scaling
No servers to
manage
Never pay for idle
– no cold servers
Benefits of AWS Lambda

Pay-per request
• Buy compute time in
100 ms increments
• Low request charge
• No hourly, daily, or
monthly minimums
• No per-device fees
Never pay for idle!
Free Tier
1 million requests and 400,000 GBs of compute
every month, every customer

Using AWS Lambda
• Bring your own code
• Node.js, Java, Python
• Bring your own libraries
(even native ones)
Simple resource model
• Select power rating from
128 MB to 1.5 GB
• CPU and network allocated
proportionately
• Reports actual usage
Flexible authorization
• Securely grant access to
resources, including VPCs
• Fine-grained control over
who can call your functions
Flexible use
• Call or send events
• Integrated with other AWS
services
• Build whole serverless
ecosystems

Using AWS Lambda
• Programming model
• AWS SDK built in (Python
and Node.js)
• Lambda is the front end
• Use processes, threads,
/tmp, sockets normally
Stateless
• Persist data using Amazon
DynamoDB, S3, or
ElastiCache
• No affinity to infrastructure
(can’t “log in to the box”)
Authoring functions
• Author directly using the
console WYSIWYG editor
• Package code as a .zip and
upload to Lambda or S3
• Plugins for Eclipse and
Visual Studio
• Command line tools
Monitoring and logging
• Built-in metrics for requests,
errors, latency, and throttles
• Built-in logs in Amazon
CloudWatch Logs

Key scenarios
Data Triggers
Customize behavior
on data updates in
S3, SNS and DDB
Control systems
Customize responses and
response workflows to
state changes within AWS
Serverless
backends
Execute server side
backend logic in a
cross platform
fashion
Big data
Realtime processing
of streaming data
updates using
Kinesis

Monitoring and debugging
Lambda Functions
• AWS Lambda console includes
a dashboard for functions
• Lists all Lambda functions
• Easy editing of resources, event
sources and other settings
• At-a-glance metrics
• Metrics automatically reported
to Amazon CloudWatch for each
Lambda function
• Requests
• Errors
• Latency
• Throttles
• Logs captured by Amazon
CloudWatch Logging service

Calling Lambda over the Internet – REST API
HTTP

API Gateway APIs for Lambda

Calling Lambda over the Internet using API Gateway
HTTP

Managed
API Gateway managed model
InternetMobile apps
AWS Lambda
functions
AWS
API Gateway
cache
Endpoints on
Amazon EC2
Any other publicly
accessible endpoint
Amazon
CloudWatch
Amazon
CloudFront
API
Gateway
API Gateway
Other AWS
services
AWS Lambda
functions

Benefits of Amazon API Gateway
Create a unified API
front end for
multiple
microservices
DDoS protection
and throttling for
back-end systems
Authenticate and
authorize requests

Lambda + Cloudwatch Events

Security and Conformity
• “Trust but verify” with high confidence via events.
• Deployments verified with every change.
• Lambda guarantees that each instance is in
compliance with defined security rules.
• Triggers shutdown of violations and notifications.
• Compliance and readiness rules can be validated
with every resource change.

Auto Tagging resources as they start

Lambda + Schedulers

Scheduled Event (CRON)
• Dev/QA Environments: Stop running instances
at 19:00 h and Start it again at 8:00 between
Monday to Friday.
• Log cleanup
• Batching up statistics
• Alarm clock
• Infrastructure automation
• Backup scheduler

Backup and Disaster Recovery
• Cross-region replication to multiple regions.
• Off-site backups.
• Validation of those backups is difficult to scale.
• Set rules on Lambda that defines what needs to
be backup and checks
• Validates and raise alarms in case of failure.

Auto Start/Shutdown of Instances
https://github.com/pebo/cloud-nanny

Lambda + S3

Dynamic data ingestion using S3+Lambda
Amazon S3 AWS Lambda
processes
the object
Amazon S3
New object
uploaded
Amazon
DynamoDB

Customers running S3 + Lambda pipelines
AWS
Lambda
Indexing
tables or
notifications
Apply custom logic to process content being
uploaded into S3.
• Watermarking / thumbnailing
• Transcoding
• Indexing and deduplication
• Aggregation and filtering
• Pre processing
• Content validation
• WAF updates
Amazon S3
Bucket
Events
Processed
files

Auto Resize images to thumbnails
• Example: Amazon S3 bucket triggers
Amazon S3 bucket events
Original object
Compressed object
1
2
3
AWS Lambda

Lambda + Kinesis

Real time stream processing with Kinesis+Lambda
Amazon
Kinesis
AWS Lambda
processes
the stream
Amazon
CloudWatch Logs
Amazon SNS
New data
available

Customers using real-time processing pipelines
AWS
Lambda
Aggregate
statistics
Real-time
analytics
Kinesis Stream
Apply custom logic to process data
being uploaded through Kinesis stream
• Client activity tracking
• Metrics generation
• Data cleansing
• Log filtering
• Indexing and searching
• Log routing
• Live alarms and notifications

Real-Time Analytics

Lambda + DynamoDB

Triggers Workflow Using DynamoDB & Lambda
New data
available
Amazon DynamoDB AWS Lambda
Amazon
DynamoDB
Amazon
Redshift

Indexing DynamoDB content using ElasticSearch

Lambda + SNS

Real-Time Message Handling Workflow Using SNS & Lambda
New message
published
Amazon SNS AWS Lambda
Amazon SNS
Amazon Kinesis

Example workloads on SNS+Lambda
AWS
Lambda
Amazon SNS
“I want to run custom logic in response to
my CloudWatch Alarms”
“I want to customize messages before
publishing them to my target audience”
“I want to execute custom code when new
messages are posted on my (SNS)
message bus”
Amazon
CloudWatch
On-prem events
Customized
message

Lambda Powered APIs

An API Call Flow
Internet
Mobile Apps
Websites
Services
API
Gateway
AWS Lambda
functions
AWS
API Gateway
Cache
Endpoints on
Amazon EC2
Any other publicly
accessible endpoint
Amazon
CloudWatch
Monitoring
Amazon
CloudFront

Serverless URL Shortener

SMS powered Lambda with Twillio
{
"body" : "$input.params('Body')",
"fromNumber" : "$input.params('From')",
"numMedia" : "$input.params('NumMedia')"
}
LambdaAPI GatewayTwilio SMS integration - webhook
Twilio Call API

Lambda + Mobile Apps

Building Mobile Backends with Lambda
• Lambda as the backend logic for mobile
applications.
• Easy Personalization
– … for devices
– … for end users

Lambda + Alexa

Alexa apps + Slack = serverless bots!
Alexa, tell Slack to
send, “I’m giving the
demo now.”
Message retrieval through scheduled polling
Kevin says,
“Break a leg!”
Message upload (via
Slack API)
Team
(channel users)
Slack

Developing Lambda How-to

AWS Serverless Application Model (SAM)
• AWS CloudFormation extension optimized
for serverless
• New serverless resource types: functions,
APIs, and tables
• Supports anything CloudFormation
supports
• Open specification (Apache 2.0)

SAM Template
AWSTemplateFormatVersion: '2010-09-09’
Transform: AWS::Serverless-2016-10-31
Resources:
GetHtmlFunction:
Type: AWS::Serverless::Function
Properties:
CodeUri: s3://sam-demo-bucket/todo_list.zip
Handler: index.gethtml
Runtime: nodejs4.3
Policies: AmazonDynamoDBReadOnlyAccess
Events:
GetHtml:
Type: Api
Properties:
Path: /{proxy+}
Method: ANY
ListTable:
Type: AWS::Serverless::SimpleTable

Serverless (previously Jaws)
• http://serverless.com
– New Release: Serverless V1.0 Beta 2
• Supports Node.js, Python & Java.
• Manages the lifecycle of your serverless architecture (build, deploy, update,
delete).
• Safely deploy functions, events and their required resources together via
provider resource managers (e.g., AWS CloudFormation).
• Functions can be grouped ("serverless services") for easy management of
code, resources & processes, across large projects & teams.
• Built-in support for multiple stages.
• Logging support (serverless logs --function myfunction)

Chalice - Python Serverless Microframework for AWS
• Allows to quickly create and deploy applications
• It provides:
– A command line tool for creating, deploying, and managing your app
– A familiar and easy to use API for declaring views in python code
– Automatic IAM policy generation
– Logging support (chalice logs)

Python Serverless Microframework for AWS

CloudFormation
• All in one template
• Versioned with GIT

Custom projects
• Bash scripts
– Create roles and policies
– Deploy functions & gateways
• Versioned with GIT
• Locally tests (emulambda)

Emulambda - Python emulator for AWS Lambda
>> emulambda nanny.lambda_handler - -v < event_bedtime.json

lambda-local - NodeJS emulator for AWS Lambda
>> lambda-local -l index.js -h handler -e event-samples/s3-put.js

SAM Local – CLI tool to test Lambda locally
• Develop and test your Lambda functions locally with sam
local and Docker
• Invoke functions from known event sources such as
Amazon S3, Amazon DynamoDB, Amazon Kinesis, etc.
• Start local API Gateway from a SAM template, and quickly
iterate over your functions with hot-reloading
• Validate SAM templates

The serverless compute manifesto
• Functions are the unit of deployment and scaling.
• No machines, VMs, or containers visible in the programming model.
• Permanent storage lives elsewhere.
• Scales per request. Users cannot over- or under-provision capacity.
• Never pay for idle resources.
• Implicitly fault-tolerant because functions can run anywhere.
• BYOC – Bring your own code and ALWAYS package dependencies
• Metrics and logging are a universal right.
• Turn VPC on only if necessary.

Thank You!
Madhusudan Shekar
Twitter: @madhushekar23
LinkedIn: /in/madhusudanshekar

Going Serverless at AWS Startup Day Bangalore

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Going Serverless at AWS Startup Day Bangalore

Similar to Going Serverless at AWS Startup Day Bangalore (20)

Recently uploaded

Recently uploaded (20)

Going Serverless at AWS Startup Day Bangalore

Editor's Notes