My serverless presentation at Riga DevDays 2017. This time we updated with over our experience of using Lambdas over the 1 year at massive scale

1. EFFICIENT AWS LAMBDA
ANTONS KRANGA

2. @acankr
@acankr
‣ Full stack developer ~ 15years
‣ Cloud Architect
‣ DevOps evangelist
‣ Speaker
‣ Marathon runner
ANTONS KRANGA

3. @acankr
ECONOMICS OF APPLICATION VIRTULIZATION ON AWS
▸ 64% or cloud costs refers to EC2 Instances
▸ 53% workloads Small Instances
▸ 29% workloads Medium size
https://goo.gl/1pmqKD

4. @acankr
ECONOMICS OF APPLICATION VIRTULIZATION ON AWS
▸ 64% or cloud costs refers to EC2 Instances
▸ 53% workloads Small Instances
▸ 29% workloads Medium size
▸ 16.7% Small instance utilization
▸ 11.9% Medium instance utilization
https://goo.gl/1pmqKD

5. @acankr
COSTS SAVING STRATEGIES
▸ Use only what you need
▸ Choose right size for instances
▸ Use Reserved instances

6. @acankr
CHALLENGES OF RESERVED INSTANCES
▸ Use only what you need
▸ Choose right size for instances
▸ Use Reserved instances
▸ Expect project run for short time
▸ Undecided about project size
▸ Fear of commitment

7. @acankr
AGENDA
▸ Introduction to FaaS
▸ Good and Bad code
▸ Serverless Patterns

8. @acankr
WHAT IS SERVERLESS
Lambda

9. @acankr
WHAT IS SERVERLESS
Lambda
CodeCommit
SmartHome
AlexaSkill IoT
API Gateway
S3 Storage
CloudWatchEvent
Logs
Cognito
SNS
Kinesis
Messages
DynamoDB
Internet of Things
Streaming
Development and Ops
Security
Trigger

10. @acankr
WHAT IS SERVERLESS
Lambda
CodeCommit
SmartHome
AlexaSkill IoT
API Gateway
S3 Storage
CloudWatchEvent
Logs
SNS
Kinesis
Messages
DynamoDB
Internet of Things
Streaming
Development and Ops
Security
Trigger
Container
Application CodeCognito

11. @acankr
WHAT IS SERVERLESS
Lambda
CodeCommit
SmartHome
AlexaSkill IoT
API Gateway
S3 Storage
CloudWatchEvent
Logs
SNS
Kinesis
Messages
DynamoDB
Internet of Things
Streaming
Development and Ops
Security
Trigger Event AWS Service
Container
Application CodeCognito

12. @acankr
▸ Price: $0.208 - $2.501 per 1M executions
▸ RAM: 128MB - 1536MB
▸ vCPU Cores: 2
▸ Ephemeral Disk: 512MB
▸ Write Partition: /tmp/*
▸ Timeout: 300sec
▸ Body Payload: 6MB
]▸ Price: $0.023 per Hour (t2-small)
▸ RAM: 2GB
▸ vCPU Cores: 1
▸ Ephemeral Disk or EBS
▸ Timeout: no
Lambda EC2 (VM)
VS

13. @acankr
▸ NodeJS 4.6
▸ NodeJS 6.10
▸ Python 2.7
▸ Python 3.6
▸ Java 8
▸ C#
▸ EdgeJS 4.6
]
Language Runtimes
CONFIGURATION MANAGEMENT
SECRET MANAGEMENT
SERVICE DISCOVERY
EXPOSURE AND AUTH
PRIVATE CLOUD ACCESS
APPLICATION DEVELOPMENT SERVICES

14. @acankr
▸ NodeJS 4.6
▸ NodeJS 6.10
▸ Python 2.7
▸ Python 3.6
▸ Java 8
▸ C#
▸ EdgeJS 4.6
Language Runtimes
MINIMALISTIC LAMBDA EXECUTION
First Execution Next Execution RAM Used
3.06ms 0.34ms 23MB
3.07-9.06ms 0.25 - 4.67ms 22MB
12.07 - 30.56ms 0.37 - 0.64ms 50MB
31.07ms 18MB0.29 - 9.96ms
0.17ms 0.18 - 0.38ms 20MB

15. @acankr
LAMBDA HANDLERS
BUILD.GRADLE
apply plugin: 'java'
version = '1.0.0'
mainClassName='Main'
repositories {
mavenCentral()
}
dependencies {
compile (
'com.amazonaws:aws-lambda-java-core:1.1.0',
'com.amazonaws:aws-lambda-java-events:1.1.0'
)
}
MAIN.JAVA
public class Main implements RequestHandler<String, String> {
public String handleRequest(String input, Context context) {
context.getLogger().log("My input is: " + input);
return "Hello: " + input
}
}
INDEX.PY
import logging
log = logging.getLogger()
log.setLevel(logging.INFO)
def handler(event, context):
log.debug(event)
return {'message': 'Hello from Lambda'}
INDEX.JS
exports.handler = (event, context, callback) => {
console.log(event)
callback(null, {'message': 'Hello from Lambda'});
};

16. DEPLOY CODE

17. @acankr
LAMBDA
SERVICE

18. @acankr
CODE
VERSIONS
LAMBDA
V1
SERVICE

19. @acankr
CODE
VERSIONS
LAMBDA
V1
SERVICE ALIAS
LATEST

20. @acankr
CODE
VERSIONS
LAMBDA
V1
V2
SERVICE ALIAS
LATEST

21. @acankr
CODE
VERSIONS
LAMBDA
V1
V2
V3
SERVICE ALIAS
LATEST

22. @acankr
CODE
VERSIONS
LAMBDA
V1
V2
V3
SERVICE ALIAS
LATEST
V4

23. @acankr
CODE
VERSIONS
LAMBDA
V1
V2
V3
SERVICE ALIAS
STABLE
V4
LATEST

24. @acankr
CODE
VERSIONS
LAMBDA
V1
V2
V3
SERVICE ALIAS
STABLE
V4
ENV
DEV
TEST
PROD
LATEST

25. @acankr
▸ CloudFormation and/or Terraform for initial deployment
▸ Setup Cloud Resources
▸ Inject dependencies via ENV VARS
▸ Encrypt Secrets with KMS
▸ CLI “update-function-code” for incremental deployment

26. EXPOSE LAMBDA

27. @acankr
API Gateway
Lambda
+
- API Management Tool
- Authorization + Custom Authorizer
- Defines: Environment Variables for Lambda
- Can be defined with Swagger and imported
- Code Supports Versioning
- Integrated with CloudWatch
- Lambda Containers are Cached for 5 minutes
- Can be deployed with “apex.run” tool
- User can write files in /tmp

28. @acankr
GET
POST
PUT
DELETE
dataAPI Gateway Lambda
ajax event
USER

29. @acankr
GET
POST
PUT
DELETE
dataAPI Gateway Lambda
ajax event
USER
Authorizer
Lambda
Identity
Service Provider

30. CHALLENGES

31. @acankr
▸ Challenge of first execution
▸ Lack of Remote Debug
▸ Heavily Rely on Unit Tests
▸ Expect Unpredictable Event Payload

32. @acankr
▸ You never know who is calling you
▸ Function events are coming in different format
▸ Use ‘jsonschema’ to validate

33. @acankr
API GATEWAY CHALLENGES
▸ Use LAMBA_PROXY integration
▸ Always check incoming payload
▸ Body transferred as String

34. STATEFUL LAMBDA

35. @acankr
GET
POST
PUT
DELETE
dataAPI Gateway
ajax event
USER
DB_URL
DB_PORT
DB_USER
Environment Variables
Lambda
VPC
KMS encrypted DB_PASSWORD

36. @acankr
GET
POST
PUT
DELETE
dataAPI Gateway
ajax event
USER
DynamoDB Table
Environment Variables
Lambda DynamoDB

37. STEP FUNCTIONS

38. @acankr
▸ Model flows of Lambda Functions
▸ Conditional flows
▸ Design error handling
▸ Design conditional execution
▸ Output of previous function will be input of next

39. WEBSITE EXAMPLE

40. @acankr
GET
Static HTML
CSS/Media
Rich JavaScript Apps
S3 StorageCloudFront
GET
POST
PUT
DELETE
Dynamic Data
Data from Database
Data from External Service
dataAPI Gateway Lambda
ajax
http
event
USER
DynamoDB
R53 Domain
example.com

41. HIPSTER PORTAL

42. HIPSTER PORTAL
"...USE GIT AS THE BASIS FOR A LIGHTWEIGHT CMS, WITH TEXT-BASED EDITING FORMATS. GIT
HAS POWERFUL FEATURES FOR TRACKING CHANGES AND EXPLORING ALTERNATIVES, WITH A
DISTRIBUTED STORAGE MODEL THAT IS FAST IN USE AND TOLERANT OF NETWORKING ISSUES."
ThoughtWorks Technology Radar
https://www.thoughtworks.com/radar/techniques/git-based-cms-git-for-non-code
assess since May 2015

43. @acankr
Lambda
+ - Lambda doesn’t have GIT client.
- You can “statically link” git libraries with
git2go library (libgit2)
- To read SSH key file with Lambda it must be stored
in “/tmp” directory
- SSH private key must have 600 credentials
- SSH private key must be owned by user “sandbox”
Code Commit
- Git Repository Service
- Backed by S3 storage
- Price: $1 per user
- Only: us-west-1 region

44. @acankr
@acankr
USER
GET
S3 Storage
CloudFront
GET
POST
PUT
DELETE
dataAPI Gateway Lambda
ajax
http
event
Lambda
push
EDITOR
event
document commit
PUT
Checkout document
Render or post-process
Publish
CodeCommit
DynamoDB
STREAM
Invalidate
Cache
Lambda

45. SERVERLESS CI

46. @acankr
Compilation
Lambda
push
DEV
event
document commit
Checkout Compile
CodeCommit
PUT
S3
GET
Checkout Compile
Testing
Lambda
if needed
long running tests
VMs
CREATE
Deployment
Lambda
Lambda
SNS
ChatOps

47. TAKEAWAYS

48. @acankr
TAKEWAYS
▸ Optimize for what you use
▸ Split deployment code to: initial and incremental
▸ Lambdas are best for rare events (cluster events, chatbots etc)
▸ Lambdas bad for UI

49. @acankr
FRAMEWORKS
▸ All frameworks we checking are limiting
▸ CloudFormation and Terraform for initial deployment
▸ Serverless to support Lambda on NodeJS
▸ Chalice for Python runtime

50. @acankr
- AZURE FUNCTIONS
- Runtimes:
- ASP .NET (1Core)
- NodeJS
- etc
- Deployment:
- REST API
- PowerShell
- GOOGLE CLOUD FUNCTIONS
- Runtimes:
- NodeJS (only)
- Deployment:
- gcloud

51. @acankr
Book: AWS Lambda in Action MEAP
Begin in 2016 February
Publication: March 2017
Author: Danilo Poccia
ISBN: 9781617293719
https://www.manning.com/books/aws-lambda-in-action

52. THANK YOU