Slides from Serverless Architecture with AWS workshop that has been delivered in Tel Aviv at December 2016 and XP Days in Kyiv at November. We go in details about AWS Lambda and give few implementation blueprints targeted to web applications

1. SERVERLESS ARCHITECTURES

2. ~ WHOAMI
▸ Full stack developer ~ 15years
▸ Cloud Architect
▸ DevOps evangelist
▸ Speaker
▸ Marathon runner
ANTONS KRANGA
@acankr

3. HOW DO WE WRITE APPS IN 2016
@acankr

4. @acankr
Chorr
Microservice

5. @acankr
Chorr
Microservice
runtime

6. @acankr
Chorr
Microservice
container
package
runtime

7. @acankr
Chorr
Microservice
cloud
container
package
runtime
deploy

8. @acankr
Chorr
Microservice
runtime
cloud
container
package
deploy
VM

9. @acankr
Chorr
Microservice
runtime
cloud
container
VM
package
deploy
RAM
# CPU
$$$ per hour

10. @acankr
Chorr
Microservice
runtime
cloud
container
VM
package
deploy
RAM
# CPU
$$$ per hour
Scales in 9 minutes*

11. WHAT WE CAN DO DIFFERENT IN 2016?
@acankr

12. @acankr
cloud

13. @acankr
cloud
Container

14. @acankr
and runtime
cloud
Container with OS

15. @acankr
Chorr
Microservice
and runtime
cloud
Container with OS
mount as volume

16. @acankr
Chorr
Microservice
and runtime
cloud
Container with OS
mount as volume
JCVM
Microservice
Schwarzz
Microservice
…

17. @acankr
Chorr
Microservice
and runtime
cloud
Container with OS
mount as volume
JCVM
Microservice
Schwarzz
Microservice
…
$$$ by 100 milliseconds
Scale in milliseconds

18. @acankr
Event

19. @acankr
Event

20. @acankr
IMPORTANT!!!
warm up time
Event

21. @acankr
Result
IMPORTANT!!!
warm up time
execution time
Event

22. @acankr
IMPORTANT!!!
warm up time
execution time
Constraints
Timeout in seconds
Max number or RAM
Event Result

23. LAMBDA
@acankr
- AWS Computing Service
- Designed to reflect async Actor Model
- Resilient and Scaleable
- 512 RAM
- Supports Runtimes
- Java
- Python
- NodeJS
- Go (implicitly)
- Max Timeout 5 mins
- Pricing:
- 0.20$ per million requests.
- Billable 100 milliseconds

24. @acankr
Lambda
API Gateway
EVENT SOURCE
Kinesis Data Streams
SNS Queue or Topic data
Lambda
other data
CONSUMER OR EVENT
CRON Job

25. LAMBDA DEPLOYMENT
@acankr

26. @acankr
LAMBDA
SERVICE

27. @acankr
CODE
VERSIONS
LAMBDA
V1
SERVICE

28. @acankr
CODE
VERSIONS
LAMBDA
V1
SERVICE ALIAS
LATEST

29. @acankr
CODE
VERSIONS
LAMBDA
V1
V2
SERVICE ALIAS
LATEST

30. @acankr
CODE
VERSIONS
LAMBDA
V1
V2
V3
SERVICE ALIAS
LATEST

31. @acankr
CODE
VERSIONS
LAMBDA
V1
V2
V3
SERVICE ALIAS
LATEST
V4

32. @acankr
CODE
VERSIONS
LAMBDA
V1
V2
V3
SERVICE ALIAS
STABLE
V4
LATEST

33. @acankr
CODE
VERSIONS
LAMBDA
V1
V2
V3
SERVICE ALIAS
STABLE
V4
ENV
DEV
TEST
PROD
LATEST

34. EXPOSE LAMBDA
@acankr

35. @acankr
API Gateway
Lambda
+
- API Management Tool
- Authorization + Custom Authorizer
- Defines: Environment Variables for Lambda
- Can be defined with Swagger and imported
- Code Supports Versioning
- Integrated with CloudWatch
- Lambda Containers are Cached for 5 minutes
- Can be deployed with “apex.run” tool
- User can write files in /tmp

36. @acankr
GET
POST
PUT
DELETE
dataAPI Gateway Lambda
ajax event
USER

37. @acankr
GET
POST
PUT
DELETE
dataAPI Gateway Lambda
ajax event
USER
Authorizer
Lambda
Identity
Service Provider

38. @acankr
GET
POST
PUT
DELETE
dataAPI Gateway Lambda
ajax event
USER
DB_URL
DB_PORT
DB_USER
Variables
Authorizer
Lambda
Identity
Service Provider

39. STAGEFUL BACKEND
@acankr

40. @acankr
GET
POST
PUT
DELETE
dataAPI Gateway
ajax event
USER
DB_CONNECTION_STRING
Variables
dynamodb

41. @acankr
GET
POST
PUT
DELETE
dataAPI Gateway
ajax event
USER
DB_URL
DB_PORT
DB_USER
Variables
Lambda
VPC

42. @acankr
GET
POST
PUT
DELETE
dataAPI Gateway Lambda
ajax event
USER
DB_URL
DB_PORT
DB_USER
Variables
VPC
ACCESS POLICY
ec2:CreateNetworkInterface
ec2:AttachNetworkInterface

43. TODAYS MISSION
@acankr

44. @acankr
BUILD A SERVERLESS MAFIA GAME
WE HAVE GROUP OF PLAYERS
THEY ALL HIDE THEIR IDENTITIES
YOU ARE THE DETECTIVE

45. @acankr
BUILD A SERVERLESS MAFIA GAME
MAFIA KNOWS THEIR IDENTITIES
INNOCENT PEOPLE DON’T

46. @acankr
STAGES OF THE GAME
#1 NIGHT: MURDER
MAFIA AWAKENS
MAFIA KILLS INNOCENT
#2 DAY: ACCUSATION
EVERYBODY AWAKENS
PLAYERS ACCUSE EACH OTHER
MAFIA NEVER ACCUSES
THEMSELVES
INNOCENT ACCUSES
EVERYBODY
#3 DAY: JUDGEMENT
DETECTIVE READS ALL
ACCUSATIONS AND BRINGS ONE
PLAYER TO THE JUDGEMENT
PLAYER UNVEILS HER IDENTITY
AND LEAVES THE GAME
#4 GAME CONTINUES

47. @acankr
GAME DESIGN
User
01-new-game
API Gateway
DynamoDB
02-game-state
03-night-murder
04-daily-accusation
05-user-judgement
GET
http

48. @acankr
DEPLOYMENT DESIGN
Makefile environment
game
Terraform Scripts
solutions
main.py game_controller.py
main.py

49. @acankr
DEPLOYMENT DESIGN
Makefile environment
game
Terraform Scripts
solutions
main.py game_controller.py
main.py
terraform.tfvars

50. @acankr
DEPLOYMENT DESIGN
Makefile environment
game
Terraform Scripts
solutions
main.py game_controller.py
main.py
terraform.tfvars
MAKEFILE
package
plan
apply
destroy
all (default)

51. https://github.com/akranga/mafia-serverless
WORKSHOP MATERIALS
https://goo.gl/mQI6wi

52. LESSONS LEARNED
@acankr

53. DESIGN FOR 100MILLIS STEPS
@acankr

54. OPTIMIZE WARMUP TIME
@acankr

55. CACHE OUTSIDE OF HANDLER
@acankr

56. AVOID CALLING
LAMBDA FROM LAMBDA
@acankr

57. GROUP HANDLER METHODS (SRP)
@acankr

58. THINK OF CONFIGURATION
MANAGEMENT
@acankr

59. NO DEBUG IN LAMBDA ;(
@acankr

60. WRITE UNIT TESTS
@acankr

61. THEN DEPLOY TO TEST ENVIRONMENT
@acankr

62. THEN RUN INTEGRATION TESTS
@acankr

63. SERVERLESS BLUEPRINTS
@acankr

64. STATIC WEBSITE
@acankr

65. @acankr
- Highly Available Serverless Storage
- Scaleable and Elastic
- Replicated across 2 availability zones
- Supports HTTP requestsS3

66. @acankr
Static HTML
CSS/Media
Rich JavaScript Apps
GET
http
S3 StorageCloudFront
USER

67. @acankr
Static HTML
CSS/Media
Rich JavaScript Apps
R53 Domain
GET
http
example.com
S3 StorageCloudFront
USER

68. @acankr
Static HTML
CSS/Media
Rich JavaScript Apps
COST MODEL: $0.03 GiB per Month
S3 HIGHLY AVAILABLE STORAGE
- Covered by AWS S3 SLA
- Durability: 99.999999999%
- Availability: 99.99%
SLOW WRITE OPERATIONS
R53 Domain
GET
http
example.com
S3 StorageCloudFront
USER

69. DYNAMIC WEBSITE
@acankr

70. @acankr
GET
Static HTML
CSS/Media
Rich JavaScript Apps
S3 StorageCloudFront
GET
POST
PUT
DELETE
Dynamic Data
Data from Database
Data from External Service
dataAPI Gateway Lambda
ajax
http
event
USER

71. HIPSTER WEB PORTAL
@acankr

72. GOOD PORTAL NEEDS CMS
@acankr

73. "...USE GIT AS THE BASIS FOR A LIGHTWEIGHT CMS, WITH TEXT-BASED EDITING
FORMATS. GIT HAS POWERFUL FEATURES FOR TRACKING CHANGES AND
EXPLORING ALTERNATIVES, WITH A DISTRIBUTED STORAGE MODEL THAT IS FAST
IN USE AND TOLERANT OF NETWORKING ISSUES."
ThoughtWorks Technology Radar
https://www.thoughtworks.com/radar/techniques/git-based-cms-git-for-non-code
assess since May 2015
BEST CMS
@acankr

74. CODECOMMIT
@acankr
- Git Repository Service
- Backed by S3 storage
- Price: $1 per user
- Only: us-west-1 region

75. CODECOMMIT
@acankr
Lambda
+
- Lambda doesn’t have GIT client.
- You can “statically link” git libraries with
git2go library (libgit2)
- To read SSH key file with Lambda it must be stored
in “/tmp” directory
- SSH private key must have 600 credentials
- SSH private key must be owned by user “sandbox”

76. @acankr
USER
GET
Static HTML
CSS/Media
Rich JavaScript Apps
S3 StorageCloudFront
GET
POST
PUT
DELETE
Dynamic Data
Data from Database
Data from External Service
dataAPI Gateway Lambda
ajax
http
event
Lambda
push
EDITOR
event
document commit
PUT
Checkout document
Render or post-process
Publish
CodeCommit

77. ALTERNATIVES
@acankr

78. @acankr
Compilation
Lambda
push
DEV
event
document commit
Checkout Compile
CodeCommit
PUT
S3
GET
Checkout Compile
Testing
Lambda
if needed
long running tests
VMs
CREATE
Deployment
Lambda
Lambda
SNS
ChatOps

79. ALTERNATIVES
@acankr

80. @acankr
- SERVICE FABRIC
- Runtimes:
- ASP .NET (1Core)
- NodeJS
- etc
- Deployment:
- REST API
- PowerShell
- GOOGLE CLOUD FUNCTIONS (ALPHA)
- Runtimes:
- NodeJS (only)
- Deployment:
- gcloud

81. TAKEAWAYS
@acankr

82. @acankr
https://www.manning.com/books/aws-lambda-in-action
Book: AWS Lambda in Action MEAP
Begin in 2016 February
Publication: March 2017
Author: Danilo Poccia
ISBN: 9781617293719

83. PAY FOR ONLY WHAT YOU USE
@acankr