How can you accelerate the delivery of new, high-quality services? How can you be able to experiment and get feedback quickly from your customers? To get the most out of the agility afforded by serverless and containers, it is essential to build CI/CD pipelines that help teams iterate on code and quickly release features. In this talk, we demonstrate how developers can build effective CI/CD release workflows to manage their serverless or containerized deployments on AWS. We cover infrastructure-as-code (IaC) application models, such as AWS Serverless Application Model (AWS SAM) and new imperative IaC tools. We also demonstrate how to set up CI/CD release pipelines with AWS Code-* family of services

1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Continuous Integration & Deployment
for Modern Applications
@sebsto sebsto
{
"name": "Sébastien Stormacq",
"role": "Developer Evangelist",
"company": "Amazon Web Services”,
"twitter": ”@sebsto”,
}

2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Development transformation at Amazon: 2001–2002
monolithic application
+ teams
2001
Lesson learned: decompose for agility
2002
microservices
+ 2 pizza teams

3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Full ownership
Full accountability
“DevOps”
Focused innovation
Two-pizza teams

4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Monolith development lifecycle
monitorreleasetestbuild
developers
delivery pipelines
services

5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Microservice development lifecycle
???
developers
delivery pipelines
services

6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Microservice development lifecycle
developers services
monitorreleasetestbuild
delivery pipelines
monitorreleasetestbuild
monitorreleasetestbuild
monitorreleasetestbuild
monitorreleasetestbuild
monitorreleasetestbuild

7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ListenIterate
Experiment
Innovation
Flywheel
Experiments power the engine of rapid innovation

8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What changes do you need to make to adopt these best practices?
Serverless
No provisioning/management
Automatic scaling
Pay for value billing
Availability and resiliency
Microservices
Componentization
Business capabilities
Products not projects
Infrastructure automation
DevOps
Cultural philosophies
Cross-disciplinary teams
CI/CD
Automation tools
DEV OPS
Architectural
patterns
Operational
Model
Software
Delivery

9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Release process stages
Source Build Test Production

10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Release process stages
Source Build Test Production

11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Release process stages
Source Build Test Production

12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pillars of releasing modern applications

13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pillars of releasing modern applications
Infrastructure
as code

14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Infrastructure as code goals
1. Make infrastructure changes repeatable and predictable
2. Release infrastructure changes using the same tools as code changes
3. Replicate production environment in a staging environment to enable
continuous testing

15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Infrastructure as code
Declarative
I tell you
what I need
I tell you
what to do
Imperative

16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Model function environments with AWS
Serverless Application Model (SAM)
• Open source framework for building serverless
applications on AWS
• Shorthand syntax to express functions, APIs,
databases, and event source mappings
• Transforms and expands SAM syntax into AWS
CloudFormation syntax on deployment
• Supports all AWS CloudFormation resource types
https://aws.amazon.com/serverless/sam/

17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SAM template
AWSTemplateFormatVersion: '2010-09-09’
Transform: AWS::Serverless-2016-10-31
Resources:
GetFunction:
Type: AWS::Serverless::Function
Properties:
Handler: index.get
Runtime: nodejs8.10
CodeUri: src/
Policies:
- DynamoDBReadPolicy:
TableName: !Ref MyTable
Events:
GetResource:
Type: Api
Properties:
Path: /resource/{resourceId}
Method: get
MyTable:
Type: AWS::Serverless::SimpleTable
Just 20 lines to create:
• Lambda function
• IAM role
• API Gateway
• DynamoDB table

18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Model container environments with AWS
Cloud Development Kit (CDK)
Developer
Preview
• Open source framework to define cloud
infrastructure in TypeScript, Python, Java, C#, …
• Provides library of higher-level resource types
(“construct” classes) that have AWS best practices
built in by default, packaged as npm modules
• Provisions resources with CloudFormation
• Supports all CloudFormation resource types
AWS
CDK
https://awslabs.github.io/aws-cdk

19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDK template
import ec2 = require('@aws-cdk/aws-ec2');
import ecs = require('@aws-cdk/aws-ecs');
import cdk = require('@aws-cdk/cdk');
class BonjourFargate extends cdk.Stack {
constructor(parent: cdk.App, name: string, props?: cdk.StackProps) {
super(parent, name, props);
const vpc = new ec2.VpcNetwork(this, 'MyVpc', { maxAZs: 2 });
const cluster = new ecs.Cluster(this, 'Cluster', { vpc });
new ecs.LoadBalancedFargateService(
this, "FargateService", {
cluster,
image: ecs.DockerHub.image("amazon/amazon-ecs-sample"),
});
}
}
const app = new cdk.App();
new BonjourFargate(app, 'Bonjour');
app.run();

20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
import ec2 = require('@aws-cdk/aws-ec2');
import ecs = require('@aws-cdk/aws-ecs');
import cdk = require('@aws-cdk/cdk');
class BonjourFargate extends cdk.Stack {
constructor(parent: cdk.App, name: string, props?: cdk.StackProps) {
super(parent, name, props);
const vpc = new ec2.VpcNetwork(this, 'MyVpc', { maxAZs: 2 });
const cluster = new ecs.Cluster(this, 'Cluster', { vpc });
new ecs.LoadBalancedFargateService(
this, "FargateService", {
cluster,
image: ecs.DockerHub.image("amazon/amazon-ecs-sample"),
});
}
}
const app = new cdk.App();
new BonjourFargate(app, 'Bonjour');
app.run();
CDK template

21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDK template
import ec2 = require('@aws-cdk/aws-ec2');
import ecs = require('@aws-cdk/aws-ecs');
import cdk = require('@aws-cdk/cdk');
class BonjourFargate extends cdk.Stack {
constructor(parent: cdk.App, name: string, props?: cdk.StackProps) {
super(parent, name, props);
const vpc = new ec2.VpcNetwork(this, 'MyVpc', { maxAZs: 2 });
const cluster = new ecs.Cluster(this, 'Cluster', { vpc });
new ecs.LoadBalancedFargateService(
this, "FargateService", {
cluster,
image: ecs.DockerHub.image("amazon/amazon-ecs-sample"),
});
}
}
const app = new cdk.App();
new BonjourFargate(app, 'Bonjour');
app.run();

22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pillars of releasing modern applications
Infrastructure
as code

23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pillars of releasing modern applications
Continuous
integration

24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Continuous integration goals
Source Build Test Production

25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Continuous integration goals
1. Automatically kick off a new release when new code is checked in
2. Build and test code in a consistent, repeatable environment
3. Continually have an artifact ready for deployment
4. Continually close feedback loop when build fails

26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS CodeBuild
• Fully managed build service that compiles source
code, runs tests, and produces software packages
• Scales continuously and processes multiple builds
concurrently
• No build servers to manage
• Pay by the minute, only for the compute
resources you use
• Monitor builds through CloudWatch Events

27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pillars of releasing modern applications
Continuous
integration

28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pillars of releasing modern applications
Continuous
deployment

29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Continuous deployment goals
Source Build Test Production

30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Continuous deployment goals
1. Automatically deploy new changes to staging environments
for testing
2. Deploy to production safely without impacting customers
3. Deliver to customers faster: Increase deployment frequency,
and reduce change lead time and change failure rate

31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS CodeDeploy
• Automates code deployments to any instance
and Lambda
• Handles the complexity of updating your
applications
• Avoid downtime during application deployment
• Roll back automatically if failure detected
• Deploy to Amazon EC2, Lambda, or on-premises
servers

32. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Progressive Deployment
• Linear, Canary, Blue / Green

33. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Progressive Deployment with Lambda
Enable in your serverless application template
Resources:
GetFunction:
Type: AWS::Serverless::Function
Properties:
DeploymentPreference:
Type: Canary10Percent10Minutes
Alarms:
- !Ref ErrorsAlarm
Hooks:
PreTraffic: !Ref PreTrafficHook
Canary10Percent30Minutes
Canary10Percent5Minutes
Canary10Percent10Minutes
Canary10Percent15Minutes
Linear10PercentEvery10Minutes
Linear10PercentEvery1Minute
Linear10PercentEvery2Minutes
Linear10PercentEvery3Minutes
AllAtOnce

34. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CodeDeploy – Lambda canary deployment
API
Gateway
Lambda
function
weighted
alias “live”
v1 Lambda
function
code
100%

35. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CodeDeploy – Lambda canary deployment
API
Gateway
Lambda
function
weighted
alias “live”
v1 code100%
Run PreTraffic hook against v2 code before it receives traffic
v2 code0%

36. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CodeDeploy – Lambda canary deployment
API
Gateway
Lambda
function
weighted
alias “live”
v1 code90%
Wait for 10 minutes, roll back in case of alarm
v2 code10%

37. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CodeDeploy – Lambda canary deployment
API
Gateway
Lambda
function
weighted
alias “live”
v1 code0%
Run PostTraffic hook and complete deployment
v2 code100%

38. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CodeDeploy-ECS blue-green deployments
• Provisions “green” tasks, then flips traffic at the
load balancer
• Validation “hooks” enable testing at each stage of
the deployment
• Fast rollback to “blue” tasks in seconds if case of
hook failure or CloudWatch alarms
• Monitor deployment status and history via
console, API, Amazon SNS notifications, and
CloudWatch Events
• Use “CodeDeploy-ECS” deploy action in
CodePipeline or “aws ecs deploy” command in
Jenkins

39. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CodeDeploy-ECS blue-green deployment
100%
Prod
traffic

40. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CodeDeploy-ECS blue-green deployment
Target
group 2
100%
Prod
traffic
Test traffic listener
(port 9000)

41. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CodeDeploy-ECS blue-green deployment
Green tasks:
v2 code
100%
Prod
traffic
Provision green tasks

42. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CodeDeploy-ECS blue-green deployment
100%
Test
traffic
100%
Prod
traffic
Run hook against test endpoint before green tasks receive prod traffic

43. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CodeDeploy-ECS blue-green deployment
100%
Prod
traffic
Flip traffic to green tasks, rollback in case of alarm
0%
Prod
traffic

44. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CodeDeploy-ECS blue-green deployment
100%
Prod
traffic
Drain blue tasks

45. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pillars of releasing modern applications
Continuous
deployment

46. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pillars of releasing modern applications

47. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Demo

48. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Takeaways
1. Manage your infrastructure as code
2. Frequently build and integrate your code to get a first feedback
3. Continuously release in production using canary releases with
monitoring and automated rollbacks
4. Use canary releases to get both technical and business feedback

49. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you – leave your feedback !
{
"name": "Sébastien Stormacq",
"role": "Developer Evangelist",
"company": "Amazon Web Services”,
"twitter": ”@sebsto”,
}
@sebsto sebsto