This document discusses continuous integration (CI) and continuous deployment (CD) workflows on AWS. It provides examples of CI/CD pipelines and tools. It also demonstrates how to automate infrastructure deployment and management using AWS services like CloudFormation, containerization with Docker, and extending CI/CD tools to interact with AWS APIs. The document concludes with a discussion on how to implement best practices for innovation, quality and governance in CI/CD processes.

1. DevOps Culture: Continuous Integration &
Continuous Deployment on the AWS Cloud
Adrian White
Solutions Architect, AWS

2. v
Innovation, Quality, Governance

3. An example CI/CD workflow
v
Stacks /
Environments(s)
Issue CI/CD Tool
Tracker
SCM
Infrastructure
automation /
deployment
Test tools /
harnesses

4. An example CI/CD workflow
v
Tasks for AWS
PHPUnit
jQuery
…
CloudFormation Stack(s)

5. v
A CI/CD pipeline
Code
Test
Deploy
Release
Teardown

6. Getting your source under control
v
Prod UAT Feature
Code
Test
Deploy
Release
Teardown
Code
Test
Deploy
Release
Teardown
Code
Test
Deploy
Release
Teardown
Code
Test
Deploy
Release
Teardown

7. v
Automated merging
UAT Feature 1 Feature 2

8. v
What does CI give us?
• Test driven promotion (of development change)
• Increasing velocity of feedback cycle through iterative change
• Contain change to reduce risk
• Bugs are detected quickly
• Automated testing reduces size of testing effort

9. v
Demo: CI pipeline

10. What does CD give us?
v
• Changes are pushed quickly to production
• Immediate feedback from users
• Supports A/B testing or “We test customer reactions to features in production”
• Hardens, de-risks the deployment process
• Gives us a breadth of data points across our applications

11. Deployment approaches
v
• Deploy in-place
• Manage interruption
• Fast deployment
• Discrete environment
• Bake AMI
• Multiple environments from branches
• Support A/B testing
• “Rolling DNS”

12. v
Bake process
• Start a builder instance
• Bootstrap with cfn-init, cfn-signal
• Bake your AMI
• EC2 CreateImage
• Tag it
• Cost remediation
• Reporting
• Destroy / clean up the builder instance
Your Code
Web
Container
Framework
Platform
OS
Your Code
Web
Container
Framework
Platform
OS
Your Code
Web
Container
Framework
Platform
OS

13. AWS::CloudFormation::Init
v
"AWS::CloudFormation::Init" : {
“cfn” : {
"packages" :{
"yum" : { "httpd" : [] }
},
"files":{
“/home/ec2-user/myfile.html:{
"source" : { "Fn::Join" : [ "", ["https://s3-ap-southeast-2.amazonaws.com/",{ "Ref" :
"S3Bucket" },”/myfile.html”]] },
"mode":"000644",
"owner":"root",
"group":"root",
"authentication":"S3AccessCreds”
},

14. AWS::CloudFormation::Init
v
"services": {
"sysvinit" : {
"httpd" : {
"enabled" : "true",
"ensureRunning" : "true"
}
}
}
}

15. v
Demo: CD pipeline

16. v
Release
Release
Test the new stack
Match the traffic between the two stacks
Update the “floating” DNS record
Send Notification(s)
ROLLBACK

17. v
Blue green deployment
cicd-bootcamp.com
cicd-bootcamp-2.com cicd-bootcamp-2.com

18. v
Blue green deployment
cicd-bootcamp.com
cicd-bootcamp-2.com cicd-bootcamp-2.com

19. v
Blue green deployment
cicd-bootcamp.com
cicd-bootcamp-2.com cicd-bootcamp-2.com

20. v
Blue green deployment
cicd-bootcamp.com
cicd-bootcamp-2.com cicd-bootcamp-2.com

21. v
Teardown
Teardown
Ensure that no traffic is moving though ELB
Teardown the CloudFormation Stack
Deregister the AMI

22. v
Advanced Techniques
• Managing CD sprawl / Segregation of duties
• CloudFormation componentization and re-use
• Extending CloudFormation with custom resources
• Injecting dynamic data into your templates
• Manage custom resources e.g. relational database schemas
• Extending your CICD tools
• Making your CI and CD tools AWS aware

23. v
Stack chaining

24. v
Stack chaining

25. v
Stack chaining

26. CloudFormation Merging
v
CloudFormation
VPC
Subnets
Security Groups
CloudFormation Frameworks
Best Practice
Application Code
Application CloudFormation
Load Balancing Setup
Git Git
Operations Repo Application Repo

27. CloudFormation Custom Resources
v
1 2
Custom Resource
Implementation
Region
SQS Queue
AWS
CloudFormation
Custom Resource
Topic
Auto scaling Group
• Add New Resources
• Including AWS resources not currently
supported by CFN
• Interact with the CloudFormation Workflow
• Inject dynamic data into a stack
• Extend the capabilities of existing resources
• Data management via CloudFormation
• It’s really simple if you use aws-cfn-resource-
bridge
• Install or fork from
https://github.com/aws/aws-cfn-resource-
bridge
Create
app:WebApp
version:1.2
os:linux
DynamoDB
3
4
6
Query table, get AMI
ID where:
app=WebApp
version=1.2
os is linux
5
Output
ami-id:ami-xxxxx
Returns AMI id
7 in ami-id key
Deploy EC2
Instance with
AMI ami-xxxxx

28. Custom Resources - DatabaseSchema
v
"MyDBSchema" : {
"Type" : "Custom::DatabaseSchema”, "Version" : "1.0",
"Properties" : {
"ServiceToken": "arn:aws:sns:us-east-1:12345EXAMPLE:DBSchema",
"databaseChangeLog" : [ {
"changeSet" : {
"id" : "1",
"author" : "adamthom",
"changes" : [ {
"createTable" : { … }
} ]
}
}
}
}

29. Custom Resources - DatabaseSchema
v
"createTable" : {
"tableName" : "example",
"columns" : [ {
"column" : {
"name" : "id",
"type" : "int",
"autoIncrement" : true,
"constraints" : {
"primaryKey" : true,
"nullable" : false
}
}
} ]
}

30. Extending your CI and CD tools
v
Tasks for AWS
DynamoDB

31. Extending your CI and CD tools
v
Tasks for AWS
DynamoDB

32. v
Demo: Release
2
1
Code
Test
Deploy
Release
Teardown
Production
Code
Test
Deploy
Release
Teardown

33. v
Situation Awareness
Burden of Responsibility
APIs
Tasks for AWS

34. v
Containerisation
• Build environments for artifacts, don’t update environments with artifacts
• All environments are transient
• Standardisation, abstraction and portability

35. Docker & AWS Elastic Beanstalk
v
• A framework for managing Linux containers
• LXC containers are more lightweight than VMs
• Amazon Linux (2014.03) bundles Docker 0.9 and LXC 0.9
• Docker containers on Beanstalk are Go!

36. EC2 Container Service (Preview)
• Highly scalable, high performance container management
v
• Supports Docker containers within your VPC
• Manages container lifecycle and definitions
• Cluster and container scheduler

37. Innovation, Quality, Governance
v
Discrete environments for each branch
Leverage CD tools to provide separation of duties
Interface with the API
Automated testing on every commit on every branch
Audit Logs
Use custom resources to extend CloudFormation
Git approvals process
Leverage DNS
Environments for artifacts

38. v

39. AWS Training & Certification
AWS offers Training and Certification to help you develop your skills and gain recognition for your technical experience
with AWS services and solutions.
v
Online Training
Gain confidence and hands-on
experience with AWS. Watch free
Instructional Videos and explore Self-
Paced Labs
Instructor Led Classes
Learn how to design, deploy and operate
highly available, cost-effective and secure
applications on AWS in courses led by
qualified AWS instructors
AWS Certification
Validate your technical expertise with
AWS and use practice exams to help you
prepare for AWS Certification
http://aws.amazon.com/training

40. v
Thank You