CI/CD using AWS developer tools

AWS User Group Bengaluru
AWS User Group BengaluruAWS User Group Bengaluru
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Bengaluru
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
CI CD using AWS Developer Tools
Bhuvaneswari Subramani & Vijaya Nirmala
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Bhuvaneswari Subramani (Bhuvana)
Director, Engineering Operations
– GT Nexus, an Infor Company
Currently working on Cloud Computing,
DevOps &, Performance QA
https://installjournal.blogspot.com
Vijaya Nirmala G (Nirmala)
DevOps Solutions Lead
– Sonata Software
Currently working on DevOps Solutions
implementation
https://cloudgoddess.blogspot.com/
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
• AWS CI CD Services Overview
• Use cases leveraging AWS CI CD Services
1. Web Application Deployments
2. Infrastructure Rollouts
3. Serverless Application Deployments
• buildspec, appspec & SAM Template
• Debugging Build & Deployment
• Rollback Deployments
• Generic Pipeline for Multiple Environments
• Metrics to gauge DevOps
Agenda
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
AWS CI CD Services - Overview
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Software Release Phases vs AWS CI CD Services
Source Build Test Deploy
AWS CodeCommit AWS CodeBuild Third Party
Tooling
AWS CodeDeploy
AWS
CodePipeline
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
AWS CodeCommit
• Secure, Scalable, and managed Git Source control
• Use Standard git tools
• Scalability, availability and durability of Amazon S3
• No repo size limit
• Post commit hooks to call out to SNS / Lambda
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Visualizer Compare Pull Request
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
AWS CodeBuild • Fully managed build service that compiles source code,
run tests, and produces software packages
• Scales continuously and processes multiple builds
• You can provide custom build environments suited to
your needs via Docker images
• Only pay by the minute for the compute resources you
use
• Launched with Services like CodePipeline or Jenkins
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
AWS CodeDeploy
• Automates code deployments to EC2 / On-prem
• Handles the complexity of updating your applications
• Minimal deployment downtime
• Rollback automatically, if failure detected
• Supports varied languages and operating systems
• Integrates with third-party tools like Jenkins
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
AWS
CodeDeploy Revision 1
Application
Revision 2
Revision 3
Revision n
Instance 1
Deployment Group
Instance 2
Instance 3
Instance n
Deployments
Deploy
Config
appspec.
yml
In-place
deployment
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
AWS
CodeDeploy Revision 1
Application
Revision 2
Revision 3
Revision n
Instance 1
Deployment Group
Instance 2
Instance 3
Instance n
Deployments
Deploy
Config
appspec.
yml
In-place
deployment
What to
deploy?
Where to
deploy?
How to
deploy?
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
AWS CodePipeline
• Continuous delivery service for fast and reliable
application updates
• Model and visualize your software release process
• Builds, tests and deploys your code on every
commit
• Integrates with third-party tools
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
AWS CodePipeline Action Action
Stage
Action Action
Stage
Action
Transition
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
AWS CI CD
Workflows
Web Application Deployments
Infrastructure Rollouts
Serverless Application Deployments
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Web Application Deployments
Infrastructure Rollouts
Serverless Application Deployments
AWS CI CD
Workflows
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Web Application Deployments
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Web Application
Deployments
AW S
CodePipeline
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Web Application Deployments
Infrastructure Rollouts
Serverless Application Deployments
AWS CI CD
Workflows
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Infrastructure Rollouts
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Infrastructure
Rollouts
AW S
CodePipeline
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Web App vs
Infrastructure
Rollouts
AW S
CodePipeline
VS
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
AWS CI CD
Workflows
Web Application Deployments
Infrastructure Rollouts
Serverless Applications
DeploymentsServerless Application Deployments
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Serverless Application Deployments
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Serverless
Application
Deployments
AW S
CodePipeline
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Serverless
Application
Deployments
AW S
CodePipeline
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
AW S
CodeBuild
buildspec.yml from Application Deployments
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
AW S
CodeBuild
Create & store an artifact in S3
buildspec.yml fromApplication Deployments
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
AW S
CodeDeploy
appspec.yml fromApplication Deployments
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
AW S
CodeDeploy
Files to be copied to the instance
during deployment’s install
appspec.yml fromApplication Deployments
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
AW S
CodeDeploy
template.yml fromServerless Application Deployments
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Debugging Builds
• Enable Logging in CloudWatch / S3
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Debugging Builds
• Enable Logging in CloudWatch / S3
• Local Build Support for AWS CodeBuild
• Get the AWS CodeBuild docker image file from AWS Github
• Build the CodeBuild image locally
• Setup CodeBuild local Agent
• Use the local agent to build your project
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Debugging Deployments
• CodeDeploy agent generates agent, updater & deployment logs
• Send them to CloudWatch for debugging
• CodeDeploy agent logs [EC2/On-prem only]
• /var/log/aws/codedeploy-agent/codedeploy-agent.log
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Debugging Deployments
• CodeDeploy agent generates agent, updater & deployment logs
• Send them to CloudWatch for debugging
• CodeDeploy agent logs [EC2/On-prem only]
• /var/log/aws/codedeploy-agent/codedeploy-agent.log
• CodeDeploy deployment logs
• /opt/codedeploy-agent/deployment-root/deployment-logs/
• CodeDeploy updater logs
• /tmp/codedeploy-agent.update.log
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Rollback Deployments
• Rollback in AWS is actually ====>
• Configure re-deploy by enabling
• Code deploy -> Rollbacks ->
• Code deploy -> ‘Automatic Rollbacks’
• Deployment Configuration to enable rollback based on healthy instances
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Generic Pipeline Setup
• Provision resources via Cloudformation with
Environment as Parameter
• Create Environment specific configuration.json
• Map the relevant configuration.json in CodePipeline
Stage
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
CloudFormation Template
Parameters
Mappings
Resources
Output template
Parameter
Values
create /
update
Env -> QA /
PreProd / Prod
stack
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Metrics to gauge DevOps
• Rapid Delivery with Increased Efficiency
• Increased Feature releases with reduced TTM
• Quicker feedback (system/user) to teams & stake holders
• Greater % of defects detected in testing (Unit & SIT Cycles)
• Ticket / Incidents volume reduction in PreProd & Prod
• High Availability
• Elastic & Scalable Infrastructure
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
CI CD Workflow MindMap
- The devil in the detail
©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
Thank you!
You may refer https://installjournal.blogspot.com for AWS CI CD LAB Series
1 of 42

Recommended

Advanced Continuous Delivery Best Practices (DEV317-R1) - AWS re:Invent 2018 by
Advanced Continuous Delivery Best Practices (DEV317-R1) - AWS re:Invent 2018Advanced Continuous Delivery Best Practices (DEV317-R1) - AWS re:Invent 2018
Advanced Continuous Delivery Best Practices (DEV317-R1) - AWS re:Invent 2018Amazon Web Services
1.4K views68 slides
Deliver Instant Demos and Trials of Your Desktop Application with AppStream 2... by
Deliver Instant Demos and Trials of Your Desktop Application with AppStream 2...Deliver Instant Demos and Trials of Your Desktop Application with AppStream 2...
Deliver Instant Demos and Trials of Your Desktop Application with AppStream 2...Amazon Web Services
172 views18 slides
How Dow Jones Uses AWS to Enable Innovation and New Engineering Work (CTD316)... by
How Dow Jones Uses AWS to Enable Innovation and New Engineering Work (CTD316)...How Dow Jones Uses AWS to Enable Innovation and New Engineering Work (CTD316)...
How Dow Jones Uses AWS to Enable Innovation and New Engineering Work (CTD316)...Amazon Web Services
415 views26 slides
Set Up a CI/CD Pipeline for Deploying Containers Using the AWS Developer Tool... by
Set Up a CI/CD Pipeline for Deploying Containers Using the AWS Developer Tool...Set Up a CI/CD Pipeline for Deploying Containers Using the AWS Developer Tool...
Set Up a CI/CD Pipeline for Deploying Containers Using the AWS Developer Tool...Amazon Web Services
997 views36 slides
Building Microservices with the Twelve Factor App Pattern on AWS by
Building Microservices with the Twelve Factor App Pattern on AWSBuilding Microservices with the Twelve Factor App Pattern on AWS
Building Microservices with the Twelve Factor App Pattern on AWSAmazon Web Services
1.4K views91 slides
Mythical Mysfits: Monolith to Microservice with Docker and AWS Fargate (CON21... by
Mythical Mysfits: Monolith to Microservice with Docker and AWS Fargate (CON21...Mythical Mysfits: Monolith to Microservice with Docker and AWS Fargate (CON21...
Mythical Mysfits: Monolith to Microservice with Docker and AWS Fargate (CON21...Amazon Web Services
1.6K views22 slides

More Related Content

What's hot

Build a Game for Echo Buttons - an Alexa Gadget! (ALX405-R2) - AWS re:Invent ... by
Build a Game for Echo Buttons - an Alexa Gadget! (ALX405-R2) - AWS re:Invent ...Build a Game for Echo Buttons - an Alexa Gadget! (ALX405-R2) - AWS re:Invent ...
Build a Game for Echo Buttons - an Alexa Gadget! (ALX405-R2) - AWS re:Invent ...Amazon Web Services
471 views45 slides
Resiliency Testing: Verify That Your System Is as Reliable as You Think (ARC4... by
Resiliency Testing: Verify That Your System Is as Reliable as You Think (ARC4...Resiliency Testing: Verify That Your System Is as Reliable as You Think (ARC4...
Resiliency Testing: Verify That Your System Is as Reliable as You Think (ARC4...Amazon Web Services
864 views30 slides
Infrastructure Is Code with the AWS Cloud Development Kit (DEV372) - AWS re:I... by
Infrastructure Is Code with the AWS Cloud Development Kit (DEV372) - AWS re:I...Infrastructure Is Code with the AWS Cloud Development Kit (DEV372) - AWS re:I...
Infrastructure Is Code with the AWS Cloud Development Kit (DEV372) - AWS re:I...Amazon Web Services
3K views32 slides
Container Scheduling by
Container SchedulingContainer Scheduling
Container SchedulingAmazon Web Services
267 views52 slides
Running Serverless at The Edge (CTD302) - AWS re:Invent 2018 by
Running Serverless at The Edge (CTD302) - AWS re:Invent 2018Running Serverless at The Edge (CTD302) - AWS re:Invent 2018
Running Serverless at The Edge (CTD302) - AWS re:Invent 2018Amazon Web Services
7.9K views76 slides
AWS and Symantec: Cyber Defense at Scale (SEC311-S) - AWS re:Invent 2018 by
AWS and Symantec: Cyber Defense at Scale (SEC311-S) - AWS re:Invent 2018AWS and Symantec: Cyber Defense at Scale (SEC311-S) - AWS re:Invent 2018
AWS and Symantec: Cyber Defense at Scale (SEC311-S) - AWS re:Invent 2018Amazon Web Services
573 views27 slides

What's hot(20)

Build a Game for Echo Buttons - an Alexa Gadget! (ALX405-R2) - AWS re:Invent ... by Amazon Web Services
Build a Game for Echo Buttons - an Alexa Gadget! (ALX405-R2) - AWS re:Invent ...Build a Game for Echo Buttons - an Alexa Gadget! (ALX405-R2) - AWS re:Invent ...
Build a Game for Echo Buttons - an Alexa Gadget! (ALX405-R2) - AWS re:Invent ...
Resiliency Testing: Verify That Your System Is as Reliable as You Think (ARC4... by Amazon Web Services
Resiliency Testing: Verify That Your System Is as Reliable as You Think (ARC4...Resiliency Testing: Verify That Your System Is as Reliable as You Think (ARC4...
Resiliency Testing: Verify That Your System Is as Reliable as You Think (ARC4...
Infrastructure Is Code with the AWS Cloud Development Kit (DEV372) - AWS re:I... by Amazon Web Services
Infrastructure Is Code with the AWS Cloud Development Kit (DEV372) - AWS re:I...Infrastructure Is Code with the AWS Cloud Development Kit (DEV372) - AWS re:I...
Infrastructure Is Code with the AWS Cloud Development Kit (DEV372) - AWS re:I...
Running Serverless at The Edge (CTD302) - AWS re:Invent 2018 by Amazon Web Services
Running Serverless at The Edge (CTD302) - AWS re:Invent 2018Running Serverless at The Edge (CTD302) - AWS re:Invent 2018
Running Serverless at The Edge (CTD302) - AWS re:Invent 2018
Amazon Web Services7.9K views
AWS and Symantec: Cyber Defense at Scale (SEC311-S) - AWS re:Invent 2018 by Amazon Web Services
AWS and Symantec: Cyber Defense at Scale (SEC311-S) - AWS re:Invent 2018AWS and Symantec: Cyber Defense at Scale (SEC311-S) - AWS re:Invent 2018
AWS and Symantec: Cyber Defense at Scale (SEC311-S) - AWS re:Invent 2018
Use Elastic Beanstalk Blue/Green Deployment to Reduce Downtime & Risk (DEV330... by Amazon Web Services
Use Elastic Beanstalk Blue/Green Deployment to Reduce Downtime & Risk (DEV330...Use Elastic Beanstalk Blue/Green Deployment to Reduce Downtime & Risk (DEV330...
Use Elastic Beanstalk Blue/Green Deployment to Reduce Downtime & Risk (DEV330...
Amazon Web Services2.3K views
Deploying Microservices using AWS Fargate (CON315-R1) - AWS re:Invent 2018 by Amazon Web Services
Deploying Microservices using AWS Fargate (CON315-R1) - AWS re:Invent 2018Deploying Microservices using AWS Fargate (CON315-R1) - AWS re:Invent 2018
Deploying Microservices using AWS Fargate (CON315-R1) - AWS re:Invent 2018
Amazon Web Services1.3K views
Thomson Reuters Shows How It Hosted a .NET App on Amazon ECS Using Windows Co... by Amazon Web Services
Thomson Reuters Shows How It Hosted a .NET App on Amazon ECS Using Windows Co...Thomson Reuters Shows How It Hosted a .NET App on Amazon ECS Using Windows Co...
Thomson Reuters Shows How It Hosted a .NET App on Amazon ECS Using Windows Co...
Amazon Web Services1.1K views
Achieving Business Value with AWS - AWS Online Tech Talks by Amazon Web Services
Achieving Business Value with AWS - AWS Online Tech TalksAchieving Business Value with AWS - AWS Online Tech Talks
Achieving Business Value with AWS - AWS Online Tech Talks
Runtime Security across Kubernetes and AWS Fargate (CON317-R1) - AWS re:Inven... by Amazon Web Services
Runtime Security across Kubernetes and AWS Fargate (CON317-R1) - AWS re:Inven...Runtime Security across Kubernetes and AWS Fargate (CON317-R1) - AWS re:Inven...
Runtime Security across Kubernetes and AWS Fargate (CON317-R1) - AWS re:Inven...
Amazon Web Services1.4K views
Analyze Slide Images and Process Phenotypic Assays at Scale on AWS (CMP358) -... by Amazon Web Services
Analyze Slide Images and Process Phenotypic Assays at Scale on AWS (CMP358) -...Analyze Slide Images and Process Phenotypic Assays at Scale on AWS (CMP358) -...
Analyze Slide Images and Process Phenotypic Assays at Scale on AWS (CMP358) -...
Amazon Web Services1.4K views
Container Power Hour with Jess, Clare, and Abby (CON362) - AWS re:Invent 2018 by Amazon Web Services
Container Power Hour with Jess, Clare, and Abby (CON362) - AWS re:Invent 2018Container Power Hour with Jess, Clare, and Abby (CON362) - AWS re:Invent 2018
Container Power Hour with Jess, Clare, and Abby (CON362) - AWS re:Invent 2018
Deploying Serverless .NET Applications (WIN323) - AWS re:Invent 2018 by Amazon Web Services
Deploying Serverless .NET Applications (WIN323) - AWS re:Invent 2018Deploying Serverless .NET Applications (WIN323) - AWS re:Invent 2018
Deploying Serverless .NET Applications (WIN323) - AWS re:Invent 2018
What’s New for Amazon DynamoDB - 2018 Q1 Update - AWS Online Tech Talks by Amazon Web Services
What’s New for Amazon DynamoDB - 2018 Q1 Update - AWS Online Tech TalksWhat’s New for Amazon DynamoDB - 2018 Q1 Update - AWS Online Tech Talks
What’s New for Amazon DynamoDB - 2018 Q1 Update - AWS Online Tech Talks
A Serverless Journey: AWS Lambda Under the Hood (SRV409-R1) - AWS re:Invent 2018 by Amazon Web Services
A Serverless Journey: AWS Lambda Under the Hood (SRV409-R1) - AWS re:Invent 2018A Serverless Journey: AWS Lambda Under the Hood (SRV409-R1) - AWS re:Invent 2018
A Serverless Journey: AWS Lambda Under the Hood (SRV409-R1) - AWS re:Invent 2018
Amazon Web Services53.5K views
Kubernetes Clusters Security with Amazon EKS (CON338-R1) - AWS re:Invent 2018 by Amazon Web Services
Kubernetes Clusters Security with Amazon EKS (CON338-R1) - AWS re:Invent 2018Kubernetes Clusters Security with Amazon EKS (CON338-R1) - AWS re:Invent 2018
Kubernetes Clusters Security with Amazon EKS (CON338-R1) - AWS re:Invent 2018
Build a Vulnerability Management Program Using AWS for AWS (SEC337-R1) - AWS ... by Amazon Web Services
Build a Vulnerability Management Program Using AWS for AWS (SEC337-R1) - AWS ...Build a Vulnerability Management Program Using AWS for AWS (SEC337-R1) - AWS ...
Build a Vulnerability Management Program Using AWS for AWS (SEC337-R1) - AWS ...

Similar to CI/CD using AWS developer tools

CI CD using AWS Developer Tools @ AWS Community Day Bengaluru 2018 by
CI CD using AWS Developer Tools @ AWS Community Day Bengaluru 2018CI CD using AWS Developer Tools @ AWS Community Day Bengaluru 2018
CI CD using AWS Developer Tools @ AWS Community Day Bengaluru 2018Bhuvaneswari Subramani
72 views43 slides
Community day _aws_ci_cd_v0.2 by
Community day _aws_ci_cd_v0.2Community day _aws_ci_cd_v0.2
Community day _aws_ci_cd_v0.2VijayaNirmalaGopal
85 views30 slides
CI CD using AWS Developer Tools @ AWS Community Day Chennai 2019 by
CI CD using AWS Developer Tools @ AWS Community Day Chennai 2019CI CD using AWS Developer Tools @ AWS Community Day Chennai 2019
CI CD using AWS Developer Tools @ AWS Community Day Chennai 2019Bhuvaneswari Subramani
105 views37 slides
DevSecOps 的規模化實踐 (Level: 300-400) by
DevSecOps 的規模化實踐 (Level: 300-400)DevSecOps 的規模化實踐 (Level: 300-400)
DevSecOps 的規模化實踐 (Level: 300-400)Amazon Web Services
493 views29 slides
CI/CD@Scale by
CI/CD@ScaleCI/CD@Scale
CI/CD@ScaleAmazon Web Services
295 views32 slides
CI/CD with AWS Developer Tools and Fargate by
CI/CD with AWS Developer Tools and FargateCI/CD with AWS Developer Tools and Fargate
CI/CD with AWS Developer Tools and FargateAmazon Web Services
2.5K views51 slides

Similar to CI/CD using AWS developer tools(20)

CI CD using AWS Developer Tools @ AWS Community Day Bengaluru 2018 by Bhuvaneswari Subramani
CI CD using AWS Developer Tools @ AWS Community Day Bengaluru 2018CI CD using AWS Developer Tools @ AWS Community Day Bengaluru 2018
CI CD using AWS Developer Tools @ AWS Community Day Bengaluru 2018
CI CD using AWS Developer Tools @ AWS Community Day Chennai 2019 by Bhuvaneswari Subramani
CI CD using AWS Developer Tools @ AWS Community Day Chennai 2019CI CD using AWS Developer Tools @ AWS Community Day Chennai 2019
CI CD using AWS Developer Tools @ AWS Community Day Chennai 2019
Improve Productivity with Continuous Integration & Delivery by Amazon Web Services
Improve Productivity with Continuous Integration & DeliveryImprove Productivity with Continuous Integration & Delivery
Improve Productivity with Continuous Integration & Delivery
CI-CD with AWS Developer Tools and Fargate_AWSPSSummit_Singapore by Amazon Web Services
CI-CD with AWS Developer Tools and Fargate_AWSPSSummit_SingaporeCI-CD with AWS Developer Tools and Fargate_AWSPSSummit_Singapore
CI-CD with AWS Developer Tools and Fargate_AWSPSSummit_Singapore
Build CICD Pipeline for Container Presentation Slides by Amazon Web Services
Build CICD Pipeline for Container Presentation SlidesBuild CICD Pipeline for Container Presentation Slides
Build CICD Pipeline for Container Presentation Slides
Amazon Web Services10.5K views
AWS DevOps Essentials: An Introductory Workshop on CI/CD Best Practices (DEV3... by Amazon Web Services
AWS DevOps Essentials: An Introductory Workshop on CI/CD Best Practices (DEV3...AWS DevOps Essentials: An Introductory Workshop on CI/CD Best Practices (DEV3...
AWS DevOps Essentials: An Introductory Workshop on CI/CD Best Practices (DEV3...
Amazon Web Services1.5K views
A Tale of Two Pizzas: Accelerating Software Delivery with AWS Developer Tools by Amazon Web Services
A Tale of Two Pizzas: Accelerating Software Delivery with AWS Developer ToolsA Tale of Two Pizzas: Accelerating Software Delivery with AWS Developer Tools
A Tale of Two Pizzas: Accelerating Software Delivery with AWS Developer Tools
Building a DevOps Pipeline on AWS (DEV326) - AWS re:Invent 2018 by Amazon Web Services
Building a DevOps Pipeline on AWS (DEV326) - AWS re:Invent 2018Building a DevOps Pipeline on AWS (DEV326) - AWS re:Invent 2018
Building a DevOps Pipeline on AWS (DEV326) - AWS re:Invent 2018
Amazon Web Services2.3K views
Scaling and Automating DevOps with CloudBees and Spot Instances (GPSTEC310) -... by Amazon Web Services
Scaling and Automating DevOps with CloudBees and Spot Instances (GPSTEC310) -...Scaling and Automating DevOps with CloudBees and Spot Instances (GPSTEC310) -...
Scaling and Automating DevOps with CloudBees and Spot Instances (GPSTEC310) -...
How Zalando integrates Kubernetes with AWS by Uri Savelchev
How Zalando integrates Kubernetes with AWSHow Zalando integrates Kubernetes with AWS
How Zalando integrates Kubernetes with AWS
Uri Savelchev72 views
Improve productivity with Continuous Integration & Delivery by Amazon Web Services
Improve productivity with Continuous Integration & DeliveryImprove productivity with Continuous Integration & Delivery
Improve productivity with Continuous Integration & Delivery
Improve Productivity with Continuous Integration & Delivery by Amazon Web Services
Improve Productivity with Continuous Integration & DeliveryImprove Productivity with Continuous Integration & Delivery
Improve Productivity with Continuous Integration & Delivery
Improve Productivity with Continuous Integration & Delivery by Amazon Web Services
Improve Productivity with Continuous Integration & DeliveryImprove Productivity with Continuous Integration & Delivery
Improve Productivity with Continuous Integration & Delivery
CI/CD for Serverless and Containerized Applications (DEV309-R1) - AWS re:Inve... by Amazon Web Services
CI/CD for Serverless and Containerized Applications (DEV309-R1) - AWS re:Inve...CI/CD for Serverless and Containerized Applications (DEV309-R1) - AWS re:Inve...
CI/CD for Serverless and Containerized Applications (DEV309-R1) - AWS re:Inve...
Amazon Web Services8.6K views

More from AWS User Group Bengaluru

Demystifying identity on AWS by
Demystifying identity on AWSDemystifying identity on AWS
Demystifying identity on AWSAWS User Group Bengaluru
440 views108 slides
AWS Secrets for Best Practices by
AWS Secrets for Best PracticesAWS Secrets for Best Practices
AWS Secrets for Best PracticesAWS User Group Bengaluru
930 views21 slides
Cloud Security by
Cloud SecurityCloud Security
Cloud SecurityAWS User Group Bengaluru
1.9K views133 slides
Lessons learnt building a Distributed Linked List on S3 by
Lessons learnt building a Distributed Linked List on S3Lessons learnt building a Distributed Linked List on S3
Lessons learnt building a Distributed Linked List on S3AWS User Group Bengaluru
312 views27 slides
Medlife journey with AWS by
Medlife journey with AWSMedlife journey with AWS
Medlife journey with AWSAWS User Group Bengaluru
336 views17 slides
Building Efficient, Scalable and Resilient Front-end logging service with AWS by
Building Efficient, Scalable and Resilient Front-end logging service with AWSBuilding Efficient, Scalable and Resilient Front-end logging service with AWS
Building Efficient, Scalable and Resilient Front-end logging service with AWSAWS User Group Bengaluru
443 views33 slides

More from AWS User Group Bengaluru(20)

Building Efficient, Scalable and Resilient Front-end logging service with AWS by AWS User Group Bengaluru
Building Efficient, Scalable and Resilient Front-end logging service with AWSBuilding Efficient, Scalable and Resilient Front-end logging service with AWS
Building Efficient, Scalable and Resilient Front-end logging service with AWS
Building Efficient, Scalable and Resilient Front-end logging service with AWS by AWS User Group Bengaluru
Building Efficient, Scalable and Resilient Front-end logging service with AWSBuilding Efficient, Scalable and Resilient Front-end logging service with AWS
Building Efficient, Scalable and Resilient Front-end logging service with AWS

Recently uploaded

Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive by
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveNetwork Automation Forum
34 views35 slides
SUPPLIER SOURCING.pptx by
SUPPLIER SOURCING.pptxSUPPLIER SOURCING.pptx
SUPPLIER SOURCING.pptxangelicacueva6
16 views1 slide
PRODUCT LISTING.pptx by
PRODUCT LISTING.pptxPRODUCT LISTING.pptx
PRODUCT LISTING.pptxangelicacueva6
14 views1 slide
PharoJS - Zürich Smalltalk Group Meetup November 2023 by
PharoJS - Zürich Smalltalk Group Meetup November 2023PharoJS - Zürich Smalltalk Group Meetup November 2023
PharoJS - Zürich Smalltalk Group Meetup November 2023Noury Bouraqadi
132 views17 slides
Business Analyst Series 2023 - Week 3 Session 5 by
Business Analyst Series 2023 -  Week 3 Session 5Business Analyst Series 2023 -  Week 3 Session 5
Business Analyst Series 2023 - Week 3 Session 5DianaGray10
300 views20 slides
virtual reality.pptx by
virtual reality.pptxvirtual reality.pptx
virtual reality.pptxG036GaikwadSnehal
14 views15 slides

Recently uploaded(20)

Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive by Network Automation Forum
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive
PharoJS - Zürich Smalltalk Group Meetup November 2023 by Noury Bouraqadi
PharoJS - Zürich Smalltalk Group Meetup November 2023PharoJS - Zürich Smalltalk Group Meetup November 2023
PharoJS - Zürich Smalltalk Group Meetup November 2023
Noury Bouraqadi132 views
Business Analyst Series 2023 - Week 3 Session 5 by DianaGray10
Business Analyst Series 2023 -  Week 3 Session 5Business Analyst Series 2023 -  Week 3 Session 5
Business Analyst Series 2023 - Week 3 Session 5
DianaGray10300 views
Voice Logger - Telephony Integration Solution at Aegis by Nirmal Sharma
Voice Logger - Telephony Integration Solution at AegisVoice Logger - Telephony Integration Solution at Aegis
Voice Logger - Telephony Integration Solution at Aegis
Nirmal Sharma39 views
Five Things You SHOULD Know About Postman by Postman
Five Things You SHOULD Know About PostmanFive Things You SHOULD Know About Postman
Five Things You SHOULD Know About Postman
Postman36 views
"Running students' code in isolation. The hard way", Yurii Holiuk by Fwdays
"Running students' code in isolation. The hard way", Yurii Holiuk "Running students' code in isolation. The hard way", Yurii Holiuk
"Running students' code in isolation. The hard way", Yurii Holiuk
Fwdays17 views
Future of AR - Facebook Presentation by ssuserb54b561
Future of AR - Facebook PresentationFuture of AR - Facebook Presentation
Future of AR - Facebook Presentation
ssuserb54b56115 views
Powerful Google developer tools for immediate impact! (2023-24) by wesley chun
Powerful Google developer tools for immediate impact! (2023-24)Powerful Google developer tools for immediate impact! (2023-24)
Powerful Google developer tools for immediate impact! (2023-24)
wesley chun10 views
ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ... by Jasper Oosterveld
ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ...ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ...
ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ...
STPI OctaNE CoE Brochure.pdf by madhurjyapb
STPI OctaNE CoE Brochure.pdfSTPI OctaNE CoE Brochure.pdf
STPI OctaNE CoE Brochure.pdf
madhurjyapb14 views
Case Study Copenhagen Energy and Business Central.pdf by Aitana
Case Study Copenhagen Energy and Business Central.pdfCase Study Copenhagen Energy and Business Central.pdf
Case Study Copenhagen Energy and Business Central.pdf
Aitana16 views
STKI Israeli Market Study 2023 corrected forecast 2023_24 v3.pdf by Dr. Jimmy Schwarzkopf
STKI Israeli Market Study 2023   corrected forecast 2023_24 v3.pdfSTKI Israeli Market Study 2023   corrected forecast 2023_24 v3.pdf
STKI Israeli Market Study 2023 corrected forecast 2023_24 v3.pdf
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas... by Bernd Ruecker
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
Bernd Ruecker40 views

CI/CD using AWS developer tools

  • 1. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Bengaluru
  • 2. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. CI CD using AWS Developer Tools Bhuvaneswari Subramani & Vijaya Nirmala
  • 3. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Bhuvaneswari Subramani (Bhuvana) Director, Engineering Operations – GT Nexus, an Infor Company Currently working on Cloud Computing, DevOps &, Performance QA https://installjournal.blogspot.com Vijaya Nirmala G (Nirmala) DevOps Solutions Lead – Sonata Software Currently working on DevOps Solutions implementation https://cloudgoddess.blogspot.com/
  • 4. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. • AWS CI CD Services Overview • Use cases leveraging AWS CI CD Services 1. Web Application Deployments 2. Infrastructure Rollouts 3. Serverless Application Deployments • buildspec, appspec & SAM Template • Debugging Build & Deployment • Rollback Deployments • Generic Pipeline for Multiple Environments • Metrics to gauge DevOps Agenda
  • 5. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. AWS CI CD Services - Overview
  • 6. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Software Release Phases vs AWS CI CD Services Source Build Test Deploy AWS CodeCommit AWS CodeBuild Third Party Tooling AWS CodeDeploy AWS CodePipeline
  • 7. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. AWS CodeCommit • Secure, Scalable, and managed Git Source control • Use Standard git tools • Scalability, availability and durability of Amazon S3 • No repo size limit • Post commit hooks to call out to SNS / Lambda
  • 8. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Visualizer Compare Pull Request
  • 9. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. AWS CodeBuild • Fully managed build service that compiles source code, run tests, and produces software packages • Scales continuously and processes multiple builds • You can provide custom build environments suited to your needs via Docker images • Only pay by the minute for the compute resources you use • Launched with Services like CodePipeline or Jenkins
  • 10. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. AWS CodeDeploy • Automates code deployments to EC2 / On-prem • Handles the complexity of updating your applications • Minimal deployment downtime • Rollback automatically, if failure detected • Supports varied languages and operating systems • Integrates with third-party tools like Jenkins
  • 11. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. AWS CodeDeploy Revision 1 Application Revision 2 Revision 3 Revision n Instance 1 Deployment Group Instance 2 Instance 3 Instance n Deployments Deploy Config appspec. yml In-place deployment
  • 12. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. AWS CodeDeploy Revision 1 Application Revision 2 Revision 3 Revision n Instance 1 Deployment Group Instance 2 Instance 3 Instance n Deployments Deploy Config appspec. yml In-place deployment What to deploy? Where to deploy? How to deploy?
  • 13. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. AWS CodePipeline • Continuous delivery service for fast and reliable application updates • Model and visualize your software release process • Builds, tests and deploys your code on every commit • Integrates with third-party tools
  • 14. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. AWS CodePipeline Action Action Stage Action Action Stage Action Transition
  • 15. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved.
  • 16. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. AWS CI CD Workflows Web Application Deployments Infrastructure Rollouts Serverless Application Deployments
  • 17. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Web Application Deployments Infrastructure Rollouts Serverless Application Deployments AWS CI CD Workflows
  • 18. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Web Application Deployments
  • 19. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Web Application Deployments AW S CodePipeline
  • 20. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Web Application Deployments Infrastructure Rollouts Serverless Application Deployments AWS CI CD Workflows
  • 21. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Infrastructure Rollouts
  • 22. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Infrastructure Rollouts AW S CodePipeline
  • 23. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Web App vs Infrastructure Rollouts AW S CodePipeline VS
  • 24. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. AWS CI CD Workflows Web Application Deployments Infrastructure Rollouts Serverless Applications DeploymentsServerless Application Deployments
  • 25. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Serverless Application Deployments
  • 26. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Serverless Application Deployments AW S CodePipeline
  • 27. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Serverless Application Deployments AW S CodePipeline
  • 28. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. AW S CodeBuild buildspec.yml from Application Deployments
  • 29. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. AW S CodeBuild Create & store an artifact in S3 buildspec.yml fromApplication Deployments
  • 30. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. AW S CodeDeploy appspec.yml fromApplication Deployments
  • 31. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. AW S CodeDeploy Files to be copied to the instance during deployment’s install appspec.yml fromApplication Deployments
  • 32. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. AW S CodeDeploy template.yml fromServerless Application Deployments
  • 33. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Debugging Builds • Enable Logging in CloudWatch / S3
  • 34. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Debugging Builds • Enable Logging in CloudWatch / S3 • Local Build Support for AWS CodeBuild • Get the AWS CodeBuild docker image file from AWS Github • Build the CodeBuild image locally • Setup CodeBuild local Agent • Use the local agent to build your project
  • 35. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Debugging Deployments • CodeDeploy agent generates agent, updater & deployment logs • Send them to CloudWatch for debugging • CodeDeploy agent logs [EC2/On-prem only] • /var/log/aws/codedeploy-agent/codedeploy-agent.log
  • 36. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Debugging Deployments • CodeDeploy agent generates agent, updater & deployment logs • Send them to CloudWatch for debugging • CodeDeploy agent logs [EC2/On-prem only] • /var/log/aws/codedeploy-agent/codedeploy-agent.log • CodeDeploy deployment logs • /opt/codedeploy-agent/deployment-root/deployment-logs/ • CodeDeploy updater logs • /tmp/codedeploy-agent.update.log
  • 37. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Rollback Deployments • Rollback in AWS is actually ====> • Configure re-deploy by enabling • Code deploy -> Rollbacks -> • Code deploy -> ‘Automatic Rollbacks’ • Deployment Configuration to enable rollback based on healthy instances
  • 38. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Generic Pipeline Setup • Provision resources via Cloudformation with Environment as Parameter • Create Environment specific configuration.json • Map the relevant configuration.json in CodePipeline Stage
  • 39. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. CloudFormation Template Parameters Mappings Resources Output template Parameter Values create / update Env -> QA / PreProd / Prod stack
  • 40. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Metrics to gauge DevOps • Rapid Delivery with Increased Efficiency • Increased Feature releases with reduced TTM • Quicker feedback (system/user) to teams & stake holders • Greater % of defects detected in testing (Unit & SIT Cycles) • Ticket / Incidents volume reduction in PreProd & Prod • High Availability • Elastic & Scalable Infrastructure
  • 41. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. CI CD Workflow MindMap - The devil in the detail
  • 42. ©2018, AmazonWebServices, Inc. or its Affiliates. All rights reserved. Thank you! You may refer https://installjournal.blogspot.com for AWS CI CD LAB Series