"From zero to Blue/Green deployments on Amazon ECS", Massimo Re Ferré, AWS Dev Day Kyiv 2019 "

•

0 likes•116 views

AWS Dev Day Kyiv 2019 Track: Modern Application Development Session: "From zero to Blue/Green deployments on Amazon ECS" Speaker: Massimo Re Ferré, AWS Technical Evangelist Level: 300 AWS Dev Day is a free, full-day technical event where new developers will learn about some of the hottest topics in cloud computing, and experienced developers can dive deep on newer AWS services. Provectus has organized AWS Dev Day Kyiv in close collaboration with Amazon Web Services: 800+ participants, 18 sessions, 3 tracks, a really AWSome Day!  Now, together with Zeo Alliance, we're building and nurturing AWS User Group Ukraine — join us on Facebook to stay updated about cloud technologies and AWS services: https://www.facebook.com/groups/AWSUserGroupUkraine Video: https://www.youtube.com/watch?v=5WR5p33eTeo

Data & Analytics

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
K Y I V
11.05.2019
CI/CD for Modern Applications
Massimo Re Ferrè
Developer Advocate
Amazon Web Services

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Who Am I ?
Amazon Web Services (Developer Advocate)
VMware (Solutions Architect and Technical Product Manager)
IBM (Professional Services and Solutions Architect)
Developer (many kilos ago)
Email: mreferre@amazon.com
Twitter: @mreferre
Github: github.com/mreferre

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How software value gets created (in the old model)
Monolithic
application
“Time to user”: months / years
Very heavy
manual
integrations

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How software value gets created (in the new model)
“Time to user”: hours / days
Small
independent
components…
End-to-end
(hands off)
automation
…. with
different
release cycles

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What are the compute options to run my code?
Instances
Containers
Lambda
Containers control plane
Containers data plane

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS compute abstractions layers
AWS
Lambda
Amazon
EC2
Metal
AWS
Fargate
Amazon
EKS
physicalseverVMcontainerfunction
Levelofabstraction
Provider space
(managed by AWS)
Consumer space
(managed by the customer)
Amazon
ECS
For this session, we are going to focus on this (as an example)

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ECS w/ EC2 data plane
AWS Account Cust Account
VPC
Amazon EC2
TaskService
ENI
aws ecs run-task … --launch-type EC2 …
You have to manage this
capacity (e.g. with ASGs)
Amazon ECS

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Scaling metrics
https://garbe.io/blog/2017/04/12/a-better-solution-to-ecs-autoscaling/
https://medium.com/thron-tech/aws-ecs-host-auto-scaling-with-custom-cloudwatch-metrics-and-aws-lambda-b9a9f55faf1d

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Need for speed – (all lines are made up)

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Need for speed – real example (all lines are for real)

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ECS w/ FARGATE data plane
AWS Account
AWS Fargate
Cust Account
VPC
TaskService
ENI
aws ecs run-task … --launch-type FARGATE …
You don’t have to manage
capacity
Amazon ECS

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Blue/Green and the pressure on infrastructure
Task
Auto Scaling group
Instance
Task Task Task Task Task Task Task Task Task Task Task
Instance Instance Instance
Task Task Task Task Task Task Task Task Task Task Task Task
AWS Fargate
On ECS/EC2 On ECS/Fargate

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Blue/Green and the pressure on infrastructure
Auto Scaling group
Instance Instance Instance Instance
AWS Fargate
Instance Instance Instance Instance
Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task
On ECS/EC2 On ECS/Fargate

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Blue/Green and the pressure on infrastructure
AWS Fargate
Auto Scaling group
Instance Instance Instance Instance
Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task Task
On ECS/EC2 On ECS/Fargate

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Blue/Green deployments
Service
Target-Group-Green Task Task Task
Service
Amazon ECR
Amazon ECS
Amazon ALB
Image1
THIS IS VER1

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Blue/Green deployments
Service
Target-Group-Green
Target-Group-Blue
Task Task Task
Service
Amazon ECR
Amazon ECS
Amazon ALB
Image1
THIS IS VER1
THIS IS VER1

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Blue/Green deployments
Service
Target-Group-Green
Target-Group-Blue Service
AWS CodeCommit AWS CodeBuild
AWS CodePipeline
AWS CodeDeploy Amazon ECR
Amazon ECS
Amazon ALB
Image1
Image2
Task Task TaskTHIS IS A NEW VER
THIS IS A NEW VER
<html>
<body>
<h1>THIS IS A NEW VER</h1>
</body>
</html>

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Demo?

More from Provectus

What's a machine learning workflow? What open source tools can you use to automate ML workflow? Reproducible ML pipelines in research and production with monitoring insights from live inference clusters could enable and accelerate the delivery of AI solutions for enterprises. There is a growing ecosystem of tools that augment researchers and machine learning engineers in their day to day operations. Still, there are big gaps in the machine learning workflow when it comes to training dataset versioning, training performance and metadata tracking, integration testing, inferencing quality monitoring, bias detection, concept drift detection and other aspects that prevent the adoption of AI in organizations of all sizes.

ODSC webinar "Kubeflow, MLFlow and Beyond — augmenting ML delivery" Stepan Pu...

Provectus

AWS Dev Day Kyiv 2019 Track: Analytics & Machine Learning Session: "Building a Modern Data platform in the Cloud" Speaker: Alex Casalboni, AWS Technical Evangelist Level: 300 AWS Dev Day is a free, full-day technical event where new developers will learn about some of the hottest topics in cloud computing, and experienced developers can dive deep on newer AWS services. Provectus has organized AWS Dev Day Kyiv in close collaboration with Amazon Web Services: 800+ participants, 18 sessions, 3 tracks, a really AWSome Day!  Now, together with Zeo Alliance, we're building and nurturing AWS User Group Ukraine — join us on Facebook to stay updated about cloud technologies and AWS services: https://www.facebook.com/groups/AWSUserGroupUkraine Video: https://youtu.be/HIDnAG9AxZo

"Building a Modern Data platform in the Cloud", Alex Casalboni, AWS Dev Day K...

Provectus

AWS Dev Day Kyiv 2019 Track: Modern Application Development Session: "How to build a global serverless service" Speaker: Alex Casalboni, AWS Technical Evangelist Level: 400 AWS Dev Day is a free, full-day technical event where new developers will learn about some of the hottest topics in cloud computing, and experienced developers can dive deep on newer AWS services. Provectus has organized AWS Dev Day Kyiv in close collaboration with Amazon Web Services: 800+ participants, 18 sessions, 3 tracks, a really AWSome Day!  Now, together with Zeo Alliance, we're building and nurturing AWS User Group Ukraine — join us on Facebook to stay updated about cloud technologies and AWS services: https://www.facebook.com/groups/AWSUserGroupUkraine Video: https://youtu.be/Q19B-NTkMfk

"How to build a global serverless service", Alex Casalboni, AWS Dev Day Kyiv ...

Provectus

AWS Dev Day Kyiv 2019 Track: Backend & Architecture Session: "Automating AWS Infrastructure with PowerShell" Speaker: Martin Beeby, AWS Principle Evangelist Level: 300 AWS Dev Day is a free, full-day technical event where new developers will learn about some of the hottest topics in cloud computing, and experienced developers can dive deep on newer AWS services. Provectus has organized AWS Dev Day Kyiv in close collaboration with Amazon Web Services: 800+ participants, 18 sessions, 3 tracks, a really AWSome Day!  Now, together with Zeo Alliance, we're building and nurturing AWS User Group Ukraine — join us on Facebook to stay updated about cloud technologies and AWS services: https://www.facebook.com/groups/AWSUserGroupUkraine Video: https://youtu.be/rgIjjK2J4dQ

"Automating AWS Infrastructure with PowerShell", Martin Beeby, AWS Dev Day Ky...

Provectus

AWS Dev Day Kyiv 2019 Track: Analytics & Machine Learning Session: "Analyzing your web and application logs" Speaker: Javier Ramirez, AWS Technical Evangelist Level: 300 AWS Dev Day is a free, full-day technical event where new developers will learn about some of the hottest topics in cloud computing, and experienced developers can dive deep on newer AWS services. Provectus has organized AWS Dev Day Kyiv in close collaboration with Amazon Web Services: 800+ participants, 18 sessions, 3 tracks, a really AWSome Day!  Now, together with Zeo Alliance, we're building and nurturing AWS User Group Ukraine — join us on Facebook to stay updated about cloud technologies and AWS services: https://www.facebook.com/groups/AWSUserGroupUkraine Video: https://youtu.be/IpEhEs1sXeg

"Analyzing your web and application logs", Javier Ramirez, AWS Dev Day Kyiv 2...

Provectus

AWS Dev Day Kyiv 2019 Track: Backend & Architecture Session: "Resiliency and Availability Design Patterns for the Cloud" Speaker: Sebastien Stormacq, AWS Technical Evangelist Level: 400 AWS Dev Day is a free, full-day technical event where new developers will learn about some of the hottest topics in cloud computing, and experienced developers can dive deep on newer AWS services. Provectus has organized AWS Dev Day Kyiv in close collaboration with Amazon Web Services: 800+ participants, 18 sessions, 3 tracks, a really AWSome Day!  Now, together with Zeo Alliance, we're building and nurturing AWS User Group Ukraine — join us on Facebook to stay updated about cloud technologies and AWS services: https://www.facebook.com/groups/AWSUserGroupUkraine Video: https://youtu.be/O8gonQCJawU

"Resiliency and Availability Design Patterns for the Cloud", Sebastien Storma...

Provectus

AWS Dev Day Kyiv 2019 Track: Backend & Architecture Session: ""Architecting SaaS solutions on AWS"" Speaker: Oleksandr Mykhalchuk, Director of DevOps & Cloud Services at Softserve Level: 300 Video: https://youtu.be/3lKoe-ts8Qs AWS Dev Day is a free, full-day technical event where new developers will learn about some of the hottest topics in cloud computing, and experienced developers can dive deep on newer AWS services. Provectus has organized AWS Dev Day Kyiv in close collaboration with Amazon Web Services: 800+ participants, 18 sessions, 3 tracks, a really AWSome Day!  Now, together with Zeo Alliance, we're building and nurturing AWS User Group Ukraine — join us on Facebook to stay updated about cloud technologies and AWS services: https://www.facebook.com/groups/AWSUserGroupUkraine

"Architecting SaaS solutions on AWS", Oleksandr Mykhalchuk, AWS Dev Day Kyiv ...

Provectus

AWS Dev Day Kyiv 2019 Track: Modern Application Development Session: "Developing with .NET Core on AWS" Speaker: Martin Beeby, AWS Principle Evangelist Level: 300 AWS Dev Day is a free, full-day technical event where new developers will learn about some of the hottest topics in cloud computing, and experienced developers can dive deep on newer AWS services. Provectus has organized AWS Dev Day Kyiv in close collaboration with Amazon Web Services: 800+ participants, 18 sessions, 3 tracks, a really AWSome Day!  Now, together with Zeo Alliance, we're building and nurturing AWS User Group Ukraine — join us on Facebook to stay updated about cloud technologies and AWS services: https://www.facebook.com/groups/AWSUserGroupUkraine Video: https://youtu.be/OzM8L7H1LmA

"Developing with .NET Core on AWS", Martin Beeby, AWS Dev Day Kyiv 2019

Provectus

AWS Dev Day Kyiv 2019 Track: Backend & Architecture Session: "How to build real-time backends" Speaker: Martin Beeby, AWS Principle Evangelist Level: 300 AWS Dev Day is a free, full-day technical event where new developers will learn about some of the hottest topics in cloud computing, and experienced developers can dive deep on newer AWS services. Provectus has organized AWS Dev Day Kyiv in close collaboration with Amazon Web Services: 800+ participants, 18 sessions, 3 tracks, a really AWSome Day!  Now, together with Zeo Alliance, we're building and nurturing AWS User Group Ukraine — join us on Facebook to stay updated about cloud technologies and AWS services: https://www.facebook.com/groups/AWSUserGroupUkraine Video: https://youtu.be/bsZYA6V3bDA

"How to build real-time backends", Martin Beeby, AWS Dev Day Kyiv 2019

Provectus

AWS Dev Day Kyiv 2019 Track: Modern Application Development Session: "Integrate your front end apps with serverless backend in the cloud" Speaker: Sebastien Stormacq, AWS Technical Evangelist Level: 200 AWS Dev Day is a free, full-day technical event where new developers will learn about some of the hottest topics in cloud computing, and experienced developers can dive deep on newer AWS services. Provectus has organized AWS Dev Day Kyiv in close collaboration with Amazon Web Services: 800+ participants, 18 sessions, 3 tracks, a really AWSome Day!  Now, together with Zeo Alliance, we're building and nurturing AWS User Group Ukraine — join us on Facebook to stay updated about cloud technologies and AWS services: https://www.facebook.com/groups/AWSUserGroupUkraine Video: https://www.youtube.com/watch?v=6z43H11qoU8&t=1s

"Integrate your front end apps with serverless backend in the cloud", Sebasti...

Provectus

AWS Dev Day Kyiv 2019 Track: Analytics & Machine Learning Session: ""Scaling ML from 0 to millions of users"" Speaker: Julien Simon, Global AI & Machine Learning Evangelist at AWS Level: 300 AWS Dev Day is a free, full-day technical event where new developers will learn about some of the hottest topics in cloud computing, and experienced developers can dive deep on newer AWS services. Provectus has organized AWS Dev Day Kyiv in close collaboration with Amazon Web Services: 800+ participants, 18 sessions, 3 tracks, a really AWSome Day!  Now, together with Zeo Alliance, we're building and nurturing AWS User Group Ukraine — join us on Facebook to stay updated about cloud technologies and AWS services: https://www.facebook.com/groups/AWSUserGroupUkraine Video: https://www.youtube.com/watch?v=N73u1mx9DqY

"Scaling ML from 0 to millions of users", Julien Simon, AWS Dev Day Kyiv 2019

Provectus

AWS Dev Day Kyiv 2019 Track: Backend & Architecture Session: ""How to implement authorization in your backend with AWS IAM"" Speaker: Stas Ivaschenko, AWS solutions architect at Provectus Level: 400 Video: https://www.youtube.com/watch?v=4Jje_WJ4V7Q AWS Dev Day is a free, full-day technical event where new developers will learn about some of the hottest topics in cloud computing, and experienced developers can dive deep on newer AWS services. Provectus has organized AWS Dev Day Kyiv in close collaboration with Amazon Web Services: 800+ participants, 18 sessions, 3 tracks, a really AWSome Day!  Now, together with Zeo Alliance, we're building and nurturing AWS User Group Ukraine — join us on Facebook to stay updated about cloud technologies and AWS services: https://www.facebook.com/groups/AWSUserGroupUkraine "

How to implement authorization in your backend with AWS IAM

Provectus

Yurii Gavrilin | ML Interpretability: From A to Z | Kazan ODSC Meetup

Provectus

Andrei Grigoriev | Version Control in Data Science | Kazan ODSC Meetup

Provectus

Modern word embeddings | Andrei Kulagin | Kazan ODSC Meetup

Provectus

Eva Sokolyanskaya, QA Stand Up: Episode 4

Provectus

Mikhail Dovgiy, QA Stand Up: Episode 4

Provectus

“Process optimization system”, Dmitry Blazhvskiy.

Provectus

«Training Deep Learning Models on Multi-GPUs Systems», Dmitry Spodarets.

Provectus

«Design and purpose of convolutional layers in neural networks», Andrii Latysh.

Provectus

More from Provectus (20)