SlideShare a Scribd company logo
1 of 45
Download to read offline
Modernizing Legacy Operations
with Containerized Solutions
26.06.2023
online
| Streamlined Data Flow
© kreuzwerker 2023
© kreuzwerker 2023
Agenda
2
ECS and Fargate Overview, 15”
Daisy Daivasagaya, AWS
Quick Demonstration, 15”
JooYong Kim, AWS
Case Study of an Event-Driven
Serverless Architecture, 10”
Kateryna Oliferchuck, kreuzwerker
Sharib Jafari, kreuzwerker
kreuzwerker
We unleash digital technology. Made to measure.
4
Founded 2012
AWS Partner since 2013
100% AWS
Berlin, Frankfurt,
Munich, Warsaw, Zurich
Migration & Modernization
Data & Analytics
Cloud Native Development
Managed Security Services
Cloud Financial Management
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
AWS Fargate
Roadmap and Updates
Daisy Daivasagaya
Senior GTM Container Specialist
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Agenda
- ECS/Fargate Overview
- Summary of releases over the past 12 months
- Looking forward at 2023’s roadmap for AWS Fargate
Features, capabilities, and timelines are shared in good faith and reflect the
roadmap today, but are subject to change
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
ECS and Fargate overview
3
Fargate – serverless compute
- No EC2 AMIs to patch, upgrade, secure, and manage
- Secure-by-design with each task running in separate kernel
- No capacity management overhead!
ECS - fully managed container orchestrator
- No control plane to upgrade, patch, and secure
- Manages deployments, autoscaling, self-healing…
ECS
Fargate
…
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
ECS core constructs
4
Task
Task
Service
Cluster
Task
…
Cluster is logical grouping of
services and tasks
Service is a group of
identical tasks
Task is one or more containers
performing specific
application function
Task Definition describes the
task needs (cpu, memory,
images, networking type, IAM)
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
• Serverless container engine
• No container host (OS) to upgrade, patch, secure
• Isolation and security by design
• Simpler and faster auto scaling
• Fully managed service
• No middleware to install and upgrade
• Free!
ECS with Fargate serverless container service overview
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Notable Fargate releases in
the past 12 months
6
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Notable Fargate releases in the past 12 months
AWS Compute Optimizer Support
Receive prescriptive recommendations on “right sizing” Task configurations
4x increase in Fargate’s largest configuration sizes
8 and 16 vCPU combinations with up to 120GB memory
12x task launch rate improvements in 2 years
Scale out the number of tasks to meet demand more quickly
Service quota transition
Migration from task/pod counts to number of vCPU
Disk utilization metrics
Monitor the disk utilization of tasks’ ephemeral storage
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Planned enhancements
coming to Fargate
8
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Fargate investment themes
New capabilities
Unblocking customers and expanding Fargate’s flexibility through
more intelligent image handling and use of Linux capabilities
Security and efficiency
Behind-the-scenes improvements to enhance reliability,
accelerating CVE remediations, and improving security monitoring
Operational excellence
Expedite availability of Fargate in new regions through automation
improvements and under-the-hood service optimizations
9
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Fargate roadmap highlights: Performance
Faster Task start times
More efficient image pulls through “lazy loading” of images
Consistent compute and networking
Greater performance consistency across Fargate
Graviton price reduction
Modifications coming for select regions including Mumbai
10
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Fargate roadmap highlights: Security
Advanced security and network controls
Enable additional Linux capabilities for runtime security monitoring,
utilize eBPF, and customize the network stack.
FIPS 140-2 compliance
Ensuring Fargate meets federal standards for cryptography
Secure ephemeral storage with Customer Managed Keys (CMK)
Expanding on today’s default of service managed keys for enhanced
control and security.
11
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Thank you!
12
AMAZON ECS BLUEPRINT
© 2023, Amazon Web Services, Inc. or its affiliates.
© 2023, Amazon Web Services, Inc. or its affiliates.
Jooyoung Kim
Specialist Solutions Architect, Container
joozero@amazon.com
ECS Blueprint
AMAZON ECS BLUEPRINT
© 2023, Amazon Web Services, Inc. or its affiliates.
© 2023, Amazon Web Services, Inc. or its affiliates.
Motivation for ECS
Blueprint
AMAZON ECS BLUEPRINT
© 2023, Amazon Web Services, Inc. or its affiliates.
Customers new to containers face a steep learning curve
Deploy
Build Run
CI/CD and infra-as-code
automation
Container service &
container infrastructure
Observability Security Cost
AMAZON ECS BLUEPRINT
© 2023, Amazon Web Services, Inc. or its affiliates.
• What is ECS? What is Fargate?
• What is ECS cluster service, task, task definition, container
definition?
• What all IAM roles do I need?
• What is different between task execution role and task role?
• How to build containers? How to setup CI and CD?
• How to configure rolling deployment?
• How to monitor ECS Fargate workload?
• How to configure logs?
• How to handle sensitive secrets?
• How to use ALB? How to use service discovery?
• How to setup VPC endpoints? What all VPC endpoints to set?
• How to use Fargate Spot?
• How to use Graviton from start?
• How to setup multi-account CI/CD?
• How and what to use for run time security monitoring?
• …
ECS Fargate is easy but …
4
Automate all this using with
IaC(Infrastructure as Code) Tool
AMAZON ECS BLUEPRINT
© 2023, Amazon Web Services, Inc. or its affiliates.
Can we accelerate ECS Fargate adoption for beginners?
5
Technical deep dive presentations
Workshops
Immersion days
Customer using ECS Fargate
In their accounts
With their applications
With end-to-end automation
Can we start here?
AMAZON ECS BLUEPRINT
© 2023, Amazon Web Services, Inc. or its affiliates.
© 2023, Amazon Web Services, Inc. or its affiliates.
ECS Blueprint Overview
AMAZON ECS BLUEPRINT
© 2023, Amazon Web Services, Inc. or its affiliates.
© 2023, Amazon Web Services, Inc. or its affiliates.
Sample Architecture
AMAZON ECS BLUEPRINT
© 2023, Amazon Web Services, Inc. or its affiliates.
Overview of Core Infra Template
18
AMAZON ECS BLUEPRINT
© 2023, Amazon Web Services, Inc. or its affiliates.
Overview of Backend Service Template
19
AMAZON ECS BLUEPRINT
© 2023, Amazon Web Services, Inc. or its affiliates.
Overview of Frontend Service Template
20
AMAZON ECS BLUEPRINT
© 2023, Amazon Web Services, Inc. or its affiliates.
Overview of CICD Service Template
21
AMAZON ECS BLUEPRINT
© 2023, Amazon Web Services, Inc. or its affiliates.
© 2023, Amazon Web Services, Inc. or its affiliates.
Demo
27
AMAZON ECS BLUEPRINT
© 2023, Amazon Web Services, Inc. or its affiliates.
Get started today!
• Official Github repository
• Terraform and CDK blueprints are included
• https://github.com/aws-ia/ecs-blueprints
• ECS Blueprints workshop
• https://catalog.workshops.aws/ecs-solution-blueprints/en-US
• AWS CDK Workshop for Python
• https://cdkworkshop.com/30-python.html
28
AMAZON ECS BLUEPRINT
© 2023, Amazon Web Services, Inc. or its affiliates.
© 2023, Amazon Web Services, Inc. or its affiliates.
Thank you!
| Streamlined Data Flow
© kreuzwerker 2023
https://kreuzwerker.de/
5
6
Case Study of an Event-Driven Serverless Architecture
Streamlined Data Flow using EventBridge and Step Functions
| Streamlined Data Flow
© kreuzwerker 2023
Client
7
- Operating in the field of clinical diagnostics and research
- Prominent company utilizing data-driven approaches
- Utilizes a Biodatabank containing over half a million
individuals' data
- Primarily focused on laboratory operations and diagnostics
- Limited expertise in software development and
implementation
Client
| Streamlined Data Flow
© kreuzwerker 2023
The Client: A rare disease company
8
Client
The customers mission is to provide
data-driven, life-changing answers to
patients, physicians, and pharma
companies for rare and
neurodegenerative diseases.
Leading data-driven rare disease company.
| Streamlined Data Flow
© kreuzwerker 2023 9
Design and implement a cloud-native, serverless solution,
streamlining the data synchronization process between
CRM, ERP and LIMS systems
Challenge
Challenge
| Streamlined Data Flow
© kreuzwerker 2023
Challenge
10
- Multiple systems, including a webshop, products database,
LIMS, ERP, and CRM, are currently in use
- Each system is managed by a separate external vendor
- These systems have overlapping data, such as customer and
product information
- No single system has exclusive ownership of the data
- Data is duplicated across the systems with custom
transformation
- Real-time data synchronization is lacking, resulting in
inconsistencies
Challenge
| Streamlined Data Flow
© kreuzwerker 2023
Use Case: Product Sync
11
- Extract relevant data from Master Data Management (MDM)
via REST
- Transform data into a single product entity with nested
attributes by aggregating multiple entities
- Load product data into different external systems, such as
CRM and ERP via REST
Use Case: Product Sync
| Streamlined Data Flow
© kreuzwerker 2023
North Star
12
- Low maintenance
- Simple to use and understand
- Includes error handling and retry mechanisms
- Utilizes REST API to integrate with external systems
- Transforms and syncs a large volume of products in parallel
for multiple targets
- Adoptable to a real-time synchronization solution when the
external systems incorporate support for it.
North Star
| Streamlined Data Flow
© kreuzwerker 2023
Architecture
13
Architecture
| Streamlined Data Flow
© kreuzwerker 2023 14
− Parallel processing of bulk data
− Cost based on actual usage
− Automated error handling and
retries
− Convenient setup of monitoring
and alarms
− Low maintenance due to modular,
automated, extensible, and
managed design
− Requires all target systems to
be idempotent
− It’s challenging to visualize
the entire workflow without
adequate documentation and
diagrams
Benefits Tradeoffs
Tradeoffs
15
Questions?
16
Services & Solutions
Serverless Readiness Assessment
Scope: Assessment of Scope, Architecture, Tech
Stack, DevOps and AWS usage.
Deliverable: Result Presentation and optional
Enablement, Trainings, Consulting
Time & Effort: 5 Person Days
Application Modernisation & Cloud Native Software Development - Proof-of-Concept
Scope Identification of (Modernisation) Use Cases and Implementation / Building of a PoC
Deliverable Proof-of-Concept
Time & Effort: 10-25 Person Days
Funding Options: PoC Funding
Well Architected Framework Review
Scope Analyse Data Workload/Architecture along the
Well-Architected Pillars
Deliverable Report of findings / recommendations
Time & Effort: 2 Person Days
Funding Options: 5k Credits
1.250 €/CHF
2.750 €/CHF
upon request
| Streamlined Data Flow
© kreuzwerker 2023
https://kreuzwerker.de/
18
kreuzwerker GmbH
Ritterstr. 12
10969 Berlin
www.kreuzwerker.de
Fon +49 30 609 838 80
Fax +49 30 609 838 899
Thank you!
aws@kreuzwerker.de

More Related Content

Similar to kreuzwerker AWS Modernizing Legacy Operations with Containerized Solutions 2023-06-26.pdf

Opinionated re:Invent recap with AWS Heroes & Builders
Opinionated re:Invent recap with AWS Heroes & BuildersOpinionated re:Invent recap with AWS Heroes & Builders
Opinionated re:Invent recap with AWS Heroes & Builders
Daniel Zivkovic
 
Securing Cloud Resources Deployed with Control Planes on Kubernetes using Gov...
Securing Cloud Resources Deployed with Control Planes on Kubernetes using Gov...Securing Cloud Resources Deployed with Control Planes on Kubernetes using Gov...
Securing Cloud Resources Deployed with Control Planes on Kubernetes using Gov...
All Things Open
 
AWS Summit 2014 - Perth - Keynote
AWS Summit 2014 - Perth - KeynoteAWS Summit 2014 - Perth - Keynote
AWS Summit 2014 - Perth - Keynote
Amazon Web Services
 

Similar to kreuzwerker AWS Modernizing Legacy Operations with Containerized Solutions 2023-06-26.pdf (20)

利用 Fargate - 無伺服器的容器環境建置高可用的系統
利用 Fargate - 無伺服器的容器環境建置高可用的系統利用 Fargate - 無伺服器的容器環境建置高可用的系統
利用 Fargate - 無伺服器的容器環境建置高可用的系統
 
Architect Your Legacy Microsoft Apps into Modern Cloud Workloads
 Architect Your Legacy Microsoft Apps into Modern Cloud Workloads Architect Your Legacy Microsoft Apps into Modern Cloud Workloads
Architect Your Legacy Microsoft Apps into Modern Cloud Workloads
 
Confluent_AWS_ImmersionDay_Q42023.pdf
Confluent_AWS_ImmersionDay_Q42023.pdfConfluent_AWS_ImmersionDay_Q42023.pdf
Confluent_AWS_ImmersionDay_Q42023.pdf
 
Build real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with ConfluentBuild real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with Confluent
 
5 Best Practices for Building an AWS Global Transit Network
 5 Best Practices for Building an AWS Global Transit Network 5 Best Practices for Building an AWS Global Transit Network
5 Best Practices for Building an AWS Global Transit Network
 
Scaling production grade EKS Multi-Cluster environments using GitOps
Scaling production grade EKS Multi-Cluster environments using GitOpsScaling production grade EKS Multi-Cluster environments using GitOps
Scaling production grade EKS Multi-Cluster environments using GitOps
 
AWS Outposts Update
AWS Outposts UpdateAWS Outposts Update
AWS Outposts Update
 
APMWQ3D2S3 Modernizing legacy Java workloads.pdf
APMWQ3D2S3 Modernizing legacy Java workloads.pdfAPMWQ3D2S3 Modernizing legacy Java workloads.pdf
APMWQ3D2S3 Modernizing legacy Java workloads.pdf
 
Opinionated re:Invent recap with AWS Heroes & Builders
Opinionated re:Invent recap with AWS Heroes & BuildersOpinionated re:Invent recap with AWS Heroes & Builders
Opinionated re:Invent recap with AWS Heroes & Builders
 
Amazon EKS multi-cluster gitops-bridge
Amazon EKS multi-cluster gitops-bridgeAmazon EKS multi-cluster gitops-bridge
Amazon EKS multi-cluster gitops-bridge
 
Introducing AWS Fargate
Introducing AWS FargateIntroducing AWS Fargate
Introducing AWS Fargate
 
Building Real-Time Serverless Data Applications With Joseph Morais and Adam W...
Building Real-Time Serverless Data Applications With Joseph Morais and Adam W...Building Real-Time Serverless Data Applications With Joseph Morais and Adam W...
Building Real-Time Serverless Data Applications With Joseph Morais and Adam W...
 
Hybrid Cloud Customer Use Cases on AWS
Hybrid Cloud Customer Use Cases on AWSHybrid Cloud Customer Use Cases on AWS
Hybrid Cloud Customer Use Cases on AWS
 
Control Planes on Kubernetes and Policy Validation
Control Planes on Kubernetes and Policy ValidationControl Planes on Kubernetes and Policy Validation
Control Planes on Kubernetes and Policy Validation
 
Securing Cloud Resources Deployed with Control Planes on Kubernetes using Gov...
Securing Cloud Resources Deployed with Control Planes on Kubernetes using Gov...Securing Cloud Resources Deployed with Control Planes on Kubernetes using Gov...
Securing Cloud Resources Deployed with Control Planes on Kubernetes using Gov...
 
How to Bring Microsoft Apps to AWS - AWS Online Tech Talks
How to Bring Microsoft Apps to AWS - AWS Online Tech TalksHow to Bring Microsoft Apps to AWS - AWS Online Tech Talks
How to Bring Microsoft Apps to AWS - AWS Online Tech Talks
 
AWS Lambda Powertools walkthrough.pdf
AWS Lambda Powertools walkthrough.pdfAWS Lambda Powertools walkthrough.pdf
AWS Lambda Powertools walkthrough.pdf
 
Operational Excellence with Containerized Workloads Using AWS Fargate (CON320...
Operational Excellence with Containerized Workloads Using AWS Fargate (CON320...Operational Excellence with Containerized Workloads Using AWS Fargate (CON320...
Operational Excellence with Containerized Workloads Using AWS Fargate (CON320...
 
AWS Summit 2014 - Perth - Keynote
AWS Summit 2014 - Perth - KeynoteAWS Summit 2014 - Perth - Keynote
AWS Summit 2014 - Perth - Keynote
 
From Zero to Production with Amazon EKS Blueprints for Terraform
 	From Zero to Production with Amazon EKS Blueprints for Terraform 	From Zero to Production with Amazon EKS Blueprints for Terraform
From Zero to Production with Amazon EKS Blueprints for Terraform
 

More from kreuzwerker GmbH

2024-02-29_Webinar_DORA_(Digital Operational Resilience Act) praxistauglich e...
2024-02-29_Webinar_DORA_(Digital Operational Resilience Act) praxistauglich e...2024-02-29_Webinar_DORA_(Digital Operational Resilience Act) praxistauglich e...
2024-02-29_Webinar_DORA_(Digital Operational Resilience Act) praxistauglich e...
kreuzwerker GmbH
 
2022-09-13 kreuzwerker Atlassian - Navigating GDPR and BaFin in the Cloud.pdf
2022-09-13 kreuzwerker Atlassian - Navigating GDPR and BaFin in the Cloud.pdf2022-09-13 kreuzwerker Atlassian - Navigating GDPR and BaFin in the Cloud.pdf
2022-09-13 kreuzwerker Atlassian - Navigating GDPR and BaFin in the Cloud.pdf
kreuzwerker GmbH
 
Infrastructure under the magnifying glass
Infrastructure under the magnifying glassInfrastructure under the magnifying glass
Infrastructure under the magnifying glass
kreuzwerker GmbH
 

More from kreuzwerker GmbH (17)

2024-02-29_Webinar_DORA_(Digital Operational Resilience Act) praxistauglich e...
2024-02-29_Webinar_DORA_(Digital Operational Resilience Act) praxistauglich e...2024-02-29_Webinar_DORA_(Digital Operational Resilience Act) praxistauglich e...
2024-02-29_Webinar_DORA_(Digital Operational Resilience Act) praxistauglich e...
 
AWS & kreuzwerker Startup Day Warsaw - 09.11.2023
AWS & kreuzwerker Startup Day Warsaw - 09.11.2023AWS & kreuzwerker Startup Day Warsaw - 09.11.2023
AWS & kreuzwerker Startup Day Warsaw - 09.11.2023
 
Level Up Your Amazon OpenSearch Cluster in a Week
Level Up Your Amazon OpenSearch Cluster in a WeekLevel Up Your Amazon OpenSearch Cluster in a Week
Level Up Your Amazon OpenSearch Cluster in a Week
 
App Modernization with Kotlin.pdf
App Modernization with Kotlin.pdfApp Modernization with Kotlin.pdf
App Modernization with Kotlin.pdf
 
Making Serverless a Game Changer for you
Making Serverless a Game Changer for youMaking Serverless a Game Changer for you
Making Serverless a Game Changer for you
 
The Testing Pyramid In a Serverless World.pdf
The Testing Pyramid In a Serverless World.pdfThe Testing Pyramid In a Serverless World.pdf
The Testing Pyramid In a Serverless World.pdf
 
2022-09-13 kreuzwerker Atlassian - Navigating GDPR and BaFin in the Cloud.pdf
2022-09-13 kreuzwerker Atlassian - Navigating GDPR and BaFin in the Cloud.pdf2022-09-13 kreuzwerker Atlassian - Navigating GDPR and BaFin in the Cloud.pdf
2022-09-13 kreuzwerker Atlassian - Navigating GDPR and BaFin in the Cloud.pdf
 
kreuzwerker FactSheet: Jira Work Management (English)
kreuzwerker FactSheet: Jira Work Management (English)kreuzwerker FactSheet: Jira Work Management (English)
kreuzwerker FactSheet: Jira Work Management (English)
 
AWS Immersion Day Zurich, kreuzwerker & AWS, 30. Mai 2022
AWS Immersion Day Zurich, kreuzwerker & AWS, 30. Mai 2022AWS Immersion Day Zurich, kreuzwerker & AWS, 30. Mai 2022
AWS Immersion Day Zurich, kreuzwerker & AWS, 30. Mai 2022
 
Business Team Collaboration- Jira Work Management Webinar by kreuzwerker.pdf
Business Team Collaboration- Jira Work Management Webinar by kreuzwerker.pdfBusiness Team Collaboration- Jira Work Management Webinar by kreuzwerker.pdf
Business Team Collaboration- Jira Work Management Webinar by kreuzwerker.pdf
 
kreuzwerker about prowler - make best practises best practises
kreuzwerker about prowler - make best practises best practiseskreuzwerker about prowler - make best practises best practises
kreuzwerker about prowler - make best practises best practises
 
Best friends forever! - Atlassian Cloud and the GDPR
Best friends forever! - Atlassian Cloud and the GDPRBest friends forever! - Atlassian Cloud and the GDPR
Best friends forever! - Atlassian Cloud and the GDPR
 
Infrastructure under the magnifying glass
Infrastructure under the magnifying glassInfrastructure under the magnifying glass
Infrastructure under the magnifying glass
 
Docker offshore
Docker offshoreDocker offshore
Docker offshore
 
Hands On Docker Workshop
Hands On Docker WorkshopHands On Docker Workshop
Hands On Docker Workshop
 
Docker Workshop
Docker WorkshopDocker Workshop
Docker Workshop
 
Docker offshore - packaging applications for hard to reach datacenter
Docker offshore - packaging applications for hard to reach datacenterDocker offshore - packaging applications for hard to reach datacenter
Docker offshore - packaging applications for hard to reach datacenter
 

Recently uploaded

JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)
Max Lee
 

Recently uploaded (20)

Odoo vs Shopify: Why Odoo is Best for Ecommerce Website Builder in 2024
Odoo vs Shopify: Why Odoo is Best for Ecommerce Website Builder in 2024Odoo vs Shopify: Why Odoo is Best for Ecommerce Website Builder in 2024
Odoo vs Shopify: Why Odoo is Best for Ecommerce Website Builder in 2024
 
How to install and activate eGrabber JobGrabber
How to install and activate eGrabber JobGrabberHow to install and activate eGrabber JobGrabber
How to install and activate eGrabber JobGrabber
 
Salesforce Introduced Zero Copy Partner Network to Simplify the Process of In...
Salesforce Introduced Zero Copy Partner Network to Simplify the Process of In...Salesforce Introduced Zero Copy Partner Network to Simplify the Process of In...
Salesforce Introduced Zero Copy Partner Network to Simplify the Process of In...
 
Modern binary build systems - PyCon 2024
Modern binary build systems - PyCon 2024Modern binary build systems - PyCon 2024
Modern binary build systems - PyCon 2024
 
Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
 
SQL Injection Introduction and Prevention
SQL Injection Introduction and PreventionSQL Injection Introduction and Prevention
SQL Injection Introduction and Prevention
 
Secure Software Ecosystem Teqnation 2024
Secure Software Ecosystem Teqnation 2024Secure Software Ecosystem Teqnation 2024
Secure Software Ecosystem Teqnation 2024
 
JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)
 
What is an API Development- Definition, Types, Specifications, Documentation.pdf
What is an API Development- Definition, Types, Specifications, Documentation.pdfWhat is an API Development- Definition, Types, Specifications, Documentation.pdf
What is an API Development- Definition, Types, Specifications, Documentation.pdf
 
how-to-download-files-safely-from-the-internet.pdf
how-to-download-files-safely-from-the-internet.pdfhow-to-download-files-safely-from-the-internet.pdf
how-to-download-files-safely-from-the-internet.pdf
 
Optimizing Operations by Aligning Resources with Strategic Objectives Using O...
Optimizing Operations by Aligning Resources with Strategic Objectives Using O...Optimizing Operations by Aligning Resources with Strategic Objectives Using O...
Optimizing Operations by Aligning Resources with Strategic Objectives Using O...
 
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
 
Community is Just as Important as Code by Andrea Goulet
Community is Just as Important as Code by Andrea GouletCommunity is Just as Important as Code by Andrea Goulet
Community is Just as Important as Code by Andrea Goulet
 
Food Delivery Business App Development Guide 2024
Food Delivery Business App Development Guide 2024Food Delivery Business App Development Guide 2024
Food Delivery Business App Development Guide 2024
 
Weeding your micro service landscape.pdf
Weeding your micro service landscape.pdfWeeding your micro service landscape.pdf
Weeding your micro service landscape.pdf
 
IT Software Development Resume, Vaibhav jha 2024
IT Software Development Resume, Vaibhav jha 2024IT Software Development Resume, Vaibhav jha 2024
IT Software Development Resume, Vaibhav jha 2024
 
Workforce Efficiency with Employee Time Tracking Software.pdf
Workforce Efficiency with Employee Time Tracking Software.pdfWorkforce Efficiency with Employee Time Tracking Software.pdf
Workforce Efficiency with Employee Time Tracking Software.pdf
 
The Impact of PLM Software on Fashion Production
The Impact of PLM Software on Fashion ProductionThe Impact of PLM Software on Fashion Production
The Impact of PLM Software on Fashion Production
 
What need to be mastered as AI-Powered Java Developers
What need to be mastered as AI-Powered Java DevelopersWhat need to be mastered as AI-Powered Java Developers
What need to be mastered as AI-Powered Java Developers
 
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdfThe Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
 

kreuzwerker AWS Modernizing Legacy Operations with Containerized Solutions 2023-06-26.pdf

  • 1. Modernizing Legacy Operations with Containerized Solutions 26.06.2023 online
  • 2. | Streamlined Data Flow © kreuzwerker 2023 © kreuzwerker 2023 Agenda 2 ECS and Fargate Overview, 15” Daisy Daivasagaya, AWS Quick Demonstration, 15” JooYong Kim, AWS Case Study of an Event-Driven Serverless Architecture, 10” Kateryna Oliferchuck, kreuzwerker Sharib Jafari, kreuzwerker
  • 3. kreuzwerker We unleash digital technology. Made to measure.
  • 4. 4 Founded 2012 AWS Partner since 2013 100% AWS Berlin, Frankfurt, Munich, Warsaw, Zurich Migration & Modernization Data & Analytics Cloud Native Development Managed Security Services Cloud Financial Management
  • 5. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. AWS Fargate Roadmap and Updates Daisy Daivasagaya Senior GTM Container Specialist
  • 6. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. Agenda - ECS/Fargate Overview - Summary of releases over the past 12 months - Looking forward at 2023’s roadmap for AWS Fargate Features, capabilities, and timelines are shared in good faith and reflect the roadmap today, but are subject to change
  • 7. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. ECS and Fargate overview 3 Fargate – serverless compute - No EC2 AMIs to patch, upgrade, secure, and manage - Secure-by-design with each task running in separate kernel - No capacity management overhead! ECS - fully managed container orchestrator - No control plane to upgrade, patch, and secure - Manages deployments, autoscaling, self-healing… ECS Fargate …
  • 8. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. ECS core constructs 4 Task Task Service Cluster Task … Cluster is logical grouping of services and tasks Service is a group of identical tasks Task is one or more containers performing specific application function Task Definition describes the task needs (cpu, memory, images, networking type, IAM)
  • 9. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. • Serverless container engine • No container host (OS) to upgrade, patch, secure • Isolation and security by design • Simpler and faster auto scaling • Fully managed service • No middleware to install and upgrade • Free! ECS with Fargate serverless container service overview
  • 10. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. Notable Fargate releases in the past 12 months 6
  • 11. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. Notable Fargate releases in the past 12 months AWS Compute Optimizer Support Receive prescriptive recommendations on “right sizing” Task configurations 4x increase in Fargate’s largest configuration sizes 8 and 16 vCPU combinations with up to 120GB memory 12x task launch rate improvements in 2 years Scale out the number of tasks to meet demand more quickly Service quota transition Migration from task/pod counts to number of vCPU Disk utilization metrics Monitor the disk utilization of tasks’ ephemeral storage
  • 12. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. Planned enhancements coming to Fargate 8
  • 13. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. Fargate investment themes New capabilities Unblocking customers and expanding Fargate’s flexibility through more intelligent image handling and use of Linux capabilities Security and efficiency Behind-the-scenes improvements to enhance reliability, accelerating CVE remediations, and improving security monitoring Operational excellence Expedite availability of Fargate in new regions through automation improvements and under-the-hood service optimizations 9
  • 14. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. Fargate roadmap highlights: Performance Faster Task start times More efficient image pulls through “lazy loading” of images Consistent compute and networking Greater performance consistency across Fargate Graviton price reduction Modifications coming for select regions including Mumbai 10
  • 15. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. Fargate roadmap highlights: Security Advanced security and network controls Enable additional Linux capabilities for runtime security monitoring, utilize eBPF, and customize the network stack. FIPS 140-2 compliance Ensuring Fargate meets federal standards for cryptography Secure ephemeral storage with Customer Managed Keys (CMK) Expanding on today’s default of service managed keys for enhanced control and security. 11
  • 16. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark. Thank you! 12
  • 17. AMAZON ECS BLUEPRINT © 2023, Amazon Web Services, Inc. or its affiliates. © 2023, Amazon Web Services, Inc. or its affiliates. Jooyoung Kim Specialist Solutions Architect, Container joozero@amazon.com ECS Blueprint
  • 18. AMAZON ECS BLUEPRINT © 2023, Amazon Web Services, Inc. or its affiliates. © 2023, Amazon Web Services, Inc. or its affiliates. Motivation for ECS Blueprint
  • 19. AMAZON ECS BLUEPRINT © 2023, Amazon Web Services, Inc. or its affiliates. Customers new to containers face a steep learning curve Deploy Build Run CI/CD and infra-as-code automation Container service & container infrastructure Observability Security Cost
  • 20. AMAZON ECS BLUEPRINT © 2023, Amazon Web Services, Inc. or its affiliates. • What is ECS? What is Fargate? • What is ECS cluster service, task, task definition, container definition? • What all IAM roles do I need? • What is different between task execution role and task role? • How to build containers? How to setup CI and CD? • How to configure rolling deployment? • How to monitor ECS Fargate workload? • How to configure logs? • How to handle sensitive secrets? • How to use ALB? How to use service discovery? • How to setup VPC endpoints? What all VPC endpoints to set? • How to use Fargate Spot? • How to use Graviton from start? • How to setup multi-account CI/CD? • How and what to use for run time security monitoring? • … ECS Fargate is easy but … 4 Automate all this using with IaC(Infrastructure as Code) Tool
  • 21. AMAZON ECS BLUEPRINT © 2023, Amazon Web Services, Inc. or its affiliates. Can we accelerate ECS Fargate adoption for beginners? 5 Technical deep dive presentations Workshops Immersion days Customer using ECS Fargate In their accounts With their applications With end-to-end automation Can we start here?
  • 22. AMAZON ECS BLUEPRINT © 2023, Amazon Web Services, Inc. or its affiliates. © 2023, Amazon Web Services, Inc. or its affiliates. ECS Blueprint Overview
  • 23. AMAZON ECS BLUEPRINT © 2023, Amazon Web Services, Inc. or its affiliates. © 2023, Amazon Web Services, Inc. or its affiliates. Sample Architecture
  • 24. AMAZON ECS BLUEPRINT © 2023, Amazon Web Services, Inc. or its affiliates. Overview of Core Infra Template 18
  • 25. AMAZON ECS BLUEPRINT © 2023, Amazon Web Services, Inc. or its affiliates. Overview of Backend Service Template 19
  • 26. AMAZON ECS BLUEPRINT © 2023, Amazon Web Services, Inc. or its affiliates. Overview of Frontend Service Template 20
  • 27. AMAZON ECS BLUEPRINT © 2023, Amazon Web Services, Inc. or its affiliates. Overview of CICD Service Template 21
  • 28. AMAZON ECS BLUEPRINT © 2023, Amazon Web Services, Inc. or its affiliates. © 2023, Amazon Web Services, Inc. or its affiliates. Demo 27
  • 29. AMAZON ECS BLUEPRINT © 2023, Amazon Web Services, Inc. or its affiliates. Get started today! • Official Github repository • Terraform and CDK blueprints are included • https://github.com/aws-ia/ecs-blueprints • ECS Blueprints workshop • https://catalog.workshops.aws/ecs-solution-blueprints/en-US • AWS CDK Workshop for Python • https://cdkworkshop.com/30-python.html 28
  • 30. AMAZON ECS BLUEPRINT © 2023, Amazon Web Services, Inc. or its affiliates. © 2023, Amazon Web Services, Inc. or its affiliates. Thank you!
  • 31. | Streamlined Data Flow © kreuzwerker 2023 https://kreuzwerker.de/ 5
  • 32. 6 Case Study of an Event-Driven Serverless Architecture Streamlined Data Flow using EventBridge and Step Functions
  • 33. | Streamlined Data Flow © kreuzwerker 2023 Client 7 - Operating in the field of clinical diagnostics and research - Prominent company utilizing data-driven approaches - Utilizes a Biodatabank containing over half a million individuals' data - Primarily focused on laboratory operations and diagnostics - Limited expertise in software development and implementation Client
  • 34. | Streamlined Data Flow © kreuzwerker 2023 The Client: A rare disease company 8 Client The customers mission is to provide data-driven, life-changing answers to patients, physicians, and pharma companies for rare and neurodegenerative diseases. Leading data-driven rare disease company.
  • 35. | Streamlined Data Flow © kreuzwerker 2023 9 Design and implement a cloud-native, serverless solution, streamlining the data synchronization process between CRM, ERP and LIMS systems Challenge Challenge
  • 36. | Streamlined Data Flow © kreuzwerker 2023 Challenge 10 - Multiple systems, including a webshop, products database, LIMS, ERP, and CRM, are currently in use - Each system is managed by a separate external vendor - These systems have overlapping data, such as customer and product information - No single system has exclusive ownership of the data - Data is duplicated across the systems with custom transformation - Real-time data synchronization is lacking, resulting in inconsistencies Challenge
  • 37. | Streamlined Data Flow © kreuzwerker 2023 Use Case: Product Sync 11 - Extract relevant data from Master Data Management (MDM) via REST - Transform data into a single product entity with nested attributes by aggregating multiple entities - Load product data into different external systems, such as CRM and ERP via REST Use Case: Product Sync
  • 38. | Streamlined Data Flow © kreuzwerker 2023 North Star 12 - Low maintenance - Simple to use and understand - Includes error handling and retry mechanisms - Utilizes REST API to integrate with external systems - Transforms and syncs a large volume of products in parallel for multiple targets - Adoptable to a real-time synchronization solution when the external systems incorporate support for it. North Star
  • 39. | Streamlined Data Flow © kreuzwerker 2023 Architecture 13 Architecture
  • 40. | Streamlined Data Flow © kreuzwerker 2023 14 − Parallel processing of bulk data − Cost based on actual usage − Automated error handling and retries − Convenient setup of monitoring and alarms − Low maintenance due to modular, automated, extensible, and managed design − Requires all target systems to be idempotent − It’s challenging to visualize the entire workflow without adequate documentation and diagrams Benefits Tradeoffs Tradeoffs
  • 43. Serverless Readiness Assessment Scope: Assessment of Scope, Architecture, Tech Stack, DevOps and AWS usage. Deliverable: Result Presentation and optional Enablement, Trainings, Consulting Time & Effort: 5 Person Days Application Modernisation & Cloud Native Software Development - Proof-of-Concept Scope Identification of (Modernisation) Use Cases and Implementation / Building of a PoC Deliverable Proof-of-Concept Time & Effort: 10-25 Person Days Funding Options: PoC Funding Well Architected Framework Review Scope Analyse Data Workload/Architecture along the Well-Architected Pillars Deliverable Report of findings / recommendations Time & Effort: 2 Person Days Funding Options: 5k Credits 1.250 €/CHF 2.750 €/CHF upon request
  • 44. | Streamlined Data Flow © kreuzwerker 2023 https://kreuzwerker.de/ 18
  • 45. kreuzwerker GmbH Ritterstr. 12 10969 Berlin www.kreuzwerker.de Fon +49 30 609 838 80 Fax +49 30 609 838 899 Thank you! aws@kreuzwerker.de