Using Containers and Serverless to Deploy Microservices (ARC214) - AWS re:Invent 2018

•

3 likes•3,667 views

The document discusses options for architecting microservices using containers and serverless architectures on AWS. It explores the benefits and trade-offs of container platforms like ECS, EKS and Fargate versus serverless platforms like AWS Lambda. It provides considerations for selecting between containers and serverless based on needs like compute requirements, data handling, demand predictability, control and operational complexity. It also notes hybrid approaches using services like API Gateway, AppSync and X-Ray for distributed systems.

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Using Containers and Serverless to
Deploy Microservices
Josh Kahn
Solutions Architect
AWS
A R C 2 1 4
Mayank Thakkar
Global Life Sciences Solutions Architect
AWS

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Our goal
Explore the benefits and trade-offs of container and
serverless architectures

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Options for architecting your microservices
AWS Lambda
Amazon EKS
Amazon ECS
AWS Fargate
Containers Serverless

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Containers: ECS, EKS, Fargate
• Platforms to run containerized applications on AWS
• Easily run and scale applications to meet your needs
• Native integration with other AWS services
• Pairs well with CI/CD
• Benefits
• Portability
• Control
• Rich ecosystem

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS container web architecture
VPC
Availability Zone A Availability Zone B
Public Subnet
Private Subnet
Public Subnet
Private Subnet
NAT Gateway NAT Gateway
ECS Cluster
Auto Scaling Group
Instances Instances
Internet
Gateway

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Serverless: Lambda
• Platform to run code without thinking about servers
• Our definition
• No servers to provision or manage
• Scales with usage
• Never pay for idle
• High availability built in, fault tolerance made easier
• Native integration with other AWS services
• Benefits
• Event-driven framework
• Multiple invocation models
• Opinionated

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS serverless web architecture
AWS Cloud

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Architectural considerations
• Custom code & services: Build
your own environment
• Numerous choices
• Requires management and
orchestration*
• Standardized choices
• Opinionated approach drives
scalable platform
• Security and scaling
managed by AWS
• Serverless and
“containerless”
Containers Serverless
* - Fargate changes this model

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Other considerations
• Wide array of power options
• Power level managed by container,
scoped by host
• Fargate offers streamlined model
• Multiple networking modes
• Mature tooling
• Easy power level selection
• 128MB to 3GB
• Network and CPU assigned
proportionally
• Can overwhelm backends
• Developing tooling
• Organizational readiness?
Containers Serverless
* - Fargate changes this model

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Ideas on selecting … containers
When you need …
• Lower startup latency
• Support for long running compute jobs (> 15 minutes)
• Predictable, high traffic usage
• Persistence of data
When you want …
• Complete control of compute environment
• But not just for the sake of control

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Ideas on selecting … serverless
When you need …
• To trigger action on an event
• Support for varying utilization
• Ability to handle unknown demand
When you want to …
• Quickly prove business value
• Hand operational complexity (for example, patching, scaling) to AWS
• Make fewer decisions

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What if I can’t decide?

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Runtime environment
compatible with AWS
Lambda?
.NET Core, Go, Java, Python,
or Node.js
Unknown
demand and
below RPS
breakeven
Inter-container
communication*
or storage-
intensive?
Desire orchestration
portability OR open
source fan?
Amazon EKS
Are you comfortable
managing your own
infrastructure?
Amazon ECSAWS Fargate
Deployment
Package size
<= 50MB
Desired Service
runtime <= 15
minutes?
AWS Lambda
Decision Tree – well, almost!

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon API Gateway
Enables best practices for distributed systems
• Throttling
• Retry with exponential fallback
• Fail fast
Support for public and private services

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS AppSync
Enables data-driven, real-time apps
• Multiple data sources, one endpoint
• Client specifies payload
• Subscription to latest data

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS X-Ray
Delivers insight into distributed applications
• Uncover application issues
• Improve application performance
• Ready for ECS, Lambda, and more

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
To learn more …
Containers
https://aws.amazon.com/containers/
Serverless
https://aws.amazon.com/serverless/

Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Josh Kahn
jkahn@amazon.com
Mayank Thakkar
mbt@amazon.com

Time: 15 minutes after this session
Location: Speaker Lounge (ARIA East, Level 1, Willow Lounge)
Duration: 30 min.

What's hot

In this session, we dive deep on best practices and design considerations for running Microsoft SQL Server on AWS. We cover how to choose between running SQL Server on Amazon EC2 and Amazon RDS. We also cover how to optimize the performance of SQL Server on AWS, how to leverage the new the Optimize CPU feature, and how to deploy SQL Server on Linux. We also review best practices for storage, monitoring, availability, security, and backup and recovery for SQL Server.

Design, Deploy, and Optimize Microsoft SQL Server on AWS (WIN324-R1) - AWS re...

Amazon Web Services

What does “Cloud First” really mean for your processes, customers, and the future of your business? In this session, learn from Hub International’s CISO and Head of Architecture how the insurance company is transforming their business by migrating to the cloud for greater scale, cost savings, performance, and security. With a goal to go all-in on AWS by end of 2018, Hub International needed real-time visibility across its cloud and hybrid environments to mitigate risks and ensure seamless migrations—thereby keeping customers happy and their data safe. See how Hub International is harnessing machine data and predictive analytics to secure applications and infrastructure, control costs and improve capacity planning. This session is brought to you by AWS partner, Splunk.

“Cloud First” Helps Hub Intl Grow the Business with Splunk on AWS (ANT330-S) ...

Amazon Web Services

Best Practices for Implementing Mobile & Web App Testing in the Cloud (MOB205...

Amazon Web Services

AWS offers a variety of data migration services and tools to help you easily and rapidly move everything from gigabytes to petabytes of data using your networks, our networks, the mail, or even a tractor trailer. Learn about the available data migration options, including the AWS Snowball family, AWS Storage Gateway, Amazon S3 Transfer Acceleration, and other approaches. We provide the guidance to help you find the right service or tool to fit your requirements, and we share examples of customers who have used these options in their cloud journey.

Migrating Data to the Cloud: Exploring Your Options from AWS (STG205-R1) - AW...

Amazon Web Services

Metrics are fundamental to succeeding with SaaS. As you pour tenants into a shared infrastructure environment, you need to rely on a rich collection of data that can drive insights into the architectural, operational, and business dimensions of your SaaS solution. In this session, learn to identify the different types of metrics commonly collected by SaaS providers and connect these with the design and architecture strategies that are employed to surface and analyze this data on AWS. We look at how SaaS organizations instrument, aggregate, publish and build actionable views of this data with specific emphasis on how a robust metrics architecture can fundamentally impact the operational, architectural, and business decision-making process for SaaS organizations.

SaaS Analytics and Metrics: Capturing and Surfacing the Data That's Fundament...

Amazon Web Services

Amazon Elasticsearch Service (Amazon ES) is both a search solution and a log monitoring solution. In this session, we address both. We build a front-end, PHP web server that provides a search experience on movie data as well as backend monitoring to send Apache web logs, syslogs, and application logs to Amazon ES. We tune the relevance for the search experience and build Kibana visualizations for the log data. In addition, we use security best practices and deploy everything into a VPC.

Have Your Front End and Monitor It, Too (ANT303) - AWS re:Invent 2018

Amazon Web Services

Companies have to process, analyze, and extract meaning from ever-growing volumes of audio, image, and video data. Automating media workflows, such as image and video indexing or manual transcription for closed captions, can help you scale the growth of your media library and save time from manual, error-prone work. In this workshop, you learn how to automate workflows using the Media Analysis Solution, which includes Amazon Rekognition, Amazon Transcribe, and Amazon Comprehend. You learn how to extract metadata from media files and create a searchable library of metadata.

Build a Searchable Media Library & Moderate Content at Scale Using Machine Le...

Amazon Web Services

Before you migrate your SQL Server workloads to AWS, you should have a clear understanding of SQL Server licensing and how to employ cloud licensing best practices for optimized TCO. In this session, we discuss licensing and support options and explore ways to optimize your database usage. AWS recently introduced new instance types and configurations that support your ability to optimize the cost of running SQL Server on AWS. We discuss how these innovations can enable your cloud strategy and help you get the most out of your licenses.

Optimize Your SQL Server Licenses on Amazon Web Services (DAT210) - AWS re:In...

Amazon Web Services

Securing Your Customers Data From Day One

Amazon Web Services

In this session, we discuss best practices and approaches for managing your Microsoft Windows-based infrastructure on AWS. We describe the AWS services that can help you manage Windows servers at scale and realize the maximum benefit of the cloud. In addition, we show you how to build simple and effective solutions to manage logging, configuration drift, inventory, licensing, and more. Please join us for a speaker meet-and-greet following this session at the Speaker Lounge (ARIA East, Level 1, Willow Lounge). The meet-and-greet starts 15 minutes after the session and runs for half an hour.

Operationalizing Microsoft Workloads (WIN320) - AWS re:Invent 2018

Amazon Web Services

In this session, Verizon shares how it uses AWS Systems Manager for inventory, compliance, and patch management solutions. Learn about the challenges that large enterprises face when they attempt to retrofit legacy solutions for cloud environments, and discover best practices for using AWS Systems Manager for minimal access policies, custom Amazon Machine Images, tagging policies, encryption, and more.

Managing Modern Infrastructure in Enterprises (ENT227-R1) - AWS re:Invent 2018

Amazon Web Services

AWS offers a wide selection of compute platforms. In this session, we highlight key platform features of different Amazon EC2 instance families, and we provide a framework in which to choose the best compute resource (including Amazon EC2 instances, AWS Fargate containers, and AWS Lambda functions) for your workloads based on metrics and workload profiles. We also share best practices and performance tips for getting the most out of your Amazon EC2 instances to help you reduce unnecessary spending and improve application performance.

Optimize Amazon EC2 Instances, AWS Fargate Containers, & Lambda Functions (CM...

Amazon Web Services

Alexa for Business enables you to deploy and manage Alexa skills for your organization. You can use Alexa skills to create smart conference rooms, help employees be more productive, and even create a unique experience for your customers. In this workshop, you have a chance to get hands on with Alexa for Business. You create an Alexa for Business organization, set up a private skills catalog for your organization, build a private skill for a Tableau BI application, and publish skills to your catalog. You also set up personal device enrollment, configure access policies for employees, and turn on voice authentication. Finally, you set up a virtual Alexa-enabled conference room and configure default dial-in information so you can join meetings using your voice. Bring your laptop and an existing AWS account. No previous Alexa experience is required.

Deploy Alexa for Business in Your Organization & Build Your First Private Ski...

Amazon Web Services

With Amazon Elasticsearch Service's simplicity comes a multitude of opportunity to use it as a back end for real-time application and infrastructure monitoring. With this wealth of opportunities comes sprawl - developers in your organization are deploying Amazon Elasticsearch Service for many different workloads and many different purposes. Should you centralize into one Amazon Elasticsearch Service domain? What are the tradeoffs in scale and cost? How do you control access to the data and dashboards? How do you structure your indexes - single tenant or multi-tenant? In this session, we'll explore whether, when, and how to centralize logging across your organization to minimize cost and maximize value and learn how Autodesk has built a unified log analytics solution using Amazon Elasticsearch Service.

Build Your Own Log Analytics Solutions on AWS (ANT323-R) - AWS re:Invent 2018

Amazon Web Services

Many customers move to the cloud to innovate faster and gain more business agility. In order to recognize these benefits of the cloud, many customers are migrating their .NET applications to AWS, whilst innovating faster by taking advantage of cloud-native services. In this session, we will go through application modernization journey for a .NET application to AWS, and walkthrough Containerization as an option. We also discuss how easy it is for the customers to transform their business applications using AWS while using the familiar Microsoft toolset and workflows.

Modernizing .NET Applications on AWS (GPSCT204) - AWS re:Invent 2018

Amazon Web Services

Enabling interactive data and analytics for thousands of users can be expensive and challenging—from having to forecast usage, provisioning and managing servers, to securing data, governing access, and ensuring auditability. In this session, learn how Amazon QuickSight’s serverless architecture and pay-per-session pricing enabled the National Football League (NFL) and Forwood Safety to roll out interactive dashboards to hundreds and thousands of users. Understand how the NFL utilizes embedded Amazon QuickSight dashboards to provide clubs, broadcasters, and internal users with Next Gen Stats data collected from games. Also, learn about Forwood's journey to enabling dashboards for thousands of Rio Tinto users worldwide, utilizing Amazon QuickSight readers, federated single sign-on, dynamic defaults, email reports, and more.

NFL and Forwood Safety Deploy Business Analytics at Scale with Amazon QuickSi...

Amazon Web Services

Many organizations want to consider a cloud strategy for their business-critical Oracle workloads. For most, however, the concern about licensing Oracle in AWS seems like a showstopper. In this session, we discuss your licensing and support options for running Oracle on AWS, and explore ways to cost optimize your Oracle workloads in the cloud. AWS recently released technical innovations that support your ability to optimize the cost of running Oracle on AWS. We discuss how these innovations and services can enable your cloud strategy for Oracle workloads.

Optimize Your Oracle Licenses on Amazon Web Services (DAT211) - AWS re:Invent...

Amazon Web Services

Over the course of hundreds of mass migrations with our enterprise customers, we've seen migrations of one or more data centers into AWS, and the common theme is that tools are crucial for reliable and fast discovery and migration. In this workshop, you get hands on experience using AWS migration tools like AWS Migration Hub and Application Discovery Service to supercharge planning and execution of your migration and move more servers and databases in less time. Learn how to discover existing servers, analyze server dependencies, group your resources into applications, and automate migrations using AWS and partner migration tools.

Discover & Migrate at Scale with AWS Migration Hub & Application Discovery Se...

Amazon Web Services

Learn how you can run your big data and machine learning models as many times as you want with Amazon EC2 Spot Instances. In this session, we discuss how to architect and run big data and machine learning workloads by combining common data processing applications with Spot Instances for scalable and cost-effective computing. We also highlight real-world customer examples with machine learning workloads running on Spot Instances.

Save up to 90% on Big Data and Machine Learning Workloads with Spot Instances...

Amazon Web Services

In this session, we explore the world's first cloud-scale file system and its targeted use cases. Learn about Amazon Elastic File System (Amazon EFS), its features and benefits, how to identify applications that are appropriate to use with Amazon EFS, and details about its performance and security models. The target audience is security administrators, application developers, and application owners who operate or build file-based applications.

Deep Dive on Amazon Elastic File System (Amazon EFS) (STG301-R1) - AWS re:Inv...

Amazon Web Services

What's hot (20)