Build Containers with AWS Cloud Map

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Build with Containers
Seoul, South Korea

Your presenters
YJ Jeong
Solutions Architect
• Focusing on Enterprise application architecture and have
various business vertical such as Media services, financial
services, and ad-tech etc.
• 3 years at AWS – Solutions Architect specializing in
container adoption and DevOps

ROBOTICS
AWS RoboMaker
Build robotic applications easily using Robot OS
Announcements At-a-Glance
TRANSFER and MIGRATION
AWS Transfer for SFTP
AWS DataSync
Copy, move, sync large amounts of data between
on-prem & AWS
NETWORKING and CONTENT DELIVERY
AWS Global Accelerator
Performance and availability for your global user
base
AWS Transit Gateway
Interconnect on-premises networks and VPCs at
scale
AWS Elemental MediaConnect
Broadcast quality video transport
Elastic Fabric Adapter
Run HPC workloads with high inter-node
communications
AWS Cloud Map
Map of your cloud complete with friendly names
AWS App Mesh
Monitor and control microservices
COMPUTE
EC2 Spot Instance
Use spot instance in auto-scale groups
AWS Outposts
Bring AWS services to any data center or on-
premises
CodeDeploy ECR as a Source Action
ECS supports Blue/Green Deployments
EC2 A1 Arm Instance
EC2 C5n Instance
EC2 P3Dn Instance
Firecracker
AWS License Manager
Lightsail Tagging
Lightsail Export to EC2
Hibernation for EC2 Instances
IoT
AWS IoT SiteWise
Collect telemetry data into cloud
AWS IoT Events
Event detection and action logic for IoT
AWS IoT Things Graph
represent Things such as devices and services as
Models
AWS IoT Service Delivery Designations
Core, Greengrass, Analytics Partners in IoT Service
Delivery
Amazon FreeRTOS
Operating system for microcontrollers
SATELLITE
AWS Ground Station
Process satellite data and downlink from the cloud
DATABASE
Dynamo Transactional APIs
All-or-nothing queries for mission critical logic
Amazon Timestream
Time-series database for IoT and operational apps
Amazon Quantum
Fully managed ledger database
DynamoDB on Demand
Remove capacity planning, Pay by the request
Amazon RDS on VMware
Run RDS on VMware vSphere
Aurora Global Database
Replicate updates globally from single region
MARKETPLACE
AWS Private Marketplace
Create a private catalog of pre-approved products
AWS Marketplace for SageMaker
Build machine learning apps using ready made
models
AWS Marketplace for Containers
Find contain products in AWS marketplace
MANAGEMENT and GOVERNANCE
CloudWatch Automatic Dashboards
Pre-built best practices dashboards for
CloudWatch
CloudWatch Logs Insights
Log analytics service for CloudWatch logs
AWS Well Architected Partner Program
Training partners to deliver Well Architected
reviews
AWS Control Tower
Automates setup of baseline environments
STORAGE
S3 Batch Operations
Manage billions of objects using APIs or console
S3 Intelligent Tiering
Automatically optimize pricing based on S3 based
on access frequency
S3 Object Lock
Write once, read many object locking for S3
S3 Glacial Deep Archive
Lowest price storage tier - for long term
S3 PUT to Glacier
four new features to reduce your storage costs
Amazon FSx for Windows File Server
Fully managed Microsoft Windows file system
Amazon FSx for Lustre
Fully managed Lustre file system
AWS Snowball Edge Compute Optimized
Run compute-intensive application offline
EBS doubles peak IOPS
EFS Infrequent Access
EFS Multi-VPC Access
ANALYTICS
Amazon Kinesis Data Analytics for Java Apps
Analyze streaming data, gain insights, respond
real-time
AWS Lake Formation
Setup secure data lakes in days
SECURITY, IDENTITY, COMPLIANCE
AWS Security Hub
Unified security management with actionable
promptsBLOCKCHAIN
Blockchain on AWS
Fully managed Blockchain network in minutes
MACHINE LEARNING
Comprehend Medical
Scan and extract unstructured medical data with
ML
AWS Ground Truth
Build quality training sets using AI labeling
Amazon Elastic Inference
Add GPU to any EC2 or SageMaker instance
AWS Inferentia
Custom inference chip for inferencing workloads
Amazon Textract
Extract text and data from virtually any document
Amazon DeepRacer
Learn Reinforcement Learning (RL) easily
Amazon Personalize
Managed recommendations engine
Amazon Forecast
Accurate time-series forecasting service
SageMaker Neo
Train model once, run them anywhere
Dynamic Training with Apache MXNet on AWS
MOBILE
AWS Amplify Console
Continuous deployment and hosting for modern
web apps
DEVELOPER TOOLS
AWS Tools for PyCharm
AWS Toolkits for Visual Studio Code, IntelliJ, and
PyCharm
Ruby Support for Lambda
AWS Lambda as a Target for App Load Balancer
AWS Lambda Layers
Amazon Managed Streaming for Kafka
AWS Well Architected Tool

Keys & definitions
GA
ICN
New Service
Preview
General Availability - Start using now in your nearest region.
Seoul Availability - Service/Feature is available in Seoul (ap-northeast-2)
Preview (Limited) – For Dev/Test only, subject to terms and conditions*.
* https://aws.amazon.com/service-terms/
New Service – A new service that has been launched.

Compute (Container) & Network
Firecracker
opensource kvm-based
virtualisation tech to run
micro-vms suitable for
secure multi-tenant
container-based services
GA Open
Source
AWS App Mesh
service mesh based on
envoy proxy to easily
monitor and control
communications across
microservices applications.
AWS Cloud Map
service discovery for
microservices and dynamic
cloud infrastructure
GAPreview ICN

Serverless
Lambda: Custom
Runtimes
Bring your own runtime
and language to run
Lambda functions
GA ICN
Lambda Layers
Lambda functions can
reference “layers” which
enables sharing common
libraries reusing pre-
written lambas/code
GA ICN
AWS Serverless
Application Model
Supports Nested
Applications
Nested apps make it
simple to reuse common
serverless patterns using
the AWS Serverless
Application Repository
GA ICN
AWS Step Functions
Adds Eight More
Service Integrations
Now easier to orchestrate
more aws services no
longer just limited to
lambda
GA ICN
Application Load
Balancer can now Invoke
Lambda Functions to
Serve HTTP(S) Requests
ALB can now invoke Lambdas
GA ICN
Lambda: Supports Ruby
Lambda now supports Ruby
as a language runtime
GA ICN

Developer Tools
CodeDeploy: ECR as a
Source Action
you can now initiate an
AWS CodePipeline
pipeline update by
uploading a new image to
Amazon ECR
GA ICN
ECS Blue/Green
deployment with
CodeDeploy
AWS Code Deploy
Supports Blue Green
Deployments for ECS &
Fargate
GA ICN
AWS Toolkit for
PyCharm
simplifies developer
experience for building
and debugging serverless
applications in their
preferred Integrated
Development
Environments (IDEs)
GA Preview
AWS Toolkit for
IntelliJ and VSCode
simplifies developer
experience for building
and debugging serverless
applications in their
preferred Integrated
Development
Environments (IDEs)
AWS Amplify Console
it is an orchestrator,
continuous deployment and
hosting service for modern
web &mobile applications
with serverless backends.
GA
Open
Source
Open
Source

Marketplace
AWS Marketplace
Container Products
you can now find and buy
trusted container products
in AWS Marketplace and
through the Amazon
Elastic Container Services
(Amazon ECS) console
GA ICN

New Container Service

AWS Container Services Landscape
MANAGEMENT
Deployment, Scheduling,
Scaling & Management of
containerized applications
HOSTING
Where the containers run
Amazon Elastic
Container Service
Amazon Elastic
Container Service
for Kubernetes
Amazon EC2 AWS Fargate
IMAGE
REGISTRY
Container Image Repository
Amazon Elastic
Container Registry

* https://www.cncf.io/blog/2018/08/29/cncf-survey-use-of-cloud-native-technologies-in-production-has-grown-over-200-percent//
Cloud Native Technologies Adoption
Amazon Elastic
Container Service
63% 51% 70%

Introducing
AWS Cloud Map
Networking
General Availability
Managed service registry for service mapping and discovery
Define friendly names
for all cloud resources
Discover resources
with specific attributes
Ensure only healthy
resources are discovered
Highly available regional
API and global DNS

Register resources for API + DNS discovery mode
1. aws servicediscovery create-public-dns-namespace --name
cloudmapdemo.com
2. aws servicediscovery create-service --name frontend
--dns-config “NamespaceId=%namespace_id%,
DnsRecords=[{Type=A, TTL=60}]”
3. aws servicediscovery register-instance --service-id
%service_id% --instance-id %id%
--attributes
AWS_INSTANCE_IPV4=52.89.144.60,
stage=beta,
version=1.0,
ready=yes

Register any cloud resource for API discovery
1. aws servicediscovery create-http-namespace --name shared
2. aws servicediscovery create-service --name logs --
namespace-id %namespace_id%
3. aws servicediscovery register-instance --service-id
%service_id% --instance-id %id%
--attributes
ARN=arn:aws:s3:::cloudmapdemoservicelogsbeta1,
stage=beta,
shard=s_1,
read_only=no,
path=/mylogs

Secure name resolution via API calls
# aws servicediscovery discover-instances --namespace-name shared --service-name logs
-->
{ "Instances": [
{
"InstanceId": "i1",
"NamespaceName": "shared",
"ServiceName": "logs",
"HealthStatus": "UNKNOWN",
"Attributes": {
"read_only": "no",
"path": "/mylogs",
"shard": "s_1",
"ARN": "arn:aws:s3:::cloudmapdemoservicelogsbeta1",
"stage": "beta”
}
}
]
}

Name resolution via DNS
# dig +short A frontend.cloudmapdemo.com
-->
52.89.144.60
52.26.95.129
34.214.232.177

Attribute-based service discovery

Stage: prod

Version: 1.0

Version: 2.0
Ready: yes

Register and discover resources with custom attributes
• Incremental deployments
• Dev / test / prod deployments
• Smart traffic routing

# aws servicediscovery discover-instances --namespace-name cloudmapdemo.com
--service-name frontend --query-parameters ready=yes
-->
{ "Instances": [
{
"InstanceId": "i1",
"NamespaceName": "cloudmapdemo.com",
"ServiceName": "frontend",
"HealthStatus": "UNKNOWN",
"Attributes": {
"ready": "yes",
"AWS_INSTANCE_IPV4": "52.89.144.60",
"version": "1.0",
"stage": "beta”
}
}
]
}

Handling partial failure
Amazon Route 53
Health Check
Amazon Route 53
Health Check
discover-instances

Handling partial failure
Amazon Route 53
Health Check
Amazon Route 53
Health Check
!
discover-instances

AWS Cloud Map ecosystem

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Copyright © 2018 HashiCorp ⁄
DC-2
Hybrid Environment
Web App
Bi-directional
Catalog Sync
Database
VPN/Direct Connect
us-east-1
us-west-1
Web App
On-prem
Web App
AWS Cloud Map and Consul
Extend Service Discovery to Hybrid Infrastructures and Multi-region

Introducing
AWS App Mesh
Networking
Public Beta
A service mesh that makes it easy to
monitor and control large microservices applications
Consistent communications for microservices
Capture, aggregate, and export metrics, logs, and traces
Open source Envoy proxy
Managed by AWS—highly available and scalable
Control network traffic routing between instances
Works with Fargate, ECS, EKS, and Kubernetes on AWS

Rust
Database
DB
Database
Rust
GoNode.is
Java
Node.is
Node.is

Containers
Database
DB
Database
Containers
λContainers
VMs
Managed
Service

What is needed
Consistent
communications
management
Complete visibility Failure isolation
and protection
Fine-grained
deployment controls

Implementation options
Microservice
Container
In-process
(SDK)
Option 1

Option 1: In-process SDK
Java
Scala
Node.js
Python
C++
Django
.NET
GO
…

Implementation options
Microservice
Container
In-process
(SDK)
Out-of-process
(sidecar proxy)
Option 1 Option 2
Microservice
Container
Proxy

Option 2: Side-car proxy
Application CodeMicroservice
Proxy
Monitoring
Routing
Discovery
Deployment

Option 2: Side-car proxy
Proxy runs
as a container
External traffic
Application
Code

Option 2: Proxy
Proxy

Best practices are emerging and evolving rapidly
• Standardize and automate operations by modeling infrastructure as
code
• Improve application performance with full stack observability
• Create a culture of innovation by organizing into small DevOps teams
• Update applications & infrastructure quickly by automating CI/CD
• Ensure trust by automating security & compliance

Why service mesh proxy
vs. Libraries or app code
Overall—migrate to microservices safer and faster
Reduce work required
by developers
Follow best practices Use any language
or platform
Simplify visibility,
troubleshooting, and
deployments

OSS project
Wide community support, numerous integrations
Stable and production-proven
“Graduated Project” in Cloud Native Computing
Foundation
Started at Lyft in 2016
App Mesh uses Envoy proxy

Dynamic state changes impact proxy configuration
App
develope
r
Infra
operator
intent
App
develope
r
App
develope
r
Magic
Deployments
Scaling
Health
reporting

Why service mesh control plane
vs. static config or self-built control plane
Don’t need to spend
dev to build and ops
to maintain
Not tied to
application
deployment system
(e.g., container orchestration)
Works across
different compute
systems
Reliably store and
distribute
configuration

Dynamic state changes impact proxy configuration
App
develope
r
Infra
operator
App
develope
r
App
develope
r
App Mesh API
Integrations
Integrations
Deployments
Scaling
Health
reporting

App Mesh configures every proxy

Additional use cases based on customer input
vs. existing control plane solutions
Works across
Clusters
Container services
Containers & VMs
AWS and partner
integrations
AWS run for scale
and stability
Extensible
architecture from
OSS base

AWS App Mesh with AWS Cloud Map
Service registry for AWS App Mesh
Discover Instances
AWS_INSTANCE_IPV4 AWS_INSTANCE_PORT
AVAILABILITY_ZONE REGION
ECS_SERVICE_NAME ECS_CLUSTER_NAME
EC2_INSTANCE_ID ECS_TASK_DEFINITION_FAMILY

AWS integrations
Service Discovery Microservices

App Mesh is available as a preview for all customers
Observability and traffic control
Easily export logs, metrics, and traces (available)
Client side traffic policies—circuit breaking, retries (coming soon)
Routes for deployments (available)
AWS container services compatibility
Today: Amazon Elastic Container Service (Amazon ECS) & Amazon
Elastic Container Service for Kubernetes (Amazon EKS)
Coming soon: AWS Fargate

Application observability
+ others
Faster troubleshooting
due to consistent data
across services
Existing tools or
dashboards with a lot
more metrics, logs and
traces
Distinguish between
service and network
issues

Proactive operations helps mitigate issues
Degraded state
Outage
Latency
Time (ms)

Client side traffic management
Traffic Shaping*
Service discovery
Retries
Timeouts
Circuit breaks
Health checks
Routing Controls
Protocols support
Header based
Cookie based
Path based
Host based

Fine-grained deployment control
B1
B2
20%
80%
A

How it works

Representing your sample app in App Mesh
Elastic Load
Balancing
Microservices App Mesh
Mesh – [myapp]
Virtual
Node A
Service
Discovery
Listener Backends
Virtual
Node B
Service
Discovery
Listener Backends

Virtual Node
Virtual Node
Service
Discovery
BackendsListeners
Virtual Node
Logical representation of
runtime services
Backends
Set of destinations that this node will
communicate with (hostnames)
Service Discovery
Describes how its callers and locate this node
(DNS hostname or AWS Cloud Map*
namespace, serviced, and selectors)
Listeners
Policies to handle incoming
traffic
Ed: port, Health check*,
Circuit breaker*, Retries*

Elastic Load
Balancing
Microservices App Mesh
Mesh – [myapp]
Virtual
Node A
Virtual
Node B
Virtual
Router
Routes
Create route

Virtual router
A
Virtual Router: B
Service Names
B
Service Name
Names that clients will use to connect to the
service

Virtual routes Destination’s virtual
router and route
Virtual router: B
HTTP routes
Match
Prefix: /
Action:
Targets
B
Route B
Virtual node
destination +
weight
Route Name: B1
Match
Action:
Route Name: B2
Other Protocol routes

Update routes
Virtual router: B
HTTP route
targets:
prefix: /
B
B’
Route B
Virtual node destination
+ weight
Route B’
New service or service
version

Mesh – [myapp]
Virtual
Node A
Service
Discovery
BackendListener
Virtual router
Domains
action:
match: /
B
B’
Service B
Service B’
Virtual
Node B’
Service
Discovery
Listener Backends
Virtual
Node B
Service
Discovery
Listener Backends

Virtual Node
B1
Mesh
Service A
Service B
Service C
Virtual
router
Virtual
router
Virtual
Node C2
Virtual
Node C1
Service D
Virtual
router
Virtual
Node D1
Virtual
Node D1

Mesh – myapp
Elastic Load
Balancing
Microservices
Envoy Bootstrap:
//“tracing": {...},
//"stats": {...},
//"logging": {...}

Introducing
Firecracker
Compute
Open source virtualization technology purpose-built for creating
and managing secure, multitenant containers and functions-based services
Security Speed by design Scale and efficiency
Minimal device model
reduces memory footprint
and attack surface area
User-space code in <125ms,
150 microVM
per second per host
Low memory overhead with
high density (thousands) of
microVMs on each server
AWS open sourcing Firecracker to enable broad access and innovation

Marketplace for Container

Introducing
AWS Marketplace Software
Container products available in AWS Marketplace
Choose from more than 160 curated
and trusted container products in AWS
Marketplace and run them on AWS
Container product images
are verified and scanned
Products are available with free, bring your own
license, and usage-based pricing models
Deploy container products on
Amazon ECS, AWS Fargate, or EKS
AWS Marketplace
for Containers

• Deploy software on demand
• Procure new, BYOL, or free open source
• Tagged, Trackable, and Metered
• 1,400+ participating ISVs
• 4,500+ product listings
• 200,000+ active customers
• 950,000+ current subscriptions
• 35+ software categories
• 650M+ hours of Amazon EC2 deployed monthly
AWS Marketplace Simplifies Software Provisioning
Find, test, buy, and deploy software
in the cloud

AWS Marketplace Capabilities
Software discovery, procurement, and deployment simplified
Get the software
you need in minutes
• Test in minutes
• Innovate faster
• Ready-to-run on AWS
• Simplify migration to the cloud
• Use BYOL investments
• Convert from Test to Buy
Pay options such as pay-as-
you-go pricing
• Pay only for what you use
• Integrate software costs
into AWS bill
• Pay by user, host, or data
• Upgrade to longer terms for
subscription discounts
• Software as a service (SaaS)
multi-year contracts
Flexible delivery and
usage options
• Easily scale up or down on
demand
• Test and learn without material
commitments
• Use only what you need without
wasting unused licenses
• Resources tagged and visible in
Spend Management Tools

BYOL
Carry previously purchased
licenses over to AWS via AWS
Marketplace.
License key required
to deploy and track.
Use existing investments and
simplify cloud deployment
capabilities.
400+ titles.
Paid
Metered pricing available
based on variables like term,
number of users, amount of
bandwidth, number of hosts.
Pay only for what you use.
Utility model eliminates large
capital investments.
Free trials available for many
products. Consolidated billing
with other AWS services.
2,000+ titles.
Open Source
Curated listings, often with
no software cost for use of
these products, unless
supported versions are
necessary.
AWS infrastructure cost
still apply to open
source deployments.
2,000+ titles.
SaaS
Service completely managed
and fulfilled by SaaS Provider
(at least for now).
No resources required to
manage infrastructure.
SaaS contracts available for
annual and multi-year
commitments.
Free trials available for many
products. Consolidated billing
with other AWS services.
175+ titles.
Server Software (AMI/Container) on Amazon EC2, ECS, EKS SaaS
AWS Marketplace Listing Types

• Adding Docker-compliant container
images as a new fulfillment option
for server software products
• Container product images are
ingested and scanned from seller
repositories, such as GitHub and
Amazon ECR
• Free, BYOL, and usage-based
pricing models for Amazon ECS
(fractional hourly and fixed
monthly models)
• Products run on Amazon ECS and
Amazon EKS using seller-
provided templates, such as Helm
Charts and Task Definitions

Key Container Products on AWS Marketplace
• Twistlock Cloud Discovery
• Automatically discover cloud-native services
across every account and Region
• Accelerate security and auditing to find
rogue and unmanaged deployments
• Single Docker image that uses native AWS
APIs for discovery with IAM access
• Available only on AWS Marketplace
• Datadog Enterprise
• Turn-key integrations with simple container-
based monitoring agent
• API extends Datadog integrations to send
metrics and events from your applications
• Out-of-the-box dashboards plus drag-and-
drop tools to create your own
• Pro and BYOL editions available also

Key Container Products on AWS Marketplace
• Sysdig Cloud Native
Intelligence Platform
• ContainerVision unlocks data to help see and
secure applications more effectively
• ServiceVision adds metadata to metrics and
events from AWS and Kubernetes
• Sysdig agent delivers deep insight to help
reduce overhead and management
• Splunk Enterprise
Docker Image
• Collect and index machine-generated data
from any source in real time
• Correlate complex events spanning data
sources across your environment
• Scales to collect and index tens of terabytes
of data per day

Questions?

Start at https://eksworkshop.com

Build Containers with AWS Cloud Map

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Build Containers with AWS Cloud Map

Similar to Build Containers with AWS Cloud Map (20)

More from Amazon Web Services Korea

More from Amazon Web Services Korea (20)

Recently uploaded

Recently uploaded (20)

Build Containers with AWS Cloud Map