Core services

CoreServices
Ric Harvey
Technical Developer Evangelist
Amazon Web Services
rjh@amazon.com
@ric__Harvey
https://gitlab.com/ric_harvey/

Amazon Global Network
• Redundant 100GbE network
• Redundant private capacity
between all Regions except China
Over 160 Global CloudFront
PoPs
89 Direct Connect Locations
Paris
Sweden
AWS GovCloud East
First 5 years: 4 regions
2016–2020: 13 regions
Next 5 years: 7 regions
AW S
REGIONS
2 0 R e g i o n s 6 0 A Z s
Milan
Cape Town

The broadest and deepest cloud platform

AmazonVPC
• Private, virtual network in the AWS Cloud
• Similar constructs as on-premises network
• You choose your own subnet
• Customizable network configurations to meet your needs
• Its possible to have public and private subnets
• Control traffic between subnets with NACLs
Amazon VPC

CommonVPC deployment
AWS Cloud
Region
VPC
Availability Zone Availability Zone Availability Zone
Public subnetPublic subnet Public subnet
Private subnet Private subnet Private subnet

VPCSummary
VPC concepts:
• Regions + Availability Zones
• An internet gateway
• Public subnet
• Private subnet
• Route Tables
• NAT Gateways
Resources:
Further concepts:
• Transit gateway: https://aws.amazon.com/transit-gateway/
• AWS VPN: https://aws.amazon.com/vpn/
• AWS Direct Connect: https://aws.amazon.com/directconnect/

SecurityGroupshttps://docs.aws.amazon.com/vpc/latest/userguide/VPC_SecurityGroups.html
Security Groups
• Security groups
• Act as built-in firewalls
• Instances or groups of instances
• Control accessibility to instances
• Ingress
• Egress

AWS Cloud
Region
VPC
Availability Zone Availability Zone Availability Zone
Public subnetPublic subnet Public subnet
Private subnet Private subnet Private subnet

Public subnet Private subnet
Users

EC2
Core Compute unit:
 Application Server
 Web Server
 Database Server
 Game Server
 Mail Server
 Media Server
 Catalog Server
 File Server
 Computing Server
 Proxy Server

Burstable
T 3
Big Data
Optimized
H 1
Memory
Optimized
R 5
High
I/O
I 3
Compute
Intensive
C 5
Graphics
Intensive
G 3
General
Purpose
GPU
P 3
Memory
Intensive
X 1
X 1 e
General
Purpose
M 5
Virtual
Private
Servers
Bare Metal
High I/O
I 3 m
Dense
Storage
D 2 F 1
FPGA
A m a z o n
L i g h t s a i l
High-
Memory
Intensive
Z 1
M 5
d
R 5
d
C 5
d
Z 1 d
• NVMe-based SSD block level instance storage physically
connected to the host server
• High-speed, low latency local block storage
EC2
• Choose between processors on AWS general purpose and memory
optimized instances
• 10% lower prices on AMD-based instances
• Most applications can run on AMD-based variants with little to no
modification
Powered by
M 5
a
R 5
a

Up to 45% lower cost for scale-out workloads

ChoosingtheRightAmazonEC2Instances
EC2 Instance types are optimized for different use cases, workloads & come in
multiple sizes. This allows you to optimally scale resources to your workload
requirements.
Consider the following when choosing your instances: core count, memory size,
storage size & type, network performance, I/O requirements & CPU technologies.

ChoosingtheRightAmazonEC2Instances
$0.107 per Hour$0.0456 per Hour

EC2 Instance Type
Compute Optimized General Purpose Memory Optimized Storage Optimized
C5 C4 M5 M4 T2 X1 X1e R4 H1 I3 D2
Intel Processor
Xeon
Platinum
8175M
Xeon E5
2666 v3
Xeon
Platinum
8175M
Xeon E5
2686 v4
2676 v3
Xeon
Family
Xeon E7
8880 v3
Xeon E7
8880 v3
Xeon E5
2686 v4
Xeon E5
2686 v4
Xeon E5
2686 v4
Xeon E5
2676 v3
Intel Processor
Technology
Skylake Haswell Skylake
Broadwell
Haswell
Yes Haswell Haswell Broadwell Broadwell Broadwell Haswell
Intel AVX Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes
Intel AVX2 Yes Yes Yes Yes - Yes Yes Yes Yes Yes Yes
Intel AVX-512 Yes - Yes - - - - - - - -
Intel Turbo Boost Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes
Storage EBS-only EBS-only EBS-only EBS-only EBS-only
SSD
EBS-Opt
SSD
EBS-Opt
- HDD SSD HDD
EC2 Instances Powered by Intel Technologies

C5:ComputeOptimizedInstances
Based on 3.0 GHz Intel Xeon Scalable
Processors (Skylake)
Up to 72 vCPUs and 144 GiB of memory
(2:1 Memory:vCPU ratio)
25 Gbps NW bandwidth
Support for Intel AVX-512
25% price/performance improvement over
C4
C4 C5
“We saw significant performance improvement on Amazon
EC2 C5, with up to a 140% performance improvement in
industry standard CPU benchmarks over C4.”
“We are eager to migrate onto the AVX-512 enabled
c5.18xlarge instance size… .We expect to decrease the
processing time of some of our key workloads by more than
30%.”

M5:Next-GenGeneralPurposeinstance
Powered by 2.5 GHz Intel Xeon
Scalable Processors (Skylake)
New larger instance size—m5.24xlarge with
96 vCPUs and 384 GiB of memory
(4:1 Memory:vCPU ratio)
Improved network and EBS performance on
smaller instance sizes
Support for Intel AVX-512 offering up to twice
the performance for vector and floating point
workloads
14% price/performance improvement With M5
M4 M5

LightsailFind out more: https://aws.amazon.com/lightsail/

ContainerServicesFind out more: https://aws.amazon.com/containers/

Whatis acontainer?Find out more: https://aws.amazon.com/containers/

Scheduling and Orchestration
Cluster Manager Placement Engine
ECS
AMI
Docker
agent
ECS
agent
EC2 Instance
ECS
AMI
Docker
agent
ECS
agent
EC2 Instance
ECS
AMI
Docker
agent
ECS
agent
EC2 Instance
Running containers atscaleFind out more: https://aws.amazon.com/containers/

Serverless
No Server Management Flexible Scaling
No Idle Costs
$
High Availability
Find out more: https://aws.amazon.com/serverless/

Languages
Lambda
support for
Ruby
+ Bring any Linux compatible language
runtime;
Powered by new Runtime API - Codifies
the runtime calling conventions and
integration points
Same technology powering Ruby support
in AWS Lambda
Bring any Linux compatible
language runtime
Custom Runtimes
+
AWSOPENSOURCE
o f f e r e d b y
o f f e r e d b y
o f f e r e d b y
o f f e r e d b y
PARTNERSUPPORTED
ServerlessFind out more: https://aws.amazon.com/serverless/

ServerlessBennifits
Uptime
Scale
Performance
Management
Safe deploys
Concurrency controls
Find out more: https://aws.amazon.com/serverless/

ElasticLoadBalancingProducts
Application Load Balancer (ALB) Network Load Balancer (NLB)
Classic(Elastic) Load Balancer
(CLB/ELB)
PREVIOUS GENERATION
for HTTP, HTTPS, andTCP
• Flexible application management
• Advanced load balancing of
HTTP and HTTPS traffic
• Operates at the request level
(Layer 7)
• Extreme performance and static
IP for your application
• Load balancing ofTCP traffic
• Operates at the connection level
(Layer 4)
• Existing application that was built
within the EC2-Classic network
• Operates at both the request
level and connection level
HTTP
HTTPS
TCP
TLST
Find out more: https://aws.amazon.com/elasticloadbalancing/

ApplicationLoadBalancerUseCasesFind out more: https://aws.amazon.com/elasticloadbalancing/

ApplicationLoadBalancerUseCases
Target Target Target Target Target Target Target
Target Group Target Group Target GroupHealth
Check
Health
Check
Health
Check
Listener ListenerRule Rule Rule
Application
Load Balancer

NetworkLoadBalancerUseCases
• Sudden and volatile traffic patterns
• Single static IP address per Availability Zone
• Ideal for applications that require extreme performance

WhatIsAutoScaling?
Helps you verify that you have the desired
number of Amazon EC2 instances available to
handle the load for your application

CapacityManagement
Capacity
Day of the Week
Su M T W Th F Sa
}Unused
Capacity
Available Capacity
Capacity
Su M T W Th F Sa
Day of the Week
Available Capacity
Auto Scaling adjusting
← capacity as needed

Elastic Load
Balancing
Auto Scaling group Auto Scaling groupAuto Scaling group
Base Configuration Scaling Out Scaling In
Launch Instances Terminate Instances
ScalingOutandScalingIn
Amazon CloudWatch to monitor performance
Auto Scaling to add or remove EC2 instances

AutoScalingComponents
• Launch Configuration
• Auto Scaling groups
• Auto Scaling Policy

Launch Configuration: What will be scaled?
Launch settings
• AMI
• Instance type
• Security groups
• Roles

Auto Scaling Group: Where will it take place?
Deployment settings
• VPC and subnets
• Load balancer
• Minimum instances
• Maximum instances
• Desired capacity

Auto Scaling Policy: When will it take place?
Policy settings
• Scheduled
• On-demand
• Scale-out policy
• Scale-in policy

DynamicAutoScaling
v

Whenever: CPUUtilization
is: >= 80
for: 1 consecutive period(s)
to
AutoScaling Action Delete
Whenever this alarm: State is ALARM
From resource type: AutoScaling
From the: IREASG
Take this action: Increase Group Size – Add 2 instances
CloudWatch Alarm for Auto Scaling

Summary
What makes an auto scale group
• A launch configuration
• Auto Scaling group
• Auto Scaling policy
Triggered Auto Scaling
• Scheduled
• On-demand

EBSVolumes
Characteristics
• Persistent and customizable block storage for EC2
instances
• HDD and SSD types
• Provisioned IOPS (optional)
• Use Snapshots for backups
• Easy and transparent encryption
• Elastic
Usage: Instance attached storage (1-1)

EFSVolumes
Characteristics
• Network attached storage
• NFS (v4.0)
Usage: Connect to multiple instances (1-Many)

FSxFind out more: https://aws.amazon.com/fsx/

AmazonS3
Features
• Fully managed cloud storage service
• Rich security controls
Functionality
• Store virtually unlimited number of objects
• Access any time, from anywhere

S3CommonUseCases
• Storing application assets
• Static web hosting
• Backup and disaster recovery (DR)
• Staging area for big data

CloudFront

Route53
• CloudFront
• S3
• Load Balancers
• API Gateway
• ….

DynamoDB NeptuneRDS
Aurora CommercialCommunity
Timestream QLDBElastiCache
Relational Key-value Document In-memory Graph Time series Ledger
AWS DatabaseServicesFind out more: https://aws.amazon.com/products/databases/

Amazon RDS
Managed relational database service with a choice of six popular database engines
Available & durable
Automatic Multi-AZ data replication;
automated backup, snapshots,
failover
Easy to administer
No need for infrastructure
provisioning, installing and
maintaining DB software
Highly scalable
Scale database compute
and storage with a few
clicks with no application
downtime
Fast & secure
SSD storage and guaranteed
provisioned I/O; data
encryption at rest and
in transit
Find out more: https://aws.amazon.com/rds/

RDS deployed as a service in on-premisesVMware private data centers (vSphere)
Automates management of on-premises databases and hybrid backup and scaling
Available and
durable
Enable hybrid features and
tap into AWS for high
availability, backup, and
restore
Secure and
compliant
Automate management of
databases for workloads that must
remain on-premises to adhere to
strict data policies
Fully managed
Easy to provision, monitor, and
operate relational databases in your
private data center
Scalability and
performance
Scale storage, compute, and
memory of on-premises databases
from a single,
simple interface
AmazonRDSonVMware(Preview)Find out more: https://aws.amazon.com/rds/

Howitworks
RDS onVMware
Deploy RDS onVMware in
your private data center and
manage on-premises
databases using a single
RDS interface
RDS interface
Use the Amazon RDS
console, APIs, or CLI to
provision databases
Log in or create AWS
account
Find RDS onVMware in the
console and choose AWS
region
Download and install the
connector
Download & install the RDS
connector in yourVMware
vSphere environment to establish
secureVPN connection between
AWS and your private data center
Automate
database
management
RDS onVMware
automates database
management tasks
including provisioning,
patching, backups and
failover
Find out more: https://aws.amazon.com/rds/

AmazonAurora
MySQL and PostgreSQL compatible relational database built for the cloud
Performance and availability of commercial-grade databases at 1/10th the cost
Availability
and durability
Fault-tolerant, self-healing storage;
six copies of data
across three AZs; continuous backup
to S3
Fully managed
Managed by RDS:
no hardware provisioning, software
patching, setup, configuration, or
backups
Highly secure
Network isolation,
encryption at rest/transit
Performance
and scalability
5x throughput of standard MySQL
and 3x of standard PostgreSQL;
scale-out up to
15 read replicas
Find out more: https://aws.amazon.com/rds/aurora/

MySQL Physical
Replication -
PREVIEW
Serverless
MySQL 5.7-
compatible -
Preview
Parallel Query Serverless -
PREVIEW
TLS Support for
MySQL Serverless
MySQL in OSU
PostgreSQL - Fast
Database Cloning
Parallel Query for
MySQL - Preview
Auto Scaling
PostgreSQL Read
Replicas in GovCloud
MySQL launch in
HKG
Multiple cross-
region read
replicas
50+features released since re:Invent
2017
MySQL Serverless
availability in all
Aurora regions
MySQL launch in SIN PostgreSQL in SFO
PostgreSQL in PDT
PostgreSQL 2.0,
compatible with
PostgreSQL 10.4
PostgreSQL in NRT
PostgreSQL BAA
Inclusion (HIPAA
eligibility)
Aurora PostgreSQL 1.1
(compatible with
PostgreSQL 9.6.6)
HTTP SQL Endpoint for
Serverless
Support for DB
Cluster Stop / Start
Aurora 5.7 –
GA
Backtrack MySQL launch in PDT PostgreSQL in ICN
Encrypted MySQL (on-
premises/EC2) to
Aurora Migration
Synchronous Lambda
for MySQL
MySQLGeneral,
Slow, and Error log
Exports to
CloudWatch Logs
MySQL Custom
Endpoints
PostgreSQL 1.3,
compatible with
PostgreSQL 9.6.9
Auto Scaling PostgreSQL
Read Replicas in Ningxia
PostgreSQL 1.2,
compatible with
PostgreSQL 9.6.8,
in GovCloud
Hash joins for
MySQL
Encrypted Snapshot
Import from RDS for
PostgreSQL to Aurora
PostgreSQL
PostgreSQL 1.2, compatible
with PostgreSQL 9.6.8
PostgreSQL in
YUL, FRA, SYD,
and BOM
Auto Scaling
PostgreSQL
Read Replicas
MySQL nAZ
support
Multi-
master
PostgreSQL Query
Plan Management
- Preview
*Projected number of launches to year-end 2017
Amazon Aurora Delivering on customer
needs

Single Global Database with cross region replication
Replication typically completes in less than a second
No impact on database performance
Write master in one region and read replicas in other regions
Cross-region disaster recovery
Local read latency for applications with global users
Primary Region Secondary Region
Application
Storage Storage
Replication <1s
AuroraGlobalDatabase(GA)
High-performance database for globally-distributed
applications

Comprehensive
security
Encrypts all data by default and
fully integrates with AWS Identity
and Access Management for
robust security
Performance at scale
Consistent, single-digit millisecond
response times at any scale; build
applications with virtually unlimited
throughput
Global database for global
users and apps
Build global applications with fast access
to local data by easily replicating tables
across multiple AWS Regions
Serverless
No hardware provisioning, software
patching, or upgrades; scales up or
down automatically; continuously
backs up your data
AmazonDynamoDB
Fast and flexible key value database service for any scale
Find out more: https://aws.amazon.com/dynamodb/

VPC
Endpoints
April 2017
Auto
Scaling
June 2017
DynamoDB
Accelerator (DAX)
Time to
Live (TTL)
February 2017
Global tables
On-demand
backup
Encryption
at rest
February 2018
December 2017 March 2018
Point-in-time
recovery
AmazonDynamoDBDeliveringoncustomerneedsFind out more: https://aws.amazon.com/dynamodb/

Thank you!
Ric Harvey
Technical Developer Evangelist
Amazon Web Services
rjh@amazon.com
@ric__Harvey
https://gitlab.com/ric_harvey/

Core services

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Core services

Similar to Core services (20)

More from Richard Harvey

More from Richard Harvey (20)

Recently uploaded

Recently uploaded (20)

Core services