This document provides an overview of Amazon EC2 and how it has evolved over time. It discusses the various EC2 instance types that are optimized for different workloads and use cases. It also covers important performance factors like networking, memory, and storage options. The document demonstrates how auto scaling on EC2 can provide greater flexibility and savings compared to traditional capacity planning.

1. Introduction to Amazon EC2
Ilya Epshteyn, Enterprise Solutions Architect

2. 16 Regions – 42 Availability Zones – 74 Edge Locations
Region & Availability Zones
AWS GovCloud (2) EU
Ireland (3)
US West Frankfurt (2)
Oregon (3) London (2)
Northern California (3)
Asia Pacific
US East Singapore (2)
N. Virginia (5), Ohio (3) Sydney (3), Tokyo (3),
Seoul (2), Mumbai (2)
Canada
Central (2) China
Beijing (2)
South America
São Paulo (3)
Announced Regions
Paris, Ningxia, Stockholm
AWS Global Infrastructure

3. AWS Region
AZ
AZ
AZ AZ AZ
Transit
Transit

4. Web Tier
Availability Zone 1 Availability Zone 2
Web Tier
App Tier App Tier
Amazon VPC
DB Tier DB Tier

5. Physical servers in
AWS global regions
Host server
Hypervisor
Guest 1 Guest 2 Guest n
Amazon Elastic Compute Cloud

6. Amazon EC2 Ten Years Ago…
First generation, single instance family and size
• m1.small (1 vCPU, 1.7 GiB RAM, 160 GB storage)
Linux only
On-Demand pricing only

7. EC2 Instances Today
c4.large
Instance family
Instance generation
Instance size

8. Choosing the Right Amazon EC2 Instance
 EC2 Instance types are optimized for different use cases & come in
multiple sizes. This allows you to optimally scale resources to your
workload requirements.
 AWS utilizes Intel® Xeon® processors for EC2 Instances providing
customers with high performance and value.
 Consider the following when choosing your instances: Core count,
Memory size, Storage size & type, Network performance, & CPU
technologies.
 Hurry Up & Go Idle - A larger compute instance can save you time
and money, therefore paying more per hour for a shorter amount of
time can be less expensive.

9. Get the Intel® Advantage
 Intel’s latest 22nm Haswell microarchitecture on new C4 instances,
with custom Intel® Xeon® v3 processors, provides new features:
 Haswell microarchitecture has better branch prediction; greater
efficiency at prefetching instructions and data; along with other
improvements that can boost existing applications’ performance by
30% or more.
 P state and C state control provides the ability to individually tune
each cores performance and sleep states to improve application
performance.
 Intel® AVX2.0 instructions can double the floating-point performance
for compute-intensive workloads over Intel® AVX, and provide
additional instructions useful for compression and encryption.

10. Intel® Processor Technologies
Intel® AVX – Get dramatically better performance for highly
parallel HPC workloads such as life science engineering, data
mining, financial analysis, or other technical computing
applications. AVX also enhances image, video, and audio
processing.
Intel® AES-NI – Enhance your security with these new
encryption instructions that reduce the performance penalty
associated with encrypting/decrypting data.
Intel® Turbo Boost Technology – Get more computing power
when you need it with performance that adapts to spikes in your
workload with Intel® Turbo Boost Technology 2.0

11. EC2 Instances with Intel® Technologies

12. http://aws.amazon.com/ec2/instance-types/

13. Performance Factor: Networking
Device Pass Through: Enhanced Networking
 SR-IOV provides higher I/O performance and lower CPU utilization
 Physical network device exposes virtual function to instance
 Enhanced Networking is currently supported in R3, C3, C4, M4, D2, and I2 instances
 Enables significantly higher packet per second (PPS) performance, lower network jitter and lower latencies
 Provides higher bandwidth, higher packet per second (PPS) performance, and consistently lower inter-instance latencies
 There is no additional charge for using enhanced networking
New: Elastic Network Adapter - Available now for the new X1 instance type!
 Next generation of Enhanced Networking
 Hardware checksums
 Multi-queue support
 20 Gbps in a placement group
 Delivers high throughput and great packet per second (PPS) performance, minimizes the load on the host processor in a
number of ways, and also does a better job of distributing the packet processing workload across multiple vCPUs

14. Performance Factor: Memory

15. Performance factor: Storage
Locally attached or “instance storage”
Network attached:
Amazon EBS General Purpose (SSD) volumes
Amazon EBS Provisioned IOPS (SSD) volumes
Amazon EBS Magnetic volumes (multiple types for different use cases)
Amazon EFS (seconds to create a scalable shared NFSv4 file system)
Amazon S3 and Amazon Glacier for object storage

16. 1 2 4 8 16 40
1
2
4
8
16
32
64
128
256
Memory(GB)
vCPU
g2.2xlarge
8 vCPU, 15 GB
1 x 60 SSD
NVIDIA GPU (1,536
CUDA cores, 4GB
Mem)
4 vCPU, 30.5 GB
i2.xlarge (High IO) - 1 x 800 SSD
d2.xlarge (Dense) - 3 x 2000
HDD
8 vCPU, 61 GB
i2.2xlarge (High IO) - 2x800 SSD
d2.2xlarge (Dense) - 6 x 2000
HDD
16 vCPU, 122 GB
i2.4xlarge (High IO) - 4x800 SSD
d2.4xlarge (Dense) - 12x2000 HDD
32 vCPU, 244 GB
i2.8xlarge (High IO) - 8x800 SSD
36 vCPU, 244 GB
d2.8xlarge (Dense) - 24x2000 HDD
m3.xlarge
4 vCPU, 15
GB
2 x 40 SSD
m3.2xlarge
8 vCPU, 30
GB
2 x 80 SSD
m3.large
2 vCPU, 7.5
GB
1 x 32 SSDm3.medium
1 vCPU, 3.75
GB,
1 x 4 SSD
t2.micro
1 vCPU,
1GB
EBS Only
t2.small
1 vCPU,
2GB
EBS Only
t2.medium
2 vCPU,
4GB
EBS Only
r3.large
2 vCPU, 15.25
GB
1 x 32 SSD
r3.xlarge
4 vCPU, 30.5 GB
1 x 80 SSD
r3.2xlarge
8 vCPU, 61 GB
1 x 160 SSD
r3.4xlarge
16 vCPU, 122 GB
1 x 320 SSD
r3.8xlarge
32 vCPU, 244 GB
2 x 320 SSD
2 vCPU, 3.75 GB
c4.large - EBS Only
c3.large - 2 x 16 SSD
4 vCPU, 7.5 GB
c4.xlarge - EBS Only
c3.xlarge - 2 x 40
SSD
8 vCPU, 15 GB
c4.2xlarge - EBS
Only
c3.2xlarge - 2 x 80
SSD
36 vCPU, 60 GB
c4.8xlarge - EBS Only
c3.8xlarge - 2 x 320
SSD
m4.large
2 vCPU, 8 GB
EBS Only
m4.xlarge
4 vCPU, 16
GB
EBS Only
m4.2xlarge
8 vCPU, 32
GB
EBS Only
m4.4xlarge
16 vCPU, 64
GB
EBS Only
m4.10xlarge
40 vCPU, 160GB
EBS Only
t2.large
2 vCPU, 8 GB
EBS Only
Storage Optimized
GPU Instances
General Purpose
Memory Optimized
Compute Optimized
New M4’s/T2 Large
t2.nano
1 vCPU, 512MB
EBS Only
g2.8xlarge
32vCPU, 60 GB
2 x 120 SSD
4 NVIDIA GPUs (1,536
CUDA cores, 4GB
Mem)
16 vCPU, 30 GB
c4.4xlarge - EBS Only
c3.4xlarge - 2 x 160
SSD
39 (latest generations) EC2 Instance Types

17. 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serverload
Hour of day

18. 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serverload
Hour of day
Capacity of 1 server

19. 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serverload
Hour of day
Capacity of 1 server
Traditional capacity required

20. 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serverload
Hour of day
Capacity of 1 server
Traditional capacity required
1 server for 8 hours

21. 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serverload
Hour of day
Capacity of 1 server
Traditional capacity required
1 server for 8 hours 1 server for 8 hours

22. 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serverload
Hour of day
Capacity of 1 server
Traditional capacity required
1 server for 8 hours 1 server for 8 hours
1 server for 8 hours

23. 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serverload
Hour of day
Capacity of 1 server
Traditional capacity required
1 server for 8 hours 1 server for 8 hours
1 server for 8 hours
1 server for 8 hours

24. 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serverload
Hour of day
Capacity of 1 server
Traditional capacity required
1/3rd
saving

25. 0
1
2
3
4
5
6
0 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30
Instancecount
Day of month

26. 0
1
2
3
4
5
6
0 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30
Instancecount
Day of month
Monthly
predictable
peak
processing

27. 0
1
2
3
4
5
6
0 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30
Instancecount
Day of month
Traditional capacity required

28. 0
1
2
3
4
5
6
0 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30
Instancecount
Day of month
Elastic capacity
Traditional capacity required

29. 0
1
2
3
4
5
6
0 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30
Instancecount
Day of month
75% savings
Traditional capacity required
Elastic capacity

30. Consistent, regular, exhaustive 3rd party evaluations
• Secured premises
• Secured access
• Built-in firewalls
• Unique users
• Multi-factor authentication
• Private subnets
• Encrypted data storage
• Dedicated connection
Architected for Enterprise Security

31. Encryption
Key
Management
Service
CloudHSM Server-side
Encryption
Networking
Virtual
Private
Cloud
Web
Application
Firewall
Compliance
ConfigCloudTrailService
Catalog
Identity
IAM Active
Directory
Integration
SAML
Federation
Deep Set of Cloud Security Controls

32. Easily build highly available applications
ELB distributes load
Auto Scaling helps ensure availability and scale
Use multiple Availability Zones (AZs)
Use multiple global regions
Building Reliable Architectures

33. Elastic Load Balancing
Elastic Load Balancing automatically distributes incoming application
traffic across multiple Amazon EC2 instances.
Two Types: Classic & Application Load Balancer

34. Elastic Load Balancing
In-Region Load Balancing Service
Distributes traffic across multiple Availability Zones
• HTTP/S, TCP/S
Built-in Health Check
Fully fault-tolerant
• Can span multiple AZs
Web
Server
AZ-3
Web
Server
Web
Server
AZ-2
Web
Server
Region
Elastic Load
Balancer
Web
Server
AZ-1
Web
Server

35. Classic Load Balancer Features:
 High Availability
 Health Checks
 Security Features
 SSL Offloading
 Sticky Sessions
 IPv6 Support
 Layer 4 or 7 Load Balancing
 Operational Monitoring
 Logging

36. Application Load Balancer Features:
 Layer-7 Load Balancing
 Content-Based Routing
 Containerized Application Support
 HTTP/2 Support (single, multiplexed connection)
 WebSockets Support (real-time messages without polling)
 Request Tracing (custom identifier “X-Amzn-Trace-Id”)
 Web Application Firewall (WAF)
 Delete Protection

37. Scale your apps with AWS Auto Scaling
 AWS Auto Scaling enables you to
automatically scale out your app
based on demand
 Scale dynamically based on
instance metrics or set schedule
 Scale in automatically when
demand subsides
 Create Auto Scaling Groups and
Scaling Policies to maintain high
availability
 Receive notifications via Amazon
SNS service when scaling occurs

38. Amazon
maintained
Set of Linux and
Windows images
Kept up to date by
Amazon in each
region
Community
maintained
Images published by
other AWS users
Managed and
maintained by
Marketplace
partners
Your machine
images
AMIs you have
created from EC2
instances
Can be kept private
or shared with other
accounts
Amazon Machine Images

39. Bake an
AMI
Start an instance
Configure the instance
Create an AMI from your instance
Start new ones from the AMI
AMI Creation

40. Bake an
AMI
Start an instance
Configure the instance
Create an AMI from your instance
Start new ones from the AMI
Configure
dynamically
Launch an instance
Use metadata service and
cloud-init to perform actions
on instance when it launches
AMI Creation

41. Bake an
AMI
Build your base images and
set up custom initialization
scripts
Maintain your ‘golden’ base
Configure
dynamically
Use bootstrapping to pass
custom information in and
perform post launch tasks like
pulling code from SVN
+
AMI Creation

42. Time consuming configuration
startup time
Static configurations
less change management
Bake an
AMI
Configure
dynamically
AMI Creation

43. Continuous deployment
latest code
Environment specific
dev-test-prod
Bake an
AMI
Configure
dynamically
AMI Creation

44. Launch
Configuration
Describes what Auto Scaling
creates when adding Instances
Only one active launch
configuration at a time
aws autoscaling create-launch-configuration
--launch-configuration-name launch-config
--image-id ami-54cf5c3d
--instance-type m3.medium
--key-name mykey
--security-groups webservers
Auto Scaling
group
Auto Scaling managed grouping
of EC2 instances
Automatically scale the number
of instances by policy
aws autoscaling create-auto-scaling-group
--auto-scaling-group-name autoscaling-group
--availability-zones eu-west-1a eu-west-1b
--launch-configuration launch-config
--load-balancer-names myELB
--min-size 1
--max-size 5
Auto Scaling
policy
Parameters for performing an
Auto Scaling action
Scale in/out and by how much
aws autoscaling put-scaling-policy
--auto-scaling-group-name autoscaling-group
--policy-name autoscaling-policy
--min-adjustment-magnitude=2
--adjustment-type ChangeInCapacity
--cooldown 300

45. A monitoring service for AWS cloud resources and
the applications that you run on AWS.
Use Amazon CloudWatch to collect and track
metrics, collect and monitor log files,
and set alarms.
Amazon CloudWatch

46. Monitoring Scripts for EC2 Instances

47. Monitor applications and systems using log data
Store in a highly durable storage and set retention
Access your log files via Web, CLI, or SDK
Amazon CloudWatch Logs

48. AWS
Resource
Your
Custom
Data
Metric Alarm Action
CloudWatch
CloudWatch Metrics & Alarms

49. AWS
Resource
Your
Custom
Data
Metric Alarm Action
CloudWatch
FilterLogs
CloudWatch Logs + Filter

50. Action
Notification
(SNS)
Auto Scaling
action
EC2 action
Recover
Stop
Terminate
Amazon EC2
Auto Recovery
Use this action
together with
status checks
to automate
instance recovery
Alarm Actions

51. Spot for Interruptible Workloads and Best Pricing
Best Spot use cases include any batch-oriented, fault-tolerant application

52. Use Dedicated Hosts to enable BYOL
Host ID = h-123abc
Sockets = 2
Physical Cores = 20
• Granular resource and placement controls
• Dedicated Host allocation
• Granular instance placement
• Instance-host affinity
• Visibility into physical resources
• Physical core and socket counts
• Capacity utilization
• Instance location

53. Dedicated Host Configurations
A C4 Dedicated Host provides capacity for 8, c4.xlarge
instances. Every C4 Dedicated Host is supported by 2
sockets and 20 physical cores.
Dedicated Host Attributes # of Instances Per Host by Instance Size
Instance
Family Sockets
Physical
Cores medium large xlarge 2xlarge 4xlarge 8xlarge 10xlarge
c3 2 20 - 16 8 4 2 1 -
c4 2 20 - 16 8 4 2 1 -
g2 2 20 - - - 4 - 1 -
m3 2 20 32 16 8 4 - - -
d2 2 24 - - 8 4 2 1 -
r3 2 20 - 16 8 4 2 1 -
m4 2 24 - 22 11 5 2 - 1
i2 2 20 - - 8 4 2 1 -

54. On-Demand
Pay for compute
capacity by the
hour with no long-
term commitments
For spiky
workloads, or to
define needs
Reserved
Make a low, one-
time payment and
receive a
significant discount
on the hourly
charge
For committed
utilization
Spot
Bid for unused
capacity, charged at
a Spot Price which
fluctuates based on
supply and demand
For time-insensitive
or transient
workloads
Dedicated
Launch instances
within a VPC that run
on hardware
dedicated to a single
customer
For BYOL and highly
sensitive/regulated
workloads
Use a Purchasing Option Mix

55. Fast Deployments
Access computing
infrastructure in minutes
Low Cost
Pay-as-you-go pricing
Elastic
Easily add or remove capacity
Globally Accessible
Easily support customers
around the world
Secure
A collection of tools to
protect data and privacy
Scalable
Access to effectively
limitless capacity

56. http://aws.amazon.com/getting-started/
Just get started - for free! (AWS Console)

57. Use the AWS Marketplace
Browse, search, discover,
and launch thousand of AWS
Marketplace Amazon
Machine Images (AMIs)
directly from within the
Amazon EC2 console
2,700+ products listed in 35
categories
software listings from more
than 925 ISVs

58. Getting Started with Amazon EC2:
http://aws.amazon.com/ec2/getting-started/
Auto Scaling Getting Started Tutorial:
http://docs.aws.amazon.com/AutoScaling/latest/DeveloperGuide/GettingStartedTutorial.html
Additional Resources and further Learning

59. Certification
aws.amazon.com/certification
Self-Paced Labs
aws.amazon.com/training/
self-paced-labs
Try products, gain new skills,
and get hands-on practice
working with AWS technologies
aws.amazon.com/training
Training
Validate your proven skills and
expertise with the AWS platform
Build technical expertise to
design and operate scalable,
efficient applications on AWS
AWS Training & Certification

60. Thank you!