SlideShare a Scribd company logo
What to know about Amazon
Elastic Block Store (EBS)
About me
● 13+ years of professional experience in System and 9+ years in Cloud
Computing architecting and administration (jacek.biernat@lcloud.pl)
● AWS Certifications:
○ AWS Certified Solutions Architect from 2013 (Professional from 2016)
○ AWS Certified SysOps Administrator from 2014
● Founder and CEO at LCloud, ex. Linxsys
○ AWS Partner from 2012 (Advanced Partner from 2016) in Poland
○ We are after 200+ AWS projects
Storage service
Block File
Object
Storage service
Block File
Object
Amazon Elastic Block Store Amazon Elastic File System Amazon Simple Storage
Service
Amazon Glacier
Block storage offering
EC2 instance
store
AWS block
storage
Amazon EC2 instance store
Non-persistent data store
Data not replicated
No snapshot support
SSD or HDD
What is EBS?
Ec2 instance
!=
EBS volume
What is EBS?
Ec2 instance
- Create, attach volumes through an
API
- Block storage as a service over the
network
EBS volume - EBS encryption is supported
What is EBS?
- EBS is independent of Ec2
- Detach and attach between Ec2
- EBS and Ec2 must be in the
same AZ
What is EBS?
- EBS attach to one Ec2 at a time
- Many EBS can attach to one Ec2
- Separate boot volume
What is EBS?
Ec2 instance
EBS volume
What is EBS?
- SLA EBS is 99.999%
-
AFR (annual failure rate) is 0.1%
- 0.2%
What is EBS snapshot?
- SLA S3 is 99.999999999%
-
No specific AZ
- Backup of modified volume blocks
- Next snapshots are incremental
What can we do with a snapshot?
- Create AMI from snapshot
-
Create new size EBS from snapshot
What can we do with a snapshot?
What is an EBS-optimized instance?
~125 MB/s
Ec2
Internet
What is an EBS-optimized instance?
~125 MB/s
Ec2
Internet
~125 MB/s
EBS
- Default for c4, d2, m4, p2, x1 Ec2 instances
- Some 8xlarge Ec2 have 10 Gbps network bandwidth and don’t
Block storage offering
EC2 instance
store
AWS block EBS HDD-backed magnetic
storage volume
Block storage offering
EC2 instance
store
AWS block EBS HDD-backed magnetic
storage volume
EBS SSD-backed
gp2 io1
Block storage offering
EC2 instance
store
AWS block EBS HDD-backed magnetic st1
sc1
storage volume
EBS SSD-backed
gp2 io1
EBS volume types
Magnetic General Purpose Provisioned IOPS Throughput Optimized Cold HDD (sc1)
SSD (gp2) SSD (io1) HDD (st1)
1GB - 1TB 1GB - 16TB 4GB - 16TB 500GB - 16TB 500GB-16TB
Av. 100 IOPS 3 IOPS @ GB Max. 20,000 IOPS Max. 500 IOPS Max. 250 IOPS
Max. 10,000 IOPS
Av. 65 MB/s Max. 160 MB/s Max. 320 MB/s 40 MB/s @ TB 12 MB/s @ TB
Max. 500 MB/s Max. 192 MB/s
Burst: - Burst: 3,000 IOPS (1TB) Burst: - Burst: 250 MB/s @ TB Burst:
80MB/s @ TB
gp2 - burst performance
gp2- how long can I burst?
Max I/O credit is 5.4 million I/O credits, accumulating 3 IOPS per GB per second
Io1 - performance
st1 - throughput
Burst to 125-500MB/s
per TB,
Accumulating 40 MB per TB
per second,
sc1 - throughput
Burst to 80MB/s per TB,
Accumulating 12 MB per TB
per second,
EBS volume types
Magnetic - data is infrequently accessed
General Purpose SSD (gp2) - boot volumes, low-latency applications, bursty database, Development
and test environments
Provisioned IOPS SSD (io1) - critical applications and large databases with sustained IOPS
Throughput Optimized HDD (st1) - large-block, high-throughput sequential workloads (streaming),
Big Data, Data warehouses, Log processing
Cold HDD (sc1) - sequential throughput workloads, such as logging and backup
Choosing an EBS volume type
When to RAID?
- Storage requirement > 16TB
- Throughput requirement > 500 MB/s
- IOPS requirement > 20,000 @ 16K
Avoid RAID for redundancy
- EBS data is already replicated
- RAID1 halves available EBS bandwidth
- RAID5/6 loses 20% - 30% of usable I/O
Thank you for your
attention.

More Related Content

What's hot

Microsoft Azure Media Services
Microsoft Azure Media ServicesMicrosoft Azure Media Services
Microsoft Azure Media Services
Pavel Revenkov
 
sinsai.infoの裏側(インフラ偏)
sinsai.infoの裏側(インフラ偏)sinsai.infoの裏側(インフラ偏)
sinsai.infoの裏側(インフラ偏)
Michael H. Oshita
 
WIndows Azure Virtual Machines - deep dive session
WIndows Azure Virtual Machines - deep dive sessionWIndows Azure Virtual Machines - deep dive session
WIndows Azure Virtual Machines - deep dive session
Microsoft
 
Redis overview for Software Architecture Forum
Redis overview for Software Architecture ForumRedis overview for Software Architecture Forum
Redis overview for Software Architecture Forum
Christopher Spring
 
Understanding and tuning WiredTiger, the new high performance database engine...
Understanding and tuning WiredTiger, the new high performance database engine...Understanding and tuning WiredTiger, the new high performance database engine...
Understanding and tuning WiredTiger, the new high performance database engine...
Ontico
 
Webinar Back to Basics 3 - Introduzione ai Replica Set
Webinar Back to Basics 3 - Introduzione ai Replica SetWebinar Back to Basics 3 - Introduzione ai Replica Set
Webinar Back to Basics 3 - Introduzione ai Replica Set
MongoDB
 
A Brief Introduction to Redis
A Brief Introduction to RedisA Brief Introduction to Redis
A Brief Introduction to Redis
Charles Anderson
 
MongoDB London PHP
MongoDB London PHPMongoDB London PHP
MongoDB London PHP
Mike Dirolf
 
Introduction to Redis
Introduction to RedisIntroduction to Redis
Introduction to Redis
Maarten Smeets
 
Backup, Restore, and Disaster Recovery
Backup, Restore, and Disaster RecoveryBackup, Restore, and Disaster Recovery
Backup, Restore, and Disaster RecoveryMongoDB
 
Mongo db in 3 minutes BoilerMake
Mongo db in 3 minutes   BoilerMakeMongo db in 3 minutes   BoilerMake
Mongo db in 3 minutes BoilerMakeValeri Karpov
 
Fusion-io and MySQL at Craigslist
Fusion-io and MySQL at CraigslistFusion-io and MySQL at Craigslist
Fusion-io and MySQL at Craigslist
Jeremy Zawodny
 
Azure ad multipleforest-pdf
Azure ad multipleforest-pdfAzure ad multipleforest-pdf
Azure ad multipleforest-pdf
Suman Singh
 
MySQL And Search At Craigslist
MySQL And Search At CraigslistMySQL And Search At Craigslist
MySQL And Search At Craigslist
Jeremy Zawodny
 
Cache is King!
Cache is King!Cache is King!
Cache is King!
David Engel
 
Caching solutions with Redis
Caching solutions   with RedisCaching solutions   with Redis
Caching solutions with Redis
George Platon
 
MongoDB
MongoDBMongoDB
MongoFr : MongoDB as a log Collector
MongoFr : MongoDB as a log CollectorMongoFr : MongoDB as a log Collector
MongoFr : MongoDB as a log Collector
Pierre Baillet
 
Introduction to Redis
Introduction to RedisIntroduction to Redis
Introduction to Redis
Arnab Mitra
 

What's hot (20)

Microsoft Azure Media Services
Microsoft Azure Media ServicesMicrosoft Azure Media Services
Microsoft Azure Media Services
 
sinsai.infoの裏側(インフラ偏)
sinsai.infoの裏側(インフラ偏)sinsai.infoの裏側(インフラ偏)
sinsai.infoの裏側(インフラ偏)
 
WIndows Azure Virtual Machines - deep dive session
WIndows Azure Virtual Machines - deep dive sessionWIndows Azure Virtual Machines - deep dive session
WIndows Azure Virtual Machines - deep dive session
 
Redis overview for Software Architecture Forum
Redis overview for Software Architecture ForumRedis overview for Software Architecture Forum
Redis overview for Software Architecture Forum
 
Understanding and tuning WiredTiger, the new high performance database engine...
Understanding and tuning WiredTiger, the new high performance database engine...Understanding and tuning WiredTiger, the new high performance database engine...
Understanding and tuning WiredTiger, the new high performance database engine...
 
MongoDB tuning on AWS
MongoDB tuning on AWSMongoDB tuning on AWS
MongoDB tuning on AWS
 
Webinar Back to Basics 3 - Introduzione ai Replica Set
Webinar Back to Basics 3 - Introduzione ai Replica SetWebinar Back to Basics 3 - Introduzione ai Replica Set
Webinar Back to Basics 3 - Introduzione ai Replica Set
 
A Brief Introduction to Redis
A Brief Introduction to RedisA Brief Introduction to Redis
A Brief Introduction to Redis
 
MongoDB London PHP
MongoDB London PHPMongoDB London PHP
MongoDB London PHP
 
Introduction to Redis
Introduction to RedisIntroduction to Redis
Introduction to Redis
 
Backup, Restore, and Disaster Recovery
Backup, Restore, and Disaster RecoveryBackup, Restore, and Disaster Recovery
Backup, Restore, and Disaster Recovery
 
Mongo db in 3 minutes BoilerMake
Mongo db in 3 minutes   BoilerMakeMongo db in 3 minutes   BoilerMake
Mongo db in 3 minutes BoilerMake
 
Fusion-io and MySQL at Craigslist
Fusion-io and MySQL at CraigslistFusion-io and MySQL at Craigslist
Fusion-io and MySQL at Craigslist
 
Azure ad multipleforest-pdf
Azure ad multipleforest-pdfAzure ad multipleforest-pdf
Azure ad multipleforest-pdf
 
MySQL And Search At Craigslist
MySQL And Search At CraigslistMySQL And Search At Craigslist
MySQL And Search At Craigslist
 
Cache is King!
Cache is King!Cache is King!
Cache is King!
 
Caching solutions with Redis
Caching solutions   with RedisCaching solutions   with Redis
Caching solutions with Redis
 
MongoDB
MongoDBMongoDB
MongoDB
 
MongoFr : MongoDB as a log Collector
MongoFr : MongoDB as a log CollectorMongoFr : MongoDB as a log Collector
MongoFr : MongoDB as a log Collector
 
Introduction to Redis
Introduction to RedisIntroduction to Redis
Introduction to Redis
 

Similar to What to know about Amazon Elastic Block Store (EBS)

AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)
AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)
AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)
Amazon Web Services
 
Aws Elastic Block Storage
Aws Elastic Block StorageAws Elastic Block Storage
Aws Elastic Block Storage
Dhananjay Aloorkar
 
AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법
AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법
AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법
Amazon Web Services Korea
 
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
Amazon Web Services
 
Deep Dive on Amazon Elastic Block Store
Deep Dive on Amazon Elastic Block StoreDeep Dive on Amazon Elastic Block Store
Deep Dive on Amazon Elastic Block Store
Amazon Web Services
 
Deep Dive on Amazon Elastic Block Store
Deep Dive on Amazon Elastic Block StoreDeep Dive on Amazon Elastic Block Store
Deep Dive on Amazon Elastic Block Store
Amazon Web Services
 
Deep Dive on Amazon Elastic Block Store
Deep Dive on Amazon Elastic Block StoreDeep Dive on Amazon Elastic Block Store
Deep Dive on Amazon Elastic Block Store
Amazon Web Services
 
Maximizing EC2 and Elastic Block Store Disk Performance
Maximizing EC2 and Elastic Block Store Disk PerformanceMaximizing EC2 and Elastic Block Store Disk Performance
Maximizing EC2 and Elastic Block Store Disk Performance
Amazon Web Services
 
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
Amazon Web Services
 
Maximizing Amazon EC2 and Amazon EBS performance
Maximizing Amazon EC2 and Amazon EBS performanceMaximizing Amazon EC2 and Amazon EBS performance
Maximizing Amazon EC2 and Amazon EBS performance
Amazon Web Services
 
Overview and Best Practices for Amazon Elastic Block Store - September 2016 W...
Overview and Best Practices for Amazon Elastic Block Store - September 2016 W...Overview and Best Practices for Amazon Elastic Block Store - September 2016 W...
Overview and Best Practices for Amazon Elastic Block Store - September 2016 W...
Amazon Web Services
 
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
Amazon Web Services
 
(STG403) Amazon EBS: Designing for Performance
(STG403) Amazon EBS: Designing for Performance(STG403) Amazon EBS: Designing for Performance
(STG403) Amazon EBS: Designing for Performance
Amazon Web Services
 
Maximizing EC2 and Elastic Block Store Disk Performance (STG302) | AWS re:Inv...
Maximizing EC2 and Elastic Block Store Disk Performance (STG302) | AWS re:Inv...Maximizing EC2 and Elastic Block Store Disk Performance (STG302) | AWS re:Inv...
Maximizing EC2 and Elastic Block Store Disk Performance (STG302) | AWS re:Inv...
Amazon Web Services
 
(SDD416) Amazon EBS Deep Dive | AWS re:Invent 2014
(SDD416) Amazon EBS Deep Dive | AWS re:Invent 2014(SDD416) Amazon EBS Deep Dive | AWS re:Invent 2014
(SDD416) Amazon EBS Deep Dive | AWS re:Invent 2014
Amazon Web Services
 
Deep Dive - Maximising EC2 & EBS Performance
Deep Dive - Maximising EC2 & EBS PerformanceDeep Dive - Maximising EC2 & EBS Performance
Deep Dive - Maximising EC2 & EBS Performance
Amazon Web Services
 
Deep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store Performance
Deep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store PerformanceDeep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store Performance
Deep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store Performance
Amazon Web Services
 
Deep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store Performance
Deep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store PerformanceDeep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store Performance
Deep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store Performance
Amazon Web Services
 
Deep Dive: Maximizing EC2 and EBS Performance
Deep Dive: Maximizing EC2 and EBS PerformanceDeep Dive: Maximizing EC2 and EBS Performance
Deep Dive: Maximizing EC2 and EBS Performance
Amazon Web Services
 
AWS vs Azure vs Google Cloud Storage Deep Dive
AWS vs Azure vs Google Cloud Storage Deep DiveAWS vs Azure vs Google Cloud Storage Deep Dive
AWS vs Azure vs Google Cloud Storage Deep Dive
RightScale
 

Similar to What to know about Amazon Elastic Block Store (EBS) (20)

AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)
AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)
AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)
 
Aws Elastic Block Storage
Aws Elastic Block StorageAws Elastic Block Storage
Aws Elastic Block Storage
 
AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법
AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법
AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법
 
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
 
Deep Dive on Amazon Elastic Block Store
Deep Dive on Amazon Elastic Block StoreDeep Dive on Amazon Elastic Block Store
Deep Dive on Amazon Elastic Block Store
 
Deep Dive on Amazon Elastic Block Store
Deep Dive on Amazon Elastic Block StoreDeep Dive on Amazon Elastic Block Store
Deep Dive on Amazon Elastic Block Store
 
Deep Dive on Amazon Elastic Block Store
Deep Dive on Amazon Elastic Block StoreDeep Dive on Amazon Elastic Block Store
Deep Dive on Amazon Elastic Block Store
 
Maximizing EC2 and Elastic Block Store Disk Performance
Maximizing EC2 and Elastic Block Store Disk PerformanceMaximizing EC2 and Elastic Block Store Disk Performance
Maximizing EC2 and Elastic Block Store Disk Performance
 
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
 
Maximizing Amazon EC2 and Amazon EBS performance
Maximizing Amazon EC2 and Amazon EBS performanceMaximizing Amazon EC2 and Amazon EBS performance
Maximizing Amazon EC2 and Amazon EBS performance
 
Overview and Best Practices for Amazon Elastic Block Store - September 2016 W...
Overview and Best Practices for Amazon Elastic Block Store - September 2016 W...Overview and Best Practices for Amazon Elastic Block Store - September 2016 W...
Overview and Best Practices for Amazon Elastic Block Store - September 2016 W...
 
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
SRV413 Deep Dive on Elastic Block Storage (Amazon EBS)
 
(STG403) Amazon EBS: Designing for Performance
(STG403) Amazon EBS: Designing for Performance(STG403) Amazon EBS: Designing for Performance
(STG403) Amazon EBS: Designing for Performance
 
Maximizing EC2 and Elastic Block Store Disk Performance (STG302) | AWS re:Inv...
Maximizing EC2 and Elastic Block Store Disk Performance (STG302) | AWS re:Inv...Maximizing EC2 and Elastic Block Store Disk Performance (STG302) | AWS re:Inv...
Maximizing EC2 and Elastic Block Store Disk Performance (STG302) | AWS re:Inv...
 
(SDD416) Amazon EBS Deep Dive | AWS re:Invent 2014
(SDD416) Amazon EBS Deep Dive | AWS re:Invent 2014(SDD416) Amazon EBS Deep Dive | AWS re:Invent 2014
(SDD416) Amazon EBS Deep Dive | AWS re:Invent 2014
 
Deep Dive - Maximising EC2 & EBS Performance
Deep Dive - Maximising EC2 & EBS PerformanceDeep Dive - Maximising EC2 & EBS Performance
Deep Dive - Maximising EC2 & EBS Performance
 
Deep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store Performance
Deep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store PerformanceDeep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store Performance
Deep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store Performance
 
Deep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store Performance
Deep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store PerformanceDeep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store Performance
Deep Dive: Maximizing Amazon EC2 and Amazon Elastic Block Store Performance
 
Deep Dive: Maximizing EC2 and EBS Performance
Deep Dive: Maximizing EC2 and EBS PerformanceDeep Dive: Maximizing EC2 and EBS Performance
Deep Dive: Maximizing EC2 and EBS Performance
 
AWS vs Azure vs Google Cloud Storage Deep Dive
AWS vs Azure vs Google Cloud Storage Deep DiveAWS vs Azure vs Google Cloud Storage Deep Dive
AWS vs Azure vs Google Cloud Storage Deep Dive
 

More from LCloud

Well architected tool - Serverless and Machine Learning Lens
Well architected tool - Serverless and Machine Learning LensWell architected tool - Serverless and Machine Learning Lens
Well architected tool - Serverless and Machine Learning Lens
LCloud
 
3 ways to efficiently migrate your big data to AWS cloud | LCloud
3 ways to efficiently migrate your big data to AWS cloud | LCloud3 ways to efficiently migrate your big data to AWS cloud | LCloud
3 ways to efficiently migrate your big data to AWS cloud | LCloud
LCloud
 
On a trail with Amazon Detective | LCloud
On a trail with Amazon Detective | LCloudOn a trail with Amazon Detective | LCloud
On a trail with Amazon Detective | LCloud
LCloud
 
"Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,...
"Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,..."Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,...
"Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,...
LCloud
 
"Building a Production-Grade Serverless Deployment" - Eoin Shanaghy, CTO, fo...
"Building a Production-Grade Serverless Deployment"  - Eoin Shanaghy, CTO, fo..."Building a Production-Grade Serverless Deployment"  - Eoin Shanaghy, CTO, fo...
"Building a Production-Grade Serverless Deployment" - Eoin Shanaghy, CTO, fo...
LCloud
 
Amazon Aurora MySQL - tips & tricks in configuration | LCloud
Amazon Aurora MySQL - tips & tricks in configuration | LCloudAmazon Aurora MySQL - tips & tricks in configuration | LCloud
Amazon Aurora MySQL - tips & tricks in configuration | LCloud
LCloud
 
AWS Landing Zone Essentials PL | LCloud
AWS Landing Zone Essentials PL | LCloudAWS Landing Zone Essentials PL | LCloud
AWS Landing Zone Essentials PL | LCloud
LCloud
 
Security management using devops | LCloud
Security management using devops | LCloudSecurity management using devops | LCloud
Security management using devops | LCloud
LCloud
 
Amazon Neptune - visually more options
Amazon Neptune - visually more optionsAmazon Neptune - visually more options
Amazon Neptune - visually more options
LCloud
 
How to use AWS practices to provide the enterprise architecture in the cloud
How to use AWS practices to provide the enterprise architecture in the cloudHow to use AWS practices to provide the enterprise architecture in the cloud
How to use AWS practices to provide the enterprise architecture in the cloud
LCloud
 
Overview of Amazon Web Services - kwiecień 2017
Overview of Amazon Web Services - kwiecień 2017Overview of Amazon Web Services - kwiecień 2017
Overview of Amazon Web Services - kwiecień 2017
LCloud
 
Good practices to design and implement IT architecture based on AWS
Good practices to design and implement IT architecture based on AWSGood practices to design and implement IT architecture based on AWS
Good practices to design and implement IT architecture based on AWS
LCloud
 
Lcloud na AWS re: Invent 2016 w Las Vegas
Lcloud na AWS re: Invent 2016 w Las Vegas Lcloud na AWS re: Invent 2016 w Las Vegas
Lcloud na AWS re: Invent 2016 w Las Vegas
LCloud
 

More from LCloud (13)

Well architected tool - Serverless and Machine Learning Lens
Well architected tool - Serverless and Machine Learning LensWell architected tool - Serverless and Machine Learning Lens
Well architected tool - Serverless and Machine Learning Lens
 
3 ways to efficiently migrate your big data to AWS cloud | LCloud
3 ways to efficiently migrate your big data to AWS cloud | LCloud3 ways to efficiently migrate your big data to AWS cloud | LCloud
3 ways to efficiently migrate your big data to AWS cloud | LCloud
 
On a trail with Amazon Detective | LCloud
On a trail with Amazon Detective | LCloudOn a trail with Amazon Detective | LCloud
On a trail with Amazon Detective | LCloud
 
"Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,...
"Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,..."Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,...
"Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,...
 
"Building a Production-Grade Serverless Deployment" - Eoin Shanaghy, CTO, fo...
"Building a Production-Grade Serverless Deployment"  - Eoin Shanaghy, CTO, fo..."Building a Production-Grade Serverless Deployment"  - Eoin Shanaghy, CTO, fo...
"Building a Production-Grade Serverless Deployment" - Eoin Shanaghy, CTO, fo...
 
Amazon Aurora MySQL - tips & tricks in configuration | LCloud
Amazon Aurora MySQL - tips & tricks in configuration | LCloudAmazon Aurora MySQL - tips & tricks in configuration | LCloud
Amazon Aurora MySQL - tips & tricks in configuration | LCloud
 
AWS Landing Zone Essentials PL | LCloud
AWS Landing Zone Essentials PL | LCloudAWS Landing Zone Essentials PL | LCloud
AWS Landing Zone Essentials PL | LCloud
 
Security management using devops | LCloud
Security management using devops | LCloudSecurity management using devops | LCloud
Security management using devops | LCloud
 
Amazon Neptune - visually more options
Amazon Neptune - visually more optionsAmazon Neptune - visually more options
Amazon Neptune - visually more options
 
How to use AWS practices to provide the enterprise architecture in the cloud
How to use AWS practices to provide the enterprise architecture in the cloudHow to use AWS practices to provide the enterprise architecture in the cloud
How to use AWS practices to provide the enterprise architecture in the cloud
 
Overview of Amazon Web Services - kwiecień 2017
Overview of Amazon Web Services - kwiecień 2017Overview of Amazon Web Services - kwiecień 2017
Overview of Amazon Web Services - kwiecień 2017
 
Good practices to design and implement IT architecture based on AWS
Good practices to design and implement IT architecture based on AWSGood practices to design and implement IT architecture based on AWS
Good practices to design and implement IT architecture based on AWS
 
Lcloud na AWS re: Invent 2016 w Las Vegas
Lcloud na AWS re: Invent 2016 w Las Vegas Lcloud na AWS re: Invent 2016 w Las Vegas
Lcloud na AWS re: Invent 2016 w Las Vegas
 

Recently uploaded

Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neo4j
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
nkrafacyberclub
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
RinaMondal9
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
Peter Spielvogel
 
GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...
ThomasParaiso2
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Neo4j
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 

Recently uploaded (20)

Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
 
GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 

What to know about Amazon Elastic Block Store (EBS)

  • 1. What to know about Amazon Elastic Block Store (EBS)
  • 2. About me ● 13+ years of professional experience in System and 9+ years in Cloud Computing architecting and administration (jacek.biernat@lcloud.pl) ● AWS Certifications: ○ AWS Certified Solutions Architect from 2013 (Professional from 2016) ○ AWS Certified SysOps Administrator from 2014 ● Founder and CEO at LCloud, ex. Linxsys ○ AWS Partner from 2012 (Advanced Partner from 2016) in Poland ○ We are after 200+ AWS projects
  • 4. Storage service Block File Object Amazon Elastic Block Store Amazon Elastic File System Amazon Simple Storage Service Amazon Glacier
  • 5. Block storage offering EC2 instance store AWS block storage
  • 6. Amazon EC2 instance store Non-persistent data store Data not replicated No snapshot support SSD or HDD
  • 7. What is EBS? Ec2 instance != EBS volume
  • 8. What is EBS? Ec2 instance - Create, attach volumes through an API - Block storage as a service over the network EBS volume - EBS encryption is supported
  • 9. What is EBS? - EBS is independent of Ec2 - Detach and attach between Ec2 - EBS and Ec2 must be in the same AZ
  • 10. What is EBS? - EBS attach to one Ec2 at a time - Many EBS can attach to one Ec2 - Separate boot volume
  • 11. What is EBS? Ec2 instance EBS volume
  • 12. What is EBS? - SLA EBS is 99.999% - AFR (annual failure rate) is 0.1% - 0.2%
  • 13. What is EBS snapshot? - SLA S3 is 99.999999999% - No specific AZ - Backup of modified volume blocks - Next snapshots are incremental
  • 14. What can we do with a snapshot? - Create AMI from snapshot - Create new size EBS from snapshot
  • 15. What can we do with a snapshot?
  • 16. What is an EBS-optimized instance? ~125 MB/s Ec2 Internet
  • 17. What is an EBS-optimized instance? ~125 MB/s Ec2 Internet ~125 MB/s EBS - Default for c4, d2, m4, p2, x1 Ec2 instances - Some 8xlarge Ec2 have 10 Gbps network bandwidth and don’t
  • 18. Block storage offering EC2 instance store AWS block EBS HDD-backed magnetic storage volume
  • 19. Block storage offering EC2 instance store AWS block EBS HDD-backed magnetic storage volume EBS SSD-backed gp2 io1
  • 20. Block storage offering EC2 instance store AWS block EBS HDD-backed magnetic st1 sc1 storage volume EBS SSD-backed gp2 io1
  • 21. EBS volume types Magnetic General Purpose Provisioned IOPS Throughput Optimized Cold HDD (sc1) SSD (gp2) SSD (io1) HDD (st1) 1GB - 1TB 1GB - 16TB 4GB - 16TB 500GB - 16TB 500GB-16TB Av. 100 IOPS 3 IOPS @ GB Max. 20,000 IOPS Max. 500 IOPS Max. 250 IOPS Max. 10,000 IOPS Av. 65 MB/s Max. 160 MB/s Max. 320 MB/s 40 MB/s @ TB 12 MB/s @ TB Max. 500 MB/s Max. 192 MB/s Burst: - Burst: 3,000 IOPS (1TB) Burst: - Burst: 250 MB/s @ TB Burst: 80MB/s @ TB
  • 22. gp2 - burst performance
  • 23. gp2- how long can I burst? Max I/O credit is 5.4 million I/O credits, accumulating 3 IOPS per GB per second
  • 25. st1 - throughput Burst to 125-500MB/s per TB, Accumulating 40 MB per TB per second,
  • 26. sc1 - throughput Burst to 80MB/s per TB, Accumulating 12 MB per TB per second,
  • 27. EBS volume types Magnetic - data is infrequently accessed General Purpose SSD (gp2) - boot volumes, low-latency applications, bursty database, Development and test environments Provisioned IOPS SSD (io1) - critical applications and large databases with sustained IOPS Throughput Optimized HDD (st1) - large-block, high-throughput sequential workloads (streaming), Big Data, Data warehouses, Log processing Cold HDD (sc1) - sequential throughput workloads, such as logging and backup
  • 28. Choosing an EBS volume type
  • 29. When to RAID? - Storage requirement > 16TB - Throughput requirement > 500 MB/s - IOPS requirement > 20,000 @ 16K
  • 30. Avoid RAID for redundancy - EBS data is already replicated - RAID1 halves available EBS bandwidth - RAID5/6 loses 20% - 30% of usable I/O
  • 31. Thank you for your attention.

Editor's Notes

  1. Everything from what makes up the service all the characteristics of it performance, best practices around reliability, security and performance durable, block-level storage device
  2. Everything from what makes up the service all the characteristics of it performance, best practices around reliability, security and performance durable, block-level storage device
  3. temporary block-level storage for your instance. This storage is located on disks that are physically attached to the host computer. Instance store is ideal for temporary storage of information that changes frequently, such as buffers, caches, scratch data.
  4. EBS volumes are highly available and reliable storage volumes that can be attached to any running instance that is in the same Availability Zone. EBS volumes that are attached to an EC2 instance are exposed as storage volumes that persist independently from the life of the instance. Attach both encrypted and unencrypted, support all EBS volume types, snapshots are encrypted, support currently generation instances
  5. Massive distributed system They are blocks that are distributed across many physical devices
  6. annual failure rate - roczna stopa awaryjności, gives the estimated probability that a device or component will fail during a full year of use For enterprise architecture hard disk is about 4%, for 1000 EBS for 1 year, we can expect to lose 1-2 EBS,
  7. First snapshot copy every modified block on S3
  8. Volume the same size or bigger
  9. Another region or AWS account We can share snapshot private/public
  10. Throughput a network bandwidth
  11. Dedicated bandwitdth to EBS
  12. What is most important for you IOPS or throughput or we are not sure Io1 daje podwojne wartosci z gp2