Have you struggled to get the best performance out of Amazon EFS? Do you think more can be done to best leverage this massively parallel storage platform? Amazon EFS is a highly available, highly durable, shared file system built on the core tenets of simplicity, scalability, and elasticity. Its distributed data storage design allows you to achieve high levels of performance using the industry standard NFSv4 protocol.  This provides new and existing applications the ability to achieve high levels of throughput while sharing file data across multiple Amazon EC2 instances and on-premises servers. In this session, you’ll hear how to best take advantage of this distributed data storage design by parallelizing access to your file system, scaling out to use multiple clients, and much, much more. You’ll also learn about the different performance and throughput modes and when to use one versus the other. Be prepared to power up your laptop to follow along with the live demos and hands-on tutorials.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Maximizing Throughput & Performance on
Amazon Elastic File System
Darryl Osborne
Solutions Architect
Amazon EFS
S T G 4 0 6

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
AWS storage overview
Introducing Amazon EFS
Workshop overview
Wrap-up and Q&A

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Portfolio breadth and depth
Amazon
EBS
Amazon
EFS
AWS Storage
Gateway
Family
Amazon
S3

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
More choice for more applications
Object storage
S3 Standard
S3 Glacier Deep Archive
S3 Glacier
S3 Intelligent-Tiering
S3 One Zone-IA
S3 Standard-IA
Block storage
Provisioned IOPS SSD
Cold HDD
Throughput-Optimized
HDD
NEW!
COMING
SOON!
File storage
EFS Standard
EFS Infrequent Access
COMING
SOON!
Elastic
Amazon EBS
Amazon
EFS
AWS Storage
Gateway Family
Amazon S3
NEW!
Amazon FSx for
Lustre
Amazon FSx for
Windows File Server

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
More options for data transfer
AWS
Direct Connect
Amazon
Kinesis
Firehose
AWS
Snowball
AWS
Snowmobile
AWS
Storage
Gateway
Amazon S3
Transfer
Acceleration
AWS
DataSync
AWS
Transfer
for SFTP
AWS
Snowball Edge
Storage Optimized
Amazon Kinesis
Data Streams
Amazon Kinesis
Video Streams
NEW!
AWS
Snowball Edge
Compute
Optimized
NEW! NEW!

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What do network file systems provide?
Allows multiple users, computers, and applications to access the
same set of files
Files and directories appear and work just as they would
on local storage
Provides high levels of throughput and IOPS (to serve multiple users,
computers, and applications) while providing near-local latencies
Works natively with existing applications and IT environments

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Key benefits of Amazon EFS
Simple

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Key benefits of Amazon EFS
ElasticSimple

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Key benefits of Amazon EFS
ElasticSimple Scalable

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Key benefits of Amazon EFS
ElasticSimple Scalable
Highly available and durable

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Key benefits of Amazon EFS
ElasticSimple Scalable
Highly available and durable

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
PERFORMANCE
Amazon Elastic file system
Scalable, elastic, cloud-native Linux file system
SHARED ACCESS HIGHLY AVAILABLE
AND DURABLE
ELASTIC AND
SCALABLE
SECURE AND
COMPLIANT
STORAGE
CLASSES

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Elastic file system
Performance modes
General purpose
Max I/O
Throughput modes
Bursting
Provisioned
Storage classes
Standard
Infrequent access
Lifecycle management
Moves files over 30 days
85% cost savings
Scalable, elastic, cloud-native Linux file system
PERFORMANCE STORAGE CLASSES

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Performance modes
General purpose
(default)
Recommended for the
majority of workloads
Max I/O
Recommended for
scale out workloads

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Performance modes
General purpose
(default)
Recommended for the
majority of workloads
Max I/O
Recommended for
scale out workloads
What it is for
Latency-sensitive applications
and general-purpose workloads
Large-scale and
data-heavy applications
Advantages
Lowest latencies
for file operations
Virtually unlimited ability to
scale out throughput/IOPS
Trade-offs
Limit of 7k ops/sec Slightly higher latencies
When to use
Best choice for most
workloads
Consider for large
scale-out workloads

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Throughput modes
Bursting throughput
(default)
Recommended for the
majority of workloads
Provisioned
throughput
Recommended for higher
throughput to storage
ratio workloads

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Throughput modes
Bursting throughput
(default)
Recommended for the
majority of workloads
Provisioned
throughput
Recommended for higher
throughput to storage
ratio workloads
What it is for
Advantages
Auto-scaling throughput User-defined throughput
Trade-offs
Fixed throughput to
storage ratio
Separate
throughput charge
When to use
Best choice for most
workloads
Ingest or higher throughput
to storage ratio
Varying throughput
workloads
Higher-consistent
throughput workloads

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EFS 2018 year in review
March
• US West (N.
California)
April
• Encryption of
data in transit
May
• Asia Pacific
(Seoul)
• HIPAA
• GDPR
July
• Asia Pacific (Tokyo)
• Provisioned Throughput
• PCI-DSS
August
• Asia Pacific
(Singapore)
October
• Access EFS over AWS
VPN
November
• 512 Locks per file (was 87)
• Multi-VPC access
• 1000 file systems per
account (was 125)
re:Invent
2017
Today
NEW!
NEW!

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Workshop
https://github.com/aws-samples/amazon-efs-workshop
1. Prerequisites
2. Create
3. Monitor
4. Performance
5. Accessible
6. Scale-out
7. Tear-down

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

25. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Darryl Osborne
Solutions Architect
Amazon EFS

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.