Enterprises of all sizes have the persistent storage challenges of data access, growth, and protection. Buying more storage stacks prolongs the pain of managing the storage lifecycle, which includes purchasing, ongoing operation, hardware failure, system retirement, and migration, yet it keeps on-premises datasets siloed from cloud workloads. In this session, learn how to use AWS Storage Gateway to connect your on-premises applications to AWS storage services by using standard storage protocols. Storage Gateway enables hybrid cloud storage solutions for file sharing, data lakes, big data analytics, backup and disaster recovery, and migration. We discuss best practices and new deployment approaches.

1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Paul Reed, Principal Product Manager
Amazon Web Services
SRV302
Deep Dive: Using Hybrid Storage
with AWS Storage Gateway to Solve
On-Premises Storage Problems

2. Photo credit: Motel George, 2010

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
• Introduction to the AWS Storage Gateway family
• Tape Gateway
• Migrating tape archives to cloud
• Volume Gateway
• Stored and cached volumes
• Amazon EBS Snapshot creation and recoveries
• File Gateway
• How it works
• Hybrid cloud data processing workflows

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Data movement
OnlineOffline
Data security
and management
Complete Set of Data Building Blocks
Amazon
EFS
Amazon
EBS
AWS Snow family
AWS Storage
Gateway Family
AWS Direct Connect
Amazon EFS File Sync
Amazon S3
Transfer Acceleration
Storage Partners
Amazon Kinesis
Data Streams
Amazon Kinesis
Video Streams
Amazon
S3
Amazon
Glacier
AWS KMS
AWS IAM
Amazon CloudWatch
AWS CloudTrail
AWS CloudFormation
AWS Lambda
Amazon Macie
Amazon QuickSight

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Storage Gateway
• Seamlessly connect on-premises applications with AWS
• Leverages cloud storage scalability, reliability, durability, and economics
• Use cases span entire customer journey to the cloud
• Key benefits
• Integration with AWS storage, management, and monitoring
• No changes to existing applications
• Local cache for low-latency access to data stored in AWS
• Optimized data transfer

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Storage Gateway Hybrid Storage Solutions
Use standard storage protocols to access AWS storage
AWS Storage
Gateway
Amazon EBS
snapshots
Amazon S3 &
Amazon S3 Standard
- Infrequent Access
Amazon Glacier
AWS Identity and Access
Management (IAM)
Amazon
CloudWatch
Files
Volumes
Tapes On-premises
AWSCloud
AWS Key Management
Service (AWS KMS)
AWS
CloudTrail

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Enabling a Spectrum of Hybrid Use Cases
Backup | DR | Archive
Enterprise data centers
Amazon
EBS
Amazon
S3
Amazon
Glacier
App. serversFile servers
Research sites
AWS Storage Gateway
DevicesDatabasesMultimedia content
Analytics | File Services | Production Tiering | Data Processing
Data Distribution | Backup | DR | Archive | Migration
Amazon
EC2
AWS
Lambda
Amazon
CloudFront
Amazon
Athena
Amazon
EMR
Backup serversUsers
Remote offices Small to medium businesses

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
A Few of Our Customers

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Storage Gateway Amazon S3 Standard &
Infrequent Access
Files
(NFS v3 / v4)
Volumes
(iSCSI)
Tapes
(iSCSI VTL)
AWS Storage Gateway
Data stored in Amazon S3 with
• Native Amazon S3 management (file)
• Snapshots to EBS (volume)
• Archive to Amazon Glacier (tape)
Service uses an appliance to provide
• Protocol conversion and device emulation
• Caching (read-through / write-back)
• Optimized data transfer
HTTPS
Amazon
EC2
Amazon Glacier
Amazon EBS
snapshots

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What’s New for Storage Gateway
• 12 feature launches last year
• Available in all commercial regions
• HIPAA-eligible
• Tape Gateway
• Support for Commvault, Arcserve
• Improved performance (pre-fetch and
faster retrievals)
• Volume - Cloning for faster DR
• File Gateway - Refresh cache for multi-
site file sharing
2017This week
• Support for S3 – One Zone - IA
• Tape Gateway in APAC (Singapore)
• File Gateway CloudWatch Events for
Automation, Requester Pays Buckets …
• Tape Gateway support for EMC NetWorker v9
This year

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tape Gateway

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tape Gateway
• Easy cloud adoption: Virtual tape storage in S3 & Amazon Glacier accessed via gateway
• Secure & efficient: Data encrypted and compressed in transit and at rest
• Scalable: Unlimited archive capacity; up to 1 PB total tape storage per gateway
• Dependable: 3–5-hour tape retrieval from Amazon Glacier with 99.999999999% data durability
• Low-cost: Simple licensing, predictable storage costs, and reduced management time
Media changer
Virtual tapes
stored in
Amazon S3
Archived tapes in
Amazon Glacier
Backup
server
iSCSI
Tape
gateway
Tape Gateway Appliance (VM)
Tape drive
HTTPS
Customer Premises Region
Virtual tape storage in Amazon S3 and Amazon Glacier with VTL management
Local
cache

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Drop-in Replacement for Tape Backups
• Works with leading common backup applications
• Emulates a tape library
• Supports existing backup workflows

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Your Tape Archive Today
Backup
Server
Customer Premises
Tape
Library
Offsite Vault
Backup
Disk
Appliance

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Move Your Tape Archive
Media Changer
Virtual Tapes
stored in
Amazon S3
Archived Tapes
stored in
Amazon Glacier
iSCSI
Storage
Gateway
Service
Tape Gateway VM
Tape Drive
HTTPS
Region
Backup
Server
Customer Premises
Tape
Library
Offsite Vault
• Deploy Storage Gateway VTL as an archive target
• Old archives can expire, or be recalled and written to SGW
• Decommission Tape Library when all tapes are expired
Backup
Disk
Appliance

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cost Comparison, a Customer Example
Every month, 100 TB and 1 tape retrieval; 1-yr retention
$56.8K / year
AWS Storage
Gateway - VTL
Data written via Gateway
Data transfer out
and tape retrieval
On-premises tape
$34.5K / year
Virtual tapes archived
in Amazon Glacier
Admin time Admin time
Tape library
maintenance
Robotic tape library
Tape media costs
Off-site archive service

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway
• Cloud-backed block storage that can be presented on-premises
• Tier snapshots or whole volumes to the cloud to reduce SAN/NAS mgt.
• Flexible recoveries in-cloud or on-premises with snapshots and clones
• Common use cases: Tiered storage for Windows file servers, backup
and restore, disaster recovery, data migrations
Application
server
Amazon EBS
snapshots
Storage
Gateway
Service
Volume
Gateway
appliance
Volume
Stored in
Amazon S3
HTTPSiSCSI
Customer Premises Region

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Stored Mode
Using Stored Volumes, a full copy of the volume is stored on-premises and
in the cloud
Application
server
Amazon EBS
snapshots
Storage
Gateway
Service
Volume
Gateway
appliance
Volume
Stored in
Amazon S3
HTTPSiSCSI
Customer Premises Region
100% of volume stored
in AWS & on-premises

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Stored Mode
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Upload
bufferVolume
Volume
iSCSI
Application
server

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Stored Mode
Amazon EBS snapshots
SAN, DAS, or NAS (any storage
that can host a virtual disk)
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Upload
bufferVolume
Volume
iSCSI
Backed by Amazon S3
Application
server

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Stored Mode
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Upload
bufferVolume
Volume
iSCSI
On-premises writable copy of
volume and upload buffer
Cloud-backed
copy of volume
Application
server

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Stored Mode
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Upload
bufferVolume
Volume
iSCSI
Cloud based
monitoring
Application
server

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Stored Write Operations
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Upload
bufferVolume
Volume
iSCSI
Application
server

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Stored Write Operations
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Upload
bufferVolume
Volume
iSCSI
Client writes to local volume
Application
server

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Stored Write Operations
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Upload
bufferVolume
Volume
iSCSI
The write is copied to the upload
buffer
Application
server

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Stored Write Operations
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Upload
bufferVolume
Volume
iSCSI
Write is compressed and uploaded to the
S3-backed gateway service over HTTPS
Application
server

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Stored Read Operations
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Upload
bufferVolume
Volume
iSCSI
Application
server

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Stored Read Operations
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Upload
bufferVolume
Volume
iSCSI
100% of reads come directly from the local
volume for low latency
Application
server

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Cached Mode
Using Cached Volumes, a full copy of the volume is stored in AWS, and a
portion (hot data) is stored on-premises
Amazon EBS
snapshots
Storage
Gateway
Service
Volume
Stored in
Amazon S3
HTTPSiSCSI
Customer Premises Region
Volume Gateway VM
Application
server

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Cached Mode
Using Cached Volumes, a full copy of the volume is stored in AWS, and a
portion (hot data) is stored on-premises
Amazon EBS
snapshots
Storage
Gateway
Service
Volume
Stored in
Amazon S3
HTTPSiSCSI
Customer Premises Region
100% of volume stored
in AWS & on-premises
Volume Gateway VM
Virtual volume Cache frequent accessed
blocks (reduce onsite storage)
Application
server

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Cached Write Operations
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
Upload buffer
Volume
Cache
Volume
Application
server

33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Cached Write Operations
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
Upload buffer
Volume
Cache
Volume
Client sends the write to the gateway, which
first populates the local cache
Application
server

34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Cached Write Operations
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
Upload buffer
Volume
Cache
Volume
The write is copied to the upload buffer
Application
server

35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Cached Write Operations
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
Upload buffer
Volume
Cache
Volume
Write is compressed and uploaded to the
S3-backed gateway service over HTTPS
Application
server

36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Cached Read Operations
Amazon EBS snapshots
Application
server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
Upload buffer
Volume
Cache
Volume

37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Cached Read Operations
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
Upload buffer
Volume
Cache
Volume
If the block is cached locally, the read comes
directly from the gateway’s local cache
Application
server

38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Cached Read Operations
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
Upload buffer
Volume
Cache
volume
If the block is not cached locally, the gateway requests the
block from the gateway service & populates the local cache
Application
server

39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Cached Read Operations
Amazon EBS snapshots
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
Upload buffer
Volume
Cache
The gateway returns the read request using
the newly cached block
Volume
Application
server

40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway + Amazon EBS
Snapshots

41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Amazon EBS Snapshots
Snapshots are point-in-time backups of a volume
Created on-demand or on a configurable schedule
Can be used to create an Amazon EBS or Storage Gateway volume
Application
server Amazon EBS
snapshots
Storage
Gateway
Service
Volume
Gateway
appliance
Volume
Stored in
Amazon S3
HTTPSiSCSI
Customer Premises Region

42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Snapshot Creation
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Volume
iSCSI
Volume
A B
A
Amazon EBS snapshots
Application
server

43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Snapshot Creation
Amazon EBS snapshots
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Volume
iSCSI
Volume
A B
A
When a snapshot is created gateway flushes
any outstanding writes to the cloud
B
Application
server

44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
A B
Snapshot Creation
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Volume
iSCSI
Volume
A B
A B
All consumed blocks that make up the volume are
backed up to an Amazon EBS snapshot
Snap1
Application
server

45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Snapshot Creation
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Volume
iSCSI
Volume
A B
A B
C
C
New data continues to be written to
the volume
A B
Snap1
Application
server

46. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Snapshot Creation
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Volume
iSCSI
Volume
A B
A B
C
C
When another snapshot is created, only
incremental data is backed up
A B C
Snap1 Snap2
Application
server

47. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Snapshot Creation
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Volume
iSCSI
Volume
A B
A B
C
C
When another snapshot is created, only
incremental data is backed up
D
D
A B C
Snap1 Snap2
Application
server

48. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Snapshot Creation
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
Volume
iSCSI
Volume
A B
A B
A B
C
C
When another snapshot is created, only
incremental data is backed up
C
D
D
D
Snap1 Snap2 Snap3
Application
server

49. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Recovery with Volume Gateway

50. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Flexible Recovery Targets with Volume Gateway
Storage Gateway
Service
Customer 2nd site
EC2
Customer VPC
Customer Data Center
EBSGateway
Volume

51. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Restores with an EBS Snapshot
Application
Server
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
iSCS
I VolumeA B
A B
C
C
volume
A B C D
D
D
Snap1 Snap2 Snap3

52. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Restores with Amazon EBS Snapshots – On-Prem.
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
iSCSI VolumeA B
A B
C
C
volume
A B C D
D
D
Snap1 Snap2 Snap3
A B C
VolumeA B C
1. Restore a GW
volume from a past
point in time
Application
Server

53. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Recovery to EBS/EC2 with Snapshots
Storage Gateway Service
Customer Premises Region
Storage Gateway
appliance
iSCSI VolumeA B
A B
C
C
volume
A B C D
D
D
Snap1 Snap2 Snap3
A B C
VolumeA B C
1. Restore a GW
volume from a past
point in time
AZ1
EBS
EC2A B
C D
2. Restore to EC2
Application
Server

54. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway

55. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway
Store files as objects in Amazon S3; Access via S3 API or file protocols
• Storage in your S3 buckets with 1:1 mapping from files-to-objects
• File metadata stored in object metadata
• Full control over how your data is accessed and stored
• Use cases: Hybrid cloud data processing (big data/data lakes), data
distribution, e.g., for content or media, backup, & recovery, etc.
Customer Premises
Glacier
HTTPS
NFS
v3 / v4.1
Application
Server
Objects in your
S3 bucket
Storage Gateway
appliance

56. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
s3://{bucket name}/{folder1}/{file1}
s3://{bucket name}/{folder1}/{file2}
s3://{bucket name}/{folder1}/{file3}
s3://{bucket name}/{folder1}/{file4}
s3://{bucket name}/{folder2}/{file1}
s3://{bucket name}/{folder2}/{file2}
File Gateway
One-to-one mapping from files-to-objects
nfs://{IP}/{share name}/{folder1}/{file1}
nfs://{IP}/{share name}/{folder1}/{file2}
nfs://{IP}/{share name}/{folder1}/{file3}
nfs://{IP}/{share name}/{folder1}/{file4}
nfs://{IP}/{share name}/{folder2}/{file1}
nfs://{IP}/{share name}/{folder2}/{file2}
File Gateway
appliance
NFS
client
Objects in
your S3 bucket

57. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway
Control how your data is accessed and stored
NFS/file options export
• IAM role for access
• Storage class
• Object encryption with AWS KMS
• Guess MIME type
Amazon S3 options per bucket
• List of allowed clients
• Read-only/read-write exports
• User squashing
• Default object ownership (UID/GID)
• Default object permissions
File Gateway
appliance
NFS
client
Objects in your
S3 bucket

58. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon
Athena
Amazon
QuickSight
Amazon
EMR
AWS
Lambda
Amazon
Rekognition
File Gateway
Metadata and workload automation
Metadata
and object
inventory
Data
cache
File
share
File Gateway
Amazon
CloudWatch
Events
NFS
client
Objects in your
S3 bucket
NotifyWhenUploaded
API

59. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway
Metadata and workload automation
Metadata
and object
inventory
Data
cache
File
share
File Gateway
NFS
client
Objects in your
S3 bucket
ls /foo/*

60. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway
Metadata and workload automation
Metadata
and object
inventory
Data
cache
File
share
File Gateway
RefreshCache
API
Amazon
CloudWatch
Events
NFS
client
Objects in your
S3 bucket

61. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway (Reads, Writes, and Updates)
Customer Premises
File Gateway
VM
Region
Share
Storage
Gateway
service
NFS client
File stored
as objects
Index
Cache

62. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway (Reads)
Customer Premises
File Gateway
VM
Region
Share
Storage
Gateway
service
NFS client
File stored
as objects
Ranged read
operations if
required
bytes are not
in cache
Read operation from cache
Index
Cache

63. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway (Writes)
Customer Premises
File Gateway
VM
Region
Share
Storage
Gateway
service
NFS client
File stored
as objects
Multipart upload
Write to cache first
Index
Cache

64. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway (Updates)
Customer
Premises File Gateway
Region
NFS client
File stored
as objects
A B C A B C

65. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway (Updates)
File Gateway
A B CA B C D A B C
Customer
Premises
Region
NFS client
File stored
as objects

66. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway (Updates)
A B CA B C D A B C
A B C D
Customer
Premises
Region
NFS client
File stored
as objects
File Gateway

67. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway (Updates)
A B C D
A B C D E F
A B C D E F
Customer
Premises
Region
NFS client
File stored
as objects
File Gateway

68. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway (Updates)
A B CA H I J E F
A B C D E F
A H I J E F
Customer
Premises
Region
NFS client
File stored
as objects
File Gateway

69. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Content Distribution with File Gateway
Miami regional office
New York regional office
Los Angeles headquarters
Amazon
S3 bucket
NFS client
(writer)
File Gateway
VM
File Gateway
VM
NFS client
(read-only)
NFS client
(read-only)
File Gateway
VM
Request
upload
notification
1
Amazon
CloudWatch
2
3
Client writes files and calls NotifyWhenUploaded API …1 When files are uploaded, the gateway sends a
CloudWatch Event …
2
Event triggers RefreshCache API on gateways in the
remote offices
3 When RefreshCache completes, the gateway
sends a CoudWatch Event notification
4

70. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Monitoring

71. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon CloudWatch Monitoring/Alerting
- Per-volume monitoring
- cachehitpercentage (80%)
- cachepercentdirty (2.5%)
- cachepercentused
- Monitor the upload buffer
for performance issues
- Gateway read/write times
- Shows performance issues
with hardware
- Correlate with VMware
- Tune alerts based on workload
- Review monthly cache averages for sizing/growth

72. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Storage Gateway
• Seamlessly connect on-premises applications with AWS Cloud storage;
No changes to existing applications
• Local cache for low-latency access to data stored durably in AWS
• Supports use cases throughout your cloud journey:
Backup & DR, tiered storage, hybrid processing workflows, migration

73. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you!
Questions?
Find me at the AWS Expo Booth – 1st Floor
Want to see a demo?
5:00 pm - Day 1 Theatre Day (in the Expo)

74. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Please complete the session survey in
the summit mobile app.

75. Submit Session Feedback
1. Tap the Schedule icon. 2. Select the session
you attended.
3. Tap Session
Evaluation to submit your
feedback.