SlideShare a Scribd company logo
S U M M I T
S Y DNEY
Lessons From Officeworks
on Optimising
Persistent Storage on AWS
Adam Ginsberg, NetApp Chief Architect
Greg Rose, Officeworks, Principal Systems Engineer
© 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — v20190429ag
3 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Persistent
Storage
Apple ][
Adam Ginsberg
ginsberg@netapp.com
NetApp
Cloud Data Services
5 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
6 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
Cloning
( kləʊnɪŋ )
Accelerate development with
multiple writable copies in 1 second
7 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
“Cloud Volumes drastically lowered our cloud
cost and server spend. My team was able to
lower the number of development systems by
10 times and drop our total deployment time to
mere minutes. For a DevOps shop, Cloud
Volumes takes our productivity to a whole new
level.”
Jeremy Goodrum, Vice President of Engineering, Wirestorm
8 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
Multi-Protocol
( mʌlti - prəʊtəkɒl )
All your stuff in one place
9 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
Storage Efficiency
( stɔːrɪdʒ ɪˈfɪʃ(ə)nsi )
big whoop-de-dupe
10 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
“Cloud Volumes allowed us to transition to the cloud
seamlessly. It enabled us to easily migrate our data
and bring the benefits of our onsite NetApp data
management and data protection to AWS.”
-Brock Cremer, Infrastructure Services Delivery
Manager, Monash University
25% Reduction in storage costs
11 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
Data Mobility
( deɪtə moˈbɪlətɪ )
Move data from here to there.
Anywhere.
Data Workflow (Actual)
12 © 2018 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
App
NFS Volume
Control-M
AFT
1
2
ec2
AWS Sydney Region
AZ: ap-southeast-2a
ebs
2
3
VPC Endpoint for S3
4
4
5
5
1. Ctrl-M trigger AFT
2. AFT Read File from NFS
AFT Upload File to EBS
3. Ctrl-M trigger ec2 Agent
4. ec2 Agent Read File from EBS
ec2 Agent Write File to S3
5. Lambda Reads from S3
Lambda Writes to Postgres RDS
2
Data Flow WITHOUT NetApp
Data Workflow (with Snap Mirror)
13 © 2018 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
NFS Volume
1
ec2
AWS Sydney Region
AZ: ap-southeast-2a
1. EC2 Reads using NFSv4
EC2 Writes to Postgres RDS
1
Data Flow WITH NetApp
14 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
Tiering
( tɪəɪŋ )
Champagne for adults,
juice for kids.
Hot
Cold
15 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
Kubernetes Service
( kyo͞ obərntēs sərvəs )
Manage containers seamlessly
On-Prem, next-to-cloud, in-the-cloud
Greg Rose
Principal Systems Engineer
17 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
18 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
You know who we are,
but did you know ?
19 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Our journey with AWS
• Started small, dramatic growth
• We consume a wide spectrum of AWS offerings
• AWS allows us to make bigger things happen
for Customers and Team Members
• The journey continues every day
20 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Why we use Cloud Volumes ?
Let me tell me you about our journey
Gauge Warm to Cool
How hot’s that data…
OR
21 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Use case 1: Cost effective archival storage
On-Premises
NetApp FAS Volume
storage
Cold Archive Data
NetApp Data Fabric
SnapMirror® or
Direct Copy
Amazon
EBS
Amazon
S3
NetApp Cloud
Volumes ONTAP
Volume
Take advantage of
Fabric Pool to leverage
Amazon S3
22 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Use case 2:
Cost effective Dev/Test and Share DR
On-Premises
NetApp FAS Volume
storage
NetApp Data Fabric
SnapMirror® Amazon
EBS
Amazon
S3
NetApp Cloud
Volumes ONTAP
Volume
23 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Use case 2:
Cost effective Dev/Test and Share DR
On-Premises
NetApp FAS Volume
storage
NetApp Data Fabric
SnapMirror® Amazon
EBS
Amazon
S3
NetApp Cloud
Volumes ONTAP
Volume
24 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
25 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Use case 3: Putting data where it
needs to be (Heating up cold data)
On-Premises
NetApp FAS Volume
storage
NetApp Data Fabric
SnapMirror®
Amazon
EBS
Amazon
S3
NetApp Cloud
Volumes ONTAP
Volume
Clones
26 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
What do we gain by using Cloud Volumes ONTAP?
• Cost effective cold data storage
• Cloud Volumes ONTAP scales to our needs
• Utilises existing tools and patterns
• Allows us to put data where we want it to go
• Feature rich
27 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Pro-tips
• Think about how you consume your data
• You can turn off Cloud Volumes ONTAP instances
when not in use
• NetApp has excellent resources to collaborate with
• Use community support and free tools
• Use NetApp SnapMirror throttling to avoid
congestion on your AWS links
28
http://cloud.netapp.com
Thank you.
© 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

More Related Content

What's hot

AWS Customer Presentation - Heavy.com
AWS Customer Presentation - Heavy.com AWS Customer Presentation - Heavy.com
AWS Customer Presentation - Heavy.com
Amazon Web Services
 
Highly Available Graphite
Highly Available GraphiteHighly Available Graphite
Highly Available Graphite
Matthew Barlocker
 
Demonstrating 100 Gbps in and out of the Clouds
Demonstrating 100 Gbps in and out of the CloudsDemonstrating 100 Gbps in and out of the Clouds
Demonstrating 100 Gbps in and out of the Clouds
Igor Sfiligoi
 
FME World Tour 2016: Your Data in Motion (Safe Software)
FME World Tour 2016: Your Data in Motion (Safe Software)FME World Tour 2016: Your Data in Motion (Safe Software)
FME World Tour 2016: Your Data in Motion (Safe Software)
GIM_nv
 
AWS Customer Presenatation - SlingMedia uses AWS
AWS Customer Presenatation - SlingMedia uses AWSAWS Customer Presenatation - SlingMedia uses AWS
AWS Customer Presenatation - SlingMedia uses AWS
Amazon Web Services
 
IT Services - TCO Study by Frost & Sullivan
IT Services - TCO Study by Frost & SullivanIT Services - TCO Study by Frost & Sullivan
IT Services - TCO Study by Frost & Sullivan
CTRLS
 
AWS Customer Presentation - JovianDATA
AWS Customer Presentation - JovianDATAAWS Customer Presentation - JovianDATA
AWS Customer Presentation - JovianDATA
Amazon Web Services
 
Dobre praktyki projektowania architektury i wdrażania systemów IT dla chmury ...
Dobre praktyki projektowania architektury i wdrażania systemów IT dla chmury ...Dobre praktyki projektowania architektury i wdrażania systemów IT dla chmury ...
Dobre praktyki projektowania architektury i wdrażania systemów IT dla chmury ...
Jacek Biernat
 
[판교에서 만나는 아마존웹서비스] Obama for America를 통해서 본 AWS에서의 데이터 분석
[판교에서 만나는 아마존웹서비스] Obama for America를 통해서 본 AWS에서의 데이터 분석 [판교에서 만나는 아마존웹서비스] Obama for America를 통해서 본 AWS에서의 데이터 분석
[판교에서 만나는 아마존웹서비스] Obama for America를 통해서 본 AWS에서의 데이터 분석
Amazon Web Services Korea
 
Federated Graphite in Docker - Denver Docker Meetup
Federated Graphite in Docker - Denver Docker MeetupFederated Graphite in Docker - Denver Docker Meetup
Federated Graphite in Docker - Denver Docker Meetup
Phil Zimmerman
 
AWS Customer Presentation - How TubeMogul uses AWS
AWS Customer Presentation - How TubeMogul uses AWSAWS Customer Presentation - How TubeMogul uses AWS
AWS Customer Presentation - How TubeMogul uses AWS
Amazon Web Services
 
Berlioz Introduction
Berlioz IntroductionBerlioz Introduction
Berlioz Introduction
Ruben Hakopian
 
Using Spatial Data Streams In Real-Time
Using Spatial Data Streams In Real-TimeUsing Spatial Data Streams In Real-Time
Using Spatial Data Streams In Real-Time
Lars Schmitz
 
(BDT403) Netflix's Next Generation Big Data Platform | AWS re:Invent 2014
(BDT403) Netflix's Next Generation Big Data Platform | AWS re:Invent 2014(BDT403) Netflix's Next Generation Big Data Platform | AWS re:Invent 2014
(BDT403) Netflix's Next Generation Big Data Platform | AWS re:Invent 2014
Amazon Web Services
 
FME User Stories from Around the World
FME User Stories from Around the WorldFME User Stories from Around the World
FME User Stories from Around the World
Safe Software
 
OPTIMIZING THE TICK STACK
OPTIMIZING THE TICK STACKOPTIMIZING THE TICK STACK
OPTIMIZING THE TICK STACK
InfluxData
 
FME World Tour 2015 - Around the World - Ken Bragg
FME World Tour 2015 - Around the World - Ken BraggFME World Tour 2015 - Around the World - Ken Bragg
FME World Tour 2015 - Around the World - Ken Bragg
IMGS
 
1Spatial: Edinburgh FME World Tour: Performance tips
1Spatial: Edinburgh FME World Tour: Performance tips1Spatial: Edinburgh FME World Tour: Performance tips
1Spatial: Edinburgh FME World Tour: Performance tips
1Spatial
 
Indoo.rs calibre
Indoo.rs calibre Indoo.rs calibre
Indoo.rs calibre
Silvia Pichler
 
Scylla Summit 2018: Discord: The Joy of Opinionated Systems
Scylla Summit 2018: Discord: The Joy of Opinionated SystemsScylla Summit 2018: Discord: The Joy of Opinionated Systems
Scylla Summit 2018: Discord: The Joy of Opinionated Systems
ScyllaDB
 

What's hot (20)

AWS Customer Presentation - Heavy.com
AWS Customer Presentation - Heavy.com AWS Customer Presentation - Heavy.com
AWS Customer Presentation - Heavy.com
 
Highly Available Graphite
Highly Available GraphiteHighly Available Graphite
Highly Available Graphite
 
Demonstrating 100 Gbps in and out of the Clouds
Demonstrating 100 Gbps in and out of the CloudsDemonstrating 100 Gbps in and out of the Clouds
Demonstrating 100 Gbps in and out of the Clouds
 
FME World Tour 2016: Your Data in Motion (Safe Software)
FME World Tour 2016: Your Data in Motion (Safe Software)FME World Tour 2016: Your Data in Motion (Safe Software)
FME World Tour 2016: Your Data in Motion (Safe Software)
 
AWS Customer Presenatation - SlingMedia uses AWS
AWS Customer Presenatation - SlingMedia uses AWSAWS Customer Presenatation - SlingMedia uses AWS
AWS Customer Presenatation - SlingMedia uses AWS
 
IT Services - TCO Study by Frost & Sullivan
IT Services - TCO Study by Frost & SullivanIT Services - TCO Study by Frost & Sullivan
IT Services - TCO Study by Frost & Sullivan
 
AWS Customer Presentation - JovianDATA
AWS Customer Presentation - JovianDATAAWS Customer Presentation - JovianDATA
AWS Customer Presentation - JovianDATA
 
Dobre praktyki projektowania architektury i wdrażania systemów IT dla chmury ...
Dobre praktyki projektowania architektury i wdrażania systemów IT dla chmury ...Dobre praktyki projektowania architektury i wdrażania systemów IT dla chmury ...
Dobre praktyki projektowania architektury i wdrażania systemów IT dla chmury ...
 
[판교에서 만나는 아마존웹서비스] Obama for America를 통해서 본 AWS에서의 데이터 분석
[판교에서 만나는 아마존웹서비스] Obama for America를 통해서 본 AWS에서의 데이터 분석 [판교에서 만나는 아마존웹서비스] Obama for America를 통해서 본 AWS에서의 데이터 분석
[판교에서 만나는 아마존웹서비스] Obama for America를 통해서 본 AWS에서의 데이터 분석
 
Federated Graphite in Docker - Denver Docker Meetup
Federated Graphite in Docker - Denver Docker MeetupFederated Graphite in Docker - Denver Docker Meetup
Federated Graphite in Docker - Denver Docker Meetup
 
AWS Customer Presentation - How TubeMogul uses AWS
AWS Customer Presentation - How TubeMogul uses AWSAWS Customer Presentation - How TubeMogul uses AWS
AWS Customer Presentation - How TubeMogul uses AWS
 
Berlioz Introduction
Berlioz IntroductionBerlioz Introduction
Berlioz Introduction
 
Using Spatial Data Streams In Real-Time
Using Spatial Data Streams In Real-TimeUsing Spatial Data Streams In Real-Time
Using Spatial Data Streams In Real-Time
 
(BDT403) Netflix's Next Generation Big Data Platform | AWS re:Invent 2014
(BDT403) Netflix's Next Generation Big Data Platform | AWS re:Invent 2014(BDT403) Netflix's Next Generation Big Data Platform | AWS re:Invent 2014
(BDT403) Netflix's Next Generation Big Data Platform | AWS re:Invent 2014
 
FME User Stories from Around the World
FME User Stories from Around the WorldFME User Stories from Around the World
FME User Stories from Around the World
 
OPTIMIZING THE TICK STACK
OPTIMIZING THE TICK STACKOPTIMIZING THE TICK STACK
OPTIMIZING THE TICK STACK
 
FME World Tour 2015 - Around the World - Ken Bragg
FME World Tour 2015 - Around the World - Ken BraggFME World Tour 2015 - Around the World - Ken Bragg
FME World Tour 2015 - Around the World - Ken Bragg
 
1Spatial: Edinburgh FME World Tour: Performance tips
1Spatial: Edinburgh FME World Tour: Performance tips1Spatial: Edinburgh FME World Tour: Performance tips
1Spatial: Edinburgh FME World Tour: Performance tips
 
Indoo.rs calibre
Indoo.rs calibre Indoo.rs calibre
Indoo.rs calibre
 
Scylla Summit 2018: Discord: The Joy of Opinionated Systems
Scylla Summit 2018: Discord: The Joy of Opinionated SystemsScylla Summit 2018: Discord: The Joy of Opinionated Systems
Scylla Summit 2018: Discord: The Joy of Opinionated Systems
 

Similar to Lessons From Officeworks on Optimising Persistent Storage on AWS (Sponsored by NetApp) - AWS Summit Sydney

Bridging Your Business Across the Enterprise and Cloud with MongoDB and NetApp
Bridging Your Business Across the Enterprise and Cloud with MongoDB and NetAppBridging Your Business Across the Enterprise and Cloud with MongoDB and NetApp
Bridging Your Business Across the Enterprise and Cloud with MongoDB and NetApp
MongoDB
 
Recipe for Success: The Right Ingredients for Enterprise-Class Cloud Data Man...
Recipe for Success: The Right Ingredients for Enterprise-Class Cloud Data Man...Recipe for Success: The Right Ingredients for Enterprise-Class Cloud Data Man...
Recipe for Success: The Right Ingredients for Enterprise-Class Cloud Data Man...
Amazon Web Services
 
Addressing Enterprise Customer Pain Points with a Data Driven Architecture
Addressing Enterprise Customer Pain Points with a Data Driven ArchitectureAddressing Enterprise Customer Pain Points with a Data Driven Architecture
Addressing Enterprise Customer Pain Points with a Data Driven Architecture
DataWorks Summit
 
Hybrid as a Stepping Stone: It’s Not All or Nothing for Your Cloud Transforma...
Hybrid as a Stepping Stone: It’s Not All or Nothing for Your Cloud Transforma...Hybrid as a Stepping Stone: It’s Not All or Nothing for Your Cloud Transforma...
Hybrid as a Stepping Stone: It’s Not All or Nothing for Your Cloud Transforma...
Amazon Web Services
 
Manage your database in the cloud like a pro with Cloud Volumes Service for A...
Manage your database in the cloud like a pro with Cloud Volumes Service for A...Manage your database in the cloud like a pro with Cloud Volumes Service for A...
Manage your database in the cloud like a pro with Cloud Volumes Service for A...
Amazon Web Services
 
OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017
OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017
OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017
Cloud Native Day Tel Aviv
 
OSDC 2019 | RTO & RPO – Best Practices in Hybrid Architectures by Fernando Honig
OSDC 2019 | RTO & RPO – Best Practices in Hybrid Architectures by Fernando HonigOSDC 2019 | RTO & RPO – Best Practices in Hybrid Architectures by Fernando Honig
OSDC 2019 | RTO & RPO – Best Practices in Hybrid Architectures by Fernando Honig
NETWAYS
 
Moving Out of the Data Center to Reach More Customer Targets (IOT222-S) - AWS...
Moving Out of the Data Center to Reach More Customer Targets (IOT222-S) - AWS...Moving Out of the Data Center to Reach More Customer Targets (IOT222-S) - AWS...
Moving Out of the Data Center to Reach More Customer Targets (IOT222-S) - AWS...
Amazon Web Services
 
Engineering Genomic Big Data Analytics at A Global Scale
Engineering Genomic Big Data Analytics at A Global ScaleEngineering Genomic Big Data Analytics at A Global Scale
Engineering Genomic Big Data Analytics at A Global Scale
Amazon Web Services
 
How Intuit simplifies storage on AWS - DEM13-S - New York AWS Summit
How Intuit simplifies storage on AWS - DEM13-S - New York AWS SummitHow Intuit simplifies storage on AWS - DEM13-S - New York AWS Summit
How Intuit simplifies storage on AWS - DEM13-S - New York AWS Summit
Amazon Web Services
 
What's new in Amazon EC2 - CMP201 - Santa Clara AWS Summit.pdf
What's new in Amazon EC2 - CMP201 - Santa Clara AWS Summit.pdfWhat's new in Amazon EC2 - CMP201 - Santa Clara AWS Summit.pdf
What's new in Amazon EC2 - CMP201 - Santa Clara AWS Summit.pdf
Amazon Web Services
 
Containerize Legacy .NET Framework Web Apps for Cloud Migration (WIN305) - AW...
Containerize Legacy .NET Framework Web Apps for Cloud Migration (WIN305) - AW...Containerize Legacy .NET Framework Web Apps for Cloud Migration (WIN305) - AW...
Containerize Legacy .NET Framework Web Apps for Cloud Migration (WIN305) - AW...
Amazon Web Services
 
Lessons learned processing 70 billion data points a day using the hybrid cloud
Lessons learned processing 70 billion data points a day using the hybrid cloudLessons learned processing 70 billion data points a day using the hybrid cloud
Lessons learned processing 70 billion data points a day using the hybrid cloud
DataWorks Summit
 
Implement a Modern Flash-to-Flash-to-Cloud Backup Environment (DEV205-S) - AW...
Implement a Modern Flash-to-Flash-to-Cloud Backup Environment (DEV205-S) - AW...Implement a Modern Flash-to-Flash-to-Cloud Backup Environment (DEV205-S) - AW...
Implement a Modern Flash-to-Flash-to-Cloud Backup Environment (DEV205-S) - AW...
Amazon Web Services
 
Move Out of the Data Center to Reach More Customers
Move Out of the Data Center to Reach More CustomersMove Out of the Data Center to Reach More Customers
Move Out of the Data Center to Reach More Customers
Amazon Web Services
 
Instantaneous Replication of Build Artifacts with NetApp
Instantaneous Replication of Build Artifacts with NetAppInstantaneous Replication of Build Artifacts with NetApp
Instantaneous Replication of Build Artifacts with NetApp
NetApp
 
NetApp Fabric Pool Deck
NetApp Fabric Pool DeckNetApp Fabric Pool Deck
NetApp Fabric Pool Deck
Alex Tsui
 
How to Accelerate the Adoption of AWS and Reduce Cost and Risk with a Data F...
 How to Accelerate the Adoption of AWS and Reduce Cost and Risk with a Data F... How to Accelerate the Adoption of AWS and Reduce Cost and Risk with a Data F...
How to Accelerate the Adoption of AWS and Reduce Cost and Risk with a Data F...
Amazon Web Services
 
NetApp Hybrid Cloud with OpenNebula
NetApp Hybrid Cloud with OpenNebulaNetApp Hybrid Cloud with OpenNebula
NetApp Hybrid Cloud with OpenNebula
OpenNebula Project
 
Breaking the Monolith road to containers.pdf
Breaking the Monolith road to containers.pdfBreaking the Monolith road to containers.pdf
Breaking the Monolith road to containers.pdf
Amazon Web Services
 

Similar to Lessons From Officeworks on Optimising Persistent Storage on AWS (Sponsored by NetApp) - AWS Summit Sydney (20)

Bridging Your Business Across the Enterprise and Cloud with MongoDB and NetApp
Bridging Your Business Across the Enterprise and Cloud with MongoDB and NetAppBridging Your Business Across the Enterprise and Cloud with MongoDB and NetApp
Bridging Your Business Across the Enterprise and Cloud with MongoDB and NetApp
 
Recipe for Success: The Right Ingredients for Enterprise-Class Cloud Data Man...
Recipe for Success: The Right Ingredients for Enterprise-Class Cloud Data Man...Recipe for Success: The Right Ingredients for Enterprise-Class Cloud Data Man...
Recipe for Success: The Right Ingredients for Enterprise-Class Cloud Data Man...
 
Addressing Enterprise Customer Pain Points with a Data Driven Architecture
Addressing Enterprise Customer Pain Points with a Data Driven ArchitectureAddressing Enterprise Customer Pain Points with a Data Driven Architecture
Addressing Enterprise Customer Pain Points with a Data Driven Architecture
 
Hybrid as a Stepping Stone: It’s Not All or Nothing for Your Cloud Transforma...
Hybrid as a Stepping Stone: It’s Not All or Nothing for Your Cloud Transforma...Hybrid as a Stepping Stone: It’s Not All or Nothing for Your Cloud Transforma...
Hybrid as a Stepping Stone: It’s Not All or Nothing for Your Cloud Transforma...
 
Manage your database in the cloud like a pro with Cloud Volumes Service for A...
Manage your database in the cloud like a pro with Cloud Volumes Service for A...Manage your database in the cloud like a pro with Cloud Volumes Service for A...
Manage your database in the cloud like a pro with Cloud Volumes Service for A...
 
OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017
OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017
OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017
 
OSDC 2019 | RTO & RPO – Best Practices in Hybrid Architectures by Fernando Honig
OSDC 2019 | RTO & RPO – Best Practices in Hybrid Architectures by Fernando HonigOSDC 2019 | RTO & RPO – Best Practices in Hybrid Architectures by Fernando Honig
OSDC 2019 | RTO & RPO – Best Practices in Hybrid Architectures by Fernando Honig
 
Moving Out of the Data Center to Reach More Customer Targets (IOT222-S) - AWS...
Moving Out of the Data Center to Reach More Customer Targets (IOT222-S) - AWS...Moving Out of the Data Center to Reach More Customer Targets (IOT222-S) - AWS...
Moving Out of the Data Center to Reach More Customer Targets (IOT222-S) - AWS...
 
Engineering Genomic Big Data Analytics at A Global Scale
Engineering Genomic Big Data Analytics at A Global ScaleEngineering Genomic Big Data Analytics at A Global Scale
Engineering Genomic Big Data Analytics at A Global Scale
 
How Intuit simplifies storage on AWS - DEM13-S - New York AWS Summit
How Intuit simplifies storage on AWS - DEM13-S - New York AWS SummitHow Intuit simplifies storage on AWS - DEM13-S - New York AWS Summit
How Intuit simplifies storage on AWS - DEM13-S - New York AWS Summit
 
What's new in Amazon EC2 - CMP201 - Santa Clara AWS Summit.pdf
What's new in Amazon EC2 - CMP201 - Santa Clara AWS Summit.pdfWhat's new in Amazon EC2 - CMP201 - Santa Clara AWS Summit.pdf
What's new in Amazon EC2 - CMP201 - Santa Clara AWS Summit.pdf
 
Containerize Legacy .NET Framework Web Apps for Cloud Migration (WIN305) - AW...
Containerize Legacy .NET Framework Web Apps for Cloud Migration (WIN305) - AW...Containerize Legacy .NET Framework Web Apps for Cloud Migration (WIN305) - AW...
Containerize Legacy .NET Framework Web Apps for Cloud Migration (WIN305) - AW...
 
Lessons learned processing 70 billion data points a day using the hybrid cloud
Lessons learned processing 70 billion data points a day using the hybrid cloudLessons learned processing 70 billion data points a day using the hybrid cloud
Lessons learned processing 70 billion data points a day using the hybrid cloud
 
Implement a Modern Flash-to-Flash-to-Cloud Backup Environment (DEV205-S) - AW...
Implement a Modern Flash-to-Flash-to-Cloud Backup Environment (DEV205-S) - AW...Implement a Modern Flash-to-Flash-to-Cloud Backup Environment (DEV205-S) - AW...
Implement a Modern Flash-to-Flash-to-Cloud Backup Environment (DEV205-S) - AW...
 
Move Out of the Data Center to Reach More Customers
Move Out of the Data Center to Reach More CustomersMove Out of the Data Center to Reach More Customers
Move Out of the Data Center to Reach More Customers
 
Instantaneous Replication of Build Artifacts with NetApp
Instantaneous Replication of Build Artifacts with NetAppInstantaneous Replication of Build Artifacts with NetApp
Instantaneous Replication of Build Artifacts with NetApp
 
NetApp Fabric Pool Deck
NetApp Fabric Pool DeckNetApp Fabric Pool Deck
NetApp Fabric Pool Deck
 
How to Accelerate the Adoption of AWS and Reduce Cost and Risk with a Data F...
 How to Accelerate the Adoption of AWS and Reduce Cost and Risk with a Data F... How to Accelerate the Adoption of AWS and Reduce Cost and Risk with a Data F...
How to Accelerate the Adoption of AWS and Reduce Cost and Risk with a Data F...
 
NetApp Hybrid Cloud with OpenNebula
NetApp Hybrid Cloud with OpenNebulaNetApp Hybrid Cloud with OpenNebula
NetApp Hybrid Cloud with OpenNebula
 
Breaking the Monolith road to containers.pdf
Breaking the Monolith road to containers.pdfBreaking the Monolith road to containers.pdf
Breaking the Monolith road to containers.pdf
 

More from Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
Amazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
Amazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
Amazon Web Services
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Amazon Web Services
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
Amazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
Amazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Amazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
Amazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Amazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
Amazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Lessons From Officeworks on Optimising Persistent Storage on AWS (Sponsored by NetApp) - AWS Summit Sydney

  • 1. S U M M I T S Y DNEY
  • 2. Lessons From Officeworks on Optimising Persistent Storage on AWS Adam Ginsberg, NetApp Chief Architect Greg Rose, Officeworks, Principal Systems Engineer © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — v20190429ag
  • 3. 3 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — Persistent Storage Apple ][ Adam Ginsberg ginsberg@netapp.com
  • 4.
  • 5. NetApp Cloud Data Services 5 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
  • 6. 6 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL --- Cloning ( kləʊnɪŋ ) Accelerate development with multiple writable copies in 1 second
  • 7. 7 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL --- “Cloud Volumes drastically lowered our cloud cost and server spend. My team was able to lower the number of development systems by 10 times and drop our total deployment time to mere minutes. For a DevOps shop, Cloud Volumes takes our productivity to a whole new level.” Jeremy Goodrum, Vice President of Engineering, Wirestorm
  • 8. 8 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL --- Multi-Protocol ( mʌlti - prəʊtəkɒl ) All your stuff in one place
  • 9. 9 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL --- Storage Efficiency ( stɔːrɪdʒ ɪˈfɪʃ(ə)nsi ) big whoop-de-dupe
  • 10. 10 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL --- “Cloud Volumes allowed us to transition to the cloud seamlessly. It enabled us to easily migrate our data and bring the benefits of our onsite NetApp data management and data protection to AWS.” -Brock Cremer, Infrastructure Services Delivery Manager, Monash University 25% Reduction in storage costs
  • 11. 11 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL --- Data Mobility ( deɪtə moˈbɪlətɪ ) Move data from here to there. Anywhere.
  • 12. Data Workflow (Actual) 12 © 2018 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — App NFS Volume Control-M AFT 1 2 ec2 AWS Sydney Region AZ: ap-southeast-2a ebs 2 3 VPC Endpoint for S3 4 4 5 5 1. Ctrl-M trigger AFT 2. AFT Read File from NFS AFT Upload File to EBS 3. Ctrl-M trigger ec2 Agent 4. ec2 Agent Read File from EBS ec2 Agent Write File to S3 5. Lambda Reads from S3 Lambda Writes to Postgres RDS 2 Data Flow WITHOUT NetApp
  • 13. Data Workflow (with Snap Mirror) 13 © 2018 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — NFS Volume 1 ec2 AWS Sydney Region AZ: ap-southeast-2a 1. EC2 Reads using NFSv4 EC2 Writes to Postgres RDS 1 Data Flow WITH NetApp
  • 14. 14 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL --- Tiering ( tɪəɪŋ ) Champagne for adults, juice for kids. Hot Cold
  • 15. 15 © 2019 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL --- Kubernetes Service ( kyo͞ obərntēs sərvəs ) Manage containers seamlessly On-Prem, next-to-cloud, in-the-cloud
  • 17. 17 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
  • 18. 18 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — You know who we are, but did you know ?
  • 19. 19 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — Our journey with AWS • Started small, dramatic growth • We consume a wide spectrum of AWS offerings • AWS allows us to make bigger things happen for Customers and Team Members • The journey continues every day
  • 20. 20 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — Why we use Cloud Volumes ? Let me tell me you about our journey Gauge Warm to Cool How hot’s that data… OR
  • 21. 21 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — Use case 1: Cost effective archival storage On-Premises NetApp FAS Volume storage Cold Archive Data NetApp Data Fabric SnapMirror® or Direct Copy Amazon EBS Amazon S3 NetApp Cloud Volumes ONTAP Volume Take advantage of Fabric Pool to leverage Amazon S3
  • 22. 22 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — Use case 2: Cost effective Dev/Test and Share DR On-Premises NetApp FAS Volume storage NetApp Data Fabric SnapMirror® Amazon EBS Amazon S3 NetApp Cloud Volumes ONTAP Volume
  • 23. 23 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — Use case 2: Cost effective Dev/Test and Share DR On-Premises NetApp FAS Volume storage NetApp Data Fabric SnapMirror® Amazon EBS Amazon S3 NetApp Cloud Volumes ONTAP Volume
  • 24. 24 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
  • 25. 25 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — Use case 3: Putting data where it needs to be (Heating up cold data) On-Premises NetApp FAS Volume storage NetApp Data Fabric SnapMirror® Amazon EBS Amazon S3 NetApp Cloud Volumes ONTAP Volume Clones
  • 26. 26 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — What do we gain by using Cloud Volumes ONTAP? • Cost effective cold data storage • Cloud Volumes ONTAP scales to our needs • Utilises existing tools and patterns • Allows us to put data where we want it to go • Feature rich
  • 27. 27 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — Pro-tips • Think about how you consume your data • You can turn off Cloud Volumes ONTAP instances when not in use • NetApp has excellent resources to collaborate with • Use community support and free tools • Use NetApp SnapMirror throttling to avoid congestion on your AWS links
  • 28. 28 http://cloud.netapp.com Thank you. © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —