Kickstart Your All-In Move to the AWS Cloud Using AWS Storage Gateway and Amazon EFS (STG335) - AWS re:Invent 2018

•

0 likes•315 views

When you move your data center to the AWS Cloud, you need an innovative and cost-effective approach to ensure a successful transition. In this chalk talk, we discuss how to efficiently and securely migrate all of your data center workloads to the AWS Cloud. Hear how one customer, LoanLogics, started with AWS Storage Gateway and Amazon EFS to solve an immediate and urgent expansion challenge and used that as a starting point for their journey to the AWS Cloud. Hear how they took advantage of the agility of the cloud to transition their storage and database workloads to Amazon Aurora and Amazon RDS. Learn tips to ease your own transition to the cloud. Bring your questions, prepare to discuss your implementation, and expect to have a deep discussion on how you can optimize your workflows.

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kickstart
Your All-In Move to the AWS Cloud Using
AWS Storage Gateway and Amazon EFS
Terrell C. Cassada
Chief Information Officer
LoanLogics
S T G 3 3 5
Rich Pilny
Vice President of Infrastructure
LoanLogics
Joe Travaglini
Senior Product Manager
Amazon Elastic File System
Kyle Somers
Solutions Architect
Amazon Web Services

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Portfolio breadth and depth
Amazon
EBS
Amazon
EFS
AWS Storage
Gateway
Family
Amazon S3

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
PERFORMANCE
Amazon Elastic File System
Scalable, elastic, cloud-native Linux file system
SHARED ACCESS HIGHLY AVAILABLE
AND DURABLE
ELASTIC AND
SCALABLE
SECURE AND
COMPLIANT
STORAGE CLASSES

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Hybrid file storage: File Gateway and Volume Gateway
FILE GATEWAY VOLUME GATEWAY + FILE SERVER
Store and access objects in Amazon S3 from
file-based applications with local caching,
and NFS and SMB access
Block storage and file systems on-
premises backed by cloud storage with
local caching, EBS snapshots, and clones

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
We’ve all been there….

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
LoanLogics AWS journey
Where we started Our first step Where we are now

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Where we started

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Our first step – Solve the storage issue

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Where we are now – All in with AWS

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Related breakouts
STG330 | Scale CI/CD & Configuration Management Pipelines with Git, Amazon EFS, & SQS | Tuesday | 4:00PM | Aria West | Chalk Talk
STG301-R | Deep Dive on Amazon Elastic File System (Amazon EFS) | Wednesday | 12:15PM | Bellagio | Breakout
STG314-R1 | EFS Performance: Maximizing Performance for Linux/Unix File Systems | Wednesday | 1:45PM | Aria East | Chalk Talk
STG406 | Maximizing Throughput and Performance on Amazon EFS | Wednesday | 3:15PM | Bellagio | Workshop
STG305-R | Deep Dive: Build Hybrid Cloud Storage Architectures with Storage Gateway | Wednesday | 3:15PM | Mirage | Breakout
STG325 | Using Cloud File Storage to Accelerate Your Software Development Pipeline | Wednesday | 5:30PM | Mirage | Chalk Talk
STGxxx | NEW! Learn how Amazon EFS Infrequent Access will optimize file system costs | Wednesday | 6:15PM | MGM | Breakout
STG392 | Deep Dive on Cloud File System Offerings: What to Use, Where, and Why | Thursday | 11:30AM | Venetian | Chalk Talk
STG301-R1 | Deep Dive on Amazon Elastic File System (Amazon EFS) | Thursday | 12:15PM | Venetian | Breakout
STG312 | Got Files? We Got You Covered! Deploy Your File Workloads Quickly & Easily with AWS | Thursday | 4:00PM | Venetian | Breakout

Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Terrell C. Cassada
terrell.cassada@loanlogics.com
Rich Pilny
Richard.Pilny@loanlogics.com
Joe Travaglini
joetrav@amazon.com
Kyle Somers
ksomers@amazon.com

Media and entertainment companies are navigating their own digital transformation strategies, and they want to make their editors, artists, and VFX compositing teams comfortable with using the cloud for their production workflows. Companies such as Disney and Netflix are on track to spend over $20B in original content this year and they need ways to get their content in front of audiences as fast as possible. In this chalk talk, learn how AWS Storage Gateway can help studios and other media and entertainment firms bridge the storage gap between the cloud and their on-premises editorial environments.

Reducing Branch Office Storage with AWS Storage Gateway (STG332) - AWS re:Inv...

Amazon Web Services

Many IT organizations must support distributed remote offices that have local storage needs far from central data centers. Providing cost effective, scalable storage and data protection for these branch locations can be a challenge for operations teams. In this chalk talk, an AWS customer explains how he has used AWS Storage Gateway cached and stored volumes and file shares for low-latency cloud-backed storage for on-premises applications, including local user file services. Learn from his experiences to understand your recovery and data migration options using volume clones and Amazon EBS Snapshot.

Introducing AWS DataSync - Simplify, automate, and accelerate online data tra...

Amazon Web Services

SFTP is used for the exchange of data across many industries, including financial services, healthcare, and retail. In this session, we will introduce you to AWS Transfer for SFTP, a service that helps you easily migrate file transfer workflows to AWS, without needing to modify applications or manage SFTP servers. We will demonstrate the product and talk about how to migrate your users so they continue to use their existing SFTP clients and credentials, while the data they access is stored in S3. You will also learn how FINRA is using this new service in conjunction with their Data Lake on AWS.N/A

Using Cloud File Storage to Accelerate Your Software Development Pipeline (ST...

Amazon Web Services

Many companies are modernizing their applications through the use of microservices to democratize software development, providing greater agility in their software delivery pipelines. Developers building their applications using a microservices strategy need persistent container storage that is highly available, easy to provision, and can scale up and down without storage admin intervention. In this session, we discuss CloudBees Core (formerly Enterprise Jenkins) and how it is using Amazon Elastic File System (Amazon EFS) for simple, scalable, on-demand persistent container storage to support customer CI/CD workflows. Bring questions, prepare to discuss your implementation, and expect to have a deep discussion on how you can optimize your own deployment.

Enterprise Data Protection with Veritas NetBackup on AWS (STG347) - AWS re:In...

Amazon Web Services

Veritas Technologies is an AWS Partner Network (APN) Advanced Technology Partner that addresses information management challenges, including backup and recovery, business continuity, software-defined storage, and information governance to simplify backup and improve efficiency. In this chalk talk, we do a deep dive on Veritas NetBackup, an industry-leading backup software that protects on-premises and Amazon EC2 workloads and provides support for Amazon S3 Standard-Infrequent Access and Amazon Glacier. We also hear from Bell Media, who is utilizing Veritas NetBackup to retain backups long-term on Amazon S3.

Building High Availability Apps on Lightsail: Load Balancing and Block Storag...

Amazon Web Services

Customizing Data Lakes to Work for Your Enterprise with Sysco (STG340) - AWS ...

Amazon Web Services

Data lakes are helping enterprises of all sizes and industries make the most of their data. However, building a data lake requires consideration of your goals and an understanding of data lakes, including data ingestion, data consumption, and usability layers. In this chalk talk, AWS experts and representatives from Sysco, a Fortune 50 company and leader in food distribution and marketing, discuss parts of a data lake, design considerations, and the pros and cons of different architectural designs. They share guidance around data tracking, costs, user access, synchronization, and data integrity so that your data lake complies with governance requirements and works towards your data goals. Sysco representatives share their data lake experiences, best practices, and lessons learned. We highlight Amazon S3 and S3 Select, Amazon Athena, Amazon EMR, Amazon EC2, and Amazon Redshift Spectrum.

Got Files? We Got You Covered! Deploy Your File Workloads Quickly & Easily wi...

Amazon Web Services

AWS offers fully managed file system services that enable you to quickly and simply lift and shift or build new applications that access file data in the AWS Cloud. In this session, join Wayne Duso, the leader of file storage, hybrid-edge storage, and data transport services, to learn about our full set of file services and latest launches. Learn all about file storage, and get firsthand input on how you can accelerate your journey to AWS as you move from on-premises or do-it-yourself implementations to fully managed file storage solutions. Hear how AWS file storage solutions enabled LoanLogics to migrate its applications to the cloud, enabling better scalability, performance, and availability. Also discover why customers choose AWS file systems for migrating their mission-critical enterprise applications and compute-intensive workloads to deliver the performance they need in a cost-effective way, saving time and money.

Have you struggled to get the best performance out of Amazon EFS? Do you think more can be done to best leverage this massively parallel storage platform? Amazon EFS is a highly available, highly durable, shared file system built on the core tenets of simplicity, scalability, and elasticity. Its distributed data storage design allows you to achieve high levels of performance using the industry standard NFSv4 protocol. This provides new and existing applications the ability to achieve high levels of throughput while sharing file data across multiple Amazon EC2 instances and on-premises servers. In this session, you’ll hear how to best take advantage of this distributed data storage design by parallelizing access to your file system, scaling out to use multiple clients, and much, much more. You’ll also learn about the different performance and throughput modes and when to use one versus the other. Be prepared to power up your laptop to follow along with the live demos and hands-on tutorials.

Querying Data in Place with AWS Object Storage Features and Analytics Tools (...

Amazon Web Services

AWS offers tools and services that make analyzing and processing petabytes of data in the cloud faster, simpler, and more cost effective. In this chalk talk, AWS experts provide an overview of our querying data-in-place services, such as Amazon S3 Select, Amazon Glacier Select, Amazon Athena, and Amazon Redshift Spectrum. We explore best practices around using them with other analytics services (like Amazon EMR and AWS Glue) and third-party tools to build data lakes in Amazon S3 and Amazon Glacier and deploy other analytics solutions. Our AWS experts also provide sample use cases.

Migrating Data to the Cloud: Exploring Your Options from AWS (STG205-R1) - AW...

Amazon Web Services

The document discusses various options for migrating data to the AWS cloud, including AWS Direct Connect for private connectivity, AWS DataSync for online data transfer, the AWS Snowball and Snowball Edge devices for offline data transfer of large volumes, AWS Storage Gateway for hybrid storage, AWS Transfer for SFTP, and Amazon S3 Transfer Acceleration. It provides overviews and use cases for each service and how they can help with migrating and managing data in hybrid cloud environments.

Make Your Disaster Recovery Plan Resilient & Cost-Effective (ENT213-S) - AWS ...

Amazon Web Services

Consolidating the data center continues to be imperative for most enterprises. There is a good chance that you've been asked to use the cloud as a disaster recovery (DR) solution and eliminate use of secondary on-premises sites. How should you think about this strategy? What are the key requirements you should consider? In this session, learn how Cohesity can help you build a bulletproof plan for disaster recovery on AWS. Hear how a joint customer is using the Cohesity DataPlatform on the AWS Cloud to meet audit requirements for DR and at the same time enable the archiving of backup data. This session is brought to you by AWS partner, Cohesity, Inc.

Cloud Data Migration with Amazon EBS (CMP406-R2) - AWS re:Invent 2018

Amazon Web Services

How to Effectively Plan for Disaster Recovery on AWS (CMP204-S) - AWS re:Inve...

Amazon Web Services

Although the AWS Cloud provides a new level of durability and resiliency, no workload is immune to disasters—be it due to accidental reasons or malicious intent. Even in the cloud, you have to ensure continuity. Traditional disaster recovery (DR) solutions are not optimized for the cloud and often result in higher costs, increased complexity, and operational challenges. To maintain compliance and business continuity service-level agreements, AWS DR planning requires a completely different approach to deal with cross-account, cross-region workload testing and failover. In this session, learn how you can set up an effective DR plan for your AWS environments. This session is brought to you by AWS partner, Druva.

Big Data and Analytics Workloads on Amazon EFS - AWS Online Tech Talks

Amazon Web Services

Migrating Open Source Databases from Amazon EC2 to Aurora PostgreSQL (DAT339)...

Amazon Web Services

AWS Data Transfer Services Deep Dive

Amazon Web Services

This session provides IT pros and application owners an overview of AWS options for building hybrid storage architectures or even entirely migrating datacenter storage to the AWS cloud. The AWS Storage Gateway connects existing on-premises block, file or tape storage systems to AWS cloud storage over the WAN in a hybrid model. The AWS Snow family of physical devices can capture, pre-process and migrate data into and out of AWS without any network connection at all. Join us to learn how you can close down datacenters, reduce storage footprints, and build solutions for tiering, data lakes, backup, disaster recovery, and migration.

PreReLa #1 (PRL1-R1) - AWS re:Invent 2018

Amazon Web Services

The document discusses Amazon FSx for Windows File Server, a fully managed native Windows file system for AWS. It provides concise summaries of key features: - FSx for Windows File Server allows users to lift and shift Windows file storage to AWS with fully managed Windows file servers that provide native Windows compatibility, fast performance, broad accessibility, and are enterprise-ready. - Key capabilities include high throughput and IOPS, integration with Active Directory and DFS, automated backups to S3, encryption at rest and in transit, and support for a wide range of use cases. - The service aims to simplify management of Windows file storage in AWS by automatically handling tasks like backups, software updates, and provisioning/man

Post-Production Media Delivery at Scale with AWS (STG391) - AWS re:Invent 2018

Amazon Web Services

Netflix is using AWS Snowball Edge to deliver post-production content to our asset management system, called Content Hub, in the AWS Cloud. Production companies have been historically using LTO tapes to move data around, and that has well-known complications. In order to accelerate and secure our media workflows Netflix has shifted to using Snowball Edge devices for data migration. Please join us to learn how Netflix is using the Snowball Edge service at scale.

Hybrid Cloud Storage for Recovery & Migration with AWS Storage Gateway (STG30...

Amazon Web Services

In this workshop, we provide hands-on experience using the AWS Storage Gateway service to protect on-premises data in AWS, recover it locally or in the cloud in minutes, and migrate it when the time is right. You work with the File Gateway and Microsoft SQL Server native tools to back up to Amazon S3, and then recover or migrate that database in AWS rapidly. In addition, you use Volume Gateway and Amazon EBS Snapshots to protect and migrate block-based volumes. Use this session to hone your skills with backup and DR, and prepare for application migrations.

[NEW LAUNCH!] Deep Dive on Amazon FSx for Windows File Server (STG322-R) - AW...

Amazon Web Services

If you have compute-intensive workloads like high performance computing, machine learning, and media processing then this is the workshop for you! Our new file storage service, Amazon FSx for Lustre, provides compute-optimized storage with fully managed Lustre file systems that can deliver hundreds of gigabytes of throughput and sub-millisecond latencies. You will learn how to spin up an FSx for Lustre file system in minutes, feed data to it from an S3 data lake, run analyses while writing results back to S3, and then spin down the file system once the workload is finished.

Wellington Management: The Journey to All-In, One Data Center at a Time (FSV2...

Amazon Web Services

Colin Mazzola of Wellington Management Company discussed their company's journey to migrating all workloads and infrastructure to AWS. They began initial proof of concepts in 2009 and made the decision to fully migrate in 2014. By 2017, they had migrated their first tier 1 system and as of 2018 had over 10,000 AWS resources deployed across multiple regions. Lessons learned included defining resiliency through fault domains, automation, and disaster recovery planning as well as controlling costs through tagging, monitoring, and reserved instances.

Hybrid Cloud Processing & Data Distribution with File Gateway & Amazon S3 (ST...

Amazon Web Services

This document discusses using AWS Storage Gateway file gateway to distribute and process files across hybrid cloud environments. It describes how file gateway stores and accesses objects in S3 while providing local file system caching. It also explains how the file gateway API and CloudWatch events can be used to trigger actions like refreshing the cache when files are uploaded to S3. This allows files to be written locally and asynchronously uploaded to S3 while notifying other sites when files have been uploaded.

[NEW LAUNCH!] Lambda Layers (SRV375) - AWS re:Invent 2018

Amazon Web Services

Lambda Layers and Runtime API are two new features which enable developers to publish and share libraries and runtimes that are compatible with AWS Lambda. Use of Layers allows separation of concerns. Publishers can build reliable and hardened software, and share it as Lambda Layers with other AWS developers to consume. Application developers can consume one or more layers in their functions which lets them focus on writing business logic. The Lambda Runtime API codifies the runtime calling conventions and integration points of a Lambda compatible runtime. By leveraging the API, developers can implement fully featured Lambda runtimes that support the Lambda programming model. In combination, these two features allow developers to share their runtimes with others as Layers, and allow function developers to seamlessly use them with their functions. In this session, Marco will deep dive into how to use the Layers and Runtime API capabilities to bring your own runtimes and libraries to Lambda.

Understanding High Availability on Amazon Aurora

Amazon Web Services

According to AWS, Amazon Aurora is the fastest growing service in the company’s history. Many businesses are looking for guidance on how to successfully move to and manage their data on Aurora. Do you know how to launch and configure a cluster on Aurora to ensure that your high-availability and performance requirements are met? Join Eric Johnson, AWS Evangelist at Rackspace, to discuss high availability and replication on Aurora, including extending the replication patterns to meet your application’s needs. He also covers how to choose the right endpoints to optimize writes and reads, as well as the future of Aurora. Spoiler: It’s serverless!

Best Practices for Running SQL Server on Amazon RDS (DAT323) - AWS re:Invent ...

Amazon Web Services

Amazon Relational Database Service (Amazon RDS) provides a managed service to run SQL Server databases in AWS. While Amazon RDS handles provisioning and maintaining the SQL Server instance, there are things you can do to ensure that the SQL Server instance is healthy. We'll review some best practices involved in configuring the Amazon RDS SQL Server instance, focusing on availability, security and migration. We'll also hear from our customer Allstate, sharing details about their use of Amazon RDS.

Optimizing Performance in Amazon S3 (STG367-R2) - AWS re:Invent 2018

Amazon Web Services

Amazon S3 powers some of the most performance-sensitive workloads running in the cloud today. 2018 has brought massive improvements in Amazon S3 request rates and overall throughput. In this chalk talk, you have the opportunity to interact directly with the Amazon S3 engineering team responsible for the S3 index and many other components at the core of these improvements. We discuss what's changed, including the removal of the need for prefix randomization, and the ways you can improve your architecture to enhance performance in the unique environment of Amazon S3.

Automating Backup and Archiving on AWS with Commvault (STG358) - AWS re:Inven...

Amazon Web Services

Are you planning to utilize just one data management platform to move, manage, and use data across on-premises and AWS Cloud environments? Commvault, an AWS Partner Network (APN) Advanced and Storage Competency Technology Partner, offers comprehensive data management for managing data across files, applications, databases, hypervisors, and clouds. In this chalk talk, we dive deep on how Commvault enables you to migrate onsite backup data onto Amazon S3 to reduce your hardware footprint and improve recoverability; implement data tiering and archive data in Amazon Glacier for long-term retention and compliance; and perform snapshot-based protection and recovery for applications running on Amazon EC2.

Deep Dive on Cloud File System Offerings: What to Use, Where, and Why (STG392...

Amazon Web Services

The document summarizes Amazon Web Services' portfolio of file storage and data transfer services. It introduces Amazon Elastic File System (EFS), Amazon FSx for Lustre and Windows File Server, AWS Storage Gateway, AWS DataSync, and AWS Transfer for SFTP. The panel of AWS product managers discuss the different services and when each one is best suited for different use cases and workloads. The presentation also highlights some new related sessions at re:Invent that provide more in-depth information on the various services.

State of the Union: Storage

Amazon Web Services

This document provides a summary of storage-related breakout sessions at the 2019 AWS re:Invent conference. There will be sessions covering best practices for implementing data lakes on S3, securing EFS for containers and data science, shifting tape backups to AWS for cost savings, new capabilities in AWS file storage, hybrid storage architectures with Storage Gateway, security and management of S3, data migration services, deep dives on EBS, storage at the edge and hybrid cloud, data migration and edge computing with Snow family, durability of S3, high performance file storage with S3 and FSx for Lustre, what's new with S3 and S3 Glacier, optimizing costs in S3, a deep dive

What's hot

Maximizing Throughput and Performance on Amazon EFS (STG406) - AWS re:Invent ...

Amazon Web Services

Querying Data in Place with AWS Object Storage Features and Analytics Tools (...

Amazon Web Services

Migrating Data to the Cloud: Exploring Your Options from AWS (STG205-R1) - AW...

Amazon Web Services

Make Your Disaster Recovery Plan Resilient & Cost-Effective (ENT213-S) - AWS ...

Amazon Web Services

Cloud Data Migration with Amazon EBS (CMP406-R2) - AWS re:Invent 2018

Amazon Web Services

How to Effectively Plan for Disaster Recovery on AWS (CMP204-S) - AWS re:Inve...

Amazon Web Services

Big Data and Analytics Workloads on Amazon EFS - AWS Online Tech Talks

Amazon Web Services

Migrating Open Source Databases from Amazon EC2 to Aurora PostgreSQL (DAT339)...

Amazon Web Services

AWS Data Transfer Services Deep Dive

Amazon Web Services

PreReLa #1 (PRL1-R1) - AWS re:Invent 2018

Amazon Web Services

Post-Production Media Delivery at Scale with AWS (STG391) - AWS re:Invent 2018

Amazon Web Services

Hybrid Cloud Storage for Recovery & Migration with AWS Storage Gateway (STG30...

Amazon Web Services

[NEW LAUNCH!] Deep Dive on Amazon FSx for Windows File Server (STG322-R) - AW...

Amazon Web Services

Wellington Management: The Journey to All-In, One Data Center at a Time (FSV2...

Amazon Web Services

Hybrid Cloud Processing & Data Distribution with File Gateway & Amazon S3 (ST...

Amazon Web Services

[NEW LAUNCH!] Lambda Layers (SRV375) - AWS re:Invent 2018

Amazon Web Services

Understanding High Availability on Amazon Aurora

Amazon Web Services

Best Practices for Running SQL Server on Amazon RDS (DAT323) - AWS re:Invent ...

Amazon Web Services

Optimizing Performance in Amazon S3 (STG367-R2) - AWS re:Invent 2018

Amazon Web Services

Automating Backup and Archiving on AWS with Commvault (STG358) - AWS re:Inven...

Amazon Web Services

What's hot (20)