Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Optimizing Storage for Enterprise Workloads and Migrations (STG202) - AWS re:Invent 2018

210 views

Published on

In this session, we focus on best practices for AWS block and file storage when supporting enterprise workloads (like SAP, Oracle, Microsoft applications, and home directories). We discuss migrating mission-critical workload data, selecting volumes or file systems, optimizing performance, and designing for durability and availability. We also review optimizing for cost to ensure that your lift-and-shift project is a success.

  • DOWNLOAD THIS BOOKS INTO AVAILABLE FORMAT (Unlimited) ......................................................................................................................... ......................................................................................................................... Download Full PDF EBOOK here { https://tinyurl.com/y6a5rkg5 } ......................................................................................................................... Download Full EPUB Ebook here { https://tinyurl.com/y6a5rkg5 } ......................................................................................................................... ACCESS WEBSITE for All Ebooks ......................................................................................................................... Download Full PDF EBOOK here { https://tinyurl.com/y6a5rkg5 } ......................................................................................................................... Download EPUB Ebook here { https://tinyurl.com/y6a5rkg5 } ......................................................................................................................... Download doc Ebook here { https://tinyurl.com/y6a5rkg5 } ......................................................................................................................... ......................................................................................................................... ......................................................................................................................... .............. Browse by Genre Available eBooks ......................................................................................................................... Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult,
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Memory Improvement: How To Improve Your Memory In Just 30 Days, click here.. ●●● https://tinyurl.com/brainpill101
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Optimizing Storage for Enterprise Workloads and Migrations (STG202) - AWS re:Invent 2018

  1. 1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Optimizing Storage for Enterprise Workloads and Migrations David Stein Sr. Business Development Manager, Storage AWS S T G 2 0 2
  2. 2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Agenda Migrating storage from on-prem to AWS File storage on AWS Block storage on AWS
  3. 3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Managing on-premise storage arrays Operational Time Costs • Long three- to six-month acquisition • 30-90 day implementation • Capex – up-front initial investment • Guesswork on how much storage you will need, mix of SSD/HDD • Expensive software for tiering and snapshotting • Availability – need a second array and datacenter for HA • Backup – secondary storage array plus offsite copy • Scalability – difficult to scale: time/cost to order more drives, upgrade controllers, EOL of array
  4. 4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Data movement OnlineOffline Data security and management Amazon EFSAmazon Elastic Block Store (Amazon EBS) Amazon S3 Amazon Glacier AWS Key Management Service (AWS KMS) AWS Identity and Access Management (IAM) AWS CloudWatch AWS CloudTrail AWS CloudFormation AWS Lambda Amazon Macie Amazon QuickSight AWS Snow family AWS Storage Gateway AWS Direct Connect Amazon Elastic File System (Amazon EFS) File Sync Amazon Simple Storage Service (Amazon S3) transfer acceleration Third party applications Amazon Kinesis Data Firehose The broadest range of storage services
  5. 5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Compliance Industry certifications Lockable with audit trails Secure Enterprise applications Integrated with major vendors Fully managed infrastructure Lift-and-shift migrations Active archive Media workflows Tape replacement Public sector, FinServ, healthcare/life sciences Databases & analytics Bespoke database lift-and-shift Tailored Hadoop workloads Backup and Restore Non-disruptive Easy place to start Integrated with all major vendors Data lakes & IoT 400% faster queries Built for streaming data Data visualization What are customers building?
  6. 6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Compliance Amazon S3 Amazon Glacier and the Vault Lock feature Enterprise applications Amazon EFS Amazon EBS Active archive Amazon S3 and the S-IA tier Amazon Glacier (with bulk and expedited retrieval tiers) Databases & analytics Amazon Elastic Compute Cloud (Amazon EC2) and Amazon EBS Amazon EMR, Amazon Redshift Backup and restore Amazon S3 & Amazon Glacier AWS Storage Gateway AWS Snow family Amazon EFS Data lakes & IoT Amazon S3, Amazon Athena, and Amazon Redshift Spectrum Amazon EFS AWS Storage Gateway (hybrid) The right storage service for common workloads
  7. 7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Storage type Features and performance Economics What do you consider when selecting storage?
  8. 8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Three types of storage File ObjectBlock Amazon EFS Amazon EBS Amazon S3, Amazon Glacier
  9. 9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Performance comparison of storage types File Object Block Latency Throughput
  10. 10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability Zone Availability Zone Availability Zone Amazon S3 Standard Amazon S3 Standard-IA Amazon Glacier Amazon EFS Availability Zone Amazon EBS Amazon S3 One Zone-IA AWS Region AWS Region How do AWS storage classes differ in design?
  11. 11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS storage customers
  12. 12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  13. 13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Moving to the cloud Common drivers of moving data to the cloud Pain points of data migration While every cloud adoption journey is unique, all require a data migration step, which can be hindered by blockers such as: Cost effectiveness Workforce productivity Business agility Operational resilience Access to innovative services Disruption Speed Costs Channels Cloud compatibility
  14. 14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon S3 Amazon EC2 Amazon EFS Amazon EBS Amazon Aurora Amazon EMR Amazon Glacier Amazon Relational Database Service (Amazon RDS) IoT Amazon Redshift DATA Migrating data: Five key questions 1) What kind of data is it, and where is it going? 4) How much data & time do you have? 2) One-time or continuous movement? 3) One-way or bidirectional access? 5) How might your WAN be a factor? Files Block volumes Databases IoT Devices
  15. 15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS migration capabilities AWS Direct Connect Establishes private connectivity between AWS and your data center, office, or colocation environment AWS Snow family (AWS Snowball, Snowball Edge, AWS Snowmobile) Move terabytes to petabytes of data to AWS using appliances designed for secure, physical transport AWS Storage Gateway (file, volume, & tape gateways) Connects on-premises applications to AWS. Uses common storage interfaces to migrate data AWS Partner Network Migration & Storage Competency Partners provide solutions and expertise to help businesses move to AWS Kinesis Data Firehose Capture, process, & load streaming data into AWS to be used with business intelligence and analytics tools Amazon S3 transfer acceleration Makes internet transfers to S3 faster. Ideal for recurring jobs such as uploads, backups, & local processing tasks Discovery & migration tracking AWS Migration Hub AWS Application Discovery Service Server & database migration AWS Server Migration Service (AWS SMS) AWS Database Migration Service (AWS DMS) VMware on AWS Data migration services Streaming data Network OptimizationsPartners Amazon EFS File Sync Sync files from a source file system into a destination Amazon EFS file system. The source file system can be on- premises or in the cloud File
  16. 16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. What are AWS DMS and AWS Schema Conversion Tool (AWS SCT)? AWS DMS easily and securely migrate and/or replicate your databases and data warehouses to AWS AWS SCT converts your commercial database and data warehouse schemas to open-source engines or AWS-native services, such as Amazon Aurora and Amazon Redshift Over 64,000 databases migrated and counting …
  17. 17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. When to use AWS DMS and AWS SCT? Modernize Migrate Replicate Modernize your database tier – • Commercial to open-source • Commercial to Amazon Aurora Modernize your data warehouse – • Commercial to Amazon Redshift • Migrate business-critical applications • Migrate from classic to VPC • Migrate data warehouse to Amazon Redshift • Upgrade to a minor version • Consolidate shards into Aurora • Create cross-regions read replicas • Run your analytics in the cloud • Keep your dev/test and production environment sync
  18. 18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  19. 19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. NFS file storage with Amazon EFS
  20. 20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. What if you could … App owners and developers Business managers • Migrate existing code, applications, and tools into the AWS cloud • Build new cloud-native applications on scalable file storage • Predict pricing and eliminate up-front capital costs • Increase agility • Spend less time managing file storage and more time driving the business IT administrators • Eliminate file system management and maintenance, especially at scale
  21. 21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon EFS Provides simple, scalable, highly available, & durable file storage in the cloud Petabyte scale file system distributed across an unconstrained number of storage servers in multiple Availability Zones (AZs) Elastic capacity, automatically growing & shrinking as you add & remove files
  22. 22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Key features of Amazon EFS Simple ScalableElastic Highly available and durable
  23. 23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon EFS is simple Fully managed - No hardware, network, file layer - Create a scalable file system in seconds! Seamless integration with existing tools and apps - NFS v4.1—Widespread, open - Standard file system access semantics - Works with standard OS file system APIs Simple pricing = simple forecasting Simple
  24. 24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon EFS is elastic File systems grow and shrink automatically as you add and remove files No need to provision storage capacity or performance You pay only for the storage space you use, with no minimum fee Elastic
  25. 25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. File systems can grow to petabyte scale Throughput and IOPS scale automatically as file systems grow Consistent low latencies regardless of file system size Support for thousands of concurrent NFS connections Amazon EFS is scalable Scalable
  26. 26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Designed to sustain AZ offline conditions Resources aggregated across multiple AZs Superior to traditional NAS availability models Appropriate for production / tier 0 applications Highly durable and highly available
  27. 27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Designed for a wide variety of use cases Scale-out jobs Metadata-intensive jobs Analytics Media workflows Enterprise apps and messaging Web serving Content management Database backups Container storage Dev tooling Home directories Low latency and serial I/OHigh throughput and parallel I/O
  28. 28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Do it yourself NFS architecture NFS Clients NFS Server Volume Volume NFS Clients NFS Server Volume Volume NFS Clients NFS Server Volume Volume
  29. 29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon EFS architecture NFS Clients NFS Clients NFS Clients Mount Target Single Namespace Mount Target Mount Target
  30. 30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. EFS TCO example Let’s say you need to store ~500 GB and require high availability and durability Using a shared file layer on top of EBS, you might provision 600 GB (with ~85% utilization) and fully replicate the data to a second Availability Zone for availability/durability Example comparative cost: Storage (two times 600 GB EBS gp2 volumes): $120 per month Compute (two time m4.xlarge instances): $350 per month Inter-AZ data transfer costs (est.): $129 per month Total $599 per month EFS cost is (500GB * $0.30/GB-month) = $150 per month, with no additional charges
  31. 31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. EFS File Sync Fast Up to five times faster than standard Linux copy tools Sync data from existing file systems into Amazon EFS file systems Secure Encrypted parallel data transfer to AWS Simple Set up and manage easily from the AWS Console File systems from on-premises to EFS DIY in-cloud file systems to EFS EFS file systems between AWS Regions Use EFS File Sync to copy
  32. 32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. EFS File Sync Fast and simple way to copy file systems to Amazon EFS File Server /NAS NFS Sync Agent Customer Premises Region file system EFS file system Amazon EFSHTTPS • Sync Agent deployed as a VM • No data is stored on the Sync Agent • Optimized TCP stack for high-throughput • Data is compressed and encrypted across the network
  33. 33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon EFS throughput modes Bursting throughput (default) Recommended for the majority of workloads Provisioned throughput Recommended for higher throughput to storage ratio workloads
  34. 34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Throughput mode comparison Mode What it is for Advantages Trade-offs When to use Bursting throughput (default) Varying throughput workloads Auto-scaling throughput Fixed throughput to storage ratio Best choice for most workloads Provisioned throughput Higher- consistent throughput workloads User-defined throughput Separate throughput charge Ingest or higher throughput to storage ratio
  35. 35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon EFS customers New York University Cornell University
  36. 36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  37. 37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Enterprise workloads on AWS Amazon EFS SMB NFS Lustre Amazon Redshift Vertica Teradata Amazon EMR Cloudera Hortonworks MapR FileData warehouse Data analytics Mission critical databases Amazon DynamoDB MongoDB Cassandra Couch Amazon RDS/ Amazon Aurora Oracle SQL MySQL PostgreSQL
  38. 38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon EBS—Let us do the undifferentiated heavy lifting Reliable PerformantTransparent Minimal re-architecting for applications Adjust performance and price on the fly Highly available Failure tolerant Foundational for enterprise applications Consistently high IOPS and throughput Optimized for low-latency workloads
  39. 39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS block storage offerings EC2 instance store sc1st1 io1gp2 EBS SSD-backed volumes EBS HDD-backed volumes I2/I3 D2/H1
  40. 40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. • Local to instance • Non-persistent data store • Data not replicated (by default) • No snapshot support • SSD or HDD What is Amazon EC2 instance store? EC2 instances Physical Host Instance Store or
  41. 41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Volumes persist independent of EC2 Select storage and compute based on your workload Detach and attach between instances within the same Availability Zone What is EBS? EC2 instance EC2 instance Availability Zone AWS Region EBS volume
  42. 42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Volumes attach to one instance Many volumes can attach to an instance Separate boot and data volumes What is EBS? EC2 instance EBS volume (boot) EBS volume (data) EBS volume (data) Availability Zone AWS Region
  43. 43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Benefits of EBS • Persistent – delete instances without losing your data, detach and reattach volumes without having to replicate data between nodes • Elastic –dynamically increase capacity, change volume types, and tune performance • Available – designed for 99.999% availability • Durable – designed for an annual failure rate (AFR) of between 0.1% - 0.2%. EBS snapshots for backups. • Secure – seamless support for data-at-rest and data-in-transit encryption between EC2 instances and EBS volumes
  44. 44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. EBS volume types General purpose SSD gp2 Provisioned IOPS SSD io1 Throughput optimized HDD st1 Cold HDD sc1 SSD HDD
  45. 45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Relational databases MySQL, PostgreSQL, SQL, Oracle, SAP File / media CIFS/NFS, Transcoding, Encoding, Rendering Big data analytics Kafka, Splunk, Hadoop, Data Warehousing Nonrelational/NoSQL Cassandra, MongoDB, CouchDB Solid state (SSD) Hard disk drive (HDD) Amazon EBS use cases
  46. 46. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon EBS offerings GP2 IO1 SC1 ST1 IOPS performance for most workloads with predictable baseline and burst Critical and IO intensive workloads needing consistent performance Colder throughput oriented workloads (e.g. log processing) Big data & analytics workloads needing consistent high throughput Snapshots Highly durable regional backups for EBS volumes SAN-like features at cloud-scale – performance and data services Optimizing value: Price to performance Simplifying customer experience
  47. 47. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Throughput? or IOPS Choosing an EBS volume type What is more important to your workload
  48. 48. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. SSD: GP2 or IO1? IO1 volumes deliver within 10 percent of the provisioned IOPS performance 99.9 percent of the time over a given year. Critical and IO intensive workloads needing consistent performance. GP2 volumes are designed to deliver the provisioned performance 99% of the time. IOPS performance for most workloads with predictable baseline and burst. GP2 Provisioned IOPS (io1)
  49. 49. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. I/O provisioned volumes Throughput provisioned volumes sc1st1io1gp2 $0.10 per GB $0.125 per GB $0.065 per PIOPS * All prices are per month, and from the us-east-1 Region as of November 2018 $0.045 per GB $0.025 per GB Snapshot storage for all volume types is $0.05 per GB per month
  50. 50. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. What is an EBS-optimized instance? c4.2xlarge ~ 125 MiB/s Shared ~ 125 MiB/s Dedicated EBS EC2 instances InternetDatabases S3
  51. 51. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. What is an EBS-optimized instance? More details: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/EBSOptimized.html • Dedicated network bandwidth for EBS I/O • Up to 80,000 16k IOPS and 1.75 GiB/s throughput • Enabled by default on most current generation instances • Can be enabled at instance launch or on a running instance • Not an option on some 10 Gbps instance types • (c3.8xlarge, r3.8xlarge, i2.8xlarge)
  52. 52. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Performance: EBS-optimized c4.large Dedicated to EBS 500 Mbps ~ 62.5 MiB/s 2 TiB GP2 volume 6,000 IOPS 160 MiB/s max throughput 4,000 16K IOPS c4.2xlarge Dedicated to EBS 1 Gbps ~ 125 MiB/s 8,000 16K IOPS 2 TiB GP2 volume 6,000 IOPS 160 MiB/s max throughput
  53. 53. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Best practice: RAID When to RAID? • Storage requirement > 16 TiB • Throughput requirement > 500 MiB/s • Largest instance can support up to 1,750 MiB/s • IOPS requirement > 32,000 at 16K • Largest instance can support up to 75,000 at 16k EBS EBS EBS
  54. 54. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Best practice: RAID Avoid RAID for redundancy • EBS data is already replicated • RAID1 halves available EBS bandwidth • RAID5/6 loses 20% to 30% of usable I/O to parity EBS EBS EBS
  55. 55. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. What is an EBS snapshot? EBS volume Availability Zone AWS Region Amazon S3 Availability Zone EBS snapshot EC2 instance
  56. 56. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How does an EBS snapshot work? • Point-in-time backup of modified volume blocks • Stored in S3, accessed through EBS APIs • Subsequent snapshots are incremental • Deleting snapshot will only remove data exclusive to that snapshot • Crash consistent EBS volume EBS snapshot
  57. 57. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. What can you do with a snapshot? EBS volume Availability Zone AWS Region Amazon S3 EBS snapshot Availability Zone EBS volume EC2 instance EC2 instance
  58. 58. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. What can you do with a snapshot? EBS volume Availability Zone AWS Region Amazon S3 EBS snapshot EBS volume Availability Zone AWS Region EBS snapshot EC2 instance EC2 instance
  59. 59. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Oracle on EBS
  60. 60. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. 1 Hosting Oracle databases: Various options MaintenanceHigh Low 2 3
  61. 61. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Best practice for running Oracle on AWS 75K IOPS, 1,750 MB/s Root 20GB Logs 100GB Data – ASM stripe 2 x 3TB, 20K 6TB, 40K IOPS, 1 GB/s If the workload is I/O bound use EBS optimized Instance Use IO1 to make sure Oracle Database meets IOPS requirement as per the AWR report (Automatic Workload Repository) Use multiple EBS volumes and install ASM on it in order to keep the Oracle files us-east-2 IO1GP2 GP2 R4.16xl 6TB Oracle DB 40K IOPS 640 MB/s
  62. 62. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Best practice for running Oracle on AWS—Backup Create a fast recovery area (FRA) in EBS ST1 for point-in-time recovery (zero to seven days) Use RMAN to backup the Oracle database files from EBS ST1 to S3 for long term retention 100GB Root 10GB Logs 2TB/20K Data eu-central-1a 2TB Backup Amazon S3 Long term backup R4.8xl ST1IO1GP2GP2 RMAN 2TB Oracle DB 20K IOPS 320 MB/s
  63. 63. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Best practice for running Oracle on AWS—HA and DR • Use Data Guard or Active Data Guard in a different AZ for HA • Use Data Guard in a different region for DR • Use Multi-AZ in RDS eu-central-1b Root Logs Data Oracle DB Root Logs Data Oracle DB Root Logs Data Oracle DB eu-central-1a eu-west-1a GP2 GP2 GP2 GP2 GP2GP2 IO1 IO1IO1 Data Guard Data Guard
  64. 64. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Oracle HA and DR deployment architecture •
  65. 65. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. SAP on EBS
  66. 66. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. • SAP mandates specific performance KPIs for SAP HANA data and log volumes • Minimum 400 MB/s for SAP HANA data • Minimum 250 MB/s for SAP HANA log • Low latency for SAP HANA log • Both IO1 and GP2 volumes are certified for SAP HANA data and log SAP HANA on AWS—Performance Root SAP Binaries HANA Shared HANA Data (Striped for Throughput) HANA Log HANA Backup Media Stage - Up to 4TB Memory in Scale-up - Up to 1750 MiB/s EBS Throughput GP2 IO1GP2 GP2 IO1 ST1 GP2
  67. 67. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. SAP HANA on AWS—Performance Higher throughput to HANA data Lower time to load data during startup - x1e.32xlarge provides 4TB memory - 1750 MiB/s EBS throughput - Maximum data held in memory ~2TB HANA Data Volume Type HANA Data Volume Config Maximum throughput to HANA Data Time to load ~2TB Data into Memory IO1 3 x 1600 GiB 1500 MiB/s ~23 Minutes GP2 3 x 1600 GiB 480 MiB/s ~1 Hr 13 Minutes  Use IO1 for business critical systems to reduce time to load data into memory
  68. 68. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. SAP HANA on AWS—Elasticity Amazon EBS Amazon EBS Amazon EC2 R4 Amazon EC2 • Scale-up from 244GiB memory to 4TB with EC2 elasticity (Stop Instance, Change Instance type, and Start Instance) • Increase storage size to match instance memory with EBS Elastic Volumes with simple API calls Just few minutes of downtime No downtime
  69. 69. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. SAP HANA QuickStart - Uses AWS CloudFormation templates and scripts - Provision SAP HANA system in less than one hour - Provides options to choose between GP2 and IO1 for HANA data and log - Automatically provisions and configures EBS volumes based on instance type - Can automatically encrypt the volumes during the launch SAP HANA on AWS—Deployment More Information - https://docs.aws.amazon.com/quickstart/latest/sap-hana/planning.html
  70. 70. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. A s i a A m e r i c a s E M E A E n t e r p r i s e SAP workloads on AWS
  71. 71. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Windows on EBS
  72. 72. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon RDS for SQL Server SQL Server on Amazon EC2 Power, HVAC, net OS install/maintenance OS patching DBMS install/maintenance DBMS patching Database backups High availability Scaling AWS managed Customer managed Power, HVAC, net OS install/maintenance OS patching DBMS install/maintenance DBMS patching Database backups High availability Scaling • Consider RDS first • Focus on business value tasks • High-level tuning • Schema optimization • No in-house database expertise • Automatic host replacement • Need full control over DB instance • Replication • Clustering • Options that are not available in RDS Options for deploying SQL Server on AWS
  73. 73. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Multi-AZ SQL Server on Amazon RDS Availability Zone 1 Private Subnet Availability Zone 2 AWS Region Amazon RDS Primary Amazon RDS Secondary Private Subnet Automatic Failover
  74. 74. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Multi-AZ SQL Server on Amazon RDS Availability Zone 1 Private Subnet Availability Zone 2 AWS Region Amazon RDS Primary Amazon RDS Secondary Private Subnet Automatic Failover Managed service
  75. 75. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Multi-AZ AlwaysOn availability group Availability Zone 1 Private Subnet Availability Zone 2 Private Subnet AWS Region Amazon EC2 Primary Replica Amazon EC2 Secondary Replica Synchronous Commit Automatic Failover
  76. 76. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Multi-region AlwaysOn availability group Availability Zone 1 Private Subnet AWS Region A Availability Zone 2 Private Subnet Availability Zone 1 Private Subnet AWS Region B Elastic IP Elastic IP VPN Amazon EC2 Primary Replica Amazon EC2 Secondary Replica Amazon EC2 Secondary Replica Synchronous Commit Automatic Failover Asynchronous Commit Manual Failover
  77. 77. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Multi-region AlwaysOn availability group Availability Zone 1 Private Subnet AWS Region A Availability Zone 2 Private Subnet Availability Zone 1 Private Subnet AWS Region B Amazon EC2 Primary Replica Amazon EC2 Secondary Replica Amazon EC2 Secondary Replica Synchronous Commit Automatic Failover Asynchronous Commit Manual Failover VPC peering
  78. 78. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Multi-AZ failover cluster instance Amazon EBS Amazon EBS Availability Zone 1 Private Subnet Availability Zone 2 Private Subnet AWS Region Amazon EC2 Primary Replica Amazon EC2 Secondary Replica Data Replication
  79. 79. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Best practice: Taking snapshots from Windows 1. Sync equivalent available 2. Use Volume Shadow Copy Service (VSS) - aware utilities for backups 3. EBS: backups on dedicated volume for snapshots
  80. 80. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. New: VSS support via EC2 SSM • Use policy generator to create IAM policy for AWS Service “Amazon Simple Service Manager” • Actions: DescribeImages, CreateTags, and CreateSnapshot • Create Amazon EC2 type IAM role and attach to Windows instances
  81. 81. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. New: VSS support via EC2 SSM • Call the run command AWSEC2- CreateVssSnapshot
  82. 82. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. New: VSS support via EC2 SSM • Select the instance • Add description, tags • Can exclude boot volume • Run command makes the VSS agent flush I/O, freeze • SSM VSS included in Microsoft Windows Server AMI version 2017.11.21 & up
  83. 83. Thank you! © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. David Stein davstein@amazon.com
  84. 84. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

×