Advertisement

Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018

Amazon Web Services
Nov. 29, 2018
Advertisement

More Related Content

Slideshows for you(20)

Similar to Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018(20)

Advertisement

More from Amazon Web Services(20)

Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018

  1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Going Deep on Amazon Aurora Serverless Anoop Gupta Software Development Manager Amazon Web Services D A T 4 2 7 R Alexey Kuznetsov Sr. Software Development Engineer Amazon Web Services
  2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Agenda • Amazon RDS & Aurora fundamentals • What is Amazon Aurora Serverless? • How it works • Q&A
  3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon RDS is . . . Cloud native engine Open source engines Commercial engines RDS platform • Automatic fail-over • Backup & recovery • X-region replication • Isolation & security • Industry compliance • Automated patching • Advanced monitoring • Routine maintenance • Push-button scaling Image credit: By Mackphillips - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=55946550
  4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora is . . .. . . Cloud native engine Open source engines Commercial engines RDS platform • Automatic fail-over • Backup & recovery • X-region replication • Isolation & security • Industry compliance • Automated patching • Advanced monitoring • Routine maintenance • Push-button scaling Image credit: By Mackphillips - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=55946550
  5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora - databases reimagined for the cloud Speed and availability of high-end commercial databases Simplicity and cost-effectiveness of open source databases Drop-in compatibility with MySQL and PostgreSQL Simple pay as you go pricing Delivered as a fully managed service
  6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability zone 1 Region Availability zone 2 Availability zone 3 Scale-out, distributed, multi-tenant design . . . Purpose-built log-structured, distributed storage Shared storage volume Storage nodes with SSDs Master SQL Transaction s Caching Reader 5 Reader 9 SQL Transaction s Caching SQL Transaction s Caching Reader 1 SQL Transaction s Caching Reader 8 SQL Transaction s Caching Reader 15 SQL Transaction s Caching … … … 10GiB stripes Master and up to 15 Readers all point to the same storage 6-way replication, 2 per AZ Quorums survive AZ+1 failure
  7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability zone 1 Region Availability zone 2 Availability zone 3 With provisioned Aurora, you size the master yourself Shared storage volume Storage nodes with SSDs Master SQL Transaction s Caching Size for the peak load -or- Continuously monitor and manually scale up/down
  8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora Serverless . . . Responds to your application automatically • Start up • Shut down • Scale capacity
  10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Real world examples…
  11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. You have some choices to make . . . Provision for peak Continuously monitor and manually scale up/down -or- Expensive Hard • Requires experts • Risks outages Provision less than peak End-user (business) impact -or-
  12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Database capacity management Availability zone 1 Region App Shared distributed storage volume Master
  13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Database capacity management Availability zone 1 Region App Shared distributed storage volume Original master Scale-up target Add a scale-up target
  14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Database capacity management Availability zone 1 Region App Shared distributed storage volume Original master New master Cutover
  15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Database capacity management Availability zone 1 Region App Shared distributed storage volume Original master New master
  16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Database capacity management Availability zone 1 Region App Shared distributed storage volume Original master Scale-up target Add a proxy, shield the application from connection changesProxy
  17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Database capacity management Availability zone 1 Region App Shared distributed storage volume New scale-up target Proxy New master Cutover
  18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Database capacity management – is hard Availability zone 1 Region App Shared distributed storage volume New scale-up target Proxy New master
  19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora Serverless . . . Responds to your application load automatically • Scale capacity with no downtime • Multi-tenant proxy is highly available • Scale target has warm buffer pool • Shuts down when not in use
  20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How does it work . . . Availability zone 1 Region App Shared distributed storage volume Multi-tenant proxy layer Warm-pool of Aurora instances Monitoring service
  22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How does it work . . . Availability zone 1 Region App Shared distributed storage volume Multi-tenant proxy layer Warm-pool of Aurora instances Monitoring service
  23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How does it work . . . Availability zone 1 Region App Shared distributed storage volume Multi-tenant proxy layer Warm-pool of Aurora instances Monitoring service
  24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How does it work . . . Availability zone 1 Region App Shared distributed storage volume Multi-tenant proxy layer Warm-pool of Aurora instances Monitoring service
  25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How does it work . . . Availability zone 1 Region App Shared distributed storage volume Multi-tenant proxy layer Warm-pool of Aurora instances Monitoring service
  26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How does it work . . . Availability zone 1 Region App Shared distributed storage volume Multi-tenant proxy layer Warm-pool of Aurora instances Monitoring service
  27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How does it work . . . Availability zone 1 Region App Shared distributed storage volume Multi-tenant proxy layer Warm-pool of Aurora instances Monitoring service
  28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How does it work . . . Availability zone 1 Region App Shared distributed storage volume Multi-tenant proxy layer Warm-pool of Aurora instances Monitoring service
  29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Simpler experience: Less to worry about • No CPU credits to monitor • No commitment to particular availability zone • No migrations between instance type generations • No DB instance reservations to manage • No instances to manage • Encryption at REST is always enabled • No need to manually suspend and resume database • No DNS propagation delays • No maintenance window • No old database versions to upgrade
  30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Introducing Amazon Relational Database Service Data API • Simple web service protocol for database access • SQL statements packaged as HTTP requests • Access your database from Lambda and AppSync • Access your database from the AWS SDK & CLI Data API Service Aurora Serverless
  32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Introducing RDS Console Query Editor • Access your database from AWS Management Console • No database client application or terminal required
  33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora Serverless – for PostgreSQL Now in preview, sign-up today: https://pages.awscloud.com/amazon -aurora-postgresql-serverless- preview.html
  34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora Serverless – more regions • Aurora Serverless newly available in: • Seoul • Singapore • Sydney • Mumbai • N. California • London, Paris • Frankfurt • Central Canada
  35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Related breakouts Thursday, November 29th Accelerate Database Development and Testing with Amazon Aurora 11:30 a.m. - 1:45 p.m. | Mirage, Mirage Event Center C3 Thursday, November 29th Accelerate Your Analytic Queries with Amazon Aurora Parallel Query 4:00 p.m. - 5:00 p.m. | Venetian, Level 2, Veronese 2406 Thursday, November 29th Build on Amazon Aurora with MySQL Compatibility 4:00 p.m. – 5:00 p.m. | Mirage, Grand Ballroom B, Table 7
  36. Thank you! © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Anoop Gupta gupanoop@amazon.com Alexey Kuznetsov alexey@amazon.com
  37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How to migrate? To Aurora MySQL To Aurora Serverless for MySQL Restore from snapshot ✓ ✓ Dump & load ✓ ✓ AWS Data Migration Service ✓ ✓ Transaction log replication ✓ ✗ Restore from Amazon S3 ✓ ✓*
  39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability Aurora MySQL (Multi-AZ) Aurora MySQL (Single-AZ) Aurora Serverless for MySQL Fast failover ✓ ✗ ✗ Cross-AZ failover ✓ ✗ ✓ Storage HA/durability ✓ ✓ ✓
Advertisement