AWS March 2016 Webinar Series - Managed Database Services on Amazon Web Services

1,019 views

Published on

AWS customers can choose among a variety of managed database services in addition to running databases in Amazon EC2 on their own. Managed database services remove the burden of implementing, managing and maintaining the database and let you focus on your applications.

In this webinar, we will help you understand the differences and common areas of these managed database, and how to choose one or more. We will explain the fundamentals of Amazon RDS, a relational database service in the cloud; Amazon DynamoDB, a fully managed NoSQL database service; Amazon ElastiCache, a fast, in-memory caching service in the cloud; and Amazon Redshift, a fully managed, petabyte-scale data-warehouse solution. We will also cover how each service can help support your application, how much each service costs, and how to get started.

Learning Objectives:
• Understand the Managed Database Service options available on AWS
• Learn how to choose among the Managed Database Services on AWS for your use cases

Who Should Attend:
• IT Professionals, IT Managers, DBAs, Systems Administrators and Developers

Published in: Technology

AWS March 2016 Webinar Series - Managed Database Services on Amazon Web Services

  1. 1. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Scott Ward, Solutions Architect March 30th 2016 Managed Database Services on Amazon Web Services
  2. 2. Today’s agenda • Why managed database services? • A non-relational managed database • A relational managed database • A managed in-memory cache • A managed data warehouse • What to do next
  3. 3. Why managed database services?
  4. 4. Options for running your database • Self-Managed—You are responsible for the hardware, OS, security, updates, backups, replication etc., but have full control over it. • EC2 Instances—You only need to focus on the database level updates, patches, replication, backups etc. and don’t have to worry about the hardware or the OS installation. • Fully Managed—You get features such as backup and replication etc. as a package service and don’t have to bother with patching and updates.
  5. 5. What are the AWS managed DB options?
  6. 6. A managed service for each major DB type In-Memory Key- Value Store Amazon ElastiCache Data Warehouse Amazon Redshift SQL Database Engines Amazon RDS Document and Key-Value Store Amazon DynamoDB
  7. 7. Pick the best tool for the job
  8. 8. What is Amazon RDS?
  9. 9. Relational databases Fully managed Fast, predictable performance Simple and fast to scale Low cost, pay for what you use Amazon RDS Amazon Aurora
  10. 10. Use cases Applicable wherever you need relational databases eCommerce Gaming Websites IT Solutions Apps Reporting
  11. 11. RDS feature matrix Feature Aurora MySQL PostgreSQL MariaDB Oracle SQL Server VPC       High availability       Instance scaling       Encryption       Read replicas     Oracle Golden Gate Cross region   Max storage 64 TB 6 TB 6 TB 6 TB 6 TB 4 TB Scale storage Auto Scaling     Provisioned IOPS NA 30,000 30,000 30,000 30,000 20,000 Largest instance R3.8XL R3.8XL M4.10XL R3.8XL M4.10XL R3.8XL M4.10XL R3.8XL M4.10XL R3.8XL M4.10XL
  12. 12. Amazon Aurora: Fast, available, and MySQL-compatible SQL Transactions AZ 1 AZ 2 AZ 3 Caching Amazon S3 5x faster than MySQL on same hardware Sysbench: 100K writes/sec and 500K reads/sec Designed for 99.99% availability 6-way replicated storage across 3 AZs Scale to 64 TB and 15 read replicas
  13. 13. Amazon RDS is simple and fast to scale Database instance types offer a range of CPU and memory selections Scale up or down amongnstance types on demand Database storage is scalable on demand
  14. 14. Amazon RDS offers fast, predictable storage General Purpose (SSD) for most workloads Provisioned IOPS (SSD) for OLTP workloads up to 30,000 IOPS Magnetic for small workloads with infrequent access
  15. 15. High availability Multi-AZ deployments Enterprise-grade fault tolerance solution for production databases
  16. 16. Choose Read Replicas for greater scalability Bring data close to your customer’s applications in different regions Relieve pressure on your master node for supporting reads and writes. Promote a read replica to a master for faster recovery in the event of disaster
  17. 17. Choose cross-region replication for enhanced data locality, even more ease of migration Even faster recovery in the event of disaster Bring data close to your customers Promote to a master for easy migration
  18. 18. Choose cross-region snapshot copy for even greater durability, ease of migration Copy a database snapshot to a different AWS region Warm standby for disaster recovery Base for migration to a different region
  19. 19. How Amazon RDS backups work? Automated backups Restore your database to a point in time Enabled by default Choose a retention period, up to 35 days Manual snapshots Build a new database instance from a snapshot when needed Initiated by you Persist until you delete them Stored in Amazon S3
  20. 20. You pay for the resources that you use Monthly bill = N × Further details at http://aws.amazon.com/elasticache/pricing/ Duration for which the nodes were used Number of nodes (Price depends on type of node) Free tier (for first 12 months) 750 micro DB instance hours 20 GB of DB storage 20 GB for backups 10 million I/O operations + Storage consumed (Price depends on type of storage) GB
  21. 21. Selected Amazon RDS customers
  22. 22. What is Amazon DynamoDB?
  23. 23. Amazon DynamoDB NoSQL database Fully managed Single-digit millisecond latency Massive and seamless scalability Low cost Amazon DynamoDB
  24. 24. Amazon DynamoDB: a managed document and key-value store Simple and fast to deploy Simple and fast to scale • To millions of IOPS Data is automatically replicated Fast, predictable performance • Backed by SSD storage Secondary indexes offer fast lookups No cost to get started; pay only for what you consume
  25. 25. Popular use cases Ad serving, retargeting, ID lookup, user profile management, session- tracking, RTB Tracking state, metadata and readings from millions of devices, real-time notifications Recording game details, leaderboards, session information, usage history, and logs Storing user profiles, session details, personalization settings, entity specific metadata Ad Tech IoT Gaming Mobile & Web
  26. 26. Writes Replicated continuously to 3 AZs Persisted to disk (custom SSD) Reads Strongly or eventually consistent No latency trade-off Automatic replication for rock-solid durability and availability
  27. 27. Amazon DynamoDB is a schemaless database Table Items Attributes (name- value pairs)
  28. 28. Each item must include a key Hash key (DynamoDB maintains an unordered index)
  29. 29. Each item must include a key Hash key Range key (DynamoDB maintains a sorted index)
  30. 30. Local secondary indexes = alternate range keys Hash key Range key LSI key
  31. 31. Global secondary indexes = “pivot charts” for your table Choose which attributes to project (if any)
  32. 32. Define the desired performance using provisioned throughput Read capacity units Write capacity units 1 RPS > 2.5 M requests in a month
  33. 33. DynamoDB: What are capacity units? One write per second up to 1KB One strongly consistent read per second up to 4KB or Two eventually consistent reads per second One write capacity unit One read capacity unit
  34. 34. Simple app architecture with Amazon DynamoDB Elastic Load Balancing Amazon EC2 app instances Clients DynamoDB Business logic
  35. 35. How DynamoDB billing works Monthly bill = GB + Assumes DB instance accessed only from AWS region Further details at http://aws.amazon.com/dynamodb/pricing/ ≈ 5 GB * $0.25 + 21 * 720 hrs * $0.0065/10 + 35 * 720 hrs * $0.0065/50 ≈ $14.36 Storage consumed (plus 100 bytes per item) Charge for write capacity units per hour + Charge for read capacity units per hour
  36. 36. How DynamoDB billing works (with free tier) Monthly bill = GB + Assumes DB instance accessed only from AWS region Further details at http://aws.amazon.com/dynamodb/pricing/ ≈ 5–25 GB * $0.25 + 21–25 * 720 hrs * $0.0065/10 + 35–25 * 720 hrs * $0.0065/50 Storage consumed (plus 100 bytes per item) Charge for write capacity units per hour Charge for read capacity units per hour Free tier (for first 12 months) • 25 GB Storage • 25 Units Write Capacity • 25 Units Read Capacity +
  37. 37. How DynamoDB billing works (with free tier) Monthly bill = GB + Assumes DB instance accessed only from AWS region Further details at http://aws.amazon.com/dynamodb/pricing/ ≈ 0 + 0 + 10 * 720 hrs * $0.0065/50 ≈ $0.94 Storage consumed (plus 100 bytes per item) Charge for write capacity units per hour + Charge for read capacity units per hour
  38. 38. Selected DynamoDB customers
  39. 39. NoSQL vs. SQL for a new app: how to choose? • Strong schema, complex relationships, transactions and joins • Scaling is difficult • Focus on consistency over scale and availability • Schema-less, easy reads and writes, simple data model • Scaling is easy • Focus on performance and availability at any scale NoSQL SQL
  40. 40. What is Amazon Redshift?
  41. 41. Amazon Redshift a lot faster a lot cheaper a whole lot simpler Relational data warehouse Massively parallel; petabyte scale Fully managed HDD and SSD platforms $1,000/TB/year; starts at $0.25/hour
  42. 42. Who uses Amazon Redshift? • Reduce costs by extending DW rather than adding HW • Migrate completely from existing DW systems • Respond faster to business; provision in minutes • Improve performance by an order of magnitude • Make more data available for analysis • Access business data via standard reporting tools • Add analytic functionality to applications • Scale DW capacity as demand grows • Reduce HW and SW costs by an order of magnitude Traditional enterprise DW Companies with big data SaaS companiesCompanies with big data
  43. 43. Amazon Redshift architecture Leader node • Simple SQL endpoint • Stores metadata • Optimizes query plan • Coordinates query execution Compute nodes • Local columnar storage • Parallel/distributed execution of all queries, loads, backups, restores, resizes Start at just $0.25/hour, grow to 2 PB (compressed) • DC1: SSD; scale 160 GB–326 TB • DS2: HDD; scale 2 TB–2 PB 10 GigE (HPC) Ingestion Backup Restore JDBC/ODBC
  44. 44. Amazon Redshift dramatically reduces I/O • With row storage, you do unnecessary I/O • To get total amount, you have to read everything ID Age State Amount 123 20 CA 500 345 25 WA 250 678 40 FL 125 957 37 WA 375 • Column storage • Data compression • Zone maps • Direct-attached storage
  45. 45. • With column storage, you only read the data you need ID Age State Amount 123 20 CA 500 345 25 WA 250 678 40 FL 125 957 37 WA 375 Amazon Redshift dramatically reduces I/O • Column storage • Data compression • Zone maps • Direct-attached storage
  46. 46. analyze compression listing; Table | Column | Encoding ---------+----------------+---------- listing | listid | delta listing | sellerid | delta32k listing | eventid | delta32k listing | dateid | bytedict listing | numtickets | bytedict listing | priceperticket | delta32k listing | totalprice | mostly32 listing | listtime | raw Amazon Redshift dramatically reduces I/O • COPY compresses automatically • You can analyze and override • More performance, less cost • Column storage • Data compression • Zone maps • Direct-attached storage
  47. 47. Amazon Redshift dramatically reduces I/O 10 | 13 | 14 | 26 |… … | 100 | 245 | 324 375 | 393 | 417… … 512 | 549 | 623 637 | 712 | 809 … … | 834 | 921 | 959 10 324 375 623 637 959 • Track the minimum and maximum value for each block • Skip over blocks that don’t contain relevant data • Column storage • Data compression • Zone maps • Direct-attached storage
  48. 48. Amazon Redshift dramatically reduces I/O • Column storage • Data compression • Zone maps • Direct-attached storage DW.HS1.8XL: • > 2 GB/sec scan rate • Optimized for data processing • High disk density DW.HS1.XL:
  49. 49. Fully managed, continuous/incremental backups Multiple copies within cluster Continuous and incremental backups to Amazon S3 Continuous and incremental backups across regions Streaming restore Amazon S3 Amazon S3 Region 1 Region 2
  50. 50. Amazon Redshift offers rock-solid fault tolerance Amazon S3 Amazon S3 Region 1 Region 2 Disk failures Node failures Network failure AZ/region level disasters
  51. 51. You pay for what you use Further details at https://aws.amazon.com/redshift/pricing/ Monthly bill = N × Number of nodes Duration for which the nodes were used (Price depends on type of node) Free Tier (2 month free trial) • 750 DC1.Large hours per month
  52. 52. Redshift has a large ecosystem Data Integration Systems IntegratorsBusiness Intelligence
  53. 53. Selected Amazon Redshift customers
  54. 54. What is Amazon ElastiCache?
  55. 55. In-memory key-value store High-performance Resizable in-memory caching Memcached and Redis Fully managed; zero admin Compatible with your existing applications Amazon ElastiCache
  56. 56. Popular use cases Caching layer for performance or cost optimization of an underlying database Storage of ephemeral key-value data High-performance application patterns such as leaderboards (for gaming users), session management, event counters, in-memory lists
  57. 57. • Fully managed • Cache node auto-discovery • Multi-AZ node placement Key ElastiCache features • Fully managed • Multi-AZ with auto-failover • Persistence • Read replicas
  58. 58. Amazon ElastiCache: simple app architecture Elastic Load Balancing Amazon EC2 app instances Clients Amazon RDSAmazon ElastiCache
  59. 59. Amazon ElastiCache: resilient app architecture Elastic Load Balancing Clients AZ a AZ b
  60. 60. How ElastiCache billing works Monthly bill = N × Further details at http://aws.amazon.com/elasticache/pricing/ Duration for which the nodes were used Number of nodes (Price depends on type of node) Free tier (for first 12 months) • 750 micro cache node hours
  61. 61. Selected ElastiCache customers
  62. 62. Managed DB services: better together Elastic Load Balancing Clients AZ a AZ b
  63. 63. Next Steps Free Tier DynamoDB RDS ElastiCache Redshift
  64. 64. Thank you!

×