AWS Summit 2013 | Singapore - Understanding Databases Options


Published on

With AWS you can choose the right database for the right job. Given the myriad of choices, from relational databases to non-relational stores, this session will profile details and examples of some of the choices available to you (MySQL, RDS, Elasticache, Redis, Cassandra, MongoDB and DynamoDB), with details on real world deployments from customers using Amazon RDS, ElastiCache and DynamoDB.

Published in: Technology
1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

AWS Summit 2013 | Singapore - Understanding Databases Options

  1. 1. Jeff Barr Chief Evangelist, AWS 18 July, 2013 Understanding Database Options on AWS
  2. 2. We want to make it easy for you to go from 1. Zero to Application in ____ Minutes 2. Zero to Millions of users in ____ Days 3. Zero to “Profits!” ASAP
  3. 3. Focus on your application
  4. 4. Spectrum of options SQL NoSQL Low Cost High Cost  Do-it-yourself Fully Managed Not available on AWS
  5. 5. Spectrum of options SQL NoSQL Do-it-yourself Fully Managed
  6. 6. RDS - MySQL - Oracle - SQL Server Spectrum of options SQL NoSQL Do-it-yourself Fully ManagedMySQL Oracle SQL Server PostgreSQL Your favorite RDBMS
  7. 7. Spectrum of options SQL NoSQL Do-it-yourself Fully Managed MongoDB Cassandra Redis Memcache Amazon DynamoDB Amazon ElastiCache
  8. 8. Thinking about the questions Should I use SQL or NoSQL? Should I use MySQL on EC2 or RDS? Should I use MongoDB, Cassandra, or DynamoDB? Should I use Redis, Memcache, or ElastiCache? ?
  9. 9. Actually, thinking about the right questions What are my scale and latency needs? What are my transactional and consistency needs? What are my read/write, storage and IOPS needs? What are my time to market and server control needs? ?
  10. 10. What’s important for your application and your team? Factors SQL NoSQL Application • App with complex business logic? • Web app with lots of users? Transactions • Complex transactions, joins, updates? • Simple data model, updates, queries? Scale • Developer managed • Automatic, on-demand scaling Performance • Developer architected • Consistent, high performance at scale Availability • Architected for fail-over • Seamless and transparent Core Skills • SQL + Java/Ruby/Python/PHP • NoSQL + Java/Ruby/Python/PHP Best of both worlds: Use both SQL and NoSQL models in one app
  11. 11. Where do you want to spend your time? Factors Do it Yourself (DIY) Fully Managed Replication • Granular, app managed • Transparent to the app and configured by the service Monitoring • Specific agents and custom • Automated and API driven Security • Root access, custom configurations • Hardened by the service Resources • Requires more dev resources and time • Requires minimal dev resources and time Time to market • Sophistication vs. speed • Rapid iteration Required Skills • Systems, databases, monitoring focused • Application development, User centric Best of both worlds: Possible to manage different tiers differently
  12. 12. We believe in choice – one size does not fit all Amazon RDS + ElastiCache Amazon DynamoDB Amazon Redshift Traditional Apps Relational DB Needs New Web Apps Massive Scalability High Performance, High Scale Data Warehouses
  13. 13. Amazon RDS is a fully managed SQL database service Simple to deploy and scale Without any operational burden Reliable and cost effective Choice of database engines
  14. 14. Schema design Frequent server upgrades Storage upgrades Backup and recovery Software upgrades Patching Hardware mgmt. Query construction Query optimization Configuration management Migration Offload the “muck” to RDS Focus on the App “innovation” Amazon RDS drives developer and IT productivity
  15. 15. Amazon RDS Configuration Improve Availability Increase Throughput Reduce Latency Push-Button Scaling Multi-AZ Read Replicas Provisioned IOPS Read ReplicasPush-Button Scaling Provisioned IOPS Region Multi-AZ Availability Zone Availability Zone Amazon RDS high availability and performance options
  16. 16. Amazon RDS Read Replica A few clicks or one API call Do-it-yourself MySQL Read Replica ~30+ manual steps Creating a read replica
  17. 17. Amazon RDS Multi-AZ A few clicks or one API call Do-it-yourself MySQL on AWS Potentially ~100+ manual steps Set up primary and standby instances Set up identical volumes Create synchronous replication Create and manage DNS entries Detect instance failure conditions Detect network failure conditions Detect storage failure conditions Decide when to fail-over…. Re-establish primary secondary connections. Creating high availability database deployments
  18. 18. Who is succeeding with RDS? More than 30,000 developers use RDS every single day Gaming Web Apps Mobile/Social Media
  19. 19. Amazon RDS – Recently announced features • RDS access via IAM • MySQL 5.6 • RDS GA with SLA • MySQL 5.1 to 5.5 version upgrade • 3 TB database size & 30,000 IOPS • Online conversion from Standard to Provisioned IOPS storage • Stay tuned…
  20. 20. Easy to set up and operate Scale cache clusters with push button ease Without any operational burden Ultra fast response time for read scaling Amazon ElastiCache is a fully managed Memcached-compatible caching service
  21. 21. Amazon ElastiCache – Recently announced features • Free tier & new instance sizes (Micros and Mediums) • Amazon VPC support • Auto Discovery • Stay tuned…
  22. 22. Store and retrieve any amount of data Scale throughput to millions of I/O Without any operational burden Single-digit millisecond latencies From the creators of the first NoSQL technology Amazon DynamoDB is a fully managed NoSQL database service
  23. 23. Do-it-yourself NoSQL on AWS Amazon DynamoDB Potentially ~100s of manual steps Three clicks or one API call Select the right NoSQL Database engine Deploy hardware configurations Set up software configurations Decide and deploy replication configurations Create and manage DNS entries Detect instance failure conditions Detect network failure conditions Detect storage failure conditions Decide when to fail-over…. Re-establish application connections. Creating NoSQL deployment on AWS
  24. 24. Amazon DynamoDB: who is succeeding with it?
  25. 25. Data warehousing done the AWS way • No upfront costs, pay as you go • Really fast performance at a really low price • Open and flexible with support for popular tools • Easy to provision and scale up massively
  26. 26. Amazon Redshift is a fast, powerful, fully managed, petabyte-scale data warehouse service 10x cheaper Without any operational burden Easy to use 10x faster
  27. 27. Amazon Redshift architecture • Columnar, massively parallel processing (MPP) • Scales from hundreds of gigabytes to a petabyte or more • Connects to standard SQL-based clients and BI tools using JDBC/ODBC via Postgres drivers • Fully-managed service • Pay as you go, no software license fees • VPC, SSL, and transparent data encryption 10 GigE (HPC) Ingestion Backup Restore JDBC/ODBC
  28. 28. Resources & Questions • •
  29. 29. Technical Track