AWS Webcast - Amazon RDS - Running Low Admin High Performance Databases in the Cloud

Like this? Share it with your network

Share

AWS Webcast - Amazon RDS - Running Low Admin High Performance Databases in the Cloud

  • 3,396 views
Uploaded on

Amazon Relational Database Service (Amazon RDS) makes it easy to set up, operate, and scale a relational database in the cloud. It provides cost-efficient and re-sizable capacity while managing......

Amazon Relational Database Service (Amazon RDS) makes it easy to set up, operate, and scale a relational database in the cloud. It provides cost-efficient and re-sizable capacity while managing time-consuming database administration tasks, freeing you up to focus on your applications and business.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
3,396
On Slideshare
3,328
From Embeds
68
Number of Embeds
2

Actions

Shares
Downloads
74
Comments
0
Likes
11

Embeds 68

https://twitter.com 57
http://tweets.valtellinux.it 11

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Amazon RDSRunning Low AdminHigh Performance Databasesin the CloudShakil Langha (slangha@amazon.com)Business Development Manager ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 2. What is AWS? Deployment & Administration Application Services Compute Storage Database Networking AWS Global Infrastructure ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 3. AWS Database Amazon Redshift Services Fast, Powerful, Fully Managed, Petabyte-Scale Data Warehouse Service Amazon DynamoDBScalable High Performance Application Storage in the Fast, Predictable, Highly-Scalable NoSQL Data Store Cloud Amazon RDS Deployment & Administration Managed Relational Database Service for MySQL, Oracle and SQL Server Application Services Amazon ElastiCache In-Memory Caching Service Compute Storage Database Networking AWS Global Infrastructure ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 4. AWS Database Amazon Redshift Services Fast, Powerful, Fully Managed, Petabyte-Scale Data Warehouse Service Amazon DynamoDBScalable High Performance Application Storage in the Fast, Predictable, Highly-Scalable NoSQL Data Store Cloud Amazon RDS Deployment & Administration Managed Relational Database Service for MySQL, Oracle and SQL Server Application Services Amazon ElastiCache In-Memory Caching Service Compute Storage Database Networking AWS Global Infrastructure ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 5. Why Managed Databases? security documentation, licensing & planning scripting & coding training 5% 5% performance tuninginstall, upgrade, patch and 40% 25%migrate differentiated effort increases the backup & recovery, data load & unload uniqueness of an application ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 6. Amazon RDS RDS is a fully managed relational database service that is simple to deploy, easy to scale, reliable and cost-effective Choice of DB Engines and Application Compatibility Ease of Deployment and Patching Automated Backups and Disaster Recovery User Snapshots and Cloning Push Button Scalability Monitoring and Automatic Host Replacement ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 7. Case Study: Samsung saved $34M Problem Needed to reduce IT costs and were looking to create a more flexible IT environment Solution AWS and RDS services. With every request, the application authenticates devices, delivers apps and content, and pushes notifications. Business Benefits Saved $34M in hardware and maintenance expenses, 85% less than running on-premises ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 8. Case Study: Gumi serves millions of users Problem Outgrew existing IT environment Solution AWS’s elasticity made it easy to respond to demand peaks and saved money during off peak times Business Benefits Scaled to handle 10 million visitors per day Reduced time-to-market and dev time ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 9. Case Study: Intuit Live Community Challenges Time to Market – Faster release cycles Cost – Millions of users, Seasonal peaks Reliability – Fast, Always ON Solution Use Amazon EC2, RDS, CloudFormation Multiple Availability Zones (by default) Business Benefits Uptime greater than 99.9% Hands free recovery using Amazon RDS Monthly to weekly release cycles ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 10. Flipboard Serves Billions of Pages With RDS Challenges 6 months to deploy a real-time, socially relevant magazine 5 million users, 2 billion page flips per month Allow frequent changes system and user requirements Solution Amazon EC2, RDS, ElastiCache Multiple Availability Zones Business Benefits High performance, reliable, proven DB technology Better Response time (Milliseconds) and uptime Complex queries on user and relevancy data ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 11. Low Admin ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 12. Key Features • Manageability • Rapid deployment with pre-configured parameters • Patch Management • Monitoring and Metrics • Availability and Data Durability • Automated Backups and Point-In-Time-Recovery • DB Snapshots • Automatic Host Replacement (Single-AZ) • Multi-AZ deployments • Scalability • Push-Button Scaling (Storage, Memory and Compute) • Read Replicas ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 13. Rapid deployment via Web Console ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 14. Backups and Recovery • DB Snapshots • User-driven snapshots of database • Kept until explicitly deleted • Automated Backups • Nightly system snapshots + transaction backup • Enables point-in-time restore to any point in retention period, up to the last 5 minutes • Max retention period = 35 days ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 15. Push Button Scaling • Scale nodes vertically up or down • M1.small (1 virtual core, 1.7GB) • M2.4XLarge (8 virtual cores, 64GB) • Scale out nodes horizontally • Shard based on data or workload characteristics • Scale Storage vertically without incurring downtime ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 16. High Availability: Multi-AZ Deployments • Enterprise-grade fault tolerance solution for production databases • With a few clicks, Amazon RDS creates and synchronously maintains a standby in a different Availability Zone • Automatic failover in case of: • Loss of availability in primary AZ • Loss of connectivity to primary • Host or storage failure on primary • Vertical Scaling • Software patching ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 17. Creating High Availability Databases Do It Yourself MySQL replication Amazon RDS Multi-AZ Set up primary and standby instances Set up identical volumes Create synchronous replication Create and manage DNS entries Detect instance failure conditions Detect network failure conditions Detect storage failure conditions Decide when to fail-over…. Re-establish primary secondary connections. Potentially ~100+ Manual steps HA with a mouse click ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 18. Horizontal Scaling with Read Replicas • Add Read Replicas • Horizontal scaling of read heavy workloads • Offload reporting • Keep in mind • Asynchronous, native tech • Single threaded and brittle • Currently available for MySQL • Overcoming challenges • RDS makes it easy to re-create if fallen behind • Deploy a proxy to round robin requests ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 19. Creating a Read Replica Do It Yourself MySQL Read Replica Amazon RDS Read Replica ~30+ manual steps Read Replica with a mouse click ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 20. High Performance ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 21. High Performance RDS ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 22. “We leveraged Amazon RDS Provisioned IOPS to decrease processing time for our Oracle applications from 96 to 24 hours.” - Adam Kierce, Principal and Co-Founder The Story Business Benefit• Australian consulting firm that provides software development services to the energy, • Able to run applications on AWS without changing the existing technology telecommunications, finance and retail industries stack or user interface• Enterprise clients found the Oracle-based applications costly to run on an on-premises • Test confirmed that utilizing Amazon RDS for Oracle Database and Amazon infrastructure RDS Provisioned IOPS reduced processing time from 96 to 24 hours• Shine wanted to run the applications as a cloud-based service but had to port a large, ten- • Estimates a 50% cost savings over a three-year period year-old Oracle Database• Using Amazon RDS for Oracle Database, Amazon RDS Provisioned IOPS, Amazon EC2, Amazon VPC, and Multi-AZ ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 23. Provisioned IOPS: Details Provision up to 3TB and 30,000 IOPS Engine Max IOPS for m2.4xlarge Oracle (3TB) 25,000 MySQL (3TB) 12,500 SQL Server (1TB) 10,000 Provisioning more than max per engine reduces latency Convert from Standard to Provisioned IOPS storage Scale storage and IOPS independently on-line ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 24. Parameters of RDS Performance Instance Size CPU Memory Bandwidth P-IOPS Optimized Provisioned IOPS I/O Performance Allocated Storage # of Storage Volumes ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 25. RDS for Production Workloads Multi-AZ Amazon RDS Improve Increase Reduce Configuration Availability Throughput Latency Push-Button Scaling Multi AZ Read Replicas Availability zone Availability zone Provisioned IOPS Region Push-Button Scaling Read Replicas Provisioned IOPS ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 26. Data Migration ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 27. Migrating to RDS Basic Advanced Not Supported Migrations Migrations Incremental Export/Import Loads Restore from backup Bulk Load 3rd Party Tools ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 28. Basic Migration On Premises AWS ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 29. RDS Basic Migration Advantages MySQL Oracle SQL Server • Simple • Ideal for initial load • Can be used for small Gen./Publish mysqldump Data Pump or large datasets Scripts Disadvantages mysqlimport SQL*Loader Bulk Copy • Requires downtime ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 30. Advanced Migration T2 T1 T2 T1 DB Copy Dump Backup Apply Delta Changes On Premise AWS ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 31. RDS Advanced Migration Advantages MySQL Oracle SQL Server • Incremental loads • Inbound replication • Minimizes downtime Mview Linked mysqlbinlog replication Servers Disadvantages • Complex Tungsten GoldenGate SSIS Replicator Dbvisit ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 32. Post-migration Steps • Turn on Backups • Turn on Multi-AZ • Create Read Replicas • Tighten down security • Notifications via CloudWatch, DBEvents ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 33. More Information • RDS Home Page: https://aws.amazon.com/rds/ • RDS FAQs: http://aws.amazon.com/rds/faqs/ • RDS Webinars: https://aws.amazon.com/resources/databaseservices/webinars/ • RDS MySQL Import: http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/MySQL.Procedural.Importing.html • RDS SQL Server Import: http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/SQLServer.Procedural.Importing.html • RDS Oracle Import: http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Oracle.Procedural.Importing.html ©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
  • 34. Questions?©2013, Amazon Web Services LLC or its affiliates. All rights reserved.