IVS CTO Night And Day 2018 Winter - [re:Cap] AWS Databases

•

0 likes•302 views

The document discusses Amazon Web Services (AWS) databases and database migration services. It provides overviews of AWS Aurora, Amazon DynamoDB, Amazon ElastiCache, and the AWS Database Migration Service. New features are highlighted for Aurora MySQL and PostgreSQL, DynamoDB transactions and on-demand mode, ElastiCache for Redis 5.0, and using Elasticsearch Service and Kinesis Data Streams as targets for database migration. Capabilities around global databases, parallel querying, security and performance monitoring are also summarized.

Technology

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
[re:Cap] AWS Databases

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Aurora with MySQL 5.6
Global Databases
• 1
1
• Binlog
Global Databases Aurora
• 2018/12
Amazon Aurora MySQL: Global Databases [1/5]
Storage Storage

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora MySQL: Global Databases [2/5]

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora MySQL: Global Databases [3/5]
• (Writer) 1
• 1
• (Reader) 16
•
• 1
•
• (Writer)
(Reader) 1

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora MySQL: Global Databases [4/5]
• Remove Regional Cluster
Global Database

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora MySQL: Global Databases [5/5]
• Aurora MySQL 5.6
• Cloning Backtrack Parallel Query Serverless
• R3/R4 T2
• Global Database Remove Regional Cluster
("EngineMode": "global") Global Database
Regional Cluster
("EngineMode": "provisioned") Global Database
•
• Percona XtraBackup mysqldump

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora MySQL :
5
• Aurora MySQL
1
5
Region 0
Region 3
Region 5
Region 2Region 1
Region 4

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Serverless: Data API
• Aurora Serverless
MySQL HTTPS
AWS SDK
• AWS Lambda AWS AppSync
VPC Aurora
• JSON
1000 1MB
• API
1
• 2018/12

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Serverless:
• Data API Aurora Serverless
•
•
• 2018/12

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Parallel Query
• OLTP
Aurora MySQL
•
ETL
•
• Aurora MySQL
/ 11
/ 11
6
1
11
1 1

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora PostgreSQL 10
• Aurora with PostgreSQL 2.0
PostgreSQL 10.4
•
•
• postgres_fdw
• 2018/12

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora / RDS for PostgreSQL:
IAM
•
IAM
• 15
• M5
GRANT rds_iam TO foo;

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora:
• Aurora
•
• MySQL / PostgreSQL

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora:
• Aurora /
•
•
• 1 7
7
AZ a AZ b
AZ a AZ b

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS for MySQL 8.0
• RDS for MySQL 8.0
• WITH
• JSON
• GIS
• MySQL 5.7 2
• (DDL)
•
• Instant ADD COLUMN DDL

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS for MySQL: GTID
• RDS for MySQL
(GTID)
• GTID
• GTID MySQL
• RDS for MySQL 5.5 5.6 8.0

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS for PostgreSQL 11 Preview
• RDS for PostgreSQL 11
• PostGIS 40
•
•
•
• 60
•

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS for SQL Server:
• 1 .bak
RDS for SQL Server
/
• AZ RDS for SQL Server
•

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS: Performance Insights
•
• 7
• Performance Insights
• API SDK
• Aurora MySQL 1.17.3 5.6
Aurora PostgreSQL RDS for MySQL 5.6.41
RDS for MySQL 5.7.22
RDS for PostgreSQL 10 RDS for Oracle

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS:
Amazon CloudWatch Events
• RDS CloudWatch Events
• CloudWatch Events RDS
• CloudWatch
•
RDS
• Aurora RDS

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS: Multi-AZ
• Multi-AZ
/
• Multi-AZ
• 1 7
•
• RDS for SQL Server
AZ a AZ b
AZ a AZ b

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS:
• EC2
• EC2
•
• Aurora RDS

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS:
•
RDS
•
• DB
• Aurora RDS

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS:
T2 M4 M5 R4 R5 X1
Aurora MySQL
Aurora PostgreSQL
RDS for MySQL
RDS for MariaDB
RDS for PostgreSQL
RDS for Oracle
RDS for SQL Server

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS:
(TiB)
Aurora MySQL 64
Aurora PostgreSQL 64
RDS for MySQL 32
RDS for MariaDB 32
RDS for PostgreSQL 32
RDS for Oracle 32
RDS for SQL Server 16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon DynamoDB: Transactions [1/2]
• DynamoDB
ACID
•
•
10
10 1

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon DynamoDB: Transactions [2/2]
• Serializable
•
•
•
•

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon DynamoDB: On-Demand
• DynamoDB
Pay-per-Request
•
on-demand
•
on-demand 1 1
•
• 100 $1.25
• 100 $0.25

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon DynamoDB:
• DynamoDB AWS Key Management Service (AWS KMS)
•
•
• LSI GSI

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon ElastiCache for Redis:
250
• ElastiCache Redis Cluster
15 × 6 = 90
250
• 15
250
• 125 × 2
50 × 5 OK
• 90

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon ElastiCache for Redis: 5.0
M5 R5
• ElastiCache for Redis 5.0
• Redis 5.0
• Streams
• 0
• M5 R5
• CPU

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon ElastiCache for Redis:
T2 /
• T2 /
•
ElastiCache

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Database Migration Service (DMS):
Amazon Elasticsearch Service and
Amazon Kinesis Data Streams as targets
• DMS Elasticsearch Service
Kinesis Data Streams
• RDBMS INSERT
RDBMS /

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Database Migration Service (DMS):
Cassandra DynamoDB
• AWS Schema Conversion Tool
Cassandra DynamoDB
•
• Fullload CDC
• Multi-DC Cassandra

Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

In this session, we explore the new fully managed service that makes it easy to launch and use shared file storage for Windows applications. FSx for Windows provides fully managed file storage built on Microsoft Windows Server, providing native support for Windows file system features and for the Server Message Block (SMB) protocol. Learn about Amazon FSx for Windows File Server features and benefits, and details about its performance and security models. The target audience is storage administrators, application developers, and applications owners and infrastructure operations personnel who build or operate file-based Windows applications or NAS.

Developing with .NET Core on AWS: What's New (DEV318-R1) - AWS re:Invent 2018

Amazon Web Services

In this demonstration-heavy session, we illustrate our latest techniques, tools, and libraries for developing end-to-end applications with .NET Core. We focus on serverless applications, but the techniques are broadly relevant. We start by showing you some useful features and best practices for authoring your serverless application, including debugging locally from the IDE and in production. From there, we demonstrate some helpful tools that make it easy to set up your CI/CD workflow from the start. Finally, we deploy our application with AWS Lambda.

Understanding High Availability on Amazon Aurora

Amazon Web Services

According to AWS, Amazon Aurora is the fastest growing service in the company’s history. Many businesses are looking for guidance on how to successfully move to and manage their data on Aurora. Do you know how to launch and configure a cluster on Aurora to ensure that your high-availability and performance requirements are met? Join Eric Johnson, AWS Evangelist at Rackspace, to discuss high availability and replication on Aurora, including extending the replication patterns to meet your application’s needs. He also covers how to choose the right endpoints to optimize writes and reads, as well as the future of Aurora. Spoiler: It’s serverless!

Replicate & Manage Data Using Managed Databases & Serverless Technologies (DA...

Amazon Web Services

Organizations often have disparate datasets and find it challenging to replicate and analyze the data to drive positive business outcomes. This workshop leverages AWS managed database services and serverless technologies to help replicate, manage, and analyze data using an MLB dataset. We replicate a SQL Server database to Amazon Aurora Serverless using AWS Database Migration Service (AWS DMS) and AWS Schema Conversion Tool. At the same time, we use AWS Glue, a serverless ETL service, to transform and load the data to Amazon S3. We then use Amazon Athena to interactively analyze data using SQL to enable better business decisions. In the course of this workshop, we use: Amazon EC2, Amazon Aurora Serverless, AWS DMS, Amazon Athena, AWS Glue, and Amazon S3. Have an AWS account and some experience with databases and SQL. Bring your own laptop

Migrating Your Oracle & SQL Server Databases to Amazon Aurora (DAT318) - AWS ...

Amazon Web Services

Organizations today are looking to free themselves from the constraints of on-premises commercial databases and leverage the power of cloud-native and open-source systems. Amazon Aurora is a MySQL- and PostgreSQL-compatible relational database that is built for the cloud, with the speed, reliability, and availability of commercial databases at one-tenth the cost. In this session, we provide an overview of Aurora and its features. We talk about the latest advances in migration tooling and automation, and we explain how many of the common legacy features of Oracle and SQL Server map to modern cloud variants. We also hear from Dow Jones about its migration journey to the cloud.

Oracle enterprise applications and middleware, such as E-Business Suite, PeopleSoft, Siebel, and WebLogic, are central to many IT departments. They often require complex deployments that can greatly benefit from the flexibility, scalability, and security of the cloud. In this interactive session, we discuss architecture patterns and best practices for migrating these applications to and running these applications on AWS. We cover how to work with Oracle enterprise applications and multiple AWS services, including Amazon RDS, AWS Database Migration Service, Amazon Elastic File System, and AWS CloudFormation. We also share examples of successful customer deployments.

Hands-On: Building a Migration Strategy for SQL Server on AWS (WIN310) - AWS ...

Amazon Web Services

Designing a Migration Strategy for Your SQL Server Infrastructure (WIN322) - ...

Amazon Web Services

Running Oracle Databases on Amazon RDS and Migrating to PostgreSQL (DAT307-R1...

Amazon Web Services

If you'd like to move your Oracle databases to the cloud, this workshop is for you. We review the basics of Amazon Relational Database Service (Amazon RDS) and how Oracle databases run in Amazon RDS. We then leverage the combination of AWS Schema Conversion Tool (AWS SCT) and AWS Database Migration Service (AWS DMS), and we show you how to migrate your databases to Amazon Aurora PostgreSQL. We provide an AWS CloudFormation template to set up the entire environment for the lab. You need a laptop with a Firefox or Chrome browser and a working AWS account.

Tailor-Made SaaS: Multi-Tenant Customizations with AWS Lambda (GPSCT311) - AW...

Amazon Web Services

Customers want to bring their own code to extend managed solutions, but as a SaaS provider, running customer-provided code on your own infrastructure raises a number of concerns. In this session, we discuss approaches to building SaaS extension mechanisms using AWS Lambda that provide your customers with the operational and pricing benefits of a multi-tenant solution while still enabling them to tailor the product to their unique needs. We dive into security architectures for isolating customer code, discuss how to avoid noisy neighbor issues, and talk about the operational considerations for scaling these solutions to thousands of tenants.

Back Up SQL Server to Amazon S3 with Microsoft Tools and File Gateway (STG380...

Amazon Web Services

A widespread method to protect databases, particularly for DBAs, is to dump a database and its logs to a file share, often redundantly consuming both production and backup storage capacity, for a backup. What if that file share really lived on Amazon S3? It can. This session describes a backup architecture using File Gateway and native SQL Server and PowerShell commands deployed by AWS customer Direct Supply. Attend this session to learn how you can reduce on-premises storage while simplifying backup, recovery, and even migration of Microsoft SQL Server to AWS.

Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018

Amazon Web Services

Data Design for Microservices

Amazon Web Services

by Darin Briskman, Technical Evangelist, AWS Microservices are an architectural and organizational approach to software development where software is composed of small independent services that communicate over well-defined APIs. Microservices architectures make applications easier to scale and faster to develop, enabling innovation and accelerating time-to-market for new features. We’ll explore best practices for microservice design and the data design needed to support microservices, using Aurora, RDS, DynamoDB, DAX, ElastiCache, and Lambda and we’ll do a design exercise in converting a monolithic solution to a microservices design.

Best Practices for Running SQL Server on Amazon RDS (DAT323) - AWS re:Invent ...

Amazon Web Services

Amazon Relational Database Service (Amazon RDS) provides a managed service to run SQL Server databases in AWS. While Amazon RDS handles provisioning and maintaining the SQL Server instance, there are things you can do to ensure that the SQL Server instance is healthy. We'll review some best practices involved in configuring the Amazon RDS SQL Server instance, focusing on availability, security and migration. We'll also hear from our customer Allstate, sharing details about their use of Amazon RDS.

Build AWS CloudFormation Custom Resources (DEV417-R2) - AWS re:Invent 2018

Amazon Web Services

Custom resources enable AWS CloudFormation customers to write customized provisioning logic in templates. Such logic can be useful in changing how existing resources get created, changed, or deleted, or in including resources that are not available as supported resource types. In this session, we cover best practices, including when to use custom resources versus other programmatic alternatives. We also cover existing custom resources that are available for download and reuse.

PreReLa #1 (PRL1-R1) - AWS re:Invent 2018Amazon Web Services

Migrating Databases to the Cloud with AWS Database Migration Service (DAT207)...

Amazon Web Services

Learn how to convert and migrate your relational databases, nonrelational databases, and data warehouses to the cloud. AWS Database Migration Service (AWS DMS) and AWS Schema Conversion Tool (AWS SCT) can help with homogeneous migrations as well as migrations between different database engines, such as Oracle or SQL Server, to Amazon Aurora. Hear from Verizon about how they intend to migrate critical databases to Amazon Aurora with PostgreSQL compatibility from their current on-premises Oracle databases, and learn how they intend to deal with challenges such as conversion of legacy code and complex data types, supporting business resiliency, and maintaining data synchronization during the transition phase.

Building Serverless Analytics Solutions with Amazon QuickSight (ANT391) - AWS...

Amazon Web Services

Querying and analyzing big data can be complicated and expensive. It requires you to setup and manage databases, data warehouses, and business intelligence (BI) applications—all of which require time, effort, and resources. Using Amazon Athena and Amazon QuickSight, you can avoid the cost and complexity by creating a fast, scalable, and serverless cloud analytics solution without the need to invest in databases, data warehouses, complex ETL solutions, and BI applications. In this session, we demonstrate how you can build a serverless big data analytics solution using Amazon Athena and Amazon QuickSight.

Optimizing Amazon EBS for Performance (CMP317-R2) - AWS re:Invent 2018

Amazon Web Services

What's New in Amazon Aurora (DAT204-R1) - AWS re:Invent 2018

Amazon Web Services

Migrating Your NoSQL Database to Amazon DynamoDB (DAT314) - AWS re:Invent 2018

Amazon Web Services

AWS Database Migration Service (AWS DMS) and AWS Schema Conversion Tool (AWS SCT) can help migrate databases from many supported data sources to supported targets. In this session, we review how the combination of AWS DMS and AWS SCT can help migrate your NoSQL databases, such as MongoDB and Cassandra, to Amazon DynamoDB. We provide an overview of AWS DMS and AWS SCT, and we demonstrate migrating a sample Cassandra database into DynamoDB.

Scaling Up to Your First 10 Million Users (ARC205-R1) - AWS re:Invent 2018

Amazon Web Services

Cloud computing provides a number of advantages, such as the ability to scale your web application or website on demand. If you have a new web application and want to use cloud computing, you might be asking yourself, "Where do I start?" Join us in this session for best practices on scaling your resources from one to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud.

Accelerate Data Analytics at Scale with Amazon EMR

Amazon Web Services

Best Practices for Migrating Oracle Databases to the Cloud - AWS Online Tech ...

Amazon Web Services

Deep Dive on Amazon Aurora MySQL Performance Tuning (DAT429-R1) - AWS re:Inve...

Amazon Web Services

Amazon Aurora offers several options for monitoring and optimizing MySQL database performance. These include Enhanced Monitoring and Performance Insights, an easy-to-use tool for assessing the load on your database and identifying slow-performing queries. In this session, learn how to tune the performance of your Aurora database with MySQL compatibility, whether your application is in development or in production.

Serverless Architectural Patterns: Collision 2018

Amazon Web Services

What's hot

Running Your SQL Server Database on Amazon RDS (DAT329) - AWS re:Invent 2018

Amazon Web Services

Oracle Enterprise Solutions on AWS (GPSCT203) - AWS re:Invent 2018

Amazon Web Services

Hands-On: Building a Migration Strategy for SQL Server on AWS (WIN310) - AWS ...

Amazon Web Services

Designing a Migration Strategy for Your SQL Server Infrastructure (WIN322) - ...

Amazon Web Services

Running Oracle Databases on Amazon RDS and Migrating to PostgreSQL (DAT307-R1...

Amazon Web Services

Tailor-Made SaaS: Multi-Tenant Customizations with AWS Lambda (GPSCT311) - AW...

Amazon Web Services

Back Up SQL Server to Amazon S3 with Microsoft Tools and File Gateway (STG380...

Amazon Web Services

Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018

Amazon Web Services

Data Design for Microservices

Amazon Web Services

Best Practices for Running SQL Server on Amazon RDS (DAT323) - AWS re:Invent ...

Amazon Web Services

Build AWS CloudFormation Custom Resources (DEV417-R2) - AWS re:Invent 2018

Amazon Web Services

PreReLa #1 (PRL1-R1) - AWS re:Invent 2018Amazon Web Services

Migrating Databases to the Cloud with AWS Database Migration Service (DAT207)...

Amazon Web Services

Building Serverless Analytics Solutions with Amazon QuickSight (ANT391) - AWS...

Amazon Web Services

Optimizing Amazon EBS for Performance (CMP317-R2) - AWS re:Invent 2018

Amazon Web Services

What's New in Amazon Aurora (DAT204-R1) - AWS re:Invent 2018

Amazon Web Services

Migrating Your NoSQL Database to Amazon DynamoDB (DAT314) - AWS re:Invent 2018

Amazon Web Services

Scaling Up to Your First 10 Million Users (ARC205-R1) - AWS re:Invent 2018

Amazon Web Services

Accelerate Data Analytics at Scale with Amazon EMR

Amazon Web Services

Best Practices for Migrating Oracle Databases to the Cloud - AWS Online Tech ...

Amazon Web Services

What's hot (20)