SlideShare a Scribd company logo
1 of 35
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tobias Börjeson
Solutions Architect, AWS
Peter Düsterdich
Head of Game Reliability Engineering Team, MovieStarPlanet
Managed NoSQL databases
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Characteristics of Internet Scale Applications
Key-valueRelational Document Graph
;
Users >1M
Data volume TB-PB-EB
Locality Global
Performance Milliseconds-Microseconds
Request rate Millions
Access Mobile, IoT, Devices
Scale Up-Out-In
Economics Pay as you go
Developer access Instant API access
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
purpose
noun | pur·pose | ˈpər-pəs
The reason for which something is done or created
or for which something exists
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Driving Adoption of Non-relational Databases
Addressing need for massive scale, low latency, and schema flexibility
Referential integrity with
strong consistency,
transactions, and hardened
scale
GraphKey value Document
;
Relational
Low latency key-based
queries with high
throughput and fast
ingestion of data
Indexing and storing
documents with support
for query on any
property
Creating and
navigating relations
between data quickly
and easily
Complex query support
via SQL
Simple query methods
with filters
Simple query with filters,
projections, and
aggregates
Easily express queries in
terms of relations
Non-relational
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Non-relational
Amazon DynamoDB Amazon ElastiCache
Key value | Document
Non-relational
AWS Database Migration Service
Amazon Neptune
Graph
AWS Non-relational Databases
Purpose built for specific application use cases
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon DynamoDB
Fast and flexible NoSQL database service for any scale
Fast, consistent
performance
Highly scalable Fully managed Business critical
reliability
Consistent single-digit
millisecond latency; DAX in-
memory performance reduces
response times to microseconds
Automatic scaling to
hundreds of terabytes of
data that serve millions
of requests per second
Automatic provisioning,
infrastructure
management, scaling,
and configuration with
zero downtime
Data is replicated across
fault-tolerant Availability
Zones, with fine-grained
access control
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon DynamoDB Schema
Table
Items
Attributes
Partition
Key
Sort
Key
Mandatory
Key-value access pattern
Determines data distribution
Optional
Model 1:N relationships
Enables rich query capabilities
All items for key
==, <, >, >=, <=
“begins with”
“between”
“contains”
“in”
sorted results
counts
top/bottom N values
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Server 1
T1.p1
Table1 Table2 Table3
Server N
T1.p2
Behind the scenes…
1K WCU or 3K RCU
Up to 10 GB
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
VPC
Endpoints
April 2017
Auto
Scaling
June 2017
DynamoDB
Accelerator (DAX)
April 2017
Time to
Live (TTL)
February 2017
Global Tables
N E W !
Backup and
Restore
N E W !
Amazon DynamoDB
Delivering on customer needs
Encryption at rest
N E W !
February 2018November 2017November 2017
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ID Name Size Expiry
1234 A 100 1456702305
2222 B 240 1456702400
3423 C 150 1459207905
• Automatically delete items from a table based on
expiration time stamp
• User-defined TTL attribute in epoch time format
• TTL activity recorded in DynamoDB Streams
TTL Attribute
Features
Key benefits
• Reduce costs by deleting items no longer needed
• Optimize application performance by controlling
table size growth
• Trigger custom workflows with Streams and
Lambda
Scaling Storage: Time-to-live (TTL)
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon VPC Endpoints
• Access DynamoDB via secure Amazon Virtual
Public Cloud (Amazon VPC) endpoint
• Control access to tables via each VPC endpoint
with unique IAM roles and permissions
Features
Key benefits
• Turn off access from public internet gateways
enhancing privacy and security
• Fast, secure data transfer between Amazon VPC
and DynamoDB
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
DynamoDB Accelerator (DAX)
In-memory performance and throughput. More than an order of magnitude faster!
Milliseconds to
microseconds
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Scaling Throughput: Auto Scaling
$$$ Savings
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
DynamoDB Global Tables
First fully managed, multi-master, multi-region database
Build high performance, globally distributed
applications
Low latency reads & writes to locally available
tables
Disaster proof with multi-region redundancy
Easy to set up, and no application rewrites
required
Globally dispersed users
Replica (N. America)
Replica (Europe)
Replica (Asia)
Global app
Global Table
NEW!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon DynamoDB – Backup and Restore
First NoSQL database to automate on demand and continuous backups
Point in time restore
for short-term
retention and data
corruption protection
Back up hundreds of
TB instantaneously
with no performance
impact
On-demand
backups for long-
term data archival
and compliance
NEW!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon DynamoDB
Encryption at rest
Server-side
encryption
Support
compliance
certifications
No application
code rewrites
NEW!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Internet scale applications need low latency and high throughput
In-memory data stores and caches:
• Deliver sub-millisecond performance
• Deliver high throughput to support millions of users
• Significantly reduce cost-at-scale
Gaming
leaderboards
Social
media
Ride
hailing
Session
stores
Media
streaming
Dating
Why Use In-Memory Data Stores and Caches
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon ElastiCache
Fully managed, Redis or Memcached compatible, in-memory data store and cache
Extreme performance Secure & hardened Easily scalable Highly available & reliable
In-memory data store and
cache for sub-millisecond
response times
VPC for cluster isolation,
encryption at rest and
transit, and HIPAA
compliance
Read scaling with
replicas, write and
memory scaling with
sharding, undisruptive
scaling
Multi-AZ with automatic
failover
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon ElastiCache
Online cluster resizing Encryption Compliance R4 Instances
Scale-out or scale-in
Redis clusters
without downtime
Secure internode
communications &
backups
Scale to 6.1 TiB of in-
memory data for Redis
and 8.14 TiB for
Memcached
HIPAA eligibility for
ElastiCache for Redis
NEW in the last 12 months!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
0–5461
Shard 1 Shard 2 Shard 3
5462–10922 10923–16383
aws elasticache modify-replication-group-shard-configuration --replication-group-id
rep-group-id
--apply-immediately --node-group-count 5
Simple API
Scale in || Out
Online Cluster Resizing – Zero Downtime
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
0–5461
Reads & writes
Shard 1 Shard 2 Shard 3
Added Added
Shard 4 Shard 5
5462–10922 10923–163830–2909,
5095–5461
5462–5783,
6876–9830
10923–14199
2910–5094,
9831–10922
No application interruption
Uniform slot distribution across shards
5784–6875,
14200–16383
Online Cluster Resizing – Scale Out
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
0–5461
Reads & writes
Shard 1 Shard 2 Shard 3
Removed Removed
Shard 4 Shard 5
5462–10922 10923–16383
Uniform slot distribution across shards
No application interruption
Online Cluster Resizing – Scale In
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Encryption and Compliance
Encryption
• In-transit: Encrypt all communications between clients and
Redis server as well as between nodes
• At-rest: Encrypt backups on disk and in Amazon S3
• Fully managed: Set up via API or console, automatic
issuance, and renewal
Compliance
• HIPAA eligibility for ElastiCache for Redis
• Included in AWS Business Associate Addendum
• Redis 3.2.6
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Other Launches
R4 instances
• Scale to 64 vCPUs, 488 GiB DDR4 memory, and 20-GiB network
• With Redis cluster, customers can scale to 6.1 TiB of memory
Flexible reconfiguration
• Launched February 2017
• Flexible reconfiguration based on backup and restore
• Allows going from noncluster mode to cluster mode
• Change replication factor
• Change number of shards
Test failover
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Session
management
Database caching APIs
(HTTP responses)
IoT
Real-time data
analytics
(filtering/aggregation)
Pub/Sub
Social media
(Sentiment analysis)
Standalone
database
(metadata store)
Gaming
leaderboards
Usage Patterns
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Caching
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Real-time Analytics
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Gaming Leaderboards
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Highly Connected Data Best Represented in a Graph
Social news feed Restaurant recommendations Retail fraud detection
Is friend of Likes
Likes
Serves
Serves
Located in
Location:
New York
Name:
Sushi
Name:
Sushi
Cuisine:
Sushi
Located in
Is friend of
Friends
Use Like Like Connect
Play Check In Read
Country City Address
Credit Card
Email Address
Date
Product
IP Order
Person
Phone
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Too expensive
Difficult to maintain
high availability
Difficult to scale
Limited support for
open standards
$
Existing Graph DatabasesRelational Databases
Inefficient graph
processing
Unnatural for
querying graph
Rigid schema inflexible
for changing graphs
Challenges building apps with highly connected data
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Neptune
Fully managed graph database
Fast & scalable ReliableOpen
Query billions of
relationships with
millisecond latency
Six replicas of your data
across three AZs with
full backup and restore
Build powerful
queries easily with
Gremlin and SPARQL
Supports Apache
TinkerPop & W3C
RDF graph models
Easy
Gremlin
SPARQL
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customers of AWS Non-relational Databases
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS databases and analytics
Broad and deep portfolio, purpose-built for builders
DW | Big Data Processing | Interactive
Business Intelligence & Machine Learning
Data Movement
Database Migration Service | Snowball | Snowmobile | Kinesis Data Firehose | Kinesis Data Streams
Amazon QuickSight
Relational Databases
RDS
Aurora
Data Lake
Amazon S3/Amazon Glacier AWS Glue
(ETL & Data Catalog)
SageMaker
Non-Relational Databases Analytics
DynamoDB
ElastiCache
(Redis, Memcached)
Neptune
(Graph)
Amazon
Redshift
EMR Athena
Kinesis
Data
Analytics
Elasticsearch
Service
Real-time
Amazon Comprehend
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you

More Related Content

What's hot

Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018
Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018
Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018Amazon Web Services
 
Making the Most of Data in Multiple Data Sources (with Virtual Data Lakes)
Making the Most of Data in Multiple Data Sources (with Virtual Data Lakes)Making the Most of Data in Multiple Data Sources (with Virtual Data Lakes)
Making the Most of Data in Multiple Data Sources (with Virtual Data Lakes)DataWorks Summit
 
AWS re:Invent 2016: Fireside chat with Groupon, Intuit, and LifeLock on solvi...
AWS re:Invent 2016: Fireside chat with Groupon, Intuit, and LifeLock on solvi...AWS re:Invent 2016: Fireside chat with Groupon, Intuit, and LifeLock on solvi...
AWS re:Invent 2016: Fireside chat with Groupon, Intuit, and LifeLock on solvi...Amazon Web Services
 
Data Transformation Patterns in AWS - AWS Online Tech Talks
Data Transformation Patterns in AWS - AWS Online Tech TalksData Transformation Patterns in AWS - AWS Online Tech Talks
Data Transformation Patterns in AWS - AWS Online Tech TalksAmazon Web Services
 
Modern Cloud Data Warehousing ft. Intuit: Optimize Analytics Practices (ANT20...
Modern Cloud Data Warehousing ft. Intuit: Optimize Analytics Practices (ANT20...Modern Cloud Data Warehousing ft. Intuit: Optimize Analytics Practices (ANT20...
Modern Cloud Data Warehousing ft. Intuit: Optimize Analytics Practices (ANT20...Amazon Web Services
 
Using data lakes to quench your analytics fire - AWS Summit Cape Town 2018
Using data lakes to quench your analytics fire - AWS Summit Cape Town 2018Using data lakes to quench your analytics fire - AWS Summit Cape Town 2018
Using data lakes to quench your analytics fire - AWS Summit Cape Town 2018Amazon Web Services
 
Building High Performance Apps with In-memory Data
Building High Performance Apps with In-memory DataBuilding High Performance Apps with In-memory Data
Building High Performance Apps with In-memory DataAmazon Web Services
 
Securing your Big Data Environments in the Cloud
Securing your Big Data Environments in the CloudSecuring your Big Data Environments in the Cloud
Securing your Big Data Environments in the CloudDataWorks Summit
 
Migrating Financial and Accounting Systems from Oracle to Amazon DynamoDB (DA...
Migrating Financial and Accounting Systems from Oracle to Amazon DynamoDB (DA...Migrating Financial and Accounting Systems from Oracle to Amazon DynamoDB (DA...
Migrating Financial and Accounting Systems from Oracle to Amazon DynamoDB (DA...Amazon Web Services
 
Build on Amazon Aurora with MySQL Compatibility (DAT348-R4) - AWS re:Invent 2018
Build on Amazon Aurora with MySQL Compatibility (DAT348-R4) - AWS re:Invent 2018Build on Amazon Aurora with MySQL Compatibility (DAT348-R4) - AWS re:Invent 2018
Build on Amazon Aurora with MySQL Compatibility (DAT348-R4) - AWS re:Invent 2018Amazon Web Services
 
Why GE Aviation Migrated from Cassandra to Amazon DynamoDB (DAT332) - AWS re:...
Why GE Aviation Migrated from Cassandra to Amazon DynamoDB (DAT332) - AWS re:...Why GE Aviation Migrated from Cassandra to Amazon DynamoDB (DAT332) - AWS re:...
Why GE Aviation Migrated from Cassandra to Amazon DynamoDB (DAT332) - AWS re:...Amazon Web Services
 
Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...
Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...
Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...Amazon Web Services
 
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...Amazon Web Services
 
Migrating Your NoSQL Database to Amazon DynamoDB (DAT314) - AWS re:Invent 2018
Migrating Your NoSQL Database to Amazon DynamoDB (DAT314) - AWS re:Invent 2018Migrating Your NoSQL Database to Amazon DynamoDB (DAT314) - AWS re:Invent 2018
Migrating Your NoSQL Database to Amazon DynamoDB (DAT314) - AWS re:Invent 2018Amazon Web Services
 
What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018
What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018
What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018Amazon Web Services
 
Big SQL: Powerful SQL Optimization - Re-Imagined for open source
Big SQL: Powerful SQL Optimization - Re-Imagined for open sourceBig SQL: Powerful SQL Optimization - Re-Imagined for open source
Big SQL: Powerful SQL Optimization - Re-Imagined for open sourceDataWorks Summit
 
DynamoDB & DAX: Database Week SF
DynamoDB & DAX: Database Week SFDynamoDB & DAX: Database Week SF
DynamoDB & DAX: Database Week SFAmazon Web Services
 

What's hot (20)

Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018
Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018
Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018
 
Data Design for Microservices
Data Design for MicroservicesData Design for Microservices
Data Design for Microservices
 
Making the Most of Data in Multiple Data Sources (with Virtual Data Lakes)
Making the Most of Data in Multiple Data Sources (with Virtual Data Lakes)Making the Most of Data in Multiple Data Sources (with Virtual Data Lakes)
Making the Most of Data in Multiple Data Sources (with Virtual Data Lakes)
 
AWS re:Invent 2016: Fireside chat with Groupon, Intuit, and LifeLock on solvi...
AWS re:Invent 2016: Fireside chat with Groupon, Intuit, and LifeLock on solvi...AWS re:Invent 2016: Fireside chat with Groupon, Intuit, and LifeLock on solvi...
AWS re:Invent 2016: Fireside chat with Groupon, Intuit, and LifeLock on solvi...
 
Data Transformation Patterns in AWS - AWS Online Tech Talks
Data Transformation Patterns in AWS - AWS Online Tech TalksData Transformation Patterns in AWS - AWS Online Tech Talks
Data Transformation Patterns in AWS - AWS Online Tech Talks
 
Modern Cloud Data Warehousing ft. Intuit: Optimize Analytics Practices (ANT20...
Modern Cloud Data Warehousing ft. Intuit: Optimize Analytics Practices (ANT20...Modern Cloud Data Warehousing ft. Intuit: Optimize Analytics Practices (ANT20...
Modern Cloud Data Warehousing ft. Intuit: Optimize Analytics Practices (ANT20...
 
Using data lakes to quench your analytics fire - AWS Summit Cape Town 2018
Using data lakes to quench your analytics fire - AWS Summit Cape Town 2018Using data lakes to quench your analytics fire - AWS Summit Cape Town 2018
Using data lakes to quench your analytics fire - AWS Summit Cape Town 2018
 
Building High Performance Apps with In-memory Data
Building High Performance Apps with In-memory DataBuilding High Performance Apps with In-memory Data
Building High Performance Apps with In-memory Data
 
Securing your Big Data Environments in the Cloud
Securing your Big Data Environments in the CloudSecuring your Big Data Environments in the Cloud
Securing your Big Data Environments in the Cloud
 
Migrating Financial and Accounting Systems from Oracle to Amazon DynamoDB (DA...
Migrating Financial and Accounting Systems from Oracle to Amazon DynamoDB (DA...Migrating Financial and Accounting Systems from Oracle to Amazon DynamoDB (DA...
Migrating Financial and Accounting Systems from Oracle to Amazon DynamoDB (DA...
 
Build on Amazon Aurora with MySQL Compatibility (DAT348-R4) - AWS re:Invent 2018
Build on Amazon Aurora with MySQL Compatibility (DAT348-R4) - AWS re:Invent 2018Build on Amazon Aurora with MySQL Compatibility (DAT348-R4) - AWS re:Invent 2018
Build on Amazon Aurora with MySQL Compatibility (DAT348-R4) - AWS re:Invent 2018
 
Why GE Aviation Migrated from Cassandra to Amazon DynamoDB (DAT332) - AWS re:...
Why GE Aviation Migrated from Cassandra to Amazon DynamoDB (DAT332) - AWS re:...Why GE Aviation Migrated from Cassandra to Amazon DynamoDB (DAT332) - AWS re:...
Why GE Aviation Migrated from Cassandra to Amazon DynamoDB (DAT332) - AWS re:...
 
Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...
Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...
Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...
 
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...
 
Migrating Your NoSQL Database to Amazon DynamoDB (DAT314) - AWS re:Invent 2018
Migrating Your NoSQL Database to Amazon DynamoDB (DAT314) - AWS re:Invent 2018Migrating Your NoSQL Database to Amazon DynamoDB (DAT314) - AWS re:Invent 2018
Migrating Your NoSQL Database to Amazon DynamoDB (DAT314) - AWS re:Invent 2018
 
What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018
What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018
What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018
 
Big SQL: Powerful SQL Optimization - Re-Imagined for open source
Big SQL: Powerful SQL Optimization - Re-Imagined for open sourceBig SQL: Powerful SQL Optimization - Re-Imagined for open source
Big SQL: Powerful SQL Optimization - Re-Imagined for open source
 
DynamoDB & DAX: Database Week SF
DynamoDB & DAX: Database Week SFDynamoDB & DAX: Database Week SF
DynamoDB & DAX: Database Week SF
 
Using Data Lakes
Using Data LakesUsing Data Lakes
Using Data Lakes
 
Database NoSQL gestiti
Database NoSQL gestitiDatabase NoSQL gestiti
Database NoSQL gestiti
 

Similar to Managed NoSQL databases

Using AWS Purpose-Built Databases to Modernize your Applications
Using AWS Purpose-Built Databases to Modernize your ApplicationsUsing AWS Purpose-Built Databases to Modernize your Applications
Using AWS Purpose-Built Databases to Modernize your ApplicationsAmazon Web Services
 
Building low latency apps with a serverless architecture and in-memory data I...
Building low latency apps with a serverless architecture and in-memory data I...Building low latency apps with a serverless architecture and in-memory data I...
Building low latency apps with a serverless architecture and in-memory data I...AWS Germany
 
Intro to Open Source Databases on AWS - AWS Online Tech Talks
Intro to Open Source Databases on AWS - AWS Online Tech TalksIntro to Open Source Databases on AWS - AWS Online Tech Talks
Intro to Open Source Databases on AWS - AWS Online Tech TalksAmazon Web Services
 
Non-Relational Revolution - Joseph Idziorek
Non-Relational Revolution - Joseph IdziorekNon-Relational Revolution - Joseph Idziorek
Non-Relational Revolution - Joseph IdziorekAmazon Web Services
 
The Non-Relational Revolution
The Non-Relational RevolutionThe Non-Relational Revolution
The Non-Relational RevolutionMikhail Prudnikov
 
Reliable & Scalable Redis in the Cloud with Amazon ElastiCache (DAT202) - AWS...
Reliable & Scalable Redis in the Cloud with Amazon ElastiCache (DAT202) - AWS...Reliable & Scalable Redis in the Cloud with Amazon ElastiCache (DAT202) - AWS...
Reliable & Scalable Redis in the Cloud with Amazon ElastiCache (DAT202) - AWS...Amazon Web Services
 
DynamoDB & DAX: Database Week San Francisco
DynamoDB & DAX: Database Week San FranciscoDynamoDB & DAX: Database Week San Francisco
DynamoDB & DAX: Database Week San FranciscoAmazon Web Services
 
NetApp Cloud Data Services & AWS Empower Your Cloud Champions
NetApp Cloud Data Services & AWS Empower Your Cloud ChampionsNetApp Cloud Data Services & AWS Empower Your Cloud Champions
NetApp Cloud Data Services & AWS Empower Your Cloud ChampionsAmazon Web Services
 
ElastiCache: Deep Dive Best Practices and Usage Patterns - AWS Online Tech Talks
ElastiCache: Deep Dive Best Practices and Usage Patterns - AWS Online Tech TalksElastiCache: Deep Dive Best Practices and Usage Patterns - AWS Online Tech Talks
ElastiCache: Deep Dive Best Practices and Usage Patterns - AWS Online Tech TalksAmazon Web Services
 
What’s New for Amazon DynamoDB - 2018 Q1 Update - AWS Online Tech Talks
What’s New for Amazon DynamoDB - 2018 Q1 Update - AWS Online Tech TalksWhat’s New for Amazon DynamoDB - 2018 Q1 Update - AWS Online Tech Talks
What’s New for Amazon DynamoDB - 2018 Q1 Update - AWS Online Tech TalksAmazon Web Services
 
Databases - EBC on the road Brazil Edition [Portuguese]
Databases - EBC on the road Brazil Edition [Portuguese]Databases - EBC on the road Brazil Edition [Portuguese]
Databases - EBC on the road Brazil Edition [Portuguese]Amazon Web Services
 
DynamoDB and Dax - Miguel Cervantes
DynamoDB and Dax - Miguel CervantesDynamoDB and Dax - Miguel Cervantes
DynamoDB and Dax - Miguel CervantesAmazon Web Services
 
Choosing the Right Database for My Workload: Purpose-Built Databases
Choosing the Right Database for My Workload: Purpose-Built Databases Choosing the Right Database for My Workload: Purpose-Built Databases
Choosing the Right Database for My Workload: Purpose-Built Databases AWS Germany
 
How a Biotech Firm Streamlined Data Protection on AWS
 How a Biotech Firm Streamlined Data Protection on AWS How a Biotech Firm Streamlined Data Protection on AWS
How a Biotech Firm Streamlined Data Protection on AWSAmazon Web Services
 
Building a Modern Data Warehouse - Deep Dive on Amazon Redshift
Building a Modern Data Warehouse - Deep Dive on Amazon RedshiftBuilding a Modern Data Warehouse - Deep Dive on Amazon Redshift
Building a Modern Data Warehouse - Deep Dive on Amazon RedshiftAmazon Web Services
 
Big data journey to the cloud rohit pujari 5.30.18
Big data journey to the cloud   rohit pujari 5.30.18Big data journey to the cloud   rohit pujari 5.30.18
Big data journey to the cloud rohit pujari 5.30.18Cloudera, Inc.
 

Similar to Managed NoSQL databases (20)

Using AWS Purpose-Built Databases to Modernize your Applications
Using AWS Purpose-Built Databases to Modernize your ApplicationsUsing AWS Purpose-Built Databases to Modernize your Applications
Using AWS Purpose-Built Databases to Modernize your Applications
 
Building low latency apps with a serverless architecture and in-memory data I...
Building low latency apps with a serverless architecture and in-memory data I...Building low latency apps with a serverless architecture and in-memory data I...
Building low latency apps with a serverless architecture and in-memory data I...
 
Intro to Open Source Databases on AWS - AWS Online Tech Talks
Intro to Open Source Databases on AWS - AWS Online Tech TalksIntro to Open Source Databases on AWS - AWS Online Tech Talks
Intro to Open Source Databases on AWS - AWS Online Tech Talks
 
Managed NoSQL databases
Managed NoSQL databasesManaged NoSQL databases
Managed NoSQL databases
 
Non-Relational Revolution - Joseph Idziorek
Non-Relational Revolution - Joseph IdziorekNon-Relational Revolution - Joseph Idziorek
Non-Relational Revolution - Joseph Idziorek
 
Non-Relational Revolution
Non-Relational RevolutionNon-Relational Revolution
Non-Relational Revolution
 
The Non-Relational Revolution
The Non-Relational RevolutionThe Non-Relational Revolution
The Non-Relational Revolution
 
DynamoDB and DAX | AWS Floor28
DynamoDB and DAX | AWS Floor28DynamoDB and DAX | AWS Floor28
DynamoDB and DAX | AWS Floor28
 
Reliable & Scalable Redis in the Cloud with Amazon ElastiCache (DAT202) - AWS...
Reliable & Scalable Redis in the Cloud with Amazon ElastiCache (DAT202) - AWS...Reliable & Scalable Redis in the Cloud with Amazon ElastiCache (DAT202) - AWS...
Reliable & Scalable Redis in the Cloud with Amazon ElastiCache (DAT202) - AWS...
 
DynamoDB & DAX: Database Week San Francisco
DynamoDB & DAX: Database Week San FranciscoDynamoDB & DAX: Database Week San Francisco
DynamoDB & DAX: Database Week San Francisco
 
NetApp Cloud Data Services & AWS Empower Your Cloud Champions
NetApp Cloud Data Services & AWS Empower Your Cloud ChampionsNetApp Cloud Data Services & AWS Empower Your Cloud Champions
NetApp Cloud Data Services & AWS Empower Your Cloud Champions
 
ElastiCache: Deep Dive Best Practices and Usage Patterns - AWS Online Tech Talks
ElastiCache: Deep Dive Best Practices and Usage Patterns - AWS Online Tech TalksElastiCache: Deep Dive Best Practices and Usage Patterns - AWS Online Tech Talks
ElastiCache: Deep Dive Best Practices and Usage Patterns - AWS Online Tech Talks
 
What’s New for Amazon DynamoDB - 2018 Q1 Update - AWS Online Tech Talks
What’s New for Amazon DynamoDB - 2018 Q1 Update - AWS Online Tech TalksWhat’s New for Amazon DynamoDB - 2018 Q1 Update - AWS Online Tech Talks
What’s New for Amazon DynamoDB - 2018 Q1 Update - AWS Online Tech Talks
 
Databases - EBC on the road Brazil Edition [Portuguese]
Databases - EBC on the road Brazil Edition [Portuguese]Databases - EBC on the road Brazil Edition [Portuguese]
Databases - EBC on the road Brazil Edition [Portuguese]
 
DynamoDB and Dax - Miguel Cervantes
DynamoDB and Dax - Miguel CervantesDynamoDB and Dax - Miguel Cervantes
DynamoDB and Dax - Miguel Cervantes
 
DynamoDB & DAX
DynamoDB & DAXDynamoDB & DAX
DynamoDB & DAX
 
Choosing the Right Database for My Workload: Purpose-Built Databases
Choosing the Right Database for My Workload: Purpose-Built Databases Choosing the Right Database for My Workload: Purpose-Built Databases
Choosing the Right Database for My Workload: Purpose-Built Databases
 
How a Biotech Firm Streamlined Data Protection on AWS
 How a Biotech Firm Streamlined Data Protection on AWS How a Biotech Firm Streamlined Data Protection on AWS
How a Biotech Firm Streamlined Data Protection on AWS
 
Building a Modern Data Warehouse - Deep Dive on Amazon Redshift
Building a Modern Data Warehouse - Deep Dive on Amazon RedshiftBuilding a Modern Data Warehouse - Deep Dive on Amazon Redshift
Building a Modern Data Warehouse - Deep Dive on Amazon Redshift
 
Big data journey to the cloud rohit pujari 5.30.18
Big data journey to the cloud   rohit pujari 5.30.18Big data journey to the cloud   rohit pujari 5.30.18
Big data journey to the cloud rohit pujari 5.30.18
 

More from Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Managed NoSQL databases

  • 1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Tobias Börjeson Solutions Architect, AWS Peter Düsterdich Head of Game Reliability Engineering Team, MovieStarPlanet Managed NoSQL databases
  • 2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Characteristics of Internet Scale Applications Key-valueRelational Document Graph ; Users >1M Data volume TB-PB-EB Locality Global Performance Milliseconds-Microseconds Request rate Millions Access Mobile, IoT, Devices Scale Up-Out-In Economics Pay as you go Developer access Instant API access
  • 3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. purpose noun | pur·pose | ˈpər-pəs The reason for which something is done or created or for which something exists
  • 4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Driving Adoption of Non-relational Databases Addressing need for massive scale, low latency, and schema flexibility Referential integrity with strong consistency, transactions, and hardened scale GraphKey value Document ; Relational Low latency key-based queries with high throughput and fast ingestion of data Indexing and storing documents with support for query on any property Creating and navigating relations between data quickly and easily Complex query support via SQL Simple query methods with filters Simple query with filters, projections, and aggregates Easily express queries in terms of relations Non-relational
  • 5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Non-relational Amazon DynamoDB Amazon ElastiCache Key value | Document Non-relational AWS Database Migration Service Amazon Neptune Graph AWS Non-relational Databases Purpose built for specific application use cases
  • 6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon DynamoDB Fast and flexible NoSQL database service for any scale Fast, consistent performance Highly scalable Fully managed Business critical reliability Consistent single-digit millisecond latency; DAX in- memory performance reduces response times to microseconds Automatic scaling to hundreds of terabytes of data that serve millions of requests per second Automatic provisioning, infrastructure management, scaling, and configuration with zero downtime Data is replicated across fault-tolerant Availability Zones, with fine-grained access control
  • 7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon DynamoDB Schema Table Items Attributes Partition Key Sort Key Mandatory Key-value access pattern Determines data distribution Optional Model 1:N relationships Enables rich query capabilities All items for key ==, <, >, >=, <= “begins with” “between” “contains” “in” sorted results counts top/bottom N values
  • 8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Server 1 T1.p1 Table1 Table2 Table3 Server N T1.p2 Behind the scenes… 1K WCU or 3K RCU Up to 10 GB
  • 9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. VPC Endpoints April 2017 Auto Scaling June 2017 DynamoDB Accelerator (DAX) April 2017 Time to Live (TTL) February 2017 Global Tables N E W ! Backup and Restore N E W ! Amazon DynamoDB Delivering on customer needs Encryption at rest N E W ! February 2018November 2017November 2017
  • 10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. ID Name Size Expiry 1234 A 100 1456702305 2222 B 240 1456702400 3423 C 150 1459207905 • Automatically delete items from a table based on expiration time stamp • User-defined TTL attribute in epoch time format • TTL activity recorded in DynamoDB Streams TTL Attribute Features Key benefits • Reduce costs by deleting items no longer needed • Optimize application performance by controlling table size growth • Trigger custom workflows with Streams and Lambda Scaling Storage: Time-to-live (TTL)
  • 11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon VPC Endpoints • Access DynamoDB via secure Amazon Virtual Public Cloud (Amazon VPC) endpoint • Control access to tables via each VPC endpoint with unique IAM roles and permissions Features Key benefits • Turn off access from public internet gateways enhancing privacy and security • Fast, secure data transfer between Amazon VPC and DynamoDB
  • 12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. DynamoDB Accelerator (DAX) In-memory performance and throughput. More than an order of magnitude faster! Milliseconds to microseconds
  • 13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Scaling Throughput: Auto Scaling $$$ Savings
  • 14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. DynamoDB Global Tables First fully managed, multi-master, multi-region database Build high performance, globally distributed applications Low latency reads & writes to locally available tables Disaster proof with multi-region redundancy Easy to set up, and no application rewrites required Globally dispersed users Replica (N. America) Replica (Europe) Replica (Asia) Global app Global Table NEW!
  • 15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon DynamoDB – Backup and Restore First NoSQL database to automate on demand and continuous backups Point in time restore for short-term retention and data corruption protection Back up hundreds of TB instantaneously with no performance impact On-demand backups for long- term data archival and compliance NEW!
  • 16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon DynamoDB Encryption at rest Server-side encryption Support compliance certifications No application code rewrites NEW!
  • 17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Internet scale applications need low latency and high throughput In-memory data stores and caches: • Deliver sub-millisecond performance • Deliver high throughput to support millions of users • Significantly reduce cost-at-scale Gaming leaderboards Social media Ride hailing Session stores Media streaming Dating Why Use In-Memory Data Stores and Caches
  • 18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon ElastiCache Fully managed, Redis or Memcached compatible, in-memory data store and cache Extreme performance Secure & hardened Easily scalable Highly available & reliable In-memory data store and cache for sub-millisecond response times VPC for cluster isolation, encryption at rest and transit, and HIPAA compliance Read scaling with replicas, write and memory scaling with sharding, undisruptive scaling Multi-AZ with automatic failover
  • 19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon ElastiCache Online cluster resizing Encryption Compliance R4 Instances Scale-out or scale-in Redis clusters without downtime Secure internode communications & backups Scale to 6.1 TiB of in- memory data for Redis and 8.14 TiB for Memcached HIPAA eligibility for ElastiCache for Redis NEW in the last 12 months!
  • 20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. 0–5461 Shard 1 Shard 2 Shard 3 5462–10922 10923–16383 aws elasticache modify-replication-group-shard-configuration --replication-group-id rep-group-id --apply-immediately --node-group-count 5 Simple API Scale in || Out Online Cluster Resizing – Zero Downtime
  • 21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. 0–5461 Reads & writes Shard 1 Shard 2 Shard 3 Added Added Shard 4 Shard 5 5462–10922 10923–163830–2909, 5095–5461 5462–5783, 6876–9830 10923–14199 2910–5094, 9831–10922 No application interruption Uniform slot distribution across shards 5784–6875, 14200–16383 Online Cluster Resizing – Scale Out
  • 22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. 0–5461 Reads & writes Shard 1 Shard 2 Shard 3 Removed Removed Shard 4 Shard 5 5462–10922 10923–16383 Uniform slot distribution across shards No application interruption Online Cluster Resizing – Scale In
  • 23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Encryption and Compliance Encryption • In-transit: Encrypt all communications between clients and Redis server as well as between nodes • At-rest: Encrypt backups on disk and in Amazon S3 • Fully managed: Set up via API or console, automatic issuance, and renewal Compliance • HIPAA eligibility for ElastiCache for Redis • Included in AWS Business Associate Addendum • Redis 3.2.6
  • 24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Other Launches R4 instances • Scale to 64 vCPUs, 488 GiB DDR4 memory, and 20-GiB network • With Redis cluster, customers can scale to 6.1 TiB of memory Flexible reconfiguration • Launched February 2017 • Flexible reconfiguration based on backup and restore • Allows going from noncluster mode to cluster mode • Change replication factor • Change number of shards Test failover
  • 25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Session management Database caching APIs (HTTP responses) IoT Real-time data analytics (filtering/aggregation) Pub/Sub Social media (Sentiment analysis) Standalone database (metadata store) Gaming leaderboards Usage Patterns
  • 26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Caching
  • 27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Real-time Analytics
  • 28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Gaming Leaderboards
  • 29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Highly Connected Data Best Represented in a Graph Social news feed Restaurant recommendations Retail fraud detection Is friend of Likes Likes Serves Serves Located in Location: New York Name: Sushi Name: Sushi Cuisine: Sushi Located in Is friend of Friends Use Like Like Connect Play Check In Read Country City Address Credit Card Email Address Date Product IP Order Person Phone
  • 30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Too expensive Difficult to maintain high availability Difficult to scale Limited support for open standards $ Existing Graph DatabasesRelational Databases Inefficient graph processing Unnatural for querying graph Rigid schema inflexible for changing graphs Challenges building apps with highly connected data
  • 31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Neptune Fully managed graph database Fast & scalable ReliableOpen Query billions of relationships with millisecond latency Six replicas of your data across three AZs with full backup and restore Build powerful queries easily with Gremlin and SPARQL Supports Apache TinkerPop & W3C RDF graph models Easy Gremlin SPARQL
  • 32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Customers of AWS Non-relational Databases
  • 33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS databases and analytics Broad and deep portfolio, purpose-built for builders DW | Big Data Processing | Interactive Business Intelligence & Machine Learning Data Movement Database Migration Service | Snowball | Snowmobile | Kinesis Data Firehose | Kinesis Data Streams Amazon QuickSight Relational Databases RDS Aurora Data Lake Amazon S3/Amazon Glacier AWS Glue (ETL & Data Catalog) SageMaker Non-Relational Databases Analytics DynamoDB ElastiCache (Redis, Memcached) Neptune (Graph) Amazon Redshift EMR Athena Kinesis Data Analytics Elasticsearch Service Real-time Amazon Comprehend
  • 34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thank you