Amazon DynamoDB
Fast, flexible, secure, NoSQL database service, for any scale
Pranav Nambiar
Senior Manager (PM), AWS
Time : 11:10 – 11:40
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Social Media
IOT Sensor Data
Bio-metrics
Click-stream data
User-activity Logs
Satellite Data
RFID
Maps
Online Content
Weather data
Email
Documents
Audio/
Video
Images
Traditional
Tabular Data
Social Media
IOT Sensor Data
Bio-metrics
Click-stream data
User-activity Logs
Satellite Data
RFID
Maps
Online Content
Weather data
Email
Documents
Audio/
Video
Images
Traditional
Tabular Data
Structured
Data
Semi-structured/
Un-structured Data
Data
Volume
Performance
Requirements
How to optimize for scale, performance, cost?
Scale Performance Cost
Zero Worries !!!
Amazon’s Journey
Dec ‘04:
Suffers
outage
Oct ‘07:
Dynamo paper
published
Jan ‘12:
DynamoDB General
Availability
Q3 ‘16:
Leader in Gartner MQ,
Forrester Wave
Today:
Tier-0 service
powering most of
Amazon
DynamoDB Customers
Ad TechGaming IoTMobile Web
Amazon DynamoDB
NoSQL Database (Document & Key-value store)
Fully managed
Fast – response times in microseconds
Massive and seamless scalability
Highly available
Low Cost
1. Scalability
3. Performance
4. Security & Monitoring
2. Availability & Data Protection
5. Manageability & TCO
6. Dev Platform & Tools
Our Key Investment Pillars
Scalability
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
Writes
Reads
>200% increase from baseline
>300% increase from baseline
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
• Millions of tables; Several tables with >100TB
• 10’s of PBs of data; Trillions of requests/month
Availability & Data Protection
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
North America
US East – N. Virginia
US East - Ohio
US West – Oregon
US West – San
Francisco
Canada - Central
AWS GovCloud (US)
European
Union
Dublin
London
Frankfurt
Asia
Pacific
Tokyo
Singapore
Sydney
Mumbai
Seoul
South
America
Sao Paulo
China
• Available in 16 regions worldwide
• Built-in replication across 3 Availability Zones
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
WRITES
Replicated continuously to 3 AZ’s
Persisted to disk (custom SSD)
READS
Strongly or eventually consistent
No latency trade-off
Designed to
support
99.99%
of availability
Built for high
Durability
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
1 2
Multi-AZ & Cross-Region Replication
Features
Key Benefits
• High availability with transparent replication at
no extra cost
• Disaster recovery on complete single region
failure
• Scale-out by directing read traffic to replicas
• Built-In 3-way data replication to three
Availability Zones (AZ) within an AWS region
• Replicate to other regions with open source,
fully-extensible, library
1
2
Available Today
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
Performance
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
DynamoDB: consistent performance at scale
ConsistentSingle-Digit Millisecond Latency
Requests(millions)
Latency(milliseconds)
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
Introducing DAX
What if we could go from milliseconds to microseconds?
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
DynamoDB
DynamoDB Accelerator(DAX)
Your Applications
New!
• Fully managed: handle all of the upgrades, patching,
and software management
• Flexible: Configure DAX for one table or many
• Highly available: fault tolerant, replication across
multi-AZs within a region
• Scalable: scales-out to any workload with up to 10
read replicas
• Manageability: fully integrated AWS service: Amazon
CloudWatch, Tagging for DynamoDB, AWS Console
• Security: Amazon VPC, AWS IAM, AWS CloudTrail,
AWS Organizations
Features
DynamoDB Accelerator (DAX) In Public Preview
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
DynamoDB
DynamoDB Accelerator(DAX)
Your Applications
New!
Key Benefits
• Fast performance: Microseconds response
times at millions of reads/sec from single DAX
cluster
• Ease of use: DynamoDB API compatible -
requires minimal code change for existing
applications, simplifying developer experience
• Lower costs: Reduce provisioned read
capacity for DynamoDB tables for tables with
hot data
DynamoDB Accelerator (DAX) In Public Preview
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
Security
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
Fine-grained Access control (FGAC) at a table, item or attribute level
with AWS IAM
Client-side encryption library with optional AWS KMS integration;
encrypt select or all attributes
Log DynamoDB configuration, table setup changes and API calls
with AWS CloudTrail
Monitor performance and trigger alarms with AWS CloudWatch
Available Today
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
• VPC: Access DynamoDB via secure
Amazon VPC endpoint
• Access Control: restrict table access for
each VPC endpoint with a unique IAM
role and permissions
Features
Key Benefits
• Turn off access from public Internet
gateways enhancing privacy and
security
• Fast, secure data transfer between
Amazon VPC and DynamoDB
VPC Endpoints for DynamoDB (VPC-E) In Public Preview
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
Manageability
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
DB hosted on premise
DynamoDB
Fully Managed service, removes management overhead
Power, HVAC, net
Rack & stack
Server maintenance
OS patches
DB s/w patches
Database backups
App optimization
High availability
DB s/w installs
OS installation
you
Scaling
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
Pay-as-you-grow
Features
Key Benefits
Available Today
RCU WCU Storage
• Fully managed, serverless, database service
• Non-expiring free tier with 25 RCU, 25 WCU, 25GB storage
and 2.5M reads for Streams
• Provision read and write capacity for base tables and GSI
independently
• Pay only for provisioned read/write capacity and actual
storage consumed
• Increase provisioned capacity in granular single unit
increments
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
Time-to-Live (TTL)
ID Name Size Expiry
1234 A 100 1456702305
2222 B 240 1456702400
3423 C 150 1459207905
TTL Value
(Epoch format)
TTL Attribute
• Automatic: Deletes items from a table based on
expiration timestamp
• Customizable: User-defined TTL attribute in epoch
time format
• Audit Log: TTL activity recorded in DynamoDB
Streams
Features
Key Benefits
• Reduce costs: Delete items no longer needed
• Performance: Optimize application performance by
controlling table size growth
• Extensible: Trigger custom workflows with
DynamoDB Streams and Lambda
Available Today
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
Tagging
• Track costs: AWS bills broken down by tags
in detailed monthly bills and Cost Explorer
• Flexible: Add customizable tags to both
tables and indexes
Features
Key Benefits
• Transparency: Know exactly how much
your DynamoDB tables and indexes cost
• Consistent: Report of spend across AWS
services
Available Today
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
Developer Platform & Tools
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
Working with AWS Ecosystem
IoT
S3
Kinesis
EMR
Redshift
Data Pipeline
Mobile HubLambda
Elasticsearch
SNS
CloudWatch
CloudTrail
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
RFID
RFID
RFID Chips
DynamoDB DynamoDB Streams
US East (N. Virginia)
US West (SFO)
Cross-region replication
Real-time notification
using DynamoDB
Triggers
Text Search
RFID
Online
Indexing
Document/Key-value
store with support1
2
4
6
5
7
3
Connect to EMR /
Redshift for further
analysis
8
Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
Summing it all up
Reasons to migrate
Volume
Variety
Velocity
Veracity
Value
Data published by Forbes Magazine
• Millions of
requests per
second from single
table
• Unlimited items
and storage
• Consistent, single
digit millisecond
latency
• Optimized for
analytics
workloads with
native indexing
• Microsecond
response times
with DynamoDB
Accelerator
(DAX)*
• Control user
access at items
and attributes level
• SOC, PCI, ISO,
FedRAMP (Mod &
High), HIPAA BAA
• Monitor with
CloudWatch
metrics & logging
with CloudTrail
• Client-side
encryption library
• Secure, private
VPC endpoints*
• Designed for
99.99% high
availability (HA)
• Built-in replication
across 3 zones
• Fully-managed
• Perpetual free tier
• Pay-as-you-grow
for capacity and
storage
independently
• Track table level
spending with
Tagging
• Purge data
automatically
(Time To Live)
• Event-driven
programming with
Triggers & Lambda
• Advanced
analytics with EMR
& Amazon
Redshift
• Full-text query
support with
Amazon
Elasticsearch
Service
• Real-time stream
processing with
Amazon Kinesis
Scalability Performance Security Availability &
Data Protection
Manageability &
TCO
Dev Platform &
Tools
* In public preview
Thank You!
Pranav Nambiar
Senior Manager (PM), AWS
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

2017 AWS DB Day | Amazon DynamoDB 서비스, 개요 및 신규 기능 소개

  • 1.
    Amazon DynamoDB Fast, flexible,secure, NoSQL database service, for any scale Pranav Nambiar Senior Manager (PM), AWS Time : 11:10 – 11:40 © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 2.
    Social Media IOT SensorData Bio-metrics Click-stream data User-activity Logs Satellite Data RFID Maps Online Content Weather data Email Documents Audio/ Video Images Traditional Tabular Data
  • 3.
    Social Media IOT SensorData Bio-metrics Click-stream data User-activity Logs Satellite Data RFID Maps Online Content Weather data Email Documents Audio/ Video Images Traditional Tabular Data Structured Data Semi-structured/ Un-structured Data Data Volume Performance Requirements
  • 4.
    How to optimizefor scale, performance, cost? Scale Performance Cost Zero Worries !!!
  • 5.
    Amazon’s Journey Dec ‘04: Suffers outage Oct‘07: Dynamo paper published Jan ‘12: DynamoDB General Availability Q3 ‘16: Leader in Gartner MQ, Forrester Wave Today: Tier-0 service powering most of Amazon
  • 6.
  • 7.
    Amazon DynamoDB NoSQL Database(Document & Key-value store) Fully managed Fast – response times in microseconds Massive and seamless scalability Highly available Low Cost
  • 8.
    1. Scalability 3. Performance 4.Security & Monitoring 2. Availability & Data Protection 5. Manageability & TCO 6. Dev Platform & Tools Our Key Investment Pillars
  • 9.
    Scalability Scalability Performance SecurityAvailability& Data Protection Manageability & TCO Dev Platform & Tools
  • 10.
    Writes Reads >200% increase frombaseline >300% increase from baseline Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools • Millions of tables; Several tables with >100TB • 10’s of PBs of data; Trillions of requests/month
  • 11.
    Availability & DataProtection Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 12.
    North America US East– N. Virginia US East - Ohio US West – Oregon US West – San Francisco Canada - Central AWS GovCloud (US) European Union Dublin London Frankfurt Asia Pacific Tokyo Singapore Sydney Mumbai Seoul South America Sao Paulo China • Available in 16 regions worldwide • Built-in replication across 3 Availability Zones Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 13.
    WRITES Replicated continuously to3 AZ’s Persisted to disk (custom SSD) READS Strongly or eventually consistent No latency trade-off Designed to support 99.99% of availability Built for high Durability Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 14.
    1 2 Multi-AZ &Cross-Region Replication Features Key Benefits • High availability with transparent replication at no extra cost • Disaster recovery on complete single region failure • Scale-out by directing read traffic to replicas • Built-In 3-way data replication to three Availability Zones (AZ) within an AWS region • Replicate to other regions with open source, fully-extensible, library 1 2 Available Today Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 15.
    Performance Scalability Performance SecurityAvailability& Data Protection Manageability & TCO Dev Platform & Tools
  • 16.
    DynamoDB: consistent performanceat scale ConsistentSingle-Digit Millisecond Latency Requests(millions) Latency(milliseconds) Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 17.
    Introducing DAX What ifwe could go from milliseconds to microseconds? Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 18.
    DynamoDB DynamoDB Accelerator(DAX) Your Applications New! •Fully managed: handle all of the upgrades, patching, and software management • Flexible: Configure DAX for one table or many • Highly available: fault tolerant, replication across multi-AZs within a region • Scalable: scales-out to any workload with up to 10 read replicas • Manageability: fully integrated AWS service: Amazon CloudWatch, Tagging for DynamoDB, AWS Console • Security: Amazon VPC, AWS IAM, AWS CloudTrail, AWS Organizations Features DynamoDB Accelerator (DAX) In Public Preview Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 19.
    DynamoDB DynamoDB Accelerator(DAX) Your Applications New! KeyBenefits • Fast performance: Microseconds response times at millions of reads/sec from single DAX cluster • Ease of use: DynamoDB API compatible - requires minimal code change for existing applications, simplifying developer experience • Lower costs: Reduce provisioned read capacity for DynamoDB tables for tables with hot data DynamoDB Accelerator (DAX) In Public Preview Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 20.
    Security Scalability Performance SecurityAvailability& Data Protection Manageability & TCO Dev Platform & Tools
  • 21.
    Fine-grained Access control(FGAC) at a table, item or attribute level with AWS IAM Client-side encryption library with optional AWS KMS integration; encrypt select or all attributes Log DynamoDB configuration, table setup changes and API calls with AWS CloudTrail Monitor performance and trigger alarms with AWS CloudWatch Available Today Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 22.
    • VPC: AccessDynamoDB via secure Amazon VPC endpoint • Access Control: restrict table access for each VPC endpoint with a unique IAM role and permissions Features Key Benefits • Turn off access from public Internet gateways enhancing privacy and security • Fast, secure data transfer between Amazon VPC and DynamoDB VPC Endpoints for DynamoDB (VPC-E) In Public Preview Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 23.
    Manageability Scalability Performance SecurityAvailability& Data Protection Manageability & TCO Dev Platform & Tools
  • 24.
    DB hosted onpremise DynamoDB Fully Managed service, removes management overhead Power, HVAC, net Rack & stack Server maintenance OS patches DB s/w patches Database backups App optimization High availability DB s/w installs OS installation you Scaling Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 25.
    Pay-as-you-grow Features Key Benefits Available Today RCUWCU Storage • Fully managed, serverless, database service • Non-expiring free tier with 25 RCU, 25 WCU, 25GB storage and 2.5M reads for Streams • Provision read and write capacity for base tables and GSI independently • Pay only for provisioned read/write capacity and actual storage consumed • Increase provisioned capacity in granular single unit increments Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 26.
    Time-to-Live (TTL) ID NameSize Expiry 1234 A 100 1456702305 2222 B 240 1456702400 3423 C 150 1459207905 TTL Value (Epoch format) TTL Attribute • Automatic: Deletes items from a table based on expiration timestamp • Customizable: User-defined TTL attribute in epoch time format • Audit Log: TTL activity recorded in DynamoDB Streams Features Key Benefits • Reduce costs: Delete items no longer needed • Performance: Optimize application performance by controlling table size growth • Extensible: Trigger custom workflows with DynamoDB Streams and Lambda Available Today Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 27.
    Tagging • Track costs:AWS bills broken down by tags in detailed monthly bills and Cost Explorer • Flexible: Add customizable tags to both tables and indexes Features Key Benefits • Transparency: Know exactly how much your DynamoDB tables and indexes cost • Consistent: Report of spend across AWS services Available Today Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 28.
    Developer Platform &Tools Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 29.
    Working with AWSEcosystem IoT S3 Kinesis EMR Redshift Data Pipeline Mobile HubLambda Elasticsearch SNS CloudWatch CloudTrail Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 30.
    RFID RFID RFID Chips DynamoDB DynamoDBStreams US East (N. Virginia) US West (SFO) Cross-region replication Real-time notification using DynamoDB Triggers Text Search RFID Online Indexing Document/Key-value store with support1 2 4 6 5 7 3 Connect to EMR / Redshift for further analysis 8 Scalability Performance SecurityAvailability & Data Protection Manageability & TCO Dev Platform & Tools
  • 31.
  • 32.
  • 33.
    • Millions of requestsper second from single table • Unlimited items and storage • Consistent, single digit millisecond latency • Optimized for analytics workloads with native indexing • Microsecond response times with DynamoDB Accelerator (DAX)* • Control user access at items and attributes level • SOC, PCI, ISO, FedRAMP (Mod & High), HIPAA BAA • Monitor with CloudWatch metrics & logging with CloudTrail • Client-side encryption library • Secure, private VPC endpoints* • Designed for 99.99% high availability (HA) • Built-in replication across 3 zones • Fully-managed • Perpetual free tier • Pay-as-you-grow for capacity and storage independently • Track table level spending with Tagging • Purge data automatically (Time To Live) • Event-driven programming with Triggers & Lambda • Advanced analytics with EMR & Amazon Redshift • Full-text query support with Amazon Elasticsearch Service • Real-time stream processing with Amazon Kinesis Scalability Performance Security Availability & Data Protection Manageability & TCO Dev Platform & Tools * In public preview
  • 34.
    Thank You! Pranav Nambiar SeniorManager (PM), AWS © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.