Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Auto scale DynamoDB
with
Dynamic DynamoDB
Sebastian Dahlgren!
@sebdah
Project overview
Throughput metrics via CloudWatch
Supports auto scaling of

tables & global secondary indexes



Live for...
Background
Auto scaling is important!
- Saves money

- Saves your skin
No auto scaling in DynamoDB
Basic config example
Configuration
• [global]	
  
o AWS credentials
o Check interval
o Circuit breaker
• [logging]	
  
o Logging settings
o Supp...
Handling many tables or
dynamic table names
• Table list refreshed for every iteration
o Addition of new tables
o Removal ...
Scaling down
• DynamoDB limits down scaling to 4 times per UTC
day
• Optimize downscaling by using

o reads-­‐lower-­‐thre...
SNS notifications
• Get an email when your
provisioning is updated

• Currently supports:
o scale-up
o scale-down
Circuit breaker
• Dynamic DynamoDB
can poll an URL to
check system health

• All scaling is paused if
the URL does not
ret...
CloudFormation template
• Launches a t1.micro
instance

(<$15/mo)
• Auto Scaling Group

min: 1, max: 1
• Running Dynamic
D...
Tadaa
Image publishing service
Thank you!
sebdah / dynamic-dynamodb
Upcoming SlideShare
Loading in …5
×

Autoscale DynamoDB with Dynamic DynamoDB

4,050 views

Published on

Published in: Technology
  • Be the first to comment

Autoscale DynamoDB with Dynamic DynamoDB

  1. 1. Auto scale DynamoDB with Dynamic DynamoDB Sebastian Dahlgren! @sebdah
  2. 2. Project overview Throughput metrics via CloudWatch Supports auto scaling of
 tables & global secondary indexes
 
 Live for about a year >10.000 monthly downloads Open source
  3. 3. Background Auto scaling is important! - Saves money
 - Saves your skin No auto scaling in DynamoDB
  4. 4. Basic config example
  5. 5. Configuration • [global]   o AWS credentials o Check interval o Circuit breaker • [logging]   o Logging settings o Supports external logging config • [table:  my_table]   o Rules for scaling a certain table o Maintenance windows • [gsi:  my_gsi  table:  my_table]   o Rules for scaling Global Secondary Indexes
  6. 6. Handling many tables or dynamic table names • Table list refreshed for every iteration o Addition of new tables o Removal of old tables
 • Use regular expressions in your configuration [table:  ^daily_data.*$]
  7. 7. Scaling down • DynamoDB limits down scaling to 4 times per UTC day • Optimize downscaling by using
 o reads-­‐lower-­‐threshold
 o writes-­‐lower-­‐threshold
 o always-­‐decrease-­‐rw-­‐together
 o maintenance-­‐windows
  8. 8. SNS notifications • Get an email when your provisioning is updated
 • Currently supports: o scale-up o scale-down
  9. 9. Circuit breaker • Dynamic DynamoDB can poll an URL to check system health
 • All scaling is paused if the URL does not return HTTP 200  OK
  10. 10. CloudFormation template • Launches a t1.micro instance
 (<$15/mo) • Auto Scaling Group
 min: 1, max: 1 • Running Dynamic DynamoDB in daemon mode • Configuration on S3
  11. 11. Tadaa Image publishing service
  12. 12. Thank you! sebdah / dynamic-dynamodb

×