Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

(BDT307) Running NoSQL on Amazon EC2 | AWS re:Invent 2014


Published on

Deploying self-managed NoSQL databases on Amazon Web Services (AWS) is more straightforward than you would think. This session focuses on three popular self-managed NoSQL systems on Amazon EC2: MongoDB, Cassandra, and Couchbase. We start with an overview of each of these popular NoSQL databases, discuss their origins and characteristics, and demonstrate the use of the AWS ecosystem to deploy these NoSQL databases quickly. Later in the session, we dive deep on use cases, design patterns, and discuss creating highly-available and high-performance architectures with careful consideration for failure and recovery. Whether you're a NoSQL developer, architect, or administrator, join us for a comprehensive session on looking at three different NoSQL systems from a uniform perspective.

Published in: Technology

(BDT307) Running NoSQL on Amazon EC2 | AWS re:Invent 2014

  1. 1. November 12th, 2014 | Las Vegas, NV Rahul Bhartia, John Loughlin, & Matt Yanchyshyn
  2. 2. •Couchbase: •MongoDB: •Datastax: AMI)
  3. 3. With AWS, you can always change later!
  4. 4. Amazon Elastic Block Store Instance Store (ephemeral) •General Purpose (SSD): 3 IOPS/GB, 3000 IOPS/volume max •PIOPS: 4000 IOPS/volume max •Max 48,000 IOPS/Instance •Up to 1TB/volume •Linear performance increases up to 12 volumes on 8xlarge instances •Snapshots •Direct-attached storage •SSD on new instance types •Up to 365,000 IOPS and 6.4 TB/instance (i2.8xlarge) •Fewer IOPS on smaller instances •No built-in backup functionality
  5. 5. •When using instance store (ephemeral), replicate sufficiently and backup often •When using Amazon EBS,leverage EBS snapshots •Stripe multiple volumes for increased performance and storage capacity
  7. 7. Provision Upgrade Scale Continuous backup Point-in-time recovery Performance alerts
  8. 8. MongoDB Primary MongoDB Secondary MMS Backup Agent
  9. 9. •Allows a node joining the cluster to pull a proportional amount of data from other nodes in the cluster. •Speeds node rebuilds as data is shipped incrementally from every other node in the cluster.
  10. 10. us-east-1 a a a a b c b c b c b c us-west-2 a a a a b c b c b c b c S3 S3
  11. 11. CB Bucket PriorityDisk I/O Priority(New in CB 3.0)
  12. 12. + + + + •Tunable memory(new in CB 3.0) •Shared thread pool(new in CB 3.0)
  13. 13. •Graceful failover (New in CB 3.0) •Delta node recovery (New in CB 3.0)
  14. 14. •Rack Awareness
  15. 15. •XDCR enables unior bi-directional •Database Change Protocol(New in CB 3.0) •Pause and resume(New in CB 3.0)
  16. 16. cbbackup •Incremental backup and restore(New in CB 3.0)
  17. 17. (New in CB 2.5) (New in CB 3.0) (New in CB 3.0)
  18. 18. XDCR XDCR Rack Awareness Rack Awareness Rack Awareness
  19. 19.