Rocking mongo db on the cloud

2,816 views
2,732 views

Published on

Published in: Technology, News & Politics
0 Comments
9 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,816
On SlideShare
0
From Embeds
0
Number of Embeds
351
Actions
Shares
0
Downloads
20
Comments
0
Likes
9
Embeds 0
No embeds

No notes for slide

Rocking mongo db on the cloud

  1. 1. rockingmongoDBon the cloud @MilesWard – AWS Solutions Architect
  2. 2. SimpleStableScalable
  3. 3. Simple: Whitepaper - - - > Marketplace Cloudformationmedia.amazonwebservices.com/AWS_NoSQL_MongoDB.pdf
  4. 4. Simple: Whitepaper - - - > Marketplace Cloudformationmedia.amazonwebservices.com/AWS_NoSQL_MongoDB.pdf
  5. 5. Easy to start a single node No extra costAmazon Linux for Premium Support bit.ly/MZa8Rz
  6. 6. Easy to start a single node? No extra costAmazon Linux for Premium Support bit.ly/MZa8Rz
  7. 7. Easy to start a single node? No extra costAmazon Linux for Premium Support bit.ly/MZa8Rz
  8. 8. Easy to start a single node? No extra costAmazon Linux for Premium Support bit.ly/MZa8Rz
  9. 9. Simple: Whitepaper - - - > Marketplace Cloudformationmedia.amazonwebservices.com/AWS_NoSQL_MongoDB.pdf
  10. 10. NestedNodes + StorageConfigurableCloudformation: Infrastructure belongsin your source control mongodb.org/display/DOCS/Automating+Deployment+with+CloudFormation
  11. 11. Stable: Memory + Storage
  12. 12. 3.757.515 < - - -Where you should be17.134.268.460.5
  13. 13. 3.75 m1.medium7.5 m1.large15 m1.xlarge …In Memory!17.1 m2.xlarge34.2 m2.2xlarge68.4 m2.4xlarge60.5 cc2.4xlarge
  14. 14. New Storage Options • EBS – Provisioned IOPS volumesEBS • Deliver predictable, high performance for I/O intensive workloadsPIOPS • Specify IOPS required upfront, and EBS provisions for lifetime of volume – 1000 IOPS per volume, can stripe to get thousands of IOPS to EC2 instanceSSD • High IO Instances – hi1.4xlarge • For applications that require 10s of thousands of IOPS • Eliminates network latency as a performance constraint to storage + • EBS Optimized Instances • Enables instances to fully utilize IOPS provisioned on an EBS volume • Dedicated instance throughput to EBS – 500 Mbps and 1000 Mbps
  15. 15. Test: random 4k readsEBS One Volume: ~200 MongoOPS with some variability, <1mb/s Loaded instance: ~ 1000 MongoOPS with some variability <10mb/s +PIOPS One Volume: 1010 MongoOPS with <1% variability, 3mb/s Loaded Instance: 10004 MongoOPS with <1% variability, 30mb/sSSD Hi1.4xlarge ephemeral: ~64,000 MongoOPS with low variability, ~245mb/s
  16. 16. Test: random 4k reads + PIOPS SSDEBS
  17. 17. random 4k reads + PIOPS SSDEBS Stable
  18. 18. Stability Tips Ext4 or XFS, nodiratime, noatimeStable Raise file descriptor limits Set disk read-ahead No large virtual memory pages SNAPSHOT SNAPSHOT SNAPSHOT
  19. 19. Scalable
  20. 20. Scalable: Get Big Fast and shrink quickly too
  21. 21. 10 Million records44 GB collection2,000 ops1000% expected growth
  22. 22. 1000% expected growth
  23. 23. 1000% expected growthreplicate
  24. 24. 1000% expected growth shard shard shard
  25. 25. 1000% expected growth shard shard shard
  26. 26. 1000% expected growth shard shard shard
  27. 27. Scale Both Ways
  28. 28. SSD ScaleSSD SSD SSD SSD SSD SSDSSD SSD SSD
  29. 29. Shrink quickly too Go from m2.4xlarge to m1.medium in
  30. 30. Shrink quickly too Go from m2.4xlarge to m1.medium in Three easy steps so that you can save
  31. 31. Shrink quickly too Go from m2.4xlarge to m1.medium in Three easy steps so that you can save 90% of the compute cost when you don’t need it…
  32. 32. THANKS! Miles Ward – AWS Solutions Architect

×