Downloaded 16 times
![Documents
www.objectrocket.com
{
"_id" : ObjectId("570680d891442f6efaff2005"),
"name" : "John Doe",
"age" : 45,
"height" : 5.9,
"weight" : NumberLong(165),
"updated_at" : "2016-01-07 15:46:32",
"active" : true,
"nickname" : null,
"zipcodes" : [ "10013" ],
"phone" : "212-555-1212"
}
{
"_id" : ObjectId("570680d891442f6efaff2005"),
"n" : "John Doe",
"a" : 45,
"h" : 5.9,
"w" : NumberLong(165),
"u" : ISODate("2016-01-07T15:46:32.085Z"),
"ac" : true,
"nn" : null,
"z" : [ "10013" ],
"p" : "212-555-1212"
}
6](https://image.slidesharecdn.com/mongodbscalabilitybestpractices-180421132400/85/MongoDB-Scalability-Best-Practices-6-320.jpg)
More Related Content
Similar to MongoDB Scalability Best Practices
![Getting Started with Apache Spark: Big Data Made Simple [Free Meetup]](https://cdn.slidesharecdn.com/ss_thumbnails/apachesparkgettingstarted-260203175547-8361bcc3-thumbnail.jpg?width=640&height=640&fit=bounds)
MongoDB Scalability Best Practices
- 1. MongoDB Scalability Best Practices JasonTerpko DBA, Rackspace/ObjectRocket www.linkedin.com/in/jterpko 1
- 2. Background • Started outin relational databases in public education then financial services • Next came online media distribution • For analytics, started working with columnar databases and engines with compression • First NoSQL project was application regression testing • Made the switch to NoSQL at ObjectRocket by Rackspace www.objectrocket.com 2
- 3. Overview • General Scalability •Schema Design • Scaling Options in MongoDB • Locking • Sharding • Right Tool For the Job www.objectrocket.com 3
- 4. General Scalability www.objectrocket.com Vertical (Up)Horizontal (Out) 4
- 5. Schema Design • FieldTypes • Field Names • Arrays • Embedded Documents • Document Size www.objectrocket.com 5
- 6. Documents www.objectrocket.com { "_id" : ObjectId("570680d891442f6efaff2005"), "name": "John Doe", "age" : 45, "height" : 5.9, "weight" : NumberLong(165), "updated_at" : "2016-01-07 15:46:32", "active" : true, "nickname" : null, "zipcodes" : [ "10013" ], "phone" : "212-555-1212" } { "_id" : ObjectId("570680d891442f6efaff2005"), "n" : "John Doe", "a" : 45, "h" : 5.9, "w" : NumberLong(165), "u" : ISODate("2016-01-07T15:46:32.085Z"), "ac" : true, "nn" : null, "z" : [ "10013" ], "p" : "212-555-1212" } 6
- 7. Scaling Options In MongoDB• Vertical • Replica Set • Sharding (Horizontal) • Pluggable Engine www.objectrocket.com 7
- 8. Vertical www.objectrocket.com Client • Hardware /Topology • Reduced Complexity • Increased Hardware Cost • Upgrade Cycles • Application Use Cases • Requires Read Consistency • Not Able To Shard • Sharding Not Required 8
- 9. Replica Set www.objectrocket.com Client • Hardware/ Topology • Reduced Complexity • Reduced Hardware Cost • Application Use Cases • Allows For Eventual Consistency • Not Able To Shard • Sharding Not Required 9
- 10. Sharding www.objectrocket.com MongoS • Hardware /Topology • Increased Complexity • Better Utilization • Application • Written For Sharding • Optional Eventual Consistency • Increased throughput 10
- 11.
- 12. Locking • MongoDB Version •Database And Collections • Engine • Sharding www.objectrocket.com 12
- 13. Locking www.objectrocket.com • MongoDB Defaults •2.4 & 2.6 – Database • 3.0 – Collection • 3.2 – Document • Database and Collection Drops • Database – Not free but cheap • Collection - Free • Engine • MMAP – Database • MMAPv1 – Collection • WiredTiger – Document • Rocks – Document • TTL and Secondary's • Added TTL Deletes • Replication Batching 13
- 14. Sharding • MongoS • ShardKey Selection • Distributed Writes • Targeted Operations www.objectrocket.com 14
- 15.
- 16. Shard Key Selection www.objectrocket.com •Limitations • Operations • Unique Constraints • Immutable • Process • Variety (Schema Analyzer) • system.profile • Staging and QA • Chunks • Preventing Jumbos • Balancing Overhead • Pre-splitting Collections • Throughput • Distributed Writes • Targeted Ops • Merging of Data 16
- 17. Non-Distributed Writes www.objectrocket.com 10% 20%30% 40% Not an efficient use of all resources. moveChunk()Key: {u: 1} 17
- 18. Distributed Writes www.objectrocket.com 25% 25%25% 25% Efficient use of all resources and write scopes. Key: {u: “hashed“} 18
- 19. Targeted Operations www.objectrocket.com Efficient useof resources. > db.mycoll.find({u: "...", c_at: "..." }) Key: {u: 1, c_at: 1} 19
- 20. Partially Targeted www.objectrocket.com Efficient useof resources. Key: {u: 1, c_at: 1} > db.mycoll.find({u: "...", u_at: "..." }) 20
- 21. Scatter-Gathers www.objectrocket.com Not an efficientuse of resources. Key: {u: 1, c_at: 1} > db.mycoll.find({u_at: "..." }) 21
- 22. Using the RightTool : Mongo • Unstructured Data • Retail Catalog Data • Social Media User Data • Analytic Data Rollups • Gaming Profiles www.objectrocket.com 22
- 23. Using the RightTool : ... maybe not Mongo • Text Search • Geo • Key / Value • Transactions www.objectrocket.com 23
- 24. Questions? www.objectrocket.com 24 Media Resources: MongoDB Leaf- http://bit.ly/29bbJIR RocksDB Logo - http://bit.ly/29cYFUS WT Logo - http://bit.ly/294QEhw
- 25. Thank you! Address: 401 CongressAve Suite 1950 Austin, TX 78701 Support: 1-800-961-4454 Sales: 1-888-440-3242 www.objectrocket.com 25