• Share
  • Email
  • Embed
  • Like
  • Private Content
Schema Design
 

Schema Design

on

  • 807 views

One of the challenges that comes with moving to MongoDB is figuring how to best model your data. While most developers have internalized the rules of thumb for designing schemas for RDBMSs, these ...

One of the challenges that comes with moving to MongoDB is figuring how to best model your data. While most developers have internalized the rules of thumb for designing schemas for RDBMSs, these rules don't always apply to MongoDB. The simple fact that documents can represent rich, schema-free data structures means that we have a lot of viable alternatives to the standard, normalized, relational model. Not only that, MongoDB has several unique features, such as atomic updates and indexed array keys, that greatly influence the kinds of schemas that make sense. Understandably, this begets good questions: Are foreign keys permissible, or is it better to represent one-to-many relations withing a single document? Are join tables necessary, or is there another technique for building out many-to-many relationships? What level of denormalization is appropriate? How do my data modeling decisions affect the efficiency of updates and queries? In this session, we'll answer these questions and more, provide a number of data modeling rules of thumb, and discuss the tradeoffs of various data modeling strategies.

Statistics

Views

Total Views
807
Views on SlideShare
612
Embed Views
195

Actions

Likes
2
Downloads
27
Comments
0

3 Embeds 195

http://www.10gen.com 182
http://www.mongodb.com 12
http://drupal1.10gen.cc 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • In the filing cabinet model, the patient’s x-rays, checkups, and allergies are stored in separate drawers and pulled together (like an RDBMS)In the file folder model, we store all of the patient information in a single folder (like MongoDB)
  • Flexibility – Ability to represent rich data structuresPerformance – Benefit from data locality
  • Concrete example of typical blog in typical relational normalized form
  • Concrete example of typical blog in typical relational normalized form
  • Concrete example of typical blog using a document oriented de-normalized approach
  • Concrete example of typical blog in typical relational normalized form
  • Tools for data manipulation
  • Tools for data access
  • Slow to get address data every time you query for a user. Requires an extra operation.
  • Patron may have two addresses, in this case, you would need a separate table in a relation databaseWith MongoDB, you simply start storing the address field as an arrayOnly patrons which have multiple addresses could have this schema!No migration necessary! but Caution: Additional application logic required!
  • Publisher is repeated for every book, data duplication!
  • Publisher is better being a separate entity and having its own collection.
  • OR: because we are using MongoDB and documents can have arrays you can choose to model the relation by creating and maintaining an array of books within each publisher entity.Careful with mutable, growing arrays. See next slide.
  • Now to create a relation between the two entities, you can choose to reference the publisher from the book document.This is similar to the relational approach for this very same problem.
  • Costly for a small number of books because to get the publisher
  • And data locality provides speed
  • Book’s kind attribute could be local or loanableNote that we have locations for loanable books but not for localNote that these two separate schemas can co-exist (loanable books / local books are both books)
  • Note that we partially de-normalize here.To get books by a particular author: - get the author - get books that have that author id in array
  • Simple solution. The biggest problem with this approach is getting an entire subtree requires several query turnarounds to the database. No intrinsic ordering of children.
  • It may also be good for storing graphs where a node has multiple parents. This way has intrinsic ordering of children.

Schema Design Schema Design Presentation Transcript

  • #MongoChicagoIntro to Schema DesignChad TindelSenior Solution Architect, 10gen
  • Agenda• Working with documents• Evolving a Schema• Queries and Indexes• Common Patterns Single Table En
  • RDBMS MongoDBDatabase ➜ DatabaseTable ➜ CollectionRow ➜ DocumentIndex ➜ IndexJoin ➜ Embedded DocumentForeign Key ➜ ReferenceTerminology
  • Working withDocuments
  • Modeling Data
  • DocumentsProvide flexibility andperformance
  • Normalized Data
  • Disk seeks and data locality Seek = 5+ ms Read = really really fast Post Comment Author Tags
  • De-Normalized (embedded)Data
  • Disk seeks and data locality Article Author Comment Tag Comment Comment Comment Comment Comment
  • Relational Schema DesignFocus on data storage
  • Document Schema DesignFocus on data use
  • Schema DesignConsiderations• How do we manipulate the data? – Dynamic Ad-Hoc Queries – Atomic Updates – Map Reduce• What are the access patterns of the application? – Read/Write Ratio – Types of Queries / Updates – Data life-cycle and growth rate
  • Data Manipulation• Conditional Query Operators – Scalar: $ne, $mod, $exists, $type, $lt, $lte, $gt, $gte, $ne – Vector: $in, $nin, $all, $size• Atomic Update Operators – Scalar: $inc, $set, $unset – Vector: $push, $pop, $pull, $pushAll, $pullAll, $addToSet
  • Data Access• Flexible Schemas• Ability to embed complex data structures• Secondary Indexes• Compound Indexes• Multi-Value Indexes (Indexes on Arrays)• Aggregation Framework – $project, $match, $limit, $skip, $sort, $group, $unwind• No Joins
  • Getting Started
  • Library ManagementApplication• Patrons• Books• Authors• Publishers
  • An ExampleOne to One Relations
  • Modeling Patronspatron = { patron = { _id: "joe" _id: "joe" name: "Joe Bookreader” name: "Joe Bookreader",} address: { street: "123 Fake St. ",address = { city: "Faketon", patron_id = "joe", state: "MA", street: "123 Fake St. ", city: "Faketon", zip: 12345 state: "MA", } zip: 12345 }}
  • One to One Relations• Mostly the same as the relational approach• Generally good idea to embed “contains” relationships• Document model provides a holistic representation of objects
  • An ExampleOne To Many Relations
  • Modeling Patronspatron = { _id: "joe" name: "Joe Bookreader", join_date: ISODate("2011-10-15"), addresses: [ {street: "1 Vernon St.", city: "Newton", state: "MA", …}, {street: "52 Main St.", city: "Boston", state: "MA", …}, ]}
  • Publishers and Books• Publishers put out many books• Books have one publisher
  • BookMongoDB: The Definitive Guide,By Kristina Chodorow and Mike DirolfPublished: 9/24/2010Pages: 216Language: EnglishPublisher: O’Reilly Media, CA
  • Modeling Books – EmbeddedPublisherbook = { title: "MongoDB: The Definitive Guide", authors: [ "Kristina Chodorow", "Mike Dirolf" ] published_date: ISODate("2010-09-24"), pages: 216, language: "English", publisher: { name: "O’Reilly Media", founded: "1980", location: "CA" }}
  • Modeling Books & PublisherRelationshippublisher = { name: "O’Reilly Media", founded: "1980", location: "CA"}book = { title: "MongoDB: The Definitive Guide", authors: [ "Kristina Chodorow", "Mike Dirolf" ] published_date: ISODate("2010-09-24"), pages: 216, language: "English"}
  • Book _id as a Foreign Key(BAD)publisher = { name: "O’Reilly Media", founded: "1980", location: "CA" books: [ "123456789", ... ]}book = { _id: "123456789", title: "MongoDB: The Definitive Guide", authors: [ "Kristina Chodorow", "Mike Dirolf" ] published_date: ISODate("2010-09-24"), pages: 216, language: "English"}
  • Publisher _id as a ForeignKeypublisher = { _id: "oreilly", name: "O’Reilly Media", founded: "1980", location: "CA"}book = { title: "MongoDB: The Definitive Guide", authors: [ "Kristina Chodorow", "Mike Dirolf" ] published_date: ISODate("2010-09-24"), pages: 216, language: "English", publisher_id: "oreilly"}
  • Where do you put the foreignKey?• Array of books inside of publisher – Makes sense when many means a handful of items – Useful when items have bound on potential growth• Reference to single publisher on books – Useful when items have unbounded growth (unlimited # of books)• SQL doesn’t give you a choice, no arrays
  • Another ExampleOne to Many Relations
  • Books and Patrons• Book can be checked out by one Patron at a time• Patrons can check out many books (but not 1000s)
  • Modeling Checkoutspatron = { _id: "joe" name: "Joe Bookreader", join_date: ISODate("2011-10-15"), address: { ... }}book = { _id: "123456789" title: "MongoDB: The Definitive Guide", authors: [ "Kristina Chodorow", "Mike Dirolf" ], ...}
  • Modeling Checkoutspatron = { _id: "joe" name: "Joe Bookreader", join_date: ISODate("2011-10-15"), address: { ... }, checked_out: [ { _id: "123456789", checked_out: "2012-10-15" }, { _id: "987654321", checked_out: "2012-09-12" }, ... ]}
  • De-normalizationProvides data locality De-normalize for speed
  • Modeling Checkouts -- de-normalizedpatron = { _id: "joe" name: "Joe Bookreader", join_date: ISODate("2011-10-15"), address: { ... }, checked_out: [ { _id: "123456789", title: "MongoDB: The Definitive Guide", authors: [ "Kristina Chodorow", "Mike Dirolf" ], checked_out: ISODate("2012-10-15") }, { _id: "987654321" title: "MongoDB: The Scaling Adventure", ... }, ... ]}
  • Referencing vs. Embedding• Embedding is a bit like pre-joined data• Document level ops are easy for server to handle• Embed when the “many” objects always appear with (viewed in the context of) their parents.• Reference when you need more flexibility
  • An ExampleSingle Table Inheritance
  • Single Table Inheritancebook = { title: "MongoDB: The Definitive Guide", authors: [ "Kristina Chodorow", "Mike Dirolf" ] published_date: ISODate("2010-09-24"), kind: ”loanable" locations: [ ... ] pages: 216, language: "English", publisher: { name: "O’Reilly Media", founded: "1980", location: "CA" }}
  • An ExampleMany to Many Relations
  • Books and Authorsbook = { title: "MongoDB: The Definitive Guide", authors = [ { _id: "kchodorow", name: ”Kristina Chodorow” }, { _id: "mdirolf", name: ”Mike Dirolf” } ] published_date: ISODate("2010-09-24"), pages: 216, language: "English"}author = { _id: "kchodorow", name: "Kristina Chodorow", hometown: "New York"}db.authors.find ( { _id : ‘kchodorow’ } )db.books.find( { authors.id : ‘kchodorow’ } )
  • An ExampleTrees
  • Modeling Trees• Parent Links - Each node is stored as a document - Contains the id of the parent• Child Links - Each node contains the id’s of the children - Can support graphs (multiple parents / child)
  • Parent Linksbook = { title: "MongoDB: The Definitive Guide", authors: [ "Kristina Chodorow", "Mike Dirolf" ], published_date: ISODate("2010-09-24"), pages: 216, language: "English", category: "MongoDB"}category = { _id: MongoDB, parent: Databases }category = { _id: Databases, parent: Programming }category = { _id: Programming }
  • Child Linksbook = { _id: 123456789, title: "MongoDB: The Definitive Guide", authors: [ "Kristina Chodorow", "Mike Dirolf" ], published_date: ISODate("2010-09-24"), pages: 216, language: "English"}category = { _id: MongoDB, children: [ 123456789, … ] }category = { _id: Databases, children: [ MongoDB, Postgres }category = { _id: Programming, children: [ Databases, Languages ] }
  • Array of Ancestorsbook = { title: "MongoDB: The Definitive Guide", authors: [ "Kristina Chodorow", "Mike Dirolf" ], published_date: ISODate("2010-09-24"), pages: 216, language: "English", parent: ”MongoDB”, categories: [ Programming, Databases, MongoDB ]}book = { title: "MySQL: The Definitive Guide", authors: [ ”Michael Kofler" ], published_date: ISODate("2010-09-24"), pages: 320, language: "English", parent: ”MySQL", categories: [ Programming, Databases, MySQL ]}db.books.find( { categories : MongoDB } )
  • An ExampleQueues
  • Book Documentbook = { _id: 123456789, title: "MongoDB: The Definitive Guide", authors: [ "Kristina Chodorow", "Mike Dirolf" ], published_date: ISODate("2010-09-24"), pages: 216, language: "English", available: 3}db.books.findAndModify({ query: { _id: 123456789, available: { "$gt": 0 } }, update: { $inc: { available: -1 } }})
  • #MongoChicagoThank YouChad TindelSolution Architect, 10gen