Introduction to NoSQL with MongoDB, with a focus on JSON document design. This presentation was delivered the March 5th 2015 at SQLi Lyon.

1. Tugdual Grall
Technical Evangelist
tug@mongodb.com
@tgrall
Introduction
Philippe Charriere
DirecteurTechnique
pcharriere@sqli.com
@k33g_org

2. Introduction to NoSQLwith MongoDB
Tugdual Grall
Technical Evangelist
tug@mongodb.com
@tgrall
Philippe Charriere
DirecteurTechnique
pcharriere@sqli.com
@k33g_org

3. Tugdual “Tug” Grall
• MongoDB
– Technical Evangelist
• Couchbase
– Technical Evangelist
• eXo
– CTO
• Oracle
– Developer/Product Manager
– Mainly Java/SOA
• Developer in consulting firms
{“about” : “me”}
• Web
– @tgrall
– http://blog.grallandco.com
– tgrall
• NantesJUG cofounder
• Pet Project
– http://www.resultri.com
• tug@mongodb.com
• tugdual@gmail.com

4. Why MongoDB?

6. The relational model : 1970

7. Big Data

8. Big Users
http://www.theconnectivist.com/
&
Cisco

9. Living in the Post-transactional Future
Order-processing systems largely “done” (RDBMS);
new focus on better search and recommendations or
adapting prices on the fly (NoSQL)
Vast majority of its engineering is focused on
recommending better movies (NoSQL), not
processing monthly bills (RDBMS)
Easy part is processing the credit card (RDBMS).
Hard part is making it location aware, so it knows
where you are and what you’re buying (NoSQL)

10. Stay up!
.
.
.
Application
Scale out
Add more “Web” servers
RDBMS
Scale Up
Get bigger server
RDBMS
App
Server

11. NoSQL to Scale out!
.
.
.
Application
Scale out
Add more “Web” servers
NoSQL
Scale Out
Add more servers
NoSQL
App
Server
.
.
.

12. RDBMS Is Like a Spreadsheet

13. With “Relations” Between Rows

15. And makes things hard to change
Name Age Phone Email
New Column
New Table
New Table
New Column

16. Relational Database Challenges
Data Types
Unstructured data
Semi-structured data
Polymorphic data
Agile Development
Iterative
Short development cycles
New workloads
Volume of Data
Petabytes of data
Trillions of records
Millions of queries/sec
New Architectures
Horizontal scaling
Commodity servers
Cloud computing

17. Operational Database Landscape
Scalability&Performance
Depth of Functionality
key/value stores
wide column
RDBMS
MongoDB

18. Data Model

19. Product Catalog

20. Baseball Bat
-3 length to weight ratio
2-5/8" barrel diameter
Two-piece construction
R2 alloy barrel provides outstanding durability, performance and "pop"
R2 composite handle shifts weight into the bat's knob for ultra-fast swing speeds
Rifle Barrel design removes weight from the barrel for thinner wall thickness
Acoustic barrel offers that sweet-sounding "ping"
Contact grip helps eliminate sting and vibration
AIR Elite is RIP-IT's® fastest BBCOR bat and the one with the most performance
BBCOR certified - approved for high school and collegiate play
Includes RIP-IT's® "Love It Or Return It" 30 Day Refund Policy with free return
shipping
Manufacturer's warranty: 400 days
Made in the USA
Model: B1403E

21. Bat Product Table
Category Model Name Brand
Length to
weight
ratio
Barrel
Dia
Type Barrel Handle Cert. Country Price
Bat B1403E Air Elite RIP-IT -3 2 5/8 Composite R2 Alloy
R2
composite BBCOR USA $399.99
Bat B1403 Prototype RIP-IT -3 2 5/8 One-piece R1 Alloy R1 Alloy BBCOR USA $199.99
Bat MCB1B One Marucci -3 2 5/8 One-piece
AZ3000
aluminum
AZ3000
aluminum BBCOR Imported $199.99
Bat BB14S1 S1 Easton -3 2 5/8 Composite IMX
SIC Black
Carbon BBCOR China $399.99

22. Lets Add Gloves
Size: 12"
Infield/Outfield/Pitcher model
2-Piece Web pattern
Most popular MLB® pattern among pitchers
Pro Stock® American steerhide leather offers rugged durability and a superior feel
Dual-Welting™ on "exposed edges" of the fingers helps maintain pocket shape and
durability
Pro Stock™ hand-designed pattern for unbeatable craftsmanship
Dri-Lex® ultra-breathable wrist lining repels moisture from your hand
Black leather with rich brown embellishments
Pattern: B212
Model: WTA2000BBB212
Wilson

23. Bat and Glove Product Table
Category Model Name Brand
Length to
weight
ratio
Barrel Dia Type Barrel Handle Cert. Country Price
Bat B1403E Air Elite RIP-IT -3 2 5/8 Composite R2 Alloy
R2
composite BBCOR USA $399.99
Bat B1403 Prototype RIP-IT -3 2 5/8 One-piece R1 Alloy R1 Alloy BBCOR USA $199.99
Bat MCB1B One Marucci -3 2 5/8 One-piece AL AL BBCOR Imported $199.99
Bat BB14S1 S1 Easton -3 2 5/8 Composite IMX
SIC Black
Carbon BBCOR China $399.99
Category Model Name Brand Size Position Pattern Web
Pattern
Material Color Country Price
Glove
WTA2000B
BB212 A2000 Wilson 12" Infield B212 2-piece Leather black Vietnam $299.99
Glove PRO112PT HOH Pro Rawlings 11.25" Outfield Pro taper
Modified
Trap-Eze
Horween
Leather black China $229.99

24. Add some baseballs
Cover: Full grain leather for excellent durability
Core: Cushioned cork core
Additions/Technologies: Made to the exact specifications of MLB
Stitching/Seams: 108 classic red stitches/Rawlings® Major League seaming
League/Certification(s): MLB
Balls included per purchase: individual
Recommended Age: All ages
Model : ROMLB
Rawlings

25. Bat and Glove Product Table
Category Model Name Brand
Length to
weight
ratio
Barrel Dia Type Barrel Handle Cert. Country Price
Bat B1403E Air Elite RIP-IT -3 2 5/8 Composite R2 Alloy
R2
composite BBCOR USA $399.99
Bat B1403 Prototype RIP-IT -3 2 5/8 One-piece R1 Alloy R1 Alloy BBCOR USA $199.99
Bat MCB1B One Marucci -3 2 5/8 One-piece AL AL BBCOR Imported $199.99
Bat BB14S1 S1 Easton -3 2 5/8 Composite IMX
SIC Black
Carbon BBCOR China $399.99
Category Model Name Brand Size Position Pattern Web
Pattern
Material Color Country Price
Glove
WTA2000B
BB212 A2000 Wilson 12" Infield B212 2-piece Leather black Vietnam $299.99
Glove PRO112PT HOH Pro Rawlings 11.25" Outfield Pro taper
Modified
Trap-Eze
Horween
Leather black China $229.99
Category Model Name Brand Color Cover Core Cert. Country Price
Baseball
DICRLLB1
PBG
Little
League Rawlings white Leather
Cork
rubber
Little
League China $4.99
Baseball ROML MLB Rawlings white Leather cork China $6.99

26. Sparse Table
Category Model Name Brand
Length to
weight
ratio
Barrel Dia Type Barrel Handle
Certificati
on
Country Price Size Position Pattern
Web
Pattern
Material Color Cover Core
Bat B1403E Air
Elite RIP-­‐IT -­‐3 2
5/8 Composite R2
Alloy
R2
composite BBCOR USA $399.99
Bat B1403 Prototype RIP-­‐IT -­‐3 2
5/8 One-­‐piece R1
Alloy R1
Alloy BBCOR USA $199.99
Bat MCB1B One Marucci -­‐3 2
5/8 One-­‐piece
AZ3000
aluminum
AZ3000
aluminum BBCOR Imported $199.99
Bat BB14S1 S1 Easton -­‐3 2
5/8 Composite IMX
SIC
Black
Carbon BBCOR China $399.99
Glove
WTA2000BB
B212 A2000 Wilson Vietnam $299.99
12" Infield B212 2-­‐piece Leather black
Glove PRO112PT HOH
Pro Rawlings China $229.99
11.25" Outfield Pro
taper
Modified
Trap-­‐Eze
Horween
Leather black
Baseball
DICRLLB1PB
G Little
League Rawlings Little
League China $4.99
white Leather
cork
and
rubber
Baseball ROML MLB Rawlings China $6.99
white Leather cork
Continue adding columns as you add new products

27. Maybe this design will work better
prodID property value
1 length/weight -3
1 barrel dia 2 5/8
1 type composite
1 certification BBCOR
…
5 size 12
5 position infield
5 pattern B212
5 material leather
5 color black
…
8 color white
8 cover leather
8 core cork
prodID
Category Model Name Brand Country Price
1 Bat B1403E Air Elite RIP-IT USA $399.99
2 Bat B1403 Prototype RIP-IT USA $199.99
3 Bat MCB1B One Marucci Imported $199.99
4 Bat BB14S1 S1 Easton China $399.99
5 Glove
WTA2000BBB
212 A2000 Wilson Vietnam $299.99
6 Glove PRO112PT HOH Pro Rawlings China $229.99
7 Baseball DICRLLB1PBG Little League Rawlings China $4.99
8 Baseball ROML MLB Rawlings China $6.99

28. MongoDB uses “Documents”
{
category:“glove”,
model:“PRO112PT”,
name:“Air Elite”,
brand:“Rawlings”,
price: 229.99,
available: Date(“2013-03-31”)
}
Fields
Values
Field values are
typed
string
number
date

29. Documents are rich structures
{
category:“glove”,
model:“PRO112PT”,
name:“Air Elite”,
brand:“Rawlings”,
price: 229.99,
available: Date(“2013-03-31”),
position: [“infield”,“outfield”,“pitcher”]
}
Fields
can
contain
arrays

30. Documents are rich structures
{
category:“glove”,
model:“PRO112PT”,
name:“Air Elite”,
brand:“Rawlings”,
price: 229.99,
available: Date(“2013-03-31”),
position: [“infield”,“outfield”,“pitcher”],
endorsed: {name:“Ryan Howard”,
team:“Phillies”,
position:“first base”},
}
Fields can contain sub-
documents

31. Documents are rich structures{
category:“glove”,
model:“PRO112PT”,
name:“Air Elite”,
brand:“Rawlings”,
price: 229.99,
available: Date(“2013-03-31”),
position: [“infield”,“outfield”,“pitcher”],
endorsed: {name:“Ryan Howard”,
team:“Phillies”,
position:“first base”},
history: [{date: Date(“2013-03-31”), price: 279.99},
{date: Date(“2013-06-01”),price: 259.79},
{date: Date(“2013-08-15”),price: 229.99}]
}
Fields can contain an
array of sub-documents

32. Variation is easy with document model
{
category: bat,
model: B1403E,
name:Air Elite,
brand:“Rip-IT”,
price: 399.99
diameter:“2 5/8”,
barrel: R2Alloy,
handle: R2 Composite,
type: composite,
}
{
category: glove,
model: PRO112PT,
name:Air Elite,
brand:“Rawlings”,
price:“229.99”
size: 11.25,
position: outfield,
pattern:“Pro taper”,
material: leather,
color: black
}
{
category: ball,
model: ROML,
name: MLB,
brand:“Rawlings”,
price:“6.99”
cover: leather,
core: cork,
color: white
}

33. {
"_id" : 45218468309,
"date" : ISODate("2015-01-28T09:40:50.615Z"),
"customer" : {
"id" : 654321,
"name" : "John Doe"
},
"ship_to" : {
"name" : "John Doe",
"street" : “Rue du Code",
"city" : “69000 Lyon",
},
"items" : [
{
"sku" : "WA34R",
"description" : "Wireless Qwerty Keyboard",
"quantity" : 1,
"unit_price" : 41.5,
"price" : 41.5,
"vat" : 20
},
{
"sku" : "MW003",
"description" : "MiWatch",
"quantity" : 2,
"unit_price" : 245,
"price" : 490,
"vat" : 20
}
],
"price" :
{ "total" : 531.5 , "vat" : 106.3 }
}
Document Data Model
Relational MongoDB

34. Document Data Model
Relational MongoDB
{
first_name: ‘Paul’,
surname: ‘Miller’,
city: ‘London’,
location: [45.123,47.232],
cars: [
{ model: ‘Bentley’,
year: 1973,
value: 100000, … },
{ model: ‘Rolls Royce’,
year: 1965,
value: 330000, … }
}
}

35. Document Model Benefits
Agility and flexibility
Data model supports business change
Rapidly iterate to meet new requirements
Intuitive, natural data representation
Eliminates ORM layer
Developers are more productive
Reduces the need for joins, disk seeks
Programming is more simple
Performance delivered at scale
{
_id : ObjectId("4c4ba5e5e8aabf3"),
employee_name: "Dunham, Justin",
department : "Marketing",
title : "Product Manager, Web",
report_up: "Neray, Graham",
pay_band: “C",
benefits : [
{ type : "Health",
plan : "PPO Plus" },
{ type : "Dental",
plan : "Standard" }
]
}

36. Morphia
MEAN
Stack
Java Python PerlRuby
Support for the most popular languages and frameworks
Drivers & Ecosystem

37. Demonstration

38. MongoDB Overview

39. ‹#›
CREATE APPLICATIONS
NEVER BEFORE POSSIBLE
AGILE SCALABLE

40. ‹#›
MongoDB
GENERAL PURPOSE DOCUMENT DATABASE OPEN-SOURCE

41. THE LARGEST ECOSYSTEM
9,000,000+
MongoDB Downloads
200,000+
Online Education Registrants
35,000+
MongoDB User Group Members
35,000+
MongoDB Management Service (MMS) Users
750+
Technology and Services Partners
2,000+
Customers Across All Industries

42. ‹#›
MongoDB and Enterprise IT Stack

43. MongoDB, Inc.
400+ employees 2,000+ customers
Over $311 million in funding13 offices around the world

44. High Availability & Scalability

45. HighAvailability
Replica Set – two or more copies
Self-healing shard
Addresses availability considerations:
High Availability
Disaster Recovery
Maintenance
Deployment Flexibility
Data locality to users
Workload isolation: operational & analytics

46. Scalability
Three types of sharding: hash-based, range-based, tag-aware
Increase or decrease capacity as you go
Automatic balancing

47. Query Routing
Multiple query optimization models
Each sharding option appropriate for
different apps

48. Demonstration

49. DeploymentArchitectures & Operations

50. Single Data Center
Automated failover
Tolerates server failures
Tolerates rack failures
Number of replicas defines failure
tolerance

51. Active/Active Data Center
Tolerates server, rack, data center failures, network partitions

52. Read Global/Write Local

53. Replicate Data Near Users

54. Single-click provisioning, scaling &
upgrades, admin tasks
Monitoring, with charts, dashboards and
alerts on 100+ metrics
Backup and restore, with point-in-time
recovery, support for sharded clusters
MongoDB Ops Manager
The Best Way to Manage MongoDB In Your Data Center
Up to 95% Reduction in Operational Overhead

55. How MongoDB Ops Manager helps you
Scale
EasilyMeet
SLAs
Best
Practices,
Automated
Cut
Management
Overhead

56. How Ops Manager Works
Ops Manager
mongod mongodmongod
Agent Agent Agent
New
Config. N
ew
C
onfig.
NewConfig.

57. Integrates with Existing Infrastructure

58. *Included with MongoDB Enterprise Advanced
BUSINESS NEEDS SECURITY FEATURES
Authentication SCRAM, LDAP*, Kerberos*, x.509 Certificates
Authorization Built-in Roles, User-Defined Roles, Field-Level Redaction
Auditing Admin, DML, DDL, Role-based
Encryption Network: SSL (with FIPS 140-2)*, Disk: Partner Solutions
Enterprise-Grade Security

59. Scalability & Performance

60. Scale
250M Ticks/Sec
300K+ Ops/Sec
500K+ Ops/SecFed Agency
Performance
1,400 Servers
1,000+ Servers
250+ Servers
Entertainment Co.
Cluster
Petabytes
10s of billions of objects
13B documents
Data
Asian Internet Co.

61. Example: MongoDB Management Service
Cloud service for managing MongoDB systems
100+ system metrics visualized and alerted
35,000+ MongoDB systems submitting data every 60 seconds
90% updates, 10% reads
~30,000 updates/second
~3.2B operations/day
Eight x86-64 servers

62. MongoDB Performance*
Top 5 Marketing Firm Government Agency Top 5 Investment Bank
Data
Key/value
10+ fields, arrays,
nested documents
20+ fields, arrays,
nested documents
Queries
Key-based
1 – 100 docs/query
80/20 read/write
Compound queries
Range queries
MapReduce
20/80 read/write
Compound queries
Range queries
50/50 read/write
Servers
~250 ~50 4
Ops/sec
1,200,000 500,000 30,000
* These figures are provided as examples. Your application governs your performance.

63. For More Information
Resource Location
Case Studies mongodb.com/customers
Presentations mongodb.com/presentations
Free Online Training education.mongodb.com
Webinars and Events mongodb.com/events
Documentation docs.mongodb.org
MongoDB Downloads mongodb.com/download
Additional Info info@mongodb.com

64. Tugdual Grall
Technical Evangelist
tug@mongodb.com
@tgrall
Questions?