MongoDB, profile picture
Uploaded byMongoDB
PDF, PPTX1,211 views

MongoDB Europe 2016 - Debugging MongoDB Performance

The document discusses MongoDB diagnostics and debugging, highlighting the importance of understanding system performance and metrics over time. It references various MongoDB logging commands and provides examples of log outputs, illustrating how to gather and analyze data for improving database performance. Additionally, it mentions the use of tools for visualizing log data through commands like 'mplotqueries'.

Embed presentation

Download as PDF, PPTX
1 / 123
2 / 123
3 / 123
4 / 123
5 / 123
6 / 123
7 / 123
8 / 123
9 / 123
10 / 123
11 / 123
12 / 123
13 / 123
14 / 123
15 / 123
16 / 123
17 / 123
18 / 123
19 / 123
20 / 123
21 / 123
22 / 123
23 / 123
24 / 123
25 / 123
26 / 123
27 / 123
28 / 123
29 / 123
30 / 123
31 / 123
32 / 123
33 / 123
34 / 123
35 / 123
36 / 123
37 / 123
38 / 123
39 / 123
40 / 123
41 / 123
42 / 123
43 / 123
44 / 123
45 / 123
46 / 123
47 / 123
48 / 123
49 / 123
50 / 123
51 / 123
52 / 123
53 / 123
54 / 123
55 / 123
56 / 123
57 / 123
58 / 123
59 / 123
60 / 123
61 / 123
62 / 123
63 / 123
64 / 123
65 / 123
66 / 123
67 / 123
68 / 123
69 / 123
70 / 123
71 / 123
72 / 123
73 / 123
74 / 123
75 / 123
76 / 123
77 / 123
78 / 123
79 / 123
80 / 123
81 / 123
82 / 123
83 / 123
84 / 123
85 / 123
86 / 123
87 / 123
88 / 123
89 / 123
90 / 123
91 / 123
92 / 123
93 / 123
94 / 123
95 / 123
96 / 123
97 / 123
98 / 123
99 / 123
100 / 123
101 / 123
102 / 123
103 / 123
104 / 123
105 / 123
106 / 123
107 / 123
108 / 123
109 / 123
110 / 123
111 / 123
112 / 123
113 / 123
114 / 123
115 / 123
116 / 123
117 / 123
118 / 123
119 / 123
120 / 123
121 / 123
122 / 123
123 / 123
Asya Kamsky, Lead Product Manager MongoDB Diagnostics and Debugging 3.4
Asya Kamsky, Lead Product Manager MongoDB Diagnostics and Debugging 3.4
“ I thought of my old teacher Joe Bell, ... of his eerie trick of spotting details. If he were a detective he would surely reduce this ... business to something nearer an exact science. —Arthur Conan Doyle
The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.
The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.
Understanding The Patient
#MDBW16 Understanding The Patient Understand the system Knowledge Monitor trends over time Trends Record all metrics "at rest" Baseline
Gathering Data “Data! Data! Data! I can't make bricks without clay.” -- Sherlock Holmes, The Adventure of the Copper Beeches
“There is nothing like first-hand evidence.” -- Sherlock Holmes, A Study in Scarlet
Available Tools
#MDBW16 Available Tools: Say "AH"
#MDBW16 Available Tools: Say "AH"
#MDBW16 Available Tools: Say "AH"
#MDBW16 Available Tools: Say "AH" > db.isMaster( ) > rs.conf( ) > rs.status( ) > sh.status( ) > db.version( ) > db.serverCmdLineOpts( )
#MDBW16 Available Tools: Say "AH"
#MDBW16 > show dbs > show collections > db.getCollectionNames().forEach(function(c) { printjson(db.getCollection(c).getIndexes()); }); Available Tools: Say "AH"
#MDBW16 Available Tools: Say "AH"
#MDBW16 Available Tools: Compass
#MDBW16 Available Tools: OS % free % blockdev --report % dmesg % ulimit -a % ifconfig, ip <...>, iptables % iostat % netstat % top; htop % perf % iperf3
#MDBW16 Available Tools: OS for MongoDB % mongostat % mongotop
mongod logs
2014-09-01T15:50:03.184-0004 [conn208] query data.activity query: { $query: { _updated_at: { $gt: new Date(1396459946346) }, _to: "_UserA" } }, $orderby: { _updated_at: -1 } } planSummary: IXSCAN { _to: 1, _created_at: -1 } ntoreturn:100 ntoskip:0 nscanned:19692 nscannedObjects:19692 numYields:170 locks(micros) r: 283957 nreturned:65 reslen:24939 342ms 2014-09-01T15:50:03.184-0004 [conn208] query data.activity query: { $query: { _updated_at: { $gt: new Date(1396459946346) }, _to: "_UserA" } }, $orderby: { _updated_at: -1 } } planSummary: IXSCAN { _to: 1, _created_at: -1 } ntoreturn:100 ntoskip:0 nscanned:19692 nscannedObjects:19692 numYields:170 locks(micros) r: 283957 nreturned:65 reslen:24939 342ms mongod logs
2015-05-26T23:33:32.774-0500 I 2015-05-28T12:37:11.440-0500 I 2015-05-28T12:38:35.839-0500 I D, I, W, E, F 3.0 mongod logs
2015-05-26T23:33:32.774-0500 I COMMAND 2015-05-28T12:37:11.440-0500 I NETWORK 2015-05-28T12:38:35.839-0500 I QUERY 3.0 COMMAND,NETWORK,QUERY,REPL,ACCESS,INDEX,JOURNAL,SHARDING,WRITE,- mongod logs
2015-05-26T23:33:32.774-0500 I COMMAND [conn45] command admin.$cmd command: listDatabases { listDatabases: 1.0 } ntoskip:0 keyUpdates:0 writeConflicts:0 numYields:0 reslen:393 locks:{ Global: { acquireCount: { r: 12 } }, Database: { acquireCount: { r: 6 } } } 321ms 2015-05-28T12:37:11.440-0500 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48625 #183 (21 connections now open) 2015-05-28T12:38:35.839-0500 I QUERY [conn183] getmore tableau.flights201406 query: { origin_city_market_id: 31703.0 } cursorid: 61957110347 ntoreturn:0 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:176 nreturned:22579 reslen:1332181 locks:{ Global: { acquireCount: { r: 354 } }, Database: { acquireCount: { r: 177 } }, Collection: { acquireCount: { r: 177 } } } 114ms 3.0 mongod logs
3.2 mongod logs
2016-06-23T10:34:41.559-0700 I COMMAND [conn26] command test.c command: find { find: "c", filter: { a: { $elemMatch: { v: { $gte: 3.0, $lt: 4.0 } } } } } planSummary: IXSCAN { a.v: 1.0 } keysExamined:2 docsExamined:1 fromMultiPlanner:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:1 nreturned:1 reslen:187 locks:{ Global: { acquireCount: { r: 4 } }, Database: { acquireCount: { r: 2 } }, Collection: { acquireCount: { r: 2 } } } protocol:op_command 110ms 3.2 mongod logs
2016-06-23T10:34:41.559-0700 I COMMAND [conn26] command test.c command: find { find: "c", filter: { a: { $elemMatch: { v: { $gte: 3.0, $lt: 4.0 } } } } } planSummary: IXSCAN { a.v: 1.0 } keysExamined:2 docsExamined:1 fromMultiPlanner:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:1 nreturned:1 reslen:187 locks:{ Global: { acquireCount: { r: 4 } }, Database: { acquireCount: { r: 2 } }, Collection: { acquireCount: { r: 2 } } } protocol:op_command 110ms 3.2 mongod logs
3.4 mongod logs
3.4 mongod logs 2016-06-01T15:30:04.373-0700 I COMMAND [conn99] command socialite.following command: aggregate { aggregate: "following", pipeline: [ { $match: { _f: "45705" } }, { $group: { _id: null, followees: { $addToSet: "$_t" } } }, { $lookup: { from: "following", localField: "followees", foreignField: "_f", as: "fofollowees" } }, { $project: { fofs: { $setUnion: [ "$followees", "$fofollowees._t" ] } } } ] } planSummary: IXSCAN { _f: 1, _t: 1 } keysExamined:1 docsExamined:0 numYields:11 reslen:316214 locks:{ Global: { acquireCount: { r: 3800 } }, Database: { acquireCount: { r: 1900 } }, Collection: { acquireCount: { r: 1900 } } } protocol:op_query 218ms
3.4 mongod logs 2016-06-25T23:38:27.346-0500 I WRITE [conn128] update ycsb.usertable query: { _id: "user7074965863272626663" } planSummary: IDHACK update: { $set: { field1: BinData(0, 2 } } keysExamined:1 docsExamined:1 nMatched:1 nModified:1 numYields:1 locks:{ Global: { acquireCount: { r: 3, w: 3 } }, Database: { acquireCount: { w: 3 } }, Collection: { acquireCount: { w: 2 } }, Metadata: { acquireCount: { w: 1 } }, oplog: { acquireCount: { w: 1 } } } 11ms
> db.getLogComponents()
> db.getLogComponents() { "verbosity" : 1, "accessControl" : { "verbosity" : -1}, "command" : { "verbosity" : -1}, "control" : { "verbosity" : -1}, "geo" : { "verbosity" : -1}, "index" : { "verbosity" : -1}, "network" : { "verbosity" : -1}, "query" : { "verbosity" : -1}, "replication" : { "verbosity" : -1}, "sharding" : { "verbosity" : -1}, "storage" : { "verbosity" : -1, "journal" : { "verbosity" : -1}}, "write" : { "verbosity" : -1} }
> db.getLogComponents() { "verbosity" : 1, "accessControl" : { "verbosity" : -1}, "command" : { "verbosity" : -1}, "control" : { "verbosity" : -1}, "executor" : { "verbosity" : -1}, "geo" : { "verbosity" : -1}, "index" : { "verbosity" : -1}, "network" : { "verbosity" : -1}, "query" : { "verbosity" : -1}, "replication" : { "verbosity" : -1}, "sharding" : { "verbosity" : -1}, "storage" : { "verbosity" : -1, "journal" : { "verbosity" : -1}}, "write" : { "verbosity" : -1}, "ftdc" : { "verbosity" : -1} }
> db.setLogLevel( logLevel, component ) > db.setLogLevel( 1, "sharding" ) > db.setLogLevel( 2, "query" )
"It is of the highest importance ... to be able to recognize, out of a number of facts, which are incidental and which vital. " Sherlock Holmes, The Reigate Puzzle
https://github.com/rueckstiess/mtools byThomasRückstieß
https://github.com/rueckstiess/mtools byThomasRückstieß
#MDBW16 mplotqueries $ mplotqueries --help usage: mplotqueries [OPTIONS] [logfile [logfile ...]] A script to plot various information from logfiles. ...
#MDBW16 mplotqueries $ mplotqueries --help usage: mplotqueries [OPTIONS] [logfile [logfile ...]] A script to plot various information from logfiles. ... optional arguments: --type {nscanned/n,rsstate,connchurn,durline,histogram,range,scatter,event} type of plot (default=scatter with --yaxis duration)
#MDBW16 mplotqueries $ mplotqueries --help usage: mplotqueries [OPTIONS] [logfile [logfile ...]] A script to plot various information from logfiles. ... optional arguments: --type {nscanned/n,rsstate,connchurn,durline,histogram,range,scatter,event} type of plot (default=scatter with --yaxis duration) --group GROUP specify value to group on. All basic plot types can group on 'namespace', 'operation', 'thread', 'pattern' ...
"... what is out of the common is usually a guide rather than a hindrance." — Sherlock Holmes, A Study in Scarlet
mplotqueries % mplotqueries firstmongo.log --type nscanned/n
% mplotqueries firstmongo.log --type nscanned/n 2014-06-17T17:13:34.235 [conn1569841] query db1.coll query: { time: { $lt: "2014-06-17 17:13:31", $gte: "2014-06-17 17:04:31" } } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:5169727 nscannedObjects:5169727 keyUpdates:0 numYields:12492 locks(micros) r:37736571 nreturned:72 reslen:32707 30129ms mplotqueries
% mplotqueries firstmongo.log --type nscanned/n 2014-06-17T17:13:34.235 [conn1569841] query db1.coll query: { time: { $lt: "2014-06-17 17:13:31", $gte: "2014-06-17 17:04:31" } } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:5169727 nscannedObjects:5169727 keyUpdates:0 numYields:12492 locks(micros) r:37736571 nreturned:72 reslen:32707 30129ms mplotqueries
% mplotqueries firstmongo.log --type nscanned/n 2014-06-17T17:13:34.235 [conn1569841] query db1.coll query: { time: { $lt: "2014-06-17 17:13:31", $gte: "2014-06-17 17:04:31" } } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:5169727 nscannedObjects:5169727 keyUpdates:0 numYields:12492 locks(micros) r:37736571 nreturned:72 reslen:32707 30129ms mplotqueries
% mplotqueries firstmongo.log --type nscanned/n 2014-06-17T17:13:34.235 [conn1569841] query db1.coll query: { time: { $lt: "2014-06-17 17:13:31", $gte: "2014-06-17 17:04:31" } } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:5169727 nscannedObjects:5169727 keyUpdates:0 numYields:12492 locks(micros) r:37736571 nreturned:72 reslen:32707 30129ms 2014-06-17T17:13:47.607 [conn1569990] query db2.coll query: { time: { $lt: "2014-06-17 17:14:05", $gte: "2014-06-17 17:05:05" }, status: 8 } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:2057564 nscannedObjects:2057564 keyUpdates:0 numYields:5008 locks(micros) r:11557172 nreturned:56 reslen:18745 13086ms mplotqueries
% mplotqueries firstmongo.log --type nscanned/n 2014-06-17T17:13:34.235 [conn1569841] query db1.coll query: { time: { $lt: "2014-06-17 17:13:31", $gte: "2014-06-17 17:04:31" } } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:5169727 nscannedObjects:5169727 keyUpdates:0 numYields:12492 locks(micros) r:37736571 nreturned:72 reslen:32707 30129ms 2014-06-17T17:13:47.607 [conn1569990] query db2.coll query: { time: { $lt: "2014-06-17 17:14:05", $gte: "2014-06-17 17:05:05" }, status: 8 } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:2057564 nscannedObjects:2057564 keyUpdates:0 numYields:5008 locks(micros) r:11557172 nreturned:56 reslen:18745 13086ms mplotqueries
% mplotqueries firstmongo.log --type nscanned/n 2014-06-17T17:13:34.235 [conn1569841] query db1.coll query: { time: { $lt: "2014-06-17 17:13:31", $gte: "2014-06-17 17:04:31" } } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:5169727 nscannedObjects:5169727 keyUpdates:0 numYields:12492 locks(micros) r:37736571 nreturned:72 reslen:32707 30129ms 2014-06-17T17:13:47.607 [conn1569990] query db2.coll query: { time: { $lt: "2014-06-17 17:14:05", $gte: "2014-06-17 17:05:05" }, status: 8 } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:2057564 nscannedObjects:2057564 keyUpdates:0 numYields:5008 locks(micros) r:11557172 nreturned:56 reslen:18745 13086ms mplotqueries
% mplotqueries updates?.log
% mplotqueries updates?.log
% mplotqueries updates?.log
% mplotqueries updates?.log
% mplotqueries updates?.log
"Eliminate all other factors, and the one which remains must be the truth." Sherlock Holmes -The Sign of Four
#MDBW16 Available Tools % mongostat
#MDBW16 mongostat
#MDBW16 --discover mongostat
#MDBW16 mongostat insert query update delete getmore command % dirty % used flushes vsize res faults qr|qw ar|aw netIn netOut conn ReplSetName role ts
#MDBW16 Trends
#MDBW16 Available Tools
#MDBW16 Available Tools: in the Cloud
#MDBW16 Available Tools: in the Cloud
#MDBW16 Available Tools: in the Cloud
#MDBW16 Available Tools: in the Cloud
#MDBW16 Available Tools: in the Cloud
#MDBW16 Available Tools: in the Cloud
#MDBW16 Available Tools: in the Cloud
#MDBW16 Available Tools: in the Cloud
#MDBW16 Available Tools: in the Cloud
% mplotqueries –type connchurn
#MDBW16 db.currentOp()
#MDBW16 db.currentOp() > db.currentOp({secs_running:{$gt:10}}) { "desc" : "conn3482", "threadId" : "140512575297280", "connectionId" : 3482, "client_s" : "10.0.149.179:55295", "active" : true, "opid" : "SocialiteAtlas-shard-2:55547103", "secs_running" : 13, "microsecs_running" : NumberLong(13483812), "op" : "query", "ns" : "db1.coll1", "numYields" : 48815, "query" : { "field1" : 5,
#MDBW16 db.currentOp() > db.currentOp({desc:/^conn/,secs_running:{$gt:0}}).inprog.forEach(function(op) { print(op.opid, op.op, op.ns, op.secs_running); }); SocialiteAtlas-shard-0:68479014 query socialite.content 3 SocialiteAtlas-shard-0:68479730 query socialite.content 2 SocialiteAtlas-shard-0:68480174 query socialite.content 1 SocialiteAtlas-shard-0:68479234 query socialite.content 2 SocialiteAtlas-shard-0:68480136 query socialite.content 1 SocialiteAtlas-shard-0:68479529 query socialite.content 2 SocialiteAtlas-shard-0:68480182 query socialite.content 1 SocialiteAtlas-shard-0:68480261 query socialite.content 1 > db.killOp ( opid )
#MDBW16
Asya Kamsky, Lead Product Manager MongoDB Diagnostics and Debugging 3.4
Title Slide Option 1 Click here to add speaker name and title
Title Slide Option 2 Click here to add speaker name and title
This is divider slide option 2
#MDBW16 Click to add title: keep it to 56 characters w/spaces This is a typical content slide with full width body. •  First level bullet list •  Second level bullet list •  Third level bullet list
#MDBW16 Two content Click to add text. •  First level bullet list •  Second level bullet list •  Third level bullet list Click to add text. •  First level bullet list •  Second level bullet list •  Third level bullet list
#MDBW16 Left content Click to add text. •  First level bullet list •  Second level bullet list
#MDBW16 Left content Click to add text. •  First level bullet list •  Second level bullet list
#MDBW16 Pie Chart 64% 25% 11% 1st Qtr 2nd Qtr 3rd Qtr 1st Quarter Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique . 2nd Quarter Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique . 3rd Quarter Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique .
#MDBW16 Bar Graph 0 1 2 3 4 5 6 Category 1 Category 2 Category 3 Category 4 Chart Title Series 1 Series 2 Series 3
#MDBW16 Column Header 1 Column Header 2 Column Header 3 Column Header 4 Column Header 5 Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Table
#MDBW16 Title only
#MDBW16 Coding Example – Light Background // Retrieve var MongoClient = require('mongodb').MongoClient; // Connect to the db MongoClient.connect("mongodb://localhost:27017/exampleDb", function(err, db) { if(err) { return console.dir(err); } db.collection('test', function(err, collection) {}); db.collection('test', {w:1}, function(err, collection) {}); db.createCollection('test', function(err, collection) {}); db.createCollection('test', {w:1}, function(err, collection) {}); });
#MDBW16 Coding Example – Dark Background // Retrieve var MongoClient = require('mongodb').MongoClient; // Connect to the db MongoClient.connect("mongodb://localhost:27017/exampleDb", function(err, db) { if(err) { return console.dir(err); } db.collection('test', function(err, collection) {}); db.collection('test', {w:1}, function(err, collection) {}); db.createCollection('test', function(err, collection) {}); db.createCollection('test', {w:1}, function(err, collection) {}); });
#MDBW16 List slide – can also be used for agenda Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem Ipsum 01 Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem Ipsum 03Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem Ipsum 02 Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem Ipsum 05 Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem Ipsum 06Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem Ipsum 05
#MDBW16 Columns and icons with copy (option 1) Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique. Linked Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique. Planning Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique. Writing Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique. Research
#MDBW16 Columns and icons with copy (option 2) Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique . Linked Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique . Planning Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique . Writing Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique . Research
#MDBW16 Timeline or progress 2013 Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. 2014 2015 Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. 2016
“ Quote sample. Lorem ipsum dolor sit amet, onsectetur adipiscing elit amet sodales. Praesent sodales odio sit amet odio tristique. Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique. Lorem ipsum dolor sit amet, onsectetur adipiscing elit.”
MongoDB Europe 2016 - Debugging MongoDB Performance

More Related Content

PDF
MongoDB Europe 2016 - ETL for Pros – Getting Data Into MongoDB The Right Way
byMongoDB
 
PDF
MongoDB Europe 2016 - Enabling the Internet of Things at Proximus - Belgium's...
byMongoDB
 
PDF
MongoDB Performance Tuning
byPuneet Behl
 
PDF
Inside MongoDB: the Internals of an Open-Source Database
byMike Dirolf
 
PDF
MongoDB Europe 2016 - Advanced MongoDB Aggregation Pipelines
byMongoDB
 
ODP
2011 Mongo FR - Indexing in MongoDB
byantoinegirbal
 
PDF
Indexing
byMike Dirolf
 
PPTX
Back to Basics Webinar 5: Introduction to the Aggregation Framework
byMongoDB
 
MongoDB Europe 2016 - ETL for Pros – Getting Data Into MongoDB The Right Way
byMongoDB
 
MongoDB Europe 2016 - Enabling the Internet of Things at Proximus - Belgium's...
byMongoDB
 
MongoDB Performance Tuning
byPuneet Behl
 
Inside MongoDB: the Internals of an Open-Source Database
byMike Dirolf
 
MongoDB Europe 2016 - Advanced MongoDB Aggregation Pipelines
byMongoDB
 
2011 Mongo FR - Indexing in MongoDB
byantoinegirbal
 
Indexing
byMike Dirolf
 
Back to Basics Webinar 5: Introduction to the Aggregation Framework
byMongoDB
 

What's hot

PDF
MongoDB World 2016: Deciphering .explain() Output
byMongoDB
 
PDF
MongoDB Europe 2016 - Graph Operations with MongoDB
byMongoDB
 
PPTX
Webinar: Index Tuning and Evaluation
byMongoDB
 
PPTX
Webinar: Exploring the Aggregation Framework
byMongoDB
 
PPTX
Getting Started with MongoDB and NodeJS
byMongoDB
 
PPTX
Back to Basics Webinar 4: Advanced Indexing, Text and Geospatial Indexes
byMongoDB
 
PDF
はじめてのMongoDB
byTakahiro Inoue
 
PPT
Introduction to MongoDB
byantoinegirbal
 
PPTX
Webinaire 2 de la série « Retour aux fondamentaux » : Votre première applicat...
byMongoDB
 
PPTX
Back to Basics Webinar 3: Schema Design Thinking in Documents
byMongoDB
 
PPTX
MongoDB + Java - Everything you need to know
byNorberto Leite
 
KEY
Mongo db presentation
byJulie Sommerville
 
PPTX
MongoDB - Aggregation Pipeline
byJason Terpko
 
PPTX
Back to Basics, webinar 2: La tua prima applicazione MongoDB
byMongoDB
 
PPTX
Agg framework selectgroup feb2015 v2
byMongoDB
 
PPTX
Building a Scalable Inbox System with MongoDB and Java
byantoinegirbal
 
PDF
MongoDB Performance Debugging
byMongoDB
 
PPTX
Mythbusting: Understanding How We Measure the Performance of MongoDB
byMongoDB
 
PPTX
Indexing with MongoDB
byMongoDB
 
PPTX
Beyond the Basics 2: Aggregation Framework
byMongoDB
 
MongoDB World 2016: Deciphering .explain() Output
byMongoDB
 
MongoDB Europe 2016 - Graph Operations with MongoDB
byMongoDB
 
Webinar: Index Tuning and Evaluation
byMongoDB
 
Webinar: Exploring the Aggregation Framework
byMongoDB
 
Getting Started with MongoDB and NodeJS
byMongoDB
 
Back to Basics Webinar 4: Advanced Indexing, Text and Geospatial Indexes
byMongoDB
 
はじめてのMongoDB
byTakahiro Inoue
 
Introduction to MongoDB
byantoinegirbal
 
Webinaire 2 de la série « Retour aux fondamentaux » : Votre première applicat...
byMongoDB
 
Back to Basics Webinar 3: Schema Design Thinking in Documents
byMongoDB
 
MongoDB + Java - Everything you need to know
byNorberto Leite
 
Mongo db presentation
byJulie Sommerville
 
MongoDB - Aggregation Pipeline
byJason Terpko
 
Back to Basics, webinar 2: La tua prima applicazione MongoDB
byMongoDB
 
Agg framework selectgroup feb2015 v2
byMongoDB
 
Building a Scalable Inbox System with MongoDB and Java
byantoinegirbal
 
MongoDB Performance Debugging
byMongoDB
 
Mythbusting: Understanding How We Measure the Performance of MongoDB
byMongoDB
 
Indexing with MongoDB
byMongoDB
 
Beyond the Basics 2: Aggregation Framework
byMongoDB
 

Viewers also liked

PDF
MongoDB Europe 2016 - MongoDB 3.4 preview and introduction to MongoDB Atlas
byMongoDB
 
PDF
Eventually Consistent
byWilfred Springer
 
PPTX
Concurrency Control in MongoDB 3.0
byMongoDB
 
PDF
MongoDB Europe 2016 - MongoDB, Ops Manager & Docker at SNCF
byMongoDB
 
PDF
MongoDB Europe 2016 - Using MongoDB to Build a Fast and Scalable Content Repo...
byMongoDB
 
PDF
MongoDB Europe 2016 - Building WiredTiger
byMongoDB
 
PDF
MongoDB Europe 2016 - Deploying MongoDB on NetApp storage
byMongoDB
 
PPTX
Webinar: Data Streaming with Apache Kafka & MongoDB
byMongoDB
 
PDF
MongoDB Europe 2016 - Choosing Between 100 Billion Travel Options – Instant S...
byMongoDB
 
PDF
MongoDB Europe 2016 - Welcome
byMongoDB
 
PDF
Webinar: Introducing the MongoDB Connector for BI 2.0 with Tableau
byMongoDB
 
PPTX
Webinar: Transitioning from SQL to MongoDB
byMongoDB
 
PDF
Webinar: 10-Step Guide to Creating a Single View of your Business
byMongoDB
 
PDF
mongoDb-certification
byDarien Alvarez
 
PPTX
MongoDB at Scale
byMongoDB
 
PDF
Indexing and Performance Tuning
byMongoDB
 
PPTX
Webinar: MongoDB Schema Design and Performance Implications
byMongoDB
 
PDF
MongoDB Europe 2016 - Welcome
byMongoDB
 
PDF
MongoDB Launchpad 2016: What’s New in the 3.4 Server
byMongoDB
 
PPTX
Production deployment
byMongoDB
 
MongoDB Europe 2016 - MongoDB 3.4 preview and introduction to MongoDB Atlas
byMongoDB
 
Eventually Consistent
byWilfred Springer
 
Concurrency Control in MongoDB 3.0
byMongoDB
 
MongoDB Europe 2016 - MongoDB, Ops Manager & Docker at SNCF
byMongoDB
 
MongoDB Europe 2016 - Using MongoDB to Build a Fast and Scalable Content Repo...
byMongoDB
 
MongoDB Europe 2016 - Building WiredTiger
byMongoDB
 
MongoDB Europe 2016 - Deploying MongoDB on NetApp storage
byMongoDB
 
Webinar: Data Streaming with Apache Kafka & MongoDB
byMongoDB
 
MongoDB Europe 2016 - Choosing Between 100 Billion Travel Options – Instant S...
byMongoDB
 
MongoDB Europe 2016 - Welcome
byMongoDB
 
Webinar: Introducing the MongoDB Connector for BI 2.0 with Tableau
byMongoDB
 
Webinar: Transitioning from SQL to MongoDB
byMongoDB
 
Webinar: 10-Step Guide to Creating a Single View of your Business
byMongoDB
 
mongoDb-certification
byDarien Alvarez
 
MongoDB at Scale
byMongoDB
 
Indexing and Performance Tuning
byMongoDB
 
Webinar: MongoDB Schema Design and Performance Implications
byMongoDB
 
MongoDB Europe 2016 - Welcome
byMongoDB
 
MongoDB Launchpad 2016: What’s New in the 3.4 Server
byMongoDB
 
Production deployment
byMongoDB
 

Similar to MongoDB Europe 2016 - Debugging MongoDB Performance

PDF
Diagnostics & Debugging webinar
byMongoDB
 
PPTX
Diagnostics and Debugging
byMongoDB
 
PPTX
MongoDb and NoSQL
byTO THE NEW | Technology
 
PPTX
MongoDB
byBembeng Arifin
 
PPTX
Performance Tuning and Optimization
byMongoDB
 
PDF
Using MongoDB and Python
byMike Bright
 
PDF
2016 feb-23 pyugre-py_mongo
byMichael Bright
 
PDF
Mongo nyc nyt + mongodb
byDeep Kapadia
 
PDF
MongoDB Performance Tuning
byMongoDB
 
KEY
NOSQL101, Or: How I Learned To Stop Worrying And Love The Mongo!
byDaniel Cousineau
 
DOCX
What are the major components of MongoDB and the major tools used in it.docx
byTechnogeeks
 
KEY
MongoDB Command Line Tools
byRainforest QA
 
PPTX
Performance Tuning Cheat Sheet for MongoDB
bySeveralnines
 
PPTX
Automated Slow Query Analysis: Dex the Index Robot
byMongoDB
 
PDF
Quick overview on mongo db
byEman Mohamed
 
PPTX
MONGODB koko ko kok k ok kk ok okoko.pptx
byismailah21645
 
PPTX
Query Optimization in MongoDB
byHamoon Mohammadian Pour
 
PPTX
1404 app dev series - session 8 - monitoring & performance tuning
byMongoDB
 
PDF
MongoDB Quick Reference Card
byJeremy Taylor
 
PDF
MongoDB.pdf54teeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeer
byMdRiyad22
 
Diagnostics & Debugging webinar
byMongoDB
 
Diagnostics and Debugging
byMongoDB
 
MongoDb and NoSQL
byTO THE NEW | Technology
 
MongoDB
byBembeng Arifin
 
Performance Tuning and Optimization
byMongoDB
 
Using MongoDB and Python
byMike Bright
 
2016 feb-23 pyugre-py_mongo
byMichael Bright
 
Mongo nyc nyt + mongodb
byDeep Kapadia
 
MongoDB Performance Tuning
byMongoDB
 
NOSQL101, Or: How I Learned To Stop Worrying And Love The Mongo!
byDaniel Cousineau
 
What are the major components of MongoDB and the major tools used in it.docx
byTechnogeeks
 
MongoDB Command Line Tools
byRainforest QA
 
Performance Tuning Cheat Sheet for MongoDB
bySeveralnines
 
Automated Slow Query Analysis: Dex the Index Robot
byMongoDB
 
Quick overview on mongo db
byEman Mohamed
 
MONGODB koko ko kok k ok kk ok okoko.pptx
byismailah21645
 
Query Optimization in MongoDB
byHamoon Mohammadian Pour
 
1404 app dev series - session 8 - monitoring & performance tuning
byMongoDB
 
MongoDB Quick Reference Card
byJeremy Taylor
 
MongoDB.pdf54teeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeer
byMdRiyad22
 

More from MongoDB

PDF
MongoDB SoCal 2020: Migrate Anything* to MongoDB Atlas
byMongoDB
 
PDF
MongoDB SoCal 2020: Go on a Data Safari with MongoDB Charts!
byMongoDB
 
PDF
MongoDB SoCal 2020: Using MongoDB Services in Kubernetes: Any Platform, Devel...
byMongoDB
 
PDF
MongoDB SoCal 2020: A Complete Methodology of Data Modeling for MongoDB
byMongoDB
 
PDF
MongoDB SoCal 2020: From Pharmacist to Analyst: Leveraging MongoDB for Real-T...
byMongoDB
 
PDF
MongoDB SoCal 2020: Best Practices for Working with IoT and Time-series Data
byMongoDB
 
PDF
MongoDB SoCal 2020: MongoDB Atlas Jump Start
byMongoDB
 
PDF
MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]
byMongoDB
 
PDF
MongoDB .local San Francisco 2020: Using Client Side Encryption in MongoDB 4.2
byMongoDB
 
PDF
MongoDB .local San Francisco 2020: Using MongoDB Services in Kubernetes: any ...
byMongoDB
 
PDF
MongoDB .local San Francisco 2020: Go on a Data Safari with MongoDB Charts!
byMongoDB
 
PDF
MongoDB .local San Francisco 2020: From SQL to NoSQL -- Changing Your Mindset
byMongoDB
 
PDF
MongoDB .local San Francisco 2020: MongoDB Atlas Jumpstart
byMongoDB
 
PDF
MongoDB .local San Francisco 2020: Tips and Tricks++ for Querying and Indexin...
byMongoDB
 
PDF
MongoDB .local San Francisco 2020: Aggregation Pipeline Power++
byMongoDB
 
PDF
MongoDB .local San Francisco 2020: A Complete Methodology of Data Modeling fo...
byMongoDB
 
PDF
MongoDB .local San Francisco 2020: MongoDB Atlas Data Lake Technical Deep Dive
byMongoDB
 
PDF
MongoDB .local San Francisco 2020: Developing Alexa Skills with MongoDB & Golang
byMongoDB
 
PDF
MongoDB .local Paris 2020: Realm : l'ingrédient secret pour de meilleures app...
byMongoDB
 
PDF
MongoDB .local Paris 2020: Upply @MongoDB : Upply : Quand le Machine Learning...
byMongoDB
 
MongoDB SoCal 2020: Migrate Anything* to MongoDB Atlas
byMongoDB
 
MongoDB SoCal 2020: Go on a Data Safari with MongoDB Charts!
byMongoDB
 
MongoDB SoCal 2020: Using MongoDB Services in Kubernetes: Any Platform, Devel...
byMongoDB
 
MongoDB SoCal 2020: A Complete Methodology of Data Modeling for MongoDB
byMongoDB
 
MongoDB SoCal 2020: From Pharmacist to Analyst: Leveraging MongoDB for Real-T...
byMongoDB
 
MongoDB SoCal 2020: Best Practices for Working with IoT and Time-series Data
byMongoDB
 
MongoDB SoCal 2020: MongoDB Atlas Jump Start
byMongoDB
 
MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]
byMongoDB
 
MongoDB .local San Francisco 2020: Using Client Side Encryption in MongoDB 4.2
byMongoDB
 
MongoDB .local San Francisco 2020: Using MongoDB Services in Kubernetes: any ...
byMongoDB
 
MongoDB .local San Francisco 2020: Go on a Data Safari with MongoDB Charts!
byMongoDB
 
MongoDB .local San Francisco 2020: From SQL to NoSQL -- Changing Your Mindset
byMongoDB
 
MongoDB .local San Francisco 2020: MongoDB Atlas Jumpstart
byMongoDB
 
MongoDB .local San Francisco 2020: Tips and Tricks++ for Querying and Indexin...
byMongoDB
 
MongoDB .local San Francisco 2020: Aggregation Pipeline Power++
byMongoDB
 
MongoDB .local San Francisco 2020: A Complete Methodology of Data Modeling fo...
byMongoDB
 
MongoDB .local San Francisco 2020: MongoDB Atlas Data Lake Technical Deep Dive
byMongoDB
 
MongoDB .local San Francisco 2020: Developing Alexa Skills with MongoDB & Golang
byMongoDB
 
MongoDB .local Paris 2020: Realm : l'ingrédient secret pour de meilleures app...
byMongoDB
 
MongoDB .local Paris 2020: Upply @MongoDB : Upply : Quand le Machine Learning...
byMongoDB
 

Recently uploaded

PDF
Baltic Startup Funding Report 2025 by FIRSTPICK and Practica Capital
byFIRSTPICK VC
 
PPTX
7.__Developing_a_Research_Proposal[1].pptx
bynahomeshetu340
 
PDF
Content Strategy Presentation.pdfjjjjhhhhh
byCerineAmmarkhodja1
 
PPTX
SQL FOR DATA ANALYSTS - MSSQLServer for Analysts
bysirtwumasi77
 
PPTX
Merge Sort Algorithm: Analysis of Time and Space Complexity.pptx
byrigurahu
 
PDF
"Essential Excel Tips for Beginners & Professionals – 50+ Techniques to Maste...
byCA Suvidha Chaplot
 
PDF
Macro Energy Trust Shock - current developments in the Venezuelan energy sector
byAurélie Dupassieux
 
PDF
TOS in History.pdf ENGLISH macro.pdf mnbv
bykristinegorre7
 
PDF
What is Context Engineering for Agentforce Developer and Architect
byParis Salesforce Developer Group
 
DOCX
CBLM SETUP COMPUTER NETWORK (2).docxMKKKKKKKKKKKKKKKKKKKKK
byCathyrineLazona
 
PPTX
Microsoft-Dynamics-365-Business-Central (1).pptx
byUlirRohwana
 
PDF
T1 DPB20042 Management Information System.pdf
by68gr55d8f9
 
PDF
Maricar Payaoan Belarma Portfolio :)))))
bymaricarbelarmava
 
PDF
Whitepaper Optymyze / Expand further (2026)
byOptymyze
 
PDF
Plainte française dans le cadre de l'affaire Epstein
bySociété Tripalio
 
PDF
"Top Excel Tips and Tricks: Conditional Formatting, Sorting, and More - Learn...
byCA Suvidha Chaplot
 
PPTX
Quartiles_Ungrouped_Data_Grade_10-1.pptx
byxiandexter21
 
PPTX
Query Parsing: The SEO Gatekeeper That Decides Rankings
bySemantic SEO BD
 
PPTX
Autism types, forms and everything we need to know
byfuzertamas
 
PDF
제 23회 보아즈(BOAZ) 빅데이터 컨퍼런스 - [MBOAX] : ABSA를 활용한 소비자 반응 분석 기반 운영 효율화 대시보드 설계
byBOAZ Bigdata
 
Baltic Startup Funding Report 2025 by FIRSTPICK and Practica Capital
byFIRSTPICK VC
 
7.__Developing_a_Research_Proposal[1].pptx
bynahomeshetu340
 
Content Strategy Presentation.pdfjjjjhhhhh
byCerineAmmarkhodja1
 
SQL FOR DATA ANALYSTS - MSSQLServer for Analysts
bysirtwumasi77
 
Merge Sort Algorithm: Analysis of Time and Space Complexity.pptx
byrigurahu
 
"Essential Excel Tips for Beginners & Professionals – 50+ Techniques to Maste...
byCA Suvidha Chaplot
 
Macro Energy Trust Shock - current developments in the Venezuelan energy sector
byAurélie Dupassieux
 
TOS in History.pdf ENGLISH macro.pdf mnbv
bykristinegorre7
 
What is Context Engineering for Agentforce Developer and Architect
byParis Salesforce Developer Group
 
CBLM SETUP COMPUTER NETWORK (2).docxMKKKKKKKKKKKKKKKKKKKKK
byCathyrineLazona
 
Microsoft-Dynamics-365-Business-Central (1).pptx
byUlirRohwana
 
T1 DPB20042 Management Information System.pdf
by68gr55d8f9
 
Maricar Payaoan Belarma Portfolio :)))))
bymaricarbelarmava
 
Whitepaper Optymyze / Expand further (2026)
byOptymyze
 
Plainte française dans le cadre de l'affaire Epstein
bySociété Tripalio
 
"Top Excel Tips and Tricks: Conditional Formatting, Sorting, and More - Learn...
byCA Suvidha Chaplot
 
Quartiles_Ungrouped_Data_Grade_10-1.pptx
byxiandexter21
 
Query Parsing: The SEO Gatekeeper That Decides Rankings
bySemantic SEO BD
 
Autism types, forms and everything we need to know
byfuzertamas
 
제 23회 보아즈(BOAZ) 빅데이터 컨퍼런스 - [MBOAX] : ABSA를 활용한 소비자 반응 분석 기반 운영 효율화 대시보드 설계
byBOAZ Bigdata
 

MongoDB Europe 2016 - Debugging MongoDB Performance

  • 2.
    Asya Kamsky, Lead ProductManager MongoDB Diagnostics and Debugging 3.4
  • 3.
    Asya Kamsky, Lead ProductManager MongoDB Diagnostics and Debugging 3.4
  • 6.
    “ I thought ofmy old teacher Joe Bell, ... of his eerie trick of spotting details. If he were a detective he would surely reduce this ... business to something nearer an exact science. —Arthur Conan Doyle
  • 7.
    The image cannotbe displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.
  • 8.
    The image cannotbe displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.
  • 9.
  • 10.
    #MDBW16 Understanding The Patient Understandthe system Knowledge Monitor trends over time Trends Record all metrics "at rest" Baseline
  • 13.
    Gathering Data “Data! Data!Data! I can't make bricks without clay.” -- Sherlock Holmes, The Adventure of the Copper Beeches
  • 15.
    “There is nothinglike first-hand evidence.” -- Sherlock Holmes, A Study in Scarlet
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
    #MDBW16 Available Tools: Say"AH" > db.isMaster( ) > rs.conf( ) > rs.status( ) > sh.status( ) > db.version( ) > db.serverCmdLineOpts( )
  • 21.
  • 22.
    #MDBW16 > show dbs >show collections > db.getCollectionNames().forEach(function(c) { printjson(db.getCollection(c).getIndexes()); }); Available Tools: Say "AH"
  • 23.
  • 24.
  • 25.
    #MDBW16 Available Tools: OS %free % blockdev --report % dmesg % ulimit -a % ifconfig, ip <...>, iptables % iostat % netstat % top; htop % perf % iperf3
  • 26.
    #MDBW16 Available Tools: OSfor MongoDB % mongostat % mongotop
  • 27.
  • 28.
    2014-09-01T15:50:03.184-0004 [conn208] query data.activityquery: { $query: { _updated_at: { $gt: new Date(1396459946346) }, _to: "_UserA" } }, $orderby: { _updated_at: -1 } } planSummary: IXSCAN { _to: 1, _created_at: -1 } ntoreturn:100 ntoskip:0 nscanned:19692 nscannedObjects:19692 numYields:170 locks(micros) r: 283957 nreturned:65 reslen:24939 342ms 2014-09-01T15:50:03.184-0004 [conn208] query data.activity query: { $query: { _updated_at: { $gt: new Date(1396459946346) }, _to: "_UserA" } }, $orderby: { _updated_at: -1 } } planSummary: IXSCAN { _to: 1, _created_at: -1 } ntoreturn:100 ntoskip:0 nscanned:19692 nscannedObjects:19692 numYields:170 locks(micros) r: 283957 nreturned:65 reslen:24939 342ms mongod logs
  • 29.
  • 30.
    2015-05-26T23:33:32.774-0500 I COMMAND 2015-05-28T12:37:11.440-0500I NETWORK 2015-05-28T12:38:35.839-0500 I QUERY 3.0 COMMAND,NETWORK,QUERY,REPL,ACCESS,INDEX,JOURNAL,SHARDING,WRITE,- mongod logs
  • 31.
    2015-05-26T23:33:32.774-0500 I COMMAND[conn45] command admin.$cmd command: listDatabases { listDatabases: 1.0 } ntoskip:0 keyUpdates:0 writeConflicts:0 numYields:0 reslen:393 locks:{ Global: { acquireCount: { r: 12 } }, Database: { acquireCount: { r: 6 } } } 321ms 2015-05-28T12:37:11.440-0500 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48625 #183 (21 connections now open) 2015-05-28T12:38:35.839-0500 I QUERY [conn183] getmore tableau.flights201406 query: { origin_city_market_id: 31703.0 } cursorid: 61957110347 ntoreturn:0 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:176 nreturned:22579 reslen:1332181 locks:{ Global: { acquireCount: { r: 354 } }, Database: { acquireCount: { r: 177 } }, Collection: { acquireCount: { r: 177 } } } 114ms 3.0 mongod logs
  • 32.
  • 33.
    2016-06-23T10:34:41.559-0700 I COMMAND[conn26] command test.c command: find { find: "c", filter: { a: { $elemMatch: { v: { $gte: 3.0, $lt: 4.0 } } } } } planSummary: IXSCAN { a.v: 1.0 } keysExamined:2 docsExamined:1 fromMultiPlanner:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:1 nreturned:1 reslen:187 locks:{ Global: { acquireCount: { r: 4 } }, Database: { acquireCount: { r: 2 } }, Collection: { acquireCount: { r: 2 } } } protocol:op_command 110ms 3.2 mongod logs
  • 34.
    2016-06-23T10:34:41.559-0700 I COMMAND[conn26] command test.c command: find { find: "c", filter: { a: { $elemMatch: { v: { $gte: 3.0, $lt: 4.0 } } } } } planSummary: IXSCAN { a.v: 1.0 } keysExamined:2 docsExamined:1 fromMultiPlanner:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:1 nreturned:1 reslen:187 locks:{ Global: { acquireCount: { r: 4 } }, Database: { acquireCount: { r: 2 } }, Collection: { acquireCount: { r: 2 } } } protocol:op_command 110ms 3.2 mongod logs
  • 35.
  • 36.
    3.4 mongod logs 2016-06-01T15:30:04.373-0700I COMMAND [conn99] command socialite.following command: aggregate { aggregate: "following", pipeline: [ { $match: { _f: "45705" } }, { $group: { _id: null, followees: { $addToSet: "$_t" } } }, { $lookup: { from: "following", localField: "followees", foreignField: "_f", as: "fofollowees" } }, { $project: { fofs: { $setUnion: [ "$followees", "$fofollowees._t" ] } } } ] } planSummary: IXSCAN { _f: 1, _t: 1 } keysExamined:1 docsExamined:0 numYields:11 reslen:316214 locks:{ Global: { acquireCount: { r: 3800 } }, Database: { acquireCount: { r: 1900 } }, Collection: { acquireCount: { r: 1900 } } } protocol:op_query 218ms
  • 37.
    3.4 mongod logs 2016-06-25T23:38:27.346-0500I WRITE [conn128] update ycsb.usertable query: { _id: "user7074965863272626663" } planSummary: IDHACK update: { $set: { field1: BinData(0, 2 } } keysExamined:1 docsExamined:1 nMatched:1 nModified:1 numYields:1 locks:{ Global: { acquireCount: { r: 3, w: 3 } }, Database: { acquireCount: { w: 3 } }, Collection: { acquireCount: { w: 2 } }, Metadata: { acquireCount: { w: 1 } }, oplog: { acquireCount: { w: 1 } } } 11ms
  • 38.
  • 39.
    > db.getLogComponents() { "verbosity": 1, "accessControl" : { "verbosity" : -1}, "command" : { "verbosity" : -1}, "control" : { "verbosity" : -1}, "geo" : { "verbosity" : -1}, "index" : { "verbosity" : -1}, "network" : { "verbosity" : -1}, "query" : { "verbosity" : -1}, "replication" : { "verbosity" : -1}, "sharding" : { "verbosity" : -1}, "storage" : { "verbosity" : -1, "journal" : { "verbosity" : -1}}, "write" : { "verbosity" : -1} }
  • 40.
    > db.getLogComponents() { "verbosity": 1, "accessControl" : { "verbosity" : -1}, "command" : { "verbosity" : -1}, "control" : { "verbosity" : -1}, "executor" : { "verbosity" : -1}, "geo" : { "verbosity" : -1}, "index" : { "verbosity" : -1}, "network" : { "verbosity" : -1}, "query" : { "verbosity" : -1}, "replication" : { "verbosity" : -1}, "sharding" : { "verbosity" : -1}, "storage" : { "verbosity" : -1, "journal" : { "verbosity" : -1}}, "write" : { "verbosity" : -1}, "ftdc" : { "verbosity" : -1} }
  • 41.
    > db.setLogLevel( logLevel,component ) > db.setLogLevel( 1, "sharding" ) > db.setLogLevel( 2, "query" )
  • 42.
    "It is ofthe highest importance ... to be able to recognize, out of a number of facts, which are incidental and which vital. " Sherlock Holmes, The Reigate Puzzle
  • 45.
  • 46.
  • 47.
    #MDBW16 mplotqueries $ mplotqueries --help usage:mplotqueries [OPTIONS] [logfile [logfile ...]] A script to plot various information from logfiles. ...
  • 48.
    #MDBW16 mplotqueries $ mplotqueries --help usage:mplotqueries [OPTIONS] [logfile [logfile ...]] A script to plot various information from logfiles. ... optional arguments: --type {nscanned/n,rsstate,connchurn,durline,histogram,range,scatter,event} type of plot (default=scatter with --yaxis duration)
  • 49.
    #MDBW16 mplotqueries $ mplotqueries --help usage:mplotqueries [OPTIONS] [logfile [logfile ...]] A script to plot various information from logfiles. ... optional arguments: --type {nscanned/n,rsstate,connchurn,durline,histogram,range,scatter,event} type of plot (default=scatter with --yaxis duration) --group GROUP specify value to group on. All basic plot types can group on 'namespace', 'operation', 'thread', 'pattern' ...
  • 51.
    "... what isout of the common is usually a guide rather than a hindrance." — Sherlock Holmes, A Study in Scarlet
  • 52.
  • 53.
    % mplotqueries firstmongo.log--type nscanned/n 2014-06-17T17:13:34.235 [conn1569841] query db1.coll query: { time: { $lt: "2014-06-17 17:13:31", $gte: "2014-06-17 17:04:31" } } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:5169727 nscannedObjects:5169727 keyUpdates:0 numYields:12492 locks(micros) r:37736571 nreturned:72 reslen:32707 30129ms mplotqueries
  • 54.
    % mplotqueries firstmongo.log--type nscanned/n 2014-06-17T17:13:34.235 [conn1569841] query db1.coll query: { time: { $lt: "2014-06-17 17:13:31", $gte: "2014-06-17 17:04:31" } } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:5169727 nscannedObjects:5169727 keyUpdates:0 numYields:12492 locks(micros) r:37736571 nreturned:72 reslen:32707 30129ms mplotqueries
  • 55.
    % mplotqueries firstmongo.log--type nscanned/n 2014-06-17T17:13:34.235 [conn1569841] query db1.coll query: { time: { $lt: "2014-06-17 17:13:31", $gte: "2014-06-17 17:04:31" } } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:5169727 nscannedObjects:5169727 keyUpdates:0 numYields:12492 locks(micros) r:37736571 nreturned:72 reslen:32707 30129ms mplotqueries
  • 56.
    % mplotqueries firstmongo.log--type nscanned/n 2014-06-17T17:13:34.235 [conn1569841] query db1.coll query: { time: { $lt: "2014-06-17 17:13:31", $gte: "2014-06-17 17:04:31" } } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:5169727 nscannedObjects:5169727 keyUpdates:0 numYields:12492 locks(micros) r:37736571 nreturned:72 reslen:32707 30129ms 2014-06-17T17:13:47.607 [conn1569990] query db2.coll query: { time: { $lt: "2014-06-17 17:14:05", $gte: "2014-06-17 17:05:05" }, status: 8 } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:2057564 nscannedObjects:2057564 keyUpdates:0 numYields:5008 locks(micros) r:11557172 nreturned:56 reslen:18745 13086ms mplotqueries
  • 57.
    % mplotqueries firstmongo.log--type nscanned/n 2014-06-17T17:13:34.235 [conn1569841] query db1.coll query: { time: { $lt: "2014-06-17 17:13:31", $gte: "2014-06-17 17:04:31" } } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:5169727 nscannedObjects:5169727 keyUpdates:0 numYields:12492 locks(micros) r:37736571 nreturned:72 reslen:32707 30129ms 2014-06-17T17:13:47.607 [conn1569990] query db2.coll query: { time: { $lt: "2014-06-17 17:14:05", $gte: "2014-06-17 17:05:05" }, status: 8 } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:2057564 nscannedObjects:2057564 keyUpdates:0 numYields:5008 locks(micros) r:11557172 nreturned:56 reslen:18745 13086ms mplotqueries
  • 58.
    % mplotqueries firstmongo.log--type nscanned/n 2014-06-17T17:13:34.235 [conn1569841] query db1.coll query: { time: { $lt: "2014-06-17 17:13:31", $gte: "2014-06-17 17:04:31" } } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:5169727 nscannedObjects:5169727 keyUpdates:0 numYields:12492 locks(micros) r:37736571 nreturned:72 reslen:32707 30129ms 2014-06-17T17:13:47.607 [conn1569990] query db2.coll query: { time: { $lt: "2014-06-17 17:14:05", $gte: "2014-06-17 17:05:05" }, status: 8 } planSummary: COLLSCAN ntoreturn:0 ntoskip:0 nscanned:2057564 nscannedObjects:2057564 keyUpdates:0 numYields:5008 locks(micros) r:11557172 nreturned:56 reslen:18745 13086ms mplotqueries
  • 60.
  • 61.
  • 62.
  • 63.
  • 64.
  • 65.
    "Eliminate all otherfactors, and the one which remains must be the truth." Sherlock Holmes -The Sign of Four
  • 66.
  • 67.
  • 68.
  • 69.
    #MDBW16 mongostat insert query updatedelete getmore command % dirty % used flushes vsize res faults qr|qw ar|aw netIn netOut conn ReplSetName role ts
  • 70.
  • 71.
  • 72.
  • 73.
  • 74.
  • 75.
  • 76.
  • 77.
  • 78.
  • 79.
  • 80.
  • 83.
  • 95.
  • 96.
    #MDBW16 db.currentOp() > db.currentOp({secs_running:{$gt:10}}) { "desc": "conn3482", "threadId" : "140512575297280", "connectionId" : 3482, "client_s" : "10.0.149.179:55295", "active" : true, "opid" : "SocialiteAtlas-shard-2:55547103", "secs_running" : 13, "microsecs_running" : NumberLong(13483812), "op" : "query", "ns" : "db1.coll1", "numYields" : 48815, "query" : { "field1" : 5,
  • 97.
    #MDBW16 db.currentOp() > db.currentOp({desc:/^conn/,secs_running:{$gt:0}}).inprog.forEach(function(op) { print(op.opid,op.op, op.ns, op.secs_running); }); SocialiteAtlas-shard-0:68479014 query socialite.content 3 SocialiteAtlas-shard-0:68479730 query socialite.content 2 SocialiteAtlas-shard-0:68480174 query socialite.content 1 SocialiteAtlas-shard-0:68479234 query socialite.content 2 SocialiteAtlas-shard-0:68480136 query socialite.content 1 SocialiteAtlas-shard-0:68479529 query socialite.content 2 SocialiteAtlas-shard-0:68480182 query socialite.content 1 SocialiteAtlas-shard-0:68480261 query socialite.content 1 > db.killOp ( opid )
  • 99.
  • 100.
    Asya Kamsky, Lead ProductManager MongoDB Diagnostics and Debugging 3.4
  • 102.
    Title Slide Option1 Click here to add speaker name and title
  • 103.
    Title Slide Option2 Click here to add speaker name and title
  • 104.
    This is dividerslide option 2
  • 105.
    #MDBW16 Click to addtitle: keep it to 56 characters w/spaces This is a typical content slide with full width body. •  First level bullet list •  Second level bullet list •  Third level bullet list
  • 106.
    #MDBW16 Two content Click toadd text. •  First level bullet list •  Second level bullet list •  Third level bullet list Click to add text. •  First level bullet list •  Second level bullet list •  Third level bullet list
  • 107.
    #MDBW16 Left content Click toadd text. •  First level bullet list •  Second level bullet list
  • 108.
    #MDBW16 Left content Click toadd text. •  First level bullet list •  Second level bullet list
  • 109.
    #MDBW16 Pie Chart 64% 25% 11% 1st Qtr2nd Qtr 3rd Qtr 1st Quarter Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique . 2nd Quarter Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique . 3rd Quarter Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique .
  • 110.
    #MDBW16 Bar Graph 0 1 2 3 4 5 6 Category 1Category 2 Category 3 Category 4 Chart Title Series 1 Series 2 Series 3
  • 111.
    #MDBW16 Column Header 1Column Header 2 Column Header 3 Column Header 4 Column Header 5 Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Table
  • 112.
  • 113.
    #MDBW16 Coding Example –Light Background // Retrieve var MongoClient = require('mongodb').MongoClient; // Connect to the db MongoClient.connect("mongodb://localhost:27017/exampleDb", function(err, db) { if(err) { return console.dir(err); } db.collection('test', function(err, collection) {}); db.collection('test', {w:1}, function(err, collection) {}); db.createCollection('test', function(err, collection) {}); db.createCollection('test', {w:1}, function(err, collection) {}); });
  • 114.
    #MDBW16 Coding Example –Dark Background // Retrieve var MongoClient = require('mongodb').MongoClient; // Connect to the db MongoClient.connect("mongodb://localhost:27017/exampleDb", function(err, db) { if(err) { return console.dir(err); } db.collection('test', function(err, collection) {}); db.collection('test', {w:1}, function(err, collection) {}); db.createCollection('test', function(err, collection) {}); db.createCollection('test', {w:1}, function(err, collection) {}); });
  • 118.
    #MDBW16 List slide –can also be used for agenda Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem Ipsum 01 Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem Ipsum 03Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem Ipsum 02 Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem Ipsum 05 Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem Ipsum 06Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem Ipsum 05
  • 119.
    #MDBW16 Columns and iconswith copy (option 1) Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique. Linked Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique. Planning Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique. Writing Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique. Research
  • 120.
    #MDBW16 Columns and iconswith copy (option 2) Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique . Linked Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique . Planning Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique . Writing Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique . Research
  • 121.
    #MDBW16 Timeline or progress 2013 Loremipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. 2014 2015 Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique sit elit. 2016
  • 122.
    “ Quote sample. Loremipsum dolor sit amet, onsectetur adipiscing elit amet sodales. Praesent sodales odio sit amet odio tristique. Lorem ipsum dolor sit amet, onsectetur adipiscing elit. Praesent sodales odio sit amet odio tristique. Lorem ipsum dolor sit amet, onsectetur adipiscing elit.”