rainforest @rainforestqa
Ops Skills and Tools for
Beginners
Russell Smith
!
English guy
Mongo DB Master
Ex Ops consultant
Ruby / PHP developer
YC S12 Alum
Using mongo in Prod since 1...
@rainforestqarainforest
Rainforest QA
!
Insanely simple testing
checkout: www.rainforestqa.com
What is Ops?
@rainforestqarainforest
Setting up servers / services
@rainforestqarainforest
Supporting Engineers
@rainforestqarainforest
Keeping stuff running
@rainforestqarainforest
Avoiding disasters
@rainforestqarainforest
Fixing breakage
Lets Learn the basics
Installation
@rainforestqarainforest
Replicated
@rainforestqarainforest
Sharded
@rainforestqarainforest
Best practices
Ubuntu is simplest
Install from Mongo’s repo
Chose the right replica set size: 3 no...
@rainforestqarainforest
Alternatives
MongoHQ
MonogLab
ObjectRocket
MMS + AWS (via automation)
Monitoring Mongo
@rainforestqarainforest
Server components
@rainforestqarainforest
Storage
magnetic, ssd
metric: disk io
@rainforestqarainforest
Memory / RAM
fastest general store
metrics; free, swap usage
@rainforestqarainforest
Network
allows communication
use 1gbit or higher (avoid 100mbit)
metrics; latency, throughput
@rainforestqarainforest
CPU
more is better
mostly used
metrics; % usage
@rainforestqarainforest
Monitoring & Diagnostics
@rainforestqarainforest
Top things to monitor
Failover events
Repl Lag
Connections
Lock %
Disk usage
@rainforestqarainforest
Hosted is Simplest
MMS
Hosted, free for monitoring
!
Also can do
Backups
Automation
Scout
Monitors mongo, servers and many
others (Plugins!)
!
non-free
Server Density
Monitors mongo, servers and many
others (Plugins!)
!
non-free
@rainforestqarainforest
Opensource options
Ganglia
Munin
Nagios
Zabbix
Linux tools to learn
mongostat / mongotop
top
iostat
vmstat
netstat
@rainforestqarainforest
Mongo shell
rs.conf()
rs.status()
db.serverStatus()
db.stats()
db.currentOp()
@rainforestqarainforest
Backups
@rainforestqarainforest
Backup options
mongodump
from the file system
LVM / EBS
MMS
@rainforestqarainforest
TEST YOUR BACKUPS
Common pitfals
Missing indexes!
Running out of disk space
Untested backups
Sharding too late / wrong key
un-replicated / even set size
@rainforestqarainforest
Conclusion
do backups
monitor
read the docs
rainforest @rainforestqa
Questions?
@rainforestqa
@rhs
Upcoming SlideShare
Loading in …5
×

Basic Ops Skills and Tools for Beginners

1,623 views

Published on

Your datastore, MongoDB, is likely critical to your project; if you're new to MongoDB or Ops and have to keep things running in production this is the talk for you. We will cover Ops with MongoDB from the ground up; which parts of servers you should monitor and why, and show how to take and test backups. Also, we'll run through different tools you can use for installing, running, and monitoring MongoDB. After this you should be comfortable with the basics of running MongoDB in production, as well as have a head start on what you should do next.

Published in: Technology
0 Comments
4 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,623
On SlideShare
0
From Embeds
0
Number of Embeds
965
Actions
Shares
0
Downloads
27
Comments
0
Likes
4
Embeds 0
No embeds

No notes for slide

Basic Ops Skills and Tools for Beginners

  1. 1. rainforest @rainforestqa Ops Skills and Tools for Beginners
  2. 2. Russell Smith ! English guy Mongo DB Master Ex Ops consultant Ruby / PHP developer YC S12 Alum Using mongo in Prod since 1.6/1.8
  3. 3. @rainforestqarainforest Rainforest QA ! Insanely simple testing checkout: www.rainforestqa.com
  4. 4. What is Ops?
  5. 5. @rainforestqarainforest Setting up servers / services
  6. 6. @rainforestqarainforest Supporting Engineers
  7. 7. @rainforestqarainforest Keeping stuff running
  8. 8. @rainforestqarainforest Avoiding disasters
  9. 9. @rainforestqarainforest Fixing breakage
  10. 10. Lets Learn the basics
  11. 11. Installation
  12. 12. @rainforestqarainforest Replicated
  13. 13. @rainforestqarainforest Sharded
  14. 14. @rainforestqarainforest Best practices Ubuntu is simplest Install from Mongo’s repo Chose the right replica set size: 3 nodes Never use 32 bits
  15. 15. @rainforestqarainforest Alternatives MongoHQ MonogLab ObjectRocket MMS + AWS (via automation)
  16. 16. Monitoring Mongo
  17. 17. @rainforestqarainforest Server components
  18. 18. @rainforestqarainforest Storage magnetic, ssd metric: disk io
  19. 19. @rainforestqarainforest Memory / RAM fastest general store metrics; free, swap usage
  20. 20. @rainforestqarainforest Network allows communication use 1gbit or higher (avoid 100mbit) metrics; latency, throughput
  21. 21. @rainforestqarainforest CPU more is better mostly used metrics; % usage
  22. 22. @rainforestqarainforest Monitoring & Diagnostics
  23. 23. @rainforestqarainforest Top things to monitor Failover events Repl Lag Connections Lock % Disk usage
  24. 24. @rainforestqarainforest Hosted is Simplest
  25. 25. MMS Hosted, free for monitoring ! Also can do Backups Automation
  26. 26. Scout Monitors mongo, servers and many others (Plugins!) ! non-free
  27. 27. Server Density Monitors mongo, servers and many others (Plugins!) ! non-free
  28. 28. @rainforestqarainforest Opensource options Ganglia Munin Nagios Zabbix
  29. 29. Linux tools to learn mongostat / mongotop top iostat vmstat netstat
  30. 30. @rainforestqarainforest Mongo shell rs.conf() rs.status() db.serverStatus() db.stats() db.currentOp()
  31. 31. @rainforestqarainforest Backups
  32. 32. @rainforestqarainforest Backup options mongodump from the file system LVM / EBS MMS
  33. 33. @rainforestqarainforest TEST YOUR BACKUPS
  34. 34. Common pitfals
  35. 35. Missing indexes! Running out of disk space Untested backups Sharding too late / wrong key un-replicated / even set size
  36. 36. @rainforestqarainforest Conclusion do backups monitor read the docs
  37. 37. rainforest @rainforestqa Questions? @rainforestqa @rhs

×