Data opsdc clearspringmetrics

898 views

Published on

lightning talk presented at DevOpsDC on metrics collection at clearspring. provides links to two new open source projects Clearspring created to deal with metrics.

Published in: Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
898
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
3
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Data opsdc clearspringmetrics

  1. 1. Metrics and Monitoring at Clearspring Matt Abrams @abramsm @bigdatadc
  2. 2. The problem?• Several hundred servers• 2 data centers (currently)• Java, Scala, and PHP applications• 3.5B+ inbound events per day• And a small (but growing) team to manage it all….
  3. 3. The Solution NagiosJVMsPHP[1] MC[2] Ganglia GraphiteLinux [1] Metric Catcher: https://github.com/clearspring/MetricCatcher [2] Phetric: https://github.com/clearspring/Phetric
  4. 4. Codahale (Yammer) Metrics[1]• Gauges – instantaneous measurement• Counters – count occurrences• Meters – measure rate over time• Histograms – statistical distribution• Timers – rate and distribution of duration• Health Checks – ummm… it’s a health check [1] http://metrics.codahale.com/getting-started.html
  5. 5. Going down!“we wouldn’t even know what to alert on without the graphs”
  6. 6. Some of these are not like the others

×