Future Proofing Your Metrics Solution
Future proofing your metrics solution Graphite has served us long and very well. However when faced with ever growing amounts of data it doesn’t always hold up as well a we wish it would. This talk guides us through all the moving parts of a standard graphite setup, the signs that show us when we are in trouble and how to scale or replace the components that are not performing as they should. Over the years almost all of the components making up graphite’s python implementations have been rewritten in either c or golang or even been replaced completely by tools like influxdb and prometheus. To make sense of this all we’ll take a data-driven journey evaluating these “proposed” changes and setups to make sure we can safely monitor our ever growing server farms into the cloud age. About Bram Bram Vogelaar spent the first part of his career as a Molecular Biologist , he then moved on to supporting his peers by building tools and platforms for them with a lot of Open Source technologies, after which he joined Inuits to focus on helping more people to deliver their software with Open Source tools.
Recommended
More Related Content
Similar to Future Proofing Your Metrics Solution
Similar to Future Proofing Your Metrics Solution (16)
More from Bram Vogelaar
More from Bram Vogelaar (20)
Recently uploaded
Recently uploaded (20)
Future Proofing Your Metrics Solution
- 1. Future Proofing Your Metrics Solution Bram Vogelaar Icinga Camp Amsterdam – 27/06/2017
- 2. ~$ whoami~$ whoami ● I used to be a Molecular Biologist,I used to be a Molecular Biologist, ● Then became a Dev,Then became a Dev, ● Now an Ops.Now an Ops. ● Open Source Consultant @Open Source Consultant @inuits.euinuits.eu
- 9. It aint that hardIt aint that hard <metric path> <metric value> <metric timestamp><metric path> <metric value> <metric timestamp>
- 10. Lets talk #’s alreadyLets talk #’s already
- 11. In != outIn != out
- 12. Dropped the ballDropped the ball
- 15. Disk IODisk IO
- 16. Rember its a django appRember its a django app
- 17. Log everything they saidLog everything they said
- 18. Can we fix it, yes we canCan we fix it, yes we can
- 19. And you get a car….And you get a car….
- 20. Just stick it on a queueJust stick it on a queue
- 22. Python is slowwwwwPython is slowwwww Statsd Statsd Grafana Grafana Graphite API Graphite API C – Relay C – Relay Collectd Collectd
- 23. C is hard, Golang is coolC is hard, Golang is cool Statsd StatsdGrafana Grafana Graphite API Graphite API Relay NG Relay NG Collectd Collectd
- 24. if it quacks like a duckif it quacks like a duck
- 25. Golang is fastGolang is fast Statsd StatsdGrafana Grafana go-carbon go-carbon Collectd Collectd
- 26. The eighties calledThe eighties called Statsd StatsdGrafana Grafana InfluxDB InfluxDB Collectd Collectd
- 27. The no-sql wayThe no-sql way Statsd StatsdGrafana Grafana InfluxDB biggraphite Ceres Cyanite KairosDB metrictank InfluxDB biggraphite Ceres Cyanite KairosDB metrictank Collectd Collectd
- 28. If youIf you reallyreally want towant to Statsd StatsdGrafana Grafana InfluxDB biggraphite Ceres Cyanite KairosDB Metrictank OpenTSB InfluxDB biggraphite Ceres Cyanite KairosDB Metrictank OpenTSB Collectd Collectd
- 30. TICKTICK
- 32. Your mileage may varyYour mileage may vary https://github.com/attachmentgenie/vagrant-metricshttps://github.com/attachmentgenie/vagrant-metrics https://github.com/mlambrichs/stresstesthttps://github.com/mlambrichs/stresstest https://github.com/Shopify/toxiproxyhttps://github.com/Shopify/toxiproxy
- 33. ContactContact Bram VogelaarBram Vogelaar +31 6 46 62 60 78+31 6 46 62 60 78 bram.vogelaar@inuits.eubram.vogelaar@inuits.eu @attachmentgenie@attachmentgenie Inuits BEInuits BE Essensteenweg 31Essensteenweg 31 2930 Brasschaat2930 Brasschaat BelgiumBelgium Inuits NLInuits NL Maashaven Zuidzijde 2Maashaven Zuidzijde 2 3081 AE Rotterdam3081 AE Rotterdam NetherlandsNetherlands