This document provides an overview of Graphite and StatsD. StatsD is a network daemon that listens for statistics like counters or timers over UDP and sends them to Carbon. Carbon is another network daemon that listens for statistics over TCP and stores them on disk using Whisper, a fixed-size database like RRD. Graphite is a web-based interface for visualizing the stored metrics, allowing users to render graphs and create dashboards from the collected time-series data.

1. Graphite
A quick look at Graphite and StatsD
Adrian Moisey
Yola
Operations Engineer

2. All these things!
What are they?
Sta o n
t sD rb
Ca
ra p hene
Gr G
er
ap is p
hi t h Gdash
e W

3. A quick diagram:
StatsD Carbon Whisper
Graphite
http://dashboard/

4. A quick diagram:
StatsD

5. StatsD
network daemon
listens for statistics: counters or timers
over UDP
aggregates them and sends them to carbon

6. StatsD
Python:
import socket
sock = socket.socket(socket.AF_INET, socket.SOCK_DGRAM)
sock.sendto("myapp.signups:1|c", ("graphite.example.com", 8125))

7. StatsD
Bash:
echo "myapp.signups:1|c" | nc -w 1 -u graphite.example.com 8125

8. StatsD
Or use something else:
Ruby - https://github.com/dawanda/statsd-client
Django - https://github.com/andymckay/django-statsd
Java - https://github.com/youdevise/java-statsd-client
PHP - https://github.com/seejohnrun/php-statsd
.net - https://github.com/ragnard/Graphite.NET
(I just googled for these)

9. A quick diagram:
StatsD Carbon

10. Carbon
network daemon
listens for statistics
over TCP
Stores them on disk using Whisper

11. A quick diagram:
StatsD Carbon Whisper

12. Whisper
fixed size database
RRD-like
fast and reliable store of numeric data

13. A quick diagram:
StatsD Carbon Whisper
Graphite

14. Graphite
http://graphite.yola.net/render/?
width=586&height=308&&target=diamond.net.yol
a.inet.prod.infra1.loadavg.01&target=diamond.ne
t.yola.inet.prod.infra1.loadavg.05&target=diamon
d.net.yola.inet.prod.infra1.loadavg.15
Hard to read?

15. Graphite
http://graphite.yola.net/render/
width=586
height=308
target=diamond.net.yola.inet.prod.infra1.loadavg.01
target=diamond.net.yola.inet.prod.infra1.loadavg.05
target=diamond.net.yola.inet.prod.infra1.loadavg.15

16. Graphite

17. Graphite
Lets make it prettier!

18. Graphite
http://graphite.yola.net/render/
Width=586
Height=308
title=infra1 – load average
vtitle=load
from=-30hours
target=alias(diamond.net.yola.inet.prod.infra1.loadavg.01,”1min”)
target=alias(diamond.net.yola.inet.prod.infra1.loadavg.05,”5min”)
target=alias(diamond.net.yola.inet.prod.infra1.loadavg.15,”15min”)

19. Graphite

20. Graphite

21. Graphite

22. Graphite
movingAverage(seriesList, windowSize)

23. Graphite

24. Graphite
integral(seriesList)

25. Graphite
http://graphite.yola.net/render/
width=586
Height=308
target=color(drawAsInfinite(stats.deploys.qa.qa.*),”red”)
target=alpha(color(stacked(diamond.net.yola.inet.qa.memor
y.Active),”orange”)%,0.7)

26. Graphite

27. A quick diagram:
StatsD Carbon Whisper
Graphite
http://dashboard/

28. Dashboards!

29. Dashboards!