Graphite

2,956 views

Published on

Graphite presentation for DevOps Melbourne

Published in: Technology, Business
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,956
On SlideShare
0
From Embeds
0
Number of Embeds
8
Actions
Shares
0
Downloads
53
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

Graphite

  1. 1. Overview• Architecture• Strengths• Weaknesses• Example Usage
  2. 2. Graphite ArchitecturePython based http://graphite.wikidot.com/
  3. 3. Web UI == DjangoRun under Apache mod_python
  4. 4. Graphics library == Cairohttp://cairographics.org/
  5. 5. Processing backend (Carbon) == Twisted Python
  6. 6. Storage Engine (Whisper) • Fixed size • Can insert data out of order
  7. 7. Storage Engine (Whisper) • Flexible configuration of precision/opt/graphite/conf/storage-schemas.conf[default_1min_for_1day_5min_for_1_year_1hr_for_5years]pattern = .*retentions = 60s:1d, 5m:365d, 1h:5y
  8. 8. 1.8 megabyte whisper file/opt/graphite/storage/whisper/
  9. 9. Strengths
  10. 10. Flexible data storage(configurable precision)
  11. 11. Easy to get data in • telnet to port 2003 • enter three values metric.name value unixtime
  12. 12. • Explore data by combining, aggregating, or performing calculations• Build dashboards by tweaking URLs
  13. 13. Weaknesses
  14. 14. • Not so nice out of the box (as Ganglia for example)• Not packaged
  15. 15. Example usage• Apache logs into Graphite• Count 200s 300s 500s etc (RPMs)• Calculate average response times
  16. 16. How to visualize data from 50 web servers?
  17. 17. cron job runs every minute on the web serversTail the apache logsAdd up the requests for each range of return codes 1xx 2xx 3xx 4xx 5xxCustom apache log format that records time to serve requests %DSend results to Graphite
  18. 18. LogtailImplemented in several languagesI used the perl one
  19. 19. LogsterFrom Etsyhttps://github.com/etsy/logsterPlug in your own parser for any log fileOutput to Graphite or Ganglia
  20. 20. Contact meDavid Lutzdavid.lutz@rea-group.comTwitter @dlutzy

×