The Telegraf Toolbelt | David McKay | InfluxData
•
1 like•108 views
Telegraf is an agent for collecting, processing, aggregating, and writing metrics. With over 200 plugins, Telegraf can fetch metrics from a variety of sources, allowing you to build aggregations and write those metrics to InfluxDB, Prometheus, Kafka, and more. In this talk, we will take a look at some of the lesser known, but awesome, plugins that are often overlooked; as well as how to use Telegraf for monitoring of Cloud Native systems.
Recommended
More Related Content
What's hot
What's hot (20)
Similar to The Telegraf Toolbelt | David McKay | InfluxData
Similar to The Telegraf Toolbelt | David McKay | InfluxData (20)
More from InfluxData
More from InfluxData (20)
Recently uploaded
Recently uploaded (20)
The Telegraf Toolbelt | David McKay | InfluxData
- 1. The Telegraf Toolbelt It can do that, really?
- 2. David McKay Developer Advocate at InfluxData @rawkode 🏴 Scottish 🐭 Has Pets 💙 Esoteric Programming Languages ☸ Kubernetes Release Team
- 3. The Plugin Ecosystem Establishing a Base Line
- 4. © InfluxData. All rights reserved. Over Plugins ➔ 169 Inputs ➔ 35 Outputs ➔ 15 Processors ➔ 14 Parsers ➔ 9 Serializers ➔ 8 Aggregators
- 5. © InfluxData. All rights reserved. V . (May) ➔ Inputs ◆ Google Cloud PubSub ◆ Kinesis Consumer ◆ Kube Inventory ◆ Neptune Apex ◆ Nginx Upstream Checks ◆ Multifile ◆ Stack Driver ➔ Outputs ◆ Google Cloud PubSub ➔ Serializers ◆ Nowmetric ◆ Carbon
- 6. © InfluxData. All rights reserved. V . (June) ➔ Inputs ◆ bind ◆ Cisco GNMI ◆ Cisco MDT ◆ ECS & Fargate ◆ GitHub ◆ OpenWeatherMap ◆ PowerDNS ➔ Outputs ◆ Health ◆ Syslog ➔ Serializers ◆ Wavefront ➔ Aggregators ◆ Final
- 7. © InfluxData. All rights reserved. V . (September) ➔ Inputs ◆ apcupsd ◆ Docker Logs ◆ Fireboard ◆ Logstash ◆ MarkLogic ◆ OpenNTPD ◆ uWSGI ➔ Outputs ◆ Exec ➔ Parsers ◆ Form ➔ Processors ◆ Date ◆ Pivot ◆ Unpivot ◆ Tag Limit
- 8. © InfluxData. All rights reserved.
- 9. There are 3249 telegraf.conf files on GitHub
- 10. © InfluxData. All rights reserved.
- 11. I could only get 1000 telegraf.conf files from GitHub
- 12. I used a sample of 1000 telegraf.conf files from GitHub
- 13. Interval % Use s (Default) . % use s % use s % use m % use s
- 15. Jitter % None
- 17. © InfluxData. All rights reserved. Output Plugins ➔ 71% 1 Output ➔ 5% 2 Outputs ➔ 2% 0 Outputs ➔ .6% 3 Outputs
- 18. © InfluxData. All rights reserved. Output Plugins ➔ 72% InfluxDB ➔ 5% File ➔ 2% Prometheus Client ➔ .9% Graphite ➔ .6% Kafka
- 19. © InfluxData. All rights reserved. Input Plugins ➔ 17% 1 Input ➔ 12% 9 Inputs ➔ 10% 8 Inputs ➔ 5% 10 Inputs ➔ 5% 11 Inputs ➔ 5% 6 Inputs ➔ 5% 7 Inputs ➔ 1 56 Inputs ?!?!
- 20. © InfluxData. All rights reserved. Input Plugins ➔ 58% CPU ➔ 53% Mem ➔ 52% Disk ➔ 51% System ➔ 47% DiskIO ➔ 47% Swap ➔ 40% Process ➔ 31% Kernel ➔ 28% Docker ➔ 23% Net
- 21. 12% Invalid
- 22. Dual Write to InfluxDB and Multiple Outputs . %
- 23. © InfluxData. All rights reserved. Multiple Outputs [[outputs.influxdb]] urls = ["http://influxdb: "] [[outputs.influxdb_v ]] urls = ["http://influxdb : "]
- 24. Fetching Configuration at Runtime v . Remote Configuration
- 25. © InfluxData. All rights reserved. Remote Configuration telegraf --config <http_uri>
- 26. © InfluxData. All rights reserved. Remote Configuration telegraf --config https://raw.githubusercontent.com /influxdata/telegraf/master/etc/telegraf.conf
- 27. © InfluxData. All rights reserved. Remote Configuration SOME_VAR=abc123 telegraf --config <http_uri>
- 28. © InfluxData. All rights reserved. Remote Configuration [agent] interval = “${INTERVAL}” [[outputs.influxdb_v2]] token = “${TOKEN}”
- 29. Handling failures without losing metrics v . ( !) Output Resiliency
- 30. © InfluxData. All rights reserved. Output Resiliency Use metric_buffer_limit to handle downtime of your outputs
- 31. © InfluxData. All rights reserved. InfluxDB Telegraf Application Software Dependencies Bare Metal / VMs Network Buffer Batch
- 32. © InfluxData. All rights reserved. Telegraf Application Software Dependencies Bare Metal / VMs Network Buffer Batch
- 33. © InfluxData. All rights reserved. InfluxDB Telegraf Application Software Dependencies Bare Metal / VMs Network Buffer Batch
- 34. © InfluxData. All rights reserved. Output Resiliency influxdb_listener http_listener v . / . % / It was me!
- 35. © InfluxData. All rights reserved. influxdb_listener Allows Telegraf to serve as a proxy for the /write endpoint of the InfluxDB HTTP API. Output Resiliency
- 37. © InfluxData. All rights reserved.
- 39. © InfluxData. All rights reserved. http_listener_v Allows Telegraf to accept metrics over HTTP in any supported format Output Resiliency
- 41. JSON [[inputs.http_listener_v2]] data_format = "json" json_name_key = "name" tag_keys = [“go_version”] Docs
- 42. Cloud Native Telegraf Bring Your Own Telegraf
- 43. Plugins come at a cost
- 44. ➜ docker image ls byot-sample 19.3MB telegraf 254MB
- 45. © InfluxData. All rights reserved. Bring Your Own Telegraf FROM rawkode/telegraf:byo AS build FROM alpine:3.7 AS telegraf COPY --from=build /etc/telegraf /etc/telegraf COPY --from=build /binary /bin/telegraf ENTRYPOINT [ "/bin/telegraf" ]
- 46. © InfluxData. All rights reserved. Bring Your Own Telegraf BYOT BYOT Example Click Me! Click Me!
- 47. © InfluxData. All rights reserved. InfluxDB Telegraf Application Software Dependencies Bare Metal / VMs Network Buffer Batch
- 48. © InfluxData. All rights reserved. InfluxDB Application Software Dependencies Bare Metal / VMs Network Telegraf Telegraf Telegraf Telegraf
- 49. Internal Telegraf Exposes Metrics Too! v . / . %
- 50. Internal ➔ Keep an eye on buffer_size ➔ Make sure you alert on metrics_dropped
- 51. Sophisticated Health Checks Health Output v . / %
- 54. © InfluxData. All rights reserved. Health Output [[outputs.health]] service_address = "http://:5559" namepass = ["web-metrics"] [[outputs.health.compares]] field = "response_time" lt = 0.300
- 55. Controlling Ingress Kafka In, Kafka Out
- 56. © InfluxData. All rights reserved. InfluxDB Application Software Dependencies Bare Metal / VMs Network Telegraf Telegraf Telegraf Telegraf Kafka Telegraf Telegraf
- 57. Demo
- 58. We’ve covered less than 10 of the 200 plugins