The document discusses the Telegraf tool, its extensive plugin ecosystem, and various configurations for inputs, outputs, and processors. It highlights statistics from a sample of Telegraf configuration files on GitHub, showcasing popular plugins and their usage. Additionally, it touches on the importance of output resiliency and internal health checks for maintaining data integrity.

1. The Telegraf Toolbelt
It can do that, really?

2. David McKay
Developer Advocate
at InfluxData
@rawkode
🏴󠁧󠁢󠁳󠁣󠁴󠁿 Scottish
🐭 Has Pets
💙 Esoteric Programming Languages
☸ Kubernetes Release Team

3. The Plugin Ecosystem
Establishing a Base Line

4. © InfluxData. All rights reserved.
Over Plugins
➔ 169 Inputs
➔ 35 Outputs
➔ 15 Processors
➔ 14 Parsers
➔ 9 Serializers
➔ 8 Aggregators

5. © InfluxData. All rights reserved.
V . (May)
➔ Inputs
◆ Google Cloud PubSub
◆ Kinesis Consumer
◆ Kube Inventory
◆ Neptune Apex
◆ Nginx Upstream Checks
◆ Multifile
◆ Stack Driver
➔ Outputs
◆ Google Cloud PubSub
➔ Serializers
◆ Nowmetric
◆ Carbon

6. © InfluxData. All rights reserved.
V . (June)
➔ Inputs
◆ bind
◆ Cisco GNMI
◆ Cisco MDT
◆ ECS & Fargate
◆ GitHub
◆ OpenWeatherMap
◆ PowerDNS
➔ Outputs
◆ Health
◆ Syslog
➔ Serializers
◆ Wavefront
➔ Aggregators
◆ Final

7. © InfluxData. All rights reserved.
V . (September)
➔ Inputs
◆ apcupsd
◆ Docker Logs
◆ Fireboard
◆ Logstash
◆ MarkLogic
◆ OpenNTPD
◆ uWSGI
➔ Outputs
◆ Exec
➔ Parsers
◆ Form
➔ Processors
◆ Date
◆ Pivot
◆ Unpivot
◆ Tag Limit

8. © InfluxData. All rights reserved.

9. There are 3249
telegraf.conf files on
GitHub

10. © InfluxData. All rights reserved.

11. I could only get 1000
telegraf.conf files from
GitHub

12. I used a sample of 1000
telegraf.conf files from
GitHub

13. Interval
% Use s (Default)
. % use s
% use s
% use m
% use s

14. Round
Interval
% True

15. Jitter % None

16. Omit
Hostname
% False

17. © InfluxData. All rights reserved.
Output Plugins
➔ 71% 1 Output
➔ 5% 2 Outputs
➔ 2% 0 Outputs
➔ .6% 3 Outputs

18. © InfluxData. All rights reserved.
Output Plugins
➔ 72% InfluxDB
➔ 5% File
➔ 2% Prometheus Client
➔ .9% Graphite
➔ .6% Kafka

19. © InfluxData. All rights reserved.
Input Plugins
➔ 17% 1 Input
➔ 12% 9 Inputs
➔ 10% 8 Inputs
➔ 5% 10 Inputs
➔ 5% 11 Inputs
➔ 5% 6 Inputs
➔ 5% 7 Inputs
➔ 1 56 Inputs ?!?!

20. © InfluxData. All rights reserved.
Input Plugins
➔ 58% CPU
➔ 53% Mem
➔ 52% Disk
➔ 51% System
➔ 47% DiskIO
➔ 47% Swap
➔ 40% Process
➔ 31% Kernel
➔ 28% Docker
➔ 23% Net

21. 12% Invalid

22. Dual Write to InfluxDB and
Multiple Outputs
. %

23. © InfluxData. All rights reserved.
Multiple Outputs
[[outputs.influxdb]]
urls = ["http://influxdb: "]
[[outputs.influxdb_v ]]
urls = ["http://influxdb : "]

24. Fetching Configuration at Runtime
v .
Remote Configuration

25. © InfluxData. All rights reserved.
Remote Configuration
telegraf --config <http_uri>

26. © InfluxData. All rights reserved.
Remote Configuration
telegraf --config
https://raw.githubusercontent.com
/influxdata/telegraf/master/etc/telegraf.conf

27. © InfluxData. All rights reserved.
Remote Configuration
SOME_VAR=abc123 telegraf --config <http_uri>

28. © InfluxData. All rights reserved.
Remote Configuration
[agent]
interval = “${INTERVAL}”
[[outputs.influxdb_v2]]
token = “${TOKEN}”

29. Handling failures without losing metrics
v . ( !)
Output Resiliency

30. © InfluxData. All rights reserved.
Output Resiliency
Use
metric_buffer_limit
to handle downtime of your outputs

31. © InfluxData. All rights reserved.
InfluxDB
Telegraf
Application
Software
Dependencies
Bare Metal
/
VMs
Network
Buffer Batch

32. © InfluxData. All rights reserved.
Telegraf
Application
Software
Dependencies
Bare Metal
/
VMs
Network
Buffer Batch

33. © InfluxData. All rights reserved.
InfluxDB
Telegraf
Application
Software
Dependencies
Bare Metal
/
VMs
Network
Buffer Batch

34. © InfluxData. All rights reserved.
Output Resiliency
influxdb_listener
http_listener
v . / . % / It was me!

35. © InfluxData. All rights reserved.
influxdb_listener
Allows Telegraf to serve as a proxy for the /write endpoint of the
InfluxDB HTTP API.
Output Resiliency

36. influxdb_listener
[[inputs.influxdb_listener]]
service_address = ":8086"

37. © InfluxData. All rights reserved.

38. v1 Client Libraries

39. © InfluxData. All rights reserved.
http_listener_v
Allows Telegraf to accept metrics over HTTP in any supported
format
Output Resiliency

40. http_listener_v
[[inputs.http_listener_v2]]
service_address = ":8080"
data_format = "json"

41. JSON
[[inputs.http_listener_v2]]
data_format = "json"
json_name_key = "name"
tag_keys = [“go_version”]
Docs

42. Cloud Native Telegraf
Bring Your Own Telegraf

43. Plugins come at a cost

44. ➜ docker image ls
byot-sample 19.3MB
telegraf 254MB

45. © InfluxData. All rights reserved.
Bring Your Own Telegraf
FROM rawkode/telegraf:byo AS build
FROM alpine:3.7 AS telegraf
COPY --from=build /etc/telegraf /etc/telegraf
COPY --from=build /binary /bin/telegraf
ENTRYPOINT [ "/bin/telegraf" ]

46. © InfluxData. All rights reserved.
Bring Your Own Telegraf
BYOT
BYOT Example
Click Me! Click Me!

47. © InfluxData. All rights reserved.
InfluxDB
Telegraf
Application
Software
Dependencies
Bare Metal
/
VMs
Network
Buffer Batch

48. © InfluxData. All rights reserved.
InfluxDB
Application
Software
Dependencies
Bare Metal
/
VMs
Network
Telegraf
Telegraf
Telegraf
Telegraf

49. Internal
Telegraf Exposes Metrics Too!
v . / . %

50. Internal
➔ Keep an eye on buffer_size
➔ Make sure you alert on metrics_dropped

51. Sophisticated Health Checks
Health Output
v . / %

52. @app.route("/health")
def healthcheck():
return "OK”

53. @app.route("/health")
def healthcheck():
return "OK”

54. © InfluxData. All rights reserved.
Health Output
[[outputs.health]]
service_address = "http://:5559"
namepass = ["web-metrics"]
[[outputs.health.compares]]
field = "response_time"
lt = 0.300

55. Controlling Ingress
Kafka In, Kafka Out

56. © InfluxData. All rights reserved.
InfluxDB
Application
Software
Dependencies
Bare Metal
/
VMs
Network
Telegraf
Telegraf
Telegraf
Telegraf
Kafka
Telegraf
Telegraf

57. Demo

58. We’ve covered less than
10 of the 200 plugins

59. @rawkode
Thank you