Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Linux System Monitoring with eBPF

177 views

Published on

Ignite talk given at dodkiel18 and dodzh18.

The long version is here: https://www.circonus.com/2018/05/linux-system-monitoring-with-ebpf/

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Linux System Monitoring with eBPF

  1. 1. Heinrich.Hartmann@Circonus.com Linux System Monitoring with eBPF DevOpsDays Kiel, 2018-05-16 Heinrich Hartmann
  2. 2. Heinrich.Hartmann@Circonus.com System Monitoring is about Kernel & Hardware
  3. 3. Heinrich.Hartmann@Circonus.com Best Practice: The USE Method https://www.circonus.com/2017/08/system-monitoring-with-the-use-dashboard CPU Memory Network Disks Utilization Saturation Errors
  4. 4. Heinrich.Hartmann@Circonus.com Best Practice: The USE Method https://www.circonus.com/2017/08/system-monitoring-with-the-use-dashboard CPU Memory Network Disks Utilization Saturation Errors
  5. 5. Heinrich.Hartmann@Circonus.com Lot’s of Unknowns remaining https://www.circonus.com/2017/08/system-monitoring-with-the-use-dashboard ? ? ? ~ ~ ~ CPU Memory Network Disks Utilization Saturation Errors
  6. 6. Heinrich.Hartmann@Circonus.com eBPF allows unparalleled insights https://github.com/iovisor/bcc Credits: - Brendan Gregg @ Netflix (Sun) - Sasha Goldshtein @ Sela, Microsoft - Brenden Blanco @ VMWare - Linus Torvalds, et. al.
  7. 7. Heinrich.Hartmann@Circonus.com eBPF allows unparalleled insights https://github.com/iovisor/bcc Credits: - Brendan Gregg @ Netflix (Sun) - Sasha Goldshtein @ Sela, Microsoft - Brenden Blanco @ VMWare - Linus Torvalds, et. al.
  8. 8. Heinrich.Hartmann@Circonus.com CPU: Scheduling Latency
  9. 9. Heinrich.Hartmann@Circonus.com Disk: Block-I/O Latency
  10. 10. Heinrich.Hartmann@Circonus.com Disk: Block-I/O Latency
  11. 11. Heinrich.Hartmann@Circonus.com Disk: Block-I/O Latency over time
  12. 12. Heinrich.Hartmann@Circonus.com Disk: Block-I/O Latency over time
  13. 13. Heinrich.Hartmann@Circonus.com Don’t shout in the Datacenter Brendan Gregg (2008) https://www.youtube.com/watch?v=tDacjrSCeq4
  14. 14. Heinrich.Hartmann@Circonus.com System Calls: The Kernel API Monitor Rate Errors Duration System Call API
  15. 15. Heinrich.Hartmann@Circonus.com Syscalls: Rate / Count sched_yield (2tn) clock_time (1.5tn) recvfrom (300bn) 394 Metrics
  16. 16. Heinrich.Hartmann@Circonus.com Syscalls: Duration 1 us 10 us
  17. 17. Heinrich.Hartmann@Circonus.com Syscall durations span >8 orders of magnitude 1s 100 ms 10 us 1.5 tn events total
  18. 18. Heinrich.Hartmann@Circonus.com File System: Latency
  19. 19. Heinrich.Hartmann@Circonus.com Memory: Allocation Latency
  20. 20. Heinrich.Hartmann@Circonus.com Further Reading Slides: @HeinrichHartman / #dodkiel18 Code: https://github.com/circonus-labs/nad/.../bccbpf Blog: http://www.circonus.com/2018/05/linux-system-monitoring-with-ebpf/

×