Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Standard measurements

665 views

Published on

Slides from June 16, 2011 LSPE talk

Published in: Technology
  • Hello there! Get Your Professional Job-Winning Resume Here! http://bit.ly/topresum
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Standard measurements

  1. 1. Scalable performance monitoring of networks, servers and applications using standard metrics
  2. 2. Host Structures
  3. 3. Host Structures• CPU: load_one, load_five, load_fifteen, proc_run, proc_total, cpu_num, cpu_speed, uptime, cpu_user, cpu_nice, cpu_system, cpu_idle, cpu_wio, cpu_intr, cpu_sintr, interupts, contexts
  4. 4. Host Structures• CPU: load_one, load_five, load_fifteen, proc_run, proc_total, cpu_num, cpu_speed, uptime, cpu_user, cpu_nice, cpu_system, cpu_idle, cpu_wio, cpu_intr, cpu_sintr, interupts, contexts• Memory: mem_total, mem_free, mem_shared, mem_buffers, mem_cached, swap_total, swap_free, page_in, page_out, swap_in, swap_out
  5. 5. Host Structures• CPU: load_one, load_five, load_fifteen, proc_run, proc_total, cpu_num, cpu_speed, uptime, cpu_user, cpu_nice, cpu_system, cpu_idle, cpu_wio, cpu_intr, cpu_sintr, interupts, contexts• Memory: mem_total, mem_free, mem_shared, mem_buffers, mem_cached, swap_total, swap_free, page_in, page_out, swap_in, swap_out• Disk IO: disk_total, disk_free, part_max_used, reads, bytes_read, read_time, writes, bytes_written, write_time
  6. 6. Host Structures• CPU: load_one, load_five, load_fifteen, proc_run, proc_total, cpu_num, cpu_speed, uptime, cpu_user, cpu_nice, cpu_system, cpu_idle, cpu_wio, cpu_intr, cpu_sintr, interupts, contexts• Memory: mem_total, mem_free, mem_shared, mem_buffers, mem_cached, swap_total, swap_free, page_in, page_out, swap_in, swap_out• Disk IO: disk_total, disk_free, part_max_used, reads, bytes_read, read_time, writes, bytes_written, write_time• Network IO: bytes_in, packets_in, errs_in, drops_in, bytes_out, packet_out, errs_out, drops_out
  7. 7. Web Services
  8. 8. Web Services• HTTP Counters: method_option_count, method_get_count, method_head_count, method_post_count, method_put_count, method_delete_count, method_trace_count, method_connect_count, method_other_count, status_1xx_count, status_2xx_count, status_3xx_count, status_4xx_count, status_5xx_count, status_other_count
  9. 9. Web Services• HTTP Counters: method_option_count, method_get_count, method_head_count, method_post_count, method_put_count, method_delete_count, method_trace_count, method_connect_count, method_other_count, status_1xx_count, status_2xx_count, status_3xx_count, status_4xx_count, status_5xx_count, status_other_count• HTTP Operations: method, uri, host, referer, useragent, authuser, mime-type, bytes, duration, status
  10. 10. Web Services • HTTP Counters: method_option_count, method_get_count, method_head_count, method_post_count, method_put_count, method_delete_count, method_trace_count, method_connect_count, method_other_count, status_1xx_count, status_2xx_count, status_3xx_count, status_4xx_count, status_5xx_count, status_other_count • HTTP Operations: method, uri, host, referer, useragent, authuser, mime-type, bytes, duration, statussFlow supports random sampling of operations forscalability - centralized monitoring of thousands of webservers, load balancers etc.
  11. 11. Unified data model links network, servers and applications Sampled Transactions Transaction Counters APPLICATION TCP/UDP Socket CPU Memory I/O HOST Power, Temp. Adapter MACs Sampled Packet Headers I/F Counters NETWORK Power, Temp.
  12. 12. Unified data model links network, servers and applications Sampled Transactions Transaction Counters APPLICATION TCP/UDP Socket CPU Memory Packet Header I/O Source Destination HOST Power, Temp. TCP/UDP Socket TCP/UDP Socket Adapter MACs MAC Address MAC Address Sampled Packet Headers I/F Counters NETWORK Power, Temp.
  13. 13. Unified data model links network, servers and applications Sampled Transactions Transaction Counters APPLICATION TCP/UDP Socket CPU Memory Packet Header I/O Source Destination HOST Power, Temp. TCP/UDP Socket TCP/UDP Socket Adapter MACs MAC Address MAC Address Sampled Packet Headers I/F Counters NETWORK Power, Temp.
  14. 14. Unified data model links network, servers and applications Sampled Transactions Transaction Counters APPLICATION TCP/UDP Socket CPU Memory Packet Header I/O Source Destination HOST Power, Temp. TCP/UDP Socket TCP/UDP Socket Adapter MACs MAC Address MAC Address Sampled Packet Headers I/F Counters NETWORK Power, Temp.
  15. 15. Current Activities
  16. 16. Current Activities• sFlow.org standardizing metrics for core services (HTTP, Memcache, HDFS, NFS etc)
  17. 17. Current Activities• sFlow.org standardizing metrics for core services (HTTP, Memcache, HDFS, NFS etc)• Embed sFlow in operating systems, hypervisors and applications (Apache, NGINX, HAproxy, Memcached, Membase, Hadoop ...)
  18. 18. Current Activities• sFlow.org standardizing metrics for core services (HTTP, Memcache, HDFS, NFS etc)• Embed sFlow in operating systems, hypervisors and applications (Apache, NGINX, HAproxy, Memcached, Membase, Hadoop ...)• Native support for sFlow in performance monitoring tools (Ganglia, Nagios, Collectd, Munin, log file analyzers etc.)
  19. 19. Current Activities• sFlow.org standardizing metrics for core services (HTTP, Memcache, HDFS, NFS etc)• Embed sFlow in operating systems, hypervisors and applications (Apache, NGINX, HAproxy, Memcached, Membase, Hadoop ...)• Native support for sFlow in performance monitoring tools (Ganglia, Nagios, Collectd, Munin, log file analyzers etc.)• Integrated network, server and application visibility

×