Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

opentsdb in a real enviroment

11,659 views

Published on

setup opentsdb (based on hadoop and hbase) to collection servers' metrics collection.

Published in: Technology, News & Politics

opentsdb in a real enviroment

  1. 1. OpentsdbRobert Chenrobertchen117@gmail.com<br />
  2. 2. Opentsdb architecture<br />TSD<br />TSD<br />TSD<br />Hbase<br />hadoop<br />
  3. 3. HBase Architecture<br />
  4. 4. Opentsdb Architecture II<br />
  5. 5. Opentsdb POC<br />
  6. 6. How to Start & Stop opentsdb<br />Start opentsdb:<br />Start hadoop environment<br />Start hbase (use internal zookeeper or outside zookeeper)<br />Start TSD<br />Stop Opentsdb:<br />Stop tsd<br />Stop hbase<br />Stop hadoop<br />
  7. 7. Sample scenario<br />This scenario is about how to insert CPU metrics of a host to opentsdb:<br />Add these metrics to hbase first:<br />./src/tsdbmkmetricproc.loadavg.1m proc.loadavg.5m <br />2. Collect on the client and post to the tsd socket:<br />cat >loadavg-collector.sh <<EOF #!/bin/bash set -e while true; do awk -v now=`date +%s` -v host=`hostname` '{ print "put proc.loadavg.1m " now " " $1 " host=" host; print "put proc.loadavg.5m " now " " $2 " host=" host }' /proc/loadavg sleep 15 done | nc -w 30 node1 8080 EOF <br />chmod+x loadavg-collector.sh <br />nohup./loadavg-collector.sh &<br />3. Put Metrics data like these:<br />[root@node1 /]# ./vendor/stumbleupon-opentsdb-33dff14/src/loadavg-collector-result.sh<br />put proc.loadavg.1m 1310023344 0.14 host=node1<br />put proc.loadavg.5m 1310023344 0.11 host=node2<br />
  8. 8. Need to do:<br />Collection metrics scripts: change from saving into RRD to save to Hbase;<br />Graphs pages on how to extract data in opentsdb and better looking<br />

×