opentsdb in a real enviroment

8,585 views

Published on

setup opentsdb (based on hadoop and hbase) to collection servers' metrics collection.

Published in: Technology, News & Politics
1 Comment
3 Likes
Statistics
Notes
No Downloads
Views
Total views
8,585
On SlideShare
0
From Embeds
0
Number of Embeds
2,975
Actions
Shares
0
Downloads
0
Comments
1
Likes
3
Embeds 0
No embeds

No notes for slide

opentsdb in a real enviroment

  1. 1. OpentsdbRobert Chenrobertchen117@gmail.com<br />
  2. 2. Opentsdb architecture<br />TSD<br />TSD<br />TSD<br />Hbase<br />hadoop<br />
  3. 3. HBase Architecture<br />
  4. 4. Opentsdb Architecture II<br />
  5. 5. Opentsdb POC<br />
  6. 6. How to Start & Stop opentsdb<br />Start opentsdb:<br />Start hadoop environment<br />Start hbase (use internal zookeeper or outside zookeeper)<br />Start TSD<br />Stop Opentsdb:<br />Stop tsd<br />Stop hbase<br />Stop hadoop<br />
  7. 7. Sample scenario<br />This scenario is about how to insert CPU metrics of a host to opentsdb:<br />Add these metrics to hbase first:<br />./src/tsdbmkmetricproc.loadavg.1m proc.loadavg.5m <br />2. Collect on the client and post to the tsd socket:<br />cat >loadavg-collector.sh <<EOF #!/bin/bash set -e while true; do awk -v now=`date +%s` -v host=`hostname` '{ print "put proc.loadavg.1m " now " " $1 " host=" host; print "put proc.loadavg.5m " now " " $2 " host=" host }' /proc/loadavg sleep 15 done | nc -w 30 node1 8080 EOF <br />chmod+x loadavg-collector.sh <br />nohup./loadavg-collector.sh &<br />3. Put Metrics data like these:<br />[root@node1 /]# ./vendor/stumbleupon-opentsdb-33dff14/src/loadavg-collector-result.sh<br />put proc.loadavg.1m 1310023344 0.14 host=node1<br />put proc.loadavg.5m 1310023344 0.11 host=node2<br />
  8. 8. Need to do:<br />Collection metrics scripts: change from saving into RRD to save to Hbase;<br />Graphs pages on how to extract data in opentsdb and better looking<br />

×