Pandora FMS:Apache Hbase Plugin

374 views
274 views

Published on

A general performance settings monitoring plugin on the Hbase database that uses system commands and the information server of Hbase to retrieve information. To know more about this plugin you can visit the following webpage: http://pandorafms.com/index.php?sec=Library&sec2=repository&lng=en&action=view_PUI&id_PUI=605

Published in: Software, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
374
On SlideShare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Pandora FMS:Apache Hbase Plugin

  1. 1. Pandora FMS Apache Hbase Plugin Administrator Manual
  2. 2. Index 1. INTRODUCTION............................................................................................................................3 2. COMPATIBILITY MATRIX............................................................................................................3 3. MODULES GENERATED BY THE PLUGIN...............................................................................3 4. PREREQUISITES............................................................................................................................4 5. SPECIFIC HBASE CONFIGURATION.........................................................................................4 6. File Configuration............................................................................................................................5 7. Plugin Execution..............................................................................................................................6 Page 2
  3. 3. 1. INTRODUCTION This document's main objective is the description of the Apache HBase monitoring procedures on Linux-based systems. To extract information this plugin uses: • Specif system commands (ps, netstat, grep, wc, etc) with no need to install libraries or third party tools. • The information server of Hbase to retrieve information through HTTP protocol. 2. COMPATIBILITY MATRIX The compatibility matrix for Apache HBase monitoring is: Systems where it has been tested • Apache Hbase 0.94.18 (Standalone version) Systems where it should work • Apache Hbase 0.94.18 or above 3. MODULES GENERATED BY THE PLUGIN This plugin returns 18 modules. All of them display valuable status information. You can fix thresholds manually to determine whether something is in a warning/critical or operative condition. • Hbase Alive: It shows if Hbase is running. If this goes critical then the rest of the modules won't be created. Page 3
  4. 4. • Hbase Connections: Display the amout of network connections in database. • Hbase CPU Usage: The percentage of CPU used by HBase. • Hbase Memory Usage: The percentage of Memory used by Hbase. • Hbase Heap Memory Used: The percentage of heap memory used by Hbase. • Hbase Process State: The state of Hbase process. • Hbase Tables: Number of tables in Hbase. • Hbase Time in CPU: It's the CPU time used by the process of Hbase so far. • Hbase/Region Servers Online: Number of Region Servers Online right now. • Hbase/Region Server Request per second: Request per second of the RegionServer of Hbase. • Hbase Log Warning Messages: Number of warning messages in Hbase Log. • Hbase Log Errors: Number of error messages in Hbase log. • Hbase/Region Server Cache Hit Ratio: Block cache hit ratio (0 to 100%) from RegionServer • Hbase/Region Server Flush Queue Size: Point in time number of enqueued regions in the MemSotre awaiting flush. • Hbase/Region Server Compaction time: Point in time length of the compaction queue. This is the number of Stores in the RegionServer that have been targeted for compaction. • Hbase/Region Server Memstore Size: Point in time sum of all the memstore sizes in the RegionServer. • Hbase/Region Server Read Request: Number of read requests for RegionServer. • Hbase/Region Server Write Request: Number of write request for RegionServer • Hbase/Region Server Number of Online Regions: Nomber of regions served by the RegionServer 4. PREREQUISITES The HBase monitoring is done retrieving data from the information server of Hbase Master and also getting data from Linux commands (i.e, ps, netstat, grep, etc). The prerequisites for this monitoring to work correctly are the following: • Hbase must be unpacked in /etc/hbase. • A local pandora agent must be installed and configured. • The HBase log files must be located in the following path: /etc/hbase/logs/ • Version 7 or above of Java is requiered to run Hbase • The JAVA_HOME enviroment variable must be defined in /etc/profile file. 5. SPECIFIC HBASE CONFIGURATION Page 4
  5. 5. This plugin needs a specific configuration for Hbase to be able to retrieve the right information throught the information server of Hbase. First of all, Hbase must be unpacked in /etc. The folder must be called “hbase” all the files which will be used by Hbase will be in that folder. Before starting Hbase we should modify the configuration file of Hbase located in /etc/hbase/conf depending of our needs. We have to edit/add the following lines in hbase-site.xml, between the “configuration” tags (<configuration> and </configuration>). <property> <name>hbase.master.info.port</name> <value>16010</value> </property> <property> <name>hbase.master.info.bindAddress</name> <value>127.0.0.1</value> </property> 6. FILE CONFIGURATION In order to configure correctly this plugin there are a few steps that should be followed: • Move the hbase_plugin.sh file from the default download directory to the /etc/pandora/plugins/ directory: • Assign necessary permitions to hbase.pl script: chmod +x hbase_plugin.pl • At the end of the pandora_agent.conf file add the following line: module_plugin /etc/pandora/plugins/hbase_plugin.pl • Restart the pandora agent process writing: service pandora_agent_daemon restart Page 5
  6. 6. 7. PLUGIN EXECUTION If everything is working fine you should be able to see the following image with all the modules created. Page 6

×