Hadoop Monitoring best Practices

How to monitor the $H!T out of Hadoop Developing a comprehensive open approach to monitoring hadoop clusters

Relevant Hadoop Information ,[object Object],[object Object],[object Object],[object Object],[object Object]

Monitoring Software ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Cacti ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

hadoop-cacti-jtg ,[object Object],[object Object],[object Object],[object Object],[object Object]

Sample Cluster P1 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

A Sample Cluster p2 ,[object Object],[object Object],[object Object],[object Object]

Prerequisites ,[object Object],[object Object],[object Object]

Alerts & Escalations ,[object Object],[object Object],[object Object],[object Object],[object Object]

Wake Me Up’s ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Don’t Wake Me Up’s ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Monitoring Battle Plan ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The Basics Nagios ,[object Object],[object Object],[object Object],[object Object],[object Object]

The Basics Cacti ,[object Object],[object Object],[object Object],[object Object],[object Object]

RAID Tools ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Before you jump in ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Nagios ,[object Object],[object Object]

Cacti ,[object Object],[object Object],[object Object]

Monitoring Battle Plan Thus Far ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Add Hadoop Specific Alarms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

nagios_check_commands.cfg ,[object Object],[object Object],define command { command_name check_remote_namenode command_line $USER1$/check_http -H $HOSTADDRESS$ -u http://$HOSTADDRESS$:$ARG1$/dfshealth.jsp -p $ARG1$ -r NameNode } define service { service_description check_remote_namenode use generic-service host_name hadoopname1 check_command check_remote_namenode!50070 }

JMX Graphing ,[object Object],[object Object]

Add JMX based Alarms ,[object Object],[object Object],[object Object],[object Object]

Quick JMX Base Walkthrough ,[object Object],[object Object],[object Object]

Review ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The Future ,[object Object],[object Object],[object Object],[object Object]

Hadoop Monitoring best Practices

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (16)

Similar to Hadoop Monitoring best Practices

Similar to Hadoop Monitoring best Practices (20)

More from Edward Capriolo

More from Edward Capriolo (16)

Recently uploaded

Recently uploaded (20)

Hadoop Monitoring best Practices