Hyperic HQ for Cloud Infrastructure Monitoring

1,477 views

Published on

Hyperic is application monitoring and performance management for virtual, physical, and cloud infrastructures. Auto-discover resources of 75+ technologies, including vSphere, and collect availability, performance, utilization, and throughput metrics.

Features
Automatically discovers, monitors, and manages software and network resources
Monitors apps on any platform, including Unix, Linux, Windows, Solaris, AIX, HPUX, VMware, and Amazon Web Services
Built-in support for 75 common components—including databases, application servers, middleware, web servers, network devices and more
Optimized for virtual environments with integration with vCenter and vSphere

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,477
On SlideShare
0
From Embeds
0
Number of Embeds
7
Actions
Shares
0
Downloads
1
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Hyperic HQ for Cloud Infrastructure Monitoring

  1. 1. Hyperic HQ [Hyperic is application monitoring and performance management for virtual, physical, and cloud infrastructures] http://sourceforge.net/projects/hyperic-hq/ Author : Sumit Arora | sumit1234@gmail.com Date 26th-April-2013 1
  2. 2. Hyperic’s Overview 2
  3. 3. “Hyperic Overview” 3 Hyperic is application monitoring and performance management for virtual, physical, and clo ud infrastructures. Auto-discover resources of 75+ technologies, including vSphere, and coll ect availability, performance, utilization, and throughput metrics. Features Automatically discovers, monitors, and manages software and network resources Monitors apps on any platform, including Unix, Linux, Windows, Solaris, AIX, HPUX, VMwar e, and Amazon Web Services Built-in support for 75 common components—including databases, application servers, midd leware, web servers, network devices and more Optimized for virtual environments with integration with vCenter and vSphere This diagram is a simple illustration of the key HQ components and how they fit together. Hyperic HQ - Hyperic's open sourc e offering is licensed under GNU GP L v2. HQ Enterprise - Hyperic's industrial strength enterprise offering has all th e capabilities of the open source versi on, plus advanced automation and co ntrol features for managing web appli cations at scale
  4. 4. Hyperic’s Installation Process 4
  5. 5. “Hyperic – Server Install” 5 STEP-1 : Download hyperic-hq-installer-4.6.6-x86-64-linux.tar.gz from http://sourceforge.net/projects/hyperic-hq/ STEP-2 : Untar it STEP-3 : create a directory as /home/hyperic (if not available now ) STEP-4 : Create a user hyperic , and assign recursive chown ,chgrp for hyperic user to /home/hyperic directories (Its very important) e.g. root@esumit-VM2:~# chown -Rf hyperic:hyperic /home/hyperic root@esumit-VM2:~# chgrp -Rf hyperic:hyperic /home/hyperic STEP-5: root@esumit-VM2:~# su – hyperic (now login as user hyperic) $ bash hyperic@esumit-VM2:~$ ls STEP-6 : Go to directory hyperic@esumit-VM2:/home/esumit/Downloads$ cd hyperic- hq-installer-4.6.6 and run ./setup.sh STEP-7 : It will ask certain yes and no on this script (from first setp choose Server to Install)e.g. Choose which software to install:1: Hyperic HQ Server2: Hyperic HQ Agent ,HQ server installation path [default '/home/hyperic']. STEP-8 : If everything goes well then you will receive a message : Installation Complete: Server successfully installed to: /home/hyperic/server-4.6.6 [ See complete log of installation here] http://pastebin.com/mCRK6jYn
  6. 6. “Hyperic – Agent Install” 6 STEP-1 : Download hyperic-hq-installer-4.6.6-x86-64-linux.tar.gz from http://sourceforge.net/projects/hyperic-hq/ STEP-2 : Untar it STEP-3 : create a directory as /home/hyperic (if not available now ) STEP-4 : Create a user hyperic , and assign recursive chown ,chgrp for hyperic user to /home/hyperic directories (Its very important) e.g. root@esumit-VM2:~# chown -Rf hyperic:hyperic /home/hyperic root@esumit-VM2:~# chgrp -Rf hyperic:hyperic /home/hyperic STEP-5: root@esumit-VM2:~# su – hyperic (now login as user hyperic) $ bash hyperic@esumit-VM2:~$ ls STEP-6 : Go to directory hyperic@esumit-VM2:/home/esumit/Downloads$ cd hyperic- hq-installer-4.6.6 and run ./setup.sh STEP-7 : It will ask certatin yes and no on this script e.g. Choose which software to install: 1: Hyperic HQ Server2: Hyperic HQ Agent ,HQ server installation path [default '/home/hyperic']. STEP-8 : If everything goes well then you will receive a message : Installation Complete: Agent successfully installed to: /home/hyperic [ See complete log of installation here] http://pastebin.com/QtYEYPa3
  7. 7. “Hyperic – Start Agent/Server” 7 Step-2: hype@esumit-VM1:/home/esumit/hype/hyperic-hq-installer- 4.6.6$ /home/hyperic/agent-4.6.6/bin/hq-agent.sh start or (stop if want to stop) Starting HQ Agent...... running (14912). [ Running agent setup ] What is the HQ server IP address: 192.168.30.151 Should Agent communications to HQ always be secure [default=yes]: no What is the HQ server port [default=7080]: - Testing insecure connection ... Success What is your HQ login [default=hqadmin]: hqadmin What is your HQ password: What IP should HQ use to contact the agent [default=127.0.1.1]: 192.168.30.150 What port should HQ use to contact the agent [default=2144]: - Received temporary auth token from agent - Registering agent with HQ The server to agent communication channel is using a self-signed certificate and could not be verified Are you sure you want to continue connecting? [default=no]: yes - HQ gave us the following agent token 1366706667061-4291381786817604188-3966130682331307001 - Informing agent of new HQ server - Validating - Successfully setup Agent/Server Step-1: Start Server : /home/hyperic/server-4.6.6/bin/hq-server.sh start or (stop if want to stop)
  8. 8. Hyperic’s Agent/Server are up and running 8
  9. 9. “Hyperic: Server is up and running ” 9
  10. 10. “Hyperic: Agent is up and Running” Agent discovered by the Server, and visible at the Admin's dashboard 10
  11. 11. “Hyperic : Health View” Display the Hyperic HQ’s Health 11
  12. 12. “Hyepric: Execute Command View” Frequently used system command can be executed directly from the browser 12
  13. 13. “Hyperic: Execute Command View” Frequently used System command can be executed directly from the browser 13
  14. 14. “Hyperic : Monitoring Item’s Inventory” Showing the list of monitoring Objects in the machine where Hyepric Agent is installed 14
  15. 15. “Hyperic: Agent monitor view” A quick monitor view 15
  16. 16. “Agent N/W Server Interface View” On Clicking to network server Interface, Shows the indicator charts 16
  17. 17. Simple Experiment : CPU Usage Monitoring 17
  18. 18. “Hyepric : CPU Usage Example” Step-1 : Executed four program which are running ―for infinite loop( for(;;);)‖ Step-2 : Checked the CPU Usage via top utility Step-3 : Check the CPU Usage data on the Hyepric Admin’s web interface ? 18
  19. 19. “Hyperic : CPU Usage Example” CPU Usage information reflection on the Hyperic HQ UI 19
  20. 20. “Hyperic : CPU Usage Example” CPU Usage information reflection on the Hyperic HQ UI 20
  21. 21. “Hyperic : CPU Usage Example” CPU Usage information reflection on the Hyperic HQ UI 21
  22. 22. Simple Experiment : Apache/MySql/Wordpress Monitoring 22
  23. 23. “Hyperic : Apache/MySql Monitoring “ Apache/MySql are up and running on the Agent Machine. Hyepric Auto discovery automatically finds the bindings and display as monitoring items at the Admin Dashboard 23
  24. 24. “Hyperic : Apache/MySql Monitoring“ [Step-1] :Hosted wordpress on Apache ( A blogging platform) and connected with MySql database. [Step-2] : Made various http request by pressing refresh to access the default index page of wordpress based blog. 24
  25. 25. “Hyperic : Apache Monitoring “ Request Served per Second by Apache 25
  26. 26. “Hyperic : Apache Monitoring“ Request Served per Second by Apache 26
  27. 27. “Hyperic : MySql Monitoring” Display MySQL’s stats e.g. Slow Queries per Minute 27
  28. 28. In-built Monitoring Support/ Monitoring Item’s Graphical View 28
  29. 29. “Hyperic : In-built Monitoring Support In-built Monitoring e.g. Application Servers 29
  30. 30. “Hyperic : Monitoring Items’ graphical view Graphical view of monitoring items 30
  31. 31. Example : Monitoring Development 31
  32. 32. “Incremental/Situation Based ㅡMonitoring Development” Hyepric’s Scalablity (5.0+): Problem We have someone who lives far from the office. To arrive each morning he needs to pass a metrop and as you already guess, there are a lot of traffic in the morning hours. This metropoline has the option of bypassing the traffic by using a "fast lane" which is a toll road. Monitoring Solution : In order to know the best hours to enter this toll road, and by that to know when the best time to lea he developed a simple Java code that monitors the internet site of the company which operates thi He parses their site and extract the price. He does that every 5 minutes. Integrated such plugin/code with Hyperic After developing this code he created an Hyperic plugin for this code and connected it to Hyperic s he has graphs over time of when the best hours to leave home are (in which the price is the lowest You can write your own plugins to whatever you need, as long as it has the right APIs, and see that 32
  33. 33. Hyperic Plugin Example :Real-time Black hole Lists RBL per minute is the number of emails blocked per minute using realtime blackhole lists. (e.g. collect all probable spam based on some rules, and block them most offending domains ) (Monitoring : Email Server e.g. qmail ,SMTP or Email Client) By blocking the most offending ones reduced the efforts to read to more useless emails 33
  34. 34. Expert Comments Nagios and Hyperic, and Hyperic’s Scalablity 34
  35. 35. An Expert Comments “Nagios vs Hyperic” It really depends of what we are looking for a full featured suite that’s going to do out monitoring trending, or if we are looking just for the alerting piece. From digitalocean (cloud hosting company) experience they have always defaulted to nagios suites, wither its hyperic or zenoss provide an easy way to get started but at the end of the day the them less flexible. With nagios we may miss a few pretty graphs but in terms of monitoring a large number of serv and services with very low latencies its perfect. Plus it’s very easy to integrate our own service che our needs evolve and there's a huge community that has every conceivable check that we can thin Ultimately it's best to use the simplest tool for the job. By conjoining monitoring, alerting, and a suite and that begins to do a poor job of all three. Nagios is just about monitoring and alerting and as a result gets the job done supremely well. To offload the analytics and trending portion to something else, we can use snmp, mrtg, rrd, or we can roll out own collection system with some help from statsd. we can also look into collectd for collecting the statistics and displaying them which also by fo ement of the above mentioned does a better job and also has a great amount of community support b t cases anything that has too much focus on a GUI and not CLI tools is something we tend to ts catering to an audience that wants ease of use, instead of fine grained control and in our ca we always want the flexibility of fine grained control. 35
  36. 36. An Expert Comments “Hyperic’s Scalablity” Hyepric’s Scalablity (5.0+): 1.Number of Hyperic agents deployed across the infrastructure. You will have to deploy an agent on each and every Host that you plan to monitor. There are some around this (virtualization, solaris zones, etc), but for the most part, you are looking at deploying an whole lotta agents. Hyperic also supports SNMP (agent less) monitoring, but not sure if you can le the features of Hyperic using SNMP. Also, Hyperic's enterprise version bills you for every host you (you can buy licenses in bulk, one license per every host). consider all this when choosing hyperic 2.Clustering of Hyperic server and their respective backend Databases. Clustering Hyperic is possible, however, how you setup a cluster depends very much on how you architecture is organized. for example - the backend DB clustering requires certain very specific th put into place (VIP, maybe even SAN). keep this in mind when you consider hyperic. 3. Amount of data collected and stored by Hyperic. Hyperic collects a huge amount of data, For example, if you are monitoring log files on proxy serv generate approx 500mb of log data a day, all that data will be pushed by Hyperic into its database which will quickly add up to a few GB in a few days. 4. It would be a good practice to prefer jumping as soon as You can to the real world and af little bit with the product , would try and monitor a real testing environment. 36
  37. 37. Further Reading http://www.krisbuytaert.be/blog/ http://www.inuits.be/ http://www.virtualization.com/ http://www.oreillygmt.com/ http://sourceforge.net/projects/hyperic-hq/ http://www.hyperic.com/ Blogs Reviews Answer from quora.com (digital ocean founder) Forums from : hyperic /nagios 37

×