Cloud stack monitoring with zenoss


Published on

An introduction to CloudStack monitoring using Zenoss presented at the Bangalore CloudStack meetup on March 7th 2013

Published in: Technology
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • ShapeBlue are specialist cloud builders and are the globally leading consultants & integrators of many many cloud technologies. We were the first Citrix Cloud Advisor in Europe and in the last 6  months we have worked with BSkysB, Colt, SunGard AS, Citrix themselves, Centrica, Orange Telecom, Slovak Telecom Trader Media  and a whole range of smaller organisations. Of particular note is our development  of Sungard's Sungard Online cloud, a major global public cloud.
  • Zenoss is an application, server, and network management platform based on the Zope application server. Zenoss provides a web interface that allows system administrators to monitor availability, inventory, configuration, performance, and events.The CloudStack ZenPack adds CloudStack/CloudPlatform specific metrics
  • ZenPacks provide a plug-in architecture that allows community members to extend Zenoss's functionality. The authors are free to choose how they license their individual ZenPacks. ZenPacks are encapsulated in Python eggs and provide instrumentation and reports for monitored infrastructure components.
  • The same list of metrics is available for each zone. The same metrics with the exception of public IPs and secondary storage are also available for each pod
  • The following metrics are available aggregated to each cluster, and for each host
  • The monitoring of the following metrics is recommended. A lower notification threshold is also suggested along with an alarm threshold, allowing for the ‘rate of consumption’ to be estimated. A high rate of consumption could indicate either a high uptake rate or an issue in the environment; it should therefore be investigated to determine its cause.Once the notification thresholds have been reached (and confirmed due to legitimate consumption) they should be raised to 50% for further ‘rate of consumption’ monitoring.
  • Zenoss has event management tools which can annotate system alerts.In addition to monitoring resource levels, Zenoss also extracts events from the CloudStack event logs. These should be monitored particularly for host failures.
  • Version 6.x of RHEL or CentOS is will automatically deploy Zenoss Core 4 for you. It will download Java, MySQL, Zenoss Core 4, all RPM dependencies, and install everything including the Zenoss Core ZenPacks. Perform these steps on a fresh CentOS or Red Hat Enterprise Linux installation:The script will take several minutes (around 10-30) to complete. When done, you should have a fully functioning Zenoss Core install and available at http://localhost:8080/
  • This ZenPack has no special installation considerations. You should install the most recent version of the ZenPack for the version of Zenoss you're running.The easiest way to start monitoring CloudStack is to navigate to the Infrastructure page, click the + menu to add a device and choose Add CloudStack. Fill out the URL, API Key, and Secret Key fields then click OK. The URL should only include the protocol, host and port (i.e. You can find or create the keys by logging into the CloudStack web interface and navigate to Accounts and users.Zenoss will then add the CloudStack device to the system along with all of its associated zones, pods and clusters. Monitoring will also start after the discovery is complete
  • Use Simple Network Management Protocol (SNMP) to configure the SNMP agent on CloudStack Management Server to generate asynchronous events, which are called traps. The traps are generated whenever there are abnormal conditions as observed by the Management Server. The traps are then sent to a remote device called a trap listener, which signals the abnormal condition on CloudStack.  The trap listener is typically an external management station such as Microsoft SCOM, HP Openview etc.Logging feature enables logging status and status information collected by various modules and components in a CloudStack environment. SYSLOG is a standard protocol for logging. It has two components -  the SYSLOG auditing module, which runs on the management server (of CloudStack), and the SYSLOG server, which can also run on the management server or on a remote system. SYSLOG uses UDP for the transfer of data.When configured,  the management server starts sending all the log information to the SYSLOG server, and the SYSLOG server can filter the log entries before storing them in a log file. A SYSLOG server can receive log information from more than one client and CloudStack management server can also send log information to more than one SYSLOG server.
  • Cloud stack monitoring with zenoss

    1. 1. Monitoring CloudStack With Zenoss Shanker BalanManaging Consultant, ShapeBlue India
    2. 2. Monitoring With Zenoss• Integrated Platform – Application Monitoring – Sever Monitoring – Network Management Platform• Features – Event Management – Time-series performance monitoring of devices – Auto Discovery – Alerting system provides notifications based on rule sets and on-call calendars
    3. 3. Extending Zenoss With ZenPacks• Download from – ZenPacks.zenoss.CloudStack – ZenPacks.zenoss.XenMonitor – –
    4. 4. CloudStack Specific MetricsThese numbers are aggregated from allzones, pods, clusters and hosts: 1. Public IPs: Total and Used 2. Private IPs: Total and Used 3. Memory: Total (with and without over- provisioning), Allocated and Used 4. CPU: Total (with and without over- provisioning), Allocated and Used 5. Primary Storage: Total (with and without over- provisioning), Allocated and Used 6. Secondary Storage: Total and Used 7. Network: Read and Write
    5. 5. CloudStack Specific Metrics• Cluster / Host Metrics 1. Memory: Total and Used 2. CPU: Total (with and without over- provisioning), Allocated, Used and Cores 3. Network: Read and Write
    6. 6. CloudStack Threshold Monitoring• Thresholds – Notifications for lower thresholds (25%) – Alarm/Warning for higher thresholds (85%)• Key Metrics 1. CPU 2. Memory
    7. 7. Zenoss Event Logging• CloudStack Logs
    8. 8. Zenoss Core Installation• OS Platform – CentOS 6.x 64-bit – 2GB RAM – Fast Disks• Deploy using available at – cd /tmp – chmod +x – ./
    9. 9. CloudStack Integration– Download CloudStack Zenpack from– # zenpack --install <filename.egg>– # zenoss restart– Navigate to the Zenoss Infra page – Add URL, API Key, and Secret Key fields
    10. 10. CloudStack Monitoring in 4.2• SNMP Support in future versions – Generate Traps STACK/SNMP+Alerts+feature• Syslog Support – Write to local syslog – Write to remote syslog – Log level / Log Priority
    11. 11. Demo• CloudStack Devcloud + Zenoss Integration
    12. 12. Questions?<>