MONITORING
VIRTUALIZED
ENVIRONMENTS
Ahmad Khalid Nasrat
SERVICE LEVEL
MANAGEMENT
ISLAMIC REPUBLIC OF AFGHANISTAN
MINISTRY OF HIGHER EDUCATION
HERAT UNIVERSITY
COMPUTER SCIENCE FACULTY
Table of Contents
 What is Virtualization
 Virtualization Benefits
 Virtualization Vendors
 Monitoring Virtualized Environment
 Metrics to be monitored
 Monitoring Framework
 Virtualization Architecture
 The eG VM Monitor tool
Monitoring Virtualized Environments|Ah. Khalid Nasrat
2
What is Virtualization?
 Virtualization allows you, virtually and
cost-effectively, to have two or more
virtual computing environments, running
different operating systems and
applications on one piece of hardware.
Monitoring Virtualized Environments|Ah. Khalid Nasrat
3
Physical vs Virtual
Monitoring Virtualized Environments|Ah. Khalid Nasrat
4
Virtualization Benefits
 Granular Scaling
 Better utilization of compute assets
 Reduce hardware, power and cooling costs
 Dynamic and flexible
 Faster deployment of new logical servers and
safer/faster migration of application
 Test and try
 Good for students, programmers to Test, Debug
 Better Operation with Automation
 Less overhead with server management
 Reduce Risks with Snapshots and backups
 Aids in disaster recovery
Monitoring Virtualized Environments|Ah. Khalid Nasrat
5
Virtual Machines
Monitoring Virtualized Environments|Ah. Khalid Nasrat
6
Virtualization Disadvantages
 New, relatively unproven abstraction layers may
introduce potential security risks
 Consolidation of servers as well as storage
virtualization may create a larger, single point of
failure - making it easier to lose significant
volumes of data
 Some vendors do not fully support virtualization
and you may need to reproduce a problem on a
non-virtualized system to facilitate diagnosis
(especially where specialized hardware drivers
are involved).
 Deploying and managing virtualized environments
requires skills that are less common but more in
demandMonitoring Virtualized Environments|Ah. Khalid Nasrat
7
Virtualization Vendors
 VMware - vSphere
 Citrix – Xen
 Microsoft – Hyper V
 Red Hat – KVM and SPICE
 …
Monitoring Virtualized Environments|Ah. Khalid Nasrat
8
Monitoring Virtualized
Environment
 Earlier it was the application, operating
systems, and physical infrastructure, including
storage and networking that were the primary
objects of monitoring.
 A virtualized infrastructure introduces a new
layer that needs to be monitored – the
hypervisor.
 The primary challenge to monitor security and
network and application performance within
virtualized environment is enabling visibility
and access to virtualized traffic and
performance.Monitoring Virtualized Environments|Ah. Khalid Nasrat
9
Monitoring Virtualized Environments|Ah. Khalid Nasrat
10
Metrics To Be Monitored
 Health Monitoring
 Performance Monitoring
 CPU, memory, storage and network performance metrics
 The virtualization-specific metrics specified by
virtualization Technology e.g., the cluster and datacenter
concepts in VMware
 Behavior of other virtualization features also be
measured
 Capacity Monitoring
 Server Utilization: Memory /CPU/resource
 Network Usage: bandwidth
 Storage Utilization
Monitoring Virtualized Environments|Ah. Khalid Nasrat
11
Metrics To Be Monitored
 Security and Compliance Monitoring
 VM Sprawl: Metrics to monitor the VM activities
 Configuration metrics: meet standards and
hardening guidelines, detect violations of IT
policy.
 Access Control: role-based access control
enforcement.
 Monitoring For Billing and Chargeback
 start date and end date of VM creation and
allocation
 Software licensing costs.
 VM uptimeMonitoring Virtualized Environments|Ah. Khalid Nasrat
12
Monitoring Framework
 Ability to collect monitoring data from variety of
sources cutting across
performance, capacity, compliance and
security goals
 Analytical Processing capability to co-relate
data collected from these sources to deliver
better results in comparison to the existing
solutions
 Make the data and the analysis available for
other application using APIs. This is in addition
to having its own reporting and notificationsMonitoring Virtualized Environments|Ah. Khalid Nasrat
13
Monitoring Framework
Architecture
Monitoring Virtualized Environments|Ah. Khalid Nasrat
14
The Virtualization and Cloud
Monitoring Reference
Architecture
Monitoring Virtualized Environments|Ah. Khalid Nasrat
15
The SAN and Storage Layers
 Great deal of the performance issues that
arise in virtualized environments have
something to do with storage
 The SNMP data available for most SAN
switches is completely useless
 Products to monitor SAN
 NetApp (Akorri) BalancePoint
 map of which guests are accessing which spindles.
 Virtual Instruments Virtual Wisdom
 use a TAP in the SAN
 Quest vFloglight Storage
Monitoring Virtualized Environments|Ah. Khalid Nasrat
16
The Physical
Server, LAN, Switch, Router, and
Virtualization Platform Layer
 Has more products available that monitor
it, extremely challenging task to find the right
products
 Monitoring tools
 eG VM Monitor
 Zenoss
 ManageEngine Applications Manager
 Hitachi IT Operations Analyzer
 Veeam Monitor
 Xangati
Monitoring Virtualized Environments|Ah. Khalid Nasrat
17
The Application Layer
 The product should be able to calculate hop-
by-hop and end-to-end response time for the
applications of interest in the environment.
 dynaTrace
 provide deep code-level diagnostics
 BlueStripe
 Correlsense
 Optier
Monitoring Virtualized Environments|Ah. Khalid Nasrat
18
Integrating your New Monitoring
Stack
 Different products in different places, still
problem- data are not monitored in one place
 Netuitive has connectors to a wide variety of
monitoring solutions (and can quickly add
more)
 Netuitive has self-learning performance
analysis engine that continuously correlates
data across multiple products
Monitoring Virtualized Environments|Ah. Khalid Nasrat
19
The eG VM Monitor
 eG VM Monitor become the best infrastructure
management tool of VMworld 2008 out of a
group of 30 competing products.
 VirtualizationAdmin.com Rating 4.8/5
Monitoring Virtualized Environments|Ah. Khalid Nasrat
20
Some of eG VM Monitor
Features
 Completely web-based.
 Extremely configurable.
 Auto discovery of servers, networks and applications.
 Daily, weekly, and monthly automatic trending of
statistics.
 Personalized views and alarms.
 Customizable alarms to send email, SMS, and SNMP
traps.
 Detailed real-time and historical graphing and
reporting.
 Layered modeling for clear problem determination.
 Complete internal and external monitoring of
network, systems, and applications
 Automatic triage using application inter-dependenciesMonitoring Virtualized Environments|Ah. Khalid Nasrat
21
Review the eG VM Monitor
 Demo video about eG VM Monitor on the eG
website http://www.eginnovations.com/
 eG Innovations hosted version of eG VM
Monitor to monitor different applications and
services online
 Install eG VM Monitor, You can try demo
Monitoring Virtualized Environments|Ah. Khalid Nasrat
22
Logging
• Different roles for different users.
• SQL Server admin who monitors only the SQL Se
Monitoring Virtualized Environments|Ah. Khalid Nasrat
23
Alarms Window upon logging in
 The red item at the top of the alarms window
is very likely the root cause of all or many of
the alarms in the window.
 Red alarm indicates that physical CPU usage
is high
Monitoring Virtualized Environments|Ah. Khalid Nasrat
24
Monitoring Virtualized Environments|Ah. Khalid Nasrat
25
Pros and Cons of eG
 Pros
 It offers the most complete picture of the
infrastructure – both virtual and physical
 Cons
 Not easy to install
 Costly
Monitoring Virtualized Environments|Ah. Khalid Nasrat
26
Conclusion
 Use of virtualization growing and growing
 The performance of virtualized environments
becomes more and more critical.
 Different products in different level of
virtualization architecture
 Integration of monitoring tools in one Netiutive
 Among all eG VM Monitor almost takes care
of everything
Monitoring Virtualized Environments|Ah. Khalid Nasrat
27
Reference
 Chandran Midhun, Jayant Walvekar, Monitoring in a Virtualized
Environment, 2010
 Davis David, eG VM Monitor, Dec 2010, online
http://www.virtualizationadmin.com/articles-tutorials/product-
reviews/eg-vm-monitor.html
 Harzog Bernd, Virtualization Performance and Availability
Monitoring – A Reference Architecture, March 2011, online
http://www.virtualizationpractice.com/virtualization-performance-
and-availability-monitoring-a-reference-architecture-9660/
 Application and Network Performance Monitoring in a Virtualized
Environment- Network Instruments whitepaper
 ca Technologies, the complete guide to monitoring virtualized
environments, 2013, http://www.ca.com
 www.manageengine.com/apm
Monitoring Virtualized Environments|Ah. Khalid Nasrat
28
Monitoring Virtualized Environments|Ah. Khalid Nasrat
29

Monitoring Virtualized Environments

  • 1.
    MONITORING VIRTUALIZED ENVIRONMENTS Ahmad Khalid Nasrat SERVICELEVEL MANAGEMENT ISLAMIC REPUBLIC OF AFGHANISTAN MINISTRY OF HIGHER EDUCATION HERAT UNIVERSITY COMPUTER SCIENCE FACULTY
  • 2.
    Table of Contents What is Virtualization  Virtualization Benefits  Virtualization Vendors  Monitoring Virtualized Environment  Metrics to be monitored  Monitoring Framework  Virtualization Architecture  The eG VM Monitor tool Monitoring Virtualized Environments|Ah. Khalid Nasrat 2
  • 3.
    What is Virtualization? Virtualization allows you, virtually and cost-effectively, to have two or more virtual computing environments, running different operating systems and applications on one piece of hardware. Monitoring Virtualized Environments|Ah. Khalid Nasrat 3
  • 4.
    Physical vs Virtual MonitoringVirtualized Environments|Ah. Khalid Nasrat 4
  • 5.
    Virtualization Benefits  GranularScaling  Better utilization of compute assets  Reduce hardware, power and cooling costs  Dynamic and flexible  Faster deployment of new logical servers and safer/faster migration of application  Test and try  Good for students, programmers to Test, Debug  Better Operation with Automation  Less overhead with server management  Reduce Risks with Snapshots and backups  Aids in disaster recovery Monitoring Virtualized Environments|Ah. Khalid Nasrat 5
  • 6.
    Virtual Machines Monitoring VirtualizedEnvironments|Ah. Khalid Nasrat 6
  • 7.
    Virtualization Disadvantages  New,relatively unproven abstraction layers may introduce potential security risks  Consolidation of servers as well as storage virtualization may create a larger, single point of failure - making it easier to lose significant volumes of data  Some vendors do not fully support virtualization and you may need to reproduce a problem on a non-virtualized system to facilitate diagnosis (especially where specialized hardware drivers are involved).  Deploying and managing virtualized environments requires skills that are less common but more in demandMonitoring Virtualized Environments|Ah. Khalid Nasrat 7
  • 8.
    Virtualization Vendors  VMware- vSphere  Citrix – Xen  Microsoft – Hyper V  Red Hat – KVM and SPICE  … Monitoring Virtualized Environments|Ah. Khalid Nasrat 8
  • 9.
    Monitoring Virtualized Environment  Earlierit was the application, operating systems, and physical infrastructure, including storage and networking that were the primary objects of monitoring.  A virtualized infrastructure introduces a new layer that needs to be monitored – the hypervisor.  The primary challenge to monitor security and network and application performance within virtualized environment is enabling visibility and access to virtualized traffic and performance.Monitoring Virtualized Environments|Ah. Khalid Nasrat 9
  • 10.
  • 11.
    Metrics To BeMonitored  Health Monitoring  Performance Monitoring  CPU, memory, storage and network performance metrics  The virtualization-specific metrics specified by virtualization Technology e.g., the cluster and datacenter concepts in VMware  Behavior of other virtualization features also be measured  Capacity Monitoring  Server Utilization: Memory /CPU/resource  Network Usage: bandwidth  Storage Utilization Monitoring Virtualized Environments|Ah. Khalid Nasrat 11
  • 12.
    Metrics To BeMonitored  Security and Compliance Monitoring  VM Sprawl: Metrics to monitor the VM activities  Configuration metrics: meet standards and hardening guidelines, detect violations of IT policy.  Access Control: role-based access control enforcement.  Monitoring For Billing and Chargeback  start date and end date of VM creation and allocation  Software licensing costs.  VM uptimeMonitoring Virtualized Environments|Ah. Khalid Nasrat 12
  • 13.
    Monitoring Framework  Abilityto collect monitoring data from variety of sources cutting across performance, capacity, compliance and security goals  Analytical Processing capability to co-relate data collected from these sources to deliver better results in comparison to the existing solutions  Make the data and the analysis available for other application using APIs. This is in addition to having its own reporting and notificationsMonitoring Virtualized Environments|Ah. Khalid Nasrat 13
  • 14.
  • 15.
    The Virtualization andCloud Monitoring Reference Architecture Monitoring Virtualized Environments|Ah. Khalid Nasrat 15
  • 16.
    The SAN andStorage Layers  Great deal of the performance issues that arise in virtualized environments have something to do with storage  The SNMP data available for most SAN switches is completely useless  Products to monitor SAN  NetApp (Akorri) BalancePoint  map of which guests are accessing which spindles.  Virtual Instruments Virtual Wisdom  use a TAP in the SAN  Quest vFloglight Storage Monitoring Virtualized Environments|Ah. Khalid Nasrat 16
  • 17.
    The Physical Server, LAN,Switch, Router, and Virtualization Platform Layer  Has more products available that monitor it, extremely challenging task to find the right products  Monitoring tools  eG VM Monitor  Zenoss  ManageEngine Applications Manager  Hitachi IT Operations Analyzer  Veeam Monitor  Xangati Monitoring Virtualized Environments|Ah. Khalid Nasrat 17
  • 18.
    The Application Layer The product should be able to calculate hop- by-hop and end-to-end response time for the applications of interest in the environment.  dynaTrace  provide deep code-level diagnostics  BlueStripe  Correlsense  Optier Monitoring Virtualized Environments|Ah. Khalid Nasrat 18
  • 19.
    Integrating your NewMonitoring Stack  Different products in different places, still problem- data are not monitored in one place  Netuitive has connectors to a wide variety of monitoring solutions (and can quickly add more)  Netuitive has self-learning performance analysis engine that continuously correlates data across multiple products Monitoring Virtualized Environments|Ah. Khalid Nasrat 19
  • 20.
    The eG VMMonitor  eG VM Monitor become the best infrastructure management tool of VMworld 2008 out of a group of 30 competing products.  VirtualizationAdmin.com Rating 4.8/5 Monitoring Virtualized Environments|Ah. Khalid Nasrat 20
  • 21.
    Some of eGVM Monitor Features  Completely web-based.  Extremely configurable.  Auto discovery of servers, networks and applications.  Daily, weekly, and monthly automatic trending of statistics.  Personalized views and alarms.  Customizable alarms to send email, SMS, and SNMP traps.  Detailed real-time and historical graphing and reporting.  Layered modeling for clear problem determination.  Complete internal and external monitoring of network, systems, and applications  Automatic triage using application inter-dependenciesMonitoring Virtualized Environments|Ah. Khalid Nasrat 21
  • 22.
    Review the eGVM Monitor  Demo video about eG VM Monitor on the eG website http://www.eginnovations.com/  eG Innovations hosted version of eG VM Monitor to monitor different applications and services online  Install eG VM Monitor, You can try demo Monitoring Virtualized Environments|Ah. Khalid Nasrat 22
  • 23.
    Logging • Different rolesfor different users. • SQL Server admin who monitors only the SQL Se Monitoring Virtualized Environments|Ah. Khalid Nasrat 23
  • 24.
    Alarms Window uponlogging in  The red item at the top of the alarms window is very likely the root cause of all or many of the alarms in the window.  Red alarm indicates that physical CPU usage is high Monitoring Virtualized Environments|Ah. Khalid Nasrat 24
  • 25.
  • 26.
    Pros and Consof eG  Pros  It offers the most complete picture of the infrastructure – both virtual and physical  Cons  Not easy to install  Costly Monitoring Virtualized Environments|Ah. Khalid Nasrat 26
  • 27.
    Conclusion  Use ofvirtualization growing and growing  The performance of virtualized environments becomes more and more critical.  Different products in different level of virtualization architecture  Integration of monitoring tools in one Netiutive  Among all eG VM Monitor almost takes care of everything Monitoring Virtualized Environments|Ah. Khalid Nasrat 27
  • 28.
    Reference  Chandran Midhun,Jayant Walvekar, Monitoring in a Virtualized Environment, 2010  Davis David, eG VM Monitor, Dec 2010, online http://www.virtualizationadmin.com/articles-tutorials/product- reviews/eg-vm-monitor.html  Harzog Bernd, Virtualization Performance and Availability Monitoring – A Reference Architecture, March 2011, online http://www.virtualizationpractice.com/virtualization-performance- and-availability-monitoring-a-reference-architecture-9660/  Application and Network Performance Monitoring in a Virtualized Environment- Network Instruments whitepaper  ca Technologies, the complete guide to monitoring virtualized environments, 2013, http://www.ca.com  www.manageengine.com/apm Monitoring Virtualized Environments|Ah. Khalid Nasrat 28
  • 29.