Customer Pain #1 priority is better performance monitoring tools for the Operations team to proactively troubleshoot the Virtual evnvironment Attempting to build a private cloud with a High VM density, however we require tools to plan capacity, maximize utilization without performance degradation. Consolidation requires an understanding of capacity and performance implications.
Managing the Apps Managing the infrastructure Allocating the necessary resources on a on demand basis Stop the over provisioning Ensure Service levels as the demand increases The VI Admins are blamed and or the virtual infrastructure Very difficult to correlate the errors and root cause. You need to see all aspects of the IT Front end and back end. End user vs Infrastructure
Availability and Performance for critical applications is key to ensuring Optimal IT performance from your Virtual Infrastructure
Discuss the features of Sitescope Monitor distributed IT environment from one IT support staff location Monitor – servers, OS, network devices and applications 24x7 performance and availability data Verify operations, identify issues and initiate corrective action prior to system downtime to mitigate risk, making IT more responsive and efficient Quickly & easily monitor remote systems Rich Application Management capabilities
Demonstrate the new VMware Solution template which communicates via the VMware APIs SiteScope reports near real-time Virtual server change topology to BSM for VMware Performance monitor and Solaris Zones monitor (moving of VM's between ESX servers; changes in zones configuration). Implemented some or all aspects of ITIL's &quot;Service Operations&quot; phase? Regardless if you call it &quot;Service Operations&quot; or something else, you are probably involved in monitoring the availability and performance of virtualized resources ... and you might have read my post on how to do just that with HP SiteScope. Now you can see it live in action with the following YouTube video. 1) SiteScope simplifies the monitoring of virtual infrastructure changes by automatically adapting the SiteScope configuration accordingly. New VMware monitors in SiteScope are dynamic monitors on 2 levels - at the VM or virtual machine level and then also at the host level. What you get are automatic updates to your SiteScope configuration if changes happen with those extremely important virtualized resources. . 2) There are now five (5) new monitors around virtualized resources: CPU, memory, storage, network, and state monitors. CPU, memory, and state monitors address problems on both VMs as well as host machines. Storage and network monitors address problems associated with host machines. All of this ultimately helps you with &quot;Problem Management&quot;, another key aspect of ITIL's &quot;Service Operations&quot; phase. 3) These new VMware monitors also have &quot;smart counters&quot;, which provide useful information around resource configuration and usage. There are also &quot;memory&quot; smart counters like VM memory reservation, VM memory limit, Host memory usage by VM, and balloon target size - to name a few examples. 4) There is also a new solution template around those VMware monitors that provides best practices on how to diagnose and troubleshoot issues as well as define thresholds that help you quickly set up monitoring of your virtualized resources. VMware VCenter operations will not rip and replace current management tools It is designed to compliment and integrate
Securely access HP SiteScope from your iPhone June 13, 2011
What is state of my Host and guest machines How do I know Disk space utilization of the Virtual Machine File System What is the CPU utilization of host systems VMware vCenter tightly integrated with ESX hypervisor Using vCenter as an event console means you are duplicating effort and cost for processing basic events. Standardize on Operations Manager as the event console and keep vCenter for advanced diagnostics of the virtual environment. Microsoft SCOM tightly integrated with HyperV hypervisor But, most IT environments contain a mix of heterogeneous components. So, HP is ideally suited as the top level manager of managers , pulling events from SCOM and correlating them with events from other IT domains.
HP puts your enterprise operations center in control of your complex applications. This control is provided by HP Smart Plug-Ins (SPIs), which are pre-configured, easy-to-install add-on products for OMW that enable you to manage your applications from the HP console. IT Operation managers and technical administrators can feel confident in a solution which can effectively manage their critical tier 1 apps.
Virtualization Infrastructure SPI capabilities include Discovery of Virtualization platforms –Hosts and Virtual Machines Monitors the performance, capacity, utilization, availability, and resource consumption of the host machines, virtual machines, and resource pools Monitors the crucial system events for the hosts managed by vMA Graphs to show the virtualization resource utilization Reports to depict the virtualization configuration and resource utilization VISPI monitors the VMware Virtualization platforms based on the configuration and performance data provided by Performance Agent
The SPI for Virtualization will discover automatically the ESX server host setup and will update the service view accordingly. This discovery will help to to have always a updated service view with the related dependencies. So easy root cause analysis based on the Service Navigator could be done. Based on the Service Map and the service objects above ( e.g. OS, application, other services ) and below the virtualization platform ( storage, network, .. ) will be shown together and show the dependency to each others. VISPI (version 2.0) should be released and will support solaris, hp-ux and AIX virtualization too.
Consolidating your event management tools and streamlining your alerts and exceptions into one single pane of glass essentially lower your TCO and will reduce your MTTR Vmware has launched VCenter Operations.
Support heterogeneous Capacity Management – VMware, Hyper-V & Physical servers Assist with virtual guest placement to optimize usage of the Virtual Hosts and maintain Business Service levels Manage Capacity to accommodate the requirements of specific Business Services served by distributed heterogeneous resources Be able to accommodate change as the virtual resources supporting a Business Service are dynamically ‘flexed’ Relate real world measures of end user response time to the Infrastructure performance (not just a theoretical model)
How best to utilize their existing resources? - When can I expect my capacity to run out? What do I need to size for – the peaks, the averages or the sum of peaks? How I can forecast the different scenarios?
Dynamic Virtulization (Vmotion) is increasingly being used. Capacity Management and Capacity Planning are back on the agenda. But there are some extra challenges. The first is how to relate the hardware needs and resource requirements of a virtual environment to the service levels for a Business Service that is supported by distributed resources. And to make it more complex there is an increasing trend for virtual hosts to be grouped into ‘farms’ with virtual guests being moved dynamically between the hosts as resource availability changes – using technologies like VMware vMotion. Support heterogeneous Capacity Management – VMware, Hyper-V & Physical servers Assist with virtual guest placement to optimize usage of the Virtual Hosts and maintain Business Service levels Manage Capacity to accommodate the requirements of specific Business Services served by distributed heterogeneous resources Be able to accommodate change as the virtual resources supporting a Business Service are dynamically ‘flexed’ Relate real world measures of end user response time to the Infrastructure performance (not just a theoretical model)
Plug and Play IT Everyone remembers the days when Microsoft coined the phrase plug and play.
Some of the key questions in terms of visualizing the capacity usage (and availability) of the managed environment are illustrated here. In the screenshot the red box highlights the “Remaining Capacity in # of VMs” column You can se that the CRM business Service is supported by 4 VM Hosts with 10 virtual guests. The VM hosts have an average CPU utilization of 8.1% so the remaining capacity is an additional 22 VM guests. How much Capacity do I have and how much do I use? Across datacenter, by Business Service, by cluster Across Physical, VMware, Hyper-V resources Does my infrastructure keep up with end-user response? Do I have idle and powered-off VMs resulting in a VM sprawl? Which servers are under or over-configured?
Optimization questions are illustrated here. The technology used to provide workload placement advice within a Virtual Server farm was developed by HP Labs and is unique to HP. The screenshots show the scenario planner and (behind it) the results after migration of 5 VMs in terms of reduced power consumption etc. How do I place my VMs optimally in a server farm? Are my VMs sized correctly? What is the right VM size for my physical server? Do I have enough headroom for unexpected spikes? Will my new workload fit in my existing cluster?
And finally some examples of forecasting and planning questions that SHO can answer. In the screenshot we have highlighted the “Days before Capacity Violation” column. This indicates how much longer (based on historical trends) the business services can continue to operate without reaching a point where the number of virtual guests would exceed the capacity available. How much room for growth do I have? Across datacenter, by Business Service, by cluster When will I run out of capacity? What-if I add or remove workloads? What-if I add/modify/remove servers, memory, or CPU? How is my datacenter usage projected to grow? Should I buy server model A or model B?
Second is the full Operations Manager deployment – OMW, SHR and SHO. This deployment option only has access to Node Group Topology information from OMW and no EUM data is available. Business Service oriented capacity view/management Draws on unique Topology View (“RTSM”, OMW etc.) Correlate EUM performance metrics with infrastructure performance Few products offer workload placement SHO builds on patented, mature algorithms developed by HP Labs Can size workloads based on headroom factor, headroom mitigates risk against unexpected load spikes Can handle heterogeneous environment Physical (x86 servers), VMware, Hyper-V Seamless integration for BSM customers Leveraging existing agents and/or SiS, other BSM products means faster time to value
Breakout HP Discover - Session 3400
HP Extends VMware and Microsoft management tools to effectively manage heterogeneous virtual IT infrastructures Luigi Tiano Enterprise Management Director CT Consultants Inc.
Polling Questions <ul><li>How many audience members are using VMware? </li></ul><ul><li>How many audience members are using Microsoft Hyper V? </li></ul>
Virtualization Management Challenges <ul><li>The VI Team always gets blamed for performance problems – but that’s 90 % inaccurate </li></ul><ul><li>Too many fire drill and unproductive conference calls </li></ul><ul><li>Operations spend a fortune on monitoring and alarming tools. However the end user is the first to know about availability and performance problems </li></ul><ul><li>Problems take so long too solve (Higher MTTR) </li></ul>
Virtualization Management & Strategy Performance - Capacity - Configuration <ul><li>Putting forth a roadmap for your Cloud and Virtualization strategy is key to ensuring optimal IT Spending </li></ul><ul><li>Understand IT as a whole instead of technology silos will help reduce OPEX </li></ul><ul><li>It is essential to manage performance and capacity for optimal virtualization infrastructure performance </li></ul>
Polling Question <ul><li>Among audience members which one of you are? </li></ul><ul><li>A. VI Administrators </li></ul><ul><li>B. Application owners (Exchange, SQL, etc…) </li></ul><ul><li>C. IT Management </li></ul><ul><li>D. Other </li></ul>
Polling Question <ul><li>For the application owners, how many of you are reluctant to host your critical tier 1 apps in a virtual infrastructure? </li></ul><ul><li>(Show of Hands) </li></ul><ul><li>For those of you who have. Have you virtualized? </li></ul><ul><li>A. Oracle </li></ul><ul><li>B. MS Exchange </li></ul><ul><li>C. MS SQL </li></ul><ul><li>D. Internally Developed / Home Grown </li></ul>
Tier - 1 Application Management <ul><li>In 2010 VMware said “It’s all about computing infrastructure” </li></ul><ul><li>In 2011 VMware has stated, “It’s all about the applications.” </li></ul>Customers have understood that their critical applications can and must reside in a cloud / virtual infrastructure. Managing them is crucial!
Application and Infrastructure Visibility Monitoring various layers of infrastructure without installing agents
VMware Infrastructure Monitoring - Sitescope <ul><li>Lightweight option </li></ul><ul><li>Communicating using the VMware API’s </li></ul>
Operations Management for Virtualization Agent Based Management <ul><li>Agent Based </li></ul><ul><li>Virtual Infrastructure Smart Plug In for VMware & Microsoft Hyper-V </li></ul><ul><li>Heterogeneous Support </li></ul><ul><li>Visibility of applications in relation to infrastructure </li></ul>
Business application Database Internet infrastructure Tier 1 Application Management Agent Based
Virtualization Policies & Architecture <ul><li>Monitor the performance capacity utilization, availability, and resource consumption of the hosts and the guest virtual machines </li></ul><ul><li>Graphs to show the virtualization resource utilization </li></ul><ul><li>Reports to depict the virtualization configuration and resource utilization </li></ul>
Virtualization – Agent Based Management Business Services Mapped to Infrastructure
Capacity Management in dynamic virtualized environments <ul><li>HP Service Health Optimizer (SHO) </li></ul>
Polling Questions <ul><li>How do you manage your virtualization or cloud capacity today? </li></ul><ul><li>A. Excel </li></ul><ul><li>B. 3 rd Party Solutions </li></ul><ul><li>C. No capacity management solution in place </li></ul>
<ul><ul><li>“ The Process responsible for ensuring that the Capacity of IT Services and the IT Infrastructure is able to deliver agreed Service Level Targets in a Cost Effective and timely manner. ”* </li></ul></ul>* Source: ITIL V3 glossary Capacity Management – Balancing Act Meeting IT Supply with Business Service Demand “Just-in-Time”
What you have, What you use, What can fit, What can be improved Multi-Dimensional, Time-Varying Analysis and Workload Placement recommendation FORECAST AND PLAN What-if Scenarios, Trend Analysis Support for Heterogeneous Environments Capable of managing 1000’s of nodes Continuous, Real-Time Monitoring and Analysis Correlate Infrastructure Performance with Business Service Performance (End User Response time metrics) HP Service Health Optimizer VISUALIZE “ Business Service Driven” Capacity Management for x86 Virtualized Environments OPTIMIZE
- Uses the BSM RTSM* to track how Business Services relate to the underlying infrastructure. - Automatically adapts to dynamic virtual environments where resources supporting a Business Application may change throughout the day. - Connects business service end user experience measurements to the underlying infrastructure resource metrics. * RTSM – Run-time Service Model Business Service Driven Capacity Management hypervisor VM web server Exchange app active directory VM VM APPLICATIONS PHYSICAL INFRASTRUCTURE (server , network, storage) VIRTUAL INFRASTRUCTURE IT Service performance server USER EXPERIENCE
Service Health Optimizer – Understanding Capacity