Philip Pooch: Application Performance Management

347 views
305 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
347
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
15
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Philip Pooch: Application Performance Management

  1. 1. Establishing an Application Performance Management Framework Philip Pooch Performance Test Specialist
  2. 2. Where are we now? <ul><li>Still Performance Test Specialists </li></ul><ul><li>Still do performance testing </li></ul><ul><li>Risk-based approach is working well </li></ul><ul><li>Our processes are mature </li></ul><ul><li>More ‘take up’, earlier engagement </li></ul><ul><li>Have become ‘consultants’ as well as ‘testers’ </li></ul><ul><li>Now moved into a Systems Management Team </li></ul><ul><li>Involved in establishing a Business Process Monitoring & Alerting service for critical business applications </li></ul>
  3. 3. Agenda <ul><li>Application Performance Management </li></ul><ul><ul><li>A Definition </li></ul></ul><ul><ul><li>Core Elements </li></ul></ul><ul><li>Our current progress and challenges </li></ul><ul><li>Removing artificial constraints </li></ul><ul><li>A way to proceed </li></ul><ul><li>Changing mindsets </li></ul><ul><li>Questions </li></ul>
  4. 4. Application Performance Management – a definition <ul><li>A business-centric approach </li></ul><ul><li>for measuring application performance with the objective of maintaining it </li></ul><ul><li>at a level that meets or exceeds </li></ul><ul><li>end-user expectations </li></ul>
  5. 5. Core elements of APM <ul><li>Performance Risk Analysis </li></ul><ul><li>Business Objectives & End-user Requirements </li></ul><ul><li>Governance (Planning, Process, Documentation) </li></ul><ul><li>Business Process Monitoring </li></ul><ul><li>Application Status Visualization </li></ul><ul><li>Real-time and Historical Data Analysis </li></ul><ul><li>Availability & Response Time Exception Handling </li></ul><ul><ul><li>Alerting </li></ul></ul><ul><ul><li>Analysis/Diagnosis </li></ul></ul><ul><ul><li>Remediation </li></ul></ul><ul><li>Reporting </li></ul>
  6. 6. Our Current Progress <ul><li>Critical Applications List </li></ul><ul><li>Implementation process documented </li></ul><ul><li>Monitoring & Alerting agreement for each application </li></ul><ul><li>Automated business processes for each application </li></ul><ul><li>Basic application status displayed on NOC dashboard </li></ul><ul><li>Monitoring data stored centrally and available via intranet </li></ul><ul><li>Exception Handling </li></ul><ul><ul><li>Availability and Response time alerting on NOC display </li></ul></ul><ul><ul><li>Analysis/Diagnosis by App/Infra Support Areas </li></ul></ul><ul><ul><li>Remediation by App/Infra Support Areas </li></ul></ul><ul><li>Automatic daily reports published to the intranet </li></ul>
  7. 7. Challenges <ul><li>Can become a ‘blame game’ in silo’ed application and infrastructure teams </li></ul><ul><li>Requirements and targets set by IT rather than the end-user </li></ul><ul><li>Resourcing and Application owner commitment </li></ul><ul><li>Script creation & maintenance an intensive ongoing process </li></ul><ul><li>Tool limitations, vendor-driven, fragmentation of toolsets </li></ul><ul><li>Product focus to the neglect of Process and People </li></ul><ul><li>Ownership of exception handling </li></ul><ul><li>Focus on changing the statistics rather than improving the customer experience </li></ul>
  8. 8. Removing Artificial Constraints Test Summary Reporting Defect Handling & Resolution Test Results & Analysis Test Status During Execution Script Creation & Execution Test Planning & Documentation Test Requirements App Risk Assessment Performance Testing
  9. 9. Removing Artificial Constraints Availability & Performance Reporting Test Summary Reporting Event Handling & Resolution Defect Handling & Resolution Real & Historical Data Analysis Test Results & Analysis Application Status (dashboard) Test Status During Execution Business Process Automation Script Creation & Execution Monitoring & Alerting Agreement Test Planning & Documentation Monitoring Requirements Test Requirements App Grading & Prioritisation App Risk Assessment Production Monitoring Performance Testing
  10. 10. Removing Artificial Constraints Availability & Performance Reporting Test Summary Application Exception Handling & Resolution Real-time & Historical Data Store/Analysis Test Results Prod Performance Status/Dashboard Test Performance Business Process Automation (Performance Measuring) Monitoring Agreement Success Criteria Test Planning Application Performance & Availability Requirements Application Performance Risk Assessment Application Performance Management
  11. 11. Business Process Automation
  12. 12. A Way to Proceed – Establish a Framework
  13. 13. A Way to Proceed (Production) - First ‘Function’ then ‘Toolset’ TestPartner Client Vantage Administrator Agent-less Monitoring Vantage NetIQ HP OpenView HP OpenView Client Vantage Administrator Vantage Visualiser Vantage View Vantage View HP OpenView HP OpenView HP OpenView Client Vantage Administrator Client Vantage Administrator MOM HP OpenView Vantage ? ?
  14. 14. A Way to Proceed (Production) - First ‘Function’ then ‘Toolset’ Agent-less Monitoring Vantage Client Vantage Administrator Vantage Visualiser Vantage View Vantage View Vantage Tivoli TestPartner Client Vantage Administrator Vantage MOM Client Vantage Administrator Client Vantage Administrator Tivoli Tivoli Tivoli Tivoli Tivoli ? ?
  15. 15. A Way to Proceed (Production) - First ‘Function’ then ‘Toolset’ Real User Monitor SiteScope Business Process Monitor Business Availability Centre Business Availability Centre Business Availability Centre Business Availability Centre MOM Business Availability Centre Business Availability Centre Business Availability Centre Business Availability Centre Business Availability Centre Business Availability Centre Business Availability Centre Business Availability Centre ? ?
  16. 16. A Way to Proceed (Pre-Production) LoadRunner Vuser Scripts Performance Centre Performance Centre Performance Centre Performance Centre Analysis Deep Diagnostics Performance Centre LoadRunner Monitors Performance Centre Performance Centre Performance Centre
  17. 17. A Way to Proceed <ul><li>Establish an APM team independent of IT App Owners, and IT Infrastructure Owners. </li></ul><ul><li>Provide a pre & post-production application performance measurement service. </li></ul><ul><li>Define clear service boundaries, roles & responsibilities. </li></ul><ul><li>Focus on Process & Function over Product. </li></ul><ul><li>Move accountability for hardware/tool software setup & maintenance to an Infrastructure Support group. </li></ul><ul><li>Determine constraints, and work within them, but keep the goal in mind. </li></ul>
  18. 18. Changing Mindsets - APM is: <ul><li>First about business outcomes - not technical solutions. </li></ul><ul><li>About Process & People - not just Product. </li></ul><ul><li>A specialist discipline that requires adequate resources. </li></ul><ul><li>First Strategic, then Operational. </li></ul><ul><li>About business disruption management – not component downtime. </li></ul><ul><li>About improving the customer experience – not an IT blame game. </li></ul><ul><li>Only going to work when the business value of establishing it is perceived. </li></ul>
  19. 19. Questions <ul><li>Questions? </li></ul><ul><li>Contact: </li></ul><ul><li>Philip Pooch - Performance Test Specialist </li></ul><ul><li>Infrastructure Services </li></ul><ul><li>Suncorp IT </li></ul><ul><li>e-mail: philip.pooch@suncorp.com.au </li></ul>

×