Show Me the Money: Connecting Performance Engineering to Real Business Results

1,987 views

Published on

Performance testing and optimization are often neglected parts of enterprise application roll out and upgrade initiatives.

The challenge for many IT managers is communicating the value of IT performance projects to business stakeholders who would benefit the most.

An interactive discussion with Walter Kuketz, CTO of Collaborative Consulting where he shares:

- How to align key business drivers with your performance engineering projects

- Ways to bridge the IT-business stakeholder communication gap

- A new approach to model business transactions and their IT dependencies

Host: Frank Days
Title: VP of Marketing, Correlsense

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,987
On SlideShare
0
From Embeds
0
Number of Embeds
256
Actions
Shares
0
Downloads
45
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • SharePath is a next generation Transaction Management Solution.SharePath Is UniqueTracks transactions across any type of element (not limited to Java/.NET), and models transaction and application behaviorDetects a change of specific component’s impact on end-user experience – One-Click-Problem-IsolationDesigned for Production from scratch. 24x7, No sampling. 100% of transactions are monitored and stored with negligible overhead.Quickly deployed. Get value in hours.Low TCO – No code changes, no “reconfigurations”, resistant to OS and application changes, no need to be familiar with application codeSharePath BenefitsEffectively isolating performance problems, even the most sporadic onesReducing risks of rollouts, identify problems before rolling outSafely migrating to Private Cloud, P2VDelivering IT Reliability:Insuring Your End-Users Are Not Impacted By Changes In Your Ever-Changing Environment
  • Byrne recommended adding to the key strengths (only verbally) that there is no need for appliances which enables more flexibility.
  • Show Me the Money: Connecting Performance Engineering to Real Business Results

    1. 1. Show Me the Money: Connecting Performance Engineering to Real Business Results<br />Walter Kuketz<br />Collaborative Consulting<br />Frank Days<br />Correlsense<br />
    2. 2. Speakers<br />Featured speaker:<br />Walter Kuketz<br />Senior Vice President and CTO<br />Collaborative Consulting<br />Your host:<br />Frank Days<br />VP, Marketing<br />Correlsense <br />2<br />
    3. 3. Housekeeping<br />Presentation will last around 30 minutes<br />Followed by Q&A<br />Slides will be available tomorrow real-user-monitoring.com<br />Enjoy!<br />3<br />
    4. 4. Agenda<br />Performance engineering challenges<br />Aligning PE to business initiatives<br />Improve IT and business communication<br />New approach to model business transactions<br />
    5. 5. Performance engineering challenges today<br />Highly distributed apps<br /><ul><li>Complex and tangled system of systems
    6. 6. Distributed Infrastructure
    7. 7. Distributed production operations</li></ul>Distributed teams<br /><ul><li>Performance engineering and testing
    8. 8. Architecture and Development
    9. 9. Business</li></ul>Evolving & changing application architectures<br /><ul><li>Mobile devices
    10. 10. Third party services
    11. 11. SaaS products
    12. 12. Cloud</li></ul>Changing usage patterns<br /><ul><li>Driven by mobile anywhere
    13. 13. Flash traffic events</li></li></ul><li>Performance engineering challenges..<br />Enterprise<br />User experience<br />Budget<br />Team skills<br /><ul><li>Performance organization; skillsets, multi disciplined, communication, split team
    14. 14. Training and career paths
    15. 15. Constant cost and budget pressure
    16. 16. Maintaining a meaningful performance lab (production-like)
    17. 17. User populations are exploding
    18. 18. Web site performance directly impacts revenue
    19. 19. Release schedules, monthly, quarterly
    20. 20. Project based </li></li></ul><li>Agenda<br />Performance Engineering challenges<br />Aligning PE to business initiatives<br />Improve IT and business communication<br />New approach to model business transactions<br />
    21. 21. Sharing information across the organization<br />Start Here<br />Business<br />goals, <br />SLA’s<br />Productions <br />Operations<br />monitoring<br />Enterprise <br />Architecture<br />SDLC <br />design <br />& build<br />Performance <br />Engineering <br />& testing<br />
    22. 22. Connecting PE to business value<br />Indirect <br />expenses<br />Website Conversion rate & fast website response time<br />Hourly cost of a website outage<br />Defer hardware upgrades or purchase<br />New product or technology evaluation for NFR’s & learning investment<br />Design and build to support SLA’s<br />Methodology has PE tasks and activities<br />SDLC<br />Will it work with the new business volumes<br />Scalability, stability, performance<br />Manage risk<br />Manage costs, efficiency<br />Costs per business transaction<br />Costs<br />Improve web site conversion rates<br />Proactively monitor real user experience<br />Website<br />Key part of managing SaaS and cloud<br />No longer your infrastructure<br />Vendors<br />
    23. 23. Connecting PE to business value<br />Indirect <br />expenses<br />Website Conversion rate & fast website response time<br />Hourly cost of a website outage<br />Defer hardware upgrades or purchase<br />New product or technology evaluation for NFR’s & learning investment<br />Conversation rate: 10%<br />Average order amount: $55.00<br />Web site visitors: 5,000/hr<br />Event duration: 24 hrs.<br />
    24. 24. Connecting PE to business value<br />Indirect <br />expenses<br />Website Conversion rate & fast website response time<br />Hourly cost of a website outage<br />Defer hardware upgrades or purchase<br />New product or technology evaluation for NFR’s & learning investment<br />Outage cost of $250,000/hour<br />$3 Million per 12 hour day<br />What is the busiest hour during the day?<br />Average revenue per day & peak revenue per day<br />
    25. 25. Connecting PE to business value<br />Indirect <br />expenses<br />Website Conversion rate & fast website response time<br />Hourly cost of a website outage<br />Defer hardware upgrades or purchase<br />New product or technology evaluation for NFR’s & learning investment<br />A constant workload, for a given system configuration<br />Design and build more efficient applications for each release cycle<br />Process the same workload with fewer computing resources<br />Defer hardware upgrades, or purchases to another quarter<br />
    26. 26. Connecting PE to business value<br />Indirect <br />expenses<br />Website Conversion rate & fast website response time<br />Hourly cost of a website outage<br />Defer hardware upgrades or purchase<br />New product or technology evaluation for NFR’s & learning investment<br />Business is interested in the competitive value of a new product or technology<br />Evaluate for non-functional requirements of performance, scalability, stability<br />Use options based approach on product evaluations <br />Use benchmarks, custom performance tests, etc<br />
    27. 27. Budgets – people, environments, tools<br />You must understand how budgeting decisions are made.<br />Shared services IT<br />Project based<br />Business unit<br />Enterprise level<br />
    28. 28. Budgets – indirect expenses<br />You must connect the resource request to:<br />Because of this we can process more requests <br />Revenue producing project<br /> Because of this we can process the same workload with less (deferred purchases)<br />Efficiency and cost<br /><ul><li>Large scale test from the cloud to remove the risk of system failure
    29. 29. Improve web site conversion rates, reduce the risk of being the last to know by proactive real user monitoring
    30. 30. Increase number of performance tests with in the testing window</li></ul>Reduce risk<br />Training the team on new technologies and monitoring the market<br />Increase options<br />
    31. 31. Agenda<br />Performance Engineering challenges<br />Aligning PE to business initiatives<br />Improve IT and business communication<br />New approach to model business transactions<br />
    32. 32. Alignment – talking with the business<br />Why invest in a performance engineering team?<br />Manage risk: <br />stability, scalability <br />(fear of the <br />unknown)<br />Reduce <br />operational costs <br />and production <br />outages<br />Increase <br />efficiency: <br />supporting same <br />workload with fewer <br />Resources & <br />Additional<br />spending<br />Support business <br />objective <br />(growth), drive <br />revenue<br />Visibility: <br />what are PE <br />resources <br />working on?<br />
    33. 33. Alignment – talking with the business<br />Know your audiences approach to investments and the significance of External focused applications vs. internal corporate<br />Internal <br />business units<br />Cost focus<br />External <br />business units<br />Revenue focus<br />
    34. 34. IT and Business communication for Performance<br />Enterprise goals<br /><ul><li>Business plans call for 20% growth
    35. 35. New client for healthcare claims processing system (from 500,000/Day to 800,000)
    36. 36. Retail brokerage is expecting day trading volume to increase by 40%
    37. 37. And we need to handle more flash market events
    38. 38. Marketing driven events with limits</li></ul>Value disciplines:<br />Customer intimacy<br />Operational excellence<br />Innovation<br />
    39. 39. Different communication styles<br />What the business says:<br />What IT says:<br /><ul><li>Growth: Have a marketing event where our customers visit the site for a discount of 15% on (limited) our product for a limited time (until they are gone).
    40. 40. Can handle that?
    41. 41. We have 750,000 customers in the database, and expect half of them to be interested in this.
    42. 42. Well, we ran a couple of tests with 1,500 to 2,000 virtual users with almost no think time and the system held, though the Database ran hot.
    43. 43. The max response time did increase well past the goal, but the average was still under six seconds.
    44. 44. We could only test half the TPS of what we think 375,000 users would do. Due to the environment be smaller than production.</li></ul>Where do you go from here??<br />
    45. 45. An alternative dialog<br />What the business says:<br />What IT says:<br /><ul><li>Growth: We have scheduled a marketing event where we just invited all our registered customers to visit the site for a department wide discount of 15% on (limited) our product for a limited time ( till they are gone).
    46. 46. Can handle that?
    47. 47. We have 750,000 customers in the database, and expect half of them to be interested in this.
    48. 48. We see risk to the event. We have successfully executed scalability tests for 175,000 users accessing the site, before their experience will be poor.
    49. 49. We have developed a few options to help us reduce the risk;
    50. 50. Option A – requires $250,000 to implement, did this business factor this into their ROI
    51. 51. Option B – requires impacting other applications during the event. Taking their computing resources
    52. 52. Option C – gracefully turn-away customer during peak load, ensure the customers in the system have a good experience.</li></li></ul><li>Agenda<br />Performance Engineering challenges<br />Aligning PE to business initiatives<br />Improve IT and business communication<br />New approach to model business transactions<br />
    53. 53. Transactions matter to the business people<br />Business Service and workflow<br />Application transaction response time<br />Infrastructure<br />Complete user experience<br />Confirm Order<br />Component view of utilization<br />
    54. 54. Business transactions<br />How do you make sure your customers have an outstanding experience on your web site?<br />How do you make sure your internal users are having the right experience on their internal systems (workflow)?<br />
    55. 55. Application performance management<br /><ul><li>Measurement and compliance to SLA’s
    56. 56. Hold SaaS vendors accountable</li></ul>SLA’s<br /><ul><li>Drive revenue with faster web site
    57. 57. Connect revenue to performance</li></ul>User experience<br /><ul><li>Watch user experience over time
    58. 58. Locate trends in response time</li></ul>Be first<br /><ul><li>Locate root-cause quickly
    59. 59. Identify slow parts of the overall transaction</li></ul>Minimize disruptions<br />
    60. 60. To Understand App Performance…<br />… You must know the experience of your real users…not a robot…<br />
    61. 61. Transaction Management for Performance Engineering<br />
    62. 62. SharePath – The APM Innovator<br />“SharePath rapidly generates detailed multitier models of an application's execution path in an almost entirely automated manner, making the technology very easy to deployand maintain, while capturing data at a high degree of granularity without having an impact on production performance.”<br />Gartner, March 2010<br />
    63. 63. SharePath RUM<br /><ul><li>Real user monitoring
    64. 64. Understanding the end user experience</li></ul>SharePath Datacenter<br /><ul><li>Transaction path detection
    65. 65. Every hop, every transaction</li></ul>SERVER<br />WEB<br />APP SVR<br />PROXY<br />MQ/ESB<br />CORBA<br />LDAP<br />DCOM<br />Web<br />Services<br />The SharePath Product Family<br />
    66. 66. Use SharePath RUM for Free<br />http://www.real-user-monitoring.com<br />
    67. 67. About Collaborative Consulting<br />Business and technology consulting firm <br />Clients across the United States<br />Consulting services <br />Business enablement<br />Information management <br />Technology enablement <br />Program management <br />31<br />
    68. 68. The Collaborative Difference<br /><ul><li>Combining a highly experienced team with several value based delivery options ensures that our clients obtain the right services utilizing the best model for their needs.
    69. 69. Experienced, pragmatic, and dedicated team
    70. 70. Integrated approach
    71. 71. Accelerators
    72. 72. Value</li></li></ul><li>Questions?<br />More information:<br />info@correlsense.com<br />www.correlsense.com/demo<br />Free real user monitoring tool:www.real-user-monitoring.com<br />Get your free copy <br />SharePath RUM today!<br />

    ×