Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Why You Should Monitor IT Service Performance in Pre-production Environments

68 views

Published on

A converged APM/IPM solution can facilitate true root-cause analysis from an end-to-end IT service perspective, inclusive of both supporting and customer-facing IT services, as well as across multiple service lifecycle stages. In addition, by having all service team members share an easy-to-use interface that is tailored to each of their requirements minimizes learning curves, enhances operational efficiency and ensures user satisfaction by providing a production-grade monitor to IT staff that are working in staging environments.

Watch this on-demand webinar where John Worthington, Director of Product Marketing, shares how a converged APM/IPM solution can be leveraged effectively in pre-production to eliminate bottlenecks in testing, delays, re-work or increased deployment risk. In it, you will discover:

- How shifting left will help you accelerate time to delivery by correlating all service events across every layer of every component
- How end to end monitoring can expose bottlenecks in supporting IT services such as Citrix before actual deployment occurs
- How converged APM/IPM can ensure end user experience as change cycles accelerate

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Why You Should Monitor IT Service Performance in Pre-production Environments

  1. 1. Monitoring Performance in Pre-Production Environments Addressing the end-to-end challenge with converged application and infrastructure monitoring www.eginnovations.com
  2. 2. Moderator Christine Ackley Director of Marketing Operations eG Innovations Christine.Ackley@eginnovations.com 8/22/17 Copyright eG Innovations 2
  3. 3. Logistics •Please submit your questions at any time during the webinar using the questions panel on the GoToWebinar client •This webinar is being recorded. All attendees will receive a link to the recording in a few days. •A copy of this presentation is posted on SlideShare: http://www.slideshare.net/eginnovations 8/22/17 Copyright eG Innovations 3
  4. 4. John Worthington Director Product Marketing eG Innovations 201.826.1374 John.worthington@eginnovatons.com https://www.linkedin.com/in/johnmworthington/ @jMarcusWorthy Today’s presenter 8/22/17 Copyright eG Innovations 4
  5. 5. About the Shift-Left Series... • This is the third in our ‘Shift- Left’ Series • Focuses on ITSM, DevOps and emergence of converged APM/IPM • Addresses monitoring across service lifecycle •Today’s focus is on monitoring in pre-production Closing the Visibility Gap Realizing Unified Cloud Monitoring Replay here Replay here 8/22/17 Copyright eG Innovations 5
  6. 6. Agenda • Introduction • Monitoring through the service lifecycle • Pre-production monitoring • Conclusion 8/22/17 Copyright eG Innovations 6
  7. 7. Introduction Monitoring Performance in Pre-Production Environments 8/22/17 Copyright eG Innovations 7
  8. 8. Who We Are... • eG Innovations is an industry leader in performance management solutions for complex, dynamic, multi-tier digital IT services 8/22/17 © eG Innovations, Inc | www.eginnovations.com 8 2001 • Universal Agent • Automatic thresholding • Automated diagnostics • Web transaction monitoring • Integration console • Service topology map • Auto correlation based on dependency maps • 360° visibility into VM performance • Industry first virtualization-aware auto-diagnosis • Broadest virtualization coverage User experience monitoring Transaction tracing Code level visibility Unified Monitoring Business Service Management 2005 2008 Virtualization 2014 Cloud 2016 Converged APM/IPM • SaaS Option • Public/Private/Hybrid cloud support • • •
  9. 9. Business Transaction Health Create Order Create Invoice Ship Product Digital Business Service Real User Monitoring | Synthetic Monitoring Business Transaction Tracing Application Health Order Service Invoice Service Logistics Service Topology Discovery | Code-Level Correlation Infrastructure Health Legacy Data Center Private Cloud Services Public Cloud Services Pre-Emptive Alerting | Automated Diagnostics Capacity Planning | Right-Sizing Public Private Hybrid Public Private Hybrid What We Do... eG Enterprise takes measurements at every layer of every component of an end-to-end IT service, learns the norms of all measurements, and through patented analytics automatically isolates which layer of which component is the source of an anomaly. Today we do this across any cloud deployment model and from code to bare metal. © eG Innovations, Inc | www.eginnovations.com 9
  10. 10. Embedded Analytics, Simple Interface • Patented analytics embedded in the monitor • Correlates every layer of every component across end-to-end digital business services • Self-learning adapts data collection in real time to operational events • Self-healing correlation provides for automated remediation • Simple, intuitive user interface 8/22/17 © eG Innovations, Inc | www.eginnovations.com 10
  11. 11. Monitoring through the service lifecycle Monitoring Performance in Pre-Production Environments
  12. 12. When Value is Created... • Value is created at The End of the service lifecycle...not the beginning • Value begins and ends with the customer • External-Customer-Facing Services are where business results originate 8/22/17 Copyright eG Innovations 12 Service Design Service Transition Service Operation Plan & Build Release Operate ITIL© DevOps Customers
  13. 13. User Groups / Consumers / Customers Digital Business Process Services are a means of delivering value 8/22/17 Copyright eG Innovations 13 Create Order Create Invoice Ship Product User Experience Order Service Invoice Service Logistics Service Application Health Business Health Legacy Data Centers Private Cloud Services Public Cloud Services Infrastructure Health The IT Service Iceberg While value is visible above the iceberg... ...a lot happens below the water line!!
  14. 14. OpsDev Test Pre- Prod Prod Accelerate time to value Accelerate & Amplify Feedback Time to value and DevOps 8/22/17 Copyright eG Innovations 14 Ah Ha! Ka Ching! Continuous Integration Continuous Delivery Continuous Deployment Dev Development practice that requires developers to integrate code into a shared repository on a daily basis focuses on making sure software is always in a releasable state throughout its lifecycle Practices that enable changes that pass automated tests to be auto deployed to prod
  15. 15. Closing the Visibility Gap 15 Dev Test Pre- Prod ProdDev Ops
  16. 16. Audience Poll • Do you leverage monitoring in pre-production? (Pick the best answer) q Yes, we do extensive load-testing and baselining in a dedicated pre- production environment using multiple monitoring tools q Yes, but testing is limited and tends to be oriented around functional and user acceptance testing rather than performance q No, we do not have a dedicated pre-production environment q Ad-Hoc; we occasionally perform testing and it is typically outsourced to a third party 8/22/17 Copyright eG Innovations 16
  17. 17. Pre-Production Monitoring Monitoring Performance in Pre-Production Environments 8/22/17 Copyright eG Innovations 17
  18. 18. What happens in pre-production? • Pre-production tends to focus on customer-facing IT services • Most customers consider monitoring of supporting IT services after customer-facing IT services are impacted • Pre-production may not get same level of attention as Prod; i.e., control of configuration changes • Pre-production testing typically includes: • Stress-testing • Baselining • Testing is more frequent as we shift left Note: There may be some overlap with testing that begins in Dev/Test (i.e., application fingerprinting, detecting memory leaks, etc.) but we’ll focus on these in a future webinar 8/22/17 Copyright eG Innovations 18
  19. 19. Citrix and the end-to-end challenge 8/22/17 Copyright eG Innovations 19 • Most people don’t even think about monitoring when adding supporting IT services....until customer- facing IT services don’t perform well • Supporting IT service monitoring ignores the end- to-end view • APM focuses on applications in earlier stages of the service lifecycle • Ignores IPM and results in visibility gaps
  20. 20. Stress-testing • Seeks to test beyond normal operating capacity, to a breaking point, in order to observe results: • What breaks, where and when? • What are usage limits? • Are specifications met? • What are the failure modes?
  21. 21. What breaks, where and when? • Easily see which layer of what component breaks • Root-cause and effects are automatically identified and captured for analysis 8/22/17 Copyright eG Innovations 21 “..we were able to easily drill down to the list of threads that were in a blocked state, including the stack trace which helped us analyze which part of the code was blocking the threads. This allowed us to identify and close performance issues in our application which otherwise would have taken a lot of time to analyze...”
  22. 22. What breaks, where and when? • Capture history to report on what load causes failure • Can view results during or after test 8/22/17 Copyright eG Innovations 22 Site Performance Summary Various Pages in the Site Geography Performance Browsers and Devices JavaScript Errors Top N (Drive Priority) See Outliers and Edge Cases Historical Reporting “..we no longer had to monitor the application when performance testing was being performed...all the data was available retrospectively which we could analyze to determine what caused the issue with relative ease...”
  23. 23. What breaks, where and when? • Can include: • End user experience • Applications • Infrastructure • Any cloud deployment model 8/22/17 Copyright eG Innovations 23 Real User Monitoring Synthetic User Monitoring Triage slowness quickly and isolate problem areas. Is it the network, server backend, content download, or front-end browser? “We’ve made a distinctive turn-around from reactive to proactive monitoring. This was by far the biggest benefit to us.”
  24. 24. What breaks, where and when? • Can include: • End user experience • Applications • Infrastructure • Any cloud deployment model 8/22/17 Copyright eG Innovations 24 Drill down to view impact of specific application code. Dill down into the slow database query. Visualize run-time application architecture and transaction flow, and isolate the cause of transaction slowness. Application Code-Level Insight Slow Database Access “.. Within a short period, we have been able to analyze and understand issues in our SAP ERP environment. What used to take us two to three days is now done in 5-10 minutes..”...”
  25. 25. What breaks, where and when? • Can include: • End user experience • Applications • Infrastructure • Any cloud deployment model 8/22/17 Copyright eG Innovations 25 GPU bottleneck identified Analyze which tier is the bottleneck Isolate Bottlenecks in Real Time Bottleneck Analysis by Tier “..I can quickly drill down into the application and determine how parts of the deployments are performing...we used to spend a lot of time getting this data, and many times the performance data was no longer available. I don’t have to wait on other SMEs and can spend less time on performance data research...”
  26. 26. What breaks, where and when? • Can include: • End user experience • Applications • Infrastructure • Any cloud deployment model 8/22/17 Copyright eG Innovations 26 Identify Third-Party Dependencies Identify third-party dependencies and remote calls within the data center and beyond. Remote Call Execution Time Capture exit calls that were initiated from within the application and their response time. • SQL Queries: database performance and SQL execution • JMS Calls: Topics and Queues • Third Party HTTP(s) calls • Third Party Web Services calls Public Private Hybrid “.. Within the heterogeneous environments among our customers either in our Cloud, Global IT or Mobility solutions, we found the monitoring platform helps us in better capacity planning and service level management.”...”
  27. 27. Identifying usage limits • Understand demand vs resource consumption during peak usage 8/22/17 Copyright eG Innovations 27 VDI Demand vs Consumption
  28. 28. Identifying usage limits • Compare to previous stress tests • Production reporting informs development & future testing 8/22/17 Copyright eG Innovations 28 Understand Peak Utilization Identify peak demand and the time of demand
  29. 29. Validating service measurements • Capture service level measurements based on load testing to compare with service level targets • For any critical-to-quality (CTQ) measurements (Transactions, logon, etc.) 8/22/17 Copyright eG Innovations 29 Production Targets Pre-Production Results User Logon Results
  30. 30. Identifying failure signatures • Auto-diagnosis from code to bare metal, any cloud deployment model and configuration changes • Accelerates feedback to appropriate stakeholders • Enables tuning alert thresholds • Example: Alert pre-defined stakeholder(s) when memory consumption reaches ‘X’ • Exposes potential opportunities for self-healing correlation • Example: Take server out of commission based on pre-defined failure signature 8/22/17 Copyright eG Innovations 30
  31. 31. Baselining • Baselining is a method for analyzing performance by comparing current performance to a historical baseline.
  32. 32. Auto-baselining • Pre-production baselining can incorporate static and dynamic thresholds • Flexible alarm policies 8/22/17 Copyright eG Innovations 32 Dynamic, time- varying thresholds automatically set https://www.eginnovations.com/documents/ white-papers/intelligent_thresholding.pdf “..We had a two week delay in testing due to a performance problem with a vendor application...we borrowed an eG Agent license from another application in QA and in less than a day we were able to install and configure the collection and trending of performance data for the application. We were not able to do this with other monitoring tools...” Get the White Paper!
  33. 33. Comparing baselines • Service analysis for end-to-end customer-facing IT services • Migration analysis for supporting IT services 8/22/17 Copyright eG Innovations 33 Before Migration After Migration XenApp/XenDesktop 6.5 to 7.14 Service Analysis Supporting IT Service Migrations
  34. 34. IT Service Baselining • Within an end-to-end IT service there are many baselines • Business transaction health • Application health • Infrastructure health • Service improvement involves a never-ending series of baselines at every layer of every component of the end- to-end IT service • This includes service-to- service interactions 8/22/17 Copyright eG Innovations 34 User Groups / Consumers / Customers Digital Business Process Create Order Create Invoice Ship Product User Experience Order Service Invoice Service Logistics Service Application Health Business Health Legacy Data Centers Private Cloud Services Public Cloud Services Infrastructure Health The IT Service Iceberg End-to-End T O P T o B O T T O M
  35. 35. Conclusion eG Enterprise in Pre-Production Environments 8/22/17 Copyright eG Innovations 35
  36. 36. Monitoring in Pre-Production • Converged APM/IPM can ensure end user experience as change cycles accelerate • Real and Synthetic User Monitoring • Application Topology Discovery & Visualization • User-defined Transaction Tracing • Auto-correlation of all service events across every layer of every component accelerates production readiness • Configuration change impacts • Code to bare metal • Any cloud deployment model • End-to-end monitoring validates that supporting IT services are properly underpinning customer-facing IT services • Auto-baselining and thresholding • End-to-end visibility and cross-tier diagnosis • Preemptive detection & alerting • Automatic topology/dependency mapping • Comprehensive reporting & trending / analytics 8/22/17 Copyright eG Innovations 36
  37. 37. Dev Test Prod Pre- Prod Shift-left with converged APM/IPM • Converged APM/IPM provides a unified monitor that all stakeholders can leverage across the service lifecycle 8/22/17 Copyright eG Innovations 37 Dev Ops Increasing need for monitoring depth and reach Need rapid, more frequent testing and monitoring
  38. 38. Why pre-production monitoring? • The costs of poor performance today is very high • Pre-production monitoring can identify preventable disruptions and delays • Value is created at the END of the service lifecycle • Monitor actual user experiences as they occur • This is where the continuous delivery process begins • A converged application and infrastructure solution provides total performance visibility, amplifies and accelerates feedback and maximizes flow across every stage of the service lifecycle 8/22/17 Copyright eG Innovations 38 Forester Research shows that, on average, every dollar invested in UX brings 100 dollars in return. That’s an ROI of a whopping 9,900 percent.
  39. 39. Questions? Please submit your questions at any time during the webinar using the questions panel on the GoToWebinar client 8/22/17 Copyright eG Innovations 39
  40. 40. •More Details • http://www.eginnovations.com/freetrial •Send an Email • Info@eginnovations.com •Call Us • +1 (866) 526 6700 For More Information 8/22/17 Copyright eG Innovations 40

×