Downloaded 31 times
Uploaded byCorrelsense
EMA - Measuring the User Experience in the Cloud
This document discusses the challenges and strategies associated with measuring user experience in cloud computing. It emphasizes the need for effective end-user experience monitoring (EUE) to manage dynamic environments, highly virtualized infrastructures, and multi-tenant setups while maintaining performance and service levels. Additionally, it provides tips for monitoring success, focusing on key metrics and automation to enhance user satisfaction.
More Related Content
![D Microsoft Apio Sales Presentation Non Branded All Up 43[1]](https://cdn.slidesharecdn.com/ss_thumbnails/DMicrosoftAPIOSalesPresentationNonBrandedAllUp431-123212157844-phpapp03-thumbnail.jpg?width=640&height=640&fit=bounds)
Similar to EMA - Measuring the User Experience in the Cloud
EMA - Measuring the User Experience in the Cloud
- 1. Measuring User Experiencein the Cloud: Which Tactics are Worth the Time?Julie CraigResearch Director, ApplicationsEnterprise Management Associates 5777 Central Avenue, Suite 105Boulder, CO 80301www.enterprisemanagement.com
- 2. AgendaCloud SnapshotCloud CharacteristicsCreate New Management ChallengesEnd User Experience Monitoring (EUE) and the CloudSummary and ClosingSlide 2
- 3. CapEx Reductions, FastDeployment, OpEx Reductions are Top Three Reasons for Cloud AdoptionWhich needs are effectively being addressed by cloud computing solutions for your organization? 3
- 4. SaaS Leads PublicCloud DeploymentsWhat cloud computing service model(s) has your organization deployed, or is planning to deploy? 4
- 5. Private Cloud LeadsPublic CloudWhat cloud computing deployment model(s) has your organization deployed, or is planning to deploy? 5
- 6. AgendaCloud SnapshotCloud CharacteristicsCreate New Management ChallengesEnd User Experience Monitoring (EUE) and the CloudSummary and ClosingSlide 6
- 7. Measuring SuccessWhich doesyour organization measure in order to quantify the success of cloud-related initiatives? 7
- 8. 8Ranked Importance ofCurrent Monitoring/ Management ToolsPlease rate the importance of the following management technologies.
- 9. End User ExperienceManagement Under-represented Which technologies does your org currently have deployed/full commitment to deploy in your environment?9
- 10. AgendaCloud SnapshotCloud CharacteristicsCreate New Management ChallengesEnd User Experience Monitoring (EUE) and the CloudSummary and ClosingSlide 10
- 11. “End user Experience”:CatchAll Term for Multiple Types of ProductsNetwork tracing or captureDeep visibility into network flows and packetsActive or synthetic transaction monitoringScript-based tests that run against an application at regular intervals.Passive or observed transaction monitoring“Hard” or “soft” appliances scan protocol-based traffic such as web interactionsEnd to end transaction reconstructionConsolidate metrics from across the data center to deliver a reconciled end to end view of transaction executionClient-side EUE Monitor performance and availability from the perspective of the user workstationSlide 11
- 12. Agentless, Client-Side EUEDeependpoint monitoring for both “internal” and “external” users Instrumentation at the endpoint via the browser“Watch” activity entering, exiting, and on the workstation or deviceDiagnose application-related issues, identify delay sourcesInstrumentation for the CloudMonitoring can be embedded in VMs“Cloud Edition” can be installed in Amazon EC2 instancesCentral repository and collector monitors EC2 environmentsInstrumentation for MobileSlide 12
- 13. Correlsense CEO, OrenEliasSlide 13End-User-Monitoring.com
- 14. The Big Question:How do we Manage Today’s Ever Changing Environments?Slide 14PublicPrivateSOAVirtualizationLots of Moving PartsAgileEnd-User-Monitoring.com
- 15. With all ofthe Complexity and Moving Parts…What Does Not Change?PublicPrivateSOAVirtualizationSlide 15AgileEnd-User-Monitoring.com
- 16. The Two AxiomsSlide 16Transactions Drive the Business User’s Expectation of PerformanceEnd-User-Monitoring.com
- 17. SERVERWEBAPP SVRElasticLBMQ/ESBCORBALDAPDCOMWebServicesPublic, Private,Hybrid Datacenter‘Under The Hood’End-User-Monitoring.com
- 18. Cloud ≠ ‘CureAll’Slide 18End-User-Monitoring.com
- 19. Four New Challengesin the Cloud“Old world” monitoring paradigms no longer fitSlide 19End-User-Monitoring.com
- 20. Challenge #1 –Dynamic EnvironmentsHighly dynamic environmentOut: Auto-discoveryIn: Auto-detectionSlide 20End-User-Monitoring.com
- 21. Challenge #2 -Highly Virtualized InfrastructureInfrastructure is highly virtualizedOut: Focus solely on Infrastructure and resource monitoringIn: Focus on end-user and applicationsSlide 21End-User-Monitoring.com
- 22. More Demanding ApplicationsCustomerfacing applications are more demandingOut: Focus solely on AvailabilityIn: Focus on performance and service levelsSlide 22End-User-Monitoring.com
- 23. Multi-Tenant EnvironmentShared environmentOut:Hardware appliancesIn: Software-based solutionsSlide 23End-User-Monitoring.com
- 24. Top 3 TipsFor Cloud Application Management
- 25. 1) Be ParanoidWatchEvery Transaction from Every UserSERVERWEBAPP SVRPROXYMQ/ESBCORBALDAPDCOMWebServicesDatacenterEnd-User-Monitoring.com
- 26. Get the KeyUser-Experience MetricsTotal End-User Response TimeBrowser Rendering TimeDatacenter TimeNetwork LatencyReal User MonitoringRendering
- 27.
- 28. Houston, We HaveA Problem
- 29. 2) Be Smart.FromTransactions to Performance ModelsEnd-User Response Time BreakdownTransactions Modeled with Transaction Profile
- 30. Compare Between ApplicationModelsWithin SLA vs. Exceeded SLABefore vs. AfterEnd-User-Monitoring.comSlide 30
- 31. Insurance in YourChanging WorldAgile Roll-Outs, Virtual Migrations, Private Cloud MigrationsCompare “new” and “old” production behaviorProve response times are better or improvedRealize causes of degradations to avoid rollbackEnd-User-Monitoring.com
- 32. 3) AutomateEnforce SLAson End-User Experience
- 33.
- 34. Alert and AutomateSlide 34End-User-Monitoring.com
- 35. Get Started withSharePath RUM Express for Freehttp://www.real-user-monitoring.comEnd-User-Monitoring.com
- 36. AgendaCloud SnapshotCloud CharacteristicsCreate New Management ChallengesEnd User Experience Monitoring (EUE) and the CloudSummary and ClosingSlide 36
- 37. SummaryCloud computing isa “hot topic” with a variety of potential benefits Cloud also brings its own set of challenges How do you measure success of Cloud adoption?How do you monitor performance and availability?How do you get visibility to End User performance?Which types of EUE tools are most useful for Cloud monitoring?Each type of product has its strengthsStretch your tools budget by making sure to match tools acquisitions with desired monitoring metricsSlide 37
- 38. For more informationon Enterprise Management Associates, please go to www.enterprisemanagement.com, or call +1 303-543-9500Thank you for attendingtoday’s presentation
Editor's Notes
- #3 Cover Agenda
- #4 Cloud computing is today’s “hot topic” and Cloud adoption is being driven by a variety of factors. Cover data on slide.
- #5 The term Cloud is not well defined, and means different things to different people. public or privateone of the few areas of agreement is that Public cloud encompasses three basic types of service offerings: SaaS, IaaS, PaaS.Characteristics of each
- #7 In fact, while the Cloud can deliver benefits, it also introduces significant management challenges.
- #8 One challenge is to be able to quantify whether public cloud adoption is actually achieving objectives. Measuring service quality is unrealistic for many companies, based on the fact that they are still struggling to manage service quality for on-premise applications. Cloud introduces additional complications
- #9 toolsets that are most often used to monitor and manage on-premise IT environments.Infrastructure performance and availability is the number one capability cited. This goes away with public cloud, particularly IaaShowever, IT still gets the call when performance degradesAsk the question: will your tools tell you where the problem is? Is it with the service provider– or with YOUR network? Cloud adoption requires a re-assessment of monitoring processes and tools
- #10 One of the most effective ways to monitor performance of cloud-delivered services is by watching the endpoint. Yet EUE solutions are at the low end of the spectrum in terms of actual product investments. The bottom four technologies shown here are, in general, those most relevant to managing applications and business services, and to monitoring cloud and hybrid applications.
- #11 Description of EUE product types and their benefits
- #12 EUE AKA APM, RUM each type of monitoring product contributes a slightly different vantage point.Network products provide detailed information about application performance as the network sees it. Synthetic transaction monitoring tools rely on script execution, advantage is they deliver transaction info regardless of whether users are actually on the system. Observed transaction management solutions deliver insight from the viewpoint of protocols such as web traffic. Transactional reconstruction assesses application performance from the data center perspective, may or may not integrate with client-side instrumentation.Client-side EUE delivers direct visibility to the experience of the user. Done by installing agents or via browser instrumentation. agent-based approach for internal users, instrumentation useful for both internal and external users.
- #13 Advantages of agentlessMonitoring for high-value customer usersOne of most effective ways to monitor cloud and mobile, as does not require installation at end pointCompatible with VMs, EC2
- #18 The point is that in this Complex, Heterogenous technology architecture, the key thing to monitor is the Transactions of all types that flow through these systems.
- #26 Don’t just rely on the provider. Track individual users.
- #27 What Is A Transaction?Request issued by an end-userGoes through multiple componentsEach component may be activated multiple timesNote that:Different transaction types take different paths and flowsSometimes instances of the same transaction type execute across different flows
- #30 Average Response Times are not enough.Monitoring the Components (silo’ed approach) vs. Monitoring the Transaction Flow (SharePath approach)When the database chokes, it is relatively easy to identify as the root cause. However, it becomes more difficult to identify root cause:When the application chokes and then comes back to life, orWhen the performance of a small portion of requests degradesDue to:Response times are all averagedLooking at one specific Tx instance does not imply on the othersThe problem may be in a non-JVM component (Apache => LDAP)JVM? LDAP? Apache? Shared/Web-Service? MF? External? Database? The other Database? Tibco? SiteMinder? Badly configured load-balancer? Network?Finger-pointing results in wasting valuable time
- #38 Summarize presentation
- #39 Turn over to Oren