Measuring User Experience in the Cloud: Which Tactics are Worth the Time?<br />Julie Craig<br />Research Director, Applica...
Agenda<br />Cloud Snapshot<br />Cloud Characteristics Create New Management Challenges<br />End User Experience Monitoring...
CapEx Reductions, Fast Deployment, OpEx Reductions are Top Three Reasons for Cloud Adoption<br />Which needs are effective...
SaaS Leads Public Cloud Deployments<br />What cloud computing service model(s) has your organization deployed, or is plann...
Private Cloud Leads Public Cloud<br />What cloud computing deployment model(s) has your organization deployed, or is plann...
Agenda<br />Cloud Snapshot<br />Cloud Characteristics Create New Management Challenges<br />End User Experience Monitoring...
Measuring Success<br />Which does your organization measure in order to quantify the success of cloud-related initiatives?...
8<br />Ranked Importance of Current Monitoring/ Management Tools<br />Please rate the importance of the following manageme...
End User Experience Management Under-represented <br />Which technologies does your org currently have deployed/full commi...
Agenda<br />Cloud Snapshot<br />Cloud Characteristics Create New Management Challenges<br />End User Experience Monitoring...
“End user Experience”:Catch All Term for Multiple Types of Products<br />Network tracing or capture<br />Deep visibility i...
Agentless, Client-Side EUE<br />Deep endpoint monitoring for both “internal” and “external” users <br />Instrumentation at...
Correlsense CEO, Oren Elias<br />Slide  13<br />End-User-Monitoring.com<br />
The Big Question: How do we Manage Today’s Ever Changing Environments?<br />Slide  14<br />Public<br />Private<br />SOA<br...
With all of the Complexity and Moving Parts…<br />What Does Not Change?<br />Public<br />Private<br />SOA<br />Virtualizat...
The Two Axioms<br />Slide  16<br />Transactions Drive the Business <br />User’s Expectation of Performance<br />End-User-M...
SERVER<br />WEB<br />APP SVR<br />Elastic<br />LB<br />MQ/ESB<br />CORBA<br />LDAP<br />DCOM<br />Web<br />Services<br />P...
Cloud ≠ ‘Cure All’<br />Slide  18<br />End-User-Monitoring.com<br />
Four New Challenges in the Cloud“Old world” monitoring paradigms no longer fit<br />Slide  19<br />End-User-Monitoring.com...
Challenge #1 – Dynamic Environments<br />Highly dynamic environment<br />Out: 	Auto-discovery<br />In: Auto-detection<br /...
Challenge #2 - Highly Virtualized Infrastructure<br />Infrastructure is highly virtualized<br />Out: Focus solely on Infra...
More Demanding Applications<br />Customer facing applications are more demanding<br />Out: Focus solely on Availability<br...
Multi-Tenant Environment<br />Shared environment<br />Out: Hardware appliances<br />In: Software-based solutions<br />Slid...
Top 3 Tips For Cloud Application Management<br />
1) Be ParanoidWatch Every Transaction from Every User<br />SERVER<br />WEB<br />APP SVR<br />PROXY<br />MQ/ESB<br />CORBA<...
Get the Key User-Experience Metrics<br />Total End-User Response Time<br />Browser Rendering Time<br />Datacenter Time<br ...
Look Across Space<br />
Houston, We Have A Problem<br />
2) Be Smart.From Transactions to Performance Models<br />End-User Response Time Breakdown<br />Transactions Modeled with T...
Compare Between Application Models<br />Within SLA               vs.              Exceeded SLA<br />Before                ...
Insurance in Your Changing WorldAgile Roll-Outs, Virtual Migrations, Private Cloud Migrations<br />Compare “new” and “old”...
3) AutomateEnforce SLAs on End-User Experience<br />
Application End-User SLAS<br />
Alert and Automate<br />Slide  34<br />End-User-Monitoring.com<br />
Get Started with SharePath RUM Express for Free<br />http://www.real-user-monitoring.com<br />End-User-Monitoring.com<br />
Agenda<br />Cloud Snapshot<br />Cloud Characteristics Create New Management Challenges<br />End User Experience Monitoring...
Summary<br /><ul><li>Cloud computing is a “hot topic” with a variety of potential benefits</li></ul> Cloud also brings its...
For more information on Enterprise Management Associates, please go to www.enterprisemanagement.com, or call +1 303-543-95...
Upcoming SlideShare
Loading in …5
×

EMA - Measuring the User Experience in the Cloud

1,562 views

Published on

Cloud computing brings with it many benefits, especially lower IT costs and increased flexibility. However, the dynamic, hybrid nature of Cloud environments require enterprises to re-think their existing IT management processes and tools. Applications that perform poorly and fail to meet service levels — whether on premise or in the Cloud — can cause users to churn and revenues to drop.

Join EMA Research Director Julie Craig and Correlsense CEO Oren Elias for this Webinar that will highlight ways to measure how end users experience your business applications, as well as identify which approaches are likely candidates for a long-term strategy.

Attendees will learn:

How end-user response times are impacted by components and new changes that are introduced in the IT environment
The 3 tips for managing Cloud-based applications
The "secret sauce" for reliable end user monitoring, based on customer case studies that will be presented

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,562
On SlideShare
0
From Embeds
0
Number of Embeds
133
Actions
Shares
0
Downloads
29
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Cover Agenda
  • Cloud computing is today’s “hot topic” and Cloud adoption is being driven by a variety of factors. Cover data on slide.
  • The term Cloud is not well defined, and means different things to different people. public or privateone of the few areas of agreement is that Public cloud encompasses three basic types of service offerings: SaaS, IaaS, PaaS.Characteristics of each
  • In fact, while the Cloud can deliver benefits, it also introduces significant management challenges.
  • One challenge is to be able to quantify whether public cloud adoption is actually achieving objectives. Measuring service quality is unrealistic for many companies, based on the fact that they are still struggling to manage service quality for on-premise applications. Cloud introduces additional complications
  • toolsets that are most often used to monitor and manage on-premise IT environments.Infrastructure performance and availability is the number one capability cited. This goes away with public cloud, particularly IaaShowever, IT still gets the call when performance degradesAsk the question: will your tools tell you where the problem is? Is it with the service provider– or with YOUR network? Cloud adoption requires a re-assessment of monitoring processes and tools
  • One of the most effective ways to monitor performance of cloud-delivered services is by watching the endpoint. Yet EUE solutions are at the low end of the spectrum in terms of actual product investments. The bottom four technologies shown here are, in general, those most relevant to managing applications and business services, and to monitoring cloud and hybrid applications.
  • Description of EUE product types and their benefits
  • EUE AKA APM, RUM each type of monitoring product contributes a slightly different vantage point.Network products provide detailed information about application performance as the network sees it. Synthetic transaction monitoring tools rely on script execution, advantage is they deliver transaction info regardless of whether users are actually on the system. Observed transaction management solutions deliver insight from the viewpoint of protocols such as web traffic. Transactional reconstruction assesses application performance from the data center perspective, may or may not integrate with client-side instrumentation.Client-side EUE delivers direct visibility to the experience of the user. Done by installing agents or via browser instrumentation. agent-based approach for internal users, instrumentation useful for both internal and external users.
  • Advantages of agentlessMonitoring for high-value customer usersOne of most effective ways to monitor cloud and mobile, as does not require installation at end pointCompatible with VMs, EC2
  • The point is that in this Complex, Heterogenous technology architecture, the key thing to monitor is the Transactions of all types that flow through these systems.
  • Don’t just rely on the provider. Track individual users.
  • What Is A Transaction?Request issued by an end-userGoes through multiple componentsEach component may be activated multiple timesNote that:Different transaction types take different paths and flowsSometimes instances of the same transaction type execute across different flows
  • Average Response Times are not enough.Monitoring the Components (silo’ed approach) vs. Monitoring the Transaction Flow (SharePath approach)When the database chokes, it is relatively easy to identify as the root cause. However, it becomes more difficult to identify root cause:When the application chokes and then comes back to life, orWhen the performance of a small portion of requests degradesDue to:Response times are all averagedLooking at one specific Tx instance does not imply on the othersThe problem may be in a non-JVM component (Apache =&gt; LDAP)JVM? LDAP? Apache? Shared/Web-Service? MF? External? Database? The other Database? Tibco? SiteMinder? Badly configured load-balancer? Network?Finger-pointing results in wasting valuable time
  • Summarize presentation
  • Turn over to Oren
  • EMA - Measuring the User Experience in the Cloud

    1. 1. Measuring User Experience in the Cloud: Which Tactics are Worth the Time?<br />Julie Craig<br />Research Director, Applications<br />Enterprise Management Associates <br />5777 Central Avenue, Suite 105<br />Boulder, CO 80301<br />www.enterprisemanagement.com<br />
    2. 2. Agenda<br />Cloud Snapshot<br />Cloud Characteristics Create New Management Challenges<br />End User Experience Monitoring (EUE) and the Cloud<br />Summary and Closing<br />Slide 2<br />
    3. 3. CapEx Reductions, Fast Deployment, OpEx Reductions are Top Three Reasons for Cloud Adoption<br />Which needs are effectively being addressed by cloud computing solutions for your organization? <br />3<br />
    4. 4. SaaS Leads Public Cloud Deployments<br />What cloud computing service model(s) has your organization deployed, or is planning to deploy? <br />4<br />
    5. 5. Private Cloud Leads Public Cloud<br />What cloud computing deployment model(s) has your organization deployed, or is planning to deploy? <br />5<br />
    6. 6. Agenda<br />Cloud Snapshot<br />Cloud Characteristics Create New Management Challenges<br />End User Experience Monitoring (EUE) and the Cloud<br />Summary and Closing<br />Slide 6<br />
    7. 7. Measuring Success<br />Which does your organization measure in order to quantify the success of cloud-related initiatives? <br />7<br />
    8. 8. 8<br />Ranked Importance of Current Monitoring/ Management Tools<br />Please rate the importance of the following management technologies.<br />
    9. 9. End User Experience Management Under-represented <br />Which technologies does your org currently have deployed/full commitment to deploy in your environment?<br />9<br />
    10. 10. Agenda<br />Cloud Snapshot<br />Cloud Characteristics Create New Management Challenges<br />End User Experience Monitoring (EUE) and the Cloud<br />Summary and Closing<br />Slide 10<br />
    11. 11. “End user Experience”:Catch All Term for Multiple Types of Products<br />Network tracing or capture<br />Deep visibility into network flows and packets<br />Active or synthetic transaction monitoring<br />Script-based tests that run against an application at regular intervals.<br />Passive or observed transaction monitoring<br />“Hard” or “soft” appliances scan protocol-based traffic such as web interactions<br />End to end transaction reconstruction<br />Consolidate metrics from across the data center to deliver a reconciled end to end view of transaction execution<br />Client-side EUE<br /> Monitor performance and availability from the perspective of the user workstation<br />Slide 11<br />
    12. 12. Agentless, Client-Side EUE<br />Deep endpoint monitoring for both “internal” and “external” users <br />Instrumentation at the endpoint via the browser<br />“Watch” activity entering, exiting, and on the workstation or device<br />Diagnose application-related issues, identify delay sources<br />Instrumentation for the Cloud<br />Monitoring can be embedded in VMs<br />“Cloud Edition” can be installed in Amazon EC2 instances<br />Central repository and collector monitors EC2 environments<br />Instrumentation for Mobile<br />Slide 12<br />
    13. 13. Correlsense CEO, Oren Elias<br />Slide 13<br />End-User-Monitoring.com<br />
    14. 14. The Big Question: How do we Manage Today’s Ever Changing Environments?<br />Slide 14<br />Public<br />Private<br />SOA<br />Virtualization<br />Lots of Moving Parts<br />Agile<br />End-User-Monitoring.com<br />
    15. 15. With all of the Complexity and Moving Parts…<br />What Does Not Change?<br />Public<br />Private<br />SOA<br />Virtualization<br />Slide 15<br />Agile<br />End-User-Monitoring.com<br />
    16. 16. The Two Axioms<br />Slide 16<br />Transactions Drive the Business <br />User’s Expectation of Performance<br />End-User-Monitoring.com<br />
    17. 17. SERVER<br />WEB<br />APP SVR<br />Elastic<br />LB<br />MQ/ESB<br />CORBA<br />LDAP<br />DCOM<br />Web<br />Services<br />Public, Private, Hybrid Datacenter<br />‘Under The Hood’<br />End-User-Monitoring.com<br />
    18. 18. Cloud ≠ ‘Cure All’<br />Slide 18<br />End-User-Monitoring.com<br />
    19. 19. Four New Challenges in the Cloud“Old world” monitoring paradigms no longer fit<br />Slide 19<br />End-User-Monitoring.com<br />
    20. 20. Challenge #1 – Dynamic Environments<br />Highly dynamic environment<br />Out: Auto-discovery<br />In: Auto-detection<br />Slide 20<br />End-User-Monitoring.com<br />
    21. 21. Challenge #2 - Highly Virtualized Infrastructure<br />Infrastructure is highly virtualized<br />Out: Focus solely on Infrastructure and resource monitoring<br />In: Focus on end-user and applications<br />Slide 21<br />End-User-Monitoring.com<br />
    22. 22. More Demanding Applications<br />Customer facing applications are more demanding<br />Out: Focus solely on Availability<br />In: Focus on performance and service levels<br />Slide 22<br />End-User-Monitoring.com<br />
    23. 23. Multi-Tenant Environment<br />Shared environment<br />Out: Hardware appliances<br />In: Software-based solutions<br />Slide 23<br />End-User-Monitoring.com<br />
    24. 24. Top 3 Tips For Cloud Application Management<br />
    25. 25. 1) Be ParanoidWatch Every Transaction from Every User<br />SERVER<br />WEB<br />APP SVR<br />PROXY<br />MQ/ESB<br />CORBA<br />LDAP<br />DCOM<br />Web<br />Services<br />Datacenter<br />End-User-Monitoring.com<br />
    26. 26. Get the Key User-Experience Metrics<br />Total End-User Response Time<br />Browser Rendering Time<br />Datacenter Time<br />Network Latency<br />Real User Monitoring<br />Rendering<br />
    27. 27. Look Across Space<br />
    28. 28. Houston, We Have A Problem<br />
    29. 29. 2) Be Smart.From Transactions to Performance Models<br />End-User Response Time Breakdown<br />Transactions Modeled with Transaction Profile<br />
    30. 30. Compare Between Application Models<br />Within SLA vs. Exceeded SLA<br />Before vs. After<br />End-User-Monitoring.com<br />Slide 30<br />
    31. 31. Insurance in Your Changing WorldAgile Roll-Outs, Virtual Migrations, Private Cloud Migrations<br />Compare “new” and “old” production behavior<br />Prove response times are better or improved<br />Realize causes of degradations to avoid rollback<br />End-User-Monitoring.com<br />
    32. 32. 3) AutomateEnforce SLAs on End-User Experience<br />
    33. 33. Application End-User SLAS<br />
    34. 34. Alert and Automate<br />Slide 34<br />End-User-Monitoring.com<br />
    35. 35. Get Started with SharePath RUM Express for Free<br />http://www.real-user-monitoring.com<br />End-User-Monitoring.com<br />
    36. 36. Agenda<br />Cloud Snapshot<br />Cloud Characteristics Create New Management Challenges<br />End User Experience Monitoring (EUE) and the Cloud<br />Summary and Closing<br />Slide 36<br />
    37. 37. Summary<br /><ul><li>Cloud computing is a “hot topic” with a variety of potential benefits</li></ul> Cloud also brings its own set of challenges <br />How do you measure success of Cloud adoption?<br />How do you monitor performance and availability?<br />How do you get visibility to End User performance?<br />Which types of EUE tools are most useful for Cloud monitoring?<br />Each type of product has its strengths<br />Stretch your tools budget by making sure to match tools acquisitions with desired monitoring metrics<br />Slide 37<br />
    38. 38. For more information on Enterprise Management Associates, please go to www.enterprisemanagement.com, or call +1 303-543-9500<br />Thank you for attendingtoday’s presentation<br />

    ×