Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Forms and Web Application management- tipsand tricksNadu Bharadwaj, Principal Product ManagerDan Brint, SUNY ITEC
Agenda•    Why should we monitor end users?•    Oracle’s Application Performance Management Solutions•    Oracle’s End Use...
Analysts Agree: User Experience is critical     Consistent end-to-end application and service                             ...
Poor Performance = Less RevenueTypical Result is 10% Revenue Loss                                     Joint study between ...
Application Performance Management(1) Source: Gartner 2006
Comprehensive End User Monitoring                                                     •  User Experience is               ...
User Experience Management Approaches   UserCommunities                                      Web Servers      Application ...
Active Monitoring8
SLM: Best Approach •  Model      •    Focus on end-user perspective      •    Map business service to IT resources      • ...
Grid Control: Systems and Services                 Services                                 Services                      ...
Modeling Services•    A Service is an entity that exposes     a useful function to its end-users:       •  Generic       •...
Service Level Monitoring        Availability   Performance         Usage          Business
Service Availability (Test-based)                        Manufacturing      Online Store         Forms                    ...
Service Availability (Test-based)Modeling User Communities Using Beacons      Service            Availability may vary fro...
Service Availability - Beacons•  Installed with Management Agent•  Easily configured through GC console•  Placed in each u...
Rich Coverage for Service Test Protocols                    Any serviceRepresentative       protocol    Client            ...
Service Level Compliance•  Service Level parameters specification:    •  Business Days, Hours    •  Availability Criteria ...
Service Level Management for Web Applications•  Inherits all the monitoring features of a Service:  •  Availability, Perfo...
Service Level Management for Forms  Applications•  Forms Service Test / Transaction Monitoring  •  Available from EM 10gR3...
• Services - Diagnosing Root Cause         • Root Cause Analysis      • Root Cause Analysis
Passive Monitoring21
Why Moniforce?                 •  Moniforce the EMEA leader                   •  Relatively new market with               ...
Architecture: Network Protocol Analysis (NPA)       Collected data:                           Page                        ...
UXInsight Product OverviewOptimizing end-user experience through real end-user monitoring                            Busin...
Oracle UXInsight Key Buyers and Value Propositions Improve                 Optimize           Proactive Business          ...
What Does UXInsight Do For: Line of BusinessSatisfaction Reports   Business Transaction Funnel                            ...
What Does UXInsight Do For:Application Owners and Application SupportDashboards& SLMBusiness Service Monitoring     User E...
What Does UXInsight Do For:IT Operations                KPI configuration,                monitoring, &                ale...
Deployment Configurations     Recommended configuration is Server = 2 CPUs and     Standalone Collector = 1 CPUStandard   ...
Example use caseLeading navigational system provider         The web services provide a           •  corporate website,   ...
Christmas 2007, user experience suffersOverall pageview                      Overall performance was affectedperformance  ...
Sales is affectedAffected sales shown in salestransaction funnels                                                         ...
Overview Affected usersUXinsight drill-down feature shows list of affected users on 25th after 15:00hrs
SUNY Case Study34
Whoami?•  Dan Brint (dan@itec.suny.edu)•  ITEC – a department of SUNY (State University of   New York)•  SUNY – depending ...
Agenda•  What we do•  Our business topology•  Our technology infrastructure•  EM Adoption•  Adding Beacons to the mix•  Ou...
37
Our SCT Banner Customers38
What we do?•  Amongst other things …•  Manage over 140 Oracle Databases•  Over 50 Oracle Application Servers•  Some of thi...
•  Serving up: SunGard   Banner, ODS, EDW,   Luminis•  Exlibris Aleph 500•    We also manage SQL   Server databases in   s...
Our technology stack41
Enterprise Manager Grid Control42
Visibility•  Even with all the targets   we are monitoring we still   have areas we can t see        Agents       Database...
Cannot see the forest for the trees.              Application 44
Application Performance Management
Beacons•  Replay synthetic   transactions initiated from   (typically) remote locations•  HTTP, FTP, DNS, Oracle   Forms, ...
Creating the Synthetic Transaction- Overview         System               Service    Web AppService Test           Metrics...
Building the Transaction (Forms App)Create a ‘System’            Create a             Create Forms•  A collection of targe...
Building the Transaction (Forms App)                             Define Availability      Based on a SYSTEM               ...
Metrics available : Part 1Availability (status)      Service Test            SystemSpecify KEY                Specify KEY ...
Metrics available : Part 2                             Performance                                             Service Tes...
Metrics available : Part 3                                              Usage                                           Sy...
Metrics available for FORMS apps?                                                    Time                             Stat...
Creating the Service pt1 54
Pt 2 55
56
57
58
Pt x – record the forms transaction. 59
60
61
62
63
64
65
66
67
68
69
70
71
The forms app perf page …72
73
7 Customers & 2 beacon hosts74
Step 1: Nassau75
Step 2: Nassau and Niagara76
Step 3: Nassau, Niagara and Jefferson 77
Beacon grid•  Beacons at every customer•  Monitoring every application from every beacon•  7 customers + 2 beacon hosts  •...
End Game•  A dashboard that is useful and usable without too   much information clutter•  We must:  •  Choose tests to dis...
If only …•  We had a customer with very poor Oracle Forms   performance immediately prior to Go Live.•  We suspected the n...
also•  We could have seen the problem before they reported   it•  We could have demonstrated that it works fine from   A, ...
Conclusions•  Even MORE data available•  Have not yet explored forms transaction monitoring•  Use dashboards to tame the v...
Questions
Upcoming SlideShare
Loading in …5
×

Forms and web application management tips and tricks v1

3,502 views

Published on

Presentation I gave with Nadu Bharadwaj from Oracle at Oracle Open World 2008 on Fusion MiddleWare Application monitoring with Enterprise Manager and the Service Management Pack.

Published in: Technology, Design
  • Be the first to comment

  • Be the first to like this

Forms and web application management tips and tricks v1

  1. 1. Forms and Web Application management- tipsand tricksNadu Bharadwaj, Principal Product ManagerDan Brint, SUNY ITEC
  2. 2. Agenda•  Why should we monitor end users?•  Oracle’s Application Performance Management Solutions•  Oracle’s End User Monitoring Solutions•  Active Monitoring•  Passive Monitoring•  SUNY Case Study•  Q&A 2
  3. 3. Analysts Agree: User Experience is critical Consistent end-to-end application and service 87% performance guarantees Unplanned infrastructure changes resulting in 73% incidents and downtime Unanticipated infrastructure effects from 49% consolidation & new application projects Misconfiguration of network objects 28%Source: Forrester Research, Top Five Challenges For Enterprise IT Infrastructure Managers — And How To Resolve Them, Thomas Mendel, March 2005
  4. 4. Poor Performance = Less RevenueTypical Result is 10% Revenue Loss Joint study between Gartner Research and Response Tek
  5. 5. Application Performance Management(1) Source: Gartner 2006
  6. 6. Comprehensive End User Monitoring •  User Experience is Packaged Applications ultimate measure ofEnd-User Management application (Siebel, E-Business Suite, PeopleSoft) performanceNetwork Composite App Management •  Comprehensive end user monitoring enables you to be Application PerformanceWeb Tier Management proactive, and measure business Real End- Proactive User performanceApp/Mid User Experience Tiers Monitoring Monitoring •  Integrates with Diagnostics (Middleware & DB) diagnostics for DB & complete ApplicationStorage Performance Management 6
  7. 7. User Experience Management Approaches UserCommunities Web Servers Application Databases Servers Internet Cloud HostsService Test Monitoring Real End User Monitoring•  Proactively monitor end user experience •  Monitor ALL real end user transactions•  Baseline performance & trend over time •  No instrumentation, No maintenance
  8. 8. Active Monitoring8
  9. 9. SLM: Best Approach •  Model •  Focus on end-user perspective •  Map business service to IT resources •  End-to-end relationships of service from end-user and system perspectives •  Monitor •  Instrument service availability, performance, usage, business metrics •  Service level compliance •  Diagnose •  Enable administrators to quickly pinpoint cause of service problems •  Report •  Centralized reporting and viewing •  Business and administrative level reporting •  Out-of-box and customized reporting
  10. 10. Grid Control: Systems and Services Services Services •  Provide business function for end-users •  Business processes or Applications System •  Data center infrastructureSystem •  Hosts, Databases, Application servers, etc.
  11. 11. Modeling Services•  A Service is an entity that exposes a useful function to its end-users: •  Generic •  Web Application •  OCS Application •  Forms Application (EM 10.2.0.3) •  Aggregate Examples: Email Online Trading
  12. 12. Service Level Monitoring Availability Performance Usage Business
  13. 13. Service Availability (Test-based) Manufacturing Online Store Forms Application Internal Email Application Order Parts Access Mail Purchase Items Can users complete these critical business functions successfully from key representative user communities?13
  14. 14. Service Availability (Test-based)Modeling User Communities Using Beacons Service Availability may vary from location to location
  15. 15. Service Availability - Beacons•  Installed with Management Agent•  Easily configured through GC console•  Placed in each user community or representative geographical location•  Plays back service tests (and recorded web / forms transactions)•  Supports various protocol tests
  16. 16. Rich Coverage for Service Test Protocols Any serviceRepresentative protocol Client DNS, FTP, HTTP NY (s), Ping, ICMP Ping, IMAP, JDBC Related System Components Tokyo SQL Timing, LDAP, NNTP, Oracle SQL Paris Timing, POP, Port Checker (includes SSL), SF SMTP, SOAP, TNS Ping, Berlin Web Transaction, Forms Transaction Rio Monitor more services (10.2.0.3) by incorporating tests Custom Script for nearly any application protocol
  17. 17. Service Level Compliance•  Service Level parameters specification: •  Business Days, Hours •  Availability Criteria •  Performance Criteria•  Calculation of Service Level over a time-period as: •  % of time during business hours Service meets the availability and performance criteria•  Comparison of achieved Service Levels to requirements in your SLA
  18. 18. Service Level Management for Web Applications•  Inherits all the monitoring features of a Service: •  Availability, Performance, Usage, Business Metrics, SLA Compliance•  Web Application service monitoring features: •  Web Transaction: http/s Web application service test for monitoring availability and performance •  Transaction Recorder automatically records web transactions for service test monitoring and are played back using beacons •  Test Performance identifies bottlenecks within the network, server, connect time, or content of transactions and pages
  19. 19. Service Level Management for Forms Applications•  Forms Service Test / Transaction Monitoring •  Available from EM 10gR3 •  Supported for Forms versions 9.0.4, 10.1.2, 6i •  Monitors transaction metrics: •  Forms total transaction time •  Login time •  Avg time per message •  Network latency •  Slowest message block time •  Database time •  Monitors Forms Application availability, performance, usage, service level compliance •  Monitors key Forms transaction- runform, callform, commit etc
  20. 20. • Services - Diagnosing Root Cause • Root Cause Analysis • Root Cause Analysis
  21. 21. Passive Monitoring21
  22. 22. Why Moniforce? •  Moniforce the EMEA leader •  Relatively new market with regional leaders – no worldwide de facto leader •  100+ customers across several industries •  Strong presence in financial services, telecommunications, e-commerce, and government •  Strong Product •  Only offering that combines both performance management and business analytics in a single solution •  Mature product, tested and customized in large deployments with demanding financial services customers
  23. 23. Architecture: Network Protocol Analysis (NPA) Collected data: Page request• Client-ip, Server-ip, Gateway-ip Network Response Time• Requested URL (Page,Object)• Cookie/Session-id Internet• Referrer• GET & POST requests• User agents (phone type) Firewall Sniffing Switch Server Response Time • Response? • Server error, web site Web Web Web error, Hit OK server server server • Content of page (i.e order details, functional errors) • Delivered? • Aborted? DB DB • Network timeout?
  24. 24. UXInsight Product OverviewOptimizing end-user experience through real end-user monitoring Business Reporting KPI Monitoring Data Export UXinsight key highlights: -  Replay of poor performance -  Executive dashboardsTransaction Performance Executive dashboard -  Extensive KPI and SLA monitoring -  Full alerting capabilities -  Quick bottle-neck analyses -  Transaction performance analyses -  Customized reporting -  Trend analyses -  Full data integration via XML
  25. 25. Oracle UXInsight Key Buyers and Value Propositions Improve Optimize Proactive Business Application And Monitoring AndPerformance User Experience DiagnosticsLine of Business Apps Manager /(LOB) Executive Apps Support IT Operations
  26. 26. What Does UXInsight Do For: Line of BusinessSatisfaction Reports Business Transaction Funnel Usage Reports: •  Data Browser •  Sales by Country/ State
  27. 27. What Does UXInsight Do For:Application Owners and Application SupportDashboards& SLMBusiness Service Monitoring User Experience Tracking,(e.g. Order Entry, Buy Stock) Page Replay
  28. 28. What Does UXInsight Do For:IT Operations KPI configuration, monitoring, & alerting Server, network, & object performance diagnostics Data Export Error reports & analysis
  29. 29. Deployment Configurations Recommended configuration is Server = 2 CPUs and Standalone Collector = 1 CPUStandard Maximum security Distributed Configuration (load balanced orConfiguration Configuration high volume applications) Collector Collector Collector Collector Collector Server Server Server
  30. 30. Example use caseLeading navigational system provider The web services provide a •  corporate website, •  shopping section and •  provision automatic software updates/upgrades
  31. 31. Christmas 2007, user experience suffersOverall pageview Overall performance was affectedperformance from after about 16:00, resulting in- Green = Satisfied a drop of total pageviews and- Orange = Tolerating frustrating long page load times- Blue = Frustrated Root cause: Updates and latest manuals sections Root cause: Overall Updates and Latest sections Page load time (blue) 4.5 – 37.1 sec Client aborts (orange) 2.6 – 28.4%
  32. 32. Sales is affectedAffected sales shown in salestransaction funnels 24th of December 955 transactions completed successfully 25th of December Only 689 transactions completed successfully Decline of 27% in sales!
  33. 33. Overview Affected usersUXinsight drill-down feature shows list of affected users on 25th after 15:00hrs
  34. 34. SUNY Case Study34
  35. 35. Whoami?•  Dan Brint (dan@itec.suny.edu)•  ITEC – a department of SUNY (State University of New York)•  SUNY – depending on your math is the largest Higher ED institute in the US 35
  36. 36. Agenda•  What we do•  Our business topology•  Our technology infrastructure•  EM Adoption•  Adding Beacons to the mix•  Our current status•  Immediate plans (3 months) 36
  37. 37. 37
  38. 38. Our SCT Banner Customers38
  39. 39. What we do?•  Amongst other things …•  Manage over 140 Oracle Databases•  Over 50 Oracle Application Servers•  Some of this is managed remotely at the campus (by ITEC) but most of it is hosted and managed by ITEC 39
  40. 40. •  Serving up: SunGard Banner, ODS, EDW, Luminis•  Exlibris Aleph 500•  We also manage SQL Server databases in support of Angel (Distance Learning) 40
  41. 41. Our technology stack41
  42. 42. Enterprise Manager Grid Control42
  43. 43. Visibility•  Even with all the targets we are monitoring we still have areas we can t see Agents Databases Systems very well •  Networks (internal and Groups Hosts Listeners external) •  Storage Oracle App & Reports MS SQL HTTP •  Etc… Servers Server Servers OMS and MS IIS OC4J OMR 43
  44. 44. Cannot see the forest for the trees. Application 44
  45. 45. Application Performance Management
  46. 46. Beacons•  Replay synthetic transactions initiated from (typically) remote locations•  HTTP, FTP, DNS, Oracle Forms, SQL, …•  For our Banner Customers we are interested (for now) in just Forms and Web applications 46
  47. 47. Creating the Synthetic Transaction- Overview System Service Web AppService Test Metrics•  Click click click •  Availability Dashboard •  Performance (Optional) •  Usage 47
  48. 48. Building the Transaction (Forms App)Create a ‘System’ Create a Create Forms•  A collection of targets ‘Service’ (choose Application Type) (wizard) •  Collab Suite •  Name •  Identity Mgmt •  Time zone •  Generic •  System •  Web •  Key Components … •  Forms •  Aggregate 48
  49. 49. Building the Transaction (Forms App) Define Availability Based on a SYSTEM Based on a SERVICE Set Service Test Characteristics Name Time zone Collection Frequency Record the Forms TransactionMust use IE Click click click STOP Test Choose PERFORMANCE metric(s) Choose USAGE metric(s) 49
  50. 50. Metrics available : Part 1Availability (status) Service Test SystemSpecify KEY Specify KEY Specify KEYService Tests Beacons. Components. and … 50
  51. 51. Metrics available : Part 2 Performance Service Test System All metrics from all Which availablebeacon (or Which Metric & Individual or Aggregate? targets canbeacons) to be used : use? Individual or Aggregate Server Time LOTS and Avg Time / Slowest Network Database LOTS of Status Login Time Forms Time message Time Latency Time these 51
  52. 52. Metrics available : Part 3 Usage System All metrics from all available targets can be used : Individual or Aggregate Database Host App Server Active Space # Online Active HTTPConnections Allocated TPS … CPU Idle % CPUs … Cache Size Connections HTTP 400 …. 52
  53. 53. Metrics available for FORMS apps? Time Status Time •  Total •  Login •  Forms Network Latency •  Time per message •  Database •  Server •  Shortest Values from a single beacon or aggregates (sum, max, min, avg, …) from multiple beacons53
  54. 54. Creating the Service pt1 54
  55. 55. Pt 2 55
  56. 56. 56
  57. 57. 57
  58. 58. 58
  59. 59. Pt x – record the forms transaction. 59
  60. 60. 60
  61. 61. 61
  62. 62. 62
  63. 63. 63
  64. 64. 64
  65. 65. 65
  66. 66. 66
  67. 67. 67
  68. 68. 68
  69. 69. 69
  70. 70. 70
  71. 71. 71
  72. 72. The forms app perf page …72
  73. 73. 73
  74. 74. 7 Customers & 2 beacon hosts74
  75. 75. Step 1: Nassau75
  76. 76. Step 2: Nassau and Niagara76
  77. 77. Step 3: Nassau, Niagara and Jefferson 77
  78. 78. Beacon grid•  Beacons at every customer•  Monitoring every application from every beacon•  7 customers + 2 beacon hosts •  Systems Admin and CPD•  9*7 = 63 tests•  + 7 more from just outside ITEC 78
  79. 79. End Game•  A dashboard that is useful and usable without too much information clutter•  We must: •  Choose tests to display wisely (not all of them) •  Choose metrics that are meaningful to everyone (not too technical)•  What does it look like? •  ? 79
  80. 80. If only …•  We had a customer with very poor Oracle Forms performance immediately prior to Go Live.•  We suspected the network. either: •  ITEC •  Customer •  Some where in between•  Remote desktop to customer performed poorly •  Could not be sure if the problem was us to them or them to us•  We flew people to the customer to help triage.•  If we had of had our beacon grid we could have narrowed the scope down considerably. 80
  81. 81. also•  We could have seen the problem before they reported it•  We could have demonstrated that it works fine from A, B and C 81
  82. 82. Conclusions•  Even MORE data available•  Have not yet explored forms transaction monitoring•  Use dashboards to tame the volume•  Currently we re simply looking at end-to-end response time and that s invaluable to us 82
  83. 83. Questions

×