• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
SAP Best Practices for Performance Testing
 

SAP Best Practices for Performance Testing

on

  • 6,710 views

How SAP uses HP LoadRunner and HP QuickTime Professional for performance measurements

How SAP uses HP LoadRunner and HP QuickTime Professional for performance measurements

Statistics

Views

Total Views
6,710
Views on SlideShare
6,710
Embed Views
0

Actions

Likes
1
Downloads
165
Comments
1

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel

11 of 1 previous next

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    SAP Best Practices for Performance Testing SAP Best Practices for Performance Testing Presentation Transcript

    • Session ID: BTOT-TU-1700/6
      Twitter hashtag #HPSWU
    • Speaker Name: Martin Moser, PhD
      Date: 30.11.2010
      Session ID: BTOT-TU-1700/6
      SAP ® Best Practices for Performance Testing
      How SAP ® uses HP LoadRunner ® and HP QuickTime Professional ® for performance measurements
    • 3
      HP Confidential
      Software Performance & Speed Bumps
    • 4
      HP Confidential
      Software Performance & Speed Bumps
      Expectation and observation regarding response time
      Response time
      Months/Release
    • Removing the Speed Bumps
      How Agile Methods Help
    • 4 week sprint run without (management) interference
      Sprints must deliver software that satisfy quality requirements
      6
      HP Confidential
      Agile development @ SAP
      Cross-Functional Team
      Daily Scrum Meeting and Artifacts Update
      4 week sprint
      Sprint Backlog of Tasks
      Product
      Owner
      Potentially shippable product increment
    • SAP Best Practices
      Measurement Methodology and Process
    • 8
      HP Confidential
      SAP Performance Map
      Full picture of system performance
      • KPIs for all potential bottlenecks
      • Software architecture dependant
      • Measured in two-stage process
      Full performance map includes front-end
      Server-only performance map excludes front-end
      ABAP
      server
      Java server
      Java DB
      ABAP DB
    • 9
      HP Confidential
      SAP Performance Test Process
      Analysis
      Reportgeneration
      Test execution
      System restart
      LoadRunner
      script recording
      System check
      Test execution
      System restart
      Tool config
      Reporting
      System check
      Stage 2
      Stage 1
      SAP performance test process
      Stage 2: Multi-user tests
      • Measure server-only performance map of a scenario
      • Average resource consumption of the scenario
      • For multiple users accessing the server in parallel
      • Focus on scalability and stability of the system
       Detect ~20% of all performance issues (mostly difficult issues)
      Stage 1: Single-user tests
      • Measure full performance map of a scenario
      • Resource consumption per dialog step
      • For one single user using the server exclusively
      • Focus on end-to-end response time
       Detect ~80% of all performance issues (mostly simple issues)
    • 10
      HP Confidential
      Stage 1: Single-Users Tests
      The SUPA tool
      • Generic UI
      • Plug-in based server
      • Plug-ins collect full performance map:
      • End-to-end response time
      • Garbage collection data
      • CPU consumption
      • Network traffic
      • DB load
      UI
      Server
      E-t-E
      ABAP
      server
      Java server
      GC
      CPU
      Java DB
      ABAP DB
      ...
    • 11
      HP Confidential
      Single-Users Tests: Follow-up
      The SAP Performance Standard defines KPIs that are a prerequisite for good performance
      Violations of the KPIs are identified using the SUPA tool
      Specific tools are available to investigate the root-cause of KPI violations, among others:
      • SAP Java Virtual Machine Profiler
      • Memory Analyzer Tool (Open source tool sponsored by SAP)
      • ABAP transactions such as ST05, STAD, ST02
      The findings are reported back to development for fixing
    • 12
      HP Confidential
      Stage 2: Multi-User Tests
      HP LoadRunner used to check
      • Server response time for fixed number of users
      • Linear scaling of throughput with number of users
      • Stability over longer periods of time
      Follow-up as for single-user tests.
      ABAP
      server
      Java server
      Java DB
      ABAP DB
    • 13
      HP Confidential
      HP LoadRunner strengths and weaknesses
      Strengths:
      • High load generation with off-the-shelf hardware
      • Supports most well-known technologies, among others: HTTP, Flash, Silverlight, SOAP, TCP/IP
      • Scriptable in various languages, such as: C, Java, Visual Basic
      • Extendable monitoring
      Weaknesses:
      • Correlation is complex (see TruClient below)
      • No monitoring for: Java garbage collection, CPU break-down & HTTP message lengths
    • 14
      HP Confidential
      SAP internal extensions to HP LoadRunner
      Scripted extensions:
      • Java garbage collection
      • CPU break-down
      • HTTP Request and response lengths
      Controller
      Monitors
      ABAP
      server
      Java server
      LR
      Script
      SAP monitoringroutines
      Java DB
      ABAP DB
    • 15
      HP Confidential
      SAP Performance Test Process Automation
      Analysis
      Reportgeneration
      Test execution
      System restart
      LoadRunner
      script recording
      System check
      Test execution
      System restart
      Tool config
      Reporting
      System check
      ARIES suite (full automation)
      NetWeaver
      TestSuite
      NetWeaver
      TestSuite
      HP QTP
      HP QTP
      LoadRunner Analysis
      SUPA
      LoadRunner Controller
      LoadRunner VUGen
      Stage 2
      Stage 1
      SAP Performance Test Process
      Semi-automated
      Semi-automated
      NetWeaver
    • Getting Even Better
      Budgets and Price Tags
    • 17
      HP Confidential
      The Way Forward to Predicting Performance
      Typical waterfall model
      • Design the UI
      • Design the architecture
      • Build the system
      • Measure the performance
      Long and expensive feedback cycle.
    • 18
      HP Confidential
      The Way Forward to Predicting Performance
      Budget and price tags
      • Define resource budget for dialog steps
      • Measure resource consumption of
      • Major UI elements
      • Major backend operations
      • Attach price tags to them
      UI designers and architects can estimate performance of designs
    • 19
      HP Confidential
      LoadRunner TruClient: First experiences @ SAP
      Strengths:
      • Runs fully embedded in the browser
      • No correlation required
      Weaknesses:
      • Significantly higher hardware requirements
      • Instrumentation extension possible, but cumbersome
    • Continue the conversation with your peers at the HP Software Community hp.com/go/swcommunity