SAP applications are business-critical for your core operations. They must be continuously tested to avoid outages and slowdowns due to new application upgrades, service packs, customizations, and enhancement packages.

1. Neotys © . All Rights Reserved.
Achieve Performance Testing Excellence for Your SAP Apps

2. Neotys © . All Rights Reserved.
Stephan Kehren
Performance Engineer - Neotys

3. Neotys © . All Rights Reserved.
Isit ReallyNecessary?
• SAP is known as standard software!
• So it can be expected that it is
• bug free
• fast
• and ready for production?
No!

4. Neotys © . All Rights Reserved.
Reality
Every SAP implementation is customized
Hardware sizing is complex and may not be accurate for production
Transactions are re-programmed to each unique implementation
Complicated, time consuming migrations and new release deployment

5. Neotys © . All Rights Reserved.
SAPApplicationsCan’tFailinProduction
• Business Critical Applications
• Are expected to perform regardless of load
• Impact the reliability of other business critical applications in production
• Business Backbone
• Business operations depend on SAP
• Organization Impact
• Employee time is wasted
• Employee satisfaction is affected
• Customer service is delayed
• User + Customer experience Impacts Revenue
• SAP application performance has a direct impact on revenue

6. Neotys © . All Rights Reserved.
PerformanceTestingUseCase
Deployment of a
new application
Migration to SAP
HANA
Change of
components
Upgrade to a new
version
Migration to the
cloud
Validate reliability
before EoY
financial reporting
Custom
Development
Deployment, customization Upgrades, Migrations
M&A, divestitures, system
consolidation, adding/removing
countries/locales from the system

7. Neotys © . All Rights Reserved.
PerformanceTestingAnswersThese Questions
• Reliability/stability/endurance (Load tests, soak tests)
• Can my SAP application sustain the expected load
• Any memory leak
• Velocity (Performance tests)
• Is the SAP application operating as fast as it should under realistic load conditions
• How long does it take to submit a sales order and is it acceptable
• Scalability (Stress Tests)
• How well can my SAP application perform on it’s current infrastructure
• Capacity
• What is the optimum infrastructure required to operate my SAP application
• Will my infrastructure be able to handle the load in 6 months

8. Neotys © . All Rights Reserved.
PerformanceTestingProcess
Test
Strategy
Test
Design
Test
Runtime
Test
Analysis
• Define scope
• Define SLAs
• Define data
• Create test
scripts
• Variabilization
• Define load
profile
• Set test schedule
• Spin up test
infrastructure
• Monitor app under
load
• Compare results
against SLAs
• Identify bottlenecks

9. Neotys © . All Rights Reserved.
PerformanceTestingProcess
• What should be tested
• Identify the components are heavily used or critical for the tests
• Defining the performance KPIs
• Use APM to measure application performance in production
• Collaborate with business teams to define SLAs
• SAP test data availability is a challenge
• Use copy of production data and anonymize it => security challenge
• Use tools to create artificial data
Test
Strategy
Test
Design
Test
Runtime
Test
Analysis

10. Neotys © . All Rights Reserved.
PerformanceTestingProcess
• Create realistic test scripts
• Create scenarios for human users
• Create scenarios for batch processes
• Variabilization is key and complex on SAP
• Simulate mobile users
• Re-use and convert functional test scripts to speed up test design
Test
Strategy
Test
Design
Test
Runtime
Test
Analysis

11. Neotys © . All Rights Reserved.
PerformanceTestingProcess
• Make sure your testing infrastructure is available
• Make sure your load infrastructure can scale
• SAP load tests are very resource intensive, generating 100’s or
1000’s of virtual users is a technical challenge
Test
Strategy
Test
Design
Test
Runtime
Test
Analysis

12. Neotys © . All Rights Reserved.
PerformanceTestingProcess
• Use SAP sys admins to retrieve data
• Use SAP tools to get KPIs: NetWeaver monitor, SDF/Mon
• NeoLoad provides its own monitoring capability
• Use APM tools to monitor the application behavior
• Involve business teams in test analysis
Test
Strategy
Test
Design
Test
Runtime
Test
Analysis

13. Neotys © . All Rights Reserved.
AnIterative Process
Test
Runtime
Test
Analysis
Test
Update
It is key to leverage a tool that
enables you to fine tune your test
rapidly
Test
Design
Test Design Fine
Tuning

14. Neotys © . All Rights Reserved.
Fromcomponentto end-to-end applicationtesting
SD
FI
MM
Component Test
SD – Sales Process
MM - Material Management
FI - Finance
End-to-end Test

15. Neotys © . All Rights Reserved.
Testing aSystemofApplications
User Interface Web, NetWeaver, FIORI, SAP GUI
Application 200 Applications
ERP (R3, S4), CRM, Hybris, SuccessFactors, Ariba,
Concur, Fieldglass
Platform SAP NetWeaver, SAP Cloud Platform
Technology Oracle, HANA
In order to be effective you need a tool that enables your organization to test
all your SAP applications
Same tool to test performance of old version vs new migrated version
One business transaction can involve several applications

16. Neotys © . All Rights Reserved.
TestDifferent Threads andThe EntireInfrastructure
Global Test
Infrastructure
Time Zone
Financial Rules

17. Neotys © . All Rights Reserved.
TopChallenges
• Test data availability => Variables
• Use case description accuracy => Accurate scripting
• Test infrastructure size => Scale load
• SAP Basis team interaction => Collaboration
• Capacity management => Resource reservation
• Time and complexity to test with traditional tools => Tool effectiveness

18. Neotys © . All Rights Reserved.
NeoLoadSAPTesting
• Test any SAP application
• ERP, SuccessFactors
• Web, Mobile, SAP GUI
• Test non-SAP applications
• Script design productivity - design faster –
maintain faster
• Repurpose functional test assets
• Simulate the most realistic scenarios
• Scale up to 1000’s of virtual users / optimize TCO
• Monitor within NeoLoad
• Convert Script from legacy tools
GUI
WEB

19. Neotys © . All Rights Reserved.
NeoLoad
recorder
NeoLoad LR
Converter
Functional
Worksoft
Tosca
NeoLoad
Controler
LG
LG
LG
ECC
Concur
…

20. Neotys © . All Rights Reserved.

21. Neotys © . All Rights Reserved.
Next Steps
Contact Stephan Kehren: stephan.kehren@neotys.com
Visit Neotys Community at answers.neotys.com
Download NeoLoad Free Edition with SAP GUI protocol included
from www.neotys.com
Questions?
Visit our website neotys.com/solutions/sap-performance-testing

22. Neotys © . All Rights Reserved.
Continuous Performance Testing Platform
Thank You
https://www.neotys.com/download