The document discusses SAP's test automation tool for SAP S/4HANA Cloud. It provides an overview of the tool's usage areas and benefits, including automating business process testing and test data management. Standard automated test scripts are delivered for SAP best practices processes. The tool supports UI and API-based automation and is integrated with SAP's ALM tools.

1. PUBLIC
Test Automation Tool For SAP S/4HANA Cloud
January 2023

2. 2
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
The information in this presentation is confidential and proprietary to SAP and may not be disclosed without
the permission of SAP. This presentation is not subject to your license agreement or any other service or
subscription agreement with SAP.
SAP has no obligation to pursue any course of business outlined in this document or any related presentation,
or to develop or release any functionality mentioned therein. This document, or any related presentation and
SAP’s strategy and possible future developments, products and or platforms directions and functionality are all
subject to change and may be changed by SAP at any time for any reason without notice. The information in
this document is not a commitment, promise or legal obligation to deliver any material, code, or functionality.
This document is provided without a warranty of any kind, either express or implied, including but not limited
to, the implied warranties of merchantability, fitness for a particular purpose, or noninfringement.
This document is for informational purposes and may not be incorporated into a contract. SAP assumes no
responsibility for errors or omissions in this document, except if such damages were caused by SAP’s willful
misconduct or gross negligence.
All forward-looking statements are subject to various risks and uncertainties that could cause actual results to
differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-
looking statements, which speak only as of their dates, and they should not be relied upon in making
purchasing decisions.
Legal Disclaimer

3. 3
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Test Automation Tool – Usage & Benefits

4. 4
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Usage Areas Of The Test Automation Tool
Discovery
Access
Onboard
and Deploy
Fit-to-Standard
Analysis
Continuous Innovation
Test Automation Tool is an integral part of SAP S/4HANA Cloud and can be used to automate business
process testing within SAP S/4HANA Cloud.
Business
Acceptance
Test (BAT)/User
Acceptance
Test (UAT)
Implementation
Test
Priority areas of test tool
3
2
1
Test cycles
1 3
Operate, Test,
Monitor, Support
Migrate, Integrate,
Extend, Test
Scope and
Configure
Regression Test
Execution of relevant test
cases after upgrade or
scope changes
Testing in Roadmap Viewer

5. 5
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
SAP S/4HANA Cloud Test Automation Tool
UI & API-based Automation Tool
Cloud Native, No installation, No code
Pre-delivered Automation Content Automated Upgrade Safeguarding
Integrated with SAP Cloud ALM

6. 6
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Business Benefits Of Test Automation Tool
Accelerate business processes and regression
tests using SAP-delivered Standard Test Scripts
Centralized Test Data Management with
the Test Data Container (TDC) App
Results dashboard with
failure categorization &
recommendations
UI & API Automation* for
S/4 HANA Cloud
Applications
Create or adopt test scripts
via recording functionality
Test executions in pre-provisioned infrastructure
backed by BTP/Hyper scalers
*Supports only SAP Public APIs
Integrated with Cloud ALM
Manage Upgrade Tests app for creating and
maintaining a regression suite for release safeguarding

7. 7
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Standard Best Practice Automates

8. 8
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Manual Test Scripts And Automated Test Scripts
Manual Test Scripts And Automated Test Scripts
• Manual Test Scripts are available in the
“Details” section of the SAP Best Practices
Explorer^ for SAP Best Practice Processes.
• Some of the manual test scripts are available as
pre-built test automation scripts* in the Test
Automation Tool for SAP S/4HANA Cloud.
• The pre-delivered automated test scripts for
Test Automation Tool, can be seen in “Manage
Your Test Processes” app, or in “Automated
Test Script Index” accelerator in SAP Activate
Roadmap Viewer.
* Please note: Not all manual test scripts and flows can be automated.
^ Applicable only to S/4HANA Public Cloud.

9. 9
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Lifecycle Of Test Automates
Standard Test Automates – SAP-delivered, preconfigured test scripts
Test automates delivered by SAP gets updated on every major release to comply
with software updates and configuration changes. This enables customers to focus
more on the maintenance needed for customized automates.
“Reduce maintenance effort during regression test by leveraging standard artefacts as much as possible.”
Custom Test Automates - Customer-specific test script
Process steps, created or changed by the customer, does not get updated.
Adapting custom test automates to release-specific changes will be
customers’ responsibility.

10. 10
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
A Test Plan represents an end-to-end business flow and can consist of several test processes.
Chaining of information across test processes is possible by having them in one test plan.
All the test data required for a test plan can be managed using test data containers and data variants.
•A Test Process represents a business process and is a set of one or more process steps.
•Standard Test Process: Standard processes are owned and updated by SAP and is non-editable.
•Custom Test Process: Custom test process can be created by either copying from a Standard process or by
creating a new one according to your business needs. It can include standard and custom process steps.
•A Process Step is a series of actions.
•Standard Process Step: Standard process steps are owned and updated by SAP to reflect specific release
changes. You should leverage standard test processes to reduce maintenance efforts during regression testing.
•Custom Process Step: Custom process steps can be created by either copying from a standard process step or
by creating a new one. They are not updated by SAP. Customers need to update them if needed.
An Action refers to a user action performed on the application under test.
The possible actions can be: Input, Click, Select, Search, and so on.
Standard Action: Standard actions are owned and updated by SAP.
Custom Action: Custom actions can be created/modified by the customer.
Test
Plan
Test
Process
Process
Step
Action
Test Your Processes – Test Plan Hierarchy

11. 11
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Test Automation Tool Flow – Test In Customer Q/T Systems
Explore tool and develop
custom Automates
Test Planning
Post-Upgrade Test
Test Result analysis
SAP S/4HANA Cloud
Test Automation Tool

12. 12
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Post-UpgradeTests

13. 13
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
“Enrich the upgrade experience of
S/4HANA Cloud by enabling
testing of existing and new
business innovations, thus
instilling confidence for seamless
consumption”

14. 14
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
• Customer has to
trigger PUT in case
of upgrades or
implementation
changes
• Auto-trigger of PUT
done after every
major release
upgrade only if
Consent is already
provided
Major Upgrade
|Deployment|
Implementation
Change
• Check the AATR*
app for results of
the latest PUT run
• Failure reason and
recommendations
make it easier for
faster analysis
• Re-execution
feature enables
quick trigger for
solved issues
Analyze Results
of PUT
• Continue to refine
the PUT scope via
the Manage
Upgrade Tests
(MUT) app
• Add or remove
required automates
based on the scope
and needs of
regression testing
Adapt PUT
Regression
Suite
Upgrade Test via Post-Upgrade Test
Post-Upgrade Test (PUT) is a high-level quality check after release upgrade in Q/T tenants. PUT is performed to test basic
standard features with customer data. PUT is an offering where after any major upgrade, deployment, or implementation
change, a customer can run their suite of regression automates (Standard + Custom).
• Test data is automatically fetched from customer system or via Test Data Container
• SAP will enable customers to perform Post-Upgrade Tests via continuous improvements
*Analyze Automated Test Results
Note: Upgrade can refer to continuous delivery, major upgrade release, content upgrade & implementation changes

15. 15
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Recent Innovations

16. 16
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Towards Zero Maintenance Automates
We have introduced new features which enable more resilient and robust automates
UI Control Repository
• Achieves modularization and reusability of
controls across scripts
• Central repository of UI Controls grouped
by application
• UI Control Repository takes care of required
adaptions for custom scripts due to app changes
API Automation Framework
• More robust tests which are not impacted by
frequent UI changes
• Smart, easy, and friendly way of creating OData-
and SOAP-based API automates
• Supports automation of all publicly available APIs
on the SAP API Business Hub*
*Except for the 127 outbound SOAP APIs.

17. 17
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Test Data Container
Addressing the need to have a simplified interface to handle and manage test data.
• Central repository with reusable test data templates based on
functional areas
• Integrated with the existing Test Automation Tool
• Test data management - single source of test data as per end
user test/business flow
• Support to download and upload multiple test data
• Option to override values in standard test data container variants
using the Excel Upload feature
Area Level
(e.g. Sales, Finance)
Business Flow
(e.g. BD9, BDA, J54, J11..)
Test Data Sets
(e.g. Material, Business Partner, etc
Can be used with multiple scope items)
Templates
TDC1 TDC2 TDC3
Test Data Container
Data Variants
V1 V2 V3 V4

18. 18
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
 Post-Upgrade Tests (PUT) have been
effective in enabling our customers to
identify defects earlier and have them
addressed by SAP
 We are moving towards making PUT more
driven by our customers with additional
options to add custom scope and decide
which data will be used
 The Manage Upgrade Tests app will be the
place to manage custom scope and assign
data variants
 Multi-level hierarchical display of
Customer Test Plans and their variants​
Set Execution Scope Via Manage Upgrade Tests

19. 19
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Understanding Failed Test Scripts Better
Error Categorization & Perspective Reporting
 Supervised Learning approach to improve Error Categorization
 Simplify and expedite the process of analyzing failed test executions, and subsequent re-
executions
 Bring smart rules based on comparative study and evolve reporting to be prescriptive
 Insights into test results and tenant readiness after upgrade

20. 20
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Other Progressive Updates
 Upload and download multiple test
processes at once (3SL specific)
 Support for recording of custom UI
automates in any language

21. 21
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Resources

22. 22
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Useful Resources
Community Page for Automation Testing
Ask a Question
Expert and Release Blogs
Learning Hub Overview Session
Building your Test Regression Suite
On-demand Tutorials
Implementation Guides
Testing in Roadmap Viewer

23. 23
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Important SAP Notes/KBAs
• Additional information on Test Automation Tool
Note 2129147
• Resolution for no progress in a test plan
execution
Note 3087418
• Resolution for failed test plan execution run with
SAP-provided default variant
Note 2985672
• Adding formula to Actions in a test script
Note 3033993
• Resolution for no progress in automatic test
process execution
Note 2820953
• Information on usage of Standard API
Automates in Test Automation Tool
Note 3044137

24. 24
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Run
Deploy
Realize
Explore
TEST
PLANNING
TEST
PREPERATION
TEST
EXECUTION –
Implementation test
TEST
EXECUTION –
Regression test
Inputs:
• Solution Scope
• Project Plan
Outputs:
• Agreed test strategy
• Test Plan/Test
Schedule
Accelerators:
• Test Strategy
Template SAP
S/4HANA Cloud
document
• Detailed test
schedule template
document
Inputs:
• Automated standard test scripts
• SAP Best Practices process
• Configuration backlog
• Test Plan/Schedule
• Project Plan, Test Strategy
Outputs:
• Test Scenarios/test cases or test scripts
• Customer specific test cases/scripts
• Configure test automation tool
Accelerators:
• Available automated test scripts
• Testing in SAP S/4HANA Cloud
• SAP Best Practices Explorer
Inputs:
• Test Data/Data Variants
• Prepared test plans & cases
Outputs:
• Status of test plan execution
• Corrected and re-executed test plans
• Test Execution monitoring – Reports
• Test execution analysis – New app
Accelerators:
• Testing in SAP S/4HANA Cloud
• Detailed test schedule template
document
• Support Portal
Executed after Q-system upgrade and prior to P-
system upgrade
Inputs:
• Standard and Customer specific test process
• What’s new document from Accelerators section in
the SAP Best Practices Explorer
• Manual test script release change information
Outputs:
• Validated functionality
• Corrected and re-executed test plans
• Defect handling by raising tickets in support portal
• Test Execution analysis & reporting
Accelerators:
• SAP Community Page
• Support Portal
• Manual test script release change information
• What´s new in testing
Usage Scenarios of Test Automation Tool
SELF
ENABLEMENT
Accelerators:
• Testing in SAP
S/4HANA Cloud

25. Thank you.
© 2023 SAP SE or an SAP affiliate company. All rights reserved. See Legal Notice on www.sap.com/legal-notice for use terms, disclaimers, disclosures, or restrictions related to SAP Materials for general audiences.
Name
Email
Contact information:

26. 28
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
© 2023 SAP SE or an SAP affiliate company. All rights reserved.
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of
SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its
distributors contain proprietary software components of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or
warranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials.
The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty
statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional
warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or
any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation,
and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, and
functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason
without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or
functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ
materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they
should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered
trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names
mentioned are the trademarks of their respective companies.
See www.sap.com/corporate-en/legal/copyright/index.epx for additional trademark information and notices.
www.sap.com/contactsap
Follow all of SAP