Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Everything You Need to Build a Risk-Based Testing Strategy for SAP


Published on

SAP testing isn’t easy. Organizations are challenged to keep pace with an incredible (and growing) volume of enhancements, updates, upgrades, and new apps. But traditional SAP impact analysis is time consuming, costly, and difficult to manage. That’s why the world’s top companies are turning to risk-based testing. Here’s how you can get started too.

Published in: Software
  • D0WNL0AD FULL ▶ ▶ ▶ ▶ ◀ ◀ ◀ ◀
    Are you sure you want to  Yes  No
    Your message goes here

Everything You Need to Build a Risk-Based Testing Strategy for SAP

  1. 1. 1 Everything You Need to Build a Risk-Based Testing Strategy for SAP Chris Kraus Sr. Director Product Management Email:, Twitter: @ChrisKraus3 4/12/2017 © 2017 Worksoft, Inc.
  2. 2. 2 • Perspective – Change is a Constant • Building a Risk Based Testing Strategy for SAP • Introduction to Worksoft Certify • Demo • Q and A 4/12/2017 © 2017 Worksoft, Inc. Agenda
  3. 3. 3 “By 2020, 60% of digital businesses will experience a major service failure because of IT teams’ inability to “manage digital risk in new technology and use cases.” Gartner Projection The Pace of Change Drives Digital Risk
  4. 4. 4 “This is probably good news for incumbents, since many of them are carefully watching tech start-ups to identify the winning plays and then imitating them at their own bigger scale. That approach, to be sure, demands cutting-edge agility to excel on all the operational and organizational aspects of digital maturity.” 4/12/2017 Source Agility Has Never Been More Important!
  5. 5. 5 SAP… Change Is a Constant • When a new process becomes available, how quickly can I integrate the process into my business and begin realizing its benefits? • How can I decrease the time required to implement system changes and events? • How do I improve implementation performance, mitigate risks, leverage accelerators, and measure adoption? EFFORT ONGOING CHANGE EVENTS DISCRETE CHANGE EVENTS …establish a quality platform to minimize time/cost of change event efforts Consolid. New Implementation Upgrades New Processes TIME Custom Dev. Custom Dev. Custom Dev. Hot Packs Support Pack Support Pack CHANGE EVENTS Business drivers  Changed business processes, M&A re-organizations & new products, vendors… Compliance drivers  Governance, risk management & compliance Technology drivers  New functionality & Upgrades Transforming software change control into business change control – company-wide, across SAP and non-SAP landscapes
  6. 6. 6 “Quality & Testing” Biggest Pain Point Of Upgrades 0 10 20 30 40 50 60 70 80 90 83% 17% % Members IN THE PROCESS OF UPGRADING NOT UPGRADING Major Cost and Time Factors during Upgrade or Implementation, % Customers QA & Testing Change Mgmt. Planning Training & Doc. Resource Mgmt. Complexity Project schedule n=52 75% 30% 16% 12% 7% 5% 0% Source: ASUG Test influence council member survey 2013 Testing and coverage is the #1 stated pain point for all customers Over 86% of customers are concerned about risks due to lack of comprehensive testing Complexity and project schedule are rated much lower compared to the rest
  7. 7. 7 The SAP systems are extremely complex and getting more so at an alarming pace! • Many touch points with other internal and external systems increase risk-prone breakage areas • Multi-component development efforts greatly increase wait/downtime • Complexity of systems renders duplication for Dev/QA extremely costly if not altogether impossible Top SAP Testing Pain Points Number of interfaces (counting point-to-point connections): Source: Results of the global Survey 2016 for SAP Process Integration (Part 1 of 2) % of users
  8. 8. 8 Unclear poorly defined Requirement Risks Complexity Technical Risks Failure to address priority conflicts Schedule Risks What Are the Risks? “Risk Based Testing is a method for prioritizing the tests based on the risk of their failure because testers cannot test everything with available resources, usually it starts early in the project cycle.” Source: International Journal of Computer Applications (0975 – 8887), Volume 65– No.1, March 2013. Risk-based Testing Techniques: A Perspective Study. Md. Mottahir Alam and Asif Irshad Khan.
  9. 9. 9 • Prioritize tests based on ability to discover defects – Find the Really Bad Stuff First • Allocate testing resources based on potential business impact and increase testing efficiency • Ability to optimize compressed test windows without increasing critical defect risks • Better Manage Change and GO FASTER! 4/12/2017 © 2017 Worksoft, Inc. Benefits of Risk Based Testing
  10. 10. Quick Intro to Worksoft Automation for End to End Business Process Testing Global Organization Offices in Dallas TX, London UK & Munich Germany Diverse Global 5000 customers across N. America, Europe & Asia Worldwide support and services Innovative Technology First-to-market with business process testing. First with process mining for SAP. Focus on Enterprise Apps: SAP,, Workday, Oracle and many others 5 patents awarded, 2 in progress Ranked #1 by Gartner in Test Automation for Packaged Enterprise Applications Diverse Community SAP Partner Global partnerships with the leading system integrators Thriving practitioner community with peer learning, blogs & customer-generated content Worksoft University and certification programs
  11. 11. 11 4/12/2017 © 2017 Worksoft, Inc. How Do You Manage the Change? Common Approaches for Risk Based Testing in SAP Transports Option 1 - Use Solution Manager, Run TBOMs & BPCA Challenge: Updated Business Blueprints are required. Challenge: Transactions need to be run with the TBOMs running to get dynamic code analysis. BPCA (Business Process Change Analyzer) 1 3 2
  12. 12. 12 Advantages: • Speed - Tests can then be immediately run in Worksoft Execution Manager or HP QC • Insights - Data can be imported into Worksoft Analyze and graphically visualized 4/12/2017 How Do You Manage the Change? You Don’t Have to Test Everything. You Just Need to Test the Right Things. Option 2 - Use Worksoft Certify and Impact What Do We Have? What Are the Risks? What’s Changing? See the SAP transactions, programs and objects that are effected Learn the risks by seeing what is not covered and what the STO3 associated risks are. Overlay your existing Certify processes that test those Tcodes. 1 3 2
  13. 13. Worksoft Solutions & Technology From Continuous Delivery to Continuous Transformation Discovery & visualization Process Mining for SAP Interactive & Passive Capture Advanced analytics Business process testing Certify Impact Visual authoring Out-of-the-box optimizations for select enterprise apps Continuous execution Lights-Out testing Multi-tenant cloud services Massive, elastic VM support Worksoft Analyze® Worksoft Certify® Operations Suite
  14. 14. 14 Worksoft Certify Impact: Risk Based Testing for SAP Developed for change management teams and non-technical users Certify Impact Key Features: • Automated change impact analysis for SAP • Automated identification of changes made by transports in SAP • Identification of appropriate tests to run in Worksoft Certify test portfolio • Integrates with SAP’s BPCA for a more detailed change analysis • Works in real-time Only execute the tests needed to verify the change, not the entire regression library! Certify Impact minimizes the time required to test changes as they are brought into the SAP landscape WHAT IMPACT IS NOT GOOD FOR: Conquering the Complexity of SAP Changes! • Comparisons between two SAP systems • Code analysis • Reporting of object level changes. BPCA can be used for this level of detail. We help with BPPs and TBOMs.
  15. 15. 15 3. Execute Identified Business Process Tests to Validate Changes in SAP System 2. Locate impacted objects in Worksoft Certify Business Process Tests  Provides an SAP-specific solution for ABAP-stack applications  Performs a deep and thorough analysis of selected SAP transports Certify Impact – Approach Certify Impact SAP® Applications ERP SAP Applications Certify Database Transports Worksoft Certify® Business Process Tests 1. Inspect Transport for Impacted Transactions and Programs Impacted Objects
  16. 16. 16 Example Of Certify Impact Object Analysis Domain Data Element Fields Tables Structures Function Module Include Program Calling Program Transaction IDOC_INPUT_ORDERS D_AUART RV45A AUART VBAK VBAK-AUART MV45AOAT VA01 SAPMV45A
  17. 17. 17 • Analyze change for • Identify major and minor projects • Run and sustain • Integrate with the testing platform • Automatically identify test cases that match the changes being made by the transports • Automatically execute the test cases from the tool • Identify testing gaps • Verify where the gaps exist between current test library and the changes being made Impact in Action
  18. 18. 18 DEMO
  19. 19. 19 • Minimizes the time and resources required to test changes in SAP • Focus resources specifically on what’s new and different • Identify, recommend, and execute end-to-end business process tests based on a set of proposed SAP application changes and their relationships to critical business processes • Increases quality in business process execution • Provides a safeguard for identifying and testing changes before committing to production Certify Impact – Business Benefits
  20. 20. 20 IDC Validates the Value of Worksoft Certify The Business Value of Worksoft Automated Business Process Validation Solutions Source: The Business Value of Worksoft Automated Business Process Validation Solutions a commissioned August 2014 study conducted by IDC on behalf of Worksoft. Method: IDC assessed the cost, benefits, and value associated with the use of Worksoft Certify by the 12 organizations interviewed for this white paper over a five-year period. Worksoft Extends Automation and Drives Business Agility ROI 273% NPV $11.46M PAYBACK 11.9 mos. INCREASED AUTOMATION Automated business process tests increased from 12% to 44%. IMPROVED PRODUCTIVITY Staff hours spent doing regression testing reduced by 48%. LOSSES FROM DEFECTS CUT Productivity losses from defects entering products cut by 44%. "We were looking for more seamless automation and fewer starts and stops for our regression testing. Worksoft filled that gap. We went from having about 50% to 80% of our regression processes automated."
  21. 21. 21 Questions?
  22. 22. 22 Join Worksoft at SAP SAPPHIRE 2017! May 16-18, 2017 Orlando, FL Booth #738
  23. 23. 23 • White Paper: Risk-Based Test Automation from a Business Process Perspective • Analyst Report: The ROI of Worksoft Solutions: IDC Report • Data Sheet: Certify Impact 4/12/2017 © 2017 Worksoft, Inc. Resources: