• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
PowerPoint Slides
 

PowerPoint Slides

on

  • 2,203 views

 

Statistics

Views

Total Views
2,203
Views on SlideShare
2,203
Embed Views
0

Actions

Likes
2
Downloads
31
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Thanks Bob and Thank you and welcome to all of you who have joined us … … . Start with why test automation should now be a critical consideration for most SAP enabled firms… Challenges and Solutions  Where we go from fantasy to fact Have time for Q& A

PowerPoint Slides PowerPoint Slides Presentation Transcript

  • Mar 20, 2008 www.arsin.com Packaged Test Automation for SAP Danis Yadegar (President & CEO Presenter
  • Agenda
    • SAP Vs Custom Applications
    • Testing needs of SAP Applications
    • Summary
    • Current Approach – Challenges & Limitations
    • Solution
    • Q&A
    CONFIDENTIAL © 2008 Arsin Corporation. All Rights Reserved
  • CONFIDENTIAL © 2006 Arsin Corporation. All Rights Reserved CONFIDENTIAL © 2006 Arsin Corporation. All Rights Reserved CONFIDENTIAL © 2008 Arsin Corporation. All Rights Reserved SAP Vs Custom-built Applications
  • SAP Vs Custom Application Testing CONFIDENTIAL © 2006 Arsin Corporation. All Rights Reserved CONFIDENTIAL © 2008 Arsin Corporation. All Rights Reserved
    • Transaction Focused Testing
    • Configurable and Customizable Execution Components
    • Configurable and Customizable Business Rule Validation
    • Complex and Large set of Test Data
    • Data in QA Environment is Hard to Refresh
    SAP
    • GUI/API Focused Testing
    • Reusable GUI/API Execution Components
    • Screen based Edit Rules & Referential Integrity checks
    • Limited and Controlled set of Test Data
    • Easy and Full Control over QA Environment, Easy to reset baseline test data
    Custom
  • Change Drivers Support Packs Within Company SAP Upgrades New Modules Additions Business Unit Changes Mergers and Acquisitions Partner & Customer Integration Business Process Changes Enhancements/Fixes System Environment Hardware and OS Changes Consolidations Recovery From Crash Disaster Recovery Readiness Data Base System Changes Other Applications SAP New Dimension Products Packaged Applications Custom Applications Complimentary Software Integration Platforms Regulatory Compliance Sarbanes-Oxley FDA System Validation International Regulatory Compliance Requirements
  • Summary CONFIDENTIAL © 2006 Arsin Corporation. All Rights Reserved CONFIDENTIAL © 2008 Arsin Corporation. All Rights Reserved
    • Testing SAP requires a different set of tools, in addition to the commercially available GUI testing tools
    • Testing SAP requires a new testing methodology and process
    • Testing SAP requires people with different knowledge areas – business process, SAP configuration & development
  • Current Approach - Limitations
    • SAP Test Automation
      • Manual and screen based validations
      • Input and expected data is managed in spread sheets, which is difficult to maintain
      • Managing changes – Inability to rapidly change test artifacts during changes in the systems
  • Test Automation Challenges - An Example CONFIDENTIAL © 2008 Arsin Corporation. All Rights Reserved LEGEND Order To Cash Scenario Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Execution Validation Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Goods Issue Delivery Stock Overview Display Condition Display Customer Display Sales Order Sales Order Billing Cust. Acct. Balance Display Display Acct. Document Balance Display Stock Overview Display Material Document Display Out Bound Delivery Cust Acct. Balance Display Display Acct. Document Incoming Payment Cust. Acct. Balance Display Balance Display Display Acct. Document Display Sales Order
  • Problem One: Data Management Order To Cash Sales Order Test Script VA01 VA03 XD03 VK13 MMBE Execution Validation Incoming Payment Billing Goods Issue Delivery Sales Order Stock Overview Display Condition Display Customer Display Sales Order Sales Order Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data
  • Problem Two: Validation
    • 1:3 Ratio – Execution to Validation
    • Screen Based Access - No Access to Internals
    • High Degree of Test Automation Skill Required
    • 3X as Hard to Maintain
    • The Only Way to Reduce the Functionals’ Workload
    Sales Order Test Script VA01 VA03 XD03 VK13 MMBE Execution Validation Stock Overview Display Condition Display Customer Display Sales Order Sales Order
  • Problem Three: Managing Change Order To Cash Scenario 1 New billing field Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Order To Cash Scenario 1 Goods Issue Delivery Stock Overview Display Condition Display Customer Display Sales Order Sales Order Billing Cust. Acct. Balance Display Display Acct. Document Balance Display Stock Overview Display Material Document Display Out Bound Delivery Cust Acct. Balance Display Display Acct. Document Incoming Payment Cust. Acct. Balance Display Balance Display Display Acct. Document Display Sales Order Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Order To Cash Scenario 1 Goods Issue Delivery Stock Overview Display Condition Display Customer Display Sales Order Sales Order Billing Cust. Acct. Balance Display Display Acct. Document Balance Display Stock Overview Display Material Document Display Out Bound Delivery Cust Acct. Balance Display Display Acct. Document Incoming Payment Cust. Acct. Balance Display Balance Display Display Acct. Document Display Sales Order Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Order To Cash Scenario 1 Goods Issue Delivery Stock Overview Display Condition Display Customer Display Sales Order Sales Order Billing Cust. Acct. Balance Display Display Acct. Document Balance Display Stock Overview Display Material Document Display Out Bound Delivery Cust Acct. Balance Display Display Acct. Document Incoming Payment Cust. Acct. Balance Display Balance Display Display Acct. Document Display Sales Order Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Order To Cash Scenario 1 Goods Issue Delivery Stock Overview Display Condition Display Customer Display Sales Order Sales Order Billing Cust. Acct. Balance Display Display Acct. Document Balance Display Stock Overview Display Material Document Display Out Bound Delivery Cust Acct. Balance Display Display Acct. Document Incoming Payment Cust. Acct. Balance Display Balance Display Display Acct. Document Display Sales Order Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Order To Cash Scenario 1 Goods Issue Delivery Stock Overview Display Condition Display Customer Display Sales Order Sales Order Billing Cust. Acct. Balance Display Display Acct. Document Balance Display Stock Overview Display Material Document Display Out Bound Delivery Cust Acct. Balance Display Display Acct. Document Incoming Payment Cust. Acct. Balance Display Balance Display Display Acct. Document Display Sales Order Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Order To Cash Scenario 1 Goods Issue Delivery Stock Overview Display Condition Display Customer Display Sales Order Sales Order Billing Cust. Acct. Balance Display Display Acct. Document Balance Display Stock Overview Display Material Document Display Out Bound Delivery Cust Acct. Balance Display Display Acct. Document Incoming Payment Cust. Acct. Balance Display Balance Display Display Acct. Document Display Sales Order Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Validation Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Spreadsheet Execution Data Goods Issue Delivery Stock Overview Display Condition Display Customer Display Sales Order Sales Order Billing Cust. Acct. Balance Display Display Acct. Document Balance Display Stock Overview Display Material Document Display Out Bound Delivery Cust Acct. Balance Display Display Acct. Document Incoming Payment Cust. Acct. Balance Display Balance Display Display Acct. Document Display Sales Order
  • Current Approach - Limitations
    • Knowledge Management
      • SAP testing is spearheaded by functional experts who map the Business Process to SAP modules
      • During the initial implementations there is more focus on testing than on capturing knowledge residing with functional & technical consultants
      • As a result, the regression library is incomplete for future support packs and upgrades
    • Methodology & Process
      • Formal Testing is addressed as one of the last activities after completion of development and unit testing
      • ASAP methodology guidelines for testing are very high level and does not focus on detailed activities to be performed by the QA team during various phases implementation
      • As a Result testing gets pushed till the end and quality is compromised due to lack of early engagement and preparation
  • Solution CONFIDENTIAL © 2008 Arsin Corporation. All Rights Reserved Methodology & Process Knowledge Management Technology
  • Technology Solution
    • Flexible multi-platform GUI test automation tool – RFT, QTP, TP
    • Scoping Workbench
    • Test Automation Framework for SAP Landscape
    • Configurable and Customizable Test Components
    • Built-in Data and Business Rule Validations for:
      • Standard and Custom Transactions
      • Custom Processing Programs
      • Inbound/Outbound Interfaces
    • Sophisticated Test Data Management
    • Pre and Post Change Comparators for Documents and Tables
    CONFIDENTIAL © 2008 Arsin Corporation. All Rights Reserved
  • Test Automation Process Flow QA Mapper™ Test Requirements Test Cases Test Procedures Meta Data of ECs Definition of VC Data Sets Wrapper Extracts Test Case Info EC Meta Data VC Name Data Set Info From QA Mapper DB GUI Automation Tool EC Scripts on Shared Drive Wrapper on the Shared Drive Runs EC Extracts Keys Pass it to Effecta for Validation 2 1 3 4 5 Validation Reports 6 RFT Log 7 System Under Test Effecta™ Validation Engine SAP ERP Core Business Processes SAP GUI Database I n t e r f a c e s
  • Test Automation Solution for Interfaces CONFIDENTIAL © 2008 Arsin Corporation. All Rights Reserved QA Mapper/GUI Tool
  • Methodology & Process Needs
    • Compatible with SAP implementation Lifecycle
    • Process to Test
      • Configuration & Modifications
      • Conversions
      • Interfaces
      • Connectivity
      • Security
      • Archiving
      • Production Fixes and Enhancements
      • Support Packs & Upgrades
    • Include Processes to handle compliance requirements
    CONFIDENTIAL © 2008 Arsin Corporation. All Rights Reserved
  • SAP QA Process CONFIDENTIAL © 2008 Arsin Corporation. All Rights Reserved
  • SAP QA Knowledge Management
    • QA Process Retains Knowledge through
      • Detailed Documentation of regression library including validation rules
      • Automated Execution
      • Automated Validation of Business Rules
    • Training Program
      • SAP Professionals on QA Processes
      • Functional & Technical Training for Non-ERP IT Professionals
      • Test Automation Frameworks
    CONFIDENTIAL © 2008 Arsin Corporation. All Rights Reserved
  • Ideal Testing Landscape TEST REQUIREMENTS TEST CASES TEST PROCEDURE TEST EXECUTION & METRICS & DEFECTS Test Management PROVIDE BUILDING BLOCKS BUILD MAINTAIN BUILD MAINTAIN EXECUTE Basis Administrator ABAP Developer Application X Developer SAP Functional Analyst Business Process Analyst Compliance Auditor Test Component Library SAP FI MM SD PP PS FS SRM CRM APO Interfaces EDI Batch EAI Non-SAP Applications Client Server AS400 Web Other Business Process Test Library Sell-Side Processes Buy Side Processes Manufacturing Processes Financial Processes GUI Test Automation Tool Effecta TM SAP Validation Engine QA Automation Engineer QA Analyst SME QA Analyst
  • IBM-Arsin’s Test Automation Solution Execution Engine Rational Functional Tester System Under Test Effecta™ Validation Engine SAP ERP Core Business Processes SAP GUI Test Scripts Database I n t e r f a c e s Web Browser Web Test Req Test Cases Test Procedures Test Data QA Mapper™ Database
  • www.arsin.com For White Paper Contact: John Hudson [email_address] 408-532-5579
  • Q&A CONFIDENTIAL © 2006 Arsin Corporation. All Rights Reserved