Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Testing a Complex ERP Application Using a Data-Driven Framework

1,164 views

Published on

This presentation describes the challenges testing a complex ERP application such as Microsoft Dynamics AX and Dynamics 365. It shows how you can use a modern test automation tool to create tests that can be used by both technical and business users.

Published in: Software
  • Be the first to comment

  • Be the first to like this

Testing a Complex ERP Application Using a Data-Driven Framework

  1. 1. © Copyright 2006-2017, Inflectra Corporation ® Page: 1 How to Test a Complex ERP Application using a Data-Driven Framework By Adam Sandman September 29th, 2017
  2. 2. © Copyright 2006-2017, Inflectra Corporation ® Page: 2 Agenda  Introduction  Testing Complex Business Applications  Using a Test Automation Framework  The Value of Test Management  Questions
  3. 3. © Copyright 2006-2017, Inflectra Corporation ® About Me  Adam Sandman was a programmer from the age of 10 and has been working in the IT industry for the past 20 years.  Currently Adam is a Director of Technology at Inflectra Corporation, where he is interested in technology, business and innovation.  Adam lives in Kensington, MD, just outside the Beltway  Page: 3
  4. 4. © Copyright 2006-2017, Inflectra Corporation ® Page: 4 Objectives 1. How to create robust automated tests for a complex desktop and web ERP application 2. The ease of use and flexibility of the Rapise Visual Language (RVL) 3. The benefits of using an integrated test management system to ensure complete coverage
  5. 5. © Copyright 2006-2017, Inflectra Corporation ® Before We Start  Who is Already Doing Test Automation?  Who has had to test an ERP System? Page: 5
  6. 6. © Copyright 2006-2017, Inflectra Corporation ® Case Study: Microsoft Dynamics Page: 6
  7. 7. © Copyright 2006-2017, Inflectra Corporation ® What is Microsoft Dynamics (Official)?  A family of ERP / CRM Applications for Medium-Large Businesses: Page: 7
  8. 8. © Copyright 2006-2017, Inflectra Corporation ® What is Microsoft Dynamics (Unofficial)? Page: 8 https://turnondynamics.com/microsoft-dynamics-ax-and-its-achilles-heel/
  9. 9. © Copyright 2006-2017, Inflectra Corporation ® Challenges of Testing Dynamics  Packaged ERP Application, configured by functional users not programmers  Limited ability to do unit testing or non-UI testing  SOAP and REST APIs can be tested independently  Difficult to integrate into a CI process  Different technologies per product  Browsers used for Dynamics 365, CRM  Windows Forms used for Dynamics AX, NAV  Complex UI elements of data  Grids of data  Proprietary menus Page: 9
  10. 10. © Copyright 2006-2017, Inflectra Corporation ® Challenges of Testing Dynamics AX 2012  Cannot use Selenium (not browser based)  Coded UI is available but low-level, lot of effort required  Testers have to deal with grids, treeviews, menus at a very low level  Hard to maintain the CodedUI scripts coded in C# Page: 10
  11. 11. © Copyright 2006-2017, Inflectra Corporation ® Challenges of Testing Dynamics 365  Selenium possible since browser based  Complex elements (e.g. main menu) hard to automate. Took over a week to create reliable web locators  Grids and other objects complex to interact with once you get beyond the root DOM element  You have popups and other dialogs that need OS click  What happens when you have an obscured item, should it pass/fail? Page: 11
  12. 12. © Copyright 2006-2017, Inflectra Corporation ® The Different Testing Roles / Needs Page: 12
  13. 13. © Copyright 2006-2017, Inflectra Corporation ® The Functional Expert  ERP = Lots of complex business rules that are designed by accountants, logisticians, warehouse managers: Page: 13 Functional Knowledge of System Doesn’t Understand Automation, XPATH, CSS, Frameworks, Libraries
  14. 14. © Copyright 2006-2017, Inflectra Corporation ® The Test Automation Engineer  Knows how to create automated software tests that are more than just ‘smoke and mirrors’ and will be resilient and reliable. Page: 14 Knowledge of How to Create Good Tests Doesn’t know a Purchase Order from a Credit Memo.
  15. 15. © Copyright 2006-2017, Inflectra Corporation ® Using an Automation Framework Page: 15
  16. 16. © Copyright 2006-2017, Inflectra Corporation ® The Landscape of Test Automation Courtesy of Yoni Flenner – http://yoniflenner.net Page: 16 This is where Selenium WebDriver Comes in (or Appium, MSAA, UIAutomation)
  17. 17. © Copyright 2006-2017, Inflectra Corporation ® Introducing Rapise  Test Automation tool that tests web, mobile, desktop and APIs  Uses JavaScript as its core language  Has Scriptless data-driven framework  Commercial tool but designed to be open and extensible, using Selenium, Appium, … Page: 17
  18. 18. © Copyright 2006-2017, Inflectra Corporation ® Object Based Recording  Separates the logic for interacting with a UI element from the test script and process flow Page: 18
  19. 19. © Copyright 2006-2017, Inflectra Corporation ® Recording & Learning  Capture User Interactions:  Generate Assertions: Page: 19
  20. 20. © Copyright 2006-2017, Inflectra Corporation ® Spy Tools  Web Spy for Browsers  XPATH Generator  Appium Spy for Mobile  Spy Tools for Desktop  Windows, Java, etc. Page: 20
  21. 21. © Copyright 2006-2017, Inflectra Corporation ® Rapise Visual Language (RVL)  Scriptless table lets functional users compose the test scenarios  The objects can be defined by automation engineers or recorded Page: 21
  22. 22. © Copyright 2006-2017, Inflectra Corporation ® Integrating Functional Roles Page: 22 Creates the test scenarios and can record simple tests Automation engineer learns objects and writes JS functions/extensions
  23. 23. © Copyright 2006-2017, Inflectra Corporation ® Rapise Demos Demonstration of Testing Dynamics AX and 365 using Rapise Page: 23
  24. 24. © Copyright 2006-2017, Inflectra Corporation ® Not a Black Box  Choose tools with open formats, that can be extended Page: 24 ==
  25. 25. © Copyright 2006-2017, Inflectra Corporation ® The Value of Test Management Page: 25
  26. 26. © Copyright 2006-2017, Inflectra Corporation ® Questions? Page: 26
  27. 27. © Copyright 2006-2017, Inflectra Corporation ® Real Time Monitoring  Modern test management tools include powerful dashboards and reports. Page: 27
  28. 28. © Copyright 2006-2017, Inflectra Corporation ® Tie in Test Automation  For ERP applications you can test the UI and APIs  You may be able to test other layers  Integrate them into your test management tool Page: 28
  29. 29. © Copyright 2006-2017, Inflectra Corporation ® Tie in Manual Testing  There are many good test management tools to choose from. Don’t default to using Excel, Google Sheets  Understand UAT manual testing vs. Exploratory Testing  They are different and should be used appropriately Page: 29
  30. 30. © Copyright 2006-2017, Inflectra Corporation ® Some Useful Links  Articles  Tricks & Tips for Testing Dynamics 365 https://www.inflectra.com/Support/KnowledgeBase/KB277.aspx  Tricks & Tips for Testing Dynamics AX https://www.inflectra.com/Support/KnowledgeBase/KB273.aspx  Tricks & Tips for Testing Dynamics NAV https://www.inflectra.com/Support/KnowledgeBase/KB292.aspx  Article about Menu support in Dynamics 365 for Operations https://www.inflectra.com/Ideas/Entry/479.aspx  Article that illustrates Yoni's diagram on slide 16 https://www.inflectra.com/Ideas/Whitepaper/Setting-Up-a-TestOps-Environment- Using-Selenium-WebDriver-and-JavaScript.aspx  Samples on GitHub  Dynamics AX Samples https://github.com/Inflectra/rapise-dynamics-samples  Dynamics 365 for Operations Samples https://github.com/Inflectra/rapise-dynamics365-samples Page: 30
  31. 31. © Copyright 2006-2017, Inflectra Corporation ® Questions? Page: 31

×