Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Automated Testing – Web, Mobile, Desktop - Challenges and Successes

2,646 views

Published on

Learn how your company can add automated testing for accessibility on all platforms. This presentation covers what Intuit has learned while working towards this goal

Published in: Technology
  • Test your mobile web and native mobile applications on multiple mobile devices that increasingly command adoption & usage for enterprise and everyday computing. https://goo.gl/caU3Xp
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Automated Testing – Web, Mobile, Desktop - Challenges and Successes

  1. 1. Automated Testing: Web, Mobile, Desktop - Sagar Barbhaya - Ted Drake - CSUN 2016
  2. 2. Intuit Accessibility - Sagar Barbhaya Software Engineer, Accessibility - Ted Drake Principal Engineer, Accessibility
  3. 3. Agenda • Introduction • HTML • Android • IOS • Windows • Results
  4. 4. INTRODUCTION • 30+ products • Accessibility is a top priority. • All customers are EQUAL. • Manual Evaluations • Multi Platform • Efficiency and Efficacy
  5. 5. WorldSpace - Deque • Hosted Testing Server • Scheduled scans • Public Facing Sites • Timeline of Compliance, not Errors • Sophisticated rules
  6. 6. FireEyes Plugin for WorldSpace • Plugs into Firebug • Manual scan of any page • Build automation scripts • Sync with WorldSpace
  7. 7. QuickBase and Worldspace Scores • Collaborative database for small businesses • Testing Tool + Product Implementation • Track error score and monthly change
  8. 8. Martini Test Library • Intuit’s Custom UI Test Automation Library • Selenium based framework • C.I. / C.D. • Low false errors
  9. 9. Martini Test Architecture
  10. 10. Acme Widgets • Good pages: 0 errors • Bad pages: Lots of errors • Open Source • fyvr.net/acme
  11. 11. Martini Accessibility Library
  12. 12. Customer Feedback • Everything at Intuit includes user testing • Product QE was our customer • TurboTax was an early adopter • Easy to integrate • Performance Improvements • Need Mobile Version
  13. 13. Performance Increase • One of the things observed was increase in the performance • Automation helped bump up these numbers • Time to run the tests was decreased from 9 minutes to 28.5 seconds.
  14. 14. Future Goals • More sophisticated tests • Documentation • Dashboard
  15. 15. • API-based testing product • Sophisticated tests • Easy to integrate with other tools • Requires passing code to external server • Internal hosting is possible
  16. 16. Nemo-Accessibility • Node-based testing server • Open source by PayPal • Choose your testing library • Code stays on Internal Server • JSON Response
  17. 17. …But Few Test For Accessibility Accessibility is used for testing
  18. 18. • Mobile testing framework –iOS –Android • Open Source
  19. 19. UI Automation - Android • Appium at Intuit • Google Test Frameworks –Espresso –Robolectric • AccessibilityChecks
  20. 20. INTEGRATING ACCESSIBILITY CHECKS WITH APPIUM • 2 Key Options – AccessibilityChecks logic + Appium – AccessibilityChecks as a service Service Solution • Easier integration • Google Updates
  21. 21. Android Lint • Static Code Analysis • Built Into Android Studio and Eclipse • Easy to Use • Provides solutions and information • Pre-build checking
  22. 22. Accessibility Automation - iOS • Appium is standard UI Test Framework • Build Standard Tests for Appium • Instruments – Apple Framework
  23. 23. Deque’s xCode Plugin • xCode Integration • Easy to use • Deprecated • New tool soon
  24. 24. Accessibility Automation - Mac OSX • Still in Research Phase • PyAtom: Python based UI • Frankk: Cucumber
  25. 25. Accessibility Automation: Windows • No consistency between products • Largely manual testing • Accessibility = Automated testing • C++ and .Net
  26. 26. Refactoring Layers • QBForms – Custom objects • QBForms built on C++ • Code refactoring in C# and .Net • Hope to make life easy!!
  27. 27. Results • Long Tail Monitoring • Reduced Barrier of Entry • Greater Awareness • Lower Costs

×