Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Test Armada Sauce Labs

96 views

Published on

Shows how Test Armada and Sauce Labs work together to create a more productive and informative testing infrastructure

Published in: Software
  • Be the first to comment

Test Armada Sauce Labs

  1. 1. Sauce Labs at Walmart Labs QUALITY AUTOMATION TOOLING SUITE Wednesday June 27th, 2018
  2. 2. • Introduction • Test Armada • Solving testing problems at Walmart scale • Sauce Labs Partnership • Impact • Q & A AGENDA
  3. 3. Praveen Kulkarni Sr. Engineering Manager Developer Experience Tools Build products that enhance developer productivity
  4. 4. End to end test platform for web, native, and backend services with actionable reporting capabilities
  5. 5. The Test Armada Fleets PERFORMANCE TESTINGFUNCTIONAL TESTING DATA INSIGHTS MOCKING ACCESSIBILITY TESTING SECURITY
  6. 6. Solving Testing Problems at Walmart Scale
  7. 7. Problem Statement • Problem Statement : • No Automation or lack of efficiencies • Less frequent production deployment : twice a month at best • High defect escape rate
  8. 8. Functional Fleet Overview Jenkins Consistency Results Analytics BaaS & DaaS
  9. 9. Sauce Labs Partnership • Key Benefits • Lets us focus on building automation products to increase frequency of deployments • Faster availability of new devices and browsers • One setup and one access point for all teams in the organization • Key Metrics • 50K+ tests executed per day and growing • 1150 OS/Browser combinations • Devices and Emulators * Exclusive access to 81 devices in private cloud Real Devices Emulators 303* 172
  10. 10. Impact ENABLES MASSIVELY PARALLEL RELIABLE & DETERMINISTIC ACTIONABLE DASHBOARDS Ability to process hundreds of test cases simultaneously to speed up overall completion of a test suite Smart Retry feature and mocking guard against flaky test Real-time and trending metrics provide valuable insights to help debug/troubleshoot quality issues Adoption: 74 teams Test Cases: 13.2K Executions: 14.5 million+ tests Multi-Tenant Platform supporting 8 product organizations Effort saving 900K + hours ~ 425 man years
  11. 11. http://testarmada.io
  12. 12. Q/A

×