Downloaded 13 times
Uploaded byTest Armada
Test Armada Sauce Labs
The document discusses Walmart Labs' implementation of Sauce Labs for quality automation tooling aimed at improving developer productivity and testing efficiency. Key benefits include increased deployment frequency, reduced defect escape rates, and extensive testing capabilities with significant metrics highlighting test executions and device accessibility. The partnership has saved over 900,000 hours of effort across multiple product organizations.
![[Infographic] Challenges in Test Automation](https://cdn.slidesharecdn.com/ss_thumbnails/challengesintestautomation-180613090723-thumbnail.jpg?width=640&height=640&fit=bounds)
Test Armada Sauce Labs
- 1. Sauce Labs atWalmart Labs QUALITY AUTOMATION TOOLING SUITE Wednesday June 27th, 2018
- 2. • Introduction • TestArmada • Solving testing problems at Walmart scale • Sauce Labs Partnership • Impact • Q & A AGENDA
- 3. Praveen Kulkarni Sr. EngineeringManager Developer Experience Tools Build products that enhance developer productivity
- 4. End to endtest platform for web, native, and backend services with actionable reporting capabilities
- 5. The Test ArmadaFleets PERFORMANCE TESTINGFUNCTIONAL TESTING DATA INSIGHTS MOCKING ACCESSIBILITY TESTING SECURITY
- 6. Solving Testing Problemsat Walmart Scale
- 7. Problem Statement • ProblemStatement : • No Automation or lack of efficiencies • Less frequent production deployment : twice a month at best • High defect escape rate
- 8.
- 9. Sauce Labs Partnership •Key Benefits • Lets us focus on building automation products to increase frequency of deployments • Faster availability of new devices and browsers • One setup and one access point for all teams in the organization • Key Metrics • 50K+ tests executed per day and growing • 1150 OS/Browser combinations • Devices and Emulators * Exclusive access to 81 devices in private cloud Real Devices Emulators 303* 172
- 10. Impact ENABLES MASSIVELY PARALLEL RELIABLE &DETERMINISTIC ACTIONABLE DASHBOARDS Ability to process hundreds of test cases simultaneously to speed up overall completion of a test suite Smart Retry feature and mocking guard against flaky test Real-time and trending metrics provide valuable insights to help debug/troubleshoot quality issues Adoption: 74 teams Test Cases: 13.2K Executions: 14.5 million+ tests Multi-Tenant Platform supporting 8 product organizations Effort saving 900K + hours ~ 425 man years
- 11.
- 12.
Editor's Notes
- #2 Good morning everyone Introduce myself We are jump starting a 5 part series to showcase our Test Armada quality automation tooling suite. Today is part 1 of the series, where we will re-introduce Test Armada to Walmart. This talk will lay the foundation for the remainder of the series scheduled over the next couple of months
- #5 Original Message: End to end test platform to cover functional and performance testing for web, native, and backend services in different environments with reporting capabilities.
- #6 Let’s take a look at what TA offers… Let’s take a look at the name. Armada is a fleet of warships used in a time of battle. As part of our re-branding efforts, we applied this meaning to Test Armada, where the Test Armada Fleets would be the supporting tools to help battled against operational efficiencies. We provide functional and performance testing TDKs for web, native, and backend services A data insights platform to review runtime and trending quality automation metrics for your test runs. And mocking framework to help remove dependencies on external services, seed data management, and prototype needs In the future we are looking at supporting two additional Fleets: Security and ADA Pranav will go into a more details of our new and improve Test Armada tool suite shortly. How does TA fit into the overall CI/CD eco-system here at Walmart?
- #7 Original Message: End to end test platform to cover functional and performance testing for web, native, and backend services in different environments with reporting capabilities.