Test Armada Sauce Labs
•Download as PPTX, PDF•
2 likes•1,357 views
Shows how Test Armada and Sauce Labs work together to create a more productive and informative testing infrastructure
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Test Armada Sauce Labs
Similar to Test Armada Sauce Labs (20)
Recently uploaded
Recently uploaded (20)
Test Armada Sauce Labs
- 1. Sauce Labs at Walmart Labs QUALITY AUTOMATION TOOLING SUITE Wednesday June 27th, 2018
- 2. • Introduction • Test Armada • Solving testing problems at Walmart scale • Sauce Labs Partnership • Impact • Q & A AGENDA
- 3. Praveen Kulkarni Sr. Engineering Manager Developer Experience Tools Build products that enhance developer productivity
- 4. End to end test platform for web, native, and backend services with actionable reporting capabilities
- 5. The Test Armada Fleets PERFORMANCE TESTINGFUNCTIONAL TESTING DATA INSIGHTS MOCKING ACCESSIBILITY TESTING SECURITY
- 6. Solving Testing Problems at Walmart Scale
- 7. Problem Statement • Problem Statement : • No Automation or lack of efficiencies • Less frequent production deployment : twice a month at best • High defect escape rate
- 9. Sauce Labs Partnership • Key Benefits • Lets us focus on building automation products to increase frequency of deployments • Faster availability of new devices and browsers • One setup and one access point for all teams in the organization • Key Metrics • 50K+ tests executed per day and growing • 1150 OS/Browser combinations • Devices and Emulators * Exclusive access to 81 devices in private cloud Real Devices Emulators 303* 172
- 10. Impact ENABLES MASSIVELY PARALLEL RELIABLE & DETERMINISTIC ACTIONABLE DASHBOARDS Ability to process hundreds of test cases simultaneously to speed up overall completion of a test suite Smart Retry feature and mocking guard against flaky test Real-time and trending metrics provide valuable insights to help debug/troubleshoot quality issues Adoption: 74 teams Test Cases: 13.2K Executions: 14.5 million+ tests Multi-Tenant Platform supporting 8 product organizations Effort saving 900K + hours ~ 425 man years
- 12. Q/A
Editor's Notes
- Good morning everyone Introduce myself We are jump starting a 5 part series to showcase our Test Armada quality automation tooling suite. Today is part 1 of the series, where we will re-introduce Test Armada to Walmart. This talk will lay the foundation for the remainder of the series scheduled over the next couple of months
- Original Message: End to end test platform to cover functional and performance testing for web, native, and backend services in different environments with reporting capabilities.
- Let’s take a look at what TA offers… Let’s take a look at the name. Armada is a fleet of warships used in a time of battle. As part of our re-branding efforts, we applied this meaning to Test Armada, where the Test Armada Fleets would be the supporting tools to help battled against operational efficiencies. We provide functional and performance testing TDKs for web, native, and backend services A data insights platform to review runtime and trending quality automation metrics for your test runs. And mocking framework to help remove dependencies on external services, seed data management, and prototype needs In the future we are looking at supporting two additional Fleets: Security and ADA Pranav will go into a more details of our new and improve Test Armada tool suite shortly. How does TA fit into the overall CI/CD eco-system here at Walmart?
- Original Message: End to end test platform to cover functional and performance testing for web, native, and backend services in different environments with reporting capabilities.