Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Building a culture of quality at scale

18 views

Published on

How to build a culture of quality at scale based on learnings from Walmart Labs

Published in: Software
  • Be the first to comment

  • Be the first to like this

Building a culture of quality at scale

  1. 1. Pranav Verma Sr. Engineering Manager Developer Experience Tools EMAIL: pverma@walmartlabs.com Building a Culture of Quality at Scale October 23, 2018 E X P E R I E N C E T O O L S CUSTO M ER E X P E R I E N C E T O O L S DEVELOPER
  2. 2. Agenda • Walmart Case Study • Test Armada Solution • Test Armada Usage • Q&A
  3. 3. E X P E R I E N C E T O O L S DEVELOPER A Cultural Shift in Quality Automation within Customer Experience Engineering 2016
  4. 4. E X P E R I E N C E T O O L S DEVELOPER You have 6 months to automate100% for your P1/P2 test cases
  5. 5. E X P E R I E N C E T O O L S DEVELOPER Automate 2000+ Manual Test Train 600 Associates On-board 25+ number of Apps Migrate FE to new Platform THE DETAILS
  6. 6. E X P E R I E N C E T O O L S DEVELOPER An Organization Going Through a Transformation DENIAL UPSET RESISTANCE ACCEPTANCE
  7. 7. The Before and After Transformation 2000+ Manual Test 100% P1/P2 Automated Lack of accountability around Quality Shared ownership of Quality 2 Deployments a month Daily deployments Test limited to a single browser Multi-browser combinations part of CI process
  8. 8. E X P E R I E N C E T O O L S DEVELOPER THE SOLUTION
  9. 9. End to end test platform for web, native, and backend services in different environments with reporting capabilities.
  10. 10. WHY IS TEST ARMADA NEEDED? Help Improve Development Process Best Practices Shift Left Policy Automate Testing Increase Test Data Integrity Ensure High Quality Product for the Customer
  11. 11. Test Armada Fleets PERFORMANCE TESTINGFUNCTIONAL TESTING DATA INSIGHTS MOCKING
  12. 12. Ecosystem REAL-TIME TRENDING FUNCTIONAL REAL-TIME TRENDING PERFORMANCE PUSH API PULL API API GATEWAY TEST ARMADA DATA INSIGHTS JS CLIENT JAVA CLIENT JS CLIENT JAVA CLIENT JS CLIENT JAVA CLIENT JS CLIENT JAVA CLIENT RWEB SERVICES NATIVE iOS DATABASE SQL JS CLIENT JAVA CLIENT JS CLIENT JAVA CLIENT NATIVE ANDROID DATABASE NoSQL TEST ARMADA MOCKING JS JS RWEB NATIVE iOS JS JAVA DECLARITIVE NATIVE ANDROID SERVICES TEST ARMADA FUNCTIONAL DECLARITIVE DECLARITIVE RWEB SERVICES SWIFT JAVA NATIVE iOS NATIVE ANDROID TEST ARMADA PERFORMANCE
  13. 13. TYPICAL DEVELOPER WORKFLOW CODE CHECK-IN PASS PASS FEATURE DEVELOPMENT PR VERIFY MASTER VERIFY PROD VERIFY WHERE Local Dev Environment WHAT Functional Tests HOW Mocked RESOURCES Local, Shared, 3rd Party WHERE Build Server WHAT Functional & Continuous Performance HOW Mocked RESOURCES Shared & 3rd Party WHERE Non-Prod WHAT Functional Tests HOW Mocked or Real Services RESOURCES Shared & 3rd Party WHERE Stage WHAT Functional & Performance HOW Real Services RESOURCES Shared & 3rd Party
  14. 14. Scope Across the Company TEAMS WE SUPPORT 85 projects in 2 years 200 projects by 2020 1.2M Development Hours Saved 19.5M Functional Tests Executed 196M Mocked API Calls LOCATIONS WE SUPPORT NUMBERS AT SCALE Bay Area San Diego Bangalore Canada Omaha Hoboken Bentonville UK Mexico Point of Sales RCT ASDA Growth USGM Jet.com Pharmacy GIF Store Systems OmniChannel Customer Promise Hayneedle USGR EXPO Portland
  15. 15. Q&A
  16. 16. Contact Us @testarmada github.com/testarmada http://www.testarmada.io

×