Downloaded 11 times
Uploaded bySOASTA
5 Keys to Your Best Automated Testing Strategy
The document outlines five key considerations for an effective automated testing strategy for mobile applications, emphasizing the importance of knowing what to automate, understanding the complexities of mobile testing, and the necessity of a well-designed regression suite. It highlights the critical impact of quality assurance on customer satisfaction and the challenges posed by the fast-paced mobile landscape. Additionally, it suggests the use of mobile-specific automation platforms to enhance testing efficiency and effectiveness.
More Related Content
Similar to 5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy
- 1. Welcome. 5 Keys toYour Best Automated Testing Strategy November 18th, 2015 We will start at 10:02pm PT
- 2. Propelics creates mobilestrategies and world-class Apps for the Enterprise. Propelics: Background • 15+ year track record • Founded in 2011 • Fortune 500 focus • Global delivery experience Trusted by some of the largest global brands: • 100% focused on digital and mobile for the Enterprise • San Jose, Boston, Pittsburgh, Guadalajara 2
- 3. © 2015 SOASTA.All rights reserved. 3 November 18, 2015 Delivering Performance for Industry Leaders Media & EntertainmentConsumerFinancial Hi-Tech GlobalRetail
- 4. Shahab Choudhry: Partner- Propelics Shahab is a visionary thought leader who has been at the forefront of trying to make sense of the various technology shifts in the past two decades. He has advised several startups, early stage companies and Fortune 500 companies in making the most of these technology shifts. He continues to be a “Trusted Advisor” to some of the leading brands around the world. Shahab is frequent speaker at conferences related to mobile. 4
- 5. Tom Chavez– SOASTAProduct Evangelist 5 Tom Chavez has more than twenty years of experience as a manager and product manager in the software development tools field. Today Tom works in product management at SOASTA, the leader in performance analytics. He has worked across the Silicon Valley at industry leaders including Apple, Sun, PalmSource, and Intuit delivering tools for Mac, Java, PalmOS, Linux and Android development and testing. He speaks frequently at industry conferences and meet-ups. Follow Tom on twitter @TomChavez
- 6. Q: What are thekey considerations for my Mobile Testing Automation Strategy? 6
- 7.
- 8. Reality #1: QA andTesting have an Impact on Customer Value, End-User Experience and Customer Satisfaction 76% of the executives interviewed saying it is important or very important 8
- 9. Reality #2: The UnforgivingUser Quick to download - Quick to delete 74% of downloaded apps are opened only once 40% of apps are deleted after first use Average expected wait time for a app to launch is 2 sec Top reason for deleting apps – app crashed Enterprise Expectation = Consumer Experience Gift of Consumerization 9
- 10. Reality #3: Mobile isplaying a more integral role More and more from Apps 10 Flurry Analytics
- 11. Reality #4: 35% ofthe QA and Testing budget for new development is spent on mobile 11 World Quality Report 2015 - 2016
- 12. Reality #5: Mobile isdifferent – Hard to keep up and it is not getting any easier 12 World Quality Report 2015 - 2016
- 13. 5 Keys toYour Best Automated Testing Strategy
- 14. 1. Don’t tryto Automate everything
- 15. 1. Don’t tryto Automate everything 15 • Know when and what to automate • Core Test Cases • Low rate of change – mature functionality and UX • Repetitive/Mundane – Testing Fatigue and Human Error • Some test cases can only be tested in non-automated ways • Not all apps in your portfolio are good candidates for automation • Apps that have a high impact • Large User Base • Multiple devices
- 16. Mobile App Portfolio– App Assessment Framework 16
- 17. Mobile App TestingAutomaton Roadmap 17
- 18. Mobile Testing AutomatonRoadmap - Ranking 18 Business Criticality (H,M,L) Core/frequently used functionality, Security/data breach/privacy/legal, Dependence on 3rd Party data or technology, User experience impact Value of Automation (H,M,L) Increases quality, Reduces resource load, High volume/Repetitive/Data driven, Feature life-span, Smoke test/Build verification Automation Readiness (H,M,L) Test Script Complexity, Stable Functionality, Measurable results, Recordable actions, Explicit list of observable steps, Test Script Maintainability Ease of Automation (H,M,L) Data or logic driven, Object level user interface, Known expected results around user experience, Clear acceptance criteria per test case, Minimal performance issues interacting with external end points or services
- 19. 2. Understand the impactof the “New Math”
- 20. 20 Mobile Testing: TheComplexity Equation # of supported devices # of supported OSes OS updates per year Number of Apps # of test cases per app App release frequency The “I can barely keep up” syndrome X
- 21. 3. Automation isnot an “Instant Fix”
- 23. 4. Take thetime to Design the Regression Suite
- 24. 4. Take thetime to Design the Regression Suite • Spend time to analyze each app, user stories and test cases • Look for re-usable elements • Design the regression suite with components that when updated can be inherited by other test cases • Starting to “record” scripts without a plan can lead to rework later.
- 25. 5. Use aMobile Specific Automation Platform
- 26. 5. Use aMobile Specific Automation Platform • Support of mobile device specific functionality • Accommodate device types • Ease of use – Minimal requirement for programming languages to record scripts
- 27. 1. Don’t tryto automate everything 2. Understand the impact of the “New Math” 3. Automation is not an “Instant fix” 4. Take the time to design the Regression Suite 5. Use a mobile specific automation platform 5 Keys to Your Best Automated Testing Strategy
- 28.
- 29. Propelics Mobile TestingServices • Mobile Testing Readiness Kickstart • Mobile Test Automation Kickstart • Mobile Testing as a Managed Service • SOASTA TouchTest Training and Advisory Services
- 31. Webinar Attendee SpecialOffer 31 Special Offer Free 1 Hour Mobile Advisory Call info@propelics.com 888-405-2820 Testing Strategy For Mobile App Scoping & Prototype Enterprise Mobile Roadmap IT Strategy for Mobile Mobile UI/UX Design Mobile COE Mobile Testing Automation
- 32. 32 Thank you forattending!
Editor's Notes
- #4 This is just a sampling of all of our customers. Household brands across every vertical utilize SOASTA technology and services everyday. The top 10 retailers like Walmart, Target, Staples and Grainger turn to us because of fast, actionable results at production scale. Financial services companies like Fidelity and Paychex trust us with critical everyday testing as well as planning for major spikes and events. Nike, Apple, Coke, Disney all protect their brands and reputations by covering use cases and scalability scenarios that match reality, and our customers are global and international…Even Nasa utilizes SOASTA to assure space programs are ready for prime time online viewers.