Matteo Doni Mobile Test Engineer, Certified Agile Tester & ScrumMaster, UK Skyscanner Android Native App & Web Test Strategy

1. Droidcon Dubai 2015 -
Android Native App &
Web Test Strategy
Matteo Doni – Test Engineer
April 15th 2015

2. Droidcon Dubai 2015 – Android Native App & Web Test Strategy

3. Droidcon Dubai 2015 – Android Native App & Web Test Strategy

4. Droidcon Dubai 2015 – Android Native App & Web Test Strategy
Outlier
Analysis
Platform, OS, Screen Size,
Visit number, Conversion Rate
Crash Meta Data,
Preferred Network access, Carrier
Mix
Other Factors
Blended &
Weighted Mobile
TE Strategy
Internal
Considerations
External
Considerations
Test
Configurations
Test Conditions
Device
Network
OS Version
Settings
Browser
Test
Configurations
Platforms, Devices,
Demographics, OS
Versions, Carriers
Interrupts, Battery,
Incoming, Transitions
Test Conditions

5. Droidcon Dubai 2015 – Android Native App & Web Test Strategy
Image Credit: Daniel Spiess,
Flickr http://goo.gl/FcnxEC
Image Credit: James Cridland,
Flickr http://goo.gl/Rnp3Qk

6. Droidcon Dubai 2015 – Android Native App & Web Test Strategy
Image Credit: James Cridland, Flickr http://goo.gl/Rnp3Qk
Crowd
Testing

7. Droidcon Dubai 2015 – Android Native App & Web Test Strategy
Crowdsourced Testing
• Widens overall coverage of testing
• Testers are in different locales/network conditions
• Very useful for usability testing and localisation testing
• Device/OS/Network mix can be widened greatly

8. Droidcon Dubai 2015 – Android Native App & Web Test Strategy
Image Credit: Daniel Spiess,
Flickr http://goo.gl/FcnxEC
Image Credit: James Cridland,
Flickr http://goo.gl/Rnp3Qk

9. Droidcon Dubai 2015 – Android Native App & Web Test Strategy
Cloud
Testing
Image Credit: Daniel Spiess, Flickr http://goo.gl/FcnxEC

10. Droidcon Dubai 2015 – Android Native App & Web Test Strategy
Cloud Testing
• Uses cloud infrastructure to simulate real world usage
• Can be a mix of emulators/simulators and real devices
• Feedback for analysis can be in stack trace, recorded
session, image and video
• Most often used for compatibility, stress, performance and
functional testing

11. Droidcon Dubai 2015 – Android Native App & Web Test Strategy
Image Credit: Daniel Spiess,
Flickr http://goo.gl/FcnxEC
Image Credit: James Cridland,
Flickr http://goo.gl/Rnp3Qk

12. Droidcon Dubai 2015 – Android Native App & Web Test Strategy
Internal
Testing

13. Droidcon Dubai 2015 – Android Native App & Web Test Strategy
Automated Testing
From Unit to Functional
Manual Exploratory
Both Testers and users across the business
Acceptance Testing
Supporting product owners

14. Droidcon Dubai 2015 – Android Native App & Web Test Strategy
In a Nutshell:
• Cyclic Data Driven Strategy
• Constant Quality Improvement
• Automation, Automation, Automation!
• Extended Reach with Cloud and Crowd
• In-house Exploratory Testing

15. Droidcon Dubai 2015 – Android Native App & Web Test Strategy
Image Credit: Daniel Spiess,
Flickr http://goo.gl/FcnxEC
Image Credit: James Cridland,
Flickr http://goo.gl/Rnp3Qk

16. Droidcon Dubai 2015 – Android Native App & Web Test Strategy
QA ≠ Q&A

17. Droidcon Dubai 2015 – Android: More Than Google’s OS
+MatteoDoni
@Todoleo
Matteo Doni

18. Edinburgh • Glasgow • Singapore • Beijing • Miami • Barcelona • Shenzen • Sofia • Budapest
Thank you!
www.skyscanner.net/jobs