This document provides an overview of mobile app testing challenges and best practices. It discusses the different types of mobile apps (native, mobile web, and hybrid), as well as challenges related to the large number of devices and OS versions, simulating real-life scenarios, usability, and development practices. Automation testing tools are presented, along with the importance of selecting representative devices for testing, simulating real-life scenarios, monitoring device logs, and using automation selectively on devices and simulators. The document concludes by offering ThoughtWorks' mobile app testing services.

1. Learnings –
Mobile Apps Testing
Dubinsky Soares
Manisha Awasthi

2. The World of Mobile Apps

3. Native
Native: An app build purely
using the components build
using the underlying platform
e.g. objective C, Java
Native app examples: Calendar,
Calculator

4. Mobile Web
It’s a web site which run on Mobile
phones.
Many companies go for a mobile
web instead of building an app as
its platform independent.
e.g. m.timesofindia.com,
m.facebook.com

5. Hybrid
Hybrid: An app build using
combination of HTML 5 with the
native components.This approach
helps in making the app platform
independent in some Way.
Frameworks based on it
Calatrava, PhoneGap
e.g. LinkedIn app, Facebook app

6. Challenges in Testing Mobile apps
Number of Devices & OS versions (Hardware configuration)
– Display density
– Different Browsers
– Network connections
– Installation issues

7. The Best Phone in the World

8. Challenges in Testing Mobile apps
Simulating real life scenarios
•
•
•
•
Call Interrupts
Low Battery
Alarms
Network Issues

9. Challenges in Testing Mobile apps
Usability
•
Accessibility
•
Identity
•
Navigation
•
Content

10. Challenges in Testing Mobile apps
Developmental
Practices
Automation
Tools
What to Automate???
Effort v/s Value

11. Non Functional Testing

12. Key Learnings

13. Ensure coverage on various devices
Select a set of
representative devices
Test End to End Flow on
each device
Extensively use Simulators

14. Ensure testing of real life scenarios
Apps can behave erratically
when
-Multiple process run in the
background
-Hardware is incompatible
-Memory Warnings are thrown

15. Constant Monitoring of Device Logs
Uncover potential problems
before they occur.
Extremely helpful to understand
the API calls the app makes

16. Showcase Tools
IOS – Reflections
Android- Android Projector
Extremely useful tools to
demo your app to clients

17. Automation Tools
Frank
Calabash
MonkeyTalk
Sikuili
UIAutomation

18. Automation Tools
Robotium
Calabash
MonkeyTalk
Sikuili
Native Driver
Android Instrumentation

19. Automation Tools
Android Driver
iPhone Driver
Watir

20. Automation Tools
MobiTest
Google Page Speed
Load Runner
Jmeter

21. Cloud Testing Services
Perfecto Mobile
Device Anywhere

22. All this talk …. Lets see something work !

23. Key Learning’s
Use simulators to get the breadth of devices tested.
Testing on different Display density mobiles
Keep an eye on smaller details as well
Simulating real life scenarios
Constant monitoring of device logs while testing
Selective automation on Devices/simulators

25. How can we help?
Dr ag
p ic tu r
e to p a
l c eho
ld er o
r cl ick
ThoughtWorks is a global custom software solutions consultancy trusted by
many of the world’s leading businesses with their most complex and critical
systems. We deliver consulting grounded in delivery expertise, build custom
applications and help organisations across all market sectors to drive IT
efficiency – working to an exceptionally high standard.
Contact us
dubinsky@thoughtworks.com
manishaa@thoughtworks.com
Private and Confidential. © 2012 ThoughtWorks. All rights reserved.