This document summarizes a presentation on mobile testing. It discusses the growth of mobile devices and apps, challenges in mobile testing like varied platforms and devices, and tools for mobile testing like emulators, automation, and beta testing. It also describes a mobile testing contest held at the conference between developers and testers involving questions about mobile history, bugs, and security.

1. Romanian Testing Conference 2014 – Cluj NapocaBaris Sarialioglu
Testing on The Move, Mobile Testing

2. My Book

3. Agenda
¨ Mobile World
¨ Mobile Challenges
¨ Mobile Testing Tools
¨ Testing Contest

4. Mobile World

5. We have computers in our pockets!
“Phone users want
computers in their
pockets.
T h e d a y s w h e r e
p h o n e s a r e u s e d
primarily to make
phone calls and send
text messages are
quickly fading away”

7. What Type of Apps?
Source: SmartBear Blog

8. Do you plan to enter Mobile Space?
Source: SmartBear Blog

9. How long have you been in Mobile Space?
Source: SmartBear Blog

10. How many Apps fail?
q More than 50% of users are deleting a Mobile App, if
they encounter just a Single BUG!
q Nearly 50% of apps are downloaded and used just once!

11. Mobile Challenges

12. Generic Challenges
# of Platforms / OS1
Device Variety2
Displays Pixel Density3
Hardware Complexity4
App Complexity5
Security6
Carriers & Providers7
Limitations over PCs8
Native Apps vs. Mobile Web9

13. Test Specific Challenges
Dynamic SDLCs1
Need for Regression Testing2
Back-end Testing3
Performance Testing4
Do not have the Right Tools5
Lack of Mobile Testing Experts6
No Time to Test7
Do not have Right Methodology8
Do not have the Devices & Environment9

14. Mobile Testing Tools

16. 1-Mobile Consumer Behaviour
http://www.thinkwithgoogle.com/mobileplanet/en/

17. 2-Mobile Purchase Journey
http://think.withgoogle.com/mobile-purchase-journey/

18. 3-Mobile Statistics
http://marketshare.hitslink.com/

19. 4-Mobile Friendliness Testing
http://www.howtogomo.com/en-gb/d/test-your-site/

20. 5-Mobile Friendliness Testing
http://validator.w3.org/mobile/

21. 6-Mobile Usability Testing
http://www.feedbackarmy.com/
http://fivesecondtest.com/

22. 7-Mobile Compatibility Testing
GhostLab, Remote Preview
Adobe Edge Inspect, Grunt, Livestyle

23. 8-Mobile Usability Testing - Prototyping
http://balsamiq.com/

24. 9-Mobile Usability Testing - Prototyping
http://www.invisionapp.com/

25. 10-Mobile Performance Testing
http://mobitest.akamai.com/m/index.cgi

26. 11-Mobile Performance Testing
http://mite.keynote.com/

27. 12-Mobile Performance Testing
http://loadimpact.com/

28. 13-Mobile Test Automation
http://www.sikuli.org/

29. 14-Mobile Test Automation
https://app.testobject.com/login/

30. 15-Mobile Test Automation
http://www.telerik.com/mobile-testing

31. 16-Mobile Test Automation
http://www.ranorex.com/mobile-automation-testing.html

32. 17-Live Mobile Testing & Distribution
http://hockeyapp.net/

33. 18-Mobile Beta Testing & Distribution
http://testflightapp.com/

34. 19-Mobile Hardware Testing & Assembly
http://www.ifixit.com/Device/iPhone

35. Tool Selection Tips
q Do PoCs!! Try to experience as many tools as possible.
q Check Jailbreaking and Rooting.
q Check if manual scripting (handcoding) is allowed and IDE / language is
adoptable.
q Real Device (Recommended) or Emulator Support.
q Object and/or Image Recognition.
q Functionalities supported – Swipe, drag & drop, zoom, scrolling, pinching,
rotating, shaking etc.
q Check integration with Test Management Tools and/or TM capabilities.
q Check scheduling and ordering of Test Cases/Scenarios.
q Check cross-platform support & Lead time for new OS versions.
q Check reporting & archiving capabilities.
q Check DB access and Data Connectors (White / Grey Box Testing)
q Check Price & Service Support
q Test the tool in your local environment (Network, Firewall, Applications, DBs
etc.)

36. Mobile Testing Contest

37. Mobile Testing Contest
q Developers vs. Testers
q 6 questions
q 30 seconds think-time
q First-honk basis answering
q Winner group gets the prize

38. Question 1
When was the first Mobile call?
a. 1946
b. 1973
c. 1986
d. 1992
Times Up!

39. Question 2
What is “Heisenbug”?
a. A city in Germany
b. A bug that disappears when one
attempts to analyze it
c. A character in TV series “Breaking Bad”
d. A bug with catastrophic behavior
Times Up!

40. Question 3
What was the first SMS message in
history?
a. Hello World
b. I love you
c. Merry Christmas
d. Test
Times Up!

41. Question 4
Which one is true for Emulators
& Simulators?
a. Emulators do include hardware
conditions
b. Simulators are more real
c. Emulators fake the behavior of the
device
d. Virtual PC’s are examples of
simulators
Times Up!

42. Question 5
Non-repudiation & integrity are covered
in,
a. Network Testing
b. Installability Testing
c. Security Testing
d. Conformance Testing
Times Up!

43. Question 6
How many apps are downloaded from
Apple Store in between 2008 & 2013?
a. Around 1 billion
b. Around 20 billions
c. Around 60 billions
d. Around 100 billions
Times Up!

44. Romanian Testing Conference 2014 – Cluj NapocaBaris Sarialioglu