This document summarizes a webinar on better mobile testing for user experience. The webinar covered types of mobile devices and apps, defined user experience, and described different types of tests to evaluate the user experience, including tests for look/display, feel/accessibility, performance, trainability, and recovery from unexpected behavior. Examples were given of specific tests for Twitter apps on different devices to check factors like text size, readability, screen usage, colors, navigation and more. The conclusion emphasized that testing user experience involves evaluating how useful, findable, accessible, desirable and valuable an app is for the user.

1. JeanAnn Harrison
& Phil Lew
Better Mobile Testing for
Better User Experience

2. XBOSoft info
• Founded in 2006
• Dedicated to software quality
• Software QA consulting
• Software testing services
• Offices in San Francisco, Beijing, Oslo and
Amsterdam

3. On the XBO side:
Amy Jan
•
Upcoming Webinar : 9/26/13 11am EST
Plan your Attack-Software Testing for Mobile
and Embedded Devices – with Jon Hagar

4. Housekeeping
• Everyone except the speaker is muted
• Questions via the gotowebinar control on the right side of your
screen
• Questions can be asked throughout the webinar, we’ll try to fit
them in when appropriate
• General Q & A at the end of the webinar
• You will receive info on recording after the webinar
Jean Ann Harrison Copyright 2013 4

5. About Phil Lew
Dr. Philip Lew, CEO of XBOSoft, is a
regular speaker at QA and software
testing conferences, published author
and is currently doing research on
user experience.
Mr. Lew is also an Adjunct Professor
at Alaska Pacific University and
Project Management College teaching
graduate courses in software
engineering, software quality
assurance, IT project management,
and IT Governance.

6. About JeanAnn Harrison
JeanAnn Harrison regularly speaks at
industry conferences and is published in
software testing magazines.
She has years of experience with mobile
testing and is a well-known figure in the
QA and software testing community.
Besides software testing , JeanAnn is an avid
fan of baseball & ice skating.
Jean Ann Harrison Copyright 2013 6

7. WEBINAR:
BETTER MOBILE TESTING FOR
BETTER USER EXPERIENCE
JEAN ANN HARRISON
Software Test Consultant for
Project Realms.
FOR MOBILE AND EMBEDDED TESTERS
Jean Ann Harrison Copyright 2013
Dr. Philip Lew
CEO
XBOSoft, Inc
7

8. AGENDA
Jean Ann Harrison Copyright 2013
• Types of devices & Types of
Mobile Apps
• Definition of User Experience
• Types of Tests
• Examples of UX Tests
• Conclusion
• Q & A
8

9. MOBILE/EMBEDDED SOFTWARE &
DEVICES
• Mobile phones, tablets
• Proprietary devices: mobile heart monitors, law enforcement
ticket generators, restaurant personnel taking customer orders
on devices, GPS devices, PDAs
• Embedded Software examples: automobile’s computer system,
air traffic control systems, airplane navigation system, drug
infusion pumps in hospital rooms, elevators, cameras, robots
Jean Ann Harrison Copyright 2013 9

10. TYPES OF MOBILE
APPS
• Native Applications
• Local to device
• Hybrid Applications
• Local to device but
interacts w/internet
• Web Applications
• Not local to device. All
interactions on internet
Jean Ann Harrison Copyright 2013 10

11. USER EXPERIENCE-
DEFINITION
Jean Ann Harrison Copyright 2013
USEFUL
DESIRABLE
FINDABLE
CREDIBLE
VALUABLE
USABLE
ACCESSIBLE
11

12. USER EXPERIENCE
- TESTS
Jean Ann Harrison Copyright 2013
• Look - display
• Feel - accessibility
• Performance
• Installations/Downloads
• Trainability - Intuitive Experience
• Recovery of Unexpected Behavior
12

13. LOOK -
DISPLAYS
• Text size
• Font of text
• Filling out screen
display surface
• Colors
• Brightness
Jean Ann Harrison Copyright 2013 13

14. IPAD MINI TWITTER
HOME PAGE
Jean Ann Harrison Copyright 2013
• Useful: Navigation button location
useful?
• Accessibility: Is the Font readable?
• Usable: Does the display fill out
the screen?
• Desirable: Are the colors pleasing
to the eye?
• Findable: Are functions easy to
see?
• Valuable: Are these functions
displayed valuable for the user on
the Home Page?
14

15. IPAD2 TWITTER HOME
PAGE
Jean Ann Harrison Copyright 2013
• Useful: Text size work for the
page?
• Accessibility: Is the Font readable?
• Usable: Does the display fill out
the screen?
• Desirable: Are the colors pleasing
to the eye?
• Findable: Are functions easy to
see?
• Valuable: Are these functions
displayed valuable for the user on
the Home Page?
15

16. IPHONE 5 TWITTER
HOME PAGE
Jean Ann Harrison Copyright 2013
• Useful: Text size work for the
page?
• Accessibility: Is the Font readable?
• Usable: Does the display fill out
the screen?
• Desirable: Are the colors pleasing
to the eye?
• Findable: Are functions easy to
see?
• Valuable: Are these functions
displayed valuable for the user on
the Home Page?
16

17. KINDLE FIRE
TWITTER HOME
PAGE
Jean Ann Harrison Copyright 2013
• Useful: Text size work for the
page?
• Accessibility: Is the Font readable?
• Usable: Does the display fill out
the screen?
• Desirable: Are the colors pleasing
to the eye?
• Findable: Are functions easy to
see?
• Valuable: Are these functions
displayed valuable for the user on
the Home Page?
17

18. ANDROID PHONE
TWITTER HOME
PAGE
Jean Ann Harrison Copyright 2013
• Useful: Text size work for the
page?
• Accessibility: Is the Font readable?
• Usable: Does the display fill out
the screen?
• Desirable: Are the colors pleasing
to the eye?
• Findable: Are functions easy to
see?
• Valuable: Are these functions
displayed valuable for the user on
the Home Page?
18

19. FEEL/ACCESSIBILITY
TESTS
• Navigation - scrolling
• Screen Rotation -
Portrait/Landscape
• Images & Links reaching
same target grouped into
one touch zone?
• Language accessible?
• Is all functionality
viewable?
Jean Ann Harrison Copyright 2013 19

20. IPAD2 ROTATION OF
CONNECT PAGE
Jean Ann Harrison Copyright 2013 20

21. IPHONE ROTATION OF
CONNECT PAGE
Jean Ann Harrison Copyright 2013
Currently, there is no way
to rotate the screen on
the iPhone to view this
application's page in
Landscape view. iOS7
was not tested. Only iOS6
was tested.
21

22. KINDLE ROTATION OF
CONTACT PAGE
Jean Ann Harrison Copyright 2013 22

23. ANDROID PHONE ROTATION
OF CONTACT PAGE
Jean Ann Harrison Copyright 2013 23

24. PERFORMANCE
• Downloading apps
• Removing apps
• Network Communication
• Onboard Database searches
• Interrupts & Resume
• Device/battery temperatures
Jean Ann Harrison Copyright 2013 24

25. PERFORMANCE -
USEFUL? IPAD2
PERFORMANCE
Jean Ann Harrison Copyright 2013
What happens when downloading of an
application is a useful performance measurement.
25

26. PERFORMANCE - USEFUL?
KINDLE(ANDROID)
PERFORMANCE
Jean Ann Harrison Copyright 2013
What happens when downloading of an
application is a useful performance measurement.
26

27. PERFORMANCE - USEFUL?
ANDROID PHONE
PERFORMANCE
Jean Ann Harrison Copyright 2013
Clear progression of the
installation. The user knows
exactly where the
downloading/installation is
in process
27

28. TRAINABILTY TESTS - NEED
HELP?
• Users learning to use the application without
Lookup Help
• Icons display functional usage
• Device differences in display are easily transferable
Jean Ann Harrison Copyright 2013 28

29. TRAINABILITY: USEFUL,
FINDABLE, ACCESSIBLE - IOS
Jean Ann Harrison Copyright 2013 29

30. TRAINABILITY: USEFUL,
FINDABLE, ACCESSIBLE -
ANDROID
Jean Ann Harrison Copyright 2013 30

31. CONCLUSION
• Testing the User Experience can be defined by considering how useful the
application is for the user's purpose - why did the user download the
application?
• Testing the User Experience can be defined by how easily findable and
accessible the application's functionality is - can user navigate through the
functionality?
• Testing the User Experience can be defined as to how desirable and whether
those desires meet the value of the user's purpose - does the application look
and feel make the user want to continue to use?
• Testing the User Experience can be defined as useable where the user can
figure out how to use the display to achieve purpose - can the user
understand what the icons ' purposes are.
Jean Ann Harrison Copyright 2013 31

32. JEAN ANN HARRISON’S
CONTACT INFORMATION
• EMAIL: jaharrison@projectrealms.com
• Twitter: https://twitter.com/JA_Harrison
Or @JA_Harrison
• Project Realms Inc website:
www.projectrealms.com
Jean Ann Harrison Copyright 2013
Q & A
32

33. REFERENC
ES
• Was assisted with submissions of IOS devices screenshots by the following:
Teri Charles, Software Tester, bouldertester.blogspot.com Twitter: @booksrg8
Michael Corum, Manager, Quality Assurance for a large media company Blog:
http://tnridgeback.blogspot.com/
• USER EXPERIENCE - DEFINITION
http://semanticstudios.com/publications/semantics/000029.php
• Performance slide of tests
http://www.organisationscience.com/styled-6/
Jean Ann Harrison Copyright 2013 33

34. Questions & Answers
Follow us: @XBOSoft
Questions: services@xbosoft.com
408-350-0508
Jean Ann Harrison Copyright 2013 34

35. Thanks for joining us today!
Join us next week for 9/26/13 at 11am (EST)
Plan your Attack-Software Testing for Mobile and Embedded
Devices
A webinar with Jon Hagar author of "Software Test Attacks to
Break Mobile and Embedded Devices"
http://www.xbosoft.com/knowledge_center/software_quality_b
log/
Jean Ann Harrison Copyright 2013 35