As organizations implement their mobile strategy, testing teams must support new technologies—while still maintaining existing systems. Melissa Tondi describes the major trends and innovations in mobile technology, usage patterns, tools, and test equipment that you should consider when transitioning existing test teams or starting new ones. Based on more than two years of research with a lab-based consultant team, Melissa focuses on areas that balance efficiency and productivity, including use of a Device Matrix technique to select devices to test against and when to use emulators and simulators rather than physical devices. She offers solutions to ensure you have a comprehensive mobile test strategy and focuses on challenges—including understanding mobile-specific integration testing and which automation tools to use—that have inundated traditional test teams. Melissa describes how to build a well-organized device lab and incorporate testing scenarios—such as gesture and interruption testing—that are unique to mobile.

1.
W11
Session
4/15/2015
2:00
PM
"Mobile Testing Trends and
Innovations"
Presented by:
Melissa Tondi
Denver Automation and Quality Engineering
Brought
to
you
by:
340
Corporate
Way,
Suite
300,
Orange
Park,
FL
32073
888-­‐268-­‐8770
·∙
904-­‐278-­‐0524
·∙
sqeinfo@sqe.com
·∙
www.sqe.com

2. Melissa Tondi
Denver Automation and Quality Engineering
Melissa Tondi has spent most of her career working within testing teams,
concentrating on functional, performance, security, and mobile testing
techniques. Now Melissa is back to being a practitioner, assisting agile teams to
continuously improve the design, build, test, and delivery of quality software. In
the software test and quality engineering field for more than fifteen years, she
focused on organizing testing teams around three major tenets—efficiency,
innovation, and culture. Melissa’s previous roles have included director of
software quality engineering in the world's leading education company; QA
consultant for health care, finance, and software-as-a-service industries; and
president of the Software Quality Association of Denver.

3. 4/8/15
1
Mobile
Tes*ng
Trends,
their
Unique
Challenges
and
Innova*ons
that
Address
them
Melissa
Tondi
Mobile
–
the
New
Fron9er
Does
your
Mobile
Strategy
Look
Like
This?

4. 4/8/15
2
Mobile
–
the
New
Fron9er
Or
This?
Trends
• Device
Prolifera9on
• Accelerated
Releases
• Increased
Work
for
the
Exis9ng
Test
Team
• And
the
List
Goes
on…

5. 4/8/15
3
Unique
Challenges
• Understanding
your
Company’s
Mobile
Strategy
and
the
Solu9ons
and
Technology
Introduced
to
Support
it
• Transi9oning
Tradi9onal
Test
Teams
to
Support
Mobile
• Staying
Efficient
while
Suppor9ng
more
Tes9ng
Permuta9ons
Your
Company’s
Strategy
WHO
are
your
Mobile
Users?
WHAT
Role
does
Mobile
Play
in
your
Industry?
WHAT
is
it
that
people
actually
want
to
do
on
this
mobile
site
or
App
and
HOW
do
they
determine
a
successful
experience?

6. 4/8/15
4
What’s
your
Mobile
Solu*on?
Mobile
Solu9on
–
m/T
Site
Mobile
Web
Site:
mobile
web
sites
designed
to
match
every
web-­‐enabled
device.
They’re
accessed
through
the
mobile
device’s
web
browser
and
do
not
need
to
be
downloaded/installed.
They
re-­‐direct
to
the
site’s
M
Site
or
T
site.

7. 4/8/15
5
Mobile
Technology
–
“Mobile
First”
Responsive
Web
Design
–
an
approach
aimed
at
building
sites
to
provide
an
appropriate
viewing
experience
(reading
and
naviga9on
with
minimal
resizing,
panning,
and
scrolling)
across
a
wide
range
of
devices.
It
adapts
the
layout
to
the
viewing
environment.
Mobile
Technology
–
“Mobile
First”
Adap*ve
Web
Design
–
uses
the
server
to
detect
the
device
that’s
being
used.
A
separate
template
is
maintained
for
each
device
that
is
supported.
Pages
load
at
a
faster
rate
than
RWD.

8. 4/8/15
6
Mobile
Technology
-­‐
Na9ve
Na*ve
Apps:
coded
with
a
specific
programming
language.
They
are
fast,
reliable,
and
powerful,
but
are
9ed
to
a
mobile
pladorm
and
downloaded
from
a
central
portal
by
OS
(i.e.
Apple
App
Store,
Google
Play).
That
means
you
must
duplicate
them
using
the
appropriate
programming
language
in
order
to
target
another
mobile
pladorm.
Mobile
Technology
–
Hybrid
Hybrid
Apps:
rely
on
development
frameworks
and
are
wrieen
with
the
same
technology
used
for
websites
and
mobile
web
implementa9ons.
They
are
hosted
or
executed
inside
a
na9ve
container
on
a
mobile
device.
They
ensure
cross-­‐pladorm
compa9bility
and
can
access
the
phone’s
hardware
(camera,
GPS,
user’s
contacts,
etc.).

9. 4/8/15
7
Technical
Configura9on
Mobile
Web:
HTML5,
Dojo,
jQuery
Na9ve
Apps:
Objec9veC
for
iOS,
Java
for
Android
Hybrid
Apps:
PhoneGap,
Titanium,
Rhomobile
Transi9oning
your
Teams
–
Types
of
Tes9ng
Peripheral
• Wireless
Tes9ng
–
NFC
(Near
Field
Communica9on),
Bluetooth/Bluetooth
LE
Accessory,
Stylus
• Wired
• Internal
to
Device
–
Headphone
Jack,
Keyboard
• External
to
Phone
-­‐
CC
Readers,
Bar
Code
Scanners

10. 4/8/15
8
Transi9oning
your
Teams
–
Types
of
Tes9ng
Connec*on
Tes*ng
• USB
Power/Data
• 4G/LTE/CDMA+/Wimax
• 3G/GSM/CDMA,
2G/Analog,
WiFi,
Hotspot
Genera9on
• Computer
Tethering
• Carrier
• Throele
–
Limi9ng
bandwidth
and
measuring
an
App’s
performance
Transi9oning
your
Teams
–
Types
of
Tes9ng
Gestures
• Swipe,
tap,
pinch/expand,
shake,
orient,
9lt,
press
and
hold,
swipe
and
hold,
eye
pause.
Interrup*on
Tests
• Controlled
-­‐
Plug
in/out
USB,
power,
and
headphone,
Home
Bueon,
Power
Bueon,
Naviga9ng
to
another
App,
Save
State
• Uncontrolled/”Elevator”
test
-­‐
SMS,
Phone
Call,
No9fica9ons

11. 4/8/15
9
Transi9oning
your
Teams
–
Types
of
Tes9ng
Syncing
• Upda9ng
two
or
more
loca9ons
to
ensure
applicable
files
are
equivalent.
• App
to
Cloud,
App
to
Computer,
App
to
App,
Device
to
Device
Internal
Hardware
Integra*on
• Camera,
GPS,
Accelerometer,
Baeery
Drain,
SIM
Card,
Volume,
SMS,
Microphone,
Speakerphone
Innova*ons

12. 4/8/15
10
Innova9ons
in
the
Lab
Choosing
Emulators
and
Simulators
A
lab
is
not
complete
without
a
mixture
of
both.
Knowing
what
that
mixture
is
will
be
the
determining
factor.
• A
Simulator
mimics
only
the
soqware.
iOS
has
one,
but
it
does
not
simulate
any
of
the
iPhone
hardware
layer
• An
Emulator
mimics
both
soqware
and
hardware.
Android
has
one,
but
only
emulates
CPU
and
Memory
Innova9ons
in
the
Lab
When
to
use
Simulators/Emulators
Tes9ng
the
Func9on
• Broken
bueons,
missing
images,
correct
formarng
for
ver9cal
and
horizontal
modes
• Responsive
Web
Design
(RWD)
or
mobile
site
elements
display
correctly
Previewing
the
Form
• Demo
basic
design
and
layout
mockups
before
significant
development
investment
is
spent
on
polishing
the
UI
• See
the
applica9on
within
the
frame
of
a
real
device,
compared
to
the
window
of
a
development
program

13. 4/8/15
11
Innova9ons
in
the
Lab
When
to
use
Simulators/Emulators
Accelera9ng
Development
Time
• For
simple
visual
checks,
opening
an
app
in
a
device
emulator
can
be
as
simple
as
switching
windows,
compared
to
fully
loading
a
physical
device
• Test
more
frequency
with
quick
checks
on
an
emulator,
thus
finding
bugs
faster
and
with
greater
context
Innova9ons
–
Simulators
and
Emulators
Simulators
16-­‐Bit
Display
Opera9ng
System
User
Interface
Emulators
Keyboard
and
Bueons
WiFi
Simulated
SIM
Card
System
on
a
Chip
Sound
Chip
Flash
Memory

14. 4/8/15
12
Innova9ons
in
the
Lab
–
Physical
Devices
24-­‐Bit
Display
Touchscreen
Mul9-­‐Touch
Camera
&
Video
Voice
Recogni9on
True
Sound
Quality
USB
Connec9ons
Bluetooth
SD
Cards
Network
Data
Real
Phone
Calls
Dual
SIM
Cards
Baeery
State
Device
Temperature
Real
GPS
&
Sensors
Pre-­‐Installed
Apps
App
Store
Access
App
Installa9on
Email
Sync
Contacts
Sync
Calendar
Sync
App
Log
Encryp9on
Network
Security
Fingerprint
Scanner

15. 4/8/15
13
Building
your
Lab
-­‐
Android
Building
your
Lab
Determining
your
Device
Matrix
• Opera9ng
System
– OS
customiza9ons,
missing
libraries,
driver
issues
• Screen
Size
– Rendering
issues,
usability,
missing
layouts
• Pixel
Density
– Density
Independence,
missing
layouts.
• Aspect
Ra9o
– X,Y
calcula9ons,
overlapping
panels,
display
issues
• System
on
a
Chip
(SoC)
– Hardware
performance,
Instruc9on
set,
baeery,
signal
• Carrier
– Network
protocol,
speed,
responsiveness,
packet
loss

16. 4/8/15
14
Building
your
Lab
–
Android
Category
Device
Name
OS
Size
Density
Resolu*on
DPI
AR
Protocol
System
on
Chip
Newest
Sam.
Galaxy
SX
4.2.2
Normal
xhdpi
1920x1080
441
16:9
LTE/GSM
Qualcomm
S4
Flagship
LG
Nexus
4
4.2
Normal
xhdpi
768x1280
318
3:5
GSM
Qualcomm
S4
Oldest
HTC
Taeoo
1.6
Small
ldpi
320x240
143
4:3
GSM
Qualcomm
S1
Popular
Sam.
Galaxy
S3
4.1.2
Normal
xhdpi
1280x720
326
16:9
CDMA
Samsung
Exynos
Common
Mot.
Droid
3
2.3.4
Normal
hdpi
960x540
275
16:9
GSM
Cortex
A9
Abnormal
LG
Op9mus
VU
4.0
Large
xhdpi
1024x468
256
4:3
GSM
Nvidia
Tegra
3
Budget
Dell
Venue
2.2
Normal
mdpi
480x800
228
3:5
GSM
Snapdragon
S2
Catch-­‐all
Sony
Xperia
P
2.3
Normal
hdpi
960x540
275
16:9
GSM
Sony
NovaThor
Building
your
Lab
-­‐
iOS
Device
Name
OS
Display
Aspect
SoC
Carrier
Newest
iPhone
6
8
5.5”
1920
x
1080
ppi
9:16
A8
Chip
with
*
Mo9on
Coprocessor
T-­‐Mobile
Oldest
iPhone
3g
6
3.5”
320
x
480
165ppi
2:3
Apple
A3
AT&T
Common
iPhone
5s
7/8
4”
1136
x
640
326ppi
9:16
Apple
A5
Verizon
Popular
iPhone
6+
6
3.5”
640x960
330ppi
2:3
Apple
A4
Sprint
iPad
(Re*na)
iPad
Air
7
9.7”
2048
x
1536
264ppi
3:4
Apple
A7
Verizon
iPod
iPod
Touch
(4th
gen)
5
3.5”
640x960
326ppi
2:3
Apple
A4
WiFi
Mini
iPad
Mini
6
7”
1024
x
768
162ppi
3:4
Apple
A5
AT&T

17. 4/8/15
15
Summary
The
Trends
• Device
Prolifera9on
• Accelerated
Releases
• Increased
Work
for
the
Exis9ng
Test
Team
The
Challenges
• Your
Company’s
Mobile
Strategy
and
Technology
• Transi9oning
Teams
• Becoming
Efficient
Innova*ons
• Defining
Mobile
Test
Techniques
• Simulators,
Emulators
and
Devices
• Building
the
Lab
Contact
Informa9on
• email:
melissa.tondi@gmail.com
• Twieer:
@melissatondi
• Blog:
MelissaTondi.blogspot.com
• LinkedIn:
Melissa
Tondi

18. 4/8/15
16