This poster was presented at the 29th British HCI Conference 2015.

1. Characteristics of
Hand Gesture Navigation:
A case study using a wearable device (MYO)
Tobias Mulling | Mithileysh Sathiyanarayanan
With the development of devices capable of identifying the
movement of hands and arms to interact with a graphical in-
terface, such as MYO armband, the understanding of ergo-
nomic, social and cognitive characteristics is needed in order
to design applications for this wearable device. In this study,
some characteristics of MYO armband gestures and approach
(sensors to capture the movement of the hand) are explained,
and a case study about how this armband can be used as
gesture recognition in map navigation using Apple Maps
Connector is discussed.
Introduction
A questionnaire (20 questions) was created with the objective
of understanding how users interact with the MYO in Apple
Maps software, through a Connector app. Users were asked
to perform common tasks for navigating interactive maps
such as Zoom, Panning, Focusing, among other commands
using the predefined MYO commands (spread fingers, wave
left, wave right, fist, rotation). The content of the questions
was associated with acceptance of MYO as a data input
device, easy to learn, use, stress and other ergonomics; for
each question, there is a common 1-5 rating (5-point Likert
scale: Strongly disagree = 1 and Strongly agree = 5).
Method
Results and Discussion
Contact Information
Initially, participants were asked if the MYO device requires
prior training to be used. Of the total participants (n=23), 20
users (83%) understand that a learning process is necessary
to perform the main gestures of the device (which are still
very limited). Moreover, 70% of participants believe that the
device has a great potential to be exploited in various appli-
cations. The following are results on the ergonomic criteria
addressed in this study:
Social Acceptability: even as a wearable device, most users do
not feel shame (mode = 1, mean = 1.60) when using and seen
(mode = 1, mean = 1.59) while performing MYO gestures .
Ease of use and learning: users had considered that the device
is difficult to learn (mode = 1, mean = 1.78) and hard to use
(mode = 1, mean = 1.69). Part of this result may be linked to the
fact that Apple Maps interface does not provide tips on every
gesture to be executed.
Comfort and ability to perform gestures: the study showed
that most users feel comfortable when using the device
(mode = 5, mean = 4.39). Moreover, it was found that MYO
did not improve the ability to perform related actions (mode
= 1, mean = 1.26). Perhaps because the control interfaces
from the movement of hands and arms is still not widely
used in applications that are not games.
Stress/Effort: It was detected a high level of effort / stress
associated with interaction with the MYO. Each specific gesture
was analysed, Wave Left (mode=4, mean=3.73), Wave Right
(mode=4, mean=4.04), Spread Fingers (mode=4, mean=4.08),
Fist (mode=4, mean=4.08) and Pan (mode=4, mean=3.95). The
analysis of general movements detected that the navigation
gestures generated a certain stress to users (mode = 4,
mean = 3.82).
1 2 3 4 5
If someone was watching you perform the
gestures proposed in the map software.
would you feel embarassed?
Strongly disagree = 1
Strongly agree = 5
1 2 3 4 5
Do you think MYO gestures on map application
are easy to use?
Strongly disagree = 1
Strongly agree = 5
1 2 3 4 5
Did you feel comfortable using the
MYO device?
Strongly disagree = 1
Strongly agree = 5
1 2 3 4 5
How do you define the general stress
(effort) generated by gestures
performed on MYO(armband)?
No effort = 1
Painful/Stressing = 5
School of Computing, Enginnering and
Mathematics (CEM) - University of Brighton
E-mail: t.mulling@brighton.ac.uk
Acknowledgments
This work was undertaken with support from
CAPES, Brazil, grant Doutorado Pleno no
Exterior–Proc. BEX BEX 13430/13-0.
Thanks to Dr. Derek Covill and Dr. Lyn Pemberton
for their support and guidance.
MYO could prevent
the occlusion,
because it uses a
different
approach
The armband
avoids the prob-
lem of “live mic”,
because it is
enabled by a
gesture
Repetition of certain
gestures might
cause fatigue on
users and also frus-
tration due to misin-
terpreted
movements.