Resultados del estudio internacional de UXFellows en el que participe en Inter-Cultura Presentado en UX2013 (Buenos Aires Argentina) junto a Gonzalo Auza y en JATIC 2015 (Mar del Plata, Argentina).

1. ¿Gestos universales para controlar
equipos electrónicos? Un estudio en
18 países.
Gonzalo J. Auza y Nicolás Jaureguiberry
UX2013 – Jornada Académica - Buenos Aires 3 de diciembre de 2013

2.  Consultora de UX con base en Buenos Aires.
 Fundada en 2005.
 Diseñamos servicios, productos y estrategias centrados en la
persona.
 Nos especializamos en:
 Design Thinking
 Diseño de Experiencia de Usuario
 Diseño Centrado en el Usuario
 Co-creación
 User driven innovation
 Diseño | Investigación | Consultoría | Capacitación
 Miembros de UX Fellows

3. Introducing UX Fellows
● Worldwide user experience research
● 25 partner companies
● Joint quality levels and processes
● UX expertise + local culture expertise

4. High quality UX research in 35+ countries

5. Gesture technology is entering our lives

6. What is a gesture?
What kind of gestures are we interesting in?

7. Let’s play a game…

8. Let’s play a game…
Say hello…

9. Let’s play a game…
Say hello…
Goodbye…

10. Let’s play a game…
Say hello…
Goodbye…
That door…

11. Let’s play a game…
Say hello…
Goodbye…
That door…
Email me later…

12. Let’s play a game…
Say hello…
Goodbye…
That door…
Email me later…
Move the chair near to the door…

13. Pointing gestures

14. Semantic gestures
● Gestures with an associated meaning
● No need for an additional GUI
● Potentially more efficient
Challenges
● Presumably influenced by local cultures
Semantic gesture for
mission control on a
Mac
● Some cultures might be more predisposed to the use of
gestures than others

15. The UX Fellows Gesture Study (video)

16. The UX Fellows Gesture Study
Which semantic gestures would people
from various cultures spontaneously use
to control consumer electronic devices?
● Country differences?
● Country clusters?
● Underlying metaphors?
● Acceptance?

17. We compared spontaneous gesture
behavior in 18 countries.
FI
CA
UK
BE
DE
NL FR
ES
IT
US
MX
RU
TR
CN
KR
IN
AU
AR

18. Setting
15 min
Warm-up: everyday gestures

19. Examined Commands
Switch on device
Volume up
P-
Confirm on-screen dialog (OK)
Channel up
Deny on-screen dialog (cancel)
Context info for current program
P+
backward navigation in menus
Pause video-on-demand (VOD)
Channel down
Restart VOD
Share current program
Fast forward VOD
Volume down
Rewind VOD
Mute volume
Skip chapter VOD
Pause current program
Previous chapter VOD
Homepage
Stop VOD
EPG
Switch off device

20. Sample
Persons who are able to imagine a gesture-control scenario for a TV.
● Regular usage of a recent HD flat TV (max. 5-6 years of age) and
other CE devices and services
● High interest in consumer electronics
● Regular usage of a touch device
● No Xbox Kinect and gesture-enabled TV users
● Potential buyers of international "premium" CE brands
(no national, retailer or "no name" brands)

21. socio-economic
background
Sample
sample
country

22. Sample
18 countries
x 20 subjects
= 360 participants
max
65 years
49%
mean
32
min
16
51%

23. The Results

24. Elaboration

25. no. of countries
Commonality of gestures
18
16
14
12
10
8
6
4
2
0
high
no. of countries with the same main gesture
medium
low

26. Commands with high commonality
Volume down
Volume up
Pause VOD
Pause current program
Rewind VOD
Fast forward VOD
Confirm on-screen dialog (OK)

27. Commands with high commonality
Volume down
Volume up
Pause VOD
Pause current program
Rewind VOD
Fast forward VOD
Confirm on-screen dialog (OK)
Commonality
18 of 18
Difficulty (1-5)
1.8
Q: How do you turn down the volume?

28. Commands with high commonality
Volume down
Volume up
Pause VOD
Pause current program
Rewind VOD
Fast forward VOD
Confirm on-screen dialog (OK)
Commonality
18 of 18
Difficulty (1-5)
1.5
Q: How do you turn up the volume?

29. Commands with high commonality
Volume down
Volume up
Pause VOD
Pause current program
Rewind VOD
Fast forward VOD
Confirm on-screen dialog (OK)
Commonality
17 of 18
Difficulty (1-5)
1.5
Q: How do you pause viewing a film?
NL

30. Commands with high commonality
Volume down
Volume up
Pause VOD
Pause current program
Rewind VOD
Fast forward VOD
Confirm on-screen dialog (OK)
Commonality
17 of 18
Difficulty (1-5)
2.0
Q: How would you pause the current TV program?
NL

31. Commands with high commonality
Volume down
Volume up
Pause VOD
Pause current program
AU, UK
Rewind VOD
Fast forward VOD
Confirm on-screen dialog (OK)
Commonality
15 of 18
Difficulty (1-5)
1.7
Q: How do you rewind? (with an image being shown)
NL

32. Commands with high commonality
Volume down
Volume up
Pause VOD
Pause current program
AU, UK
Rewind VOD
Fast forward VOD
Confirm on-screen dialog (OK)
Commonality
15 of 18
Difficulty (1-5)
1.9
Q: You are watching a boring scene, how do you fast-forward (with an image being shown)?
NL

33. Commands with high commonality
Volume down
Volume up
Pause VOD
Pause current program
Rewind VOD
CN, IT, KR
Fast forward VOD
Confirm on-screen dialog (OK)
Commonality
15 of 18
Difficulty (1-5)
1.9
Q: You have chosen a film from an online video library. The TV asks you "do you really want to buy the film?" How do you answer "yes"?

34. Commands with medium commonality
Channel up
Channel down
Stop VOD
Mute volume
backward navigation in menus
Deny on-screen dialog (cancel)
Skip chapter VOD

35. Commands with medium commonality
P+ Channel up
Channel down
Stop VOD
Mute volume
AU, ES, KR, US
backward navigation in menus
Deny on-screen dialog (cancel)
Skip chapter VOD
CA
Commonality
13 of 18
Difficulty (1-5)
1.8
Q: You are zapping through the TV programs: How do you change from channel 15 to channel 16 for example?

36. Commands with medium commonality
Channel up
P- Channel down
Stop VOD
Mute volume
backward navigation in menus
AU, ES, KR, UK, US
Deny on-screen dialog (cancel)
Skip chapter VOD
Commonality
12 of 18
Difficulty (1-5)
1.6
Q: You are zapping through the TV programs: How do you change from channel 16 to channel 15 for example?
CA

37. Commands with medium commonality
Channel up
Channel down
Stop VOD
CN, KR
Mute volume
backward navigation in menus
Deny on-screen dialog (cancel)
FI, RU
Skip chapter VOD
Commonality
13 of 18
Difficulty (1-5)
2.1
Q: How would you stop watching the film altogether (because you want to do something different)?
NL

38. Commands with medium commonality
Channel up
Channel down
Stop VOD
AU, CN, MX
FI, RU
Mute volume
backward navigation in menus
Deny on-screen dialog (cancel)
Skip chapter VOD
Commonality
11 of 18
Difficulty (1-5)
BE
2.0
Q: How do you set the volume to "mute"?
UK

39. Commands with medium commonality
Channel up
Channel down
Stop VOD
AU, BE, CA
Mute volume
Backward navigation in menus
Deny on-screen dialog (cancel)
ES, MX, US
Skip chapter VOD
Commonality
10 of 18
Difficulty (1-5)
AR, RU
2.3
Q: Imagine that you were looking for a film in an online video library. You have gone to the comedies section and have chosen the description of a
single movie. Now you want to return to the previous set of options (all of the comedies). Which gesture would you use for that?

40. Commands with medium commonality
Channel up
Channel down
Stop VOD
AU, CN, RU, TR
Mute volume
backward navigation in menus
Deny on-screen dialog (cancel)
AR, BE, IT, MX
Skip chapter VOD
Commonality
9 of 18
Difficulty (1-5)
1.8
Q: How do you express that you don’t want to buy it?
KR

41. Commands with medium commonality
Channel up
Channel down
Stop VOD
Mute volume
BE, CN, ES, FI, FR, IN, MX, UK
backward navigation in menus
Deny on-screen dialog (cancel)
Skip chapter VOD
Commonality
9 of 18
Difficulty (1-5)
2.2
Q: How would you skip to the next chapter of the film?
NL

42. Commands with low commonality
Switch on device
Switch off device
Previous chapter VOD
Restart VOD
Share current program
EPG
Context info for current program
Homepage

43. Commands with low commonality
Switch on device
Switch off device
Previous chapter VOD
Restart VOD
BE, FR, US
DE, IT
Share current program
FI
EPG
Context info for current program
KR
Homepage
Commonality
8 of 18
Difficulty (1-5)
2.0
TR
Q: How would you switch on the TV?
CA
CN

44. Commands with low commonality
Switch on device
Switch off device
Previous chapter VOD
ES, MX, NL
IN, KR
Restart VOD
Share current program
EPG
Context info for current program
Homepage
Commonality
7 of 18
Difficulty (1-5)
2.9
CA
RU
Q: How would you switch off the TV? Note: No common gesture in Italy
AR
TR

45. Commands with low commonality
Switch on device
Switch off device
Previous chapter VOD
Restart VOD
Share current program
BE, CN, ES, FI, FR,
MX, NL
EPG
Context info for current program
UK
Homepage
Commonality
8 of 18
Difficulty (1-5)
2.0
Q: How would you return to the previous chapter of the film?
IN, US

46. Commands with low commonality
Switch on device
Switch off device
Previous chapter VOD
AU, ES, KR, MX
AR, DE
Restart VOD
Share current program
EPG
RU
NL
Context info for current program
Homepage
Commonality
7 of 18
Difficulty (1-5)
2.0
Q: How do you start it (film) again? Note: No common gesture in UK
US
BE

47. Commands with low commonality
Switch on device
Switch off device
Previous chapter VOD
CN, FR, IN
AR, TR
Restart VOD
FI
Share current program
EPG
RU
MX
Context info for current program
Homepage
KR
Commonality
6 of 18
Difficulty (1-5)
3.2
US
Q: How would you share with your friends what you are currently watching or listening to? Note: No common gesture in UK
NL

48. Commands with low commonality
Switch on device
Switch off device
Previous chapter VOD
AU, US
Restart VOD
CN, FI, IN,
KR, RU
MX
Share current program
EPG
Context info for current program
Homepage
Commonality
5 of 18
NL
BE, UK
Difficulty (1-5)
2.8
Q: You'd like to see an overview of tonight's TV programs of the main channels (EPG). How do you activate this function with a hand gesture?
Note: No common gesture in Italy
TR

49. Commands with low commonality
Switch on device
Switch off device
Previous chapter VOD
CN, IN, TR
FR, KR, RU
Restart VOD
AU, FI
Share current program
EPG
Context info for current program
ES
US
DE
Homepage
Commonality
4 of 18
Difficulty (1-5)
2.8
Q: How would you get more information for the running TV program?
BE
UK
AR

50. Commands with low commonality
Switch on device
Switch off device
AR, AU, MX
Previous chapter VOD
BE, IN
Restart VOD
Share current program
CA, ES, TR
EPG
Context info for current program
NL, UK
DE
Homepage
Commonality
4 of 18
FI
Difficulty (1-5)
2.9
Q: Now you want to go to the initial set of options - that means the first options you see when you switch on the device.
Note: No common gesture in Italy
US

51. Direct vs. abstract gestures
We observed two kinds of gestures.
● "Direct" gestures
o strongly influenced by touch devices
● Abstract gestures
o basis in language, iconography and metaphors
o associated with more complex tasks
o lower intercultural commonality

52. Some general insights

53. Average gesture difficulty by country
max 5,0
…
Everyday gestures
CE gestures
3.0
difficulty
2.5
2.0
1.5
min
1.0
TR FR MX AR IN
FI
CN RU NL DE AU US BE ES CA
IT
KR UK

54. Average gesture difficulty by country
max 5,0
…
CE gestures
3.0
difficulty
2.5
2.0
1.5
min
1.0
FR CN TR IN AR RU MX US
IT
DE AU FI
CA BE ES NL UK KR

55. Gesture difficulty by countries
FR CN TR IN AR RU MX US
Volume down
Pause VOD
Channel down
Rewind VOD
Volume up
Deny on-screen dialog (cancel)
Channel up
Confirm on-screen dialog (OK)
Switch off device
Fast forward VOD
Switch on device
Restart VOD
Mute volume
Previous chapter VOD
Pause current program
Stop VOD
Skip chapter VOD
backward navigation in menus
Context info for current program
EPG
IT DE AU
FI CA BE ES NL UK KR

56. Gesture difficulty by countries
FR CN TR IN AR RU MX US
IT DE AU
FI CA BE ES NL UK KR Mean
Volume down
1.2 1.2 1.3 1.6 1.3 1.1 1.3 1.6 1.3 1.4 1.6 1.5 1.5 1.6 1.0 1.5 2.2 2.2
1.5
Pause VOD
1.3 1.5 1.1 1.3 1.1 1.3 1.6 1.2 1.5 1.4 1.4 1.7 1.5 1.4 1.7 1.5 2.2 2.9
1.5
Channel down
1.1 1.4 1.5 1.4 1.4 1.1 1.5 1.7 1.7 2.0 1.8 1.8 1.6 1.8 1.0 1.6 2.3 2.1
1.6
Rewind VOD
1.0 1.6 1.3 1.8 1.8 1.8 1.3 1.8 1.6 1.4 1.5 2.0 1.5 2.5 1.2 2.0 2.4 2.5
1.7
Volume up
1.4 1.8 1.8 1.4 1.3 1.6 1.3 1.9 1.4 1.9 1.6 1.6 1.9 2.0 1.9 2.2 2.5 2.3
1.8
Deny on-screen dialog (cancel)
1.3 1.8 2.1 1.3 1.2 1.7 1.3 1.5 1.6 1.5 1.7 1.8 1.8 2.4 2.6 1.9 2.5 2.5
1.8
Channel up
1.2 1.5 1.5 1.7 1.5 1.8 1.5 2.1 1.8 2.0 2.2 1.7 2.4 1.8 1.4 2.2 2.5 2.2
1.8
Confirm on-screen dialog (OK)
1.7 2.1 2.2 1.3 1.8 1.8 1.3 1.5 1.7 2.1 1.8 2.1 2.1 1.4 2.4 1.9 2.3 2.3
1.9
Switch off device
1.5 1.9 1.1 1.9 1.5 2.3 1.6 1.8 2.0 2.0 1.6 2.1 2.2 2.0 2.3 2.0 2.2 2.4
1.9
Fast forward VOD
1.9 1.6 1.5 2.1 1.8 2.0 1.4 1.7 1.6 1.6 1.8 2.1 1.7 2.1 2.3 2.2 2.6 2.5
1.9
Switch on device
2.1 1.3 1.4 1.7 1.4 1.6 2.2 1.4 1.9 2.0 2.1 1.9 2.4 2.7 2.5 1.9 2.3 2.6
2.0
Restart VOD
1.8 1.5 1.7 1.9 1.5 1.9 1.6 1.6 2.1 1.4 2.5 1.7 1.9 2.4 2.7 2.1 2.5 3.0
2.0

57. General acceptance
● Our 360 tech-savvy participants responded very positively to
the idea of semantic gesture input for TVs.
"fun to use", "convenient", "coolness factor"
● Participants would like to use gestures to control other
devices as well (e.g. audio).

58. Operation
Many participants felt that voice and sound could be a good
support for gesture input.
waking up the device with a sound
Can the TV
hear me?

59. Gesture type preference
FR
Semantic 
Pointing
associated
with more
advanced
commands
CN TR
IN




AR RU MX US



DE AU
FI
CA
BE
ES
NL UK KR
Σ

IT





15

Many users would prefer switching between gesture types.









9

60. Typical concerns of users
● Learning and retention of gestures
(but: would be easy if based on implicit behavior repertory)
● Sensitivity and accuracy of devices
● Interference by other gestures in the room
● Compatibility with lean-back disposition

61. Conclusions

62. Conclusions
1. For basic CE commands a common language for semantic
gestures already exists across cultures.
2. More complex commands could be realized by either
a. customizing these gestures for each individual market
b. customizing individually
c. proposing a set of semantic gestures that need to be
learned (the study provides some suggestions)
d. switching to pointing gestures in combination with a GUI
3. It is necessary to consider cultural differences at a country
level when it comes to designing advanced gesture control
for globally marketed devices.

63. Thumbs up to the audience!
Download complete reports: www.uxfellows.com
Find us:
gonzalo.auza@inter-cultura.com
nicojaure@gmail.com

64. Thumbs up to the audience!
Pueden bajar todas las conclusiones en: www.uxfellows.com
Pueden:
gonzalo.auza@inter-cultura.com
nicojaure@gmail.com