Mnemonical Body Shortcuts improving mobile interaction

Tiago Guerreiro [email_address] http://immi.inesc-id.pt/~tjvg TU Lisbon Technical Superior Institute INESC-ID VIMMI Ricardo Gamboa Joaquim Jorge

http://m-accessibility.blogspot.com

you're stuck in a moment And you can't get out of it - Bono ‘‘ ’’

Limited Screen Size

Multi-task Graphical Displays

Slow and Visually Demanding

Mother Father Messages Key Shortcuts Hard to memorize Girlfriend Agenda Calculator Dog

Can it be more natural?

Recognition Issues

Low Acceptance

Task Analysis Mobile Interaction and Shortcuts

20 Users Mobile Interaction Habits Shortcut usage observation

20 Users

Mobile

Interaction

Habits

Shortcut

usage

observation

Calls, SMS, Agenda, Contact List and Watch 75% use Key shortcuts but do not recall most of the shortcuts Voice Shortcuts are not used ( unavailable or unconfident on recognition)

4 clicks to access the most used applications 5 clicks to call the most used contacts .... although they were on fast dial

Body Mnemonics Ängeslevä et al.

Camera (Rohs et al., 2004) EMG (Costanza et al., 2005) Inertial Sensing (Choi et al., 2005) RFID ( Headon et al., 2003)

100%

20 Users Associate applications with keys and body parts

20 Users 12 Gestures repeated 5 times Offline Recognition Analysis Knn suitable for default gestures Naive Bayes suitable to used-defined gestures

Rate Errors without Multichoice or Cancelling 17,95% Errors using only Cancelling 14,14% Errors using only Multichoice 10,8% Errors 3,3% Rate Clicks Average 2,5 clicks Time Average 3,8 seconds Stops during Shortcuts 1,4%

Evaluate the system in adverse situations Adapt and evaluate it with blind users Create a language model to totally rely on gestures to control the device

Evaluate the system in adverse situations

Adapt and evaluate it with blind users

Create a language model to totally rely on gestures to control the device

rbut

Mnemonical Body Shortcuts improving mobile interaction Tiago Guerreiro [email_address] t