Li Chi08 Blind Sight

691 views
613 views

Published on

Published in: Business, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
691
On SlideShare
0
From Embeds
0
Number of Embeds
16
Actions
Shares
0
Downloads
12
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Li Chi08 Blind Sight

    1. 1. blindSight: Eyes-free mobile phone interaction Kevin Li , University of California, San Diego Patrick Baudisch , Microsoft Research Ken Hinckley , Microsoft Research
    2. 2. calendar preview “ Monday 9am” “ tic, tic, sssssh” “ How ab out Monday morning?” “ Yeah, looks like I’m free after 10” blindSight
    3. 3. <ul><ul><li>is an application running on Microsoft Windows Smartphone </li></ul></ul><ul><ul><li>is launched when user places or receive a call. It then replaces the in-call menu </li></ul></ul><ul><ul><li>unlike the in-call menu, blindSight uses auditory feedback </li></ul></ul>blindSight
    4. 4. why?
    5. 5. PCs… PC screens have the users’ undivided attention  design for the visual channel
    6. 6. eyePhone
    7. 7. environment
    8. 8. visual impairment
    9. 9. screen-less device
    10. 10. can’t see screen
    11. 13. Lots of information is stored on mobile phones…
    12. 14. … the interfaces are visual
    13. 15. # of participants “ I need to access as part of a phone conversation:” survey
    14. 16. <ul><li>Ok, so let’s just translate all text from visual to auditory </li></ul><ul><ul><li>“ Menu: Press 1 to search contacts; press 2 to add a contact; press 3 to access your calendar…” </li></ul></ul><ul><li>Wait, that sounds familiar </li></ul>
    15. 17. Please listen carefully as our options have changed…
    16. 18. related work
    17. 19. <ul><li>User’s should be able to “dial ahead” [Perugini et al., CHI 2007 ] </li></ul><ul><li>Zap and Zoom allows users to jump to locations using shortcuts [Hornstein, UBILAB Rep 1994 ] </li></ul><ul><li>Use visual channel to inform users about options [Yin and Zhai, CHI 2006 ] </li></ul>interactive voice response
    18. 20. <ul><li>Time compress audio [Dietz and Yerazunis, UIST 2001 ] </li></ul><ul><li>Integrate speech commands into the conversation [Lyons et al., CHI 2004 ] </li></ul>phone interaction mid-conversation
    19. 21. blindSight’s auditory feedback
    20. 22. audio is heard only by the user, not by the person at the other end
    21. 23. rationale  people can recover from audio interruptions as long as interruption is short human-human conversation contains redundancy can we use this redundancy to inject auditory feedback from the device?
    22. 24. <ul><li>how do we make sure device feedback fits into these time windows of low information content? </li></ul>
    23. 25. rules 1. feedback only on-demand hear voice note mute speaker phone hear task list add contact record voice find contact cal endar hear emails hear text message home
    24. 28. rules 2. brevity 2 1 3 8 delete 4 9 7 6 5 abc def tuv ghi wxyz pqrs mno jkl next play find contact type 6 “ 200 hits” type 2 “ 12 hits” type 7 “ Marion”
    25. 29. rules 3. non-speech previews of composites week week day day 3 hours 3 hours ½ hour ½ hour block ½h preview day + – – – + _ whereAmI go today preview 3 hours ++ calendar (what if the content is a long list, such as appointments for a day?)
    26. 32. rules 4. decomposition week week day day 3 hours 3 hours ½ hour ½ hour next preview day + – – – + _ whereAmI go today preview 3 hours (what if the content is a long list, such as appointments for a day?)
    27. 33. rules 5. interruptability user interface runs as a separate thread
    28. 34. rules 6. minimize modes mon wed tue sat thu fri sun action delete save pick day start time end time … 1 3 2 6 4 5 9 7 8 action delete save 1 3 2 6 4 5 9 7 8 action delete save modes
    29. 35. rules 6. minimize modes (  avoid wizards) week week day day 3 hours 3 hours ½ hour ½ hour block ½h preview day + – – – + _ whereAmI go today preview 3 hours ++ + +
    30. 36. home hear voice note mute speaker phone hear task list add contact record voice find contact cal endar hear emails hear text message
    31. 37. add contact 2 1 3 8 save 4 9 7 6 0 5 delete
    32. 38. iterator 1 3 2 6 4 5 9 7 8 action action delete save menu patterns
    33. 39. calendar week week day day 3 hours 3 hours ½ hour ½ hour block ½h preview day + – – – + _ whereAmI go today preview 3 hours ++ + +
    34. 40. <ul><li>(shows fast usage by an experienced user) </li></ul>demo video
    35. 43. hardware
    36. 47. space
    37. 48. epoxy dots enlarged spaces
    38. 49. error Flip Ear Visual
    39. 51. 1 3 2 6 4 5 9 7 8 # * 0 .
    40. 52. error Flip Ear Visual
    41. 53. blindSight evaluation
    42. 54. interfaces Smartphone 2003 (sighted) BlindSight (eyes-free) vs.
    43. 55. task while “driving” idle (1) schedule appointments and (2) add contacts
    44. 56. Overall preference results 0 1 2 3 4 5 6 7 8 Was not missing information Knew position in the menu Knew what day/time I was at Felt in control of the conversation Better for setting meeting times Prefer if driving and talking Prefer Overall blindSight Smartphone
    45. 57. 1. brevity is good, but use in moderation clarification of navigation overrides brevity 2. predictable/modeless user interface is key 3. auditory feedback goes a long way even during phone call (disclaimer: need to study how it interferes with activities… driving) lessons
    46. 58. environment visual impairment can’t see screen screen-less device next:
    47. 59. eyePhone
    48. 60. eyePhone eyes Free Phone ?
    49. 61. blindSight: Eyes-free mobile phone interaction Kevin Li , University of California, San Diego Patrick Baudisch , Microsoft Research Ken Hinckley , Microsoft Research
    50. 63. extra slides
    51. 65. <ul><li>built a system </li></ul><ul><li>a set of eyes-free design rules </li></ul><ul><li>keypad modifications enabling eyes-free </li></ul><ul><li>user study comparing with a product (Smartphone 2003) </li></ul>contributions
    52. 66. <ul><li>1. feedback only on-demand </li></ul><ul><li>2. brevity </li></ul><ul><li>3. non-speech previews of composites </li></ul><ul><li>4. decomposition </li></ul><ul><li>5. interruptability </li></ul><ul><li>6. minimize modes </li></ul>rules
    53. 67. iterator 1 3 2 6 4 5 9 7 8 action action delete save menu patterns
    54. 68. home hear voice note mute speaker phone hear task list add contact record voice find contact cal endar hear emails hear text message
    55. 69. add contact 2 1 3 8 save 4 9 7 6 0 5 delete
    56. 70. iterator 1 3 2 6 4 5 9 7 8 action action delete save menu patterns
    57. 71. calendar week week day day 3 hours 3 hours ½ hour ½ hour block ½h preview day + – – – + _ whereAmI go today preview 3 hours ++ + +
    58. 72. hear voice note mute speaker phone hear task list add contact record voice find contact cal endar hear emails hear text message 2 1 3 8 save 4 9 7 6 0 5 delete week week day day 3 hours 3 hours ½ hour ½ hour block ½h preview day + – – – + _ whereAmI go today preview 3 hours ++ 2 1 3 8 delete 4 9 7 6 5 abc def tuv ghi wxyz pqrs mno jkl next play add contact find contact calendar home type type folder folder n items n items item item play + – – – + _ + preview + email, tasks, voice, SMS home help hold bottom left for hold bottom right for menu
    59. 73. … is a phenomenon in which people who are perceptually blind in a certain area of their visual field demonstrate some visual awareness, without any qualitative experience blindSight... [wikipedia]
    60. 74. don’t mode me in blind sight 10 design rules to allow eyes-free use and flow tactile features
    61. 75. phones… … are in in a mobile situation If they requires visual attention, users will fail at their current activity interference with social activities drive off the road…
    62. 77. vs. baseline interfaces
    63. 78. task times

    ×