Eyes-Free User Interaction

670 views

Published on

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
670
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
14
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Eyes-Free User Interaction

  1. 1. Eyes-Free User Interaction T. V. Raman Google Research http://emacspeak.sf.net/raman February 9, 2009
  2. 2. Overview Android Dialer Contacts Shell Conclusion Android Dialer Contacts Shell Conclusion Eyes-Free Interaction Stanford February 2009 – 2 / 25
  3. 3. Android Dialer Contacts Shell Conclusion Android Programming
  4. 4. Android: Engineer’s Dream! Android Dialer Contacts Shell Conclusion s Smart phones — computer in your pocket. s Open platform — liberates innovation. s New I/O — minimize user interaction. Bend technology to your will! Eyes-Free Interaction Stanford February 2009 – 4 / 25
  5. 5. Innovative User Interfaces Android Dialer Contacts Shell Conclusion Create innovative end-user solutions that: s Fit into the user’s mode of working, s Avoid one-size fits all solutions, s Design context-aware solutions, s Tailor solutions to user’s needs. Eyes-Free Interaction Stanford February 2009 – 5 / 25
  6. 6. Eyes-Free Interaction Android Dialer Contacts Shell Conclusion Not just for blind users! s Eyes-busy environments —driving. s One-handed use. s Minimize explicit user interaction. Rethink all assumptions about the user. Eyes-Free Interaction Stanford February 2009 – 6 / 25
  7. 7. Devices That Sense Android Dialer Contacts Shell Conclusion Mobile phones make UI design exciting! s Can capture user intent — keyboard, . . .. s Can see — camera. s Can hear and speak — speech I/O. s Can sense and stimulate touch — touch screen and vibration. s Can sense motion — accelerometer, compass. s Can sense position — GPS, cell towers. . . s .. Our Android has many eyes and ears! Eyes-Free Interaction Stanford February 2009 – 7 / 25
  8. 8. Android Dialer Contacts Shell Conclusion Eyes-Free Interaction With The Touch Screen
  9. 9. Using A Touch Screen Android Dialer Contacts Shell Conclusion These are atomic tasks: s Identifying the item to touch. s Touching item to activate it. s Eyes-free use requires help with the former. s Activation should produce appropriate feedback. Eyes-Free Interaction Stanford February 2009 – 9 / 25
  10. 10. On-Screen Touchpads Android Dialer Contacts Shell Conclusion Eyes-Free use of an on-screen touchpad: s Need to see the buttons to know where to touch. s Because: buttons use absolute positioning. s Conclusion: (wrong) — you need to see to use a touch screen! s Solution: Relax constraint of absolute positioning. What if we used relative positioning instead? Eyes-Free Interaction Stanford February 2009 – 10 / 25
  11. 11. Phone Keypad Android Dialer Contacts Shell Conclusion Eyes-free phone dialer: s Keypad centered where you touch — relative positioning. s Users already know layout of a phone keypad. s Can stroke from the center for a desired digit. Enables eyes-free one-handed dialing! Eyes-Free Interaction Stanford February 2009 – 11 / 25
  12. 12. Dialer Feedback Android Dialer Contacts Shell Conclusion Enables one-handed, eyes-free use: s Buttons vibrate when you move over them. s Augmented by auditory feedback. s Pressing buttons produces spoken and tactile feedback. s Shake to erase input. Synchronized auditory and haptic feedback is key. Eyes-Free Interaction Stanford February 2009 – 12 / 25
  13. 13. Android Dialer Contacts Shell Conclusion Text Input Via Touch Screen
  14. 14. Contact Manager Android Dialer Contacts Shell Conclusion No one dials phone numbers any more! s Browsing contacts using touch screen. s Finding contacts. s Managing contacts. Eyes-Free Interaction Stanford February 2009 – 14 / 25
  15. 15. Entering Text Input Android Dialer Contacts Shell Conclusion Extending stroke dialer for textual input: s Arrange letters in 4 concentric circles. s Strokes access distinct circles. s Choose desired letter by tracing chosen circle. Any letter is at most 3 steps away! Eyes-Free Interaction Stanford February 2009 – 15 / 25
  16. 16. Keypad Layout Android Dialer Contacts Shell Conclusion Gesture: Pick circle, and trace to desired character. A I Q Letter Gesture A Stroke up to the left ⊙ Y B Stroke A, trace right U M E E Stroke down to the right Eyes-Free Interaction Stanford February 2009 – 16 / 25
  17. 17. Managing Contacts Android Dialer Contacts Shell Conclusion Contacts live in the cloud. s Contacts managed over the network. s Updated automatically on the device. s No more editing contacts with two fingers! Eyes-Free Interaction Stanford February 2009 – 17 / 25
  18. 18. Android Dialer Contacts Shell Conclusion Marvin: Eyes-Free Shell
  19. 19. Eyes-Free Shell Android Dialer Contacts Shell Conclusion Marvin: Shell for launching eyes-free interaction. s Home screen provides one-touch access to oft-used tasks. s Uses stroke dialer for launching tasks. s Code is Open Source. http://eyes-free.googlecode.com Eyes-Free Interaction Stanford February 2009 – 19 / 25
  20. 20. Talking Compass Android Dialer Contacts Shell Conclusion s Compass is one touch away on the home screen. s Speaks current bearing. s Provides succinct or verbose feedback. s Augmented by auditory tones and vibration for cardinal directions. Eyes-Free Interaction Stanford February 2009 – 20 / 25
  21. 21. Weather Forecast Android Dialer Contacts Shell Conclusion s Android phone knows its location. s Current weather is therefore just one touch away. s Retrieves RSS weather forecast. s Speaks weather headline. Eyes-Free Interaction Stanford February 2009 – 21 / 25
  22. 22. Device Status Android Dialer Contacts Shell Conclusion s Device status available as single touch gestures. s Airplane mode. s Date and time. s Battery status. Eyes-Free Interaction Stanford February 2009 – 22 / 25
  23. 23. Android Dialer Contacts Shell Conclusion Conclusion
  24. 24. Summary Android Dialer Contacts Shell Conclusion s Programmable smart phones are an engineer’s dream! s I/O peripherals open up new UI avenues. s Provide desired information with minimal user interaction. Profound impact on how we work and play! Eyes-Free Interaction Stanford February 2009 – 24 / 25
  25. 25. Watch Computing Take Off! Android Dialer Contacts Shell Conclusion Eyes-Free Interaction Stanford February 2009 – 25 / 25

×