SXSW The future of touch

The Future of Touch Interaction at SXSW 2011 South by Southwest Interactive 2011 # sxsw #futureoftouch

Who are we…
Amish Patel
UX Program Manager
Kay Hofmeester
User Experience Design Lead

Who are we…
We work at Microsoft
But this is not about Microsoft

Today’s journey
... which needs to be developed …
Realizing touch is a language …
… enables us to see into the future.

Appendix
Touch is a language
image by Assbach

We’ve been creating languages for decades
Graphical User Interface
Command Line Interface
Touch User Interface
Text commands
On-screen pointer
Single-channel input
Multi-channel output
Single User
Text commands
Single-channel output
Single User
Direct touch input
Multi-channel input
Multi-user

When things go wrong
What happens if you use a new input method with an old language.

angry video game nerd

Appendix
Touch needs it’s own language.

Input languages develop in stages

Three stages of media
New technology
Copy old language
New language
Stage one
Stage two
Stage three
inspired by Randy Pausch

1877: EadweardMuybridge – The horse in motion

1895: American Biograph and Mutoscope co.
Images courtesy the Library of Congress

1941: Citizen Kane

Appendix
Mouse

1968 Douglas C. Engelbart
1968 First mouse by Douglas Engelbart

1977: Command line interface with mouse adopted

1973: Xerox PARC Alto, 1984: MacIntosh 128K

Appendix
Touch

1972: Plato IV touch screen terminal

Touch is in stage two

Are we still in stage two? WTF!

Touch is still emulating mouse

Touch is still emulating hardware keyboard

Touch is still using scrolling and scroll bars

New technology
Copy old language
New language
Stage one
Stage two
Stage three

Combine gestures with keyboard

Copy real life

We are all trying to get to stage three

Our pathto get tostage three
Multi-touch
Body-aware
Multi-modal

Body-aware

Multi-touch

Multi-modal
“Every input method is best for something
and worst for something else.”
Bill Buxton
touch and pen
touch and speech
touch and air
+
+
+

Is touch the end of the yellow brick road?
Graphical User Interface
Touch User Interface
Command Line Interface
Natural User Interface
Text commands
On screen pointer
Single User
Direct Touch Input
Multi-channel input
Multi-user
Text commands
Single-channel output
Single User
Touch
Voice
Air / Movement Gestures
Sensor Input
Multi-channel in and out
Multi-user

What do you think?
@amishpatel
@kayhof
# sxsw #futureoftouch

http://www.standardsinsight.com	192
http://captainfutureelearning.blogspot.com	28
http://www.tobydonovan.com	8
url_unknown	3
http://translate.googleusercontent.com	2
http://www.blogger.com	2
https://si0.twimg.com	1
https://twimg0-a.akamaihd.net	1
http://webcache.googleusercontent.com	1
http://www.standardsinsight.com.	1
http://twitter.com	1
http://captainfutureelearning.blogspot.jp	1

SXSW The future of touch

by Kay Hofmeester on Mar 14, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

12 Embeds 241

Statistics

SXSW The future of touch — Presentation Transcript