Touching the Future
Chris Koenig
Developer Evangelist, Microsoft Corporation
6/3/2009 Joe Fletcher MIX09, Las Vegas
1

6/3/2009 Joe Fletcher MIX09, Las Vegas
2

Touch is not Touch is a Touch is great
good for computing for specific
everything evolution aspects
It is not an end all solution It is an addition element for users to New technology has enabled touch
interact with their content in new and systems, which can enhance certain
unique ways activities
6/3/2009 Joe Fletcher MIX09, Las Vegas
3

Touch Gesture Manipulation
The act of directly touching your digital Hand motions to take an action Alteration or freeform movement of
content digital content using touch
Natural User Interface
The combination of these and other
elements the create a unique way to
interact with your digital content
6/3/2009 Joe Fletcher MIX09, Las Vegas
4

Why Evolve?
6/3/2009 Joe Fletcher MIX09, Las Vegas
5

Command Line Interface (CLI)
6/3/2009 Joe Fletcher MIX09, Las Vegas
6

Graphic User Interface (GUI)
6/3/2009 Joe Fletcher MIX09, Las Vegas
7

Natural User Interface (NUI)
6/3/2009 Joe Fletcher MIX09, Las Vegas
8

Natural User Interface (NUI)
6/3/2009 Joe Fletcher MIX09, Las Vegas
9

NUI
vs.
Web 2.0
6/3/2009 Joe Fletcher MIX09, Las Vegas
10

NUI & Touch
should not be a
novelty
6/3/2009 Joe Fletcher MIX09, Las Vegas
11

6/3/2009 Joe Fletcher MIX09, Las Vegas
12

Tap is not the new click
≠
6/3/2009 Joe Fletcher MIX09, Las Vegas
13

Input Ecology
Keyboard Mouse Stylus Single point Multi point
Good for Good for Good for Good for Good for
Accuracy Moving across the Freeform input Direct object selection Manipulating objects
screen efficiently Social
Con Con Con Con Con
Limited Indirect Low accuracy Not for quick input Not for input
Need large controls Low accuracy Low accuracy
Need of large controls Need large controls
Mis-hits from Support of hands and
fingernails of perceived screen
hit area
6/3/2009 Joe Fletcher MIX09, Las Vegas
14

[Partial] Touch Ecology
Multi point Multi Touch NUI
(screen) (screen) (Gesture & Physical/Digital)
Reacts to direct input Reacts to multiple Reacts to multiple
inputs inputs
Orients UI to the Spatial Recognition -
direction of the touch Orients UI to the
direction of the touch
Spatial recognition of
system Object recognition -
Blurring physical and
digital
6/3/2009 Joe Fletcher MIX09, Las Vegas
15

Context, task, and use define the solution
6/3/2009 Joe Fletcher MIX09, Las Vegas
16

Context, task, and use define the solution
Touch is not a
solution in search of
a problem
6/3/2009 Joe Fletcher MIX09, Las Vegas
17

Surface Massive Multi-touch, Multi-user
Unique
Spot
Windows 7 PC’s, Form Factors, Technology
6/3/2009 Joe Fletcher MIX09, Las Vegas
18

Microsoft Surface
Microsoft Surface is a revolutionary
computer that responds to natural hand
gestures and real-world objects, creating
unique new ways for people to
collaboratively interact with digital
content.
6/3/2009 Joe Fletcher MIX09, Las Vegas
19

Microsoft Surface and NUI
Microsoft Surface computing uses sensing and display technology to infuse everyday
surfaces with digital content and is comprised of the following unique attributes:
Direct interaction Multi-touch Multi-user Object recognition
6/3/2009 Joe Fletcher MIX09, Las Vegas
20

6/3/2009 Joe Fletcher MIX09, Las Vegas
21

Building Surface Applications
6/3/2009 Joe Fletcher MIX09, Las Vegas
22

Windows 7
6/3/2009 Joe Fletcher MIX09, Las Vegas
23

Windows 7
6/3/2009 Joe Fletcher MIX09, Las Vegas
24

Touch Scenarios And Windows 7
Scenarios Areas of investment
 Navigating the web
 Reading & sorting email • Developer Platform
 Viewing photos
 Casual games • UI Enhancements
 Music and video
 Navigating files
• Gestures
 Arranging windows
 Using Office applications
• Applications
All focused on consumption
6/3/2009 Joe Fletcher MIX09, Las Vegas
25

Building Windows 7 Applications
6/3/2009 Joe Fletcher MIX09, Las Vegas
26

Touch Development Roadmap
NET 4.0 / 7 Release Release
Windows Surface 2.0
3.5 1.0
Surface
Multi-Touch Controls
Multi-Touch
Controls &API
Multi-Touch API
Multi-Touch API
Multi-Touch API and Controls
Multi-Touch API
6/3/2009 Joe Fletcher MIX09, Las Vegas
27

Challenge Form Factor & Technology
6/3/2009 Joe Fletcher MIX09, Las Vegas
28

Touch Hardware Ecology
6/3/2009 Joe Fletcher MIX09, Las Vegas
29

Touch Hardware Ecology
Capacitive Capacitive Infrared Vision system Stylus
6/3/2009 Joe Fletcher MIX09, Las Vegas
30

Touch Hardware Ecology
Capacitive Capacitive Infrared Vision system Stylus
N-Trig (2-10) N-trig (2-10) HP (2) Surface (52) Wacom (1)
6/3/2009 Joe Fletcher MIX09, Las Vegas
31

Challenge Patterns
6/3/2009 Joe Fletcher MIX09, Las Vegas
32

FireFox
Swipe Left: Go back in history
Swipe Up: Go to the top of the page
6/3/2009 Joe Fletcher MIX09, Las Vegas
33

Apple iPhone
Swipe Left: Go Forward in History
Swipe up: Go to the bottom of a page
6/3/2009 Joe Fletcher MIX09, Las Vegas
34

Challenge Orientation
6/3/2009 Joe Fletcher MIX09, Las Vegas
35

Horizontal Vertical
6/3/2009 Joe Fletcher MIX09, Las Vegas
36

Challenge Cardio Effect
6/3/2009 Joe Fletcher MIX09, Las Vegas
37

Challenge Paradigms
6/3/2009 Joe Fletcher MIX09, Las Vegas
38

To button
or
not to button
6/3/2009 Joe Fletcher MIX09, Las Vegas
39

Challenge Getting people to touch
6/3/2009 Joe Fletcher MIX09, Las Vegas
40

Exploration Instruct
6/3/2009 Joe Fletcher MIX09, Las Vegas
41

Challenge Visualizing Touch
6/3/2009 Joe Fletcher MIX09, Las Vegas
42

Is it working?
6/3/2009 Joe Fletcher MIX09, Las Vegas
43

Your effort to remain
what you are is what
limits you
Ghost in the Shell
6/3/2009 Joe Fletcher MIX09, Las Vegas
44

Debating the future
of touch is useless
6/3/2009 Joe Fletcher MIX09, Las Vegas
45

Creating the future
is more interesting
6/3/2009 Joe Fletcher MIX09, Las Vegas
46

Touch is not good Touch is an Touch is great for
for everything evolution specific aspects
6/3/2009 Joe Fletcher MIX09, Las Vegas
47

Take advantage of Microsoft Surface
Download SDK • Available from the Surface Community site
Workstation Edition
• Learn how to build applications from scratch on Surface
Develop for Surface by viewing videos on Surface.com
• Interested in purchasing a Surface? Email to
Purchase a Surface sbizdesk@microsoft.com
6/3/2009 Joe Fletcher MIX09, Las Vegas
48

Future Vision
2019
6/3/2009 Joe Fletcher MIX09, Las Vegas
49

Thank you!
Chris Koenig
chris.koenig@microsoft.com
http://blogs.msdn.com/chkoenig
@chriskoenig
6/3/2009 Joe Fletcher MIX09, Las Vegas
50