The Windows® 7 Developer Experience (mt)Microsoft® Corporation

Windows 7 Multi-Touch the future is Here!

The past drives the future.

Input DevicesHow many people here use a mouse?When was it invented?1963 !!! by Douglas EnglebartWhen was it first (widely) used?Mid 90’sWhile Xerox put out a computer with a mouse in 1982 and others slowly followed, it was not until the MID 90’s that mice were widely used on the computer (30 YEARS!!!)

Input DevicesHow many people here use a touch screen?When was it invented?1972 !!! The PLATO IV (Research Scientists At University of Illinois)

Multi-touch through the years1985: Sensor Frame (Carnegie Mellon University)1992: Flip Keyboard1995/97: Active Desk

Multi-touch through the years1999: Portfolio Wall2005: PlayAnywhere2007: Microsoft Surface Computing

Gestures1983: Video Place / Video Desk (Myron Krueger) Essentially “wrote the book” in terms of unencumbered (i.e., no gloves, mice, styli, etc.) rich gestural interaction.

Touch HistoryAbout the same time themac came out

Touch Phones2006: Synaptics & Pilotfish (San Jose) http://www.synaptics.com2007: Apple iPhone1992: Simon (IBM & Bell South) The first touch phone

“So how can I play with this now??”

3 things to know….the screensthe hardwarethe software

The Screens

How to touch ResistiveThink Push Down and drag

How to touch CapacitiveThink Electric Impulse

How to touch InfraredThink laser pointer(s)

The Hardware

HardwareCapacitiveHP Touchsmart tx2N-trig (2-10)CapacitiveDell LatitudeXT2N-Trig (2-10)InfraredHP Touchsmart IQ816NewWindow(2)

The Software

Multi-Touch Development TiersGood – Better – BestWindows application can target one of three levels of touch integrationGood: No specific touch APIs are used but the application UI is appropriately sized and works well with the built-in gesturesBetter: The gesture APIs are supported to give smooth natural interactionsBest: Deep touch-focused experiences designed to take advantage of multi-touch features

WM_Touch – WM_Gesture

Windows7.MultitouchEasyto Write code nowPC’s, Form Factors, TechnologyWindows7.Multitouch.WPFWM_Touch

Massive Multi-touch, Multi-userEasier to Write code soonPC’s, Form Factors, Technology

The API protected event EventHandler<WMTouchEventArgs> Touchdown; // touch down event handlerprotected event EventHandler<WMTouchEventArgs> Touchup; // touch up event handlerprotected event EventHandler<WMTouchEventArgs> TouchMove; // touch move event handler // Private data members private int x; // touch x client coordinate in pixels private int y; // touch y client coordinate in pixels private int id; // contact ID private int mask; // mask which fields in the structure are valid private int flags; // flags private int time; // touch event time private intcontactX; // x size of the contact area in pixels private intcontactY; // y size of the contact area in pixels

Working with MultiTouchdemo

More InformationMulti-Touch Systems that I Have Known and Lovedhttp://www.billbuxton.com/multitouchOverview.htmlMike Taulty’s Blog http://bit.ly/NKVTNExample Photo App http://bit.ly/d4eE9

Multi-touch is not new1972: PLATO IV Touch Screen Terminal Windows 7 Multi-touchTouchable HologramPresentFuture(http://bit.ly/akq7V)Past

The End(or a new beginning)

Lightning RodFranklin StoveOdometer

Leonardo Da VinciHelecopterEight Barrel Machine GunParachute

Thomas EdisonPhonographFilm ProjectorLight Bulb

George Jetson

Jet packs

Big Flatscreen TV's

Robot Housekeepers

Guestures and MovementWhat can I do?

Predefined Gestures – TranslatePlace two fingers in the application window and drag in the direction you want

Zoom and RotateRotateTouch the image with two fingers and turn fingers in a circleZoomTouch the image with two fingers and move them closer or further apart

Two Finger Tapand Finger RollTwo Finger TapTap once with both fingersFinger RollPlace one finger on the screen, place second finger on the screen, lift the second finger, and then lift the first finger

ManipulationsManipulations are a great foundation for touch-optimized experiences. They are:2D affine transformations (translate, scale, rotate)Superset of supported gesturesSupports multiple concurrent manipulationsNeed a source of raw data: WM_TOUCHSimilar to Surface APIsInterfaces:IManipulationProcessorIManipulationEvents

InertiaProvides basic physicsWorks hand in hand with manipulationsInterfaces:IInertiaProcessorIManipulationEvents – Same event interface as manipulations