This document summarizes Shane Morris' presentation on designing for multitouch interfaces like Microsoft Surface. Some key points discussed include: considering showing "hotspots" and natural gestures over traditional controls; ensuring gestures are discoverable; addressing challenges of multi-user interaction like orientation independence and one user not being able to place the whole app in a mode. A proof of concept project with Lonely Planet is described that brought guidebook content to life on Surface for a more engaging store experience. User experience considerations like collaboration, handling multiple videos and maps for multi-user are also covered.

1. Designing for Multitouch, and Multiple TouchpointsShane MorrisUser Experience EvangelistMicrosoft Australia

2. Future VisionVideo at http://www.microsoft.com/video/en/us/details/e7728af1-3fe4-4e25-a907-3dbf689fe11a?vp_evt=eref&vp_video=Productivity+Future+Vision

3. StaticResponsiveEvocativeDisconnectedIndirectUnmediatedHigh-LowDouble MediumFast FewDirectedExploratoryContextualRecallRecognitionIntuitionCUIGUINUITextGraphicsObjects

4. Microsoft Surface

5. Microsoft SurfaceVideo at: http://www.microsoft.com/surface/Pages/Experience/Videos.aspx?video=63932882-8a7f-44a4-9eb3-2a6f3d83980a

6. Surface AttributesObject recognitionDirect interactionMulti-touchMulti-user

7. Designing for Multitouch

8. Tap is not the new click

9. Touch

10. Some Things About Designing for TouchConsider Showing the “Hotspot”Avoid “controls” in favour of natural interactionsGesturesAre they discoverable?

11. Is it working?

12. Is it Working?(Video of Surface SP1 showing “hotspots”)

13. FireFoxGestureSwipe Left: Go back in historySwipe Up: Go to the top of the page

14. Apple iPhoneGestureSwipe Left: Go Forward in HistorySwipe up: Go to the bottom of a page

15. Some Things About Designing for Surface (Multi-user)Orientation-Independence

17. Is this really just a big PC?I don’t like having to share and wait my turnConstantly reaching across the table is not fun Reading upside down makes my head hurt

18. Some Things About Designing for Surface (Multi-user)Orientation-IndependenceModalityOne user can’t place the whole application into a ‘mode’Tools and Targets

19. Lonely Planet Proof of Concept

20. The Back Story

21. The BriefBridge the physical and the digitalBring guidebook content to lifeConnect physical products with broader Lonely Planet ‘ecosystem’Create an experience that extends beyond the storeCreate buzz around technologyDrive purchasesBring people together

23. The ProcessBrainstormActivity ScenarioTech CheckDe-scoping StoryboardCodeDesignRefineCode...

24. The inevitable big ideas we threw outTranslationTrip PlannerBulletin BoardCommunication between storesBuild your own guideBig ScreenMapping

25. The Activity ScenarioMatt and Kate in SydneyMatt and Kate have finally made it through immigration at Sydney airport. They've been planning their South American trip for months - it's finally here!But first they have to suffer through the usual two hour wait in the airport before departure. Matt thinks quickly - 'let's get a coffee!' They wander around scanning the usual airport shops, looking for a Gloria Jean's. There are sunglasses shops, duty free of course, a newsagent... Suddenly Kate notices a cool looking store sporting a big blue Lonely Planet logo."Oh my God! I didn't know there were Lonely Planet stores! Let's check it out!"While planning the trip, Kate was a regular visitor to lonelyplanet.com. She has registered a Lonely Planet profile, and the South America guidebook that they've been thumbing through for the last 4 months is in her bag. Kate has even stored her favourite South American destinations on lonelyplanet.com, and has posted a bunch of questions on Thorntree about the best romantic spots in Buenos Aires. Matt has been less involved in the planning. He knows the Lonely Planet brand, but just associates them with guidebooks.As they walk into the store, they can see not only Lonely Planet products, but also Crumpler, Teva, Northface and a bunch of other travel related brands. Kate is immediately attracted to the wall of books, while Matt notices a group of people leaning over a display screen in the middle of the store.Matt watches a young boy flick through images of New Zealand on the tabletop screen using his hands. Behind the photos is a map of the Queenstown area of New Zealand.Over at the book shelf, Kate notices a sticker on the back of the Buenos Aires city guide. The sticker says “Place me on our Microsoft Surface to learn more!” She grabs Argentina, Peru, and Buenos Aires and takes them over to Matt.

26. IterationVideo of first prototype (taken with a Mobile phone)The prototype was an important milestone in gaining stakeholder buy-in.

27. Lonely Planet Surface Proof of ConceptDemo

28. Lonely Planet Surface P.O.C.Various videos of the demo. Similar videos are here:http://blogs.msdn.com/shanemo/archive/2009/07/02/remix-australia-lonely-planet-surface-demo.aspx

29. User Experience ConsiderationsCollaborationReal EstateMulti-userHow to handle multiple videos?How to handle mapping?

30. Multiple Videos

31. User Experience ConsiderationsCollaborationReal EstateMulti-userHow to handle multiple videos?How to handle mapping?

32. Map me

33. User Experience ConsiderationsMulti-userHow to handle multiple videos?How to handle mapping?‘Destination cards’ or books?The ‘Passport’How to identify individuals?

34. Designing for TouchNo standardsShift away from ‘controls’Possibly no ‘top’Possibly multi-user=>More than usual attention to Design and the User Interface.Think about the ‘super-real’

35. © 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.