Multi(Touch) Gesture Research

Multi(Touch) Gesture Research Lecture: Journal Club – spring 2010 Florian Weil University of Art Linz – Master: Interface Culture

Questions● Which differences exist in gesture interaction on different screen sizes?● How is the research community for gesture interaction organized? ● Which conferences exist? ● Who are the key researcher and other important researcher?

Different screenformats - Small Small Screens Smart Phones

Different screenformats - Medium Netbooks Tablet PCs

Different screenformats - Large MultiTouch Displays TableTop Displays

Different screenformats – extra large Touch Walls

Researcher & People● Explored ● Keynote and Opening Speakers ● Reviewer Lists ● Papers● Could not find key roles● Good balance of academic (University) and economic driven research (Microsoft etc.)

Conferences & Community● Computer Human Interaction (CHI)● Interactive Tapletop and Surfaces (ITS)● Tangible, Embedded, and Embodied Interaction (TEI)● Gesture Workshop (GW)

Computer Human Interaction (CHI)● Big and general conference about Human and Computer Interaction● Special Session about surfaces and tabletop Interaction → with gesture interaction● Organizer ● Georgia Institute of Technology ● Brigham Young University ● Microsoft Research / University of Washington● Place ● Mainly USA and Canada, sometimes Europe ● Atlanta, Boston, Florence, San Jose, Montreal...

Tangible, Embedded, andEmbodied Interaction (TEI)● Medium big conference on Tangible, Embedded, and Embodied Interaction.● Very good for gesture research for tangible devices.● Sponsors: ● Nokia, Microsoft Research, Philips, Fraunhofer, ACM, SIGCHI● Place: ● Europe and North America ● Portugal, USA, UK, Germany, ...

Interactive Tapletop and Surfaces● Medium and pretty young conference (started 2006) with focus on interaction design in connection with surfaces and tabletop systems, like reactable● Very good for research in (multiTouch) gesture interaction● Organizer: ● Sriram Subramanian, University of Bristol, UK ● Antonio Krüger (DFKI GmbH) ● And other...● Place: ● Very often in Europe ● Saarbrücken, Banff, Amsterdam, Newport

Gesture Workshop● Small conference / workshop with focus on gesture interaction in general● Mostly focus on free form and auditive gestures● Organizer ● University Bielefeld, Adetti, University of South Brittany, …● Place ● Only in Europe ● Bielefeld, Lisbon, Ile de Berder, Genova, London, ...

Researched PapersAnne Roudaut, Eric Lecolinet and Yves Guiard, “MicroRolls: expanding touch-screen input vocabulary bydistinguishing rolls vs. slides of the thumb”, Proceedings of CHI 2009, Boston, MA, USA, 2009, pp. 927-936..Tom Moscovich and John F. Hughes, “Indirect mappings of multi-touch input using one and two hands”,Proceedings of CHI 2008, Florence, Italy, 2008, pp. 1275-1284.Chi Tai Dang, Martin Straub, Elisabeth André, “Hand distinction for multi-touch tabletop interaction”,Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 101-108.Mathias Frisch, Jens Heydekorn, Raimund Dachselt, “Investigating multi-touch and pen gestures fordiagram editing on interactive surfaces”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 149-156Alexander Schick, Florian van de Camp, Joris Ijsselmuiden and Rainer Stiefelhagen, “Extending touch:towards interaction with large-scale surfaces”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp.117-124.

Small Screen Gesture with Thumb● http://www.youtube.com/watch?v=bfH0-OqgbLw● Context: during movement, one hand interaction● Categories: Drag, Swipe, Rubbing, MicroRolls● Testings (10 people, Aged 23-28) ● MicroRoll 2x faster than contex menu UI ● MicroRoll same as fast as easy Toolbar, faster than difficult toolbar● MicroRoll Gesture itself: ● Robust and easy to learn ● Good perfomance (influenced by the position of the gesture) ● Good combination with TapTap, TapRoll, RollMark gestures

Medium screen: uni or bimanual gesture● Context: TableTop systems and Medium Screens● Motivation: investigate perfomance and the right task for uni and bimanual gestures● Approach: Testing the commands align, positioning, rotation, scaling of digital objects.● Result: ● Unimanual interaction for visual rotation, transporting, rotating, and stretching ● Bimanual interaction for control of two individual (control) points (example tasks: window manipulation, image croping etc.) ● Perfomance differences are small, so the designer can safely interchange between the two methods

TableTop Screen: Hand Distinction● Context: TableTop systems and Large Screens● Motivation: Distinguish one-hand and two-hand gestures improves gesture systems ● more stable and accurated gesture recognition ● avoiding of conflicts in multi-user systems● Approach: use the anatomy information of the user hand and combine them with touch point and finger orientation data.● Result: ● Average: 96% successfully hand recognition ● Thumb need a more detail observation ● Heuristic formular works fine, but constant values needs improvements

TableTop Screen: Hand Distinction Source: Chi Tai Dang, Martin Straub, Elisabeth André, “Hand distinction for multi-touch tabletop interaction”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 101-108.

Large Screen Gesture via Pointing● http://www.youtube.com/watch?v=cV60gwiM5HM● Context: Big static screen, some objects are not reachable● Categories: Pointing and Touch gestures● Seamlessly direct object manipulation with pointing and touch● User test results: ● User think it is a very useful extension ● Very intuitiv and easy learning interaction ● Objects are easier to reach and less exhausting compared to touch-only systems ● User did not really use these two interactions for the same task

http://blog.derhess.de	376
https://wiki.liip.ch	1
http://translate.googleusercontent.com	1

Multi(Touch) Gesture Research

by Florian Weil on Dec 05, 2010

Accessibility

Categories

Tags

Upload Details

Usage Rights

3 Embeds 378

Statistics

Multi(Touch) Gesture Research — Presentation Transcript