Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Multi(Touch) Gesture Research


Published on

A list of important academic conferences for gesture based interaction, and a summary of 4 papers about gestures on different screen size.

  • Dating direct: ❶❶❶ ❶❶❶
    Are you sure you want to  Yes  No
    Your message goes here
  • Follow the link, new dating source: ❶❶❶ ❶❶❶
    Are you sure you want to  Yes  No
    Your message goes here

Multi(Touch) Gesture Research

  1. 1. Multi(Touch) Gesture Research Lecture: Journal Club – spring 2010 Florian Weil University of Art Linz – Master: Interface Culture
  2. 2. Questions● Which differences exist in gesture interaction on different screen sizes?● How is the research community for gesture interaction organized? ● Which conferences exist? ● Who are the key researcher and other important researcher?
  3. 3. Different screenformats - Small Small Screens Smart Phones
  4. 4. Different screenformats - Medium Netbooks Tablet PCs
  5. 5. Different screenformats - Large MultiTouch Displays TableTop Displays
  6. 6. Different screenformats – extra large Touch Walls
  7. 7. Researcher & People● Explored ● Keynote and Opening Speakers ● Reviewer Lists ● Papers● Could not find key roles● Good balance of academic (University) and economic driven research (Microsoft etc.)
  8. 8. Conferences & Community● Computer Human Interaction (CHI)● Interactive Tapletop and Surfaces (ITS)● Tangible, Embedded, and Embodied Interaction (TEI)● Gesture Workshop (GW)
  9. 9. Computer Human Interaction (CHI)● Big and general conference about Human and Computer Interaction● Special Session about surfaces and tabletop Interaction → with gesture interaction● Organizer ● Georgia Institute of Technology ● Brigham Young University ● Microsoft Research / University of Washington● Place ● Mainly USA and Canada, sometimes Europe ● Atlanta, Boston, Florence, San Jose, Montreal...
  10. 10. Tangible, Embedded, andEmbodied Interaction (TEI)● Medium big conference on Tangible, Embedded, and Embodied Interaction.● Very good for gesture research for tangible devices.● Sponsors: ● Nokia, Microsoft Research, Philips, Fraunhofer, ACM, SIGCHI● Place: ● Europe and North America ● Portugal, USA, UK, Germany, ...
  11. 11. Interactive Tapletop and Surfaces● Medium and pretty young conference (started 2006) with focus on interaction design in connection with surfaces and tabletop systems, like reactable● Very good for research in (multiTouch) gesture interaction● Organizer: ● Sriram Subramanian, University of Bristol, UK ● Antonio Krüger (DFKI GmbH) ● And other...● Place: ● Very often in Europe ● Saarbrücken, Banff, Amsterdam, Newport
  12. 12. Gesture Workshop● Small conference / workshop with focus on gesture interaction in general● Mostly focus on free form and auditive gestures● Organizer ● University Bielefeld, Adetti, University of South Brittany, …● Place ● Only in Europe ● Bielefeld, Lisbon, Ile de Berder, Genova, London, ...
  13. 13. Researched PapersAnne Roudaut, Eric Lecolinet and Yves Guiard, “MicroRolls: expanding touch-screen input vocabulary bydistinguishing rolls vs. slides of the thumb”, Proceedings of CHI 2009, Boston, MA, USA, 2009, pp. 927-936..Tom Moscovich and John F. Hughes, “Indirect mappings of multi-touch input using one and two hands”,Proceedings of CHI 2008, Florence, Italy, 2008, pp. 1275-1284.Chi Tai Dang, Martin Straub, Elisabeth André, “Hand distinction for multi-touch tabletop interaction”,Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 101-108.Mathias Frisch, Jens Heydekorn, Raimund Dachselt, “Investigating multi-touch and pen gestures fordiagram editing on interactive surfaces”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 149-156Alexander Schick, Florian van de Camp, Joris Ijsselmuiden and Rainer Stiefelhagen, “Extending touch:towards interaction with large-scale surfaces”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp.117-124.
  14. 14. Small Screen Gesture with Thumb●● Context: during movement, one hand interaction● Categories: Drag, Swipe, Rubbing, MicroRolls● Testings (10 people, Aged 23-28) ● MicroRoll 2x faster than contex menu UI ● MicroRoll same as fast as easy Toolbar, faster than difficult toolbar● MicroRoll Gesture itself: ● Robust and easy to learn ● Good perfomance (influenced by the position of the gesture) ● Good combination with TapTap, TapRoll, RollMark gestures
  15. 15. Medium screen: uni or bimanual gesture● Context: TableTop systems and Medium Screens● Motivation: investigate perfomance and the right task for uni and bimanual gestures● Approach: Testing the commands align, positioning, rotation, scaling of digital objects.● Result: ● Unimanual interaction for visual rotation, transporting, rotating, and stretching ● Bimanual interaction for control of two individual (control) points (example tasks: window manipulation, image croping etc.) ● Perfomance differences are small, so the designer can safely interchange between the two methods
  16. 16. TableTop Screen: Hand Distinction● Context: TableTop systems and Large Screens● Motivation: Distinguish one-hand and two-hand gestures improves gesture systems ● more stable and accurated gesture recognition ● avoiding of conflicts in multi-user systems● Approach: use the anatomy information of the user hand and combine them with touch point and finger orientation data.● Result: ● Average: 96% successfully hand recognition ● Thumb need a more detail observation ● Heuristic formular works fine, but constant values needs improvements
  17. 17. TableTop Screen: Hand Distinction Source: Chi Tai Dang, Martin Straub, Elisabeth André, “Hand distinction for multi-touch tabletop interaction”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 101-108.
  18. 18. Large Screen Gesture via Pointing●● Context: Big static screen, some objects are not reachable● Categories: Pointing and Touch gestures● Seamlessly direct object manipulation with pointing and touch● User test results: ● User think it is a very useful extension ● Very intuitiv and easy learning interaction ● Objects are easier to reach and less exhausting compared to touch-only systems ● User did not really use these two interactions for the same task