Multi(Touch) Gesture Research      Lecture: Journal Club – spring 2010                       Florian Weil   University of ...
Questions●   Which differences exist in gesture    interaction on different screen sizes?●   How is the research community...
Different screenformats - Small     Small Screens                          Smart Phones
Different screenformats - Medium     Netbooks                        Tablet PCs
Different screenformats - Large    MultiTouch Displays   TableTop Displays
Different screenformats – extra large                      Touch Walls
Researcher & People●   Explored    ●   Keynote and Opening Speakers    ●   Reviewer Lists    ●   Papers●   Could not find ...
Conferences & Community●   Computer Human Interaction (CHI)●   Interactive Tapletop and Surfaces (ITS)●   Tangible, Embedd...
Computer Human Interaction (CHI)●   Big and general conference about Human and Computer Interaction●   Special Session abo...
Tangible, Embedded, andEmbodied Interaction (TEI)●   Medium big conference on Tangible, Embedded, and Embodied    Interact...
Interactive Tapletop and Surfaces●   Medium and pretty young conference (started 2006) with focus on    interaction design...
Gesture Workshop●   Small conference / workshop with focus on gesture interaction    in general●   Mostly focus on free fo...
Researched PapersAnne Roudaut, Eric Lecolinet and Yves Guiard, “MicroRolls: expanding touch-screen input vocabulary bydist...
Small Screen Gesture with Thumb●   http://www.youtube.com/watch?v=bfH0-OqgbLw●   Context: during movement, one hand intera...
Medium screen: uni or bimanual gesture●    Context: TableTop systems and Medium Screens●    Motivation: investigate perfom...
TableTop Screen: Hand Distinction●    Context: TableTop systems and Large Screens●    Motivation: Distinguish one-hand and...
TableTop Screen: Hand Distinction            Source: Chi Tai Dang, Martin Straub, Elisabeth André, “Hand distinction for m...
Large Screen Gesture via Pointing●   http://www.youtube.com/watch?v=cV60gwiM5HM●   Context: Big static screen, some object...
Upcoming SlideShare
Loading in...5
×

Multi(Touch) Gesture Research

3,195

Published on

A list of important academic conferences for gesture based interaction, and a summary of 4 papers about gestures on different screen size.

0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,195
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
98
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Multi(Touch) Gesture Research

  1. 1. Multi(Touch) Gesture Research Lecture: Journal Club – spring 2010 Florian Weil University of Art Linz – Master: Interface Culture
  2. 2. Questions● Which differences exist in gesture interaction on different screen sizes?● How is the research community for gesture interaction organized? ● Which conferences exist? ● Who are the key researcher and other important researcher?
  3. 3. Different screenformats - Small Small Screens Smart Phones
  4. 4. Different screenformats - Medium Netbooks Tablet PCs
  5. 5. Different screenformats - Large MultiTouch Displays TableTop Displays
  6. 6. Different screenformats – extra large Touch Walls
  7. 7. Researcher & People● Explored ● Keynote and Opening Speakers ● Reviewer Lists ● Papers● Could not find key roles● Good balance of academic (University) and economic driven research (Microsoft etc.)
  8. 8. Conferences & Community● Computer Human Interaction (CHI)● Interactive Tapletop and Surfaces (ITS)● Tangible, Embedded, and Embodied Interaction (TEI)● Gesture Workshop (GW)
  9. 9. Computer Human Interaction (CHI)● Big and general conference about Human and Computer Interaction● Special Session about surfaces and tabletop Interaction → with gesture interaction● Organizer ● Georgia Institute of Technology ● Brigham Young University ● Microsoft Research / University of Washington● Place ● Mainly USA and Canada, sometimes Europe ● Atlanta, Boston, Florence, San Jose, Montreal...
  10. 10. Tangible, Embedded, andEmbodied Interaction (TEI)● Medium big conference on Tangible, Embedded, and Embodied Interaction.● Very good for gesture research for tangible devices.● Sponsors: ● Nokia, Microsoft Research, Philips, Fraunhofer, ACM, SIGCHI● Place: ● Europe and North America ● Portugal, USA, UK, Germany, ...
  11. 11. Interactive Tapletop and Surfaces● Medium and pretty young conference (started 2006) with focus on interaction design in connection with surfaces and tabletop systems, like reactable● Very good for research in (multiTouch) gesture interaction● Organizer: ● Sriram Subramanian, University of Bristol, UK ● Antonio Krüger (DFKI GmbH) ● And other...● Place: ● Very often in Europe ● Saarbrücken, Banff, Amsterdam, Newport
  12. 12. Gesture Workshop● Small conference / workshop with focus on gesture interaction in general● Mostly focus on free form and auditive gestures● Organizer ● University Bielefeld, Adetti, University of South Brittany, …● Place ● Only in Europe ● Bielefeld, Lisbon, Ile de Berder, Genova, London, ...
  13. 13. Researched PapersAnne Roudaut, Eric Lecolinet and Yves Guiard, “MicroRolls: expanding touch-screen input vocabulary bydistinguishing rolls vs. slides of the thumb”, Proceedings of CHI 2009, Boston, MA, USA, 2009, pp. 927-936..Tom Moscovich and John F. Hughes, “Indirect mappings of multi-touch input using one and two hands”,Proceedings of CHI 2008, Florence, Italy, 2008, pp. 1275-1284.Chi Tai Dang, Martin Straub, Elisabeth André, “Hand distinction for multi-touch tabletop interaction”,Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 101-108.Mathias Frisch, Jens Heydekorn, Raimund Dachselt, “Investigating multi-touch and pen gestures fordiagram editing on interactive surfaces”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 149-156Alexander Schick, Florian van de Camp, Joris Ijsselmuiden and Rainer Stiefelhagen, “Extending touch:towards interaction with large-scale surfaces”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp.117-124.
  14. 14. Small Screen Gesture with Thumb● http://www.youtube.com/watch?v=bfH0-OqgbLw● Context: during movement, one hand interaction● Categories: Drag, Swipe, Rubbing, MicroRolls● Testings (10 people, Aged 23-28) ● MicroRoll 2x faster than contex menu UI ● MicroRoll same as fast as easy Toolbar, faster than difficult toolbar● MicroRoll Gesture itself: ● Robust and easy to learn ● Good perfomance (influenced by the position of the gesture) ● Good combination with TapTap, TapRoll, RollMark gestures
  15. 15. Medium screen: uni or bimanual gesture● Context: TableTop systems and Medium Screens● Motivation: investigate perfomance and the right task for uni and bimanual gestures● Approach: Testing the commands align, positioning, rotation, scaling of digital objects.● Result: ● Unimanual interaction for visual rotation, transporting, rotating, and stretching ● Bimanual interaction for control of two individual (control) points (example tasks: window manipulation, image croping etc.) ● Perfomance differences are small, so the designer can safely interchange between the two methods
  16. 16. TableTop Screen: Hand Distinction● Context: TableTop systems and Large Screens● Motivation: Distinguish one-hand and two-hand gestures improves gesture systems ● more stable and accurated gesture recognition ● avoiding of conflicts in multi-user systems● Approach: use the anatomy information of the user hand and combine them with touch point and finger orientation data.● Result: ● Average: 96% successfully hand recognition ● Thumb need a more detail observation ● Heuristic formular works fine, but constant values needs improvements
  17. 17. TableTop Screen: Hand Distinction Source: Chi Tai Dang, Martin Straub, Elisabeth André, “Hand distinction for multi-touch tabletop interaction”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 101-108.
  18. 18. Large Screen Gesture via Pointing● http://www.youtube.com/watch?v=cV60gwiM5HM● Context: Big static screen, some objects are not reachable● Categories: Pointing and Touch gestures● Seamlessly direct object manipulation with pointing and touch● User test results: ● User think it is a very useful extension ● Very intuitiv and easy learning interaction ● Objects are easier to reach and less exhausting compared to touch-only systems ● User did not really use these two interactions for the same task
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×