Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Interactive Tabletops and Surfaces - Lecture 07 - Next Generation User Interfaces (4018166FNR)

490 views

Published on

This lecture is part of a Next Generation User Interfaces course given at the Vrije Universiteit Brussel.

Published in: Education
  • Be the first to comment

  • Be the first to like this

Interactive Tabletops and Surfaces - Lecture 07 - Next Generation User Interfaces (4018166FNR)

  1. 1. 2 December 2005 Next Generation User Interfaces Interactive Tabletops and Surfaces Prof. Beat Signer Department of Computer Science Vrije Universiteit Brussel http://www.beatsigner.com
  2. 2. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 2November 7, 2016 Tabletops  The term tabletop was introduced in 2001  Tabletop interfaces are suitable for a number of specific activities  multi-user (group) collaborative work  shared horizontal workspace  interaction with the table as well as objects placed on the table (affordances of the table) - relies on a user's mental model of traditional tables  Tabletops support new forms of  hand and gesture interaction  tangible interaction  interactive visualisations
  3. 3. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 3November 7, 2016 Tabletops …  Typical tabletop applications  viewing photos or videos  brainstorming  advanced visualisation and data analysis  what about productivity tasks? - word processing - email - …  Current tabletop solutions seem to be used for dedicated tasks but not as all-purpose computing devices  missing keyboard input, precise pointing and standard applications  what about combining multi-touch with keyboard and mouse input?
  4. 4. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 4November 7, 2016 Tabletops …  Ergonomic issues  neck muscle strain or back problems when using a horizontal tabletop as primary input device  what about tabletops with an adjustable angle?  visibility and reachability of elements when working in larger groups
  5. 5. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 5November 7, 2016 Tabletop Research Domains  Computer Supported Cooperative Work (CSCW)  computer-mediated group collaboration and social interactions  Human Computer Interaction (HCI)  beyond the desktop metaphor  individual user actions and performance  Ubiquitous Computing (UbiComp)  beyond traditional desktop computer displays  Tangible User Interfaces (TEI)  interaction with physical objects on a tabletop CSCW HCI UbiCompTEI
  6. 6. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 6November 7, 2016 Multi-User Tabletop Interfaces  One of the core features of a tabletop interface is that there is enough room for multiple people to sit or stand around the table  Users share the interface  Studies have shown that users adopt territories on a tabletop for better coordination  personal territories - reserved for personal use (generally in front of the user)  group territories - space to perform main task activities (reachable by all users)  storage territories - used to store task resources and non-task items (in the periphery)
  7. 7. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 7November 7, 2016 Multi-User Tabletop Interfaces …  Some multi-user tabletop interfaces guidelines  provide visibility and transparency of actions - users should see that actions are going on and which actions are performed - personal territory on laptop vs. personal territory on shared tabletop  provide appropriate table space - users should not run out of space when not participating in the group activity Scott et al., 2004
  8. 8. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 8November 7, 2016 Multi-User Tabletop Interfaces …  Some multi-user tabletop interfaces guidelines …  provide functionality in the appropriate locality - e.g. reading/writing support in personal territory  support casual grouping of items and tools in the workspace - e.g. group/organise resources in piles as reminder Scott et al., 2004
  9. 9. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 9November 7, 2016 Enabling Technologies  Basic components of a tabletop system  touch sensor technology - size that can be covered - real-time and multi-touch tracking - integration with display - planar or support for curved surfaces?  display - projectors - LCD displays - OLED displays  software - potentially events from multiple users and multiple fingers to be tracked - beyond traditional WIMP interfaces - rotation of display areas
  10. 10. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 10November 7, 2016 Resistive Touch Panels  Typically two clear layers coated with transparent conductive substances  insulating layer between the two conductive sheets  Controller alternates between the layers  driving electric current on one and measuring the current on the other - detection of horizontal and vertical position Schöning et al., 2008
  11. 11. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 11November 7, 2016 Resistive Touch Panels …  Low-cost manufacturing  Low power consumption compared to other approaches  Input requires pressure on the outer layer  can also be used with a stylus or when wearing gloves  Reduced display quality due to the additional layers  Typically used for mobile phones, PDAs, digital cameras, …
  12. 12. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 12November 7, 2016 Surface Capacitive Touch Panels  Uniform transparent conduc- tive coating on glass panel  Electrodes in each corner  uniform electric field across the conductive layer  Touch with finger (or other conductive object) results in transport of charge  Better display quality than resistive panels  High positional accuracy  Difficult to detect multi-touch Schöning et al., 2008
  13. 13. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 13November 7, 2016 Projected Capacitive Touch Panels  Sensor grid (electrodes) covered by front layer  Enables accurate detection of multi-touch  High positional accuracy  Surface/projected ca- pacitive solutions only work with finger/special stylus  Not suited for large panels  slower transmission of electrical current  Typically used in more recent mobile phones, … Schöning et al., 2008
  14. 14. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 14November 7, 2016 Surface Acoustic Wave (SAW)  Glass panel with trans- mitting and receiving transducers as well as reflectors  ultrasonic waves  Soft material (e.g. finger) absorbs ultrasonic waves  detected by transducers  Excellent display quality since no layer on top  Can support dual-touch  Wide frame area necessary for transducers [http://www.dmccoltd.com/english/museum/touchscreens/technologies/AcousticWave.asp]
  15. 15. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 15November 7, 2016 Frustrated Total Internal Reflection (FTIR)  Optical total internal reflection  inner material must have a higher refractive index than outer material  angle at the boundary has to be sufficiently small  Infrared light is injected and reflected if a finger touches the surface  computer vision algorithms used to compute the location  Back projection can be used in combination with FTIR [http://www.teksol.in/2015/11/how-screen-touch-works.html]
  16. 16. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 16November 7, 2016 Diffused Illumination (DI)  Infrared light placed be- hind the projection surface  Depending on the diffuser, DI might also detect fingers and objects above the surface  Easier tracking of physical objects which might be identified by their shape or fiducial markers
  17. 17. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 17November 7, 2016 DigitalDesk  DigitalDesk developed by Pierre Wellner at Xerox EuroPARC  camera-based tracking and projection  "Instead of making the workstation more like a desk, make the desk more like a workstation"  Many follow-up augmented desk projects Wellner, DigitalDesk, 1991
  18. 18. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 18November 7, 2016 DiamondTouch Table  Developed at Mitsubishi Electric Research Labora- tories (MERL) in 2001  Front-projected interactive display  Can detect who is touching the surface  capacitive coupling between the touch surface and receivers located in the chair of each user [http://www.guillaumeriviere.name/collection/tabletop.html]
  19. 19. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 19November 7, 2016 Video: DiamondTouch Table
  20. 20. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 20November 7, 2016 Jeff Han’s Multi-Touch Table  Uses refined version of Frustrated Total Internal Reflection (FTIR)  Simple and cheap implementation of a multi-touch surface presented in 2006
  21. 21. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 21November 7, 2016 Video: Jeff Han’s Multi-Touch Table
  22. 22. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 22November 7, 2016 BendDesk  Seamlessly combines a vertical and a horizontal multi-touch surface  Uses 2 projectors and 3 cameras  FTIR-based tracking Weiss et al., 2010
  23. 23. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 23November 7, 2016 Video: BendDesk
  24. 24. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 24November 7, 2016 Microsoft PixelSense (Samsung SUR40)  Samsung produces the hardware and Microsoft the software  40 inch LED backlit LCD display (1920×1080)  integrated PC and PixelSense technology  Backlight with IR LEDs  reflected by fingers and other objects - multi-touch and real objects  pixels act as IR sensors [http://www.embeddedinsights.com/channels/wp-content/uploads/2011/03/110329-surface.png]
  25. 25. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 25November 7, 2016 Video: Microsoft PixelSense
  26. 26. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 26November 7, 2016 ReacTIVision  Open source toolkit for tangible multi-touch surfaces  Fiducial markers and multi-touch finger tracking Kaltenbrunner and Bencina, 2007
  27. 27. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 27November 7, 2016 Video: Reactable
  28. 28. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 28November 7, 2016 iTable Interactive Tabletop  Interactive tabletop based on digital pen a paper technology  developed by the GlobIS group at ETH Zurich  table surface covered with Anoto pattern - e.g. pattern printed on paper and covered with glass  top projection  high precision pen tracking Pen-Based Google Earth Browser Pen-Based Drawing Tool
  29. 29. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 29November 7, 2016 Video: iTable Interactive Tabletop
  30. 30. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 30November 7, 2016 Pen and Touch Interaction on Tabletops  Pen and touch interaction for authoring and editing documents on tabletops  simultaneous use of two modalities  alternative to on-screen widgets (for experts)  non-dominant hand postures define the pen mode Matulic and Norrie, 2013
  31. 31. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 31November 7, 2016 we-inspire Room  Ideation technology  based on Anoto's digital pen and paper technology  Large collaborative interactive wall surface  Various applications  sketch, write, brainstorm and capture
  32. 32. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 32November 7, 2016 Video: we-inspire Room
  33. 33. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 33November 7, 2016 HP Sprout  Immersive computing platform by HP  All-in-one PC  capacitive tactile touchpad with top projection  3D scanning cameras  creative work without mouse and keyboard …  “blended reality”
  34. 34. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 34November 7, 2016 Video: HP Sprout
  35. 35. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 35November 7, 2016 Microsoft Surface Studio  All-in-one PC  28-inch 4.5K PixelSense display  screen can be tilted to flat position (hinge design)  New tools for creative process  e.g. Surface dial - control for different applications when placed on the screen - haptic feedback (menu options)  Release date early 2017
  36. 36. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 36November 7, 2016 Video: Microsoft Surface Studio
  37. 37. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 37November 7, 2016 OLED Technology  Displays based on Organic Light Emitting Diodes (OLEDs)  flexible/thinner than LCDs  no background light  1000 times faster tan LEDs  can be printed and produced at less costs  Combination of OLED displays with thin multi- touch devices  ultimate tabletop system
  38. 38. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 38November 7, 2016 Windowless Plane  Futuristic windowless plane design concept by Technicon Design  Video stream from wing- mounted cameras  Screen estate could also be used for  showing movies  video conferences  …  Plane needs less fuel
  39. 39. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 39November 7, 2016 Video: Windowless Plane
  40. 40. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 40November 7, 2016 AquaTop Display  Interactive water surface that can for example be used in a bathroom  gesture-based interaction  Kinect in combination with top projection  New possibilities to interact with a water surface  e.g. poking fingers from beneath the water Takahashi et al., 2012
  41. 41. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 41November 7, 2016 Video: AquaTop Display
  42. 42. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 42November 7, 2016 Video: A Day Made of Glass
  43. 43. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 43November 7, 2016 Video: A Day Made of Glass 2
  44. 44. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 44November 7, 2016 References  S.D. Scott, M. Sheelagh, T. Carpendale and K.M. Inkpen, Territoriality in Collaborative Tabletop Workspaces, Proceedings of CSCW 2004, International Conference on Computer Supported Cooperative Work, Chicago, USA, November 2004  http://dx.doi.org/10.1145/1031607.1031655  J. Schöning et al., Multi-Touch Surfaces: A Technical Guide, Technical Report TUM-I0833, 2008  http://campar.in.tum.de/pub/schoening2008multitouch/schoening2008multit ouch.pdf  Jeff Han’s Multi-Touch Table, 2006  http://www.ted.com/talks/jeff_han_demos_his_breakthrough_touchscreen
  45. 45. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 45November 7, 2016 References …  P. Wellner, The DigitalDesk Calculator: Tangi- ble Manipulation on a Desk Top Display, Proceedings of ACM UIST 1991, Symposium on User Interface Software and Technology, Hilton Head, USA, November 1991  http://dx.doi.org/10.1145/120782.120785  M. Weiss, S. Voelker, C. Sutter and J. Borchers, BendDesk: Dragging Across the Curve, Proceedings of ITS 2010, International Conference on Interactive Tabletops and Surfaces, Saarbrücken, Germany, November 2010  http://dx.doi.org/10.1145/1936652.1936654
  46. 46. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 46November 7, 2016 References …  M. Kaltenbrunner and R. Bencina, ReacTIVision: A Computer-Vision Framework for Table- based Tangible Interaction, Proceedings of TEI 2007, International Conference on Tangible and Embedded Interaction, Baton Rouge, USA, February 2007  http://dx.doi.org/10.1145/1226969.1226983  F. Matulic and M.C. Norrie, Pen and Touch Gestural Environ- ment for Document Editing on Interactive Tabletops, Proceed- ings of ITS 2013, International Conference on Interactive Tabletops and Surfaces, St Andrews, UK, October 2013  http://dx.doi.org/10.1145/2512349.2512802
  47. 47. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 47November 7, 2016 References  Y. Takahashi, Y. Matoba and H. Koike, Fluid Surface: Interactive Water Surface Display for Viewing Information in a Bathroom, Proceedings of ITS 2012, International Conference on Interactive Tabletops and Surfaces, Cambridge, USA, November 2012  http://dx.doi.org/10.1145/2396636.2396687  C. Müller-Tomfelde (Ed.), Tabletops – Horizontal Inter- active Displays, Springer 2010  http://dx.doi.org/10.1007/978-1-84996-113-4  BendDesk  https://www.youtube.com/watch?v=5VNTPwVvLzE
  48. 48. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 48November 7, 2016 References …  Microsoft Pixelsense  https://www.youtube.com/watch?v=58dsqozft3k  HP Sprout  https://www.youtube.com/watch?v=t7v_7keCQf0  Microsoft Surface Studio  https://www.youtube.com/watch?v=BzMLA8YIgG0  iTable Interactive Tabletop  https://www.youtube.com/watch?v=rc7I5h6XirY  we-inspire Collaboration Technology  https://www.youtube.com/watch?v=eLfpMlyt4BA  AquaTop Display  https://www.youtube.com/watch?v=fYJneaa2O8I
  49. 49. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 49November 7, 2016 References …  Reactable  https://www.youtube.com/watch?v=0h-RhyopUmc  A Day Made of Glass  https://www.youtube.com/watch?v=6Cf7IL_eZ38  A Day Made of Glass 2  https://www.youtube.com/watch?v=jZkHpNnXLB0  Technicon Design Windowless Plane  https://www.youtube.com/watch?v=lNo3Sj_ri78
  50. 50. 2 December 2005 Next Lecture Gesture-based Interaction

×