Download to read offline
![Proxemics Distances [Hall, 1966]](https://image.slidesharecdn.com/0cmis15112015-forslideshare-160121114802/75/Touching-More-than-3-Dimensions-Research-Into-Novel-Interfaces-three-dimensions-and-above-58-2048.jpg)
Uploaded byJoaquim Jorge
Touching More than 3 Dimensions Research Into Novel Interfaces – three dimensions and above
The document discusses research into novel interfaces that extend interaction beyond traditional dimensions, particularly focusing on bimanual interactions and multimodal input methods for 3D modeling. It highlights techniques and evaluations for combining pen-based input with gestures on multi-touch surfaces, showcasing the benefits of direct manipulation and acoustic sensing. Key findings include user preferences for combined interaction techniques and insights into designing continuous interaction spaces for natural user experiences.
More Related Content
Similar to Touching More than 3 Dimensions Research Into Novel Interfaces – three dimensions and above
Touching More than 3 Dimensions Research Into Novel Interfaces – three dimensions and above
- 1. Touching More than3 Dimensions Research Into Novel Interfaces – three dimensions and above Joaquim Jorge INESC-ID & IST / U Lisboa Portugal IP / Leiria Nov 2015
- 2. Joaquim Jorge Instituto SuperiorTécnico Universidade de Lisboa Visualization and Multimodal Interfaces @ INESC-ID Lisboa http://web.ist.utl.pt/jorgej ACM/SIGGRAPH Small Conferences Committee Chair Editor Computers & GraphicsResearch Interests: Calligraphic Interaction, Multimodal Interfaces, Graphical Modeling
- 3. IS TONY STARKHOME IS TONY STARK HOME ?
- 4. WE HAVE SEENTHE FUTURE…
- 5.
- 6.
- 7. NATURAL INTERACTION Ivan Sutherland– 52 years ago
- 8. Ivan Sutherland SketchPadVideo youtube.com/watch?v=495nCzxM9PI
- 9. Beyond 2D + SpaceContinuous Above + Hands Bimanual Interactions + Dimensions 3D UIs + Expressiveness Sound, Kicking + Proxemics Eery Space
- 10. INTERACT 2011 Interaction TechniquesUnifying Touch and Gesture On and Above a Digital Surface
- 11. The Continuous InteractionSpace Video http://youtu.be/A8kb7BV7j1Y
- 12. Exploring Bimanual Interactionon a TableTop www.shapeshop3d.com
- 13. Pedro Lopes, DanielMendes, Bruno Araújo, Joaquim A. Jorge Combining bimanual manipulation and pen-based input for 3D modeling, SBIM 2011
- 14. Key Points Table Architecture CombiningPen and Gestures Asymetric Guiard Model
- 15.
- 16.
- 17.
- 18.
- 19. Evaluation Camera operations: morefluid (seconds) 44% faster
- 20. Evaluation Hand Role Distribution 9%91% 3% 80% 17%
- 21. Evaluation Users prefer touchfor all manipulations Imagem e benefits of direct vs indirect
- 22.
- 23. Observations Bimanual workspace andhand role
- 24.
- 25. Observations Pen-only often forcesre-arrangement
- 26. Observations Pen-only causes toomuch DH motion
- 27. Observations Rotate gesture wasfrail, swapped pen to NDH
- 28. Observations Combined gestures werenaturally used
- 29. Getting it together: MockupBuilder
- 30. Setup Multitouch 120Hz Touch 16.25DPI 3D SVGA 120Hz Active Stereo Kinect (30Hz) Gametrak (120Hz)
- 31.
- 32. User Model Active UserKinect Head Position Kinect Hand Position (Right/Left) Kinect Finger touches Table 4 Fingers tracked in Space (Gametrak) Finger X from Hand Y on or above the surface from user Z
- 33. BIMANUAL Asymmetric DH :SketchingNDH : Manipulation Modes Hands (WIMP)
- 34.
- 35. NDH: Context MenusDH: Selects
- 36. ON & ABOVETHE SURFACE Snapping Discrete Constraint Continuous Constraints On the fly Active as long as needed
- 37. Preliminary Results expert architectRhino3D 5’20” 2’45” 5’41” 3’46” xpert User our modeler
- 38. Touching The 3DDimension, Dagstuhl Feb. 2012 Modeling On and Above a Stereoscopic Multitouch Display, (3DCHI): May, 2012. Mockup Builder: Direct 3D Modeling On and Above the Surface in a Continuous Interaction Space (GI'2012), May 28 - May 30, 2012. Special Section C&G (January 2013) ACM Spatial User Interfaces Symposia (SUI)
- 39. Adding Sound toMultimodal Interfaces ITS 2011
- 40. Take-Home message Touch signatureImpact Intensity Interaction space Tangibles
- 41. Take-Home message Touch signatureImpact Intensity Interaction space Tangibles
- 42. Take-Home message Touch signatureImpact Intensity Interaction space Tangibles
- 43. Take-Home message Touch signatureImpact Intensity Interaction space Tangibles
- 44.
- 45.
- 46.
- 47.
- 48.
- 49.
- 50.
- 51. Acoustic Sensing Conclusions Recognize contactparts (timbre)
- 52.
- 53.
- 54. Let’s Kick It CHI2014 Exploring New Interaction Space Large Scale Displays Interacting with the bottom of the screen
- 55.
- 56. Remote Proxemics: Personto Device Interactions
- 57.
- 58.
- 59.
- 60. Providing Awareness: FloorCircles
- 61. Issues Working / VirtualSpace Simple Operators / Dialogues Implicit Mode Changes Continuous Transition Asymmetric Bimanual Modes
- 62. Take Home Message ExtendingTouch With Other Modalities Bimanual Interaction Explore Surface Above Table Use Sound in Novel Ways Explore New Modalities Proxemics as tool for implicit interactions
- 63.
- 64. Content Creation inVEs Sketch Interpretation (3D) New Modalities Self Disclosure (Not!) Understandability
- 65. Thank You! Joaquim Jorge http://web.ist.utl.pt/jorgej BrunoRodrigues De Araújo Maurício de Sousa Ricardo Jorge Jota Costa Pedro Lopes Daniel Mendes
Editor's Notes
- #6 ACRESCENTAR VIDEO MINORITY REPORT
- #7 Pinter accao natural 3D Modelling should rely on more natural interaction techniques and take more advantage of virtual environments not only for visualization Ambientes Virtuais e Estereo mas não so para visualizacao Mas tambem para modelacao O conteudo virtual deveria libertar restricoes fisicas das maquetes
- #11 The Continuous Interaction Space: Interaction Techniques Unifying Touch and Gesture On and Above a Digital Surface
- #22 Questionnaire Analysis
- #23 Questionnaire Analysis
- #34 Implicit Switch between creation and manipulation DH : Sketching NDH : Manipulation (T R S 1 or 2 fingers/hands)
- #35 On and Above Surface Interaction On surface: Sketch Based Modeling Interface Above the surface: Push and Pull Modelling Metaphor Shapes created by extrusion Topological Features (Vertex, Edge, Faces) Movable Curvilinear Extrusion
- #36 Contextual Simple Menu (2D layer) Selection DH Menu Location NDH Only Visible if NDH close to surface Fading Effect Dynamic Moving
- #37 DH Modelling NDH Operation Attribute complement DH NDH Operation mode Snapping Clonning Constraint Snapping Switch between surface and space Discrete Constraint Position of Clonning Activate Mirror Plane for Sketches Limit Extrusion while Extruding Continuous Constraint Scaling Profile Factor while extruding (cone, frustum...) Constraint Definition
- #56 Working/Virtual Space Co-location Simple Operators and Dialogues Data Fusion from several devices Benefits of on and above interaction Continuous transition surface and space Asymmetric Bimanual Interaction Implicit Mode Switch Good Not error prone for non familiar users Some relaxation needed Button vs Pinch gesture vs other modalities Physics Initially considered for Modeling Sketch based Beautification (measures needed)
- #57 Also, As prof-of-concept for person to device interactions, We devised the role of the moderator of the meeting, when in close proximity to a wall display, the person assuming that role can perform actions that relate to every participant.
- #58 People like to meet in person, and when they do, they communicate in different manners besides verbally. Edward Hall states that space and distance play key roles in the way people communicate. Therefore, Proxemics are a non-verbal type of communication and can be exploited in the context of virtual meetings.
- #59 We use the Proxemic Distances model to provide the necessary knowledge to bring social interactions into virtual meetings. To provide, the means for people to implicitly and automatically start remote interactions just by getting together.
- #60 Avatars and telepresence robots are a poor representation of people, and they contribute to the lack of presence Our model do not play by the same rules The question is not how well we represent people. The important part of our research is the representation of interactions occurring around the room.
- #61 We use a ceiling mounted projector to display floor circles which account for the position of all eery space participants. In this way, every one becomes aware of their intimate space (the inner circle) and their personal space (the outer ring). The dimensions follow the proxemic distances proposed by Edward Hall. In this figure, we display two people forming a social bubble, and performing a collaborative task. Again, there is no need for high definition avatars or video for people to know about the presence of others.
- #62 Working/Virtual Space Co-location Simple Operators and Dialogues Data Fusion from several devices Benefits of on and above interaction Continuous transition surface and space Asymmetric Bimanual Interaction Implicit Mode Switch Good Not error prone for non familiar users Some relaxation needed Button vs Pinch gesture vs other modalities Physics Initially considered for Modeling Sketch based Beautification (measures needed)