• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
The Augmented Drag-and-Drop
 

The Augmented Drag-and-Drop

on

  • 429 views

The development of Augmented Reality (AR) applications is still driven by development at source-code level. Although recent approaches focus to standardize AR functionality, to our knowledge a ...

The development of Augmented Reality (AR) applications is still driven by development at source-code level. Although recent approaches focus to standardize AR functionality, to our knowledge a declarative and model-driven design (MDD) has not been applied for AR development so far. MDD approaches have been successfully applied to model user interfaces for a wide spectrum of modes (such as speech-command interfaces, or remote controls) and media such as HTML, 3D, and smart phone interfaces for instance. In this paper we propose a MDD approach for modeling seamless interaction between Web and AR interfaces. Therefore we implemented a prototype of a web furniture shop that supports arranging furniture in an augmented reality to prove our approach. We then present our approach of modeling a reality spanning Drag-and-Drop interaction between a 2D browser and an AR scene. Finally, we discuss the issues that we were confronted with to support reality spanning interaction like switching interaction modes and coordinate systems and present limitations that we have experienced with using other control modes, like a Wii-Controller or glove-based gesture detection.

Statistics

Views

Total Views
429
Views on SlideShare
429
Embed Views
0

Actions

Likes
0
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    The Augmented Drag-and-Drop The Augmented Drag-and-Drop Presentation Transcript

    • 1. Juni 2011
      Model-based Design of Interactions that can bridge RealitiesThe Augmented “Drag-and-Drop”Sebastian Feuerstack, Allan C. M. de Oliveira, Regina B. Araujo
      Universidade Federal de São CarlosDepartamento de Computacão
    • The Augmented “Drag-and-Drop”
      2
      1. Juni 2011
      Basic Question
      How to model Interactions that span Modes and Media ?
    • The Augmented “Drag-and-Drop
      3
      1. Juni 2011
      Which Media ?
      http://flic.kr/p/6A7D3E
    • The Augmented “Drag-and-Drop”
      4
      1. Juni 2011
      Which Modes?
      http://flic.kr/p/7sZ6ho
      http://flic.kr/p/6eeLwg
    • The Augmented “Drag-and-Drop
      5
      1. Juni 2011
      How ?
      Device ; Modality
    • The Augmented “Drag-and-Drop
      6
      1. Juni 2011
      Why modeling?
      One specification that
      is declarative and exact to discuss & execute
      Is located between Tool and Code
      can be easily adapted or enhanced to different forms of interaction
    • The Augmented “Drag-and-Drop
      7
      1. Juni 2011
      Use Case:
      Augmented Drag and Drop
      Buying Furniture
      Shopping Cart
      Drag and Drop
      Into my environment
    • Video: Connecting the Web with AR
      The Augmented “Drag-and-Drop
      8
      1. Juni 2011
      VIDEO
      Mouse-based Drag-and-Drop
    • The Augmented “Drag-and-Drop
      9
      1. Juni 2011
      How to model?
      Models
      Interactors(Abstract & Concrete Media, Mode)
      Static: class diagramm, Behavior: state-chart
      Mappings Mode-To-Media Synchronization
      Custom Notation
    • The Augmented “Drag-and-Drop
      10
      1. Juni 2011
      Abstract Media Model
    • The Augmented “Drag-and-Drop
      11
      1. Juni 2011
      Abstract Media Model
      Single Choice
      Aggregates a set of Entities from that only one can be chosen at a time
      Examples: Direction (leftorright), Shopping Cart
      Further Properties:
      Output tothe User
      Container -> Aggregation,
      Discrete,
      thatare Inputs
      Contains Single Choice Elements
    • The Augmented “Drag-and-Drop
      12
      1. Juni 2011
      Abstract Behavior Model
    • Design of Multimodal Interaction
      13
      1. Juni 2011
      Mode Model
      (Example: Mouse)
    • The Augmented “Drag-and-Drop
      14
      1. Juni 2011
      Multimodal Mapping
      The Drag-and-Drop
    • The Augmented “Drag-and-Drop
      15
      1. Juni 2011
      Conclusions & Future Work
      What’s the advantage?
      Detailed, declarative Modeling of Interactions (Media, Mode)
      We can combine Modes & Media and bridge Realities
      What`s still missing is a tool
      What`s the advantage???
      Lets see a demo with different Modes
    • Gesture-based Drag and Drop Control
      The Augmented “Drag-and-Drop
      16
      1. Juni 2011
      Cam
      Jessica
      Pointing
      Cam
      Command
      Monitor
    • Gesture-based Drag and Drop Control
      Design of Multimodal Interaction
      17
      1. Juni 2011
      VIDEO
      Gesture-based Drag-and-Drop
    • The Augmented “Drag-and-Drop
      18
      1. Juni 2011
      The End …
      Thank you for your attention!
      Your questions please …
    • The Augmented “Drag-and-Drop
      19
      1. Juni 2011
      Abstract Model
      Reference – Object or Property of an Object to unambigously identify it
      Examples: Name, Color, Number, Shape, Coordinate
      Further Properties:
      Discrete -> Distinguishable
      Input -> bythe User
    • The Augmented “Drag-and-Drop
      20
      1. Juni 2011
      Multimodal Mapping
      (Combining Mode with Media)