DataTiles: a modula platform for mixed physical and digtial interactions (Rekimoto, CHI2001)
Upcoming SlideShare
Loading in...5

DataTiles: a modula platform for mixed physical and digtial interactions (Rekimoto, CHI2001)






Total Views
Slideshare-icon Views on SlideShare
Embed Views



0 Embeds 0

No embeds



Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
Post Comment
Edit your comment

    DataTiles: a modula platform for mixed physical and digtial interactions (Rekimoto, CHI2001) DataTiles: a modula platform for mixed physical and digtial interactions (Rekimoto, CHI2001) Presentation Transcript

    • DataTiles : A Modular Platform for Mixed Physical and Graphical Interactions April 4, 2001 Jun Rekimoto * Brygg Ullmer † Haruo Oba * * Sony CSL Interaction Laboratory † MIT Media Laboratory
    • Motivation
      • Flexible interface platform for controlling digital information
      • Merging two UI paradigms Graphicsl UIs & Physical/Tangible UI
      • Visual+Physical “construction kit” for end users
    • Some historical ancestors… “ Denshi (electronic) Block” (‘70s) Japan Railload “MARS” terminal (‘70s) “ Triangles” (Gorbet/Orth/Ishii, 1998) “ AlgoBlock” (Suzuki/Kato, 1995) “ Intelligent Beermats” (Frazer, 1982)
    • DataTiles
      • Transparent objects (tiles) as information modules -> tight coupling of input & output
      • Integration of Physical manipulation & graphical information
      • Used as Home-Computer interfaces, Collaboration supports, Internet-”Toys”
    • Time Point Information
    • Tile Classes Application Tiles Portal (Remote) Tiles Parameter Tiles Container Tiles Stores information Specific Services, Applications Connects to real-world objects (places, people, devices) Visualizes & Controls other connected tiles
    • video
    • DataTiles basic interaction style Pen Sensitive LCD Display (“Tray”) ID-Reader tagged transparent object RFID RFID Grooves Printed Information Input devices (Pen, etc.) Input Graphical Output
    • Interacting with DataTiles
      • Interaction Techniques
        • Tile placement, reconfiguration, removal
        • Pen manipulations on each tile (as GUI)
        • Physical manipulators (e.g., dial)
        • Inter-tile pen gestures
      • Tile adjacency  communications between tiles
        • Parameter flow: Query Parameters, Time points
        • Data-flow: Image, movie, sound
    • Printed & Grooved Tiles = + + = printed information: high resolution, static displayed information: low resolution, dynamic grooved widget: passive haptic feedback combined:
    • Tiles with manipulators
    • Examples of Tile Combinations Container Paint Portal WebCam print image real printer Application Tile Container Tile Portal Tile Container Movie Movie Movie Parameters Baseball TimeWheel Scribble time point parameter tile parameter tile query parameters
      • Visual Feedback of tile connection types
      • Inter-tile pen gestures
      Movie TimeMachine Weather Simple connection Menu for choosing Connection types Mail Fax Animation indicating streamed media transmission Wall Screen A People Container Invokes one-shot transmission PhotoAlbum Container Remote Portal Suspends streamed transmission
    • System Configuration PC (Sony VAIO LX) Windows 2000 Pentium III (866MHz) Java JDK1.3 LCD Display with built-in pen tablet RFID tags (TIRIS) RFID reader (TIRIS) RFID multiplexer + PC interface (PIC16F873) RS232C Switches 12 antenna coils ( 100ms / ID) RFID reader coils
    • Sensor Configuration LCD display Back light Pen digitizer Wire to the RF reader Acrylic tile cover glass 6mm RF tag RFID reader coils Wire to the RFID reader RFID tag Reader coil
    • Implementation (software) The System dynamically loads and activates a corresponding Java Class for each tile ID. Each Java program also dynamically checks nearby tile classes and interfaces. public class WebCamTile extends Tile implements ImageCreateInterface , TimeMachineInterface , … { …… …… } …… Tile t = getLeftTile(); if (t instanceof TimeMachineInterface ) { … .. } … .
    • User Experiences
      • Data manipulation by physical layout
        • Many users were willing to explore various types of tile combinations. Some of them were beyond our expectation.
        • Visual feedback was essential
      • Effects of tiles’ graspable capability
        • Users could always take control (e.g., remove a music tile to stop it)
        • Suitable for multi-user activities
    • Applications
      • Interfaces to Networked Information
        • Portal to Information services
        • Information Appliances Control
        • Remote Collaboration
      • Media Construction Environments
        • Movie/Music Editing, Video Jockey
        • (Networked) Game Environment
        • Education Tools, Toys
      • Support of Collaborative Work, Decision making
        • Simulation, database visualization
    • Summary
      • DataTiles:  
        • A platform environment with mixed Physical-Graphical Interactions
      • Future Work
        • Study of Physical Language “Grammar”
        • Other configuration method (e.g, stacking)
        • Active (CPU embedded) tiles with sensors