DataTiles : A Modular Platform for Mixed Physical and Graphical Interactions April 4, 2001 Jun Rekimoto *   Brygg Ullmer †...
Motivation <ul><li>Flexible interface platform for controlling digital information </li></ul><ul><li>Merging two UI paradi...
Some historical ancestors… “ Denshi (electronic) Block” (‘70s) Japan Railload “MARS” terminal (‘70s) “ Triangles”  (Gorbet...
DataTiles
<ul><li>Transparent objects (tiles) as information modules -> tight coupling of input & output </li></ul><ul><li>Integrati...
Time Point Information
Tile Classes Application Tiles Portal (Remote) Tiles Parameter Tiles Container Tiles Stores information Specific Services,...
video
DataTiles  basic interaction style Pen Sensitive LCD Display  (“Tray”) ID-Reader tagged transparent object RFID RFID Groov...
Interacting with DataTiles <ul><li>Interaction Techniques </li></ul><ul><ul><li>Tile placement, reconfiguration, removal <...
Printed & Grooved Tiles = + + = printed information: high resolution, static displayed information: low resolution, dynami...
Tiles with manipulators
Examples of  Tile Combinations Container Paint Portal WebCam print image real printer Application Tile Container Tile Port...
<ul><li>Visual Feedback of tile connection types </li></ul><ul><li>Inter-tile pen gestures </li></ul>Movie TimeMachine Wea...
System Configuration PC (Sony VAIO LX) Windows 2000 Pentium III (866MHz) Java JDK1.3 LCD Display with built-in pen tablet ...
Sensor Configuration LCD display Back light Pen digitizer Wire to the RF reader Acrylic tile  cover glass 6mm RF tag  RFID...
Implementation (software) The System dynamically loads and activates a corresponding  Java Class  for each tile ID. Each J...
User Experiences <ul><li>Data manipulation by physical layout </li></ul><ul><ul><li>Many users were willing to explore var...
Applications <ul><li>Interfaces to Networked Information </li></ul><ul><ul><li>Portal to Information services </li></ul></...
Summary <ul><li>DataTiles:   </li></ul><ul><ul><li>A platform environment with mixed Physical-Graphical Interactions </li>...
Upcoming SlideShare
Loading in …5
×

DataTiles: a modula platform for mixed physical and digtial interactions (Rekimoto, CHI2001)

892 views

Published on

Published in: Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
892
On SlideShare
0
From Embeds
0
Number of Embeds
34
Actions
Shares
0
Downloads
17
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

DataTiles: a modula platform for mixed physical and digtial interactions (Rekimoto, CHI2001)

  1. 1. DataTiles : A Modular Platform for Mixed Physical and Graphical Interactions April 4, 2001 Jun Rekimoto * Brygg Ullmer † Haruo Oba * * Sony CSL Interaction Laboratory † MIT Media Laboratory
  2. 2. Motivation <ul><li>Flexible interface platform for controlling digital information </li></ul><ul><li>Merging two UI paradigms Graphicsl UIs & Physical/Tangible UI </li></ul><ul><li>Visual+Physical “construction kit” for end users </li></ul>
  3. 3. Some historical ancestors… “ Denshi (electronic) Block” (‘70s) Japan Railload “MARS” terminal (‘70s) “ Triangles” (Gorbet/Orth/Ishii, 1998) “ AlgoBlock” (Suzuki/Kato, 1995) “ Intelligent Beermats” (Frazer, 1982)
  4. 4. DataTiles
  5. 5. <ul><li>Transparent objects (tiles) as information modules -> tight coupling of input & output </li></ul><ul><li>Integration of Physical manipulation & graphical information </li></ul><ul><li>Used as Home-Computer interfaces, Collaboration supports, Internet-”Toys” </li></ul>DataTiles
  6. 6. Time Point Information
  7. 7. Tile Classes Application Tiles Portal (Remote) Tiles Parameter Tiles Container Tiles Stores information Specific Services, Applications Connects to real-world objects (places, people, devices) Visualizes & Controls other connected tiles
  8. 8. video
  9. 9. DataTiles basic interaction style Pen Sensitive LCD Display (“Tray”) ID-Reader tagged transparent object RFID RFID Grooves Printed Information Input devices (Pen, etc.) Input Graphical Output
  10. 10. Interacting with DataTiles <ul><li>Interaction Techniques </li></ul><ul><ul><li>Tile placement, reconfiguration, removal </li></ul></ul><ul><ul><li>Pen manipulations on each tile (as GUI) </li></ul></ul><ul><ul><li>Physical manipulators (e.g., dial) </li></ul></ul><ul><ul><li>Inter-tile pen gestures </li></ul></ul><ul><li>Tile adjacency  communications between tiles </li></ul><ul><ul><li>Parameter flow: Query Parameters, Time points </li></ul></ul><ul><ul><li>Data-flow: Image, movie, sound </li></ul></ul>
  11. 11. Printed & Grooved Tiles = + + = printed information: high resolution, static displayed information: low resolution, dynamic grooved widget: passive haptic feedback combined:
  12. 12. Tiles with manipulators
  13. 13. Examples of Tile Combinations Container Paint Portal WebCam print image real printer Application Tile Container Tile Portal Tile Container Movie Movie Movie Parameters Baseball TimeWheel Scribble time point parameter tile parameter tile query parameters
  14. 14. <ul><li>Visual Feedback of tile connection types </li></ul><ul><li>Inter-tile pen gestures </li></ul>Movie TimeMachine Weather Simple connection Menu for choosing Connection types Mail Fax Animation indicating streamed media transmission Wall Screen A People Container Invokes one-shot transmission PhotoAlbum Container Remote Portal Suspends streamed transmission
  15. 15. System Configuration PC (Sony VAIO LX) Windows 2000 Pentium III (866MHz) Java JDK1.3 LCD Display with built-in pen tablet RFID tags (TIRIS) RFID reader (TIRIS) RFID multiplexer + PC interface (PIC16F873) RS232C Switches 12 antenna coils ( 100ms / ID) RFID reader coils
  16. 16. Sensor Configuration LCD display Back light Pen digitizer Wire to the RF reader Acrylic tile cover glass 6mm RF tag RFID reader coils Wire to the RFID reader RFID tag Reader coil
  17. 17. Implementation (software) The System dynamically loads and activates a corresponding Java Class for each tile ID. Each Java program also dynamically checks nearby tile classes and interfaces. public class WebCamTile extends Tile implements ImageCreateInterface , TimeMachineInterface , … { …… …… } …… Tile t = getLeftTile(); if (t instanceof TimeMachineInterface ) { … .. } … .
  18. 18. User Experiences <ul><li>Data manipulation by physical layout </li></ul><ul><ul><li>Many users were willing to explore various types of tile combinations. Some of them were beyond our expectation. </li></ul></ul><ul><ul><li>Visual feedback was essential </li></ul></ul><ul><li>Effects of tiles’ graspable capability </li></ul><ul><ul><li>Users could always take control (e.g., remove a music tile to stop it) </li></ul></ul><ul><ul><li>Suitable for multi-user activities </li></ul></ul>
  19. 19. Applications <ul><li>Interfaces to Networked Information </li></ul><ul><ul><li>Portal to Information services </li></ul></ul><ul><ul><li>Information Appliances Control </li></ul></ul><ul><ul><li>Remote Collaboration </li></ul></ul><ul><li>Media Construction Environments </li></ul><ul><ul><li>Movie/Music Editing, Video Jockey </li></ul></ul><ul><ul><li>(Networked) Game Environment </li></ul></ul><ul><ul><li>Education Tools, Toys </li></ul></ul><ul><li>Support of Collaborative Work, Decision making </li></ul><ul><ul><li>Simulation, database visualization </li></ul></ul>
  20. 20. Summary <ul><li>DataTiles:   </li></ul><ul><ul><li>A platform environment with mixed Physical-Graphical Interactions </li></ul></ul><ul><li>Future Work </li></ul><ul><ul><li>Study of Physical Language “Grammar” </li></ul></ul><ul><ul><li>Other configuration method (e.g, stacking) </li></ul></ul><ul><ul><li>Active (CPU embedded) tiles with sensors </li></ul></ul>

×