1. DataTiles ： A Modular Platform for Mixed Physical and Graphical Interactions April 4, 2001 Jun Rekimoto * Brygg Ullmer † Haruo Oba * * Sony CSL Interaction Laboratory † MIT Media Laboratory

3. Some historical ancestors… “ Denshi (electronic) Block” (‘70s) Japan Railload “MARS” terminal (‘70s) “ Triangles” (Gorbet/Orth/Ishii, 1998) “ AlgoBlock” (Suzuki/Kato, 1995) “ Intelligent Beermats” (Frazer, 1982)

4. DataTiles

6. Time Point Information

7. Tile Classes Application Tiles Portal (Remote) Tiles Parameter Tiles Container Tiles Stores information Specific Services, Applications Connects to real-world objects (places, people, devices) Visualizes & Controls other connected tiles

8. video

9. DataTiles basic interaction style Pen Sensitive LCD Display (“Tray”) ID-Reader tagged transparent object RFID RFID Grooves Printed Information Input devices (Pen, etc.) Input Graphical Output

11. Printed & Grooved Tiles = + + = printed information: high resolution, static displayed information: low resolution, dynamic grooved widget: passive haptic feedback combined:

12. Tiles with manipulators

13. Examples of Tile Combinations Container Paint Portal WebCam print image real printer Application Tile Container Tile Portal Tile Container Movie Movie Movie Parameters Baseball TimeWheel Scribble time point parameter tile parameter tile query parameters

15. System Configuration PC (Sony VAIO LX) Windows 2000 Pentium III (866MHz) Java JDK1.3 LCD Display with built-in pen tablet RFID tags (TIRIS) RFID reader (TIRIS) RFID multiplexer + PC interface (PIC16F873) RS232C Switches 12 antenna coils （ 100ms / ID) RFID reader coils

16. Sensor Configuration LCD display Back light Pen digitizer Wire to the RF reader Acrylic tile cover glass 6mm RF tag RFID reader coils Wire to the RFID reader RFID tag Reader coil

17. Implementation (software) The System dynamically loads and activates a corresponding Java Class for each tile ID. Each Java program also dynamically checks nearby tile classes and interfaces. public class WebCamTile extends Tile implements ImageCreateInterface , TimeMachineInterface , … { …… …… } …… Tile t = getLeftTile(); if (t instanceof TimeMachineInterface ) { … .. } … .