Interactive Paper
Introduction and Basic Technology
Applications and Future Developments
Beat Signer
Global Information Sy...
The Paperless Office (1975)




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
The "Paperless Office" (2003)




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
The Myth of the Paperless Office
 For decades, people have predicted the
     office of the future as a paperless office
...
Affordances of Paper
 The physical properties of an object determine
     how people use that object
 Properties of pape...
Paper in Everyday Settings




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
Electronic Paper (e-paper)




 E-Ink Cooperation
            paper-like high contrast
             appearance
        ...
Augmenting the Physical Space
 Embedding computing functionality in everyday
     objects instead of digitising the physi...
Paper-Digital Integration Technologies
 Document (object) identification / tracking
            barcodes
            RF...
Listen Reader (Maribeth Back et al.)




 Combines the look and feel of a real book with an
     interactive soundtrack

...
Digital Pen and Paper
 Developed by Anoto
 Different pen manufacturers
            Logitech, Maxel, Nokia,
            ...
Forms Automation Systems
 Capture form data
            data is processed and
             stored in a database

 Appli...
Active Areas and Virtual Page Layers

                                                                 image




         ...
Cross-Media Link Server (iServer)
                                                         web pages
                    c...
iPaper @ ETH Zurich
                                                                               Tools
                 ...
Edinburgh Fringe Festival
 World's largest
     international arts festival
 4 weeks
 ~1700 events
 ~27000 performance...
EdFest Project




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
EdFest User Trials




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
EdFest Demo




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
Design of Interactive Paper Documents




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
References
 The Myth of the Paperless Office, A.J. Sellen
     and R. Harper, MIT Press, November 2001
 Scrolling Forwar...
Interactive Paper Applications
 Enhanced Reading                                           Enhanced Writing
           ...
PaperPoint Presentation Tool
                                            Mobile presentation tool
                       ...
PaperPoint Stickers
 Empty Stickers linked to
     specific PowerPoint slides

 Digital information (text,
     image, m...
Rough Guide




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
Natural History Museum, London




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
Natural History Museum, London ...




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
Natural History Museum, London ...




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
Natural History Museum, London ...




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
DiDA (Diploma in Digital Applications)




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
Mammography Annotations




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
Print-n-Link
                                            Citations build the basis
                                      ...
Print-n-Link …




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
PaperWeb
                                            Print arbitrary web pages
                                          ...
Document Editing
 Digital and paper-based user interface
 Support for collaborative editing
 Multiple digital/physical ...
PaperProof




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
Paper-Digital Structural Mapping




 Dual document representation in digital and
     physical document spaces

Y-Toolbo...
PaperProof




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
The Lost Cosmonaut
 Writing as a collaborative
     act of memory and story-
     telling
 Reading, writing and
     nar...
The Lost Cosmonaut …




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
The Lost Cosmonaut …




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
Generosa Enterprise




 Interactive drawing installation
 Exhibited at the 150 Years ETH Zurich Jubilee (more
     than...
Generosa Enterprise …




 Generation of a new artwork
 http://www.generosa.ethz.ch/



Y-Toolbox, April 17, 2008   Beat...
Generosa Enterprise …




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
Interactive Table (iTable)




          Pen-Based Google Earth Browser                                      Pen-Based Dra...
Interactive Table (iTable) …




Y-Toolbox, April 17, 2008   Beat Signer, signer@inf.ethz.ch
Remote Sketching on Paper
                                            Integration of Skype and
                          ...
Query by Sketching (QbS)
                                            Pen-based sketching
                                ...
FLY Fusion™ Pentop Computer
 Everything integrated into
     the pen

 Voice feedback
 Applications on cartridge
      ...
Pulse Smartpen
 Record and replay
     synchronised ink & audio
 1 GB memory
            16'000 pages
            200 ...
Upcoming SlideShare
Loading in …5
×

Interactive Paper - Introduction and Basic Technology & Interactive Paper - Applications and Future Developments

2,411 views

Published on

Presentation given at Y-Toolbox, Workshop about Paper, Y (Institute for Transdisciplinarity), Bern University of Arts, Bern, Switzerland, April 2008

Published in: Technology, Business
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,411
On SlideShare
0
From Embeds
0
Number of Embeds
67
Actions
Shares
0
Downloads
65
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

Interactive Paper - Introduction and Basic Technology & Interactive Paper - Applications and Future Developments

  1. 1. Interactive Paper Introduction and Basic Technology Applications and Future Developments Beat Signer Global Information Systems Research Group ETH Zurich http://vub.academia.edu/BeatSigner Y-Toolbox, April 17, 2008
  2. 2. The Paperless Office (1975) Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  3. 3. The "Paperless Office" (2003) Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  4. 4. The Myth of the Paperless Office  For decades, people have predicted the office of the future as a paperless office  documents generated, published and distributed electronically  documents read electronically  What has happened to this imminent revolution? Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  5. 5. Affordances of Paper  The physical properties of an object determine how people use that object  Properties of paper  light, flexible, robust, porous, opaque, transparent, ….  Human actions  grasping, folding, tearing, carrying, writing, on ….  Paper supports forms of collaboration and interaction difficult to mimic in the digital world Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  6. 6. Paper in Everyday Settings Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  7. 7. Electronic Paper (e-paper)  E-Ink Cooperation  paper-like high contrast appearance  low power consumption  thin, light form Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  8. 8. Augmenting the Physical Space  Embedding computing functionality in everyday objects instead of digitising the physical environment At breakfast Sal reads the news. She still prefers the paper form, as do most people. She spots an interesting quote from a columnist in the business section. She wipes her pen over the newspaper’s name, date, section, and page number and then circles the quote. The pen sends a message to the paper, which transmits the quote to her office. The Computer for the 21st Century, Weiser, 1991 Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  9. 9. Paper-Digital Integration Technologies  Document (object) identification / tracking  barcodes  RFID tags  optical tracking  …  Within-document position tracking  relative/absolute positions  support for mobility  … Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  10. 10. Listen Reader (Maribeth Back et al.)  Combines the look and feel of a real book with an interactive soundtrack  RFID tags embedded in each page  Electric field sensors in the book binding Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  11. 11. Digital Pen and Paper  Developed by Anoto  Different pen manufacturers  Logitech, Maxel, Nokia, Adapx, Livescribe ...  Pattern space  60 million km2 Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  12. 12. Forms Automation Systems  Capture form data  data is processed and stored in a database  Applications  policies  hospitals  transporation  ...  No real-time interaction! Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  13. 13. Active Areas and Virtual Page Layers image video clip Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  14. 14. Cross-Media Link Server (iServer) web pages consumers / publishers publisher videos books presentation slides Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  15. 15. iPaper @ ETH Zurich Tools Cross-Media Link Infrastructure Applications Publishing Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  16. 16. Edinburgh Fringe Festival  World's largest international arts festival  4 weeks  ~1700 events  ~27000 performances Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  17. 17. EdFest Project Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  18. 18. EdFest User Trials Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  19. 19. EdFest Demo Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  20. 20. Design of Interactive Paper Documents Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  21. 21. References  The Myth of the Paperless Office, A.J. Sellen and R. Harper, MIT Press, November 2001  Scrolling Forward: Making Sense of Documents in the Digital Age, D.M. Levy, October 2001  Fundamental Concepts for Interactive Paper and Cross-Media Information Spaces, B. Signer, Diss ETH Zurich Nr. 16218, 2006  http://www.ipaper.ethz.ch Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  22. 22. Interactive Paper Applications  Enhanced Reading  Enhanced Writing  interactive paper maps  photo album  interactive festival brochures  researcher's notebook  educational materials  mammography  auction brochures  search system  scientific publications  …  …  Paper-Based Interfaces  Artists' Installations  PaperPoint  Lost Cosmonaut  digital libraries  Generosa Enterprise  video analysis tool  educational games  Interactive TableTops http://www.globis.ethz.ch/research/paper/applications/ Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  23. 23. PaperPoint Presentation Tool  Mobile presentation tool  Non-linear presentations  Paper-based real-time annotations  Digital whiteboard  Multi-pen support  brainstorming Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  24. 24. PaperPoint Stickers  Empty Stickers linked to specific PowerPoint slides  Digital information (text, image, movie, ...) embedded in slides  Mock-ups for interactive paper applications Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  25. 25. Rough Guide Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  26. 26. Natural History Museum, London Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  27. 27. Natural History Museum, London ... Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  28. 28. Natural History Museum, London ... Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  29. 29. Natural History Museum, London ... Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  30. 30. DiDA (Diploma in Digital Applications) Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  31. 31. Mammography Annotations Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  32. 32. Print-n-Link  Citations build the basis for a scientific web of publications  Use digital services to search / retrieve cited publications  Automatic authoring Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  33. 33. Print-n-Link … Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  34. 34. PaperWeb  Print arbitrary web pages with iDoc printer driver  All hyperlinks become interactive on the printout version  Automatic authoring of links Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  35. 35. Document Editing  Digital and paper-based user interface  Support for collaborative editing  Multiple digital/physical editing iteration cycles Digital Document Printed Document Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  36. 36. PaperProof Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  37. 37. Paper-Digital Structural Mapping  Dual document representation in digital and physical document spaces Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  38. 38. PaperProof Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  39. 39. The Lost Cosmonaut  Writing as a collaborative act of memory and story- telling  Reading, writing and narrative as an act of making sense  Handwriting as a tool for human computer interaction In collaboration with Axel Vogelsang, Artists in Labs Programme Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  40. 40. The Lost Cosmonaut … Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  41. 41. The Lost Cosmonaut … Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  42. 42. Generosa Enterprise  Interactive drawing installation  Exhibited at the 150 Years ETH Zurich Jubilee (more than 200'000 visitors) Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  43. 43. Generosa Enterprise …  Generation of a new artwork  http://www.generosa.ethz.ch/ Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  44. 44. Generosa Enterprise … Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  45. 45. Interactive Table (iTable) Pen-Based Google Earth Browser Pen-Based Drawing Tool Photo Browser Photo Browser (Slider) Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  46. 46. Interactive Table (iTable) … Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  47. 47. Remote Sketching on Paper  Integration of Skype and paper-based remote sketching, Hermann Hofstetter  HCI group University of Konstanz, H. Reiterer  GlobIS group Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  48. 48. Query by Sketching (QbS)  Pen-based sketching interface  University of Basel  GlobIS group Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  49. 49. FLY Fusion™ Pentop Computer  Everything integrated into the pen  Voice feedback  Applications on cartridge  english to spanish translator  calculator  ... Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch
  50. 50. Pulse Smartpen  Record and replay synchronised ink & audio  1 GB memory  16'000 pages  200 hours voice recording  96x18 OLED Display  Open application platform Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch

×