iPaper@GlobIS – Interactive Paper Research
CSCW Seminar
Beat Signer, Nadir Weibel, Adriana Ispas and Moira C. Norrie
Globa...
Problems of Existing Applications
 Many projects focus on the input device, paper,
     printing and other hardware techn...
Our Approach
 General interactive framework
           different forms of paper-based interactions (enhanced
           ...
Active Areas and Virtual Page Layers

                                                                        image




  ...
iPaper Architecture




CSCW Seminar 2007, June 12, 2007   Beat Signer, signer@inf.ethz.ch
iServer Metamodel and Resource Plug-ins
                                                                           link

 ...
iSERVER
iServer
    Links                                                                                                 ...
iServer Interfaces
 Java API
 XML import and export
 Interface based on XML and XSLT
           XHTML
           WAP,...
iWeb Firefox Extension




CSCW Seminar 2007, June 12, 2007   Beat Signer, signer@inf.ethz.ch
iWeb Plug-in




                                   World Wide Web

                                     HTTP     HTTP
   ...
Active Content
 Execute code (services) on the client and server side

                                                  ...
Active Components
                                    Button                                            Image

           ...
Active Components …
 <?xml version="1.0" encoding="UTF-8" ?>                                     PAPERPOINT_CONTROL
 <iser...
PaperPoint Presentation Tool




CSCW Seminar 2007, June 12, 2007   Beat Signer, signer@inf.ethz.ch
XML-Based Authoring
...                                                   ...
<document id="handout" creator="beat">      ...
Digital Link Authoring Tool




CSCW Seminar 2007, June 12, 2007   Beat Signer, signer@inf.ethz.ch
PaperPoint Architecture




CSCW Seminar 2007, June 12, 2007   Beat Signer, signer@inf.ethz.ch
EdFest Components




CSCW Seminar 2007, June 12, 2007   Beat Signer, signer@inf.ethz.ch
EdFest Architecture Overview
                                                               Context                XCM
   ...
Content Publishing Framework
                                                                                             ...
Print-n-Link
                                                   Citations build the basis
                               ...
Print-n-Link Architecture
Interactive Paper Architecture                                                                  ...
Printed-Digital Mapping

                                                                     static physical rendering
  ...
Printed-Digital Mapping

       Logical                                     Physical
    Representation                   ...
Mixed Physical-Digital Model




CSCW Seminar 2007, June 12, 2007   Beat Signer, signer@inf.ethz.ch
Interactive Paper Applications
 Enhanced Reading                                        Enhanced Writing
           int...
Mammography Annotations




CSCW Seminar 2007, June 12, 2007   Beat Signer, signer@inf.ethz.ch
The Lost Cosmonaut
 Writing as a collaborative
     act of memory and story-
     telling
 Reading, writing and
     nar...
Generosa Enterprise
 Interactive drawing installation
 Exhibited at the 150 Years ETH Zurich Jubilee (more
     than 200...
iGesture Framework
                                                   Common interface for
                              ...
iGesture Admin Tab




CSCW Seminar 2007, June 12, 2007   Beat Signer, signer@inf.ethz.ch
Capture of Samples




CSCW Seminar 2007, June 12, 2007   Beat Signer, signer@inf.ethz.ch
Conclusions
 Interactive paper framework (iPaper)
           information-centric approach supports different
           ...
Student Projects
   Basic technologies and infrastructure
             iServer resource plug-ins, …
             Integr...
References
 http://www.ipaper.inf.ethz.ch
 http://www.igesture.org
 Fundamental Concepts for Interactive Paper and
    ...
Upcoming SlideShare
Loading in …5
×

iPaper@GlobIS - Interactive Paper Research

1,465 views

Published on

Presentation given at CSCW Seminar, ETH Zurich, June 2007

Published in: Science, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,465
On SlideShare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
10
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

iPaper@GlobIS - Interactive Paper Research

  1. 1. iPaper@GlobIS – Interactive Paper Research CSCW Seminar Beat Signer, Nadir Weibel, Adriana Ispas and Moira C. Norrie Global Information Systems Research Group Department of Computer Science, ETH Zurich http://vub.academia.edu/BeatSigner CSCW Seminar 2007, June 12, 2007
  2. 2. Problems of Existing Applications  Many projects focus on the input device, paper, printing and other hardware technologies rather than on the data integration and information management aspects  isolated solutions  The linking of paper tends to be based on physical rather than information-centric concepts  difficult to integrate new input / output devices CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  3. 3. Our Approach  General interactive framework  different forms of paper-based interactions (enhanced reading, enhanced writing, …)  rapid prototyping as well as large scale publishing  integration of new types of resources and services  integration of new input devices  The key to a highly integrated interactive paper solution lies in the introduction of a platform for general cross-media information management CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  4. 4. Active Areas and Virtual Page Layers image video clip CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  5. 5. iPaper Architecture CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  6. 6. iServer Metamodel and Resource Plug-ins link Entities Selectors Resources Shape Page Query DB Object Time Span / Movie Clip XPointer XHTML Data/Metadata Spatial Info Document iPaper Application Database Movie Clips HTML Documents CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  7. 7. iSERVER iServer Links link parameter (1,*) (1,*) Has (0,*) HasSource Links HasTarget Preferences Preferences (0,*) (0,*) (0,*) parameter entity (0,*) AccessibleTo (0,*) user (0,*) (0,*) (0,*) Properties HasProperties Entities (0,*) (0,*) Users HasMembers (1,1) InaccessibleTo Layers partition partition (0,*) layer individual group (0,*) (0,*) |Layers| OnLayer CreatedBy Individuals Groups Users layer (1,1) Plug-ins selector resource Active (1,1) (0,*) (0,*) Selectors RefersTo Resources Contains Layers (0,*) Resources iPAPER page resource activeComponent medium (0,*) Active Com- OnPage Pages Containers Media (1,1) ponents shape (0,*) Shapes HasShapes (1,1) medium document Contains (0,*) Movies partition (2,*) Documents Pages rectangle polygon ellipse circle complexShape medium medium Complex Rectangles Polygons Ellipses Circles Images Webpages Shapes CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  8. 8. iServer Interfaces  Java API  XML import and export  Interface based on XML and XSLT  XHTML  WAP, i-mode  VoiceXML  Web Service  Peer-to-peer (P2P) CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  9. 9. iWeb Firefox Extension CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  10. 10. iWeb Plug-in World Wide Web HTTP HTTP Request Response SOAP Request iServExt SOAP Response iWeb Plug-in Link DB Firefox Web Client CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  11. 11. Active Content  Execute code (services) on the client and server side AC Manager Active Component ACS Manager A Active Component Active Component Stub B B Request Sender Client Device Active Component AC Names HTTP C iServer AC Names Client Server CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  12. 12. Active Components Button Image Slider Sound Slider2D Movie DateSelector SQLClient Browser XCMRequest MapSelector ClientCtrlRequest Rating PaperPointControl Capture PaperPointAnnot CaptureAndSpeak ... CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  13. 13. Active Components … <?xml version="1.0" encoding="UTF-8" ?> PAPERPOINT_CONTROL <iserver> <activeComponent id="s1a" creator="beat"> Show slide 1 <name>Show slide 1</name> <properties> command showSlide <parameter> <key>org.ximtec.iserver.ac:command</key> slide 1 <value>showSlide</value> </parameter> <parameter> <key>org.ximtec.iserver.ac:slide</key> <value>1</value> </parameter> </properties> <identifier>PAPERPOINT_CONTROL</identifier> </activeComponent> ... </iserver> CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  14. 14. PaperPoint Presentation Tool CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  15. 15. XML-Based Authoring ... ... <document id="handout" creator="beat"> <activeComponent id="fsa" creator="beat"> <name>Slide Handout</name> <name>First slide action</name> <id>h1</id> <properties> <size> <parameter> <width>210</width> <key>org.ximtec.iserver.ac:command</key> <height>297</height> <value>firstSlide</value> </size> </parameter> <content>handout.pdf</content> </properties> </document> <identifier>PAPERPOINT_CONTROL</identifier> <page id="p1" creator="beat" document="h1"> </activeComponent> <name>Page 1, Slide Controller</name> ... <number>1</number> <link id="fsl" creator="beat" sources="fs" </page> targets="fsa"> ... <name>Show the first slide</name> <rectangle id="fs" creator="beat" </link> layer="default" resource="p1"> ... <name>First Slide</name> <upperLeft> <point><x>24</x><y>12</y></point> </upperLeft> <size> <width>25</width><height>8</height> </size> </rectangle> ... CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  16. 16. Digital Link Authoring Tool CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  17. 17. PaperPoint Architecture CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  18. 18. EdFest Components CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  19. 19. EdFest Architecture Overview Context XCM Engine content publishing platform Context DB Metadata DB Appln DB Text-to-Speech Engine ICR Software Client handwriting Controller recognition Active iPaper Client iServer/iPaper cross-media Components link server Link DB CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  20. 20. Content Publishing Framework iServer cross-media link server XML link XCM iPublish definition content publishing publishing framework data publish • paper link data Structure Style • active areas on paper • layers • digital resources import • user model PDF XML data XSL CSS of festival venues and events CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  21. 21. Print-n-Link  Citations build the basis for a scientific web of publications  Use digital services to search / retrieve cited publications  Automatic authoring CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  22. 22. Print-n-Link Architecture Interactive Paper Architecture Desktop (x,y) Coordinates iSERVER iPAPER Active Content Text-to- Speech iPaper iPaper Plug-in Client Link DB Publish Positions and Active Content Definition Document Retrieval Print-n-Link Engine Web Search Citation Document Services Retrieval Lookup Print-n-Link: Weaving the Paper Web Semantic Mapper Printing Moira C. Norrie Beat Signer Nadir Weibel Dept. of Computer Science Dept. of Computer Science Dept. of Computer Science ETH Zurich ETH Zurich ETH Zurich 8092 Zurich, Switzerland norrie@inf.ethz.ch 8092 Zurich, Switzerland signer@inf.ethz.ch 8092 Zurich, Switzerland weibel@inf.ethz.ch Publish Display ABSTRACT Citation DB Citations engines and web browsers. The ease with which we can Citations form the basis for a web of scientific publications. not only find documents on the web, but also follow links Search engines, embedded hyperlinks and digital libraries to related documents is considered to be one of the main all simplify the task of finding publications of interest on advantages of working with digital documents as opposed the web and navigating to cited publications or web sites. to paper equivalents. Y many studies have shown that et However the actual reading of publications often takes place paper is still the preferred med ium when it comes to reading on paper and frequently on the move. We present a system documents for reasons of comfort, mobility and also ease of Print-n-Link that uses technologies for interactive paper to annotation. enhance the reading process by enabling users to access dig- In this paper, we show how emerging technologies for in- ital information and/or searches for cited documents from a teractive paper enable a bridge to be built between paper printed version of a publication using a digital pen for inter- and digital document spaces that allows users to travel back and forth between the two using the medium most appropri- iDOC action. A special virtual printer driver automatically gener- ates links from paper to digital services during the printing ate to the current task and sit uation. Users can print doc- process based on an analysis of PDF documents. Depend- uments for reading and, by activating hyperlinks on paper ing on the user setting and interaction gesture, the system with a digital pen, they can not only access digital informa- may retrieve metadata about the citation and inform the tion about related documents, but also initiate web searches user through an audio channel or directly display the cited to retrieve copies of those documents. The retrieved docu- document on the user’s screen. ments may in turn be printed for reading with automatically generated embedded hyperlinks on the paper. Mobility is supported by providing disconnected users on the move with Categories and Subject Descriptors audio information about related documents and the option D.2.11 [ Software Engineering ]: Software Architectures; of adding them to a request list to be processed when recon- H.4.m [ Information Systems Applications ]: Miscella- nected. neous; H.5.m [ Information Interfaces and Presenta- As an application, we take the everyday academic task of tion ]: Miscellaneous reading scientific publications. Whether the reading activ- Semantic Mapper ity is for the purpose of knowledge discovery or reviewing, readers regularly look up citations to other publications by General Terms flicking to the reference list at the back of the paper. In some Design, Algorithms, Experimentation cases, a search for the cited publication may follow and, if found, often it is printed and added to a pile of documents to Keywords be read. Citations are the established means of providing the links that form the basis of the scientific web of publications Publish Interactive paper, document integration, digital library, ci- that spans the digital and paper worlds. Just as citations tation management within digital documents can be used to automatically gen- 1. INTRODUCTION erate hyperlinks to cited documents, we can automatically generate links within paper documents through an analysis Citation Printer Nowadays we are all familiar with the notion of hyperlinks as a means of creating interconnected document spaces that of the PDF file when the document is printed. Section 2 presents a more detailed look at the activity of reading scientific publications and a discussion of related Document Print Driver can be easily searched and navigated with the help of search work. Section 3 describes the digital pen and paper tech- nologies and how these can be used to support interaction Analyser Pattern between paper and digital services. We then present the Permission to make digital or hard copies of all or part of this work for general functionality of our enhanced reading system in Sec- personal or classroom use is granted without fee provided that copies are tion 4 and the overall architecture in Section 5. Details of not made or distributed for profit or commercial advantage and that copies the virtual printer component used to analyse PDF docu- bear this notice and the full citation on the first page. To copy otherwise, to ments for automatic link generation as well as printing are republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. given in Section 6. Concluding remarks follow in Section 7. DocEng’06, October 10–13, 2006, Amsterdam, The Netherlands. Copyright 2006 ACM 1-59593-515-0/06/0010 ...$5.00. Document DB CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  23. 23. Printed-Digital Mapping static physical rendering dynamic logical document CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  24. 24. Printed-Digital Mapping Logical Physical Representation Representation Augmenting Enhanced Technology Virtual Printer (ex. Anoto) Source Digital Interactive Paginated Document Document (Print-Ready) Document (e.g. Anoto) (ID, page, x,y) iDoc iServer Geometrical Shapes, Digital Active Components Elements CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  25. 25. Mixed Physical-Digital Model CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  26. 26. Interactive Paper Applications  Enhanced Reading  Enhanced Writing  interactive paper maps  photo album  interactive festival brochures  researcher's notebook  educational materials  mammography  auction brochures  search system  scientific publications  …  …  Paper-Based Interfaces  Artists' Installations  PaperPoint  Lost Cosmonaut  digital libraries  Generosa Enterprise  video analysis tool  educational games  Interactive TableTops http://www.globis.ethz.ch/research/paper/applications/ CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  27. 27. Mammography Annotations CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  28. 28. The Lost Cosmonaut  Writing as a collaborative act of memory and story- telling  Reading, writing and narrative as an act of making sense  Handwriting as a tool for human computer interaction In collaboration with Axel Vogelsang, Artists in Labs Programme CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  29. 29. Generosa Enterprise  Interactive drawing installation  Exhibited at the 150 Years ETH Zurich Jubilee (more than 200'000 visitors) CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  30. 30. iGesture Framework  Common interface for different gesture recognition algorithms  Tools for implementing and evaluating new algorithms  Gesture set management CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  31. 31. iGesture Admin Tab CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  32. 32. Capture of Samples CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  33. 33. Conclusions  Interactive paper framework (iPaper)  information-centric approach supports different technologies, functionalities and applications  rapid prototyping (reusable active components)  Extensible platform for cross-media information management (iServer)  Cross-media authoring / publishing tools  manual, content-driven and automatic link authoring CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch
  34. 34. Student Projects  Basic technologies and infrastructure  iServer resource plug-ins, …  Integration of new tracking technologies  Interactive paper authoring tools  iGesture recognition framework (www.igesture.org)  Paper-based applications  PaperPoint, paper-based interface to digital agenda/todo list (e.g. Outlook), paper-digital notebook, paper-digital photo album, … We offer Master and Semester projects and are also looking for Hilfsassistenten CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch 34
  35. 35. References  http://www.ipaper.inf.ethz.ch  http://www.igesture.org  Fundamental Concepts for Interactive Paper and Cross-Media Information Spaces, B. Signer, Diss ETH Zurich Nr. 16218, 2006 CSCW Seminar 2007, June 12, 2007 Beat Signer, signer@inf.ethz.ch 35

×