Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Paper-Digital User InterfacesApplications, Frameworks and Future ChallengesBeat SignerDepartment of Computer ScienceVrije ...
Bridging the Paper-Digital DivideUser Interface Colloquium, November 2, 2009   Beat Signer, bsigner@vub.ac.be
Personal Background Research on paper-digital and cross-media     solutions over the last 8 years            realised mo...
Applications Enhanced Reading                                            Enhanced Writing            interactive paper ...
EdFest ProjectUser Interface Colloquium, November 2, 2009   Beat Signer, bsigner@vub.ac.be
EdFest DocumentsUser Interface Colloquium, November 2, 2009   Beat Signer, bsigner@vub.ac.be
Design ChallengesUser Interface Colloquium, November 2, 2009   Beat Signer, bsigner@vub.ac.be
Rough GuideUser Interface Colloquium, November 2, 2009   Beat Signer, bsigner@vub.ac.be
iGesture Framework                                                              iGesture Workbench                       ...
Print-n-Link Handle existing PDF     documents            e.g. research papers Automatic link autho-     ring at print ...
PaperPoint Presentation Tool                                                              Mobile PowerPoint              ...
PaperPoint Stickers Empty stickers linked     to specific PowerPoint     slides containing            text            i...
PaperProof: Paper-Digital Proof-EditingUser Interface Colloquium, November 2, 2009   Beat Signer, bsigner@vub.ac.be
Mammography AnnotationsUser Interface Colloquium, November 2, 2009   Beat Signer, bsigner@vub.ac.be   14
The Lost Cosmonaut Writing as a collaborative     act of memory and story-     telling Reading, writing and     narrativ...
iPaper Research              Link Metamodel (RSL)                                                Tools           Cross-Med...
RSL Metamodel and iServerUser Interface Colloquium, November 2, 2009   Beat Signer, bsigner@vub.ac.be
Structure         Links                                                                                        Users      ...
Active Components                                      Button                                         Image               ...
Cross-Media Authoring and Publishing Manual link authoring Content-driven     publishing            e.g. EdFest brochur...
Content-driven Cross-Media Publishing                                                                                     ...
Interactive Paper 2.0                                                                    web pages                   consu...
Interactive Paper 2.0 ... Global and open architecture instead of isolated     solutions Two main challenges to be addre...
Interactive Paper 2.0 ... It is not only about enabling interactions accross     different interactive paper solutions   ...
Future Challenges Design            visual encoding of interactive areas and functionality            interaction desig...
Conclusions Interactive paper framework (iPaper)            information-centric approach supports different             ...
Further Information Presentation available on            http://www.slideshare.net/signer/ Research papers about the pr...
Upcoming SlideShare
Loading in …5
×

Paper-Digital User Interfaces - Applications, Frameworks and Future Challenges

13,306 views

Published on

Invited talk given at the User Interface Colloquium, Otto-von-Guericke University Magdeburg, Germany, November 2, 2009

While there have been dramatic increases in the use of digital technologies for information storage, processing and delivery over the last few decades, the affordances of paper have ensured its retention as a key information medium. Despite predictions of the paperless office, paper is ever more present in our daily work. However, there is a gap between the paper and digital worlds: information present in paper documents cannot be seamlessly transferred to digital media and digital services are not easily accessible from the paper world.

ABSTRACT: In this talk I will present an information-centric approach for integrating paper with digital as well as physical media based on a general cross-media information platform (iServer). Some details about the architecture and implementation of the iServer platform as well as the underlying resource-selector-link (RSL) metamodel for cross-media linking will be highlighted. A selection of interactive paper applications that have been developed based on this platform over the past nine years will be presented, including the EdFest interactive paper guide for the Edinburgh festivals, the PaperPoint presentation tool as well as the PaperProof proof-editing solution. Challenges and solutions for novel forms of interactive paper and cross-media publishing are discussed based on the presented applications. This includes specific extensions of the iServer platform and RSL model as well as the application of our solution in new domains such as digital libraries, cross-media annotation and retrieval or personal cross-media information management that goes beyond the hierarchical information management imposed by the desktop metaphor.

Published in: Technology, Education
  • Be the first to comment

Paper-Digital User Interfaces - Applications, Frameworks and Future Challenges

  1. 1. Paper-Digital User InterfacesApplications, Frameworks and Future ChallengesBeat SignerDepartment of Computer ScienceVrije Universiteit Brusselhttp://www.beatsigner.com Otto-von-Guericke-Universität Magdeburg, User Interface Colloquium, November 2, 2009
  2. 2. Bridging the Paper-Digital DivideUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  3. 3. Personal Background Research on paper-digital and cross-media solutions over the last 8 years  realised more than 20 interactive paper applications Involved in 2 European projects  Paper++ (2001-2004) - focus on enhanced reading  PaperWorks (2005-2008) - enhanced reading, writing and publishingUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  4. 4. Applications Enhanced Reading  Enhanced Writing  interactive paper maps  photo album  interactive festival brochures  researchers notebook  educational materials  mammography annotation  auction brochures  query by sketching  scientific publications  …  …  Art Installations Paper-based Interfaces  Lost Cosmonaut  PaperPoint  Generosa Enterprise  document proof-editing  digital libraries  Interactive Tabletops  video analysis tool  photo browser  educational games  collaborative sketch toolUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  5. 5. EdFest ProjectUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  6. 6. EdFest DocumentsUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  7. 7. Design ChallengesUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  8. 8. Rough GuideUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  9. 9. iGesture Framework  iGesture Workbench  create/test gesture sets and algorithms  Different modalities  digital pen, tablet PC, mouse, Wii remote, …  multimodal gestures  Open Source  http://www.igesture.orgUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  10. 10. Print-n-Link Handle existing PDF documents  e.g. research papers Automatic link autho- ring at print time  applicable to other domainsUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  11. 11. PaperPoint Presentation Tool  Mobile PowerPoint presentation tool  non-linear presentations  real-time annotations  digital whiteboard  ...  Multi-pen support  brainstormingUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  12. 12. PaperPoint Stickers Empty stickers linked to specific PowerPoint slides containing  text  images  movies, ... Effective tool for inter- active paper mockupsUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  13. 13. PaperProof: Paper-Digital Proof-EditingUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  14. 14. Mammography AnnotationsUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be 14
  15. 15. The Lost Cosmonaut Writing as a collaborative act of memory and story- telling Reading, writing and narrative as an act of making sense Handwriting as a tool for human computer interaction In collaboration with Axel Vogelsang, Artists in Labs ProgrammeUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  16. 16. iPaper Research Link Metamodel (RSL) Tools Cross-Media Frameworks ApplicationsUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  17. 17. RSL Metamodel and iServerUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  18. 18. Structure Links Users Layers Plug-ins Active ContentUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  19. 19. Active Components Button Image Slider Sound Slider2D Movie DateSelector SQLClient Browser XCMRequest MapSelector ClientCtrlRequest Rating PaperPointControl Capture PaperPointAnnot CaptureAndSpeak ...User Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  20. 20. Cross-Media Authoring and Publishing Manual link authoring Content-driven publishing  e.g. EdFest brochure Automatic link authoring  e.g. Print-n-Link Collaborative authoringUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  21. 21. Content-driven Cross-Media Publishing XML link XCM iPublish definitioncontent publishing publishing framework data publish iServer Structure Style cross-media link server import PDF XML data XSL CSS of festival venues and events Information-centric approach User Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  22. 22. Interactive Paper 2.0 web pages consumers / publishers publisher videos books presentation slidesUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  23. 23. Interactive Paper 2.0 ... Global and open architecture instead of isolated solutions Two main challenges to be addressed  unqiue addressing and resolving of interactive paper services - requires a global paper lookup service (PLS) similar to the DNS on the Internet  service oriented architecture to enable cross- application interaction and compositionUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  24. 24. Interactive Paper 2.0 ... It is not only about enabling interactions accross different interactive paper solutions  integegration with existing paperless information spaces (e.g. Web 2.0)  personal cross-media information management Are we missing a basic layer in existing interactive paper architectures?User Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  25. 25. Future Challenges Design  visual encoding of interactive areas and functionality  interaction design - online/offline processing, lack of modal dialogues, ... Interactive Paper 2.0  global publishing and interaction architecture  collaborative authoring and information sharing  seamless integration with personal cross-media information management environmentsUser Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  26. 26. Conclusions Interactive paper framework (iPaper)  information-centric approach supports different technologies, functionalities and applications  separation of authoring and programming  rapid prototyping Innovative authoring and publishing tools  manual, content-driven, automatic and collaborative Future Interactive Paper 2.0 challenges!User Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be
  27. 27. Further Information Presentation available on  http://www.slideshare.net/signer/ Research papers about the presented applications and frameworks are available on  http://vub.academia.edu/BeatSigner Fundamental Concepts for Interactive Paper and Cross-Media Information Spaces, Beat Signer, ISBN 978-3-8370-2713-6, May 2008User Interface Colloquium, November 2, 2009 Beat Signer, bsigner@vub.ac.be

×