i3 – Recent iServer, iPaper and iGesture Developments
Beat Signer
Institute for Information Systems
ETH Zurich
CH-8092 Zurich, Switzerland
5 December 2007

iServer Extensions and Modifications
 RSL (resource-selector-link) model is the new
name for the underlying iServer model
 Context Resolver
 Layers
 Structural Links
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 2

RSL Context Resolver
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 3

RSL Layers
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 4

RSL Structural Links
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 5

RSL Structural Links …
 Structure over data
 structural relationship of different resources
 e.g. regular document (chapters, sections, ...)
 possible to reuse the same resource in different
structures  transclusion (Ted Nelson)
 context-dependant structures based on context
resolver concept
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 6

RSL Structural Links …
 Structure over structures
 reuse of complete substructures
 structural composition of data and substructures can
be combined
 Structure over links
 put different navigational links in relation to each other
 e.g. single structural link to define linear order over
set of links  trails and tours
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 7

Structure
Links
Users
Layers
Plug-ins Active
Content
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 8

RSL Metamodel
Beat Signer and Moira C. Norrie, As We May Link:
A General Metamodel for Hypermedia Systems,
In Proceedings of ER 2007, 26th International Conference on
Conceptual Modeling, Auckland, New Zealand, November 2007
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

Digital Link Authoring Tool
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 10

Digital Link Authoring Tool …
 Extension of iServer authoring tool, Adriana
 Integration of earlier student projects (e.g. active
component authoring tool)
 Focus on the iPaper authoring plug-in but later
other plug-ins may be integrated
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 11

iPaper Templates
 Links that occur on multiple pages (e.g. controls,
headers, footers) should not have to be repeated
 Templates can be defined on document or
individual page level
 Multiple templates can be combined (page and
document level)
 PaperPoint currently uses a single template to
define the functionality available on all slides
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 12

iServer / iPaper Infrastructure
 Resource plug-in management
 Application management
 Pattern space management, Monica Frisoni
 I/O pen connector (Bluetooth), Claudio Hatz
 ...
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 13

PaperPoint v0.5
 New design / functionality
 colours, pointer types, …
 Single step printing
process
 User studies, Elke
 interviews
 lab sessions
 long term usage
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 14

PaperPoint v0.5
Beat Signer and Moira C. Norrie, PaperPoint: A Paper-Based
Presentation and Interactive Paper Prototyping Tool, In
Proceedings of TEI 2007, First International Conference on
Tangible and Embedded Interaction, Baton Rouge, USA,
February 2007
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

Interactive Table (iTable)
Pen-Based Google Earth Browser Pen-Based Drawing Tool
Photo Browser Photo Browser (Slider)
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 16

Interactive Table (iTable) …
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

Interactive Table (iTable) …
 Extension of iTable interface, Matthias Geel
 calibration of beamer and input area
 general desktop control active components
 Applications
 Pen-based Google Earth Explorer
 Pen-based Drawing Tool
 Photo Browser
 …
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 18

Rough Guide
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 19

Query by Sketching (QbS)
 Pen-based sketching
interface
 University of Basel
 GlobIS group
 Start date: October 2007 (2 year project), Adriana
Michael Springmann, Adriana Ispas, Heiko Schuldt, Moira
C. Norrie and Beat Signer, Towards Query by Sketch,
Second DELOS Conference on Digital Libraries, Pisa, Italy,
December 2007
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

PaperWeb
 Automatic authoring of
active areas
 all hyperlinks become
interactive on the
printout version
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 21

Remote Sketching on Paper
 Integration of Skype and
paper-based remote
sketching, Hermann
Hofstetter
 HCI group University of
Konstanz, H. Reiterer
 GlobIS group
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

Powerwall, Konstanz
 Facts
 5.20 m x 2.5 m
 8 beamers
 4640 x 1920 pixels
 soft-edge-blending
 Visualisation of large data sets
 Input devices
 3D tracker, laser "pen", mouse
 iPaper as a new input device?
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

Wellness Game Project, Shanghai
 Science, Technology &
Culture Festival, May 2008
 Projects
 Thai Chi, Native Systems Group,
Dennis Majoe
 China Gates, Native Systems
Group, Art Clay
 Real Time Panorama, Native
Systems Group, Jürg Gutknecht
 iPaper Project, GlobIS Group,
Moira C. Norrie
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 24

Multi Digital, LZ Medien
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 25

PaperProof
 Planned user studies,
Nadir & Elke
 Definition of new gestures
for edit commands?
Nadir Weibel, Adriana Ispas, Beat Signer and Moira C. Norrie,
PaperProof: A Paper-Digital Proof-Editing System,
Proceedings of CHI 2008, 26th International Conference on
Human Factors in Computing Systems (Interactivity Track),
Florence, Italy, April 2008
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 26

iGesture Framework
 http://www.igesture.org
 Open Source (Apache 2.0)
 initial release February 2007
 1682 downloads
 Presented at ICDAR 2007
 FKI Group, University of Berne
 DFKI, Germany
 Computer Vision Center,
Barcelona
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 27

iGesture Framework …
 New input handler for graphics tablets and
Tablet PCs, Michele Croci
Beat Signer, Ueli Kurmann and Moira C. Norrie, iGesture:
A General Gesture Recognition Framework, Proceedings of
ICDAR 2007, 9th International Conference on Document
Analysis and Recognition, Curitiba, Brazil, September 2007
Beat Signer, Moira C. Norrie and Ueli Kurmann, iGesture:
A Java Framework for the Development and Deployment of
Stroke-Based Online Gesture Recognition Algorithms,
Technical Report ETH Zurich, TR561, September 2007
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

Geco (Gesture Control)
 Mapping of gestures
(iGesture gesture sets),
Michele Croci
 hotkeys
 command line calls
 …
 Initial release (freeware)
planned within next month
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

Department Events
 Maturandentage 2008
 January 8/9
 PaperProof and PaperPoint
 Jahr der Informatik
 visit different locations
 PaperPoint as presentation tool?
5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch