A Framework for Cross-media Information Management

•

1 like•2,277 views

Presentation given at EuroIMSA 2005, International Conference on Internet and Multimedia Systems and Applications. Grindelwald, Switzerland, February 2005 ABSTRACT: Nowadays a user's personal information space is fragmented into multiple repositories on their local machine as well as on remote servers. In order to enable later access to resources managed within such a cross-media information space, information has to be organised in a format that can be processed by automatic retrieval processes. We propose a general framework for personal information management based on extending a cross-media link server with supplemental metadata functionality. In addition to user generated information, our solution automatically derives metadata for classifying and associating resources based on direct interaction with the information space. Resources and metadata can be integrated by referencing external resources or information may be managed directly by the framework. The presented cross-media information management solution is not limited to a fixed set of predefined resources and can be extended based on a resource plug-in mechanism.

Technology Business

A Framework
for Cross-Media
Information Management

Beat Signer
Moira C. Norrie

Global Information Systems Research Group
Global Information Systems Group ETH Zurich
Department of Computer Science
Switzerland
ETH Zurich, Switzerland

EuroIMSA 2005, February 23, 2005

Outline

Motivation
iServer
cross-media information management
Resource plug-ins
Cross-media authoring
Information sharing

Global Information Systems Group
Department of Computer Science
ETH Zurich, Switzerland

Paper++ Augmented Paper

document
positions

Global Information Systems Group
Department of Computer Science Transformation of positions to shapes
ETH Zurich, Switzerland

Paper++ Applications

Global Information Systems Group
Department of Computer Science
ETH Zurich, Switzerland

Paper++ Architecture

Global Information Systems Group
Department of Computer Science
ETH Zurich, Switzerland

iServer Cross-Media Platform

link

Entities

Selectors Resources

Shape Page Query DB Object
Time Span / Movie Clip XPointer XHTML
Data/Metadata
Spatial Info Document

Global Information Systems Group
Department of Computer Science
Paper++ Application Database
ETH Zurich, Switzerland Movie Clips HTML Documents

iServer Concepts

Links link parameter
(1,*) (1,*) Has (0,*)
HasSource Links HasTarget Preferences
Preferences
(0,*) (0,*)
(0,*)

parameter entity (0,*) AccessibleTo (0,*) user
(0,*) (0,*) (0,*)
Properties HasProperties Entities (0,*)
(0,*)
Users HasMembers
(1,1)
InaccessibleTo
Layers partition
partition
(0,*)

layer individual group
(0,*) (0,*)
|Layers| OnLayer CreatedBy Individuals Groups
Users
layer
(1,1) Plug-ins
selector resource

Active (1,1) (0,*) (0,*)
Selectors RefersTo Resources Contains
Layers

(0,*)
Resources
P aper
++
shape
(1,1)
OnPage
(0,*)
Pages
page

Containers
resource textComp

Texts
medium

Media

(0,*)
Shapes HasShapes (1,1)
medium
document

Contains (0,*) Movies
partition (2,*) Documents
Global Information Systems Group
Pages
rectangle polygon ellipse circle complexShape medium medium
Department of Computer Science
Complex
Rectangles
ETH Zurich, Switzerland Polygons Ellipses Circles Images Webpages
Shapes

XHTML Plug-in

World Wide Web

HTTP Original
Request Response

HTTP Request
Link Data

Response
XHTML Plug-in
Link DB
Web Client Proxy Server
Global Information Systems Group
Department of Computer Science
ETH Zurich, Switzerland

Paper++ Authoring Tool

Global Information Systems Group
Department of Computer Science
ETH Zurich, Switzerland

iServer Authoring Tool

Extensible iServer authoring tool
provides handling of core iServer
concepts (layers, user management, ...)
resource plug-ins to define the selectors
XML Import
Integration of existing publishing tools
via iServer XML import

Global Information Systems Group
Department of Computer Science
ETH Zurich, Switzerland

iServer Interfaces

Java API
XML import and export
Web interface based on XML and XSLT
XHTML
WAP, i-mode
VoiceXML
Web Service

Global Information Systems Group
Department of Computer Science
ETH Zurich, Switzerland

Information Sharing

Each user should become
an author of his personal information
a publisher for the community
Decentralised P2P network of iServers
Filters to "ensure" information quality
frequency count
user confidence values
Combine preauthored and personal
Global Information Systems Group
information
Department of Computer Science
ETH Zurich, Switzerland

Conclusion

Flexible platform for cross-media
information management
resource plug-ins
Integration of digital and physical
information
digitally augmented physical objects
physically augmented digital objects
digitally augmented digital objects
physically augmented physical objects
Global Information Systems Group
Department of Computer Science
ETH Zurich, Switzerland
Collaborative authoring

Questions?

Global Information Systems Group
Department of Computer Science
ETH Zurich, Switzerland

Presentation given at Hypertext 2003, 14th ACM Conference on Hypertext and Hypermedia. Nottingham, United Kingdom, August 2003 ABSTRACT: The integration of printed paper and digital information enables new forms of enhanced reading. We present digitally augmented paper as a specific application of our more general Integration Server (iServer) architecture for crossmedia information management. Multi-layered linking is introduced as a way to manage the granularity of link anchors and an application making active use of multi-layered links is presented. Furthermore, we point out how the concept of supporting multiple layers in link management can be applied to other media such as, for example, XHTML in combination with the XML Linking Language (XLink).

Bridging the Paper-Digital Divide: The iPaper Interactive Paper Framework

Beat Signer

Linking Paper and Digital Media

Beat Signer

Switching over to Paper: A New Web Channel

Beat Signer

Presentation given at WISE 2003, 4th International Conference on Web Information Systems Engineering, Rome, Italy, December 2003 ABSTRACT: We present a general web-based information infrastructure capable of supporting the rapid development of highlyinteractive information environments that cater for widely varying requirements across application domains and all forms of fixed and mobile client devices. In particular, we describe how this infrastructure has been extended to support digitally augmented paper through a special transformation component that can map active areas of document pages to information objects so that user- and contextdependent interaction can be supported. Our infrastructure is sufficiently general and flexible to adapt to, not only emerging and even unanticipated technologies in the area of interactive paper, but also the rapidly expanding interaction sphere of hypermedia.

Nesc invited presentation: Semantic Provenance and Linked Open DataPaolo Missier

Structural Dynamics Toolbox and OpenFEM, a technical overview

SDTools

Computer Programming Chapter 6 : Array and ArrayListAtit Patumvan

OcrAmit Singh

Presentation given at ER 2010, 29th International Conference on Conceptual Modeling, Vancouver, Canada, November 2010 ABSTRACT: Many of today's digital document formats are strongly based on a digital emulation of printed media. While such a paper simulation might be appropriate for the visualisation of certain digital content, it is generally not the most effective solution for digitally managing and storing information. The oversimplistic modelling of digital documents as monolithic blocks of linear content, with a lack of structural semantics, does not pay attention to some of the superior features that digital media offers in comparison to traditional paper documents. For example, existing digital document formats adopt the limitations of paper documents by unnecessarily replicating content via copy and paste operations, instead of digitally embedding and reusing parts of digital documents via structural references. We introduce a conceptual model for structural cross-media content composition and highlight how the proposed solution not only enables the reuse of content via structural relationships, but also supports dynamic and context-dependent document adaptation, structural content annotations as well as the integration of arbitrary non-textual media types. We further discuss solutions for the fluid navigation and cross-media content publishing based on the proposed structural cross-media content model.

On metadata for Open Data

Yannis Charalabidis

Infrastructure and Workflow for the Formal Evaluation of Semantic Search Tech...

Stuart Wrigley

This paper describes an infrastructure for the automated evaluation of semantic technologies and, in particular, semantic search technologies. For this purpose, we present an evaluation framework which follows a service-oriented approach for evaluating semantic technologies and uses the Business Process Execution Language (BPEL) to define evaluation workflows that can be executed by process engines. This framework supports a variety of evaluations, from different semantic areas, including search, and is extendible to new evaluations. We show how BPEL addresses this diversity as well as how it is used to solve specific challenges such as heterogeneity, error handling and reuse. Presented at Data infrastructurEs for Supporting Information Retrieval Evaluation (DESIRE 2011) Workshop, Co-located with CIKM 2011, the 20th ACM Conference on Information and Knowledge Management Friday 28th October 2011, Glasgow, UK http://www.promise-noe.eu/events/desire-2011/

Requirements for Processing Datasets for Recommender SystemsStoitsis Giannis

Interactive Paper and Cross-Media Publishing

Beat Signer

OI in the Public Sector by Esteve Almirall

citycamptunisia

Achieving Semantic Interoperability in the Internet of Things

iotest

Naming, Search and Discovery in IoT: Issues and proposed solutions in the FP7...

iotest

HFile: A Block-Indexed File Format to Store Sorted Key-Value Pairs

Schubert Zhang

Hfile格式详细介绍

Institute of Computing Technology, Chinese Academy of Sciences

Linked Sensor Data 101 (FIS2011)Jean-Paul Calbimonte

NET RIA Services - Building Data-Driven Applications with Microsoft Silverlig...

goodfriday

เฉลยคำตอบ OSurapong Jakang

(ATS3-APP02) What's new in Isentris 4.0

BIOVIA

Searching for Interestingness in Wikipedia and Yahoo! Answers

Gabriela Agustini

In many cases, when browsing the Web, users are searching for specific information. Sometimes, though, users are also looking for something interesting, surprising, or entertain- ing. Serendipitous search puts interestingness on par with relevance. We investigate how interesting are the results one can obtain via serendipitous search, and what makes them so, by comparing entity networks extracted from two promi- nent social media sites, Wikipedia and Yahoo! Answers. PAPER ACCEPTED FOR THE WWW2013 CONFERENCE (www.2013.org).

2010-06 - a smalltalk about salesforce.com with java architects at YaJuG

Yves Leblond

Towards Abundant Do-it-Yourself (DiY) Service Creativity in the Internet-of-T...

trappenl

A profound impact of the Web2.0 lies in its power to transform skilled users into service providers, resulting in more complex value networks. As recently traditional “operated” network infrastructure is complemented with huge amounts of connected smart objects (the Internet-of-Things), the same mass creativity can be made applicable to smart, context-enabled services with real-world interactivity, collaboratively created by end users with varying degrees of programming skills. We report on a vision and solutions addressing easy, do-it-yourself service creation by the masses in an Internet-of-Things enabled world, from which we discuss the (i) value networks, (ii) enabling technology framework, and (iii) domain-specific proof-of-concepts.

(ATS4-APP05) What's new in Isentris 4.0SP1

BIOVIA

In this session we will do a tour of the recently released Isentris 4.0SP1 with Accelrys Draw 4.1. You will see Chemical Representation advances made available in this release; extended search and bond types (Dative, Haptic, H-Bond, Homology, Biologics – Self Contained Sequence Representation: SCSR, Markush - positional bond uncertainty). Isentris’ enhanced visualization components, the new Isentris for Excel renderer, and how Pipeline Pilot can now be seamless called within Isentris, opening a wide set of opportunities to bring new functionalities to the end-users.

Data-Intensive Research

Jano van Hemert

Edinburgh Data-Intensive Research Data-intensive refers to huge volumes of data, complex patterns of data integration and analysis, and intricate interactions between data and users. Current methods and tools are failing to address data-intensive challenges effectively. They fail for several reasons, all of which are aspects of scalability. The deluge of computational methods and plethora of computational systems prevents effective and efficient use of resources, user interfaces are not adopted at a sufficient rate to satisfy demand for scientific computing and data and knowledge is created outside suitable contexts for collaborative research to be effective. The Edinburgh Data-Intensive Research group addresses these scalability issues by providing mappings from abstract formulations to concrete and optimised executions of research challenges, by developing intuitive interfaces to enable access to steer these executions and by developing systems to aid in creating new research challenges. In this talk I will present several exemplars where we have dealt with scalability issues in scientific scenarios.

Introduction - Lecture 1 - Human-Computer Interaction (1023841ANR)

Beat Signer

Indoor Positioning Using the OpenHPS Framework

Beat Signer

Research paper presentation given at IPIN 2021, Lloret de Mar, Spain. Hybrid positioning frameworks use various sensors and algorithms to enhance positioning through different types of fusion. The optimisation of the fusion process requires the testing of different algorithm parameters and optimal lowas well as high-level sensor fusion techniques. The presented OpenHPS open source hybrid positioning system is a modular framework managing individual nodes in a process network, which can be configured to support concrete positioning use cases or to adapt to specific technologies. This modularity allows developers to rapidly develop and optimise their positioning system while still providing them the flexibility to add their own algorithms. In this paper we discuss how a process network developed with OpenHPS can be used to realise a customisable indoor positioning solution with an offline and online stage, and how it can be adapted for high accuracy or low latency. For the demonstration and validation of our indoor positioning solution, we further compiled a publicly available dataset containing data from WLAN access points, BLE beacons as well as several trajectories that include IMU data. Research paper: https://beatsigner.com/publications/indoor-positioning-using-the-openhps-framework.pdf

Similar to A Framework for Cross-media Information Management

iPaper@GlobIS - Interactive Paper Research

Beat Signer

What is Wrong with Digital Documents? A Conceptual Model for Structural Cross...

Beat Signer

On metadata for Open Data

Yannis Charalabidis

Infrastructure and Workflow for the Formal Evaluation of Semantic Search Tech...

Stuart Wrigley

Requirements for Processing Datasets for Recommender SystemsStoitsis Giannis

Interactive Paper and Cross-Media Publishing

Beat Signer

OI in the Public Sector by Esteve Almirall

citycamptunisia

Achieving Semantic Interoperability in the Internet of Things

iotest

Naming, Search and Discovery in IoT: Issues and proposed solutions in the FP7...

iotest

HFile: A Block-Indexed File Format to Store Sorted Key-Value Pairs

Schubert Zhang

Hfile格式详细介绍

Institute of Computing Technology, Chinese Academy of Sciences

Linked Sensor Data 101 (FIS2011)Jean-Paul Calbimonte

NET RIA Services - Building Data-Driven Applications with Microsoft Silverlig...

goodfriday

เฉลยคำตอบ OSurapong Jakang

(ATS3-APP02) What's new in Isentris 4.0

BIOVIA

Searching for Interestingness in Wikipedia and Yahoo! Answers

Gabriela Agustini

2010-06 - a smalltalk about salesforce.com with java architects at YaJuG

Yves Leblond

Towards Abundant Do-it-Yourself (DiY) Service Creativity in the Internet-of-T...

trappenl

(ATS4-APP05) What's new in Isentris 4.0SP1

BIOVIA

Data-Intensive Research

Jano van Hemert

Similar to A Framework for Cross-media Information Management (20)

iPaper@GlobIS - Interactive Paper Research

What is Wrong with Digital Documents? A Conceptual Model for Structural Cross...

On metadata for Open Data

Infrastructure and Workflow for the Formal Evaluation of Semantic Search Tech...

Requirements for Processing Datasets for Recommender Systems

Interactive Paper and Cross-Media Publishing

OI in the Public Sector by Esteve Almirall

Achieving Semantic Interoperability in the Internet of Things

Naming, Search and Discovery in IoT: Issues and proposed solutions in the FP7...

HFile: A Block-Indexed File Format to Store Sorted Key-Value Pairs

Hfile格式详细介绍

Linked Sensor Data 101 (FIS2011)

NET RIA Services - Building Data-Driven Applications with Microsoft Silverlig...

เฉลยคำตอบ O

(ATS3-APP02) What's new in Isentris 4.0

Searching for Interestingness in Wikipedia and Yahoo! Answers

2010-06 - a smalltalk about salesforce.com with java architects at YaJuG

Towards Abundant Do-it-Yourself (DiY) Service Creativity in the Internet-of-T...

(ATS4-APP05) What's new in Isentris 4.0SP1

Data-Intensive Research

More from Beat Signer

Introduction - Lecture 1 - Human-Computer Interaction (1023841ANR)

Beat Signer

Indoor Positioning Using the OpenHPS Framework

Beat Signer

Personalised Learning Environments Based on Knowledge Graphs and the Zone of ...

Beat Signer

Presentation given at CSEDU 2022, Virtual Event. The learning of new knowledge and skills often requires previous knowledge, which can lead to some frustration if a teacher does not know a learner's exact knowledge and skills and therefore confronts them with exercises that are too difficult to solve. We present a solution to address this issue when teaching techniques and skills in the domain of table tennis, based on the concrete needs of trainers that we have investigated in a survey. We present a conceptual model for the representation of knowledge graphs as well as the level at which individual players already master parts of this knowledge graph. Our fine-grained model enables the automatic suggestion of optimal exercises in a player's so-called zone of proximal development, and our domain-specific application allows table tennis trainers to schedule their training sessions and exercises based on this rich information. In an initial evaluation of the resulting solution for personalised learning environments, we received positive and promising feedback from trainers. We are currently investigating how our approach and conceptual model can be generalised to some more traditional educational settings and how the personalised learning environment might be further improved based on the expressive concepts of the presented model. Research paper: https://beatsigner.com/publications/personalised-learning-environments-based-on-knowledge-graphs-and-the-zone-of-proximal-development.pdf

Cross-Media Technologies and Applications - Future Directions for Personal In...

Beat Signer

Webinar given at icity Lab Talks - The Digital Value Chain In this talk, I will first provide an overview of the lab’s research on a general data-driven approach for cross-media information system and architectures based on the resource-selector-link (RSL) hypermedia metamodel. We will then have a look at several cross-media applications for personal information management and next-generation presentation solutions (MindXpres). Finally, I will outline the lab’s most recent research on tangible interaction and dynamic data physicalisation.

Bridging the Gap: Managing and Interacting with Information Across Media Boun...

Beat Signer

Codeschool in a Box: A Low-Barrier Approach to Packaging Programming Curricula

Beat Signer

Presentation given at CSEDU 2023, Prague, Czech Republic. The tech industry is a fast-growing field, with many companies facing issues in finding skilled workers to fill their open vacancies. At the same time, many people have limited access to the quality education necessary to enter this job market. To address this issue, various small and often volunteer-run non-profit organisations have emerged to up-skill capable learners. However, these organisations face tight constraints and many challenges while trying to design and deliver high-quality education to their learners. In this position paper, we discuss some of these challenges and present a preliminary version of a curriculum packager addressing some of these issues. Our proposed solution, inspired by first-hand experience in these organisations as well as computing education research (CER), is based on a combination of micromaterials, study lenses and a companion mobile application. While our solution is designed for the specific context of small organisations providing vocational ICT training, it can also be applied to the broader domain of learning environments facing similar constraints. Research paper: https://beatsigner.com/publications/codeschool-in-a-box-a-low-barrier-approach-to-packaging-programming-curricula.pdf

The RSL Hypermedia Metamodel and Its Application in Cross-Media Solutions

Beat Signer

Case Studies and Course Review - Lecture 12 - Information Visualisation (4019...

Beat Signer

Dashboards - Lecture 11 - Information Visualisation (4019538FNR)

Beat Signer

Interaction - Lecture 10 - Information Visualisation (4019538FNR)

Beat Signer

View Manipulation and Reduction - Lecture 9 - Information Visualisation (4019...

Beat Signer

Visualisation Techniques - Lecture 8 - Information Visualisation (4019538FNR)

Beat Signer

Design Guidelines and Principles - Lecture 7 - Information Visualisation (401...

Beat Signer

Data Processing and Visualisation Frameworks - Lecture 6 - Information Visual...

Beat Signer

Data Presentation - Lecture 5 - Information Visualisation (4019538FNR)

Beat Signer

Analysis and Validation - Lecture 4 - Information Visualisation (4019538FNR)

Beat Signer

Data Representation - Lecture 3 - Information Visualisation (4019538FNR)

Beat Signer

Human Perception and Colour Theory - Lecture 2 - Information Visualisation (4...

Beat Signer

Introduction - Lecture 1 - Information Visualisation (4019538FNR)

Beat Signer

Towards a Framework for Dynamic Data Physicalisation

Beat Signer

Presentation given at the International Workshop Toward a Design Language for Data Physicalization, Berlin, Germany, October 2018 ABSTRACT: Advanced data visualisation techniques enable the exploration and analysis of large datasets. Recently, there is the emerging field of data physicalisation, where data is represented in physical space (e.g. via physical models) and can no longer only be explored visually, but also by making use of other senses such as touch. Most existing data physicalisation solutions are static and cannot be dynamically updated based on a user's interaction. Our goal is to develop a framework for new forms of dynamic data physicalisation in order to support an interactive exploration and analysis of datasets. Based on a study of the design space for dynamic data physicalisation, we are therefore working on a grammar for representing the fundamental physical operations and interactions that can be applied to the underlying data. Our envisioned extensible data physicalisation framework will enable the rapid prototyping of dynamic data physicalisations and thereby support researchers who want to experiment with new combinations of physical variables or output devices for dynamic data physicalisation as well as designers and application developers who are interested in the development of innovative dynamic data physicalisation solutions. Paper: https://www.academia.edu/37336859/Towards_a_Framework_for_Dynamic_Data_Physicalisation

More from Beat Signer (20)