Sara Streng, University of Munich (DE) Dominique Guinard, SAP Research Zurich (CH) Hans-Werner Gellersen, Lancaster University (UK) Albrecht Schmidt, University of Bonn b-it (DE) [email_address] http://ubicomp.lancs.ac.uk/relategateways USING SPATIAL CONDITIONS FOR PROACTIVE COMPUTING AND INTERACTION METAPHORS

Today’s Menu Motivation Spatial Condition Toolkit Gateway Application User Study Conclusion Dominique Guinard 18.03.2008

Motivation

Spatial Condition Toolkit

Gateway Application

User Study

Conclusion

Motivation: Discovering a Printer on a Mobile Device Dominique Guinard 18.03.2008 Source: http://www.java.sun.com and my computer running vista.

Motivation We have real troubles identifying pervasive services [1, etc.]: Especially while on the run, in unknown places [2, etc.]. We structure our environment primarily spatially [3, etc.]. Why don’t we discover service on mobile devices according to spatial conditions ? Dominique Guinard 18.03.2008 [1] Adam Greenfield. The Dawning Age of Ubiquitous Computing. New Riders Publishing, 1st edition, March 2006. [2] Thomas Koeltinger, Martin Tomitsch, Karin Kappel, and Thomas Grechenig. Understanding spatial mobile service discovery using pointing and touching. In Mobile Mobile Spatial Interaction Workshop at ACM International Conference on Human Factors in Computing Systems, CHI 2007 - Reach Beyond, April 2007. [3] Felix Hupfeld and Michael Beigl. Spatially aware local communication in the raum system. In IDMS '00: Proceedings of the 7th International Workshop on Interactive Distributed Multimedia Systems and Telecommunication Services , pages 285296, London, UK, 2000. Springer-Verlag.

We have real troubles identifying pervasive services [1, etc.]:

Especially while on the run, in unknown places [2, etc.].

We structure our environment primarily spatially [3, etc.].

Why don’t we discover service on mobile devices according to spatial conditions ?

Today’s Menu Motivation Spatial Condition Toolkit Gateway Application User Study Conclusion Dominique Guinard 18.03.2008

Motivation

Spatial Condition Toolkit

Gateway Application

User Study

Conclusion

Basic Spatial Conditions Dominique Guinard 18.03.2008 Position Information Location Motion within ambient (= remote) zone within interaction (= proximate) zone distance quantitative qualitative qualitative towards / away within zone closer / further away than ... in line of sight area same building Within notification zone coordinates with respect to another object definition same room Orientation left / right of quantitative qualitative facing / turning back to unit vector exactly within angle within range exactly within angle overlap direction velocity acceleration quantitative relation on top of / below

Spatial Condition Toolkit SCT assists with the automatic triggering of actions under spatial conditions. Consists of four layers: Dominique Guinard 18.03.2008 Positioning System Provides position of registered Trackables Monitor Keeps track of all registered Trackables and their position information Reports position changes Trigger Agent Detects whether conditions are fulfilled Triggers actions when spatial condition are fulfilled Application Registers at the Trigger Agent and makes use of its functionality register pairs of (condition, action) register involved trackables trigger action if spatial condition is fulfilled inform trigger agent when position of an involved trackable changes

SCT assists with the automatic triggering of actions under spatial conditions.

Consists of four layers:

Keeps track of all registered Trackables and their position information

Reports position changes

Detects whether conditions are fulfilled

Triggers actions when spatial condition are fulfilled

Today’s Menu Motivation Spatial Condition Toolkit Gateway Application User Study Conclusion Dominique Guinard 18.03.2008

Motivation

Spatial Condition Toolkit

Gateway Application

User Study

Conclusion

A Compass User Interface Mobile user interface (UI) as a “ compass ”: Helps users to identify services available in the immediate environment. Gateways move as the user moves. Mapping the user’s view of his environment on the mobile desktop. Dominique Guinard 18.03.2008

Mobile user interface (UI) as a “ compass ”:

Helps users to identify services available in the immediate environment.

Gateways move as the user moves.

Mapping the user’s view of his environment on the mobile desktop.

SCT and the Gateway Application Dominique Guinard 18.03.2008 Gateway Application Spatial Condition Toolkit (SCT) Condition Condition fulfilled fulfilled drag-and-drop / press button Condition Condition Action Show Gateway Service scanning mode conditional mode drag-and-drop / press button Show Gateway Service requests user

Video: Youtube for « RelateGateways » Dominique Guinard 18.03.2008

Today’s Menu Motivation Spatial Condition Toolkit Gateway Application User Study Conclusion Dominique Guinard 18.03.2008

Motivation

Spatial Condition Toolkit

Gateway Application

User Study

Conclusion

Formative User Study Test run in Lancaster, formative User Study in Munich, total of 20 users. 3 services in a large office. 3 different triggering conditions: Moving towards the printer. Oriented towards the display. Very close to the keyboard. Testing the application both in scanning and conditional modes. Dominique Guinard 18.03.2008

Test run in Lancaster, formative User Study in Munich, total of 20 users.

3 services in a large office.

3 different triggering conditions:

Moving towards the printer.

Oriented towards the display.

Very close to the keyboard.

Testing the application both in scanning and conditional modes.

Qualitative Results: Percieved Benefits Dominique Guinard 18.03.2008

Qualitative Results: Comparing the Two Modes Dominique Guinard 18.03.2008

Qualtitative Results: Usage Dominique Guinard 18.03.2008

Today’s Menu Motivation Spatial Condition Toolkit Gateway Application User Study Conclusion Dominique Guinard 18.03.2008

Motivation

Spatial Condition Toolkit

Gateway Application

User Study

Conclusion

Conclusion There is an (obvious) need for service discovery based on spatial context: It reflects our way of organizing and discovering our environment. The Spatial Condition Toolkit provides a software architecture to create applications based on spatial context: Conditions(rules)-based trigger. The Gateway application was used to test the toolkit and evaluate the need for such applications: Especially useful in unknown places. There is a need for a comparative user study, comparing the gateways technique with other, list-based, discovery systems (e.g. bluetooth, Jini, DPWS, etc.). Dominique Guinard 18.03.2008

There is an (obvious) need for service discovery based on spatial context:

It reflects our way of organizing and discovering our environment.

The Spatial Condition Toolkit provides a software architecture to create applications based on spatial context:

Conditions(rules)-based trigger.

The Gateway application was used to test the toolkit and evaluate the need for such applications:

Especially useful in unknown places.

There is a need for a comparative user study, comparing the gateways technique with other, list-based, discovery systems (e.g. bluetooth, Jini, DPWS, etc.).

Thanks for your attention! Dominique Guinard 18.03.2008 Project’s homepage: http://ubicomp.lancs.ac.uk/relategateways Contact: dominique.guinard@sap.com

BACKUP Dominique Guinard 18.03.2008

Underlying Sensor Network Dominique Guinard 18.03.2008

Quantitative Results: Comparing the Devices. Dominique Guinard 18.03.2008

Automatic Triggering of Local Services Dominique Guinard 18.03.2008 Solution Inform the user about available local services in a way that is not disturbing Let the user decide when to trigger a service with a few mouse clicks Problem Triggering services without the user requesting it can be disturbing same screen content as before the spatial criteria were fulfilled local services you printer display print what‘s on your PDA print document scan document fax document show screen shot of your PDA start slide show 2) By pressing the button, a map of the local environment and services are shown 1) When the conditions are fulfilled, a small button appears on the screen, which indicates that local services are available Idea I: Maps and Menus same screen content as before the spatial criteria were fulfilled printer display Gateways represent a co-located device. The user can interact with the device by clicking on the gateway or using drag-and-drop Idea II: Gateways

Inform the user about available local services in a way that is not disturbing

Let the user decide when to trigger a service with a few mouse clicks

print what‘s on your PDA

print document

scan document

fax document

show screen shot of your PDA

start slide show

The Gateways Widgets as access points to the services: Gateways. Visual discovery of services: Mapping the user’s view of his environment on the mobile desktop. Dominique Guinard 18.03.2008

Widgets as access points to the services:

Gateways.

Visual discovery of services:

Mapping the user’s view of his environment on the mobile desktop.