RelateGateways An Architecture to Enable Spontaneous Mobile Spatial Interaction with Pervasive Services Master Thesis, Dom...
Context <ul><li>Lancaster, Northern UK: </li></ul><ul><ul><li>Pop: 30’000  </li></ul></ul><ul><ul><li>(100’000 when includ...
Today’s Menu… <ul><li>Introduction, Aim </li></ul><ul><li>E2ESD Model </li></ul><ul><ul><li>Spatial Discovery </li></ul></...
Introduction: Bob’s Adventure <ul><li>Bob, researcher in biology at Unifr talk at Lancs. </li></ul><ul><li>Bob needs to pr...
Introduction: Bob’s Adventure <ul><li>Bob finds someone who knows someone who met someone who knows where the printer is l...
Introduction: Bob’s Adventure <ul><li>Bob now needs: </li></ul><ul><ul><li>To find the printer’s drivers. </li></ul></ul><...
Introduction: Summary <ul><li>Mobile users can benefit from access to pervasive services. </li></ul><ul><li>Network and se...
Aim <ul><li>Using the mobile device to: </li></ul><ul><ul><li>Identify  services available in the user’s immediate environ...
Today’s Menu… <ul><li>Introduction, Aim </li></ul><ul><li>E2ESD Model </li></ul><ul><ul><li>Spatial Discovery </li></ul></...
End-to-End Service  Discovery Model (E2ESD)  / 35 E2ESD Model
Layer 1: Spatial Discovery  / 35
Gateways User Interface <ul><li>Widgets as access points to the services: </li></ul><ul><ul><li>Gateways. </li></ul></ul><...
Implementation <ul><li>Small Java Swing windows representing the service providers. </li></ul><ul><li>At the screen periph...
Spatial Context <ul><li>Spatial context initialy delivered to the mobile client by a Wizard of Oz interface. </li></ul><ul...
Spatial Context: Deployement <ul><li>To provide the user interface with spatial context we need: </li></ul><ul><ul><li>A U...
Video Demonstration  / 35
Layer 2: Network & Service Discovery  / 35
Extending Relate: Before  / 35 Network Discovery
Extending Relate: After  / 35 Network Discovery
Layer 3: Invocation and Interoperability  / 35 Interoperability
Modeling the Services <ul><li>A service is composed of: </li></ul><ul><ul><li>A ServiceProvider, enclosing the service log...
« Plug and Play » Invocation <ul><li>The semantics of Pull-and-Push Services is  unknown  to the mobile client before disc...
Cross-Device Interactions  <ul><li>Using the  computing power  as a service. </li></ul><ul><li>Use-cases: </li></ul><ul><u...
Today’s Menu… <ul><li>Introduction, Aim </li></ul><ul><li>E2ESD Model </li></ul><ul><ul><li>Spatial Discovery </li></ul></...
Settings <ul><li>Test run in Lancaster, formative user study in Munich. </li></ul><ul><li>Total of 20 users. </li></ul><ul...
Qualitative Results <ul><li>Most cited benefits: </li></ul><ul><ul><li>No installation, no configuration: saves time. </li...
Today’s Menu… <ul><li>Introduction, Aim </li></ul><ul><li>E2ESD Model </li></ul><ul><ul><li>Spatial Discovery </li></ul></...
Bootstraping Spontaneous Mobile Spatial Interactions <ul><li>Implementation of the E2ESD bundled into a single, runnable a...
Quantitative Outputs <ul><li>Dissemination </li></ul><ul><ul><li>3 accepted workshop papers: </li></ul></ul><ul><ul><ul><l...
Open Questions <ul><li>Scalability of the application: </li></ul><ul><ul><li>In terms of user interface. </li></ul></ul><u...
Questions ? <ul><li>Thanks for your attention…. </li></ul><ul><li>Project’s homepage:  http://ubicomp.lancs.ac.uk/relatega...
Upcoming SlideShare
Loading in …5
×

An Architecture to Enable Spontaneous Mobile Spatial Interaction with Pervasive Services

1,162 views
1,096 views

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,162
On SlideShare
0
From Embeds
0
Number of Embeds
21
Actions
Shares
0
Downloads
21
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • ~ 20 slides for 20 minutes (+ 5 min for questions).
  • An Architecture to Enable Spontaneous Mobile Spatial Interaction with Pervasive Services

    1. 1. RelateGateways An Architecture to Enable Spontaneous Mobile Spatial Interaction with Pervasive Services Master Thesis, Dominique Guinard, Fribourg 2007 Supervisors: Hans Gellersen, Denis Lalanne, Rolf Ingold.
    2. 2. Context <ul><li>Lancaster, Northern UK: </li></ul><ul><ul><li>Pop: 30’000 </li></ul></ul><ul><ul><li>(100’000 when including the sheeps). </li></ul></ul><ul><li>Infolab 21: </li></ul><ul><ul><li>250 IT researchers. </li></ul></ul><ul><ul><li>Ubicomp Group. </li></ul></ul> / 35
    3. 3. Today’s Menu… <ul><li>Introduction, Aim </li></ul><ul><li>E2ESD Model </li></ul><ul><ul><li>Spatial Discovery </li></ul></ul><ul><ul><li>Video </li></ul></ul><ul><ul><li>Network and Service Discovery </li></ul></ul><ul><ul><li>Invocation and Interoperability </li></ul></ul><ul><ul><ul><li>Cross-device Interactions </li></ul></ul></ul><ul><li>Evaluation </li></ul><ul><li>Conclusion </li></ul> / 35
    4. 4. Introduction: Bob’s Adventure <ul><li>Bob, researcher in biology at Unifr talk at Lancs. </li></ul><ul><li>Bob needs to print his presentation. </li></ul><ul><li>W here is the printer? </li></ul> / 35 ? T - 30 minutes
    5. 5. Introduction: Bob’s Adventure <ul><li>Bob finds someone who knows someone who met someone who knows where the printer is located! </li></ul><ul><li>Hem, Bob feels less cool. </li></ul> / 35 ? T - 10 minutes
    6. 6. Introduction: Bob’s Adventure <ul><li>Bob now needs: </li></ul><ul><ul><li>To find the printer’s drivers. </li></ul></ul><ul><ul><li>Install the printer. </li></ul></ul><ul><ul><li>Get the right to access it. </li></ul></ul><ul><ul><li>Find out about the printer’s properties and accepted formats. </li></ul></ul><ul><ul><li>Etc… </li></ul></ul><ul><ul><li>… print the document! </li></ul></ul><ul><li>Arg, Bob doesn’t feel cool anymore! </li></ul> / 35 T - 30 seconds
    7. 7. Introduction: Summary <ul><li>Mobile users can benefit from access to pervasive services. </li></ul><ul><li>Network and service discovery technologies facilitate spontaneous connections. </li></ul><ul><li>However, these approaches are not user centric: </li></ul><ul><ul><li>Difficult for users to identify services; </li></ul></ul><ul><ul><li>Lack of simple and natural interaction techniques: </li></ul></ul><ul><ul><li>=> Lack of spontaneity in interaction… </li></ul></ul> / 35 Introduction
    8. 8. Aim <ul><li>Using the mobile device to: </li></ul><ul><ul><li>Identify services available in the user’s immediate environment. </li></ul></ul><ul><ul><li>Consume the services in a natural and standard manner. </li></ul></ul><ul><li>Need to: </li></ul><ul><ul><li>Include users in the discovery process. </li></ul></ul><ul><ul><li>Address identification, discovery and invocation. </li></ul></ul> / 35 Introduction
    9. 9. Today’s Menu… <ul><li>Introduction, Aim </li></ul><ul><li>E2ESD Model </li></ul><ul><ul><li>Spatial Discovery </li></ul></ul><ul><ul><li>Video </li></ul></ul><ul><ul><li>Network and Service Discovery </li></ul></ul><ul><ul><li>Invocation and Interoperability </li></ul></ul><ul><ul><ul><li>Cross-device Interactions </li></ul></ul></ul><ul><li>Evaluation </li></ul><ul><li>Conclusion </li></ul> / 35
    10. 10. End-to-End Service Discovery Model (E2ESD) / 35 E2ESD Model
    11. 11. Layer 1: Spatial Discovery / 35
    12. 12. Gateways User Interface <ul><li>Widgets as access points to the services: </li></ul><ul><ul><li>Gateways. </li></ul></ul><ul><li>Users visually discover the services: </li></ul><ul><ul><li>Mapping the user’s view of his environment on the mobile desktop. </li></ul></ul><ul><ul><li>UI as a compass. </li></ul></ul> / 35 Spatial Discovery
    13. 13. Implementation <ul><li>Small Java Swing windows representing the service providers. </li></ul><ul><li>At the screen periphery, integrated to the desktop. </li></ul><ul><li>Two interaction modes: </li></ul><ul><ul><li>Drag-and-Drop. </li></ul></ul><ul><ul><li>Click. </li></ul></ul> / 35 Spatial Discovery
    14. 14. Spatial Context <ul><li>Spatial context initialy delivered to the mobile client by a Wizard of Oz interface. </li></ul><ul><li>Introducing Relate: </li></ul><ul><ul><li>EU-founded project. </li></ul></ul><ul><ul><li>Ad-hoc sensor network. </li></ul></ul><ul><ul><li>Providing relative positioning. </li></ul></ul><ul><li>Achieved: first extend to provide real-time positioning data to the compass UI. </li></ul> / 35 Spatial Discovery
    15. 15. Spatial Context: Deployement <ul><li>To provide the user interface with spatial context we need: </li></ul><ul><ul><li>A USB Dongle/Brick on the mobile device. </li></ul></ul><ul><ul><li>An autonomous Dot on each service provider. </li></ul></ul> / 35 Spatial Discovery
    16. 16. Video Demonstration / 35
    17. 17. Layer 2: Network & Service Discovery / 35
    18. 18. Extending Relate: Before / 35 Network Discovery
    19. 19. Extending Relate: After / 35 Network Discovery
    20. 20. Layer 3: Invocation and Interoperability / 35 Interoperability
    21. 21. Modeling the Services <ul><li>A service is composed of: </li></ul><ul><ul><li>A ServiceProvider, enclosing the service logic. </li></ul></ul><ul><ul><li>A ServiceRequester containing enough information to invoke the service. </li></ul></ul><ul><li>2 types of services: </li></ul><ul><ul><li>Push service (can be invoked using a Universal Requester). </li></ul></ul><ul><ul><li>Pull-and-Push service. </li></ul></ul> / 35 Interoperability
    22. 22. « Plug and Play » Invocation <ul><li>The semantics of Pull-and-Push Services is unknown to the mobile client before discovery. </li></ul><ul><li>Packets of Mobile Code (ServiceRequesters, descriptions, icon, etc.) are downloaded and dynamically loaded on the mobile device. </li></ul> / 35 Interoperability
    23. 23. Cross-Device Interactions <ul><li>Using the computing power as a service. </li></ul><ul><li>Use-cases: </li></ul><ul><ul><li>Collaborative tasks </li></ul></ul><ul><ul><li>Cross-device interactions for single user. </li></ul></ul><ul><li>Extending the EBL toolkit: </li></ul><ul><ul><li>Cooperation with UCL (Université Catholique de Louvain la Neuve, HCI Lab). </li></ul></ul> / 35 Interoperability
    24. 24. Today’s Menu… <ul><li>Introduction, Aim </li></ul><ul><li>E2ESD Model </li></ul><ul><ul><li>Spatial Discovery </li></ul></ul><ul><ul><li>Video </li></ul></ul><ul><ul><li>Network and Service Discovery </li></ul></ul><ul><ul><li>Invocation and Interoperability </li></ul></ul><ul><ul><ul><li>Cross-device Interactions </li></ul></ul></ul><ul><li>Evaluation </li></ul><ul><li>Conclusion </li></ul> / 35
    25. 25. Settings <ul><li>Test run in Lancaster, formative user study in Munich. </li></ul><ul><li>Total of 20 users. </li></ul><ul><li>3 “service enabled” devices within a large office. </li></ul> / 35 Evaluation
    26. 26. Qualitative Results <ul><li>Most cited benefits: </li></ul><ul><ul><li>No installation, no configuration: saves time. </li></ul></ul><ul><ul><li>Ease of interaction with the services: drag and drop. </li></ul></ul><ul><ul><li>Dynamic spatial arrangement of the gateways: making the UI more natural, especially useful in unknown places. </li></ul></ul><ul><li>Suggested a number of UI improvements. And services to implement. </li></ul> / 35 Evaluation
    27. 27. Today’s Menu… <ul><li>Introduction, Aim </li></ul><ul><li>E2ESD Model </li></ul><ul><ul><li>Spatial Discovery </li></ul></ul><ul><ul><li>Video </li></ul></ul><ul><ul><li>Network and Service Discovery </li></ul></ul><ul><ul><li>Invocation and Interoperability </li></ul></ul><ul><ul><ul><li>Cross-device Interactions </li></ul></ul></ul><ul><li>Evaluation </li></ul><ul><li>Conclusion </li></ul> / 35
    28. 28. Bootstraping Spontaneous Mobile Spatial Interactions <ul><li>Implementation of the E2ESD bundled into a single, runnable application offering: </li></ul><ul><ul><li>A spatial user interface « toolkit » (MVC based + contextual rules-engine). </li></ul></ul><ul><ul><li>A Network and Service Discovery system. </li></ul></ul><ul><ul><li>An Invocation and Interoperability system. </li></ul></ul><ul><ul><li>An architecture for prototyping pervasive services. </li></ul></ul><ul><ul><li>Various simulation and debugging tools. </li></ul></ul><ul><li>A framework (SOA) supporting the rapid prototyping of mobile spatial interactions. </li></ul> / 35 Conclusion
    29. 29. Quantitative Outputs <ul><li>Dissemination </li></ul><ul><ul><li>3 accepted workshop papers: </li></ul></ul><ul><ul><ul><li>MSI @ CHI 07, Permid @ Pervasive 07, SensorNet 07 </li></ul></ul></ul><ul><ul><li>2 conference papers submited </li></ul></ul><ul><ul><ul><li>Ubicomp 07 (Demo Paper), LoCA 07 </li></ul></ul></ul><ul><li>Prototyping Framework: </li></ul><ul><ul><ul><li>~16’000 lines of code. </li></ul></ul></ul><ul><ul><ul><li>~160 classes (to consolidate!). </li></ul></ul></ul><ul><ul><ul><li>To few hours of sleep… </li></ul></ul></ul> / 35 Conclusion
    30. 30. Open Questions <ul><li>Scalability of the application: </li></ul><ul><ul><li>In terms of user interface. </li></ul></ul><ul><ul><li>In terms of prototyping framework. </li></ul></ul><ul><li>User study is formative: </li></ul><ul><ul><li>Need for a comparative study as well. </li></ul></ul><ul><ul><li>Need to evaluate the framework and its use for the prototyping of mobile spatial applications. </li></ul></ul><ul><li>Security concerns: </li></ul><ul><ul><li>Spontaneity is nice but it leaves a number of doors open for attackers. </li></ul></ul> / 35 Conclusion
    31. 31. Questions ? <ul><li>Thanks for your attention…. </li></ul><ul><li>Project’s homepage: http://ubicomp.lancs.ac.uk/relategateways </li></ul><ul><li>Contact: [email_address] </li></ul> / 35 Conclusion

    ×