Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Towards User-defined Cross-Device Interaction


Published on

Over the last decade we have seen various research on distributed user interfaces (DUIs). We provide an overview of existing DUI approaches and classify the di fferent solutions based on the granularity of the distributed UI components, location constraints as well as their support for the distribution of state. We propose an approach for user-defi ned cross-device interaction where users can author their customised user interfaces based on a hypermedia metamodel and the concept of
active components. Furthermore, we discuss the confi guration and sharing of customised distributed user interfaces by end users where the focus is on an authoring rather than programming approach

Published in: Engineering
  • Be the first to comment

Towards User-defined Cross-Device Interaction

  1. 1. Towards User-defined Cross-Device Interaction AUDREY SANCTORUM & BEAT SIGNER VRIJE UNIVERSITEIT BRUSSEL
  2. 2. 0% 5% 10% 15% 20% 25% 30% 0 1 2 3 4 5 or more Percentage of users Numberofdevices How many connected devices do people use? Belgium Switzerland USA Spain Japan The Connected Consumer Survey 2014/2015 Google Inc. 65%
  3. 3. Conductor (2014) HuddleLamp (2014) Connichiwa (2015)Panelrama (2014)MultiSpace (2006) ReticularSpaces (2012)
  4. 4. Existing Classifications "The 4C Reference Model for Distributed User Interfaces" by Demeure et al. • computation, configuration, communication and coordination "Distributed User Interfaces: State of the Art" by Niklas Elmqvist • input, output, platform, space and time
  5. 5. UI + data + UI elements UI + data Table / Camera Room Network connection to the server Anywhere HuddleLamp MultiSpace ReticularSpaces Panelrama Conductor Connichiwa Granularity of distribution Location constraint
  6. 6. UI + data + UI elements UI + data Table / Camera Room Network connection to the server Anywhere HuddleLamp Airlift MultiSpace ReticularSpaces ARIS GroupTogether iLand iRoom Panelrama Conductor IMPROMPTU THAW Deep Shot Weave Connichiwa XDStudio WebSplitter Melchior et al. (2009) CAMELEON-RT Granularity of distribution Location constraint Robertson et al. (1996) Frosini et al. (2013)MultiMasher Pick-and-Drop End Users
  7. 7. How to allow end users to define customised cross-device interactions? How much control will end users have in terms of the granularity of the UI components to be distributed? Will end users be limited by a specific location, space or office setting? Will end users be able to share their configuration of customised DUIs? Can end users reuse parts of other configurations? What will end users be able to modify? …
  8. 8. <?xml version="1.0"encoding="UTF-8"?> <activeComponents> <activeComponent> <identifier>Sound< /identifier> <logic>…</logic> </activeComponent> </activeComponents> Active Component Architecture Active Components Resource/Selector Plug-ins Developer RegistryCore RSL User Profile End-User Registry Configuration Pool User Developer Button 1
  9. 9. Scenarios
  10. 10. Swipe AC Double Swipe AC Triple Swipe AC Direction AC Swipe Area TABLET Sound AC TV Runtime environment Runtime environment ... Gesture AC Play AC Data Transfer AC Data Transfer AC Proposed Approach [28] Signer and Norrie As We May Link: A General Metamodel for Hypermedia Systems.(2007)
  11. 11. Authoring Rather Than Programming Swipe Gesture Device: Tablet Area Device: Tablet DataTransfer SDevice: Tablet TDevice: TV Play Device: TV Sound Device: TV Volume: 80% _ X  Components DataTransfer Play Sound Swipe Area Double Swipe Triple Swipe Direction ...
  12. 12. Conclusion • Classification of DUI systems • User-defined cross-device interactions • Linking UI components and application logic • RSL hypermedia metamodel • Arbitrary level of granularity • Sharing of user-defined interactions
  13. 13. Takeaway Message Hypermedia based DUI development Authoring rather than programming approach
  14. 14. Reference SanctorumA. and Signer B. :Towards User-defined Cross-Device Interaction. In the Workshop on Distributed User Interfaces. Lugano, Switzerland (2016).