Distributed User Interfaces in Space and Time<br />Jérémie MelchiorUniversité catholique de Louvain<br />Doctoral Consorti...
It beginswith…<br />Motivations<br />Drawbacks of Related Work<br />Ideas for solutions<br />Implementation<br />Case Stud...
Motivations<br />Mobile devices (iPad, iPhone,...)<br />Smartphones are popular<br />Focus of researchers for distribution...
Drawbacks of Related Work<br />No publicly released toolkit<br />Limited support for multi-platform<br />Lack of customiza...
Drawbacks of Related Work<br />Predefined distribution<br />ITEA UsiXML project #08026, 2009-2012<br />5<br />
Ideas for solutions<br />Unification of the techniques (toolkit)<br />Model-based approach defining the distribution<br />...
Implementation<br />Issues:<br />distribution mechanisms <br />centralized VS decentralized<br />control of the behavior<b...
Concepts<br />Under-lying concepts:<br />Distribution primitives<br />Distribution scenario<br />Distribution graph<br />E...
Concepts 1/8<br />Distribution primitives<br />4 categories : <br />simple primitives (widget in container)<br />basic pri...
Concepts 1/8<br />Distribution primitives<br />Simple Primitives<br />Set, Display, Undisplay, Expose (display without con...
Concepts 2/8<br />Distribution scenario<br />To apply several primitives sequentially<br />Small example of scenario:<br /...
Concepts 2/8<br />Distribution scenario<br />{Undisplaycreate_game#p1}<br />{Update status "Running game: "#Name}<br />ITE...
Concepts 2/8<br />Distribution scenario<br />{Display td(name:observer lr(...) lr(...) lr(...))#p1}<br />{Display td(name:...
Concepts 2/8<br />Distribution scenario<br />{Undisplay create_game#p1}<br />{Update status "Running game: "#Name}<br />{D...
Concepts 3/8<br />Distribution graph<br />Platforms involved in the system<br />CUI model associated to the laptop<br />IT...
Concepts 4/8<br />EBNF grammar + language<br />statement = operation , source , ”TO” , target ;<br />operation = "SET" | "...
Concepts 5/8<br />3 models:<br />CUI model<br />Platform model<br />User and environment model<br />ITEA UsiXML project #0...
Concepts 5/8<br />3 models:<br />CUI model (rendering)<br />ITEA UsiXML project #08026, 2009-2012<br />18<br />
Concepts 5/8<br />3 models: <br />Platform model<br />ITEA UsiXML project #08026, 2009-2012<br />19<br />
Concepts 5/8<br />3 models:<br />User and environment model<br />Description of the user: U = (Pi, Vi)<br />through proper...
Concepts 6,7,8/8<br />Under-lying concepts:<br />A catalogue of primitives<br />Multi-platform environment:<br />Android, ...
Case Studies<br />DeTransDraw<br />Decentralized, Transactional Drawing tool<br />Pictionary<br />a distributed pictionary...
Validation<br />Small end-user survey on Distribution primitives (done)<br />Big survey on Distribution primitives (planne...
Contributions<br />Conceptual:<br />Distribution primitives<br />Distribution scenario <br />Distribution graph<br />EBNF ...
Future Work and Conclusion<br />Finalization and publication of the catalog<br />Finalization and release of preliminary v...
Future Work and Conclusion<br />Finalization and publication of the catalog<br />Finalization and release of preliminary v...
User-Task-Display-Environment<br />ITEA UsiXML project #08026, 2009-2012<br />27<br />
Upcoming SlideShare
Loading in …5
×

Distributed User Interfaces in Space and Time

0 views
1,356 views

Published on

A Mo

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
0
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
11
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Distributed User Interfaces in Space and Time

  1. 1. Distributed User Interfaces in Space and Time<br />Jérémie MelchiorUniversité catholique de Louvain<br />Doctoral Consortium at EICS2011<br />
  2. 2. It beginswith…<br />Motivations<br />Drawbacks of Related Work<br />Ideas for solutions<br />Implementation<br />Case Studies (3)<br />Validation<br />Future Work and Conclusion<br />ITEA UsiXML project #08026, 2009-2012<br />2<br />
  3. 3. Motivations<br />Mobile devices (iPad, iPhone,...)<br />Smartphones are popular<br />Focus of researchers for distribution<br />Limitations of the user's space<br />Independence between the UI and the application<br />ITEA UsiXML project #08026, 2009-2012<br />3<br />
  4. 4. Drawbacks of Related Work<br />No publicly released toolkit<br />Limited support for multi-platform<br />Lack of customization<br />Closely connected devices (often in the same room)<br />Predefined distribution<br />Lack of real-time distribution, reusability, modeling, feedback and control<br />ITEA UsiXML project #08026, 2009-2012<br />4<br />
  5. 5. Drawbacks of Related Work<br />Predefined distribution<br />ITEA UsiXML project #08026, 2009-2012<br />5<br />
  6. 6. Ideas for solutions<br />Unification of the techniques (toolkit)<br />Model-based approach defining the distribution<br />Open language supporting the distribution<br />Real-time feedbacks for local and global distribution and interaction<br />Real-time controlon every single component of the UI<br />Distribution of a whole, a part or a custom group of widgets<br />Multi-platform support (computer + tablets + smartphones)<br />ITEA UsiXML project #08026, 2009-2012<br />6<br />
  7. 7. Implementation<br />Issues:<br />distribution mechanisms <br />centralized VS decentralized<br />control of the behavior<br />distribution of the UI<br />UI and behavior<br />UI and a new behavior<br />communication <br />through messages<br />through a DHT <br />multi-platform support<br />ITEA UsiXML project #08026, 2009-2012<br />7<br />
  8. 8. Concepts<br />Under-lying concepts:<br />Distribution primitives<br />Distribution scenario<br />Distribution graph<br />EBNF grammar + language<br />3 Models: CUI, Platform and, User and Environment<br />A catalogue of primitives<br />Multi-platform environment (e.g. Android)<br />Selectors mechanism (universal, type, class and id)<br />ITEA UsiXML project #08026, 2009-2012<br />8<br />
  9. 9. Concepts 1/8<br />Distribution primitives<br />4 categories : <br />simple primitives (widget in container)<br />basic primitives (reshuffle the widget)<br />advanced primitives (widgets)<br />management primitives (complex system)<br />ITEA UsiXML project #08026, 2009-2012<br />9<br />
  10. 10. Concepts 1/8<br />Distribution primitives<br />Simple Primitives<br />Set, Display, Undisplay, Expose (display without control)<br />Basic Primitives<br />Copy, Move, Switch, Permute (in both directions)<br />Advanced Primitives<br />Merge / Separate, Replace, Distribute / Reset,Append (merge in FIFO order), Transform<br />Management Primitives<br />Save, Restore (UNDO-REDO), Import/Export<br />ITEA UsiXML project #08026, 2009-2012<br />10<br />
  11. 11. Concepts 2/8<br />Distribution scenario<br />To apply several primitives sequentially<br />Small example of scenario:<br />{Undisplaycreate_game#p1}<br />{Updatestatus "Running game: "#Name}<br />{Display td(name:observer lr(...) lr(...) lr(...))#p1}<br />{Display td(name:p1create_gameobserverstatus)}<br />ITEA UsiXML project #08026, 2009-2012<br />11<br />
  12. 12. Concepts 2/8<br />Distribution scenario<br />{Undisplaycreate_game#p1}<br />{Update status "Running game: "#Name}<br />ITEA UsiXML project #08026, 2009-2012<br />12<br />
  13. 13. Concepts 2/8<br />Distribution scenario<br />{Display td(name:observer lr(...) lr(...) lr(...))#p1}<br />{Display td(name:p1 create_game observer status)}<br />ITEA UsiXML project #08026, 2009-2012<br />13<br />
  14. 14. Concepts 2/8<br />Distribution scenario<br />{Undisplay create_game#p1}<br />{Update status "Running game: "#Name}<br />{Display td(name:observer lr(...) lr(...) lr(...))#p1}<br />{Display td(name:p1 create_game observer status)}<br />ITEA UsiXML project #08026, 2009-2012<br />14<br />
  15. 15. Concepts 3/8<br />Distribution graph<br />Platforms involved in the system<br />CUI model associated to the laptop<br />ITEA UsiXML project #08026, 2009-2012<br />15<br />
  16. 16. Concepts 4/8<br />EBNF grammar + language<br />statement = operation , source , ”TO” , target ;<br />operation = "SET" | "DISPLAY" | "UNDISPLAY" | "COPY" | "MOVE" | "REPLACE" | "TRANSFORM" | "MERGE" | "SWITCH" | "SEPARATE" | "DISTRIBUTE";<br />source = selector ;<br />target = displays | selector , “ON” , displays ;<br />displays = display_platform , { “,” , display_platform}<br />display_platform = display , [ “OF” , platform] ;<br />selector = identifier , { “,” , identifier } | universal ;<br />display = identifier ;<br />platform = identifier ;<br />ITEA UsiXML project #08026, 2009-2012<br />16<br />
  17. 17. Concepts 5/8<br />3 models:<br />CUI model<br />Platform model<br />User and environment model<br />ITEA UsiXML project #08026, 2009-2012<br />17<br />
  18. 18. Concepts 5/8<br />3 models:<br />CUI model (rendering)<br />ITEA UsiXML project #08026, 2009-2012<br />18<br />
  19. 19. Concepts 5/8<br />3 models: <br />Platform model<br />ITEA UsiXML project #08026, 2009-2012<br />19<br />
  20. 20. Concepts 5/8<br />3 models:<br />User and environment model<br />Description of the user: U = (Pi, Vi)<br />through properties (Pi)<br />and values (Vi)<br />Description of the environment: E = (Pi, Vi)<br />through properties (Pi)<br />and values (Vi)<br />ITEA UsiXML project #08026, 2009-2012<br />20<br />
  21. 21. Concepts 6,7,8/8<br />Under-lying concepts:<br />A catalogue of primitives<br />Multi-platform environment:<br />Android, Windows, Linux, iOS and Mac OS X<br />Selectorsmechanism<br />universal: to all UI elements<br />type: to all UI elements corresponding to the type<br />class: to all UI elements belonging to the class<br />id: to the only UI elements corresponding to the id<br />ITEA UsiXML project #08026, 2009-2012<br />21<br />
  22. 22. Case Studies<br />DeTransDraw<br />Decentralized, Transactional Drawing tool<br />Pictionary<br />a distributed pictionary<br />Game of the Goose<br />an evolutive game through real-time redistribution <br />Each square is a game<br />Game is a DUI that automatically distributes itself to the right players<br />The board can be controlled in real-time in order to remove, add, change games.<br />ITEA UsiXML project #08026, 2009-2012<br />22<br />
  23. 23. Validation<br />Small end-user survey on Distribution primitives (done)<br />Big survey on Distribution primitives (planned)<br />Survey on reactivity of the feedbacks<br />Real world experiences<br />ITEA UsiXML project #08026, 2009-2012<br />23<br />
  24. 24. Contributions<br />Conceptual:<br />Distribution primitives<br />Distribution scenario <br />Distribution graph<br />EBNF grammar + language<br />Methodological:<br />CUI, Platform and, User and Environment models<br />A catalogue of primitives<br />Tool:<br />Development of JayTkbased on EBL and Qtk<br />UsiDistribisincluded in UsiXML language<br />ITEA UsiXML project #08026, 2009-2012<br />24<br />
  25. 25. Future Work and Conclusion<br />Finalization and publication of the catalog<br />Finalization and release of preliminary versions of the toolkit<br />Validation as cited in the previous slide<br />Combination with cloud computing power<br />ITEA UsiXML project #08026, 2009-2012<br />25<br />
  26. 26. Future Work and Conclusion<br />Finalization and publication of the catalog<br />Finalization and release of preliminary versions of the toolkit<br />Validation as cited in the previous slide<br />Combination with cloud computing power<br />ITEA UsiXML project #08026, 2009-2012<br />26<br />QUESTIONS ???<br />
  27. 27. User-Task-Display-Environment<br />ITEA UsiXML project #08026, 2009-2012<br />27<br />

×