Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Dissemination and Evaluation Claudia Roda, Damien Clauzel, Joona Laukkanen
Dissemination: Atgentive book <ul><li>Latest version has been distributed </li></ul><ul><ul><li>Need  feedback  on proposa...
Dissemination: Atgentive Book <ul><li>Timeline: </li></ul><ul><ul><li>First version of each chapter: 15 February 2008 </li...
Evaluation <ul><li>Objective: enable the assessment of the value of the conceptual framework and reasoning module in conte...
Evaluation <ul><li>Conceptual Framework  - Demonstrate that the conceptual framework may hold in the context of very diffe...
Evaluation: Conceptual Framework <ul><li>We look at the context restoration issue.  </li></ul><ul><li>Virtual multi-deskto...
Evaluation: Conceptual Framework <ul><li>Experiment: </li></ul><ul><ul><li>Subjects work for 20 minutes on three fully des...
Task 1: Spreadsheet
Task 2: Translation
Task 3: Video
Interruption
Resume
Evaluation: Reasoning Module <ul><li>Reasoning module  - New version of the test centre:  </li></ul><ul><ul><li>Visualize ...
The test center <ul><li>Tool for experimenting with the RM </li></ul><ul><li>The  test center  was not very intuitive </li...
 
Desktop
<ul><li>Minimal applications on a desktop </li></ul><ul><ul><li>application provides task model, sends events </li></ul></...
<ul><li>Interventions </li></ul>Desktop
User and task properties editable
Reasoning module activity
Utilities for creating environment events: New information available, idle input
<ul><li>EXAMPLE </li></ul>
user has finished intro and is notified about next task (learning goals)..
user starts learning goals (interventions disappear)..
user starts the wrong task, gets interventions suggesting correct subtask.  Math task is also suggested as possible altern...
The applications <ul><li>Pretty much like real applications </li></ul><ul><ul><li>Started from desktop icons.. </li></ul><...
The applications <ul><li>Pretty much like real applications </li></ul><ul><ul><li>Started from desktop icons.. </li></ul><...
The future vision <ul><li>Several applications </li></ul><ul><ul><li>Some applications provide their task model </li></ul>...
Future test center
Future test center
Upcoming SlideShare
Loading in …5
×

Dissemination and Evaluation

776 views

Published on

Strategy for evaluating and communicate the results of the AtGentive project

Published in: Technology, Travel
  • Be the first to comment

  • Be the first to like this

Dissemination and Evaluation

  1. 1. Dissemination and Evaluation Claudia Roda, Damien Clauzel, Joona Laukkanen
  2. 2. Dissemination: Atgentive book <ul><li>Latest version has been distributed </li></ul><ul><ul><li>Need feedback on proposal (5 pages to read!) </li></ul></ul><ul><ul><li>Participation : </li></ul></ul><ul><ul><ul><li>I am listing as committed: Cantoche, OBU, Ontdeknet, and AUP </li></ul></ul></ul><ul><ul><ul><li>Informed but not committed: INSEAD, UTA (I have no description of contribution) </li></ul></ul></ul><ul><ul><ul><li>I had no feedback from: CELN, STC </li></ul></ul></ul><ul><li>Could you please check your bios </li></ul>
  3. 3. Dissemination: Atgentive Book <ul><li>Timeline: </li></ul><ul><ul><li>First version of each chapter: 15 February 2008 </li></ul></ul><ul><ul><li>Feedback from review: 15 March 2008 </li></ul></ul><ul><ul><li>Final formatted version of each chapter 15 April 2008 </li></ul></ul><ul><ul><li>Publication: ?? </li></ul></ul>
  4. 4. Evaluation <ul><li>Objective: enable the assessment of the value of the conceptual framework and reasoning module in contexts that are not represented in the pilots </li></ul><ul><li>Should this go under strategic evaluation? </li></ul>
  5. 5. Evaluation <ul><li>Conceptual Framework - Demonstrate that the conceptual framework may hold in the context of very different implementations and applications. </li></ul><ul><li>Reasoning module - New version of the test centre: </li></ul><ul><ul><li>Visualize the reasoning of the reasoning module in applications such as Ontdeknet </li></ul></ul><ul><ul><li>Show how the reasoning module can be used also in less structured, non-task-based applications, and in the context of several (rather than one) applications. </li></ul></ul>
  6. 6. Evaluation: Conceptual Framework <ul><li>We look at the context restoration issue. </li></ul><ul><li>Virtual multi-desktop interface as an implementation of context-restoration facility </li></ul><ul><li>We hope to demonstrate that context restore will enhance both performance and user satisfaction </li></ul><ul><li>Hypotheses (Virtual multi-desktop interface vs Control): </li></ul><ul><ul><li>Increased perception of productivity and pleasure </li></ul></ul><ul><ul><li>Tasks are completed faster and better </li></ul></ul><ul><ul><li>Tasks are resumed faster and more easily </li></ul></ul><ul><ul><li>Fewer interface management actions and fewer mistakes on interface management actions </li></ul></ul>
  7. 7. Evaluation: Conceptual Framework <ul><li>Experiment: </li></ul><ul><ul><li>Subjects work for 20 minutes on three fully described tasks (spreadsheet based, translation, video). </li></ul></ul><ul><ul><li>They are interrupted regularly by requests to work at a different task, they are required to satisfy these requests </li></ul></ul><ul><ul><li>Control group (standard window interface), experimental group (virtual multi-desktop) </li></ul></ul><ul><li>Measures: </li></ul><ul><ul><li>Task completion level </li></ul></ul><ul><ul><li>Task quality level (# of errors) </li></ul></ul><ul><ul><li>Task resumption times </li></ul></ul><ul><ul><li>Reported evaluation </li></ul></ul>
  8. 8. Task 1: Spreadsheet
  9. 9. Task 2: Translation
  10. 10. Task 3: Video
  11. 11. Interruption
  12. 12. Resume
  13. 13. Evaluation: Reasoning Module <ul><li>Reasoning module - New version of the test centre: </li></ul><ul><ul><li>Visualize the reasoning of the reasoning module in applications such as Ontdeknet </li></ul></ul><ul><ul><li>Show how the reasoning module can be used also in less structured, non-task-based applications, and in the context of several (rather than one) applications. </li></ul></ul>
  14. 14. The test center <ul><li>Tool for experimenting with the RM </li></ul><ul><li>The test center was not very intuitive </li></ul><ul><li>Desire to experiment with the future vision of the RM (still working on) </li></ul>
  15. 16. Desktop
  16. 17. <ul><li>Minimal applications on a desktop </li></ul><ul><ul><li>application provides task model, sends events </li></ul></ul><ul><ul><li>interact with the application instead of creating events </li></ul></ul>Desktop
  17. 18. <ul><li>Interventions </li></ul>Desktop
  18. 19. User and task properties editable
  19. 20. Reasoning module activity
  20. 21. Utilities for creating environment events: New information available, idle input
  21. 22. <ul><li>EXAMPLE </li></ul>
  22. 23. user has finished intro and is notified about next task (learning goals)..
  23. 24. user starts learning goals (interventions disappear)..
  24. 25. user starts the wrong task, gets interventions suggesting correct subtask. Math task is also suggested as possible alternative task ..
  25. 26. The applications <ul><li>Pretty much like real applications </li></ul><ul><ul><li>Started from desktop icons.. </li></ul></ul><ul><li>Known task model </li></ul><ul><li>For now just one application (AtGentSchool) </li></ul><ul><li>Displays interventions allowing.. </li></ul><ul><ul><li>to start suggested task </li></ul></ul><ul><ul><li>In the future to provide feedback on the suggestions </li></ul></ul>
  26. 27. The applications <ul><li>Pretty much like real applications </li></ul><ul><ul><li>Started from desktop icons.. </li></ul></ul><ul><li>Known task model </li></ul><ul><li>For now just one application (AtGentSchool) </li></ul><ul><li>Displays interventions allowing.. </li></ul><ul><ul><li>to start suggested task </li></ul></ul><ul><ul><li>In the future to provide feedback on the suggestions </li></ul></ul>
  27. 28. The future vision <ul><li>Several applications </li></ul><ul><ul><li>Some applications provide their task model </li></ul></ul><ul><ul><li>Applications may be very different from what we have seen so far </li></ul></ul><ul><li>Task management side bar </li></ul>
  28. 29. Future test center
  29. 30. Future test center

×