Dissemination and Evaluation

711 views
647 views

Published on

Strategy for evaluating and communicate the results of the AtGentive project

Published in: Technology, Travel
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
711
On SlideShare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
8
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Dissemination and Evaluation

    1. 1. Dissemination and Evaluation Claudia Roda, Damien Clauzel, Joona Laukkanen
    2. 2. Dissemination: Atgentive book <ul><li>Latest version has been distributed </li></ul><ul><ul><li>Need feedback on proposal (5 pages to read!) </li></ul></ul><ul><ul><li>Participation : </li></ul></ul><ul><ul><ul><li>I am listing as committed: Cantoche, OBU, Ontdeknet, and AUP </li></ul></ul></ul><ul><ul><ul><li>Informed but not committed: INSEAD, UTA (I have no description of contribution) </li></ul></ul></ul><ul><ul><ul><li>I had no feedback from: CELN, STC </li></ul></ul></ul><ul><li>Could you please check your bios </li></ul>
    3. 3. Dissemination: Atgentive Book <ul><li>Timeline: </li></ul><ul><ul><li>First version of each chapter: 15 February 2008 </li></ul></ul><ul><ul><li>Feedback from review: 15 March 2008 </li></ul></ul><ul><ul><li>Final formatted version of each chapter 15 April 2008 </li></ul></ul><ul><ul><li>Publication: ?? </li></ul></ul>
    4. 4. Evaluation <ul><li>Objective: enable the assessment of the value of the conceptual framework and reasoning module in contexts that are not represented in the pilots </li></ul><ul><li>Should this go under strategic evaluation? </li></ul>
    5. 5. Evaluation <ul><li>Conceptual Framework - Demonstrate that the conceptual framework may hold in the context of very different implementations and applications. </li></ul><ul><li>Reasoning module - New version of the test centre: </li></ul><ul><ul><li>Visualize the reasoning of the reasoning module in applications such as Ontdeknet </li></ul></ul><ul><ul><li>Show how the reasoning module can be used also in less structured, non-task-based applications, and in the context of several (rather than one) applications. </li></ul></ul>
    6. 6. Evaluation: Conceptual Framework <ul><li>We look at the context restoration issue. </li></ul><ul><li>Virtual multi-desktop interface as an implementation of context-restoration facility </li></ul><ul><li>We hope to demonstrate that context restore will enhance both performance and user satisfaction </li></ul><ul><li>Hypotheses (Virtual multi-desktop interface vs Control): </li></ul><ul><ul><li>Increased perception of productivity and pleasure </li></ul></ul><ul><ul><li>Tasks are completed faster and better </li></ul></ul><ul><ul><li>Tasks are resumed faster and more easily </li></ul></ul><ul><ul><li>Fewer interface management actions and fewer mistakes on interface management actions </li></ul></ul>
    7. 7. Evaluation: Conceptual Framework <ul><li>Experiment: </li></ul><ul><ul><li>Subjects work for 20 minutes on three fully described tasks (spreadsheet based, translation, video). </li></ul></ul><ul><ul><li>They are interrupted regularly by requests to work at a different task, they are required to satisfy these requests </li></ul></ul><ul><ul><li>Control group (standard window interface), experimental group (virtual multi-desktop) </li></ul></ul><ul><li>Measures: </li></ul><ul><ul><li>Task completion level </li></ul></ul><ul><ul><li>Task quality level (# of errors) </li></ul></ul><ul><ul><li>Task resumption times </li></ul></ul><ul><ul><li>Reported evaluation </li></ul></ul>
    8. 8. Task 1: Spreadsheet
    9. 9. Task 2: Translation
    10. 10. Task 3: Video
    11. 11. Interruption
    12. 12. Resume
    13. 13. Evaluation: Reasoning Module <ul><li>Reasoning module - New version of the test centre: </li></ul><ul><ul><li>Visualize the reasoning of the reasoning module in applications such as Ontdeknet </li></ul></ul><ul><ul><li>Show how the reasoning module can be used also in less structured, non-task-based applications, and in the context of several (rather than one) applications. </li></ul></ul>
    14. 14. The test center <ul><li>Tool for experimenting with the RM </li></ul><ul><li>The test center was not very intuitive </li></ul><ul><li>Desire to experiment with the future vision of the RM (still working on) </li></ul>
    15. 16. Desktop
    16. 17. <ul><li>Minimal applications on a desktop </li></ul><ul><ul><li>application provides task model, sends events </li></ul></ul><ul><ul><li>interact with the application instead of creating events </li></ul></ul>Desktop
    17. 18. <ul><li>Interventions </li></ul>Desktop
    18. 19. User and task properties editable
    19. 20. Reasoning module activity
    20. 21. Utilities for creating environment events: New information available, idle input
    21. 22. <ul><li>EXAMPLE </li></ul>
    22. 23. user has finished intro and is notified about next task (learning goals)..
    23. 24. user starts learning goals (interventions disappear)..
    24. 25. user starts the wrong task, gets interventions suggesting correct subtask. Math task is also suggested as possible alternative task ..
    25. 26. The applications <ul><li>Pretty much like real applications </li></ul><ul><ul><li>Started from desktop icons.. </li></ul></ul><ul><li>Known task model </li></ul><ul><li>For now just one application (AtGentSchool) </li></ul><ul><li>Displays interventions allowing.. </li></ul><ul><ul><li>to start suggested task </li></ul></ul><ul><ul><li>In the future to provide feedback on the suggestions </li></ul></ul>
    26. 27. The applications <ul><li>Pretty much like real applications </li></ul><ul><ul><li>Started from desktop icons.. </li></ul></ul><ul><li>Known task model </li></ul><ul><li>For now just one application (AtGentSchool) </li></ul><ul><li>Displays interventions allowing.. </li></ul><ul><ul><li>to start suggested task </li></ul></ul><ul><ul><li>In the future to provide feedback on the suggestions </li></ul></ul>
    27. 28. The future vision <ul><li>Several applications </li></ul><ul><ul><li>Some applications provide their task model </li></ul></ul><ul><ul><li>Applications may be very different from what we have seen so far </li></ul></ul><ul><li>Task management side bar </li></ul>
    28. 29. Future test center
    29. 30. Future test center

    ×