http://www.slideshare.net/jlsantoso Goal-oriented visualizations of activitytracking: a case study with engineering       ...
Motivation     1. Means: Information        visualization     2. Goals        1. Awareness        2. Self-reflection      ...
Related workLAMS                DOKEOS  MOODLE               KHAN ACADEMY   3
1.   Upton et al. Narcissus: Group and Individual Models to Support Small Group Work. UMAP’09 http://goo.gl/ZzNbF2.   Deri...
1.   Santos et al. Visualizing PLE usage. EFEPLE’11 workshop. http://goo.gl/PWbBF2.   Govaerts et al. The student activity...
Design based research          methodology   Design      Implementation   Deployment                                Observ...
One… two… three… and… four!1. Paper prototype  – Professors and teacher assistants.2. Digital prototype  – Professors and ...
1st and 2nd iterations          -Generic (CAM)          -Usability          -Think-aloud protocol.          -15-30 minutes...
Results•   Size of tables•   Redundant information•   Personalization•   Context centralization vs diversification•   Moti...
Scenario       Awareness and        reflection             Goal-orientedHow do students spend their time during           ...
Why and what do we track?• Individual and group spent time• Type of activity  (development, writing, …)• Application• Prog...
How do we visualize this data?http://sourceforge.net/apps/mediawiki/role-project                    http://role-sandbox.eu...
14
15
16
17
18
19
20
21
First evaluation with real data• 36 students• Questionnaire after seeing a demo  – From USE questionnaire• Perceived usefu...
Conclusions              23
•   Useful•   Helpful•   Lab tracking•   Usability?                   24
Second evaluation with real data•   10 students•   4 lab sessions•   15 minutes•   SUS•   Perceived usefulness•   Tracking...
Conclusions• SUS score: 72• Useful?• Detection of  certain patterns                                   26
Conclusions              27
Final conclusions•   Not included in this paper•   14 students•   SUS: 66•   Useful for:    – Teachers (6)    – Students (...
Although they consider ituseful, understandable, us          able…                         29
…students did not use the     tool frequently          WHY?                            30
One student said:“We had other priorities”                            31
How can we engage students     in this process?                         32
33
Thank you! Any question?               @jlsantoso                  @erikduval                  @katrien_v   http://jlsanto...
Lak12 jlsantos-v2
Upcoming SlideShare
Loading in …5
×

Lak12 jlsantos-v2

1,627 views
1,589 views

Published on

Published in: Education, Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,627
On SlideShare
0
From Embeds
0
Number of Embeds
313
Actions
Shares
0
Downloads
8
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Lak12 jlsantos-v2

  1. 1. http://www.slideshare.net/jlsantoso Goal-oriented visualizations of activitytracking: a case study with engineering students José Luis Santos, StenGovaerts, KatrienVerbert, Erik Duval 1
  2. 2. Motivation 1. Means: Information visualization 2. Goals 1. Awareness 2. Self-reflection 3. Sense-making but even more important… to engage students on these processes. 2
  3. 3. Related workLAMS DOKEOS MOODLE KHAN ACADEMY 3
  4. 4. 1. Upton et al. Narcissus: Group and Individual Models to Support Small Group Work. UMAP’09 http://goo.gl/ZzNbF2. Derick et al. GLASS: A first look through a Learning Analytics System. LAK’12 http://goo.gl/eY4w23. Mazza et al. Exploring usage analysis in learning systems. Workshop at AIED’05 http://goo.gl/ycrFQ 4
  5. 5. 1. Santos et al. Visualizing PLE usage. EFEPLE’11 workshop. http://goo.gl/PWbBF2. Govaerts et al. The student activity meter for awareness and reflection. ACM SIGCHI 2012. http://goo.gl/SGfta3. Duval et al. Learning dashboard and learnscapes. Workshop at ACM SIGCHI 2012. http://goo.gl/j7NeJ4. Duval. Attention please! Learning analytics for visualization and recommendation. LAK’11. http://goo.gl/Kfwii 5
  6. 6. Design based research methodology Design Implementation Deployment ObservationRequirements Analysis & Evaluation 7
  7. 7. One… two… three… and… four!1. Paper prototype – Professors and teacher assistants.2. Digital prototype – Professors and teacher assistants.3. First release – Students4. Second release – Students 8
  8. 8. 1st and 2nd iterations -Generic (CAM) -Usability -Think-aloud protocol. -15-30 minutes - 1st -> 7 participants - 2nd -> 5 participants 9
  9. 9. Results• Size of tables• Redundant information• Personalization• Context centralization vs diversification• Motion chart 10
  10. 10. Scenario Awareness and reflection Goal-orientedHow do students spend their time during the lab sessions? 11
  11. 11. Why and what do we track?• Individual and group spent time• Type of activity (development, writing, …)• Application• Program code• Websites + 12
  12. 12. How do we visualize this data?http://sourceforge.net/apps/mediawiki/role-project http://role-sandbox.eu/spaces/dashboardkul or http://goo.gl/qzP9H 13
  13. 13. 14
  14. 14. 15
  15. 15. 16
  16. 16. 17
  17. 17. 18
  18. 18. 19
  19. 19. 20
  20. 20. 21
  21. 21. First evaluation with real data• 36 students• Questionnaire after seeing a demo – From USE questionnaire• Perceived usefulness• Privacy concerns 22
  22. 22. Conclusions 23
  23. 23. • Useful• Helpful• Lab tracking• Usability? 24
  24. 24. Second evaluation with real data• 10 students• 4 lab sessions• 15 minutes• SUS• Perceived usefulness• Tracking/privacy concerns.• Questionnaire 25
  25. 25. Conclusions• SUS score: 72• Useful?• Detection of certain patterns 26
  26. 26. Conclusions 27
  27. 27. Final conclusions• Not included in this paper• 14 students• SUS: 66• Useful for: – Teachers (6) – Students (5) – Both (3)• Satisfaction: – 4.4 (over 7) 28
  28. 28. Although they consider ituseful, understandable, us able… 29
  29. 29. …students did not use the tool frequently WHY? 30
  30. 30. One student said:“We had other priorities” 31
  31. 31. How can we engage students in this process? 32
  32. 32. 33
  33. 33. Thank you! Any question? @jlsantoso @erikduval @katrien_v http://jlsantoso.blogspot.com http://erikduval.wordpress.com 34

×