Winter School defense simulation: Visualizing Activities for Self-reflection and Awareness

794 views
702 views

Published on

My slides for the defense simulation at the JTEL Winter School.

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
794
On SlideShare
0
From Embeds
0
Number of Embeds
7
Actions
Shares
0
Downloads
10
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Winter School defense simulation: Visualizing Activities for Self-reflection and Awareness

    1. 1. VISUALIZING ACTIVITIES FOR SELF-REFLECTION AND AWARENESS Sten Govaerts Katholieke Universiteit Leuven (Belgium) http://www.role-project.eu
    2. 2. OVERVIEW• Research outline• Student Activity Meter• Objectives• Design & Implementation• Three Evaluations• Conclusion
    3. 3. RESEARCH QUESTION?• canvisualizations assist teachers to improve awareness?• canvisualizations assist students with self-reflection?
    4. 4. PROBLEM
    5. 5. PROBLEM
    6. 6. PROBLEM
    7. 7. PROBLEM
    8. 8. OBJECTIVES• self-monitoring for learners• awareness for teachers• time tracking• learning resource recommendation
    9. 9. STUDENT ACTIVITY MONITOR
    10. 10. STUDENT ACTIVITY MONITOR
    11. 11. STUDENT ACTIVITY MONITOR
    12. 12. 3 EVALUATIONS• with CS students• withCGIAR courses and teachers• with Learning and Knowledge Analytics course participants
    13. 13. WHAT?• usability• user satisfaction• for what can the users use the visualizations? (usefulness) • does this match the objectives?
    14. 14. HOW?• paper mockups• implementation• usability studies• surveys• designbased research: give student tool to teachers to evaluate
    15. 15. DATA & DEPLOYMENTS• Contextualized Attention Metadata (CAM) data• scripts to extract CAM data from Moodle
    16. 16. CS STUDENTS CASE STUDY• usability and user satisfaction evaluation• 12 CS students•2 evaluation sessions: • task based interview with think aloud (after 1 week of tracking) • user satisfaction (SUS & MSDT) (after 1 month)
    17. 17. USABILITY & USER SATISFACTION• in general, people understand the visualizations well!• some small issues were uncovered...• average SUS score: 73% (stdv: 9,35)
    18. 18. USABILITY & USER SATISFACTION
    19. 19. USABILITY & USER SATISFACTION
    20. 20. USABILITY & USER SATISFACTION
    21. 21. USABILITY & USER SATISFACTION
    22. 22. USABILITY & USER SATISFACTION
    23. 23. CGIAR CASE STUDY
    24. 24. CGIAR CASE STUDY
    25. 25. CGIAR CASE STUDY
    26. 26. CGIAR CASE STUDY
    27. 27. CGIAR CASE STUDY
    28. 28. CGIAR CASE STUDY wants to more details search for detect outliers on student students good indicator for effort understand the workloadmore metrics use for course design optimizationobtain course overview compare students increase awarenesswant better 1 to 1 progress evolution comparison tool
    29. 29. LAK CASE STUDY• open course on learning and knowledge analytics• visual analytics enthousiasts + experts (who can also teach)
    30. 30. LAK CASE STUDY• open course on learning and knowledge analytics• visual analytics enthousiasts + experts (who can also teach)
    31. 31. LAK CASE STUDY verify the status of the more metrics classroom activity chronological course dwell timeself-reflection to measure progress and increase motivation find students experiencing problems and low engagement more data
    32. 32. IDEA’S FROM EXPERTS
    33. 33. IDEA’S FROM EXPERTS 2 5 4 3 1
    34. 34. FUTURE WORK• extend SAM with feedback of experts• evaluate the usefulness in a larger group of students • offer from Tallinn University• evaluate an improved version of SAM with teachers.
    35. 35. THANK YOU! QUESTIONS?slides will appear on http://www.slideshare.net/stengovaerts

    ×