0
VISUALIZING ACTIVITIES FOR   SELF-REFLECTION AND        AWARENESS                Sten Govaerts    Katholieke Universiteit ...
OVERVIEW• Research   outline• Student Activity   Meter• Objectives• Design   & Implementation• Three   Evaluations• Conclu...
RESEARCH QUESTION?• canvisualizations assist teachers to improve awareness?• canvisualizations assist students with self-r...
PROBLEM
PROBLEM
PROBLEM
PROBLEM
OBJECTIVES• self-monitoring   for learners• awareness    for teachers• time   tracking• learning       resource recommenda...
STUDENT ACTIVITY MONITOR
STUDENT ACTIVITY MONITOR
STUDENT ACTIVITY MONITOR
3 EVALUATIONS• with   CS students• withCGIAR courses and teachers• with     Learning and Knowledge Analytics course partic...
WHAT?• usability• user   satisfaction• for   what can the users use the visualizations? (usefulness)  • does    this match...
HOW?• paper    mockups• implementation• usability   studies• surveys• designbased research: give student tool to teachers ...
DATA & DEPLOYMENTS• Contextualized Attention   Metadata (CAM) data• scripts      to extract CAM data from Moodle
CS STUDENTS CASE STUDY• usability   and user satisfaction evaluation• 12   CS students•2   evaluation sessions:  • task  b...
USABILITY & USER                 SATISFACTION• in   general, people understand the visualizations well!• some    small iss...
USABILITY & USER SATISFACTION
USABILITY & USER SATISFACTION
USABILITY & USER SATISFACTION
USABILITY & USER SATISFACTION
USABILITY & USER SATISFACTION
CGIAR CASE STUDY
CGIAR CASE STUDY
CGIAR CASE STUDY
CGIAR CASE STUDY
CGIAR CASE STUDY
CGIAR CASE STUDY  wants to                          more details search for       detect outliers    on student  students ...
LAK CASE STUDY• open     course on learning and knowledge analytics• visual   analytics enthousiasts + experts (who can al...
LAK CASE STUDY• open     course on learning and knowledge analytics• visual   analytics enthousiasts + experts (who can al...
LAK CASE STUDY  verify the status of the     more metrics    classroom activity                      chronological course ...
IDEA’S FROM EXPERTS
IDEA’S FROM EXPERTS       2           5                4               3           1
FUTURE WORK• extend    SAM with feedback of experts• evaluate         the usefulness in a larger group of students  • offe...
THANK YOU!                QUESTIONS?slides will appear on http://www.slideshare.net/stengovaerts
Winter School defense simulation: Visualizing Activities for Self-reflection and Awareness
Winter School defense simulation: Visualizing Activities for Self-reflection and Awareness
Upcoming SlideShare
Loading in...5
×

Winter School defense simulation: Visualizing Activities for Self-reflection and Awareness

568

Published on

My slides for the defense simulation at the JTEL Winter School.

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
568
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
6
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Transcript of "Winter School defense simulation: Visualizing Activities for Self-reflection and Awareness"

    1. 1. VISUALIZING ACTIVITIES FOR SELF-REFLECTION AND AWARENESS Sten Govaerts Katholieke Universiteit Leuven (Belgium) http://www.role-project.eu
    2. 2. OVERVIEW• Research outline• Student Activity Meter• Objectives• Design & Implementation• Three Evaluations• Conclusion
    3. 3. RESEARCH QUESTION?• canvisualizations assist teachers to improve awareness?• canvisualizations assist students with self-reflection?
    4. 4. PROBLEM
    5. 5. PROBLEM
    6. 6. PROBLEM
    7. 7. PROBLEM
    8. 8. OBJECTIVES• self-monitoring for learners• awareness for teachers• time tracking• learning resource recommendation
    9. 9. STUDENT ACTIVITY MONITOR
    10. 10. STUDENT ACTIVITY MONITOR
    11. 11. STUDENT ACTIVITY MONITOR
    12. 12. 3 EVALUATIONS• with CS students• withCGIAR courses and teachers• with Learning and Knowledge Analytics course participants
    13. 13. WHAT?• usability• user satisfaction• for what can the users use the visualizations? (usefulness) • does this match the objectives?
    14. 14. HOW?• paper mockups• implementation• usability studies• surveys• designbased research: give student tool to teachers to evaluate
    15. 15. DATA & DEPLOYMENTS• Contextualized Attention Metadata (CAM) data• scripts to extract CAM data from Moodle
    16. 16. CS STUDENTS CASE STUDY• usability and user satisfaction evaluation• 12 CS students•2 evaluation sessions: • task based interview with think aloud (after 1 week of tracking) • user satisfaction (SUS & MSDT) (after 1 month)
    17. 17. USABILITY & USER SATISFACTION• in general, people understand the visualizations well!• some small issues were uncovered...• average SUS score: 73% (stdv: 9,35)
    18. 18. USABILITY & USER SATISFACTION
    19. 19. USABILITY & USER SATISFACTION
    20. 20. USABILITY & USER SATISFACTION
    21. 21. USABILITY & USER SATISFACTION
    22. 22. USABILITY & USER SATISFACTION
    23. 23. CGIAR CASE STUDY
    24. 24. CGIAR CASE STUDY
    25. 25. CGIAR CASE STUDY
    26. 26. CGIAR CASE STUDY
    27. 27. CGIAR CASE STUDY
    28. 28. CGIAR CASE STUDY wants to more details search for detect outliers on student students good indicator for effort understand the workloadmore metrics use for course design optimizationobtain course overview compare students increase awarenesswant better 1 to 1 progress evolution comparison tool
    29. 29. LAK CASE STUDY• open course on learning and knowledge analytics• visual analytics enthousiasts + experts (who can also teach)
    30. 30. LAK CASE STUDY• open course on learning and knowledge analytics• visual analytics enthousiasts + experts (who can also teach)
    31. 31. LAK CASE STUDY verify the status of the more metrics classroom activity chronological course dwell timeself-reflection to measure progress and increase motivation find students experiencing problems and low engagement more data
    32. 32. IDEA’S FROM EXPERTS
    33. 33. IDEA’S FROM EXPERTS 2 5 4 3 1
    34. 34. FUTURE WORK• extend SAM with feedback of experts• evaluate the usefulness in a larger group of students • offer from Tallinn University• evaluate an improved version of SAM with teachers.
    35. 35. THANK YOU! QUESTIONS?slides will appear on http://www.slideshare.net/stengovaerts
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×