Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Unleash 2011

Presentatie gebruikt tijdens de Unleash 2011 conferentie in Madison, Wisconsin

  • Login to see the comments

  • Be the first to like this

Unleash 2011

  1. 1. Do You Know What Your Students Do with Your Lecture Recordings? May 17, 2011 Pierre Gorissen Fontys University of Applied Sciences Twitter: @PeterMcAllister
  2. 2. Madison - Eindhoven
  3. 3. Quick show of hands…
  4. 4. How it all started for us..
  5. 5. Reports… Viewers per slide Viewers per slide Viewers per slide
  6. 6. Research Questions <ul><li>How do students use recorded lectures? </li></ul><ul><ul><li>What do they say? </li></ul></ul><ul><ul><li>What do they actually do?   </li></ul></ul><ul><li>Which patterns are there in the reported and actual use of recorded lectures by students? </li></ul><ul><li>How can we better support the use of recorded lectures? </li></ul>
  7. 8. Recorded Lectures
  8. 9. Recorded Lectures <ul><li>Many </li></ul><ul><li>Long (45 min. Average) </li></ul><ul><li>Expensive to create </li></ul>
  9. 10. Our question was simple: <ul><li>How (when and why) do students use the recorded lectures for course C01? </li></ul>
  10. 11. Two step approach <ul><li>#1 Let’s ask them: </li></ul><ul><ul><li>Survey </li></ul></ul><ul><ul><li>Interviews </li></ul></ul><ul><li>#2 Measure their use: </li></ul><ul><ul><li>Mediasite reports </li></ul></ul><ul><ul><li>Log files </li></ul></ul>
  11. 12. #1 Let’s ask them <ul><li>Survey in February 2010 </li></ul><ul><li>1,122 studenten (203 Fontys / 919 TU/e) </li></ul><ul><li>7 courses (1 Fontys / 6 TU/e) </li></ul><ul><li>Response rate 46.1% (517 students) </li></ul><ul><li>Follow up interviews (30 minutes) with 14 students </li></ul>
  12. 13. Main results <ul><li>Most students watch recordings at home; </li></ul><ul><li>No major technical problems; </li></ul><ul><li>They know where to find the recordings; </li></ul><ul><li>They would prefer for all courses to be recorded. </li></ul>
  13. 14. Main results <ul><li>Why do they watch: </li></ul><ul><ul><li>Missed one or more lectures; </li></ul></ul><ul><ul><li>Prepare for exams / improving test scores; </li></ul></ul><ul><ul><li>Improve retention of lecture materials; </li></ul></ul><ul><ul><li>Replacement for live attendance; </li></ul></ul><ul><ul><li>Review the material after a lecture. </li></ul></ul>
  14. 15. Main results <ul><li>Reasons why not to watch: </li></ul><ul><ul><li>Already attended the live lecture; </li></ul></ul><ul><ul><li>No time; </li></ul></ul><ul><ul><li>Didn’t feel I missed anything. </li></ul></ul>
  15. 16. How much of a lecture do you watch?
  16. 17. Would students really lie?
  17. 18. Just asking is not enough! <ul><li>It is unlikely that students watch that much of a recording; </li></ul><ul><li>The interviews do suggest that it may be true for some students (but how many?). </li></ul>
  18. 19. Two step approach <ul><li>#1 Let’s ask them: </li></ul><ul><ul><li>Survey </li></ul></ul><ul><ul><li>Interviews </li></ul></ul><ul><li>#2 Measure the use: </li></ul><ul><ul><li>Mediasite reports </li></ul></ul><ul><ul><li>Log files </li></ul></ul>
  19. 20. Our question was simple: <ul><li>How (when and why) do students use the recorded lectures for course C01? </li></ul>
  20. 21. Mediasite
  21. 22. Mediasite <ul><li>Server Activity / Date for all recordings </li></ul>
  22. 23. Mediasite <ul><li>Total Views / Presentation for Course C01 </li></ul>
  23. 24. Mediasite <ul><li>Presentation Summary for single recording </li></ul>
  24. 25. Our question apparently was not that simple ! <ul><li>How (when and why) do students use the recorded lectures for course C01? </li></ul>
  25. 26. Server logs
  26. 27. Combine data
  27. 28. New problem/challenge: <ul><li>We had way to much data! </li></ul><ul><li>Were to start? </li></ul>
  28. 29. Step #1 <ul><li>Define what it is you are interested in: </li></ul><ul><ul><li>Who: </li></ul></ul><ul><ul><ul><li>Students only </li></ul></ul></ul><ul><ul><ul><li>Not: staff / researcher(s) / professors </li></ul></ul></ul><ul><ul><ul><li>Not: anonymous users </li></ul></ul></ul><ul><ul><li>What: </li></ul></ul><ul><ul><ul><li>Recorded Lectures </li></ul></ul></ul><ul><ul><ul><li>Not: public seminars / opening of academic year / graduation sessions / …. </li></ul></ul></ul>
  29. 30. Step #2 <ul><li>Define what it is you are interested in: </li></ul><ul><ul><li>Learner Sessions </li></ul></ul><ul><ul><ul><li>What is a learner session? </li></ul></ul></ul><ul><ul><ul><li>How long is a learner session? </li></ul></ul></ul><ul><ul><li>Student </li></ul></ul><ul><ul><li>Recording </li></ul></ul>
  30. 31. Step #3 <ul><li>Clean your data! </li></ul><ul><ul><li>Remove all those short learner sessions! </li></ul></ul><ul><ul><li>Remove all recordings you’re not interested in! </li></ul></ul><ul><ul><li>Remove all viewers you’re not interested in! </li></ul></ul>
  31. 32. Now we are getting somewhere…
  32. 33. We now know.. <ul><li>When students watch </li></ul><ul><li>Why students watch (we think we do) </li></ul><ul><li>… how do they watch? </li></ul>
  33. 34. Heatmap Student 1 Student 188 T = 45 min T = 0 min
  34. 35. Work in progress <ul><li>Log data does not contain much info about navigation through the Mediasite environment; </li></ul><ul><li>Need more data, e.g. logs from LMS/VLE. </li></ul>
  35. 36. Take away points… <ul><li>Know what you want to know; </li></ul><ul><li>Combine data if available; </li></ul><ul><li>Don’t be afraid to throw out data; </li></ul><ul><li>Student centered approach needed; </li></ul><ul><li>Different students mean different use; </li></ul><ul><li>Different recordings mean different use. </li></ul>
  36. 37. Final comment from one of the interviews: A recording of a bad lecture can actually improve that lecture... … the recording can be replayed at high speed!
  37. 38. [email_address] <ul><li> </li></ul>