Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Janine Kiers
Product Manager DelftX MOOCs
Based on conference submission with Danika Marquis and Leonie Meijerink
Evaluati...
What is a successful MOOC?
• Different perspectives
• Branding
• Innovation
• Research
• Educational
CC 0 Public domain Pi...
Quality Assurance cycle
Design
Develop
Run
Evaluate
Evaluating Teaching & Learning
• Quality AssuranceIntention:
• ToolsImplementation:
• Share & interpret resultsExperience:...
Tools: how to evaluate Teaching
and Learning in a MOOC?
• Passing rate
• Student satisfaction
• Design
CC 0 Public domain ...
Implementation of evaluation
Tool: Online Learning Experience
Online Learning Experience
• Flexible (in time, space & content)
• Diverse (activities, resources & assessment)
• Inclusiv...
Implementation of evaluation
Tools to gather & process data
Sources of data Used in
Student surveys Course report
Forum an...
• Collaborative Analysis - eLD & Course Team
• Discussion of results
• Implement in rerun
Implementation of evaluation
Tea...
Evaluation: platform data
• Data analysed (completers, respondents)
• Participants’ feedback
• in Likert scale
• written f...
Student expectations
Workload: expected and actual
Describe the course in one word
Evaluation: Student activity
Weekly numbers of active students (blue line), students who watched a video
(green line) and ...
Evaluation: Replay video
Evaluation: Student performance
• Review questions e.g. < 50%
Experience
Challenges in interpretation
• No student-teacher personal contact
• Survey results are biased
- low response r...
Learning points from experience
• Standardization of implementation
• Standardization of interpretation of OLE
• Dedicate ...
Effect of course evaluation
• Improve evaluated course
• Create knowledge base (generalized)
• Reflect on support process
...
Thank you
Questions?
Evaluating teaching and learning in MOOCs
Upcoming SlideShare
Loading in …5
×

Evaluating teaching and learning in MOOCs

1,570 views

Published on

Presentation for eMOOCs conference 2016
by Leonie Meijerink, Danika Marquis, Janine Kiers

Published in: Education
  • Be the first to comment

  • Be the first to like this

Evaluating teaching and learning in MOOCs

  1. 1. Janine Kiers Product Manager DelftX MOOCs Based on conference submission with Danika Marquis and Leonie Meijerink Evaluating Teaching and Learning
  2. 2. What is a successful MOOC? • Different perspectives • Branding • Innovation • Research • Educational CC 0 Public domain Pixabay
  3. 3. Quality Assurance cycle Design Develop Run Evaluate
  4. 4. Evaluating Teaching & Learning • Quality AssuranceIntention: • ToolsImplementation: • Share & interpret resultsExperience: • SuggestionsImprove:
  5. 5. Tools: how to evaluate Teaching and Learning in a MOOC? • Passing rate • Student satisfaction • Design CC 0 Public domain Pixabay
  6. 6. Implementation of evaluation Tool: Online Learning Experience
  7. 7. Online Learning Experience • Flexible (in time, space & content) • Diverse (activities, resources & assessment) • Inclusive (accessible, cultural & gender) • Supportive (guidance & feedback) • Interactive (learner – learner/teacher/content) • Active (learning by doing) • Contextual (real world situations & problems) • Innovative (new tools, strategies & insights)
  8. 8. Implementation of evaluation Tools to gather & process data Sources of data Used in Student surveys Course report Forum analysis Course report Stakeholder interviews Discussion Platform data Course report
  9. 9. • Collaborative Analysis - eLD & Course Team • Discussion of results • Implement in rerun Implementation of evaluation Teaching and Learning report CC BY 2.0 IvanWalsh.com
  10. 10. Evaluation: platform data • Data analysed (completers, respondents) • Participants’ feedback • in Likert scale • written feedback
  11. 11. Student expectations
  12. 12. Workload: expected and actual
  13. 13. Describe the course in one word
  14. 14. Evaluation: Student activity Weekly numbers of active students (blue line), students who watched a video (green line) and students who tried an assignment (orange line).
  15. 15. Evaluation: Replay video
  16. 16. Evaluation: Student performance • Review questions e.g. < 50%
  17. 17. Experience Challenges in interpretation • No student-teacher personal contact • Survey results are biased - low response rates & bias for completers • Heterogeneity of learners • Eliminate content specific results
  18. 18. Learning points from experience • Standardization of implementation • Standardization of interpretation of OLE • Dedicate time for evaluation • by Course Team • by support team / eLD
  19. 19. Effect of course evaluation • Improve evaluated course • Create knowledge base (generalized) • Reflect on support process • Professional development
  20. 20. Thank you Questions?

×