3. • Course-‐based
online
MulGple
Choice
QuesGon
repository
built
by
students
• Students:
– develop new questions with
associated explanations
– answer existing questions and rate
them for quality and difficulty
– take part in discussions
– can follow other authors
peerwise.cs.auckland.ac.nz
16. Implementation in PHAS 101
8 sections (4-3-1) N(total) ~1800
2012 W2 3 sections N ~750
All non majors.
2 PeerWise assignments
- scaffolded ahead of the first
- support woven into 4 subsequent tutorials
16
17. Assessment requirements
As a minimum:
• Write one question
• Answer 5
• Comment on & rate 3
Contributed 2 x 2.5% to course assessment
(mostly participation, small bonus for performance)
Student questions on midterm and final
17
18. We were deliberately
hands off.
• No moderation
• No corrections
• No interventions at all
But we did observe…..
18
31. Learning
• Good
engagement
and
parGcipaGon
beyond
the
minimum
requirements
• CorrelaGon
between
use
and
end-‐of-‐course
outcome
• ReplicaGon
study
in
3
insGtuGons,
5
courses,
3
disciplines
1st
year
Physics
N=172
University
of
Edinburgh
32. 1st
year
Physics
N=172
University
of
Edinburgh
1st
year
Chemistry
N=172
University
of
Edinburgh
33. 0%
5%
10%
15%
20%
25%
30%
35%
40%
45%
50%
1 2 3 4 5 6
Taxonomic Category
PercentageofSubmittedQuestions
Learning
• QuesGon
quality:
mapped
onto
levels
in
cogniGve
domain
of
Bloom’s
taxonomy
• Surprisingly
high
overall
quality,
even
from
‘novices’
First
semester
N
=
350
Second
semester
N
=
252
34.
35.
36. Acknowledgements
Physics 101 course team
Georg Rieger
Firas Moosvi
Emily Altiere UBC CWSEI
simon.bates@ubc.ca
@simonpbates
Ross Galloway
Judy Hardy
Karon McBride
Alison Kay
Keith Brunton
Jonathan Riise
Danny Homer
Chemistry – Peter Kirsop
Biology – Heather McQueen
Physics – Morag Casey
Comp Sci – Paul Denny
40. Question quality analysis (1st year Physics University of Edinburgh)
Assessing the quality of a student-generated question repository, submitted to Phys
Rev, ST Phys Educ Res.
Multi-institution, multi-course study
Student-generated content: Enhancing learning through sharing multiple-choice
questions, submitted to International Journal of Science Education
Scaffolding Student Learning via Online Peer Learning, submitted to International
Journal of Science Education
Publications in preparation / review / press