SlideShare a Scribd company logo
1 of 40
Download to read offline
7	
  Research-­‐Based	
  Principles	
  
For	
  Learning	
  &	
  Teaching	
  
Adapted	
  from	
  ‘How	
  Learning	
  Works’	
  
	
  	
  
Overview
I.  About PeerWise
II. Implemention
III. Engagement, Learning, Question Quality
•  Course-­‐based	
  online	
  MulGple	
  Choice	
  QuesGon	
  	
  
repository	
  built	
  by	
  students	
  
•  Students:	
  
–  develop new questions with
associated explanations
–  answer existing questions and rate
them for quality and difficulty
–  take part in discussions
–  can follow other authors
peerwise.cs.auckland.ac.nz	
  
>100,000
student contributors
>500,000
unique questions
>10,000,000
answers
5
As a question author…..
6
7
10
As a question answerer …..
11
12
13
14
Overview
I.  About PeerWise
II. Implemention
III. Engagement, Learning, Question Quality
Implementation in PHAS 101
8 sections (4-3-1) N(total) ~1800
2012 W2 3 sections N ~750
All non majors.
2 PeerWise assignments
- scaffolded ahead of the first
- support woven into 4 subsequent tutorials
16
Assessment requirements
As a minimum:
•  Write one question
•  Answer 5
•  Comment on & rate 3
Contributed 2 x 2.5% to course assessment
(mostly participation, small bonus for performance)
Student questions on midterm and final
17
We were deliberately
hands off.
•  No moderation
•  No corrections
•  No interventions at all
But we did observe…..
18
Scaffolding in tutorials
19
Scaffolding in tutorials
20
Overview
I.  About PeerWise
II. Implemention
III. Engagement, Learning, Question Quality
•  Phys	
  101	
  uptake	
  graph	
  showing	
  midterm	
  	
  
Engagement	
  
	
  
First	
  assessment	
  exercise:	
  
	
  
•  664	
  acGve	
  students	
  (85%	
  of	
  cohort)	
  	
  
•  1340	
  Q,	
  11000	
  A,	
  5000	
  C	
  
•  x1.75,	
  x17,	
  x7	
  minimum	
  requirements	
  
Engagement	
  
Score	
  
Examples
27
28
Learning	
  
•  Good	
  engagement	
  and	
  parGcipaGon	
  beyond	
  
the	
  minimum	
  requirements	
  
•  CorrelaGon	
  between	
  use	
  and	
  end-­‐of-­‐course	
  
outcome	
  
•  ReplicaGon	
  study	
  in	
  	
  
3	
  insGtuGons,	
  5	
  courses,	
  
3	
  disciplines	
  
1st	
  year	
  Physics	
  	
  	
  N=172	
  
University	
  of	
  Edinburgh	
  
1st	
  year	
  Physics	
  	
  	
  N=172	
  
University	
  of	
  Edinburgh	
  
1st	
  year	
  Chemistry	
  N=172	
  
University	
  of	
  Edinburgh	
  
0%
5%
10%
15%
20%
25%
30%
35%
40%
45%
50%
1 2 3 4 5 6
Taxonomic Category
PercentageofSubmittedQuestions
Learning	
  
•  QuesGon	
  quality:	
  mapped	
  onto	
  levels	
  in	
  
cogniGve	
  domain	
  of	
  Bloom’s	
  taxonomy	
  
•  Surprisingly	
  high	
  	
  
overall	
  quality,	
  even	
  
from	
  ‘novices’	
  
First	
  semester	
  	
  	
  	
  	
  	
  	
  	
  N	
  =	
  350
	
  	
  
Second	
  semester	
  	
  	
  N	
  =	
  252	
  
Acknowledgements
Physics 101 course team
Georg Rieger
Firas Moosvi
Emily Altiere UBC CWSEI
simon.bates@ubc.ca 
@simonpbates
Ross Galloway
Judy Hardy
Karon McBride
Alison Kay
Keith Brunton
Jonathan Riise
Danny Homer
Chemistry – Peter Kirsop
Biology – Heather McQueen
Physics – Morag Casey
Comp Sci – Paul Denny
Resources	
  -­‐	
  PeerWise	
  
Site: http://peerwise.cs.auckland.ac.nz
Community: http://www.PeerWise-Community.org
JISC-funded multi institution study:
https://www.wiki.ed.ac.uk/display/SGC4L/Home
UoE Physics Pilot Study: AIP Conf. Proc. 1413, 359
http://dx.doi.org/10.1063/1.3680069
RSC overview article
http://www.rsc.org/Education/EiC/issues/2013January/
student-generated-assessment.asp
UoE Physics scaffolding resources
http://www2.ph.ed.ac.uk/elearning/projects/peerwise/
Question quality analysis (1st year Physics University of Edinburgh)
Assessing the quality of a student-generated question repository, submitted to Phys
Rev, ST Phys Educ Res.
Multi-institution, multi-course study
Student-generated content: Enhancing learning through sharing multiple-choice
questions, submitted to International Journal of Science Education
Scaffolding Student Learning via Online Peer Learning, submitted to International
Journal of Science Education
Publications in preparation / review / press

More Related Content

What's hot

U of Sydney - If you don't lecture
U of Sydney - If you don't lecture U of Sydney - If you don't lecture
U of Sydney - If you don't lecture Simon Bates
 
Ah yes, but that would never work with my students
Ah yes, but that would never work with my students Ah yes, but that would never work with my students
Ah yes, but that would never work with my students Simon Bates
 
Expert Guided Crowdsourced Learning Content - STEM 2014
Expert Guided Crowdsourced Learning Content - STEM 2014Expert Guided Crowdsourced Learning Content - STEM 2014
Expert Guided Crowdsourced Learning Content - STEM 2014Simon Bates
 
Keynote lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...
Keynote lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...Keynote lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...
Keynote lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...Simon Bates
 
Faculty and students; as collaborators, coproducers and makers
Faculty and students; as collaborators, coproducers and makersFaculty and students; as collaborators, coproducers and makers
Faculty and students; as collaborators, coproducers and makersSimon Bates
 
The Anatomy of a 21st Century Educator
The Anatomy of a 21st Century Educator The Anatomy of a 21st Century Educator
The Anatomy of a 21st Century Educator Simon Bates
 
Aapt peer wise_bates
Aapt peer wise_batesAapt peer wise_bates
Aapt peer wise_batesSimon Bates
 
Strategies to enhance student engagement and learning in class: flipping and ...
Strategies to enhance student engagement and learning in class: flipping and ...Strategies to enhance student engagement and learning in class: flipping and ...
Strategies to enhance student engagement and learning in class: flipping and ...Simon Bates
 
Think outside the lecture: heads on hand-on active learning in the classroom
Think outside the lecture: heads on hand-on active learning in the classroomThink outside the lecture: heads on hand-on active learning in the classroom
Think outside the lecture: heads on hand-on active learning in the classroomSimon Bates
 
Learning and Teaching Maths in Biosciences
Learning and Teaching Maths in BiosciencesLearning and Teaching Maths in Biosciences
Learning and Teaching Maths in BiosciencesAlan Cann
 
The 21st Century Educator - students as partners in teaching and learning
The  21st Century Educator - students as partners in teaching and learning The  21st Century Educator - students as partners in teaching and learning
The 21st Century Educator - students as partners in teaching and learning Simon Bates
 
A perfect match blended learning and student engagement
A perfect match blended learning and student engagementA perfect match blended learning and student engagement
A perfect match blended learning and student engagementCOHERE2012
 
Students in the sandbox - developing professionals?
Students in the sandbox - developing professionals?Students in the sandbox - developing professionals?
Students in the sandbox - developing professionals?Alan Cann
 
Moving through MOOCs: Pedagogy, Learning and Patterns of Engagement
Moving through MOOCs: Pedagogy, Learning and Patterns of EngagementMoving through MOOCs: Pedagogy, Learning and Patterns of Engagement
Moving through MOOCs: Pedagogy, Learning and Patterns of EngagementRebecca Ferguson
 
CCCOER May 11 Webinar: 3 Faculty Perpectives on OER Adoption
CCCOER May 11 Webinar:  3 Faculty Perpectives on OER AdoptionCCCOER May 11 Webinar:  3 Faculty Perpectives on OER Adoption
CCCOER May 11 Webinar: 3 Faculty Perpectives on OER AdoptionUna Daly
 
Improving student learning through taking a programme approach
Improving student learning through taking a programme approachImproving student learning through taking a programme approach
Improving student learning through taking a programme approachTansy Jessop
 
Cohere 2014 comparing kinesiology-blended, online courses
Cohere 2014 comparing kinesiology-blended, online coursesCohere 2014 comparing kinesiology-blended, online courses
Cohere 2014 comparing kinesiology-blended, online coursesCOHERE2012
 
From Theory to Practice, Balancing Pedagogy and Technology for Diverse Profes...
From Theory to Practice, Balancing Pedagogy and Technology for Diverse Profes...From Theory to Practice, Balancing Pedagogy and Technology for Diverse Profes...
From Theory to Practice, Balancing Pedagogy and Technology for Diverse Profes...COHERE2012
 
Learning design and learning analytics
Learning design and learning analyticsLearning design and learning analytics
Learning design and learning analyticsRebecca Ferguson
 
Course Design on the Fly, Supporting a New Colloaborative Nursing Program (My...
Course Design on the Fly, Supporting a New Colloaborative Nursing Program (My...Course Design on the Fly, Supporting a New Colloaborative Nursing Program (My...
Course Design on the Fly, Supporting a New Colloaborative Nursing Program (My...COHERE2012
 

What's hot (20)

U of Sydney - If you don't lecture
U of Sydney - If you don't lecture U of Sydney - If you don't lecture
U of Sydney - If you don't lecture
 
Ah yes, but that would never work with my students
Ah yes, but that would never work with my students Ah yes, but that would never work with my students
Ah yes, but that would never work with my students
 
Expert Guided Crowdsourced Learning Content - STEM 2014
Expert Guided Crowdsourced Learning Content - STEM 2014Expert Guided Crowdsourced Learning Content - STEM 2014
Expert Guided Crowdsourced Learning Content - STEM 2014
 
Keynote lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...
Keynote lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...Keynote lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...
Keynote lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...
 
Faculty and students; as collaborators, coproducers and makers
Faculty and students; as collaborators, coproducers and makersFaculty and students; as collaborators, coproducers and makers
Faculty and students; as collaborators, coproducers and makers
 
The Anatomy of a 21st Century Educator
The Anatomy of a 21st Century Educator The Anatomy of a 21st Century Educator
The Anatomy of a 21st Century Educator
 
Aapt peer wise_bates
Aapt peer wise_batesAapt peer wise_bates
Aapt peer wise_bates
 
Strategies to enhance student engagement and learning in class: flipping and ...
Strategies to enhance student engagement and learning in class: flipping and ...Strategies to enhance student engagement and learning in class: flipping and ...
Strategies to enhance student engagement and learning in class: flipping and ...
 
Think outside the lecture: heads on hand-on active learning in the classroom
Think outside the lecture: heads on hand-on active learning in the classroomThink outside the lecture: heads on hand-on active learning in the classroom
Think outside the lecture: heads on hand-on active learning in the classroom
 
Learning and Teaching Maths in Biosciences
Learning and Teaching Maths in BiosciencesLearning and Teaching Maths in Biosciences
Learning and Teaching Maths in Biosciences
 
The 21st Century Educator - students as partners in teaching and learning
The  21st Century Educator - students as partners in teaching and learning The  21st Century Educator - students as partners in teaching and learning
The 21st Century Educator - students as partners in teaching and learning
 
A perfect match blended learning and student engagement
A perfect match blended learning and student engagementA perfect match blended learning and student engagement
A perfect match blended learning and student engagement
 
Students in the sandbox - developing professionals?
Students in the sandbox - developing professionals?Students in the sandbox - developing professionals?
Students in the sandbox - developing professionals?
 
Moving through MOOCs: Pedagogy, Learning and Patterns of Engagement
Moving through MOOCs: Pedagogy, Learning and Patterns of EngagementMoving through MOOCs: Pedagogy, Learning and Patterns of Engagement
Moving through MOOCs: Pedagogy, Learning and Patterns of Engagement
 
CCCOER May 11 Webinar: 3 Faculty Perpectives on OER Adoption
CCCOER May 11 Webinar:  3 Faculty Perpectives on OER AdoptionCCCOER May 11 Webinar:  3 Faculty Perpectives on OER Adoption
CCCOER May 11 Webinar: 3 Faculty Perpectives on OER Adoption
 
Improving student learning through taking a programme approach
Improving student learning through taking a programme approachImproving student learning through taking a programme approach
Improving student learning through taking a programme approach
 
Cohere 2014 comparing kinesiology-blended, online courses
Cohere 2014 comparing kinesiology-blended, online coursesCohere 2014 comparing kinesiology-blended, online courses
Cohere 2014 comparing kinesiology-blended, online courses
 
From Theory to Practice, Balancing Pedagogy and Technology for Diverse Profes...
From Theory to Practice, Balancing Pedagogy and Technology for Diverse Profes...From Theory to Practice, Balancing Pedagogy and Technology for Diverse Profes...
From Theory to Practice, Balancing Pedagogy and Technology for Diverse Profes...
 
Learning design and learning analytics
Learning design and learning analyticsLearning design and learning analytics
Learning design and learning analytics
 
Course Design on the Fly, Supporting a New Colloaborative Nursing Program (My...
Course Design on the Fly, Supporting a New Colloaborative Nursing Program (My...Course Design on the Fly, Supporting a New Colloaborative Nursing Program (My...
Course Design on the Fly, Supporting a New Colloaborative Nursing Program (My...
 

Similar to PeerWise Bates (STLHE 2013)

Can Student-Generated Content Enhance Learning in Introductory Physics?
Can Student-Generated Content Enhance Learning in Introductory Physics?Can Student-Generated Content Enhance Learning in Introductory Physics?
Can Student-Generated Content Enhance Learning in Introductory Physics?Simon Bates
 
Peerwise - Paul Denny - Edinburgh 2011 (part 2)
Peerwise - Paul Denny - Edinburgh 2011 (part 2)Peerwise - Paul Denny - Edinburgh 2011 (part 2)
Peerwise - Paul Denny - Edinburgh 2011 (part 2)EdUniSciEng
 
Familiarity breeds content peer wise
Familiarity breeds content peer wiseFamiliarity breeds content peer wise
Familiarity breeds content peer wiseJisc
 
Bates inverted classroom
Bates inverted classroomBates inverted classroom
Bates inverted classroomSimon Bates
 
Scaffolding Problem Based Learning
Scaffolding Problem Based LearningScaffolding Problem Based Learning
Scaffolding Problem Based LearningSarah_Gretton
 
Improving student learning through programme assessment
Improving student learning through programme assessmentImproving student learning through programme assessment
Improving student learning through programme assessmentTansy Jessop
 
Skills Development Through Authentic Assessment
Skills Development Through Authentic AssessmentSkills Development Through Authentic Assessment
Skills Development Through Authentic AssessmentAlan Cann
 
NTU Innovations in Teaching Seminar - students as co creators
NTU Innovations in Teaching Seminar - students as co creatorsNTU Innovations in Teaching Seminar - students as co creators
NTU Innovations in Teaching Seminar - students as co creatorsSimon Bates
 
Learner Engagement, QM Standards and the Blended Course
Learner Engagement, QM Standards and the Blended CourseLearner Engagement, QM Standards and the Blended Course
Learner Engagement, QM Standards and the Blended CourseLakeland Community College
 
Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...
Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...
Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...Blackboard APAC
 
Influences on empowerment of talented secondary science students dortmund2
Influences on empowerment of talented secondary science students dortmund2Influences on empowerment of talented secondary science students dortmund2
Influences on empowerment of talented secondary science students dortmund2Junior College Utrecht
 
Reflexive learning, socio-cognitive conflict and peer- assessment to improve ...
Reflexive learning, socio-cognitive conflict and peer- assessment to improve ...Reflexive learning, socio-cognitive conflict and peer- assessment to improve ...
Reflexive learning, socio-cognitive conflict and peer- assessment to improve ...Franck Silvestre
 
Recent Findings from the OER Research Fellows
Recent Findings from the OER Research Fellows Recent Findings from the OER Research Fellows
Recent Findings from the OER Research Fellows johnhilton3
 
California Community College Faculty Motivation and Reflection on Open Textbo...
California Community College Faculty Motivation and Reflection on Open Textbo...California Community College Faculty Motivation and Reflection on Open Textbo...
California Community College Faculty Motivation and Reflection on Open Textbo...Una Daly
 
Intro to OER for the University System of Maryland
Intro to OER for the University System of MarylandIntro to OER for the University System of Maryland
Intro to OER for the University System of MarylandLumen Learning
 
Inspiring change in assessment and feedback
Inspiring change in assessment and feedbackInspiring change in assessment and feedback
Inspiring change in assessment and feedbackTansy Jessop
 
Hybrid Courses & Curriculum
Hybrid Courses & CurriculumHybrid Courses & Curriculum
Hybrid Courses & CurriculumChristopher Rice
 
Moodle Moot 2017
Moodle Moot 2017Moodle Moot 2017
Moodle Moot 2017Jenny Crow
 

Similar to PeerWise Bates (STLHE 2013) (20)

Can Student-Generated Content Enhance Learning in Introductory Physics?
Can Student-Generated Content Enhance Learning in Introductory Physics?Can Student-Generated Content Enhance Learning in Introductory Physics?
Can Student-Generated Content Enhance Learning in Introductory Physics?
 
Peerwise - Paul Denny - Edinburgh 2011 (part 2)
Peerwise - Paul Denny - Edinburgh 2011 (part 2)Peerwise - Paul Denny - Edinburgh 2011 (part 2)
Peerwise - Paul Denny - Edinburgh 2011 (part 2)
 
Familiarity breeds content peer wise
Familiarity breeds content peer wiseFamiliarity breeds content peer wise
Familiarity breeds content peer wise
 
Bates inverted classroom
Bates inverted classroomBates inverted classroom
Bates inverted classroom
 
Jennie bullock conf_10
Jennie bullock conf_10Jennie bullock conf_10
Jennie bullock conf_10
 
Scaffolding Problem Based Learning
Scaffolding Problem Based LearningScaffolding Problem Based Learning
Scaffolding Problem Based Learning
 
Improving student learning through programme assessment
Improving student learning through programme assessmentImproving student learning through programme assessment
Improving student learning through programme assessment
 
Skills Development Through Authentic Assessment
Skills Development Through Authentic AssessmentSkills Development Through Authentic Assessment
Skills Development Through Authentic Assessment
 
NTU Innovations in Teaching Seminar - students as co creators
NTU Innovations in Teaching Seminar - students as co creatorsNTU Innovations in Teaching Seminar - students as co creators
NTU Innovations in Teaching Seminar - students as co creators
 
Learner Engagement, QM Standards and the Blended Course
Learner Engagement, QM Standards and the Blended CourseLearner Engagement, QM Standards and the Blended Course
Learner Engagement, QM Standards and the Blended Course
 
Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...
Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...
Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...
 
Influences on empowerment of talented secondary science students dortmund2
Influences on empowerment of talented secondary science students dortmund2Influences on empowerment of talented secondary science students dortmund2
Influences on empowerment of talented secondary science students dortmund2
 
Reflexive learning, socio-cognitive conflict and peer- assessment to improve ...
Reflexive learning, socio-cognitive conflict and peer- assessment to improve ...Reflexive learning, socio-cognitive conflict and peer- assessment to improve ...
Reflexive learning, socio-cognitive conflict and peer- assessment to improve ...
 
Recent Findings from the OER Research Fellows
Recent Findings from the OER Research Fellows Recent Findings from the OER Research Fellows
Recent Findings from the OER Research Fellows
 
California Community College Faculty Motivation and Reflection on Open Textbo...
California Community College Faculty Motivation and Reflection on Open Textbo...California Community College Faculty Motivation and Reflection on Open Textbo...
California Community College Faculty Motivation and Reflection on Open Textbo...
 
Intro to OER for the University System of Maryland
Intro to OER for the University System of MarylandIntro to OER for the University System of Maryland
Intro to OER for the University System of Maryland
 
Inspiring change in assessment and feedback
Inspiring change in assessment and feedbackInspiring change in assessment and feedback
Inspiring change in assessment and feedback
 
HE Course and Module Evaluation Conference - Suzanne Cholerton
HE Course and Module Evaluation Conference - Suzanne Cholerton HE Course and Module Evaluation Conference - Suzanne Cholerton
HE Course and Module Evaluation Conference - Suzanne Cholerton
 
Hybrid Courses & Curriculum
Hybrid Courses & CurriculumHybrid Courses & Curriculum
Hybrid Courses & Curriculum
 
Moodle Moot 2017
Moodle Moot 2017Moodle Moot 2017
Moodle Moot 2017
 

More from Simon Bates

The anatomy of the empowered educator: pathways for institutional support
The anatomy of the empowered educator: pathways for institutional supportThe anatomy of the empowered educator: pathways for institutional support
The anatomy of the empowered educator: pathways for institutional supportSimon Bates
 
Teaching Excellence Summit - the HE perspective on the digital divide
Teaching Excellence Summit - the HE perspective on the digital divideTeaching Excellence Summit - the HE perspective on the digital divide
Teaching Excellence Summit - the HE perspective on the digital divideSimon Bates
 
Students as producers, of high quality engaging assessments to support learning
Students as producers, of high quality engaging assessments to support learningStudents as producers, of high quality engaging assessments to support learning
Students as producers, of high quality engaging assessments to support learningSimon Bates
 
The what, why and how of evidence-based teaching and active learning
The what, why and how of evidence-based teaching and active learningThe what, why and how of evidence-based teaching and active learning
The what, why and how of evidence-based teaching and active learningSimon Bates
 
Beliefs about learning: an interactive quiz
Beliefs about learning: an interactive quizBeliefs about learning: an interactive quiz
Beliefs about learning: an interactive quizSimon Bates
 
Teaching practices, attitudes and perceptions: a multi-institutional study
Teaching practices, attitudes and perceptions: a multi-institutional studyTeaching practices, attitudes and perceptions: a multi-institutional study
Teaching practices, attitudes and perceptions: a multi-institutional studySimon Bates
 
Future evolution of the learning technology ecosystem
Future evolution of the learning technology ecosystemFuture evolution of the learning technology ecosystem
Future evolution of the learning technology ecosystemSimon Bates
 
Development & trends in teaching and learning
Development & trends in teaching and learning Development & trends in teaching and learning
Development & trends in teaching and learning Simon Bates
 
Interactive engagement strategies for large classes
Interactive engagement strategies for large classesInteractive engagement strategies for large classes
Interactive engagement strategies for large classesSimon Bates
 
Breaking out of the 'walled garden'
Breaking out of the 'walled garden'Breaking out of the 'walled garden'
Breaking out of the 'walled garden'Simon Bates
 
The 21st Century Educator
The 21st Century EducatorThe 21st Century Educator
The 21st Century EducatorSimon Bates
 
Workshop at 2016 NTU Learning and Teaching Seminar - Students as Partners in ...
Workshop at 2016 NTU Learning and Teaching Seminar - Students as Partners in ...Workshop at 2016 NTU Learning and Teaching Seminar - Students as Partners in ...
Workshop at 2016 NTU Learning and Teaching Seminar - Students as Partners in ...Simon Bates
 
2 stage exams: assessments of, for and as learning
2 stage exams: assessments of, for and as learning 2 stage exams: assessments of, for and as learning
2 stage exams: assessments of, for and as learning Simon Bates
 
Strategies to enhance student engagement and learning in class: blending and ...
Strategies to enhance student engagement and learning in class: blending and ...Strategies to enhance student engagement and learning in class: blending and ...
Strategies to enhance student engagement and learning in class: blending and ...Simon Bates
 
Think outside the lecture: heads on hands on active learning in the classroom
Think outside the lecture: heads on hands on active learning in the classroomThink outside the lecture: heads on hands on active learning in the classroom
Think outside the lecture: heads on hands on active learning in the classroomSimon Bates
 
Expert Guided Crowd Sourced Learning Content
Expert Guided Crowd Sourced Learning ContentExpert Guided Crowd Sourced Learning Content
Expert Guided Crowd Sourced Learning ContentSimon Bates
 
Deciphering the MOOC ecosystem: what makes successful MOOCs
Deciphering the MOOC ecosystem: what makes successful MOOCsDeciphering the MOOC ecosystem: what makes successful MOOCs
Deciphering the MOOC ecosystem: what makes successful MOOCsSimon Bates
 
Students as producers - expert guided crowd sourcing
Students as producers - expert guided crowd sourcing Students as producers - expert guided crowd sourcing
Students as producers - expert guided crowd sourcing Simon Bates
 
The Anatomy of the 21st Century Educator
The Anatomy of the 21st Century Educator The Anatomy of the 21st Century Educator
The Anatomy of the 21st Century Educator Simon Bates
 

More from Simon Bates (19)

The anatomy of the empowered educator: pathways for institutional support
The anatomy of the empowered educator: pathways for institutional supportThe anatomy of the empowered educator: pathways for institutional support
The anatomy of the empowered educator: pathways for institutional support
 
Teaching Excellence Summit - the HE perspective on the digital divide
Teaching Excellence Summit - the HE perspective on the digital divideTeaching Excellence Summit - the HE perspective on the digital divide
Teaching Excellence Summit - the HE perspective on the digital divide
 
Students as producers, of high quality engaging assessments to support learning
Students as producers, of high quality engaging assessments to support learningStudents as producers, of high quality engaging assessments to support learning
Students as producers, of high quality engaging assessments to support learning
 
The what, why and how of evidence-based teaching and active learning
The what, why and how of evidence-based teaching and active learningThe what, why and how of evidence-based teaching and active learning
The what, why and how of evidence-based teaching and active learning
 
Beliefs about learning: an interactive quiz
Beliefs about learning: an interactive quizBeliefs about learning: an interactive quiz
Beliefs about learning: an interactive quiz
 
Teaching practices, attitudes and perceptions: a multi-institutional study
Teaching practices, attitudes and perceptions: a multi-institutional studyTeaching practices, attitudes and perceptions: a multi-institutional study
Teaching practices, attitudes and perceptions: a multi-institutional study
 
Future evolution of the learning technology ecosystem
Future evolution of the learning technology ecosystemFuture evolution of the learning technology ecosystem
Future evolution of the learning technology ecosystem
 
Development & trends in teaching and learning
Development & trends in teaching and learning Development & trends in teaching and learning
Development & trends in teaching and learning
 
Interactive engagement strategies for large classes
Interactive engagement strategies for large classesInteractive engagement strategies for large classes
Interactive engagement strategies for large classes
 
Breaking out of the 'walled garden'
Breaking out of the 'walled garden'Breaking out of the 'walled garden'
Breaking out of the 'walled garden'
 
The 21st Century Educator
The 21st Century EducatorThe 21st Century Educator
The 21st Century Educator
 
Workshop at 2016 NTU Learning and Teaching Seminar - Students as Partners in ...
Workshop at 2016 NTU Learning and Teaching Seminar - Students as Partners in ...Workshop at 2016 NTU Learning and Teaching Seminar - Students as Partners in ...
Workshop at 2016 NTU Learning and Teaching Seminar - Students as Partners in ...
 
2 stage exams: assessments of, for and as learning
2 stage exams: assessments of, for and as learning 2 stage exams: assessments of, for and as learning
2 stage exams: assessments of, for and as learning
 
Strategies to enhance student engagement and learning in class: blending and ...
Strategies to enhance student engagement and learning in class: blending and ...Strategies to enhance student engagement and learning in class: blending and ...
Strategies to enhance student engagement and learning in class: blending and ...
 
Think outside the lecture: heads on hands on active learning in the classroom
Think outside the lecture: heads on hands on active learning in the classroomThink outside the lecture: heads on hands on active learning in the classroom
Think outside the lecture: heads on hands on active learning in the classroom
 
Expert Guided Crowd Sourced Learning Content
Expert Guided Crowd Sourced Learning ContentExpert Guided Crowd Sourced Learning Content
Expert Guided Crowd Sourced Learning Content
 
Deciphering the MOOC ecosystem: what makes successful MOOCs
Deciphering the MOOC ecosystem: what makes successful MOOCsDeciphering the MOOC ecosystem: what makes successful MOOCs
Deciphering the MOOC ecosystem: what makes successful MOOCs
 
Students as producers - expert guided crowd sourcing
Students as producers - expert guided crowd sourcing Students as producers - expert guided crowd sourcing
Students as producers - expert guided crowd sourcing
 
The Anatomy of the 21st Century Educator
The Anatomy of the 21st Century Educator The Anatomy of the 21st Century Educator
The Anatomy of the 21st Century Educator
 

PeerWise Bates (STLHE 2013)

  • 1. 7  Research-­‐Based  Principles   For  Learning  &  Teaching   Adapted  from  ‘How  Learning  Works’      
  • 3. •  Course-­‐based  online  MulGple  Choice  QuesGon     repository  built  by  students   •  Students:   –  develop new questions with associated explanations –  answer existing questions and rate them for quality and difficulty –  take part in discussions –  can follow other authors peerwise.cs.auckland.ac.nz  
  • 5. 5 As a question author…..
  • 6. 6
  • 7. 7
  • 8.
  • 9.
  • 10. 10 As a question answerer …..
  • 11. 11
  • 12. 12
  • 13. 13
  • 14. 14
  • 16. Implementation in PHAS 101 8 sections (4-3-1) N(total) ~1800 2012 W2 3 sections N ~750 All non majors. 2 PeerWise assignments - scaffolded ahead of the first - support woven into 4 subsequent tutorials 16
  • 17. Assessment requirements As a minimum: •  Write one question •  Answer 5 •  Comment on & rate 3 Contributed 2 x 2.5% to course assessment (mostly participation, small bonus for performance) Student questions on midterm and final 17
  • 18. We were deliberately hands off. •  No moderation •  No corrections •  No interventions at all But we did observe….. 18
  • 21.
  • 23.
  • 24. •  Phys  101  uptake  graph  showing  midterm    
  • 25. Engagement     First  assessment  exercise:     •  664  acGve  students  (85%  of  cohort)     •  1340  Q,  11000  A,  5000  C   •  x1.75,  x17,  x7  minimum  requirements  
  • 28. 28
  • 29.
  • 30.
  • 31. Learning   •  Good  engagement  and  parGcipaGon  beyond   the  minimum  requirements   •  CorrelaGon  between  use  and  end-­‐of-­‐course   outcome   •  ReplicaGon  study  in     3  insGtuGons,  5  courses,   3  disciplines   1st  year  Physics      N=172   University  of  Edinburgh  
  • 32. 1st  year  Physics      N=172   University  of  Edinburgh   1st  year  Chemistry  N=172   University  of  Edinburgh  
  • 33. 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 1 2 3 4 5 6 Taxonomic Category PercentageofSubmittedQuestions Learning   •  QuesGon  quality:  mapped  onto  levels  in   cogniGve  domain  of  Bloom’s  taxonomy   •  Surprisingly  high     overall  quality,  even   from  ‘novices’   First  semester                N  =  350     Second  semester      N  =  252  
  • 34.
  • 35.
  • 36. Acknowledgements Physics 101 course team Georg Rieger Firas Moosvi Emily Altiere UBC CWSEI simon.bates@ubc.ca @simonpbates Ross Galloway Judy Hardy Karon McBride Alison Kay Keith Brunton Jonathan Riise Danny Homer Chemistry – Peter Kirsop Biology – Heather McQueen Physics – Morag Casey Comp Sci – Paul Denny
  • 37.
  • 38. Resources  -­‐  PeerWise   Site: http://peerwise.cs.auckland.ac.nz Community: http://www.PeerWise-Community.org JISC-funded multi institution study: https://www.wiki.ed.ac.uk/display/SGC4L/Home UoE Physics Pilot Study: AIP Conf. Proc. 1413, 359 http://dx.doi.org/10.1063/1.3680069 RSC overview article http://www.rsc.org/Education/EiC/issues/2013January/ student-generated-assessment.asp UoE Physics scaffolding resources http://www2.ph.ed.ac.uk/elearning/projects/peerwise/
  • 39.
  • 40. Question quality analysis (1st year Physics University of Edinburgh) Assessing the quality of a student-generated question repository, submitted to Phys Rev, ST Phys Educ Res. Multi-institution, multi-course study Student-generated content: Enhancing learning through sharing multiple-choice questions, submitted to International Journal of Science Education Scaffolding Student Learning via Online Peer Learning, submitted to International Journal of Science Education Publications in preparation / review / press