SlideShare a Scribd company logo
Beyond teacher comments:
Designing for student uptake of
feedback
Professor David Carless,
@CarlessDavid
Faculty of Education,
CETL Feedback Series, HKU,
March 12, 2019
The University of Hong Kong
Overview
1. From telling to student involvement
2. Meeting students’ needs
3. Flipping feedback sequences
4. Designs for large classes
The University of Hong Kong
Feedback is for students
Students’ needs and preferences should be
prioritized
The University of Hong Kong
Student growth
What are we hoping to achieve through
feedback processes?
The University of Hong Kong
Key aim of feedback processes
To enhance student
ability to self-monitor
their work in
progress
The University of Hong Kong
The University of Hong Kong
Feedback challenges
Too much feedback as telling
Lack of engagement with feedback
Lack of strategies for using feedback
The way modules/feedback are organized
The University of Hong Kong
Limits of Feedback as telling
“Learners do not always
learn much purely from
being told, even when
they are told repeatedly in
the kindest possible way”
(Sadler, 2015, p. 16)
The University of Hong Kong
Student frustrations
Feedback often comes at the end of teaching
sequences and it is too late for students to act
The University of Hong Kong
Survey evidence
Students consistently express
dissatisfaction with university feedback
practices
SLEQ SETL
The University of Hong Kong
Feedback often seems like …
… a perversely belated revelation of things
that should have been made clear earlier
(Crook, Gross & Dymott, 2006)
The University of Hong Kong
Feedback graveyards
The University of Hong Kong
DEFINING FEEDBACK
The University of Hong Kong
Feedback as information
Information about performance or
understanding (Hattie & Timperley, 2007)
The University of Hong Kong
Feedback as interaction
All dialogue to support learning in both
formal and informal situations
(Askew & Lodge, 2000)
The University of Hong Kong
Feedback as action
Learners making sense of comments &
using them for improvement (Boud & Molloy,
2013; Carless & Boud, 2018)
The University of Hong Kong
Closing feedback loops
It’s only feedback
if students take
some action
The University of Hong Kong
Social constructivism
Action on feedback is developed through
learner agency, dialogue & co-construction
The University of Hong Kong
Information  action
(Winstone & Carless, 2019)
The University of Hong Kong
The University of Hong Kong
RESEARCH BASE
The University of Hong Kong
Differing perceptions
Study 1. Questionnaire data from 460 staff &
1740 students
Teachers thought their feedback was more
useful than students did (Carless, 2006)
The University of Hong Kong
Sustainable feedback
Study 2. Interviews with 10 award-winning
teachers from 10 different Faculties
Sustainable feedback:
Enhancing student role to generate & use
feedback (Carless et al. 2011)
The University of Hong Kong
Sustainable feedback defined
Activities in which students generate & use
feedback from peers, self or others as part
of self-regulation (Carless, 2013)
The University of Hong Kong
5-year longitudinal inquiry
Study 3. Longitudinal tracking of four
students’ experiences of feedback
(Carless, 2018)
The University of Hong Kong
FOCUS ON THE STUDENTS
The University of Hong Kong
Teacher-centred feedback
Too much feedback is not aligned with
students’ needs and interests
The University of Hong Kong
Helping Students
“Teachers could do more to identify
students’ needs and find out how they can
help us”. (Philippa, year 5)
The University of Hong Kong
Feedback for better grades
The main student consideration is the grade
The University of Hong Kong
Centrality of grades
“Teachers don’t see grades as being as
important as students do.” (Philippa, year 5)
The University of Hong Kong
Flipped feedback
Inverting the sequence of guidance
Students want more support during the
assessment process … & less at its end
The University of Hong Kong
Timing of critique
“I welcome critical feedback when I can use
it to improve my grade but critical feedback
at the end is no use” (Candice, year 5)
The University of Hong Kong
FEEDBACK LITERACY
The University of Hong Kong
Defining student feedback literacy
Understandings, capacities & dispositions
needed to use feedback for improvement
(Carless & Boud, 2018).
The University of Hong Kong
Student feedback literacy
The University of Hong Kong
Making
Judgments
Appreciating
Feedback
Managing
Affect
Taking Action
(Carless & Boud, 2018)
Teacher role
Curriculum & assessment design to promote
generating and using feedback
The University of Hong Kong
Feedback designs
Task 1  feedback  interlinked task 2
Position students as active feedback
seekers & users
The University of Hong Kong
Designs for large classes
• Peer tutoring
• Exemplars as guidance
• Automated feedback e.g. quizzes
• Group projects
• Integrated sequences of rich tasks
The University of Hong Kong
TECHNOLOGY-ENABLED
FEEDBACK STRATEGIES
The University of Hong Kong
Technology & feedback
Pros: Immediacy, attractiveness,
convenience, innovativeness
Cons: Failure to implement sound
feedback designs
The University of Hong Kong
Screencast feedback
Digital recording of users’ screen combined
with voice narration
The University of Hong Kong
Audio & Video feedback
Rapport
Nuance
Personalisation
Uptake & impact?
The University of Hong Kong
Peer video feedback
Peer-to-peer video feedback
delivered via Facebook
Hung (2016)
The University of Hong Kong
Composing peer feedback
Providing feedback more cognitively engaging
than receiving feedback (e.g. Nicol et al., 2014)
The University of Hong Kong
Implications
The University of Hong Kong
Shifts in priorities
The University of Hong Kong
Increase Decrease
Feedback on students’ needs Feedback on teachers’ priorities
Within module guidance Terminal comments
Comments on first task Comments on final task
Feedback for first years Feedback for final year
Use resources wisely
Reduce teacher commentary at times when
it cannot reasonably be taken up (Boud &
Molloy, 2013)
The University of Hong Kong
(Wiliam, 2015)
https://www.dylanwiliamcenter.com/feedback-for
The University of Hong Kong
“Feedback should
be more work for
the recipient than
the donor”
Key recommendations
Focus on learners’ needs
Flip feedback processes
Design for student uptake
The University of Hong Kong
QUESTIONS
&
COMMENTS
The University of Hong Kong
References
Askew, S., & Lodge, C. (2000). Gifts, ping-pong and loops - linking feedback and learning. In S.
Askew (Ed.), Feedback for Learning (pp.1-18). London: Routledge Falmer.
Boud, D. & Molloy, E. (2013). Rethinking models of feedback for learning: The challenge of design.
Assessment and Evaluation in Higher Education, 38(6), 698-712.
Carless, D. (2006). Differing perceptions in the feedback process. Studies in Higher Education, 31(2),
219-233.
Carless, D. (2013). Sustainable feedback and the development of student self-evaluative capacities.
In S. Merry, M. Price, D. Carless & M.. Taras, (Eds.), Reconceptualising Feedback in Higher
Education. London: Routledge.
Carless, D. (2015). Excellence in University Assessment: Learning from award-winning practice.
London: Routledge.
Carless, D. (2018). Feedback loops and the longer-term: Towards feedback spirals. Assessment and
Evaluation in Higher Education, https://doi.org/10.1080/02602938.2018.1531108
Carless, D. & Boud, D. (2018). The development of student feedback literacy: Enabling uptake of
feedback. Assessment and Evaluation in Higher Education,
https://doi.org/10.1080/02602938.2018.1463354.
The University of Hong Kong
References (continued)
Carless, D., Salter, D., Yang, M. & Lam, J. (2011). Developing sustainable feedback practices.
Studies in Higher Education, 36(4), 395-407.
Crook, C., Gross, H. & Dymott, R. (2006). Assessment relationships in higher education: The tension
of process and practice. British Educational Research Journal, 32(1), 95-114.
Hung, S.-T. A. (2016). Enhancing feedback provision through multimodal video technology.
Computers & Education, 98, 90-101.
Nicol, D. (2010). From monologue to dialogue: Improving written feedback processes in mass higher
education. Assessment and Evaluation in Higher Education, 35(5), 501-517.
Nicol, D., Thomson, A. & Breslin, C. (2014). Rethinking feedback practices in higher education: A
peer review perspective. Assessment and Evaluation in Higher Education, 39(1), 102-122.
Sadler, D. R. (2010). Beyond feedback: Developing student capability in complex appraisal.
Assessment and Evaluation in Higher Education, 35(5), 535-550.
Sadler, D.R. (2015). Backwards assessment explanations: Implications for teaching and assessment
practice. In D. Lebler et al. (Eds.), Assessment in music education: From policy to practice (pp.9-
19). Cham: Springer.
Winstone, N. & Carless, D. (2019, in press). Designing effective feedback processes in higher
education: A learning-focused approach. London: Routledge.
The University of Hong Kong
THANK YOU
The University of Hong Kong

More Related Content

What's hot

Importance of feedback in teaching and learning languages
Importance of feedback in teaching and learning languagesImportance of feedback in teaching and learning languages
Importance of feedback in teaching and learning languages
Mahdi Bouguerine
 
Critical review - Teaching Practice
Critical review - Teaching PracticeCritical review - Teaching Practice
Critical review - Teaching Practice
Winston Tambyrajah
 
Bics and calp
Bics and calpBics and calp
Bics and calp
edac4co
 
task-based language teaching
 task-based language teaching task-based language teaching
task-based language teaching
Alex Chacon
 
Diverse Learners
Diverse LearnersDiverse Learners
Diverse Learners
Keith Kirkwood
 
Creating an inclusive classroom finish
Creating an inclusive classroom finishCreating an inclusive classroom finish
Creating an inclusive classroom finisharyanty
 
PhD defence presentation
PhD defence presentationPhD defence presentation
PhD defence presentation
csteinmann
 
Content and language Integrated Learning (CLIL)
Content and language Integrated Learning (CLIL)Content and language Integrated Learning (CLIL)
Content and language Integrated Learning (CLIL)
Suresh Babu
 
Toward a Theory of Second Language Acquisition
Toward a Theory of Second Language AcquisitionToward a Theory of Second Language Acquisition
Toward a Theory of Second Language Acquisition
Noni Ib
 
Beliefs about teaching and learning
Beliefs about teaching and learningBeliefs about teaching and learning
Beliefs about teaching and learningBarbara Reid
 
Language learning styles and strategies
Language learning styles and strategiesLanguage learning styles and strategies
Language learning styles and strategies
UNY Pasca PBI-B
 
Chapter 5 observing learning and teaching in the second language classroom
Chapter 5   observing learning and teaching in the second language classroomChapter 5   observing learning and teaching in the second language classroom
Chapter 5 observing learning and teaching in the second language classroom
Tshen Tashi
 
Curriculum and syllabus design
Curriculum and syllabus designCurriculum and syllabus design
Curriculum and syllabus design
Montse Irun _Chavarria
 
FLIPPED CLASSROOM,ppt
FLIPPED CLASSROOM,pptFLIPPED CLASSROOM,ppt
FLIPPED CLASSROOM,ppt
Shahaziya Ummer
 
Classroom Management & Classroom Interaction
Classroom Management & Classroom InteractionClassroom Management & Classroom Interaction
Classroom Management & Classroom Interaction
Nova Pulsar
 
Traditional Teaching Method vs Now
Traditional Teaching Method vs NowTraditional Teaching Method vs Now
Traditional Teaching Method vs Now
Heri Winarko
 
02 lesson planning
02 lesson planning02 lesson planning
02 lesson planning
Mikhail Rogozin
 
Curriculum Adaptation.ppt
Curriculum Adaptation.pptCurriculum Adaptation.ppt
Curriculum Adaptation.ppt
ParimalBera2
 
Language Learning Strategies
Language Learning StrategiesLanguage Learning Strategies
Language Learning Strategiesguest7066cc
 
L1 and L2 acquisition
L1 and L2 acquisitionL1 and L2 acquisition
L1 and L2 acquisitionjalomi112
 

What's hot (20)

Importance of feedback in teaching and learning languages
Importance of feedback in teaching and learning languagesImportance of feedback in teaching and learning languages
Importance of feedback in teaching and learning languages
 
Critical review - Teaching Practice
Critical review - Teaching PracticeCritical review - Teaching Practice
Critical review - Teaching Practice
 
Bics and calp
Bics and calpBics and calp
Bics and calp
 
task-based language teaching
 task-based language teaching task-based language teaching
task-based language teaching
 
Diverse Learners
Diverse LearnersDiverse Learners
Diverse Learners
 
Creating an inclusive classroom finish
Creating an inclusive classroom finishCreating an inclusive classroom finish
Creating an inclusive classroom finish
 
PhD defence presentation
PhD defence presentationPhD defence presentation
PhD defence presentation
 
Content and language Integrated Learning (CLIL)
Content and language Integrated Learning (CLIL)Content and language Integrated Learning (CLIL)
Content and language Integrated Learning (CLIL)
 
Toward a Theory of Second Language Acquisition
Toward a Theory of Second Language AcquisitionToward a Theory of Second Language Acquisition
Toward a Theory of Second Language Acquisition
 
Beliefs about teaching and learning
Beliefs about teaching and learningBeliefs about teaching and learning
Beliefs about teaching and learning
 
Language learning styles and strategies
Language learning styles and strategiesLanguage learning styles and strategies
Language learning styles and strategies
 
Chapter 5 observing learning and teaching in the second language classroom
Chapter 5   observing learning and teaching in the second language classroomChapter 5   observing learning and teaching in the second language classroom
Chapter 5 observing learning and teaching in the second language classroom
 
Curriculum and syllabus design
Curriculum and syllabus designCurriculum and syllabus design
Curriculum and syllabus design
 
FLIPPED CLASSROOM,ppt
FLIPPED CLASSROOM,pptFLIPPED CLASSROOM,ppt
FLIPPED CLASSROOM,ppt
 
Classroom Management & Classroom Interaction
Classroom Management & Classroom InteractionClassroom Management & Classroom Interaction
Classroom Management & Classroom Interaction
 
Traditional Teaching Method vs Now
Traditional Teaching Method vs NowTraditional Teaching Method vs Now
Traditional Teaching Method vs Now
 
02 lesson planning
02 lesson planning02 lesson planning
02 lesson planning
 
Curriculum Adaptation.ppt
Curriculum Adaptation.pptCurriculum Adaptation.ppt
Curriculum Adaptation.ppt
 
Language Learning Strategies
Language Learning StrategiesLanguage Learning Strategies
Language Learning Strategies
 
L1 and L2 acquisition
L1 and L2 acquisitionL1 and L2 acquisition
L1 and L2 acquisition
 

Similar to Beyond teacher comments: Designing for student uptake of feedback

Supporting Students in Generating and Using Feedback
Supporting Students in Generating and Using FeedbackSupporting Students in Generating and Using Feedback
Supporting Students in Generating and Using Feedback
David Carless
 
Integrating the development of student and staff feedback literacy
Integrating the development of student and staff feedback literacyIntegrating the development of student and staff feedback literacy
Integrating the development of student and staff feedback literacy
David Carless
 
Developing sustainable feedback
Developing sustainable feedback Developing sustainable feedback
Developing sustainable feedback
David Carless
 
Feedback for student learning as partnership between teachers and students
Feedback for student learning as partnership between teachers and studentsFeedback for student learning as partnership between teachers and students
Feedback for student learning as partnership between teachers and students
David Carless
 
Towards making feedback processes satisfying for teachers and useful for stud...
Towards making feedback processes satisfying for teachers and useful for stud...Towards making feedback processes satisfying for teachers and useful for stud...
Towards making feedback processes satisfying for teachers and useful for stud...
David Carless
 
Learner agency, feedback and learning analytics
Learner agency, feedback and learning analyticsLearner agency, feedback and learning analytics
Learner agency, feedback and learning analytics
David Carless
 
Developing feedback as dialogue
Developing feedback as dialogueDeveloping feedback as dialogue
Developing feedback as dialogue
David Carless
 
Keynote sustainable feedback
Keynote sustainable feedbackKeynote sustainable feedback
Keynote sustainable feedback
David Carless
 
Feedback by design
Feedback by design Feedback by design
Feedback by design
David Carless
 
Partnership with students in designing feedback processes for large classes
Partnership with students in designing feedback processes for large classesPartnership with students in designing feedback processes for large classes
Partnership with students in designing feedback processes for large classes
David Carless
 
Designing for student uptake of feedback in EAP
Designing for student uptake of feedback in EAPDesigning for student uptake of feedback in EAP
Designing for student uptake of feedback in EAP
David Carless
 
Learners seeking, generating and using feedback inputs: The role of student a...
Learners seeking, generating and using feedback inputs: The role of student a...Learners seeking, generating and using feedback inputs: The role of student a...
Learners seeking, generating and using feedback inputs: The role of student a...
David Carless
 
Researching Excellence in Assessment and Feedback
Researching Excellence in Assessment and FeedbackResearching Excellence in Assessment and Feedback
Researching Excellence in Assessment and Feedback
David Carless
 
Relieving feedback frustrations
Relieving feedback frustrationsRelieving feedback frustrations
Relieving feedback frustrations
David Carless
 
Designing satisfying feedback experiences
Designing satisfying feedback experiencesDesigning satisfying feedback experiences
Designing satisfying feedback experiences
David Carless
 
Implementing Peer Feedback
Implementing Peer FeedbackImplementing Peer Feedback
Implementing Peer Feedback
David Carless
 
Developing staff and student feedback literacy in partnership
Developing staff and student feedback literacy in partnershipDeveloping staff and student feedback literacy in partnership
Developing staff and student feedback literacy in partnership
David Carless
 
Developing staff & student feedback literacy
Developing staff & student feedback literacyDeveloping staff & student feedback literacy
Developing staff & student feedback literacy
David Carless
 
Shared feedback literacy: Designing for productive feedback experiences
Shared feedback literacy: Designing for productive feedback experiencesShared feedback literacy: Designing for productive feedback experiences
Shared feedback literacy: Designing for productive feedback experiences
David Carless
 
Promoting student engagement with feedback
Promoting student engagement with feedbackPromoting student engagement with feedback
Promoting student engagement with feedback
David Carless
 

Similar to Beyond teacher comments: Designing for student uptake of feedback (20)

Supporting Students in Generating and Using Feedback
Supporting Students in Generating and Using FeedbackSupporting Students in Generating and Using Feedback
Supporting Students in Generating and Using Feedback
 
Integrating the development of student and staff feedback literacy
Integrating the development of student and staff feedback literacyIntegrating the development of student and staff feedback literacy
Integrating the development of student and staff feedback literacy
 
Developing sustainable feedback
Developing sustainable feedback Developing sustainable feedback
Developing sustainable feedback
 
Feedback for student learning as partnership between teachers and students
Feedback for student learning as partnership between teachers and studentsFeedback for student learning as partnership between teachers and students
Feedback for student learning as partnership between teachers and students
 
Towards making feedback processes satisfying for teachers and useful for stud...
Towards making feedback processes satisfying for teachers and useful for stud...Towards making feedback processes satisfying for teachers and useful for stud...
Towards making feedback processes satisfying for teachers and useful for stud...
 
Learner agency, feedback and learning analytics
Learner agency, feedback and learning analyticsLearner agency, feedback and learning analytics
Learner agency, feedback and learning analytics
 
Developing feedback as dialogue
Developing feedback as dialogueDeveloping feedback as dialogue
Developing feedback as dialogue
 
Keynote sustainable feedback
Keynote sustainable feedbackKeynote sustainable feedback
Keynote sustainable feedback
 
Feedback by design
Feedback by design Feedback by design
Feedback by design
 
Partnership with students in designing feedback processes for large classes
Partnership with students in designing feedback processes for large classesPartnership with students in designing feedback processes for large classes
Partnership with students in designing feedback processes for large classes
 
Designing for student uptake of feedback in EAP
Designing for student uptake of feedback in EAPDesigning for student uptake of feedback in EAP
Designing for student uptake of feedback in EAP
 
Learners seeking, generating and using feedback inputs: The role of student a...
Learners seeking, generating and using feedback inputs: The role of student a...Learners seeking, generating and using feedback inputs: The role of student a...
Learners seeking, generating and using feedback inputs: The role of student a...
 
Researching Excellence in Assessment and Feedback
Researching Excellence in Assessment and FeedbackResearching Excellence in Assessment and Feedback
Researching Excellence in Assessment and Feedback
 
Relieving feedback frustrations
Relieving feedback frustrationsRelieving feedback frustrations
Relieving feedback frustrations
 
Designing satisfying feedback experiences
Designing satisfying feedback experiencesDesigning satisfying feedback experiences
Designing satisfying feedback experiences
 
Implementing Peer Feedback
Implementing Peer FeedbackImplementing Peer Feedback
Implementing Peer Feedback
 
Developing staff and student feedback literacy in partnership
Developing staff and student feedback literacy in partnershipDeveloping staff and student feedback literacy in partnership
Developing staff and student feedback literacy in partnership
 
Developing staff & student feedback literacy
Developing staff & student feedback literacyDeveloping staff & student feedback literacy
Developing staff & student feedback literacy
 
Shared feedback literacy: Designing for productive feedback experiences
Shared feedback literacy: Designing for productive feedback experiencesShared feedback literacy: Designing for productive feedback experiences
Shared feedback literacy: Designing for productive feedback experiences
 
Promoting student engagement with feedback
Promoting student engagement with feedbackPromoting student engagement with feedback
Promoting student engagement with feedback
 

More from David Carless

Feedback literacy, feedback seeking and lifelong learning: Implications for d...
Feedback literacy, feedback seeking and lifelong learning: Implications for d...Feedback literacy, feedback seeking and lifelong learning: Implications for d...
Feedback literacy, feedback seeking and lifelong learning: Implications for d...
David Carless
 
Assessment values & their enactment in the generative AI era
Assessment values & their enactment in the generative AI eraAssessment values & their enactment in the generative AI era
Assessment values & their enactment in the generative AI era
David Carless
 
Learner feedback seeking: prospects and challenges
Learner feedback seeking: prospects and challengesLearner feedback seeking: prospects and challenges
Learner feedback seeking: prospects and challenges
David Carless
 
Assessment and feedback re-designs for the generative AI era
Assessment and feedback re-designs for the generative AI eraAssessment and feedback re-designs for the generative AI era
Assessment and feedback re-designs for the generative AI era
David Carless
 
Feedback literacy for automated feedback
Feedback literacy for automated feedbackFeedback literacy for automated feedback
Feedback literacy for automated feedback
David Carless
 
The making of feedback literacy: a critical review of an emerging concept
The making of feedback literacy: a critical review of an emerging conceptThe making of feedback literacy: a critical review of an emerging concept
The making of feedback literacy: a critical review of an emerging concept
David Carless
 
New directions for feedback seeking research and practice
New directions for feedback seeking research and practiceNew directions for feedback seeking research and practice
New directions for feedback seeking research and practice
David Carless
 
Towards productive teacher-student partnerships in feedback processes
Towards productive teacher-student partnerships in feedback processesTowards productive teacher-student partnerships in feedback processes
Towards productive teacher-student partnerships in feedback processes
David Carless
 
Improvement begins with I: The value of feedback literacy
Improvement begins with I: The value of feedback literacyImprovement begins with I: The value of feedback literacy
Improvement begins with I: The value of feedback literacy
David Carless
 
Feedback requests in ELT and beyond
Feedback requests in ELT and beyondFeedback requests in ELT and beyond
Feedback requests in ELT and beyond
David Carless
 
Supporting the development of student feedback literacy
Supporting the development of student feedback literacySupporting the development of student feedback literacy
Supporting the development of student feedback literacy
David Carless
 
Assessment and feedback for learning: Beyond closed book exams
Assessment and feedback for learning: Beyond closed book examsAssessment and feedback for learning: Beyond closed book exams
Assessment and feedback for learning: Beyond closed book exams
David Carless
 
Feedback literacy for digital futures
Feedback literacy for digital futuresFeedback literacy for digital futures
Feedback literacy for digital futures
David Carless
 
Assessment for digital futures
Assessment for digital futuresAssessment for digital futures
Assessment for digital futures
David Carless
 
Teacher feedback literacy, designing learning environments & prospects for ch...
Teacher feedback literacy, designing learning environments & prospects for ch...Teacher feedback literacy, designing learning environments & prospects for ch...
Teacher feedback literacy, designing learning environments & prospects for ch...
David Carless
 
Feedback literacy research and practice: state-of-the art and future directions
Feedback literacy research and practice: state-of-the art and future directionsFeedback literacy research and practice: state-of-the art and future directions
Feedback literacy research and practice: state-of-the art and future directions
David Carless
 
Teacher feedback literacy & feedback designs for student learning
Teacher feedback literacy & feedback designs for student learningTeacher feedback literacy & feedback designs for student learning
Teacher feedback literacy & feedback designs for student learning
David Carless
 
Creating learning environments for self-generated feedback to thrive
Creating learning environments for  self-generated feedback to thriveCreating learning environments for  self-generated feedback to thrive
Creating learning environments for self-generated feedback to thrive
David Carless
 
Students generating and using feedback in online learning environments
Students generating and using feedback in online learning environmentsStudents generating and using feedback in online learning environments
Students generating and using feedback in online learning environments
David Carless
 
Assessment and feedback in large classes
Assessment and feedback in large classesAssessment and feedback in large classes
Assessment and feedback in large classes
David Carless
 

More from David Carless (20)

Feedback literacy, feedback seeking and lifelong learning: Implications for d...
Feedback literacy, feedback seeking and lifelong learning: Implications for d...Feedback literacy, feedback seeking and lifelong learning: Implications for d...
Feedback literacy, feedback seeking and lifelong learning: Implications for d...
 
Assessment values & their enactment in the generative AI era
Assessment values & their enactment in the generative AI eraAssessment values & their enactment in the generative AI era
Assessment values & their enactment in the generative AI era
 
Learner feedback seeking: prospects and challenges
Learner feedback seeking: prospects and challengesLearner feedback seeking: prospects and challenges
Learner feedback seeking: prospects and challenges
 
Assessment and feedback re-designs for the generative AI era
Assessment and feedback re-designs for the generative AI eraAssessment and feedback re-designs for the generative AI era
Assessment and feedback re-designs for the generative AI era
 
Feedback literacy for automated feedback
Feedback literacy for automated feedbackFeedback literacy for automated feedback
Feedback literacy for automated feedback
 
The making of feedback literacy: a critical review of an emerging concept
The making of feedback literacy: a critical review of an emerging conceptThe making of feedback literacy: a critical review of an emerging concept
The making of feedback literacy: a critical review of an emerging concept
 
New directions for feedback seeking research and practice
New directions for feedback seeking research and practiceNew directions for feedback seeking research and practice
New directions for feedback seeking research and practice
 
Towards productive teacher-student partnerships in feedback processes
Towards productive teacher-student partnerships in feedback processesTowards productive teacher-student partnerships in feedback processes
Towards productive teacher-student partnerships in feedback processes
 
Improvement begins with I: The value of feedback literacy
Improvement begins with I: The value of feedback literacyImprovement begins with I: The value of feedback literacy
Improvement begins with I: The value of feedback literacy
 
Feedback requests in ELT and beyond
Feedback requests in ELT and beyondFeedback requests in ELT and beyond
Feedback requests in ELT and beyond
 
Supporting the development of student feedback literacy
Supporting the development of student feedback literacySupporting the development of student feedback literacy
Supporting the development of student feedback literacy
 
Assessment and feedback for learning: Beyond closed book exams
Assessment and feedback for learning: Beyond closed book examsAssessment and feedback for learning: Beyond closed book exams
Assessment and feedback for learning: Beyond closed book exams
 
Feedback literacy for digital futures
Feedback literacy for digital futuresFeedback literacy for digital futures
Feedback literacy for digital futures
 
Assessment for digital futures
Assessment for digital futuresAssessment for digital futures
Assessment for digital futures
 
Teacher feedback literacy, designing learning environments & prospects for ch...
Teacher feedback literacy, designing learning environments & prospects for ch...Teacher feedback literacy, designing learning environments & prospects for ch...
Teacher feedback literacy, designing learning environments & prospects for ch...
 
Feedback literacy research and practice: state-of-the art and future directions
Feedback literacy research and practice: state-of-the art and future directionsFeedback literacy research and practice: state-of-the art and future directions
Feedback literacy research and practice: state-of-the art and future directions
 
Teacher feedback literacy & feedback designs for student learning
Teacher feedback literacy & feedback designs for student learningTeacher feedback literacy & feedback designs for student learning
Teacher feedback literacy & feedback designs for student learning
 
Creating learning environments for self-generated feedback to thrive
Creating learning environments for  self-generated feedback to thriveCreating learning environments for  self-generated feedback to thrive
Creating learning environments for self-generated feedback to thrive
 
Students generating and using feedback in online learning environments
Students generating and using feedback in online learning environmentsStudents generating and using feedback in online learning environments
Students generating and using feedback in online learning environments
 
Assessment and feedback in large classes
Assessment and feedback in large classesAssessment and feedback in large classes
Assessment and feedback in large classes
 

Recently uploaded

Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
MysoreMuleSoftMeetup
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
Vivekanand Anglo Vedic Academy
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
Delapenabediema
 
Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)
rosedainty
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
Pavel ( NSTU)
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
Jisc
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
Jisc
 
The Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve ThomasonThe Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve Thomason
Steve Thomason
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
beazzy04
 
Sectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdfSectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdf
Vivekanand Anglo Vedic Academy
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
Celine George
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
JosvitaDsouza2
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
siemaillard
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
Sandy Millin
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS Module
Celine George
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
Thiyagu K
 
Introduction to Quality Improvement Essentials
Introduction to Quality Improvement EssentialsIntroduction to Quality Improvement Essentials
Introduction to Quality Improvement Essentials
Excellence Foundation for South Sudan
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
bennyroshan06
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
Atul Kumar Singh
 

Recently uploaded (20)

Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
 
Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
 
The Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve ThomasonThe Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve Thomason
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
 
Sectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdfSectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdf
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS Module
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
 
Introduction to Quality Improvement Essentials
Introduction to Quality Improvement EssentialsIntroduction to Quality Improvement Essentials
Introduction to Quality Improvement Essentials
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
 

Beyond teacher comments: Designing for student uptake of feedback

  • 1. Beyond teacher comments: Designing for student uptake of feedback Professor David Carless, @CarlessDavid Faculty of Education, CETL Feedback Series, HKU, March 12, 2019 The University of Hong Kong
  • 2. Overview 1. From telling to student involvement 2. Meeting students’ needs 3. Flipping feedback sequences 4. Designs for large classes The University of Hong Kong
  • 3. Feedback is for students Students’ needs and preferences should be prioritized The University of Hong Kong
  • 4. Student growth What are we hoping to achieve through feedback processes? The University of Hong Kong
  • 5. Key aim of feedback processes To enhance student ability to self-monitor their work in progress The University of Hong Kong
  • 6. The University of Hong Kong
  • 7. Feedback challenges Too much feedback as telling Lack of engagement with feedback Lack of strategies for using feedback The way modules/feedback are organized The University of Hong Kong
  • 8. Limits of Feedback as telling “Learners do not always learn much purely from being told, even when they are told repeatedly in the kindest possible way” (Sadler, 2015, p. 16) The University of Hong Kong
  • 9. Student frustrations Feedback often comes at the end of teaching sequences and it is too late for students to act The University of Hong Kong
  • 10. Survey evidence Students consistently express dissatisfaction with university feedback practices SLEQ SETL The University of Hong Kong
  • 11. Feedback often seems like … … a perversely belated revelation of things that should have been made clear earlier (Crook, Gross & Dymott, 2006) The University of Hong Kong
  • 14. Feedback as information Information about performance or understanding (Hattie & Timperley, 2007) The University of Hong Kong
  • 15. Feedback as interaction All dialogue to support learning in both formal and informal situations (Askew & Lodge, 2000) The University of Hong Kong
  • 16. Feedback as action Learners making sense of comments & using them for improvement (Boud & Molloy, 2013; Carless & Boud, 2018) The University of Hong Kong
  • 17. Closing feedback loops It’s only feedback if students take some action The University of Hong Kong
  • 18. Social constructivism Action on feedback is developed through learner agency, dialogue & co-construction The University of Hong Kong
  • 19. Information  action (Winstone & Carless, 2019) The University of Hong Kong
  • 20. The University of Hong Kong
  • 22. Differing perceptions Study 1. Questionnaire data from 460 staff & 1740 students Teachers thought their feedback was more useful than students did (Carless, 2006) The University of Hong Kong
  • 23. Sustainable feedback Study 2. Interviews with 10 award-winning teachers from 10 different Faculties Sustainable feedback: Enhancing student role to generate & use feedback (Carless et al. 2011) The University of Hong Kong
  • 24. Sustainable feedback defined Activities in which students generate & use feedback from peers, self or others as part of self-regulation (Carless, 2013) The University of Hong Kong
  • 25. 5-year longitudinal inquiry Study 3. Longitudinal tracking of four students’ experiences of feedback (Carless, 2018) The University of Hong Kong
  • 26. FOCUS ON THE STUDENTS The University of Hong Kong
  • 27. Teacher-centred feedback Too much feedback is not aligned with students’ needs and interests The University of Hong Kong
  • 28. Helping Students “Teachers could do more to identify students’ needs and find out how they can help us”. (Philippa, year 5) The University of Hong Kong
  • 29. Feedback for better grades The main student consideration is the grade The University of Hong Kong
  • 30. Centrality of grades “Teachers don’t see grades as being as important as students do.” (Philippa, year 5) The University of Hong Kong
  • 31. Flipped feedback Inverting the sequence of guidance Students want more support during the assessment process … & less at its end The University of Hong Kong
  • 32. Timing of critique “I welcome critical feedback when I can use it to improve my grade but critical feedback at the end is no use” (Candice, year 5) The University of Hong Kong
  • 34. Defining student feedback literacy Understandings, capacities & dispositions needed to use feedback for improvement (Carless & Boud, 2018). The University of Hong Kong
  • 35. Student feedback literacy The University of Hong Kong Making Judgments Appreciating Feedback Managing Affect Taking Action (Carless & Boud, 2018)
  • 36. Teacher role Curriculum & assessment design to promote generating and using feedback The University of Hong Kong
  • 37. Feedback designs Task 1  feedback  interlinked task 2 Position students as active feedback seekers & users The University of Hong Kong
  • 38. Designs for large classes • Peer tutoring • Exemplars as guidance • Automated feedback e.g. quizzes • Group projects • Integrated sequences of rich tasks The University of Hong Kong
  • 40. Technology & feedback Pros: Immediacy, attractiveness, convenience, innovativeness Cons: Failure to implement sound feedback designs The University of Hong Kong
  • 41. Screencast feedback Digital recording of users’ screen combined with voice narration The University of Hong Kong
  • 42. Audio & Video feedback Rapport Nuance Personalisation Uptake & impact? The University of Hong Kong
  • 43. Peer video feedback Peer-to-peer video feedback delivered via Facebook Hung (2016) The University of Hong Kong
  • 44. Composing peer feedback Providing feedback more cognitively engaging than receiving feedback (e.g. Nicol et al., 2014) The University of Hong Kong
  • 46. Shifts in priorities The University of Hong Kong Increase Decrease Feedback on students’ needs Feedback on teachers’ priorities Within module guidance Terminal comments Comments on first task Comments on final task Feedback for first years Feedback for final year
  • 47. Use resources wisely Reduce teacher commentary at times when it cannot reasonably be taken up (Boud & Molloy, 2013) The University of Hong Kong
  • 48. (Wiliam, 2015) https://www.dylanwiliamcenter.com/feedback-for The University of Hong Kong “Feedback should be more work for the recipient than the donor”
  • 49. Key recommendations Focus on learners’ needs Flip feedback processes Design for student uptake The University of Hong Kong
  • 51. References Askew, S., & Lodge, C. (2000). Gifts, ping-pong and loops - linking feedback and learning. In S. Askew (Ed.), Feedback for Learning (pp.1-18). London: Routledge Falmer. Boud, D. & Molloy, E. (2013). Rethinking models of feedback for learning: The challenge of design. Assessment and Evaluation in Higher Education, 38(6), 698-712. Carless, D. (2006). Differing perceptions in the feedback process. Studies in Higher Education, 31(2), 219-233. Carless, D. (2013). Sustainable feedback and the development of student self-evaluative capacities. In S. Merry, M. Price, D. Carless & M.. Taras, (Eds.), Reconceptualising Feedback in Higher Education. London: Routledge. Carless, D. (2015). Excellence in University Assessment: Learning from award-winning practice. London: Routledge. Carless, D. (2018). Feedback loops and the longer-term: Towards feedback spirals. Assessment and Evaluation in Higher Education, https://doi.org/10.1080/02602938.2018.1531108 Carless, D. & Boud, D. (2018). The development of student feedback literacy: Enabling uptake of feedback. Assessment and Evaluation in Higher Education, https://doi.org/10.1080/02602938.2018.1463354. The University of Hong Kong
  • 52. References (continued) Carless, D., Salter, D., Yang, M. & Lam, J. (2011). Developing sustainable feedback practices. Studies in Higher Education, 36(4), 395-407. Crook, C., Gross, H. & Dymott, R. (2006). Assessment relationships in higher education: The tension of process and practice. British Educational Research Journal, 32(1), 95-114. Hung, S.-T. A. (2016). Enhancing feedback provision through multimodal video technology. Computers & Education, 98, 90-101. Nicol, D. (2010). From monologue to dialogue: Improving written feedback processes in mass higher education. Assessment and Evaluation in Higher Education, 35(5), 501-517. Nicol, D., Thomson, A. & Breslin, C. (2014). Rethinking feedback practices in higher education: A peer review perspective. Assessment and Evaluation in Higher Education, 39(1), 102-122. Sadler, D. R. (2010). Beyond feedback: Developing student capability in complex appraisal. Assessment and Evaluation in Higher Education, 35(5), 535-550. Sadler, D.R. (2015). Backwards assessment explanations: Implications for teaching and assessment practice. In D. Lebler et al. (Eds.), Assessment in music education: From policy to practice (pp.9- 19). Cham: Springer. Winstone, N. & Carless, D. (2019, in press). Designing effective feedback processes in higher education: A learning-focused approach. London: Routledge. The University of Hong Kong
  • 53. THANK YOU The University of Hong Kong

Editor's Notes

  1. http://i811.photobucket.com/albums/zz31/angelsofhope_picture/Kinder/r8w2fc.jpg