SlideShare a Scribd company logo
Towards making feedback
processes satisfying for teachers
and useful for students
@CarlessDavid
University of Hong Kong
Seminar at University of Surrey
The University of Hong Kong
Acknowledgement
Research Grants Council of Hong Kong
Humanities and Social Sciences Prestigious
Fellowship Scheme Awardee 2022
Feedback literacy for lifelong learning: new
pathways for research and practice
The University of Hong Kong
Overview
1. Feedback needs somewhere to land
2. Curtailing (or abandoning) individual
summative written feedback …
3. Challenges & Implications
The University of Hong Kong
FEEDBACK FROM STUDENTS’
PERSPECTIVES
The University of Hong Kong
Differing perceptions
Questionnaire data from 460 staff & 1740
students
+ qualitative data from BEd Students
Key finding: staff thought their feedback was
much more useful than their students did
(Carless, 2006)
The University of Hong Kong
Assessment dialogues
Discussing assessment processes to help
students understand rules of the game
(Carless, 2006)
The University of Hong Kong
Feedback often seems like …
… a perversely belated revelation of things
that should have been made clear earlier
(Crook, Gross & Dymott, 2006)
The University of Hong Kong
I want
guidance
Guidance
Integrated cycles of guidance & feedback
within learning processes (Hounsell et al.
2008)
The University of Hong Kong
Model of guidance & feedback
Preparatory Guidance
-Clarifying task
-Engaging with criteria
-Analyzing exemplars
Student self-monitoring
-Seeking & using feedback
-Peer review
-Self-evaluation
Ongoing clarification
-Opportunities for practice
-Apply criteria
-Review work in progress
Dissonances & mythologies
Dissonance between teachers’ & students’
assumptions about what feedback is & what
it can do (Adcroft, 2011)
The University of Hong Kong
Timing of critique
For students the Grade is the Feedback!
“I welcome critical feedback when I can use
it to improve my grade but critical feedback
at the end is no use” (student, Carless 2020)
The University of Hong Kong
“Check the grade and log-out”
“The grade is your priority” … “you are not
going to get any more marks for looking at
the feedback” (student, Winstone et al.
2021)
38% of LMS feedback files not accessed
N=484 students
(Mensink & King, 2020)
The University of Hong Kong
TOWARDS ABOLISHING END OF
SEMESTER COMMENTARY
The University of Hong Kong
Main proposition
Reduce end-of-semester written
feedback significantly & replace it
with increased whole-class
guidance during the course
The University of Hong Kong
Tripartite aspirations
Achieving positive NSS results
Making staff workload more productive
Providing actionable feedback for students
The University of Hong Kong
NSS questions
Criteria used for marking clear in advance.
Marking and assessment has been fair.
Feedback on my work has been timely
I received helpful comments on my work.
The University of Hong Kong
Deploy teacher workload wisely
Reduce teacher commentary when it cannot
be used (Boud & Molloy, 2013)
The University of Hong Kong
Collective feedback
How students have performed; common
errors; suggestions for improvement
Key issues: timing for action; activating
students
The University of Hong Kong
Proposed summative template
Sentence 1.
This assignment is {appraisal} because
{grade explanation}
Sentence 2.
In future work, you might consider …
The University of Hong Kong
Challenges
Students have worked hard on assignments,
& want that effort to be reciprocated
Changing status quo
Other?
The University of Hong Kong
Making space for guidance
Talking about feedback as a process
Developing understanding of criteria/standards
Analyzing exemplars of different quality
Well-designed audio/video peer feedback
The University of Hong Kong
Discussing feedback as a process
What feedback means
What it can or can’t do
Key roles & responsibilities
The University of Hong Kong
ALTERNATIVE MODES OF
GUIDANCE
The University of Hong Kong
1. Demystifying criteria
Co-constructing rubrics
Applying rubrics
Analyzing exemplars
(NSS: Criteria clear in advance)
The University of Hong Kong
2. Suggested exemplars sequence
Students draft attempt at task
Exemplars = feedback
Students revise draft
(Lipnevich et al. 2014; To, Panadero &
Carless, 2021; Carless, 2022)
The University of Hong Kong
3. Oral feedback
Timely, interactive, negotiate meaning
But time-consuming
… An occasional option
The University of Hong Kong
Ongoing research
Longitudinal intervention with a feedback seeking
undergraduate
-Transcripts of oral feedback seeking interactions
from the student perspective
-Changes & development over time
(Carless & Young, in progress)
The University of Hong Kong
Elicited feedback encounters
Build rapport & gain inspiration
Thinking together about work-in-progress
Yet anxiety-inducing
The University of Hong Kong
FEEDBACK LITERACIES
The University of Hong Kong
How feedback works
Making the most of feedback opportunities
of different kinds
The University of Hong Kong
Potential Inputs
The University of Hong Kong
Self
Teachers Peers
Materials
Teacher feedback literacy
Expertise in designing feedback processes
to enable student uptake of feedback
(Carless & Winstone, 2020)
The University of Hong Kong
Connected feedback literacies
Working together towards connected
development of feedback literacies
Student Union ... Feedback campaign,
feedback awards
The University of Hong Kong
The University of Hong Kong
Conclusion
The University of Hong Kong
Final thoughts
Strive to appreciate students’ perspectives
on feedback
Avoid wasted effort of commentary that
cannot be readily taken up
Support students with whole-class guidance
The University of Hong Kong
References
Adcroft, A. (2011). The mythology of feedback. Higher Education Research & Development, 30(4),
405-419. doi:10.1080/07294360.2010.526096
Boud, D. & E. Molloy (2013). Decision-making for feedback. In D. Boud & E. Molloy (Eds.), Feedback
in Higher and Professional Education. London: Routledge.
Buckley, A. (2020). Crisis? What crisis? Interpreting student feedback on assessment. Assessment &
Evaluation in Higher Education, https://doi.org/10.1080/02602938.2020.1846015
Carless, D. (2020). A Longitudinal Inquiry into Students’ Experiences of Feedback: A Need for
Teacher-Student Partnerships. Higher Education Research and Development 39(3): 425-438.
Carless, D. (2022). From teacher transmission of information to student feedback literacy: Activating
the learner role in feedback processes. Active Learning in Higher Education, 23(2), 143-153.
https://doi.org/10.1177/1469787420945845
Carless, D., & Winstone, N. (2020). Teacher feedback literacy and its interplay with student feedback
literacy, Teaching in Higher Education. https://doi.org/10.1080/13562517.2020.1782372
Crook, C., Gross, H. & Dymott, R. (2006). Assessment relationships in higher education: The tension
of process and practice. British Educational Research Journal, 32(1), 95-114.
Hounsell, D., McCune, V., Hounsell, J. & Litjens. J. (2008). The quality of guidance and feedback to
students. Higher Education Research and Development, 27(1), 55-67.
Lipnevich, A., L. McCallen, K. Miles, and J. Smith. 2014. “Mind the Gap! Students' Use of Exemplars
and Detailed Rubrics as Formative Assessment”. Instructional Science 42 (4): 539-559.
The University of Hong Kong
References (continued)
Matthews, K., Tai, J., Enright, E., Carless, D., Rafferty, C. & Winstone, N. (2021). Transgressing the
boundaries of ‘students as partners’ and ‘feedback’ discourse communities to advance democratic
education. Teaching in Higher Education https://doi.org/10.1080/13562517.2021.1903854
Mensink, P. & King, K. (2020). Student access of online feedback is modified by the availability of
marks, gender and academic performance. British Journal of Technology, 51(1), 10-22
https://doi.org/10.1111/bjet.12752
To, J., Panadero, E. & Carless, D. (2021). A systematic review of the educational uses and effects of
exemplars. Assessment & Evaluation in Higher Education,
https://doi.org/10.1080/02602938.2021.2011134
Winstone, N., Ajjawi, R., Dirkx, K., & Boud, D. (2021). Measuring what matters: The positioning of
students in feedback Processes within national student satisfaction surveys. Studies in Higher
Education. doi:10.1080/03075079.2021.1916909.
Winstone, N., Bourne, J., Medland, E., Niculescu, I., & Rees, R. (2021). “Check the grade, log out”:
students’ engagement with feedback in learning management systems. Assessment & Evaluation
in Higher Education, 46(4), 631-643.
Winstone, N., & Carless, D. (2019). Designing effective feedback processes in higher education: A
learning-focused approach. London: Routledge.
The University of Hong Kong
QUESTIONS
&
COMMENTS
The University of Hong Kong
Feedback design
Assessment task 1
Assessment task 2
Assessment task 3
The University of Hong Kong
Teacher role
Design learning environments for students
to generate feedback
The University of Hong Kong
The University of Hong Kong

More Related Content

What's hot

Doctorate Dissertation Proposal
Doctorate Dissertation ProposalDoctorate Dissertation Proposal
Doctorate Dissertation Proposal
Maurice Dawson
 
Standardized Tests, by Kathy and Mary
Standardized Tests, by Kathy and MaryStandardized Tests, by Kathy and Mary
Standardized Tests, by Kathy and Mary
marz_bar_angel_9999
 
Higher Level Questioning
Higher Level QuestioningHigher Level Questioning
Higher Level Questioning
Todd_Stanley
 
A Qualitative Phenomenological Study on Prison Volunteers in California’s Cor...
A Qualitative Phenomenological Study on Prison Volunteers in California’s Cor...A Qualitative Phenomenological Study on Prison Volunteers in California’s Cor...
A Qualitative Phenomenological Study on Prison Volunteers in California’s Cor...Donna Madison-Bell
 
How are education policies supporting students to think creatively.pptx
How are education policies supporting students to think creatively.pptxHow are education policies supporting students to think creatively.pptx
How are education policies supporting students to think creatively.pptx
EduSkills OECD
 
Sample Research Proposal for PhD in Mathematics
Sample Research Proposal for PhD in MathematicsSample Research Proposal for PhD in Mathematics
Sample Research Proposal for PhD in Mathematics
PhD Research Proposal
 
A comparative analysis of i-Ready, IXL, and Prodigy learning software programs
A comparative analysis of i-Ready, IXL, and Prodigy learning software programsA comparative analysis of i-Ready, IXL, and Prodigy learning software programs
A comparative analysis of i-Ready, IXL, and Prodigy learning software programs
CristinaRyter
 
ppt norm reference and criteration test
ppt norm reference and criteration testppt norm reference and criteration test
ppt norm reference and criteration testNur Arif S
 
Assessment in Higher Education
Assessment in Higher EducationAssessment in Higher Education
Assessment in Higher Education
NewportCELT
 
Teacher feedback literacy, designing learning environments & prospects for ch...
Teacher feedback literacy, designing learning environments & prospects for ch...Teacher feedback literacy, designing learning environments & prospects for ch...
Teacher feedback literacy, designing learning environments & prospects for ch...
David Carless
 
Classroom climate show
Classroom climate showClassroom climate show
Classroom climate show
professor shamshad
 
Norm criterion
Norm criterionNorm criterion
Norm criterion
dulce amor cruz
 
Exploring Teachers Practices of Classroom Assessment in Secondary Science Cla...
Exploring Teachers Practices of Classroom Assessment in Secondary Science Cla...Exploring Teachers Practices of Classroom Assessment in Secondary Science Cla...
Exploring Teachers Practices of Classroom Assessment in Secondary Science Cla...
Md. Mehadi Rahman
 
Embedded formative assessment
Embedded formative assessmentEmbedded formative assessment
Embedded formative assessment
mmcneffnd
 
Assessment for learning
Assessment for learningAssessment for learning
Assessment for learning
Tansy Jessop
 
Assessment
AssessmentAssessment
Assessment
Lorena Fleitas
 
Topic 8b Item Analysis
Topic 8b Item AnalysisTopic 8b Item Analysis
Topic 8b Item AnalysisYee Bee Choo
 
Standard Setting In Medical Exams
Standard Setting In Medical ExamsStandard Setting In Medical Exams
Standard Setting In Medical Exams
Sanjoy Sanyal
 
The challenges of Assessment and Feedback: findings from an HEA project
The challenges of Assessment and Feedback: findings from an HEA projectThe challenges of Assessment and Feedback: findings from an HEA project
The challenges of Assessment and Feedback: findings from an HEA project
Denise Whitelock
 

What's hot (20)

Doctorate Dissertation Proposal
Doctorate Dissertation ProposalDoctorate Dissertation Proposal
Doctorate Dissertation Proposal
 
Standardized Tests, by Kathy and Mary
Standardized Tests, by Kathy and MaryStandardized Tests, by Kathy and Mary
Standardized Tests, by Kathy and Mary
 
Higher Level Questioning
Higher Level QuestioningHigher Level Questioning
Higher Level Questioning
 
A Qualitative Phenomenological Study on Prison Volunteers in California’s Cor...
A Qualitative Phenomenological Study on Prison Volunteers in California’s Cor...A Qualitative Phenomenological Study on Prison Volunteers in California’s Cor...
A Qualitative Phenomenological Study on Prison Volunteers in California’s Cor...
 
How are education policies supporting students to think creatively.pptx
How are education policies supporting students to think creatively.pptxHow are education policies supporting students to think creatively.pptx
How are education policies supporting students to think creatively.pptx
 
Sample Research Proposal for PhD in Mathematics
Sample Research Proposal for PhD in MathematicsSample Research Proposal for PhD in Mathematics
Sample Research Proposal for PhD in Mathematics
 
A comparative analysis of i-Ready, IXL, and Prodigy learning software programs
A comparative analysis of i-Ready, IXL, and Prodigy learning software programsA comparative analysis of i-Ready, IXL, and Prodigy learning software programs
A comparative analysis of i-Ready, IXL, and Prodigy learning software programs
 
ppt norm reference and criteration test
ppt norm reference and criteration testppt norm reference and criteration test
ppt norm reference and criteration test
 
Assessment in Higher Education
Assessment in Higher EducationAssessment in Higher Education
Assessment in Higher Education
 
Teacher feedback literacy, designing learning environments & prospects for ch...
Teacher feedback literacy, designing learning environments & prospects for ch...Teacher feedback literacy, designing learning environments & prospects for ch...
Teacher feedback literacy, designing learning environments & prospects for ch...
 
Classroom climate show
Classroom climate showClassroom climate show
Classroom climate show
 
Norm criterion
Norm criterionNorm criterion
Norm criterion
 
Exploring Teachers Practices of Classroom Assessment in Secondary Science Cla...
Exploring Teachers Practices of Classroom Assessment in Secondary Science Cla...Exploring Teachers Practices of Classroom Assessment in Secondary Science Cla...
Exploring Teachers Practices of Classroom Assessment in Secondary Science Cla...
 
Embedded formative assessment
Embedded formative assessmentEmbedded formative assessment
Embedded formative assessment
 
Assessment for learning
Assessment for learningAssessment for learning
Assessment for learning
 
Assessment
AssessmentAssessment
Assessment
 
Topic 8b Item Analysis
Topic 8b Item AnalysisTopic 8b Item Analysis
Topic 8b Item Analysis
 
Standard Setting In Medical Exams
Standard Setting In Medical ExamsStandard Setting In Medical Exams
Standard Setting In Medical Exams
 
Educational Research
Educational ResearchEducational Research
Educational Research
 
The challenges of Assessment and Feedback: findings from an HEA project
The challenges of Assessment and Feedback: findings from an HEA projectThe challenges of Assessment and Feedback: findings from an HEA project
The challenges of Assessment and Feedback: findings from an HEA project
 

Similar to Towards making feedback processes satisfying for teachers and useful for students

Supporting Students in Generating and Using Feedback
Supporting Students in Generating and Using FeedbackSupporting Students in Generating and Using Feedback
Supporting Students in Generating and Using Feedback
David Carless
 
Beyond teacher comments: Designing for student uptake of feedback
Beyond teacher comments: Designing for student uptake of feedbackBeyond teacher comments: Designing for student uptake of feedback
Beyond teacher comments: Designing for student uptake of feedback
David Carless
 
Integrating the development of student and staff feedback literacy
Integrating the development of student and staff feedback literacyIntegrating the development of student and staff feedback literacy
Integrating the development of student and staff feedback literacy
David Carless
 
Developing sustainable feedback
Developing sustainable feedback Developing sustainable feedback
Developing sustainable feedback
David Carless
 
Keynote sustainable feedback
Keynote sustainable feedbackKeynote sustainable feedback
Keynote sustainable feedback
David Carless
 
Developing staff and student feedback literacy in partnership
Developing staff and student feedback literacy in partnershipDeveloping staff and student feedback literacy in partnership
Developing staff and student feedback literacy in partnership
David Carless
 
Shared feedback literacy: Designing for productive feedback experiences
Shared feedback literacy: Designing for productive feedback experiencesShared feedback literacy: Designing for productive feedback experiences
Shared feedback literacy: Designing for productive feedback experiences
David Carless
 
Designing satisfying feedback experiences
Designing satisfying feedback experiencesDesigning satisfying feedback experiences
Designing satisfying feedback experiences
David Carless
 
Relieving feedback frustrations
Relieving feedback frustrationsRelieving feedback frustrations
Relieving feedback frustrations
David Carless
 
Developing feedback as dialogue
Developing feedback as dialogueDeveloping feedback as dialogue
Developing feedback as dialogue
David Carless
 
Designing for student uptake of feedback in EAP
Designing for student uptake of feedback in EAPDesigning for student uptake of feedback in EAP
Designing for student uptake of feedback in EAP
David Carless
 
Feedback for student learning as partnership between teachers and students
Feedback for student learning as partnership between teachers and studentsFeedback for student learning as partnership between teachers and students
Feedback for student learning as partnership between teachers and students
David Carless
 
Learner agency, feedback and learning analytics
Learner agency, feedback and learning analyticsLearner agency, feedback and learning analytics
Learner agency, feedback and learning analytics
David Carless
 
Partnership with students in designing feedback processes for large classes
Partnership with students in designing feedback processes for large classesPartnership with students in designing feedback processes for large classes
Partnership with students in designing feedback processes for large classes
David Carless
 
Towards productive teacher-student partnerships in feedback processes
Towards productive teacher-student partnerships in feedback processesTowards productive teacher-student partnerships in feedback processes
Towards productive teacher-student partnerships in feedback processes
David Carless
 
Teacher feedback literacy & feedback designs for student learning
Teacher feedback literacy & feedback designs for student learningTeacher feedback literacy & feedback designs for student learning
Teacher feedback literacy & feedback designs for student learning
David Carless
 
Researching Excellence in Assessment and Feedback
Researching Excellence in Assessment and FeedbackResearching Excellence in Assessment and Feedback
Researching Excellence in Assessment and Feedback
David Carless
 
Learners seeking, generating and using feedback inputs: The role of student a...
Learners seeking, generating and using feedback inputs: The role of student a...Learners seeking, generating and using feedback inputs: The role of student a...
Learners seeking, generating and using feedback inputs: The role of student a...
David Carless
 
Technology-enabled learning-oriented assessment
Technology-enabled learning-oriented assessmentTechnology-enabled learning-oriented assessment
Technology-enabled learning-oriented assessment
David Carless
 
Implementing Peer Feedback
Implementing Peer FeedbackImplementing Peer Feedback
Implementing Peer Feedback
David Carless
 

Similar to Towards making feedback processes satisfying for teachers and useful for students (20)

Supporting Students in Generating and Using Feedback
Supporting Students in Generating and Using FeedbackSupporting Students in Generating and Using Feedback
Supporting Students in Generating and Using Feedback
 
Beyond teacher comments: Designing for student uptake of feedback
Beyond teacher comments: Designing for student uptake of feedbackBeyond teacher comments: Designing for student uptake of feedback
Beyond teacher comments: Designing for student uptake of feedback
 
Integrating the development of student and staff feedback literacy
Integrating the development of student and staff feedback literacyIntegrating the development of student and staff feedback literacy
Integrating the development of student and staff feedback literacy
 
Developing sustainable feedback
Developing sustainable feedback Developing sustainable feedback
Developing sustainable feedback
 
Keynote sustainable feedback
Keynote sustainable feedbackKeynote sustainable feedback
Keynote sustainable feedback
 
Developing staff and student feedback literacy in partnership
Developing staff and student feedback literacy in partnershipDeveloping staff and student feedback literacy in partnership
Developing staff and student feedback literacy in partnership
 
Shared feedback literacy: Designing for productive feedback experiences
Shared feedback literacy: Designing for productive feedback experiencesShared feedback literacy: Designing for productive feedback experiences
Shared feedback literacy: Designing for productive feedback experiences
 
Designing satisfying feedback experiences
Designing satisfying feedback experiencesDesigning satisfying feedback experiences
Designing satisfying feedback experiences
 
Relieving feedback frustrations
Relieving feedback frustrationsRelieving feedback frustrations
Relieving feedback frustrations
 
Developing feedback as dialogue
Developing feedback as dialogueDeveloping feedback as dialogue
Developing feedback as dialogue
 
Designing for student uptake of feedback in EAP
Designing for student uptake of feedback in EAPDesigning for student uptake of feedback in EAP
Designing for student uptake of feedback in EAP
 
Feedback for student learning as partnership between teachers and students
Feedback for student learning as partnership between teachers and studentsFeedback for student learning as partnership between teachers and students
Feedback for student learning as partnership between teachers and students
 
Learner agency, feedback and learning analytics
Learner agency, feedback and learning analyticsLearner agency, feedback and learning analytics
Learner agency, feedback and learning analytics
 
Partnership with students in designing feedback processes for large classes
Partnership with students in designing feedback processes for large classesPartnership with students in designing feedback processes for large classes
Partnership with students in designing feedback processes for large classes
 
Towards productive teacher-student partnerships in feedback processes
Towards productive teacher-student partnerships in feedback processesTowards productive teacher-student partnerships in feedback processes
Towards productive teacher-student partnerships in feedback processes
 
Teacher feedback literacy & feedback designs for student learning
Teacher feedback literacy & feedback designs for student learningTeacher feedback literacy & feedback designs for student learning
Teacher feedback literacy & feedback designs for student learning
 
Researching Excellence in Assessment and Feedback
Researching Excellence in Assessment and FeedbackResearching Excellence in Assessment and Feedback
Researching Excellence in Assessment and Feedback
 
Learners seeking, generating and using feedback inputs: The role of student a...
Learners seeking, generating and using feedback inputs: The role of student a...Learners seeking, generating and using feedback inputs: The role of student a...
Learners seeking, generating and using feedback inputs: The role of student a...
 
Technology-enabled learning-oriented assessment
Technology-enabled learning-oriented assessmentTechnology-enabled learning-oriented assessment
Technology-enabled learning-oriented assessment
 
Implementing Peer Feedback
Implementing Peer FeedbackImplementing Peer Feedback
Implementing Peer Feedback
 

More from David Carless

Feedback literacy, feedback seeking and lifelong learning: Implications for d...
Feedback literacy, feedback seeking and lifelong learning: Implications for d...Feedback literacy, feedback seeking and lifelong learning: Implications for d...
Feedback literacy, feedback seeking and lifelong learning: Implications for d...
David Carless
 
Assessment values & their enactment in the generative AI era
Assessment values & their enactment in the generative AI eraAssessment values & their enactment in the generative AI era
Assessment values & their enactment in the generative AI era
David Carless
 
Learner feedback seeking: prospects and challenges
Learner feedback seeking: prospects and challengesLearner feedback seeking: prospects and challenges
Learner feedback seeking: prospects and challenges
David Carless
 
Assessment and feedback re-designs for the generative AI era
Assessment and feedback re-designs for the generative AI eraAssessment and feedback re-designs for the generative AI era
Assessment and feedback re-designs for the generative AI era
David Carless
 
Feedback literacy for automated feedback
Feedback literacy for automated feedbackFeedback literacy for automated feedback
Feedback literacy for automated feedback
David Carless
 
New directions for feedback seeking research and practice
New directions for feedback seeking research and practiceNew directions for feedback seeking research and practice
New directions for feedback seeking research and practice
David Carless
 
Improvement begins with I: The value of feedback literacy
Improvement begins with I: The value of feedback literacyImprovement begins with I: The value of feedback literacy
Improvement begins with I: The value of feedback literacy
David Carless
 
Feedback requests in ELT and beyond
Feedback requests in ELT and beyondFeedback requests in ELT and beyond
Feedback requests in ELT and beyond
David Carless
 
Assessment and feedback for learning: Beyond closed book exams
Assessment and feedback for learning: Beyond closed book examsAssessment and feedback for learning: Beyond closed book exams
Assessment and feedback for learning: Beyond closed book exams
David Carless
 
Feedback literacy for digital futures
Feedback literacy for digital futuresFeedback literacy for digital futures
Feedback literacy for digital futures
David Carless
 
Assessment for digital futures
Assessment for digital futuresAssessment for digital futures
Assessment for digital futures
David Carless
 
Feedback literacy research and practice: state-of-the art and future directions
Feedback literacy research and practice: state-of-the art and future directionsFeedback literacy research and practice: state-of-the art and future directions
Feedback literacy research and practice: state-of-the art and future directions
David Carless
 
Developing staff & student feedback literacy
Developing staff & student feedback literacyDeveloping staff & student feedback literacy
Developing staff & student feedback literacy
David Carless
 
Creating learning environments for self-generated feedback to thrive
Creating learning environments for  self-generated feedback to thriveCreating learning environments for  self-generated feedback to thrive
Creating learning environments for self-generated feedback to thrive
David Carless
 
Students generating and using feedback in online learning environments
Students generating and using feedback in online learning environmentsStudents generating and using feedback in online learning environments
Students generating and using feedback in online learning environments
David Carless
 
Assessment and feedback in large classes
Assessment and feedback in large classesAssessment and feedback in large classes
Assessment and feedback in large classes
David Carless
 
Sustainable assessment & online learning environments
Sustainable assessment & online learning environmentsSustainable assessment & online learning environments
Sustainable assessment & online learning environments
David Carless
 
Feedback in online learning environments
Feedback in online learning environmentsFeedback in online learning environments
Feedback in online learning environments
David Carless
 
Assessment possibilities
Assessment possibilitiesAssessment possibilities
Assessment possibilities
David Carless
 
Towards broader conceptions of feedback
Towards broader conceptions of feedbackTowards broader conceptions of feedback
Towards broader conceptions of feedback
David Carless
 

More from David Carless (20)

Feedback literacy, feedback seeking and lifelong learning: Implications for d...
Feedback literacy, feedback seeking and lifelong learning: Implications for d...Feedback literacy, feedback seeking and lifelong learning: Implications for d...
Feedback literacy, feedback seeking and lifelong learning: Implications for d...
 
Assessment values & their enactment in the generative AI era
Assessment values & their enactment in the generative AI eraAssessment values & their enactment in the generative AI era
Assessment values & their enactment in the generative AI era
 
Learner feedback seeking: prospects and challenges
Learner feedback seeking: prospects and challengesLearner feedback seeking: prospects and challenges
Learner feedback seeking: prospects and challenges
 
Assessment and feedback re-designs for the generative AI era
Assessment and feedback re-designs for the generative AI eraAssessment and feedback re-designs for the generative AI era
Assessment and feedback re-designs for the generative AI era
 
Feedback literacy for automated feedback
Feedback literacy for automated feedbackFeedback literacy for automated feedback
Feedback literacy for automated feedback
 
New directions for feedback seeking research and practice
New directions for feedback seeking research and practiceNew directions for feedback seeking research and practice
New directions for feedback seeking research and practice
 
Improvement begins with I: The value of feedback literacy
Improvement begins with I: The value of feedback literacyImprovement begins with I: The value of feedback literacy
Improvement begins with I: The value of feedback literacy
 
Feedback requests in ELT and beyond
Feedback requests in ELT and beyondFeedback requests in ELT and beyond
Feedback requests in ELT and beyond
 
Assessment and feedback for learning: Beyond closed book exams
Assessment and feedback for learning: Beyond closed book examsAssessment and feedback for learning: Beyond closed book exams
Assessment and feedback for learning: Beyond closed book exams
 
Feedback literacy for digital futures
Feedback literacy for digital futuresFeedback literacy for digital futures
Feedback literacy for digital futures
 
Assessment for digital futures
Assessment for digital futuresAssessment for digital futures
Assessment for digital futures
 
Feedback literacy research and practice: state-of-the art and future directions
Feedback literacy research and practice: state-of-the art and future directionsFeedback literacy research and practice: state-of-the art and future directions
Feedback literacy research and practice: state-of-the art and future directions
 
Developing staff & student feedback literacy
Developing staff & student feedback literacyDeveloping staff & student feedback literacy
Developing staff & student feedback literacy
 
Creating learning environments for self-generated feedback to thrive
Creating learning environments for  self-generated feedback to thriveCreating learning environments for  self-generated feedback to thrive
Creating learning environments for self-generated feedback to thrive
 
Students generating and using feedback in online learning environments
Students generating and using feedback in online learning environmentsStudents generating and using feedback in online learning environments
Students generating and using feedback in online learning environments
 
Assessment and feedback in large classes
Assessment and feedback in large classesAssessment and feedback in large classes
Assessment and feedback in large classes
 
Sustainable assessment & online learning environments
Sustainable assessment & online learning environmentsSustainable assessment & online learning environments
Sustainable assessment & online learning environments
 
Feedback in online learning environments
Feedback in online learning environmentsFeedback in online learning environments
Feedback in online learning environments
 
Assessment possibilities
Assessment possibilitiesAssessment possibilities
Assessment possibilities
 
Towards broader conceptions of feedback
Towards broader conceptions of feedbackTowards broader conceptions of feedback
Towards broader conceptions of feedback
 

Recently uploaded

Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptxStudents, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
EduSkills OECD
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
siemaillard
 
Basic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumersBasic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumers
PedroFerreira53928
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
Jisc
 
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdfESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
Fundacja Rozwoju Społeczeństwa Przedsiębiorczego
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
EverAndrsGuerraGuerr
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Thiyagu K
 
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
AzmatAli747758
 
Sectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdfSectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdf
Vivekanand Anglo Vedic Academy
 
How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
Jisc
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
BhavyaRajput3
 
Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)
rosedainty
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
bennyroshan06
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
Atul Kumar Singh
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
Pavel ( NSTU)
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
Jisc
 
Polish students' mobility in the Czech Republic
Polish students' mobility in the Czech RepublicPolish students' mobility in the Czech Republic
Polish students' mobility in the Czech Republic
Anna Sz.
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
siemaillard
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
Jheel Barad
 

Recently uploaded (20)

Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptxStudents, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
Basic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumersBasic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumers
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
 
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdfESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
 
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
 
Sectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdfSectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdf
 
How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
 
Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
 
Polish students' mobility in the Czech Republic
Polish students' mobility in the Czech RepublicPolish students' mobility in the Czech Republic
Polish students' mobility in the Czech Republic
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
 

Towards making feedback processes satisfying for teachers and useful for students

  • 1. Towards making feedback processes satisfying for teachers and useful for students @CarlessDavid University of Hong Kong Seminar at University of Surrey The University of Hong Kong
  • 2. Acknowledgement Research Grants Council of Hong Kong Humanities and Social Sciences Prestigious Fellowship Scheme Awardee 2022 Feedback literacy for lifelong learning: new pathways for research and practice The University of Hong Kong
  • 3. Overview 1. Feedback needs somewhere to land 2. Curtailing (or abandoning) individual summative written feedback … 3. Challenges & Implications The University of Hong Kong
  • 5. Differing perceptions Questionnaire data from 460 staff & 1740 students + qualitative data from BEd Students Key finding: staff thought their feedback was much more useful than their students did (Carless, 2006) The University of Hong Kong
  • 6. Assessment dialogues Discussing assessment processes to help students understand rules of the game (Carless, 2006) The University of Hong Kong
  • 7. Feedback often seems like … … a perversely belated revelation of things that should have been made clear earlier (Crook, Gross & Dymott, 2006) The University of Hong Kong I want guidance
  • 8. Guidance Integrated cycles of guidance & feedback within learning processes (Hounsell et al. 2008) The University of Hong Kong
  • 9. Model of guidance & feedback Preparatory Guidance -Clarifying task -Engaging with criteria -Analyzing exemplars Student self-monitoring -Seeking & using feedback -Peer review -Self-evaluation Ongoing clarification -Opportunities for practice -Apply criteria -Review work in progress
  • 10. Dissonances & mythologies Dissonance between teachers’ & students’ assumptions about what feedback is & what it can do (Adcroft, 2011) The University of Hong Kong
  • 11. Timing of critique For students the Grade is the Feedback! “I welcome critical feedback when I can use it to improve my grade but critical feedback at the end is no use” (student, Carless 2020) The University of Hong Kong
  • 12. “Check the grade and log-out” “The grade is your priority” … “you are not going to get any more marks for looking at the feedback” (student, Winstone et al. 2021) 38% of LMS feedback files not accessed N=484 students (Mensink & King, 2020) The University of Hong Kong
  • 13. TOWARDS ABOLISHING END OF SEMESTER COMMENTARY The University of Hong Kong
  • 14. Main proposition Reduce end-of-semester written feedback significantly & replace it with increased whole-class guidance during the course The University of Hong Kong
  • 15. Tripartite aspirations Achieving positive NSS results Making staff workload more productive Providing actionable feedback for students The University of Hong Kong
  • 16. NSS questions Criteria used for marking clear in advance. Marking and assessment has been fair. Feedback on my work has been timely I received helpful comments on my work. The University of Hong Kong
  • 17. Deploy teacher workload wisely Reduce teacher commentary when it cannot be used (Boud & Molloy, 2013) The University of Hong Kong
  • 18. Collective feedback How students have performed; common errors; suggestions for improvement Key issues: timing for action; activating students The University of Hong Kong
  • 19. Proposed summative template Sentence 1. This assignment is {appraisal} because {grade explanation} Sentence 2. In future work, you might consider … The University of Hong Kong
  • 20. Challenges Students have worked hard on assignments, & want that effort to be reciprocated Changing status quo Other? The University of Hong Kong
  • 21. Making space for guidance Talking about feedback as a process Developing understanding of criteria/standards Analyzing exemplars of different quality Well-designed audio/video peer feedback The University of Hong Kong
  • 22. Discussing feedback as a process What feedback means What it can or can’t do Key roles & responsibilities The University of Hong Kong
  • 23. ALTERNATIVE MODES OF GUIDANCE The University of Hong Kong
  • 24. 1. Demystifying criteria Co-constructing rubrics Applying rubrics Analyzing exemplars (NSS: Criteria clear in advance) The University of Hong Kong
  • 25. 2. Suggested exemplars sequence Students draft attempt at task Exemplars = feedback Students revise draft (Lipnevich et al. 2014; To, Panadero & Carless, 2021; Carless, 2022) The University of Hong Kong
  • 26. 3. Oral feedback Timely, interactive, negotiate meaning But time-consuming … An occasional option The University of Hong Kong
  • 27. Ongoing research Longitudinal intervention with a feedback seeking undergraduate -Transcripts of oral feedback seeking interactions from the student perspective -Changes & development over time (Carless & Young, in progress) The University of Hong Kong
  • 28. Elicited feedback encounters Build rapport & gain inspiration Thinking together about work-in-progress Yet anxiety-inducing The University of Hong Kong
  • 30. How feedback works Making the most of feedback opportunities of different kinds The University of Hong Kong
  • 31. Potential Inputs The University of Hong Kong Self Teachers Peers Materials
  • 32. Teacher feedback literacy Expertise in designing feedback processes to enable student uptake of feedback (Carless & Winstone, 2020) The University of Hong Kong
  • 33. Connected feedback literacies Working together towards connected development of feedback literacies Student Union ... Feedback campaign, feedback awards The University of Hong Kong
  • 34. The University of Hong Kong
  • 36. Final thoughts Strive to appreciate students’ perspectives on feedback Avoid wasted effort of commentary that cannot be readily taken up Support students with whole-class guidance The University of Hong Kong
  • 37. References Adcroft, A. (2011). The mythology of feedback. Higher Education Research & Development, 30(4), 405-419. doi:10.1080/07294360.2010.526096 Boud, D. & E. Molloy (2013). Decision-making for feedback. In D. Boud & E. Molloy (Eds.), Feedback in Higher and Professional Education. London: Routledge. Buckley, A. (2020). Crisis? What crisis? Interpreting student feedback on assessment. Assessment & Evaluation in Higher Education, https://doi.org/10.1080/02602938.2020.1846015 Carless, D. (2020). A Longitudinal Inquiry into Students’ Experiences of Feedback: A Need for Teacher-Student Partnerships. Higher Education Research and Development 39(3): 425-438. Carless, D. (2022). From teacher transmission of information to student feedback literacy: Activating the learner role in feedback processes. Active Learning in Higher Education, 23(2), 143-153. https://doi.org/10.1177/1469787420945845 Carless, D., & Winstone, N. (2020). Teacher feedback literacy and its interplay with student feedback literacy, Teaching in Higher Education. https://doi.org/10.1080/13562517.2020.1782372 Crook, C., Gross, H. & Dymott, R. (2006). Assessment relationships in higher education: The tension of process and practice. British Educational Research Journal, 32(1), 95-114. Hounsell, D., McCune, V., Hounsell, J. & Litjens. J. (2008). The quality of guidance and feedback to students. Higher Education Research and Development, 27(1), 55-67. Lipnevich, A., L. McCallen, K. Miles, and J. Smith. 2014. “Mind the Gap! Students' Use of Exemplars and Detailed Rubrics as Formative Assessment”. Instructional Science 42 (4): 539-559. The University of Hong Kong
  • 38. References (continued) Matthews, K., Tai, J., Enright, E., Carless, D., Rafferty, C. & Winstone, N. (2021). Transgressing the boundaries of ‘students as partners’ and ‘feedback’ discourse communities to advance democratic education. Teaching in Higher Education https://doi.org/10.1080/13562517.2021.1903854 Mensink, P. & King, K. (2020). Student access of online feedback is modified by the availability of marks, gender and academic performance. British Journal of Technology, 51(1), 10-22 https://doi.org/10.1111/bjet.12752 To, J., Panadero, E. & Carless, D. (2021). A systematic review of the educational uses and effects of exemplars. Assessment & Evaluation in Higher Education, https://doi.org/10.1080/02602938.2021.2011134 Winstone, N., Ajjawi, R., Dirkx, K., & Boud, D. (2021). Measuring what matters: The positioning of students in feedback Processes within national student satisfaction surveys. Studies in Higher Education. doi:10.1080/03075079.2021.1916909. Winstone, N., Bourne, J., Medland, E., Niculescu, I., & Rees, R. (2021). “Check the grade, log out”: students’ engagement with feedback in learning management systems. Assessment & Evaluation in Higher Education, 46(4), 631-643. Winstone, N., & Carless, D. (2019). Designing effective feedback processes in higher education: A learning-focused approach. London: Routledge. The University of Hong Kong
  • 40. Feedback design Assessment task 1 Assessment task 2 Assessment task 3 The University of Hong Kong
  • 41. Teacher role Design learning environments for students to generate feedback The University of Hong Kong
  • 42. The University of Hong Kong