Feedback for the longer
term: enhancing student
feedback literacy
@CarlessDavid
University of Hong Kong
June 28, 2018
AHE Manchester
The University of Hong Kong
The University of Hong Kong
The University of Hong Kong
Overview
1. Longer term perspectives
2. Student perspectives
3. Student feedback literacy
4. Challenges & implications
The University of Hong Kong
Defining feedback
A process in which learners make sense of
comments & use them to enhance work or
learning strategies.
Carless & Boud (2018)
The University of Hong Kong
5-year longitudinal inquiry
Longitudinal analysis of four undergraduate
students’ experiences of feedback
The University of Hong Kong
Key research probe
Eliciting examples of feedback that was
acted upon
The University of Hong Kong
Timeliness
Draft  teacher feedback  submission
What was great is that she gave
constructive suggestions about how we can
improve. She pointed out what we can do
and we revised it. (Eva, year 2)
The University of Hong Kong
Action but …
• Short-term, behaviorist
• Limited student agency
• Risk of teacher dependency
The University of Hong Kong
Less is more
“Try not to cover too many points, discuss a
small number in detail” (Candice, year 2)
“In-depth is better than lots of shallow ideas”
(Eva, year 4)
The University of Hong Kong
Using criteria
Philippa & rubrics
The University of Hong Kong
AFFECTIVE ASPECTS
The University of Hong Kong
Feedback is emotional
The University of Hong Kong
Affective responses
Eva’s development:
Year 1: craves support
Year 5: confident enough to face critique
The University of Hong Kong
Timing
“Critical feedback at the end is no use”
(Candice, year 5)
The University of Hong Kong
STUDENT CHANGE
The University of Hong Kong
Long-term change
“I used to procrastinate
a lot but now I leave
myself more time to
revise my assignments
and do proofreading”.
(Alicia)
The University of Hong Kong
Disengagement
“From year 3 onwards I realized that I am
not too good or too bad, so I have lost the
motivation to improve. I still care about the
grades but not that much about the
feedback” (Candice, year 5).
The University of Hong Kong
Role of degree classification
Final year scramble for
desired Degree
Guidance & feedback more
important (Alicia, Eva)
Always grappling with what
the teacher wants (Philippa)
The University of Hong Kong
LONGER-TERM FEEDBACK &
OPEN LOOPS
The University of Hong Kong
Provocative feedback
The most insightful feedback provokes
ongoing thinking and reflection
Puzzlement … confusion … interest
The University of Hong Kong
West Midlands College, Walsall
The University of Hong Kong
Final teaching practice
Supervisor (May 1983):
The University of Hong Kong
“But where’s the pzazz?”
Philippa’s ongoing puzzle
“I want to be synchronized with the markers”
(Year 1)
“I still don’t really know what each teacher is
looking for” (Year 5)
The University of Hong Kong
Feedback Loops
Unclosed loops
Short-term loops
Longer-term loops
Ongoing puzzles
The University of Hong Kong
TACKLING FEEDBACK
CHALLENGES
The University of Hong Kong
Student feedback challenges
Social-affective dimensions
Lack of engagement with feedback
Lack of strategies for using feedback
The way feedback is organized
The University of Hong Kong
Teacher-centred feedback
Too much feedback is not aligned with
students needs and interests
The University of Hong Kong
Limits of Feedback as telling
“Learners do not always
learn much purely from
being told, even when
they are told repeatedly in
the kindest possible way”
(Sadler, 2015, p. 16)
The University of Hong Kong
Social constructivism
Action on feedback is developed through
learner agency, dialogue & co-construction
The University of Hong Kong
INVOLVE STUDENTS MORE
CENTRALLY IN FEEDBACK
PROCESSES
The University of Hong Kong
Eva (year 2)
“Feedback is usually one-way. I am not
going to respond to end-of-module
feedback”.
The University of Hong Kong
A quest for dialogue
“To really understand the students’ needs is
a long-term process. To promote dialogue,
teachers could do more to find out how they
can help us” (Philippa, year 5)
The University of Hong Kong
Student needs
Find out what students want & prefer
The University of Hong Kong
Conditions for uptake
Students will only act if comments align with
their needs … (and belief systems?)
And there are opportunities to act
The University of Hong Kong
STUDENT FEEDBACK
LITERACY
The University of Hong Kong
Defining student feedback literacy
Understandings, capacities and dispositions
needed to make sense of comments and
use them for enhancement purposes
(Carless & Boud, 2018).
The University of Hong Kong
Student feedback literacy
The University of Hong Kong
Making
Judgments
Appreciating
Feedback
Managing
Affect
Taking Action
(Carless & Boud, 2018)
Teacher role
Curriculum & assessment design to promote
generating and using feedback
The University of Hong Kong
IMPLICATIONS FOR
PRACTICE
The University of Hong Kong
The University of Hong Kong
Interactive coversheet
Invite students to state what feedback they
want (Bloxham & Campbell, 2010)
Coversheet follow through
State the previous feedback that you are
using to strengthen this assignment
The University of Hong Kong
Feedback designs
Designs which position students as active
feedback seekers & users (Boud & Molloy,
2013)
The University of Hong Kong
References
Bloxham, S. & Campbell. L. (2010). Generating dialogue in assessment feedback: Exploring the use
of interactive cover sheets. Assessment and Evaluation in Higher Education, 35(3), 291-300.
Boud, D. & Molloy, E. (2013). Rethinking models of feedback for learning: The challenge of design.
Assessment and Evaluation in Higher Education, 38(6), 698-712.
Carless, D. and Boud, D. (2018). The development of student feedback literacy: Enabling uptake of
feedback. Assessment and Evaluation in Higher Education,
https://doi.org/10.1080/02602938.2018.1463354.
Orsmond, P. & Merry, S. (2013). The importance of self-assessment in students’ use of tutors’
feedback: A qualitative study of high and non-high achieving biology undergraduates. Assessment
and Evaluation in Higher Education, 38(6), 737-753.
Sadler, D. R. (2010). Beyond feedback: Developing student capability in complex appraisal.
Assessment and Evaluation in Higher Education, 35(5), 535-550.
Sadler, D.R. (2015). Backwards assessment explanations: Implications for teaching and assessment
practice. In D. Lebler et al. (Eds.), Assessment in music education: From policy to practice (pp.9-
19). Cham: Springer.
Sutton, P. (2012). Conceptualizing feedback literacy: Knowing, being and acting. Innovations in
Education and Teaching International, 49(1), 31-40.
The University of Hong Kong
THANK YOU
The University of Hong Kong
Feedback literacy
Learners need to acquire academic
literacies to interpret complex ideas; &
capacities to act on feedback
(Sutton, 2012)
The University of Hong Kong
Orsmond & Merry, 2013
Limited research on what students do with
feedback; teacher-oriented feedback
models are questionable
The University of Hong Kong
Feedback as telling
Learning from being told is flawed as a
general strategy because the conditions for
the statements to make intimate connection
with the student work (with a view to future
work) are rarely satisfied (Sadler, 2010, p.
548)
The University of Hong Kong
Alicia
I don’t feel that I have received much
feedback that is particularly useful. Often I
just got some feedback which told me what I
was doing wrong (year 2)
I read through the comments but don’t do
anything to follow-up (year 4)
The University of Hong Kong
Candice
For mid-term assignments feedback is more
useful, for end of semester assignments we
don’t come back to it because it is finished.
I can’t generalize the comments to other
subjects because they are a different topic
with a different teacher.
The University of Hong Kong

Feedback for the longer term: enhancing student feedback literacy

  • 1.
    Feedback for thelonger term: enhancing student feedback literacy @CarlessDavid University of Hong Kong June 28, 2018 AHE Manchester The University of Hong Kong
  • 2.
  • 3.
  • 4.
    Overview 1. Longer termperspectives 2. Student perspectives 3. Student feedback literacy 4. Challenges & implications The University of Hong Kong
  • 5.
    Defining feedback A processin which learners make sense of comments & use them to enhance work or learning strategies. Carless & Boud (2018) The University of Hong Kong
  • 6.
    5-year longitudinal inquiry Longitudinalanalysis of four undergraduate students’ experiences of feedback The University of Hong Kong
  • 7.
    Key research probe Elicitingexamples of feedback that was acted upon The University of Hong Kong
  • 8.
    Timeliness Draft  teacherfeedback  submission What was great is that she gave constructive suggestions about how we can improve. She pointed out what we can do and we revised it. (Eva, year 2) The University of Hong Kong
  • 9.
    Action but … •Short-term, behaviorist • Limited student agency • Risk of teacher dependency The University of Hong Kong
  • 10.
    Less is more “Trynot to cover too many points, discuss a small number in detail” (Candice, year 2) “In-depth is better than lots of shallow ideas” (Eva, year 4) The University of Hong Kong
  • 11.
    Using criteria Philippa &rubrics The University of Hong Kong
  • 12.
  • 13.
    Feedback is emotional TheUniversity of Hong Kong
  • 14.
    Affective responses Eva’s development: Year1: craves support Year 5: confident enough to face critique The University of Hong Kong
  • 15.
    Timing “Critical feedback atthe end is no use” (Candice, year 5) The University of Hong Kong
  • 16.
  • 17.
    Long-term change “I usedto procrastinate a lot but now I leave myself more time to revise my assignments and do proofreading”. (Alicia) The University of Hong Kong
  • 18.
    Disengagement “From year 3onwards I realized that I am not too good or too bad, so I have lost the motivation to improve. I still care about the grades but not that much about the feedback” (Candice, year 5). The University of Hong Kong
  • 19.
    Role of degreeclassification Final year scramble for desired Degree Guidance & feedback more important (Alicia, Eva) Always grappling with what the teacher wants (Philippa) The University of Hong Kong
  • 20.
    LONGER-TERM FEEDBACK & OPENLOOPS The University of Hong Kong
  • 21.
    Provocative feedback The mostinsightful feedback provokes ongoing thinking and reflection Puzzlement … confusion … interest The University of Hong Kong
  • 22.
    West Midlands College,Walsall The University of Hong Kong
  • 23.
    Final teaching practice Supervisor(May 1983): The University of Hong Kong “But where’s the pzazz?”
  • 24.
    Philippa’s ongoing puzzle “Iwant to be synchronized with the markers” (Year 1) “I still don’t really know what each teacher is looking for” (Year 5) The University of Hong Kong
  • 25.
    Feedback Loops Unclosed loops Short-termloops Longer-term loops Ongoing puzzles The University of Hong Kong
  • 26.
  • 27.
    Student feedback challenges Social-affectivedimensions Lack of engagement with feedback Lack of strategies for using feedback The way feedback is organized The University of Hong Kong
  • 28.
    Teacher-centred feedback Too muchfeedback is not aligned with students needs and interests The University of Hong Kong
  • 29.
    Limits of Feedbackas telling “Learners do not always learn much purely from being told, even when they are told repeatedly in the kindest possible way” (Sadler, 2015, p. 16) The University of Hong Kong
  • 30.
    Social constructivism Action onfeedback is developed through learner agency, dialogue & co-construction The University of Hong Kong
  • 31.
    INVOLVE STUDENTS MORE CENTRALLYIN FEEDBACK PROCESSES The University of Hong Kong
  • 32.
    Eva (year 2) “Feedbackis usually one-way. I am not going to respond to end-of-module feedback”. The University of Hong Kong
  • 33.
    A quest fordialogue “To really understand the students’ needs is a long-term process. To promote dialogue, teachers could do more to find out how they can help us” (Philippa, year 5) The University of Hong Kong
  • 34.
    Student needs Find outwhat students want & prefer The University of Hong Kong
  • 35.
    Conditions for uptake Studentswill only act if comments align with their needs … (and belief systems?) And there are opportunities to act The University of Hong Kong
  • 36.
  • 37.
    Defining student feedbackliteracy Understandings, capacities and dispositions needed to make sense of comments and use them for enhancement purposes (Carless & Boud, 2018). The University of Hong Kong
  • 38.
    Student feedback literacy TheUniversity of Hong Kong Making Judgments Appreciating Feedback Managing Affect Taking Action (Carless & Boud, 2018)
  • 39.
    Teacher role Curriculum &assessment design to promote generating and using feedback The University of Hong Kong
  • 40.
  • 41.
    The University ofHong Kong Interactive coversheet Invite students to state what feedback they want (Bloxham & Campbell, 2010)
  • 42.
    Coversheet follow through Statethe previous feedback that you are using to strengthen this assignment The University of Hong Kong
  • 43.
    Feedback designs Designs whichposition students as active feedback seekers & users (Boud & Molloy, 2013) The University of Hong Kong
  • 44.
    References Bloxham, S. &Campbell. L. (2010). Generating dialogue in assessment feedback: Exploring the use of interactive cover sheets. Assessment and Evaluation in Higher Education, 35(3), 291-300. Boud, D. & Molloy, E. (2013). Rethinking models of feedback for learning: The challenge of design. Assessment and Evaluation in Higher Education, 38(6), 698-712. Carless, D. and Boud, D. (2018). The development of student feedback literacy: Enabling uptake of feedback. Assessment and Evaluation in Higher Education, https://doi.org/10.1080/02602938.2018.1463354. Orsmond, P. & Merry, S. (2013). The importance of self-assessment in students’ use of tutors’ feedback: A qualitative study of high and non-high achieving biology undergraduates. Assessment and Evaluation in Higher Education, 38(6), 737-753. Sadler, D. R. (2010). Beyond feedback: Developing student capability in complex appraisal. Assessment and Evaluation in Higher Education, 35(5), 535-550. Sadler, D.R. (2015). Backwards assessment explanations: Implications for teaching and assessment practice. In D. Lebler et al. (Eds.), Assessment in music education: From policy to practice (pp.9- 19). Cham: Springer. Sutton, P. (2012). Conceptualizing feedback literacy: Knowing, being and acting. Innovations in Education and Teaching International, 49(1), 31-40. The University of Hong Kong
  • 45.
  • 46.
    Feedback literacy Learners needto acquire academic literacies to interpret complex ideas; & capacities to act on feedback (Sutton, 2012) The University of Hong Kong
  • 47.
    Orsmond & Merry,2013 Limited research on what students do with feedback; teacher-oriented feedback models are questionable The University of Hong Kong
  • 48.
    Feedback as telling Learningfrom being told is flawed as a general strategy because the conditions for the statements to make intimate connection with the student work (with a view to future work) are rarely satisfied (Sadler, 2010, p. 548) The University of Hong Kong
  • 50.
    Alicia I don’t feelthat I have received much feedback that is particularly useful. Often I just got some feedback which told me what I was doing wrong (year 2) I read through the comments but don’t do anything to follow-up (year 4) The University of Hong Kong
  • 51.
    Candice For mid-term assignmentsfeedback is more useful, for end of semester assignments we don’t come back to it because it is finished. I can’t generalize the comments to other subjects because they are a different topic with a different teacher. The University of Hong Kong