Glasgow feedback v1


Published on

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Intro – feedback as continuous correction and the feedback loop Examples Audio – reflect on personal concept map Vid – alt epigeum winner from 2010 Clickers – exeter business school Adaptive – Access – CAA at bradford Mobile – campusM/txttools? Are these the way forward To go next – take examples from the PASS and TESTA projects Bring out the implications of RH work on student identity and mindset – reactions to feedback may be a symptom and not a cause. PASS
  • 03/02/11
  • 03/02/11
  • Glasgow feedback v1

    1. 1. Assessment & feedback: rediscovering that the feedback loop works! Peter Hartley, University of Bradford [email_address] http :// /educational-development/ aboutus / team/Full_details_27414_en.php
    2. 2. This input <ul><li>Exploring the meaning of ‘feedback’ </li></ul><ul><li>Different examples of innovation </li></ul><ul><ul><li>Audio feedback. </li></ul></ul><ul><ul><li>Video and audio combinations. </li></ul></ul><ul><ul><li>Clickers and response systems. </li></ul></ul><ul><ul><li>Adaptive systems. </li></ul></ul><ul><ul><li>Integrating systems and mobile applications. </li></ul></ul><ul><li>Where to go next? </li></ul><ul><ul><li>Feedback-embedded curriculum design. </li></ul></ul><ul><ul><li>Programme-based assessment (PASS project) </li></ul></ul><ul><ul><li>Defining/comparing assessment environments (TESTA project) </li></ul></ul><ul><ul><li>Exploring the assessment/identity link (following Higgins et al). </li></ul></ul>
    3. 3. Assessment is a problem: feedback is just part of it. <ul><li>See the PASS Project Issues Paper </li></ul><ul><ul><li>Please comment/feedback and use. </li></ul></ul><ul><ul><ul><li> </li></ul></ul></ul><ul><li>Would highlight: </li></ul><ul><ul><li>Assessment ‘drives and channels’ </li></ul></ul><ul><ul><li>What/why are we measuring: the ‘slowly learnt’problem. </li></ul></ul><ul><ul><li>Limitations of grading (e.g. marks are not numbers). </li></ul></ul><ul><ul><li>Implications for course structures/regulations </li></ul></ul><ul><ul><li>. </li></ul></ul>
    4. 4. An example to start … <ul><li>59% Excellent. </li></ul><ul><ul><ul><li>This was the only tutor comment on a student assignment. How do you think the student reacted and felt? </li></ul></ul></ul>
    5. 5. The meaning of feedback <ul><ul><li>Cannot we ‘recapture’ the ‘original’ meaning of feedback: enabling self-correcting behaviour towards a known goal. </li></ul></ul><ul><ul><li>This means rediscovering the ‘feedback loop’ whereby information must be ‘fed back’ so that it: </li></ul></ul><ul><ul><ul><li>relates to the goal. </li></ul></ul></ul><ul><ul><ul><li>is received. </li></ul></ul></ul><ul><ul><ul><li>is correctly interpreted. </li></ul></ul></ul><ul><ul><ul><li>enables corrective action. </li></ul></ul></ul><ul><ul><li>cf. the work of Royce Sadler in Higher Education, e.g. </li></ul></ul><ul><ul><ul><li> </li></ul></ul></ul>
    6. 6. Assessment: multi-purpose & multi-audience
    7. 7. Example 1: audio <ul><li>The ASEL project </li></ul><ul><ul><li>led by Bradford with Kingston as partner. </li></ul></ul><ul><ul><li>various uses of audio, including feedback, in different disciplines. </li></ul></ul><ul><li>Noted: </li></ul><ul><ul><li>Technology is now easy and accessible. </li></ul></ul><ul><ul><li>Positive student reactions. </li></ul></ul><ul><ul><li>Different tutor styles and approaches. </li></ul></ul><ul><ul><li>A different form of communication? </li></ul></ul><ul><ul><li>Serendipity – e.g. feedback stimulated podcasts. </li></ul></ul>
    8. 8. ASEL main conclusion <ul><ul><li>… audio is a powerful tool, providing opportunities for personalising learning, promoting greater student engagement, and encouraging creativity. In introducing audio into their practice, lecturers were required to rethink their pedagogical approaches and learning design, adopting new and innovative ways to enable students to be more actively involved in the learning process. It allowed lecturers to provide more personal and richer feedback to students, and increased the level of interaction and dialogue amongst students and between students and lecturers. (Stewart and Dearnley) </li></ul></ul>
    9. 10. Example 2: audio and video <ul><li>Growing number of examples. </li></ul><ul><ul><li>ALT/Epigeum Awards 2010: see the ALT Open Access Repository </li></ul></ul><ul><li>See the winning entry by Read and Brown from Southampton: </li></ul><ul><ul><li>Organic Chemistry. </li></ul></ul><ul><ul><li>Use of tablets to show solutions and working. See at: </li></ul></ul><ul><ul><li>Focus on self-assessment. </li></ul></ul>
    10. 11. Example 3: clickers are coming <ul><li>Student Response Systems at the moment? </li></ul><ul><ul><li>They work … they can change staff and student behaviour and performance. </li></ul></ul><ul><li>But </li></ul><ul><ul><li>can be cumbersome and fiddly. </li></ul></ul><ul><ul><li>setup time. </li></ul></ul><ul><ul><li>need strong commitment and support (e.g. see experience at Exeter Business School). </li></ul></ul>
    11. 12. Example 3: clickers are coming <ul><li>Student Response Systems in the future? </li></ul><ul><ul><li>They will radically change staff and student behaviour. </li></ul></ul><ul><ul><li>They will be flexible and easy to use. </li></ul></ul><ul><ul><li>They will be on the student’s own device! </li></ul></ul>
    12. 13. Example 4: adaptive systems <ul><li>PBL with consequences – you get immediate feedback on the consequences of your decisions. </li></ul><ul><ul><li>e.g. The G4 project at St George’s </li></ul></ul><ul><ul><ul><li> </li></ul></ul></ul><ul><li>Adaptive assessment </li></ul><ul><ul><li>e.g. the work of Trevor Barker </li></ul></ul><ul><ul><ul><li> </li></ul></ul></ul>
    13. 14. Example 5a: integrating systems: CAA <ul><li>IT4SEA project at Bradford </li></ul><ul><ul><li>New 100-seater facility. </li></ul></ul><ul><ul><li>Thin client technology. </li></ul></ul><ul><ul><li>QMP as University standard for summative assessment. </li></ul></ul><ul><ul><li>Procedures agreed with Exam Office. </li></ul></ul><ul><ul><li>Design of room (available as cluster outside assessment times) </li></ul></ul><ul><ul><li>Teaching potential. </li></ul></ul>
    14. 15. The main CAA room at Bradford
    15. 16. And the growth …
    16. 17. Example 5b: integrating applications <ul><li>Use of mobile technology </li></ul><ul><ul><li>e.g. CampusM at Bradford: </li></ul></ul><ul><ul><ul><li> </li></ul></ul></ul><ul><ul><ul><li>;selector-1 </li></ul></ul></ul><ul><li>Integrating different technologies </li></ul><ul><ul><li>e.g. Clive Barker et al: </li></ul></ul><ul><ul><ul><li> </li></ul></ul></ul>
    17. 18. Where to go next? <ul><li>Feedback-embedded curriculum design (see recent/ongoing JISC Programmes ). </li></ul><ul><li>Programme-based assessment (PASS). </li></ul><ul><li>Defining/comparing assessment environments (TESTA project). </li></ul><ul><li>Exploring the assessment/identity link (following Higgins et al). </li></ul>
    18. 19. Programme-based assessment: PASS <ul><li>NTFS group project over 3 years </li></ul><ul><ul><li>development and investigation leading to pilots and implementation </li></ul></ul><ul><li>Consortium </li></ul><ul><ul><li>Led by Bradford </li></ul></ul><ul><ul><li>2 CETLs – ASKE and AfL </li></ul></ul><ul><ul><li>Plus Exeter, Plymouth and Leeds Met. </li></ul></ul>
    19. 20. TESTA project <ul><li>NTFS group project with 4 partners: </li></ul><ul><ul><li>‘ aims to improve the quality of student learning through addressing programme-level assessment. ’ </li></ul></ul><ul><li>starting from audit of current practice on nine programmes: </li></ul><ul><ul><li>surveyed students using focus groups and AEQ – Assessment Experience Questionnaire – Graham Gibbs et al </li></ul></ul><ul><ul><li>also using tool to identify programme level ‘assessment environments’ (Gibbs) </li></ul></ul>
    20. 21. Assessment environment and impact <ul><li>Interim findings from TESTA </li></ul><ul><ul><li>variety of assessments can cause problems </li></ul></ul><ul><ul><li>Issues over understanding assessment criteria, marker variation, and feedback </li></ul></ul><ul><ul><li>variation across programmes </li></ul></ul><ul><ul><li>QA ‘myths and traditions’ can get in the way </li></ul></ul>
    21. 22. The need for strategy <ul><li>An example finding from Gibbs </li></ul><ul><ul><li>‘ greater explicitness of goals and standards was not associated with students experiencing the goals and standards to be clearer’ </li></ul></ul><ul><li>And what did make a difference? </li></ul>
    22. 23. The need for strategy <ul><li>An example finding from Gibbs </li></ul><ul><ul><li>‘ greater explicitness of goals and standards was not associated with students experiencing the goals and standards to be clearer’ </li></ul></ul><ul><li>And what did make a difference? </li></ul><ul><ul><li>Formative-only assessment </li></ul></ul><ul><ul><li>More oral feedback </li></ul></ul><ul><ul><li>Students ‘came to understand standards through many cycles of practice and feedback’ </li></ul></ul>
    23. 24. Typical student concerns (based on PASS) <ul><li>perceptions of ‘the course’ variable. </li></ul><ul><li>assessment experienced as ‘fragmented’. </li></ul><ul><li>anxieties re move to more integrated assessment – perceived risk in terms of performance. </li></ul><ul><li>Concerns about feedback and timing. </li></ul>
    24. 25. An example from PASS: Peninsula Medical School <ul><li>Includes: </li></ul><ul><li>four assessment modules that run through the 5 year undergraduate medical programme and are not linked directly to specific areas of teaching </li></ul><ul><li>focus on high-quality learning (Mattick and Knight, 2007) </li></ul>
    25. 26. Will PBA be the ‘effective assessment strategy’
    26. 27. And finally …assessment/ identity interface <ul><li>Students as ‘conscientious consumers’ (Higgins et al, 2002). </li></ul><ul><li>But: </li></ul><ul><li>personal identity as ‘mediator’. </li></ul><ul><ul><li>e.g. apprentice (‘feedback is useful tool’) cf. victim (‘feedback is another burden’). </li></ul></ul><ul><li>So need to change the mindsets of some students. </li></ul>
    27. 28. And finally finally … some other contacts <ul><li>PASS </li></ul><ul><ul><li>Project Manager: Ruth Whitfield r.whitfield@ </li></ul></ul><ul><li>ASEL </li></ul><ul><ul><li>Project Manager: Will Stewart w.stewart@ </li></ul></ul><ul><li>CAA (building on IT4SEA) </li></ul><ul><ul><li>Project Manager: John Dermo [email_address] </li></ul></ul>