SlideShare a Scribd company logo
1 of 25
Download to read offline
Reflections on transforming assessment and
feedback: complexity and collaboration.
Debbie Holley, Professor of Learning Innovation
and
Anne Quinney, University Lead for Pedagogical Innovations
in Assessment and Feedback
Bournemouth University
Keynote: Medway 'Creative and Inclusive Assessment and
Feedback' Festival September 10th 2020
Anne Quinney
• Senior Fellow of the HEA (Advance HE)
• Leads the institutional Assessment and
Feedback policies and practice for
Learning and Teaching
• Recently Programme Leader and unit
leader for the PGCert/PGDip and MA
Education Practice
• Interests, in addition to assessment &
feedback, include narrative and visual
research methods
Debbie Holley
• National Teaching Fellow
• Interested in digital assessment and
feedback
• Led the university Centre for promoting
excellence in learning and teaching
• Led the validation of our MA Education
Practice, which included a specialist unit
on Assessment and Feeback
Please be aware …. Cough, voice loss and background noise
warning.
Anne is asthmatic and has builders in doing major renovations!
Audience
participation
invitation
What are the hot topics or sticky
problems in assessment and
feedback at your institution?
Please respond in the chat facility. We will collate the
anonymised responses, write a blog post and share it
back to be disseminated to conference participants
Assessment
and feedback
drivers
National drivers for Assessment &
Feedback
• National Student Survey (NSS)
• The Teaching Excellence and
Student Outcomes Framework
(TEF)
• The ongoing ‘tilt to online’ as a
response to Covid-19 (see
Nordmann et al 2020)
The challenge…..
Assessment practices in most universities have
not kept pace with the vast changes in the
context, aims and structure of higher
education. They can no longer do justice to
the outcomes we expect from a university
education in relation to wide-ranging
knowledge, skills and employability. (Ball et al
2012 p7)
Is a radical
rethink
overdue?
Is a radical rethink overdue?
• The HEA recommended "a radical rethink
of assessment practices and regulations"
and a "holistic and proactive approach (Ball
et al 2012 p8)
• "the greatest potential to improve
student learning is a shift in the balance of
summative and formative assessment (Ball
et all, 2012 p9)
The
Bournemouth
University
response
A year of Assessment and Feedback in 2017/2018 was launched
which included events, resources, and policy re-design:
Fundamental review and revision of the Principles of Assessment
Design policy
Worked in partnership with our Students Union, Academic Quality
colleagues and Faculties
Hosted an Assessment & Feedback Conference
Dai Hounsell, an internationally renowned expert, joined us as a
Visiting Professor
Led workshops, and Masterclasses for credit and CPD
An assessment & feedback pocket guide produced for all staff
Curriculum design workshops were promoted to inform the
programme review and revalidation cycle
Key principles:
• Adopt assessment for learning (Sambell et al
2012) as the key principle for policy and
practice
• Promote of a broader menu of innovative
assessment tasks
• Reduce the volume and number of
assessment tasks
• Recognise the role that Technology
Enhanced Learning (TEL) can play
Academic dilemma 1:
Choosing an appropriate
assessment method:
How many different assessment methods are used on the
programmes you are familiar with?
Please respond with a number in the chat box
Assessment & Feedback Toolkit Headings
50 ways - 4 types
50 ways - 4 types in more detail
Aligned assessment
Matching learning outcomes (graduate attributes)
to innovative assessment options are emphasised at
curriculum design and review phases
Academic dilemma 2:
Students don’t always
understand how to use
feedback
What ideas do you use to help address this?
Please respond in the chat box
‘Flipping’ feedback
• A shift from retrospective feedback to
prospective feedforward
• Reconfiguring teaching and learning activities to
create more opportunities for ‘real-time’ or
‘just-in-time’ feedback for learning
• Embed opportunities for giving, receiving and
responding to feedback
These approaches emphasise feedback as a dialogue and an
exchange of ideas, not only the comments on summative
assignments.
‘Real-time’ feedback – online or on campus
• ‘Boot-grit’ feedback at the end of session: what didn’t you
understand; what needs more explanation. Responses,
explanations, clarification can be posted in the VLE
• In class quizzes and activities can provide rapid feedback on
learning. Breaking into pairs or groups for ‘peer instruction’ can
be used to discuss then revise answers. Team-based learning
works well.
• Adopt the ‘flipped classroom’. In-class time for engagement,
collaboration, understanding is maximised.
Feedback information for students
(REAP project www.reap.ac.uk)
Assessment Literacy
Exploring Peer Feedback in depth (Hounsell 2020)
Triggers for reflection……
Choose one of the headings from the
Peer Feedback Resource and note your
response
The headings include:
• How do students benefit from peer
feedback?
• Does peer feedback have to involve
giving a grade?
• What forms does peer feedback
take?
Authentic
Assessments designed to prepare students for what they
do next, using technology they will use in their careers
Accessible
Assessments designed with an accessibility-first principle
Appropriately automated
A balance found of automated and human marking to
deliver maximum benefit to students
Continuous
Assessment data used to explore opportunities for
continuous assessment to improve the learning
experience
Secure
Authoring detection and biometric authentication
adopted for identification and remote proctoring
JISC 2020
Harnessing the power of new technologies
technologies
How might you use technology to support this?
Please respond in the chat box
Academic dilemma 3:
How to adopt authentic
learning experiences?
Response: Augmented
Reality/Virtual Reality
• Heidi Singleton: doctoral work with a simulated
diabetic patient
• Virtual Technologies in Nurse Education :
• Results from her Randomised Control Trial
demonstrated that students retain the knowledge
longer using technology!
There is a youtube clip demo here
Reflections on transforming pedagogic policy and practice
Underpinned by a collaborative and trans-disciplinary approach
Used the triple helix model of educational innovation (Hutchings and
Quinney 2015, Quinney et al 2017)
But….
Not everyone will embrace change and some will actively resist
Our solution was a shared vision, a robust team approach, the need for
ongoing horizon scanning and the application of soft skills to deliver
‘optimal disruption’
Ball S et al (2012) A marked improvement: transforming assessment in higher education. York: HEA
Boud D and Falkinov N. (2006) Aligning assessment with long term learning. Assessment
and evaluationin higher education. 38(6) p698-712
Hounsell D. Flipping feedback. Undated. Wise Assessment Briefing 12. University of Hong Kong.
https://www.cetl.hku.hk/teaching-learning-cop/wp-content/uploads/2015/08/wise-assessment-briefing12.pdf
Hutchings M and Quinney A, (2015). The flipped classroom, disruptive pedagogies, enabling technologies and wicked problems: responding to the
‘bomb in the basement’. Electronic Journal of E-learning. 13(2) p106-119
Jessop T. (2017). Inspiring transformation through TESTA’s programme approach. In Carless D et al eds. Scaling up assessment for learning in higher education. Springer.
Nicol D and McFarlane D (2006) Formative assessment and self-regulated learning; a model and seven principles of good feedback practice. Studies in Higher Education. 32(2)
p199-21.
Nordmann E, Horlin C, Hutchison J, Murray J-A, Robson L, Seery MK, and MacKay JRD. (2020). 10 simple rules for supporting a temporary online pivot in higher education.
PsyArXiv Preprints
https://psyarxiv.com/qdh25
Price M. undated. Promoting student assessment literacy. Wise Assessment Briefing 7. University of Hong Kong.
https://www.cetl.hku.hk/teaching-learning-cop/wp-content/uploads/2015/08/wise-assessment-briefing7.pdf
Quinney A, Lamont C, Biggins D and Holley D. (2017). Optimising disruptive approaches: extending academic roles and identities in higher education. Journal of Learning
~Development in Higher Education. Issue 12.
Sambell K, McDowell L, and Montgomery, C. (2012). Assessment for learning in higher education. Routledge.
Useful resources
• The Bournemouth University Assessment and Feedback
toolkit. (This externally facing version is incomplete as
work halted to prioritise developments for the internal Toolkit).
• Sally Brown’s blog https://sally-brown.net
• FLIE blog https://microsites.bournemouth.ac.uk/flie/
• Winstone N and Carless D. 2019. Designing effective feedback processes in Higher Education: A learning-
focused approach.

More Related Content

What's hot

Engaging students with inquiry: Project-based learning and problem-based lear...
Engaging students with inquiry: Project-based learning and problem-based lear...Engaging students with inquiry: Project-based learning and problem-based lear...
Engaging students with inquiry: Project-based learning and problem-based lear...Michael M Grant
 
Teaching and learning futures
Teaching and learning futuresTeaching and learning futures
Teaching and learning futuresRebecca Ferguson
 
Successful implementation of the EPQ
Successful implementation of the EPQSuccessful implementation of the EPQ
Successful implementation of the EPQCranleigh School
 
Lessons learned? The digital future of education
Lessons learned? The digital future of educationLessons learned? The digital future of education
Lessons learned? The digital future of educationTexthelp
 
Are Traditional Teaching Methods Right for Today's Students
Are Traditional Teaching Methods Right for Today's StudentsAre Traditional Teaching Methods Right for Today's Students
Are Traditional Teaching Methods Right for Today's StudentsWiley
 
Here project toolkit
Here project toolkitHere project toolkit
Here project toolkitEd Foster
 
24-hour Papers: The Open-Book Alternative to Exams for Online Assessment
24-hour Papers: The Open-Book Alternative to Exams for Online Assessment24-hour Papers: The Open-Book Alternative to Exams for Online Assessment
24-hour Papers: The Open-Book Alternative to Exams for Online AssessmentDavid Hopkins
 
Using badging to motivate and engage learners Mairead Fountain Emma Collins
Using badging to motivate and engage learners Mairead Fountain Emma CollinsUsing badging to motivate and engage learners Mairead Fountain Emma Collins
Using badging to motivate and engage learners Mairead Fountain Emma CollinsePortfolios Australia
 
Actively engaging learners by using a technology enhanced approach that enric...
Actively engaging learners by using a technology enhanced approach that enric...Actively engaging learners by using a technology enhanced approach that enric...
Actively engaging learners by using a technology enhanced approach that enric...Andy Jaffrey
 
Pg cert lthe jim turner
Pg cert lthe jim turnerPg cert lthe jim turner
Pg cert lthe jim turnerClareVMilsom
 
Pbl team pres_may2013
Pbl team pres_may2013Pbl team pres_may2013
Pbl team pres_may2013Mike5050
 
Innovating pedagogy at the OU
Innovating pedagogy at the OUInnovating pedagogy at the OU
Innovating pedagogy at the OURebecca Ferguson
 
Dr. Valerie Irvine 2014 Keynote
Dr. Valerie Irvine 2014 KeynoteDr. Valerie Irvine 2014 Keynote
Dr. Valerie Irvine 2014 KeynoteCOHERE2012
 
Presentation mental health in higher ed exploring the relevance of udl km u...
Presentation mental health in higher ed   exploring the relevance of udl km u...Presentation mental health in higher ed   exploring the relevance of udl km u...
Presentation mental health in higher ed exploring the relevance of udl km u...Frederic Fovet
 
Project based learning
Project based learningProject based learning
Project based learningAtul Thakur
 

What's hot (19)

Project Based Learning
Project Based LearningProject Based Learning
Project Based Learning
 
Engaging students with inquiry: Project-based learning and problem-based lear...
Engaging students with inquiry: Project-based learning and problem-based lear...Engaging students with inquiry: Project-based learning and problem-based lear...
Engaging students with inquiry: Project-based learning and problem-based lear...
 
Teaching and learning futures
Teaching and learning futuresTeaching and learning futures
Teaching and learning futures
 
Successful implementation of the EPQ
Successful implementation of the EPQSuccessful implementation of the EPQ
Successful implementation of the EPQ
 
Lessons learned? The digital future of education
Lessons learned? The digital future of educationLessons learned? The digital future of education
Lessons learned? The digital future of education
 
Are Traditional Teaching Methods Right for Today's Students
Are Traditional Teaching Methods Right for Today's StudentsAre Traditional Teaching Methods Right for Today's Students
Are Traditional Teaching Methods Right for Today's Students
 
Here project toolkit
Here project toolkitHere project toolkit
Here project toolkit
 
24-hour Papers: The Open-Book Alternative to Exams for Online Assessment
24-hour Papers: The Open-Book Alternative to Exams for Online Assessment24-hour Papers: The Open-Book Alternative to Exams for Online Assessment
24-hour Papers: The Open-Book Alternative to Exams for Online Assessment
 
Using badging to motivate and engage learners Mairead Fountain Emma Collins
Using badging to motivate and engage learners Mairead Fountain Emma CollinsUsing badging to motivate and engage learners Mairead Fountain Emma Collins
Using badging to motivate and engage learners Mairead Fountain Emma Collins
 
Hull keynote 15 june 2016
Hull keynote 15 june 2016Hull keynote 15 june 2016
Hull keynote 15 june 2016
 
Actively engaging learners by using a technology enhanced approach that enric...
Actively engaging learners by using a technology enhanced approach that enric...Actively engaging learners by using a technology enhanced approach that enric...
Actively engaging learners by using a technology enhanced approach that enric...
 
Pg cert lthe jim turner
Pg cert lthe jim turnerPg cert lthe jim turner
Pg cert lthe jim turner
 
Pbl team pres_may2013
Pbl team pres_may2013Pbl team pres_may2013
Pbl team pres_may2013
 
Innovating pedagogy at the OU
Innovating pedagogy at the OUInnovating pedagogy at the OU
Innovating pedagogy at the OU
 
Dr. Valerie Irvine 2014 Keynote
Dr. Valerie Irvine 2014 KeynoteDr. Valerie Irvine 2014 Keynote
Dr. Valerie Irvine 2014 Keynote
 
PBL in engineering
PBL in engineeringPBL in engineering
PBL in engineering
 
Presentation mental health in higher ed exploring the relevance of udl km u...
Presentation mental health in higher ed   exploring the relevance of udl km u...Presentation mental health in higher ed   exploring the relevance of udl km u...
Presentation mental health in higher ed exploring the relevance of udl km u...
 
Project based learning in e twinning
Project based learning in e twinning Project based learning in e twinning
Project based learning in e twinning
 
Project based learning
Project based learningProject based learning
Project based learning
 

Similar to Reflections on transforming assessment and feedback: complexity and collaboration

Principles as discourse: A Blueprint for transformational change in assessment
Principles as discourse: A Blueprint for transformational change in assessmentPrinciples as discourse: A Blueprint for transformational change in assessment
Principles as discourse: A Blueprint for transformational change in assessmentSHU Learning & Teaching
 
Feed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedbackFeed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedbackjisc-elearning
 
Manchester Next Generation Spaces keynote
Manchester Next Generation Spaces keynoteManchester Next Generation Spaces keynote
Manchester Next Generation Spaces keynoteAlejandro Armellini
 
Tbl, pbl, ebl, scale up, buzz, virtual or what?
Tbl, pbl, ebl, scale up, buzz, virtual or what?Tbl, pbl, ebl, scale up, buzz, virtual or what?
Tbl, pbl, ebl, scale up, buzz, virtual or what?SEDA
 
Teamwork seda may 2018
Teamwork seda may 2018Teamwork seda may 2018
Teamwork seda may 2018Peter Hartley
 
Teaching Excellence Series: The Educator Perspective
Teaching Excellence Series: The Educator PerspectiveTeaching Excellence Series: The Educator Perspective
Teaching Excellence Series: The Educator PerspectiveNewcastle Educators
 
Jisc webinar: Curriculum design: Changing the paradigm
Jisc webinar: Curriculum design: Changing the paradigmJisc webinar: Curriculum design: Changing the paradigm
Jisc webinar: Curriculum design: Changing the paradigmJisc
 
Sally Brown 2008
Sally Brown 2008Sally Brown 2008
Sally Brown 2008Diana Quinn
 
Assessment and Feedback Using ePortfolios: Shifting to a New Paradigm of Prac...
Assessment and Feedback Using ePortfolios: Shifting to a New Paradigm of Prac...Assessment and Feedback Using ePortfolios: Shifting to a New Paradigm of Prac...
Assessment and Feedback Using ePortfolios: Shifting to a New Paradigm of Prac...ePortfolios Australia
 
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...Diogo Casanova
 
UHI Millennium Institute, HoTLS, Experiential Education Presentation, 2008
UHI Millennium Institute, HoTLS, Experiential Education Presentation, 2008UHI Millennium Institute, HoTLS, Experiential Education Presentation, 2008
UHI Millennium Institute, HoTLS, Experiential Education Presentation, 2008Rob Macpherson
 
Ifp staff training day2
Ifp staff training day2Ifp staff training day2
Ifp staff training day2sarahattersley
 
Icel2013 empowering educators
Icel2013 empowering educatorsIcel2013 empowering educators
Icel2013 empowering educatorsVivienne Bozalek
 
Feedback as dialogue and learning technologies: can e-assessment be formative?
Feedback as dialogue and learning technologies: can e-assessment be formative?Feedback as dialogue and learning technologies: can e-assessment be formative?
Feedback as dialogue and learning technologies: can e-assessment be formative?Centre for Distance Education
 
Forbairt vehicle for improvement
Forbairt vehicle for improvementForbairt vehicle for improvement
Forbairt vehicle for improvementMartin Brown
 
Flipped Classroom A Concept for Engaging Nursing Students in Learning
Flipped Classroom A Concept for Engaging Nursing Students in LearningFlipped Classroom A Concept for Engaging Nursing Students in Learning
Flipped Classroom A Concept for Engaging Nursing Students in Learningijtsrd
 
Bottom Line Presentation
Bottom Line PresentationBottom Line Presentation
Bottom Line PresentationTaylor Edwards
 
BEA Ignite2015 - Davie
BEA Ignite2015 - DavieBEA Ignite2015 - Davie
BEA Ignite2015 - DavieMichael Bruce
 
Online professionaldevelopment[1]
Online professionaldevelopment[1]Online professionaldevelopment[1]
Online professionaldevelopment[1]Stacey Campo
 

Similar to Reflections on transforming assessment and feedback: complexity and collaboration (20)

Principles as discourse: A Blueprint for transformational change in assessment
Principles as discourse: A Blueprint for transformational change in assessmentPrinciples as discourse: A Blueprint for transformational change in assessment
Principles as discourse: A Blueprint for transformational change in assessment
 
Feed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedbackFeed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedback
 
Manchester Next Generation Spaces keynote
Manchester Next Generation Spaces keynoteManchester Next Generation Spaces keynote
Manchester Next Generation Spaces keynote
 
Tbl, pbl, ebl, scale up, buzz, virtual or what?
Tbl, pbl, ebl, scale up, buzz, virtual or what?Tbl, pbl, ebl, scale up, buzz, virtual or what?
Tbl, pbl, ebl, scale up, buzz, virtual or what?
 
Teamwork seda may 2018
Teamwork seda may 2018Teamwork seda may 2018
Teamwork seda may 2018
 
Teaching Excellence Series: The Educator Perspective
Teaching Excellence Series: The Educator PerspectiveTeaching Excellence Series: The Educator Perspective
Teaching Excellence Series: The Educator Perspective
 
Jisc webinar: Curriculum design: Changing the paradigm
Jisc webinar: Curriculum design: Changing the paradigmJisc webinar: Curriculum design: Changing the paradigm
Jisc webinar: Curriculum design: Changing the paradigm
 
Sally Brown 2008
Sally Brown 2008Sally Brown 2008
Sally Brown 2008
 
Assessment and Feedback Using ePortfolios: Shifting to a New Paradigm of Prac...
Assessment and Feedback Using ePortfolios: Shifting to a New Paradigm of Prac...Assessment and Feedback Using ePortfolios: Shifting to a New Paradigm of Prac...
Assessment and Feedback Using ePortfolios: Shifting to a New Paradigm of Prac...
 
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
 
UHI Millennium Institute, HoTLS, Experiential Education Presentation, 2008
UHI Millennium Institute, HoTLS, Experiential Education Presentation, 2008UHI Millennium Institute, HoTLS, Experiential Education Presentation, 2008
UHI Millennium Institute, HoTLS, Experiential Education Presentation, 2008
 
Ifp staff training day2
Ifp staff training day2Ifp staff training day2
Ifp staff training day2
 
Icel2013 empowering educators
Icel2013 empowering educatorsIcel2013 empowering educators
Icel2013 empowering educators
 
Feedback as dialogue and learning technologies: can e-assessment be formative?
Feedback as dialogue and learning technologies: can e-assessment be formative?Feedback as dialogue and learning technologies: can e-assessment be formative?
Feedback as dialogue and learning technologies: can e-assessment be formative?
 
Forbairt vehicle for improvement
Forbairt vehicle for improvementForbairt vehicle for improvement
Forbairt vehicle for improvement
 
Flipped Classroom A Concept for Engaging Nursing Students in Learning
Flipped Classroom A Concept for Engaging Nursing Students in LearningFlipped Classroom A Concept for Engaging Nursing Students in Learning
Flipped Classroom A Concept for Engaging Nursing Students in Learning
 
Poster EARLI SIG 6&7 2016
Poster EARLI SIG 6&7 2016Poster EARLI SIG 6&7 2016
Poster EARLI SIG 6&7 2016
 
Bottom Line Presentation
Bottom Line PresentationBottom Line Presentation
Bottom Line Presentation
 
BEA Ignite2015 - Davie
BEA Ignite2015 - DavieBEA Ignite2015 - Davie
BEA Ignite2015 - Davie
 
Online professionaldevelopment[1]
Online professionaldevelopment[1]Online professionaldevelopment[1]
Online professionaldevelopment[1]
 

More from debbieholley1

Spaghetti Symphony to Technology Harmony
Spaghetti Symphony to Technology  HarmonySpaghetti Symphony to Technology  Harmony
Spaghetti Symphony to Technology Harmonydebbieholley1
 
Student reboot 4.0: the affordances of their Brave New World
Student reboot 4.0: the affordances of their Brave New WorldStudent reboot 4.0: the affordances of their Brave New World
Student reboot 4.0: the affordances of their Brave New Worlddebbieholley1
 
Valuing the invisible: metrics and meaning
Valuing the invisible: metrics and meaningValuing the invisible: metrics and meaning
Valuing the invisible: metrics and meaningdebbieholley1
 
Towards a taxonomy of scale: a sustainable approach
Towards a taxonomy of scale: a sustainable approachTowards a taxonomy of scale: a sustainable approach
Towards a taxonomy of scale: a sustainable approachdebbieholley1
 
The Brave New World of the University of Bedfordshire (v4.0)
The Brave New World of the University of Bedfordshire (v4.0)  The Brave New World of the University of Bedfordshire (v4.0)
The Brave New World of the University of Bedfordshire (v4.0) debbieholley1
 
Creating authentic learning environments: An evaluation of Godzilla (II) the...
Creating authentic learning environments: An evaluation of  Godzilla (II) the...Creating authentic learning environments: An evaluation of  Godzilla (II) the...
Creating authentic learning environments: An evaluation of Godzilla (II) the...debbieholley1
 
Tech Chat: technology mediated learning
Tech Chat: technology mediated learning Tech Chat: technology mediated learning
Tech Chat: technology mediated learning debbieholley1
 
Creating a culture for learning
Creating a culture for learning Creating a culture for learning
Creating a culture for learning debbieholley1
 
Why students engage in simulation and how it prepares them for work
Why students engage in simulation and how it prepares them for workWhy students engage in simulation and how it prepares them for work
Why students engage in simulation and how it prepares them for workdebbieholley1
 
A manifesto for the metaverse: opportunities and challenges for learning deve...
A manifesto for the metaverse: opportunities and challenges for learning deve...A manifesto for the metaverse: opportunities and challenges for learning deve...
A manifesto for the metaverse: opportunities and challenges for learning deve...debbieholley1
 
Recognition for learning developers
Recognition for learning developersRecognition for learning developers
Recognition for learning developersdebbieholley1
 
Why students engage in simulation and how it prepares them for work
Why students engage in simulation and how it prepares them for workWhy students engage in simulation and how it prepares them for work
Why students engage in simulation and how it prepares them for workdebbieholley1
 
Simulation theory briefing paper (ALDinHE Conference 2023)
Simulation theory briefing paper (ALDinHE Conference 2023) Simulation theory briefing paper (ALDinHE Conference 2023)
Simulation theory briefing paper (ALDinHE Conference 2023) debbieholley1
 
Technostress and the student experience
Technostress and the student experienceTechnostress and the student experience
Technostress and the student experiencedebbieholley1
 
Harnessing the Blend: Creating authentic learning experiences
Harnessing the Blend: Creating authentic learning experiencesHarnessing the Blend: Creating authentic learning experiences
Harnessing the Blend: Creating authentic learning experiencesdebbieholley1
 
Metaphor (money) and Metaverse
Metaphor (money) and MetaverseMetaphor (money) and Metaverse
Metaphor (money) and Metaversedebbieholley1
 
"The future is human, and the future of learning is immersive": discuss
 "The future is human, and the future of learning is immersive": discuss  "The future is human, and the future of learning is immersive": discuss
"The future is human, and the future of learning is immersive": discuss debbieholley1
 
Hololens_a starting point
Hololens_a starting pointHololens_a starting point
Hololens_a starting pointdebbieholley1
 
The promise of technology
The promise of technologyThe promise of technology
The promise of technologydebbieholley1
 
Glossary_Tech_ January 23.docx
Glossary_Tech_ January 23.docxGlossary_Tech_ January 23.docx
Glossary_Tech_ January 23.docxdebbieholley1
 

More from debbieholley1 (20)

Spaghetti Symphony to Technology Harmony
Spaghetti Symphony to Technology  HarmonySpaghetti Symphony to Technology  Harmony
Spaghetti Symphony to Technology Harmony
 
Student reboot 4.0: the affordances of their Brave New World
Student reboot 4.0: the affordances of their Brave New WorldStudent reboot 4.0: the affordances of their Brave New World
Student reboot 4.0: the affordances of their Brave New World
 
Valuing the invisible: metrics and meaning
Valuing the invisible: metrics and meaningValuing the invisible: metrics and meaning
Valuing the invisible: metrics and meaning
 
Towards a taxonomy of scale: a sustainable approach
Towards a taxonomy of scale: a sustainable approachTowards a taxonomy of scale: a sustainable approach
Towards a taxonomy of scale: a sustainable approach
 
The Brave New World of the University of Bedfordshire (v4.0)
The Brave New World of the University of Bedfordshire (v4.0)  The Brave New World of the University of Bedfordshire (v4.0)
The Brave New World of the University of Bedfordshire (v4.0)
 
Creating authentic learning environments: An evaluation of Godzilla (II) the...
Creating authentic learning environments: An evaluation of  Godzilla (II) the...Creating authentic learning environments: An evaluation of  Godzilla (II) the...
Creating authentic learning environments: An evaluation of Godzilla (II) the...
 
Tech Chat: technology mediated learning
Tech Chat: technology mediated learning Tech Chat: technology mediated learning
Tech Chat: technology mediated learning
 
Creating a culture for learning
Creating a culture for learning Creating a culture for learning
Creating a culture for learning
 
Why students engage in simulation and how it prepares them for work
Why students engage in simulation and how it prepares them for workWhy students engage in simulation and how it prepares them for work
Why students engage in simulation and how it prepares them for work
 
A manifesto for the metaverse: opportunities and challenges for learning deve...
A manifesto for the metaverse: opportunities and challenges for learning deve...A manifesto for the metaverse: opportunities and challenges for learning deve...
A manifesto for the metaverse: opportunities and challenges for learning deve...
 
Recognition for learning developers
Recognition for learning developersRecognition for learning developers
Recognition for learning developers
 
Why students engage in simulation and how it prepares them for work
Why students engage in simulation and how it prepares them for workWhy students engage in simulation and how it prepares them for work
Why students engage in simulation and how it prepares them for work
 
Simulation theory briefing paper (ALDinHE Conference 2023)
Simulation theory briefing paper (ALDinHE Conference 2023) Simulation theory briefing paper (ALDinHE Conference 2023)
Simulation theory briefing paper (ALDinHE Conference 2023)
 
Technostress and the student experience
Technostress and the student experienceTechnostress and the student experience
Technostress and the student experience
 
Harnessing the Blend: Creating authentic learning experiences
Harnessing the Blend: Creating authentic learning experiencesHarnessing the Blend: Creating authentic learning experiences
Harnessing the Blend: Creating authentic learning experiences
 
Metaphor (money) and Metaverse
Metaphor (money) and MetaverseMetaphor (money) and Metaverse
Metaphor (money) and Metaverse
 
"The future is human, and the future of learning is immersive": discuss
 "The future is human, and the future of learning is immersive": discuss  "The future is human, and the future of learning is immersive": discuss
"The future is human, and the future of learning is immersive": discuss
 
Hololens_a starting point
Hololens_a starting pointHololens_a starting point
Hololens_a starting point
 
The promise of technology
The promise of technologyThe promise of technology
The promise of technology
 
Glossary_Tech_ January 23.docx
Glossary_Tech_ January 23.docxGlossary_Tech_ January 23.docx
Glossary_Tech_ January 23.docx
 

Recently uploaded

Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxRoyAbrique
 
Science 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsScience 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsKarinaGenton
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdfssuser54595a
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13Steve Thomason
 
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfEnzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfSumit Tiwari
 
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Celine George
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTiammrhaywood
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
MENTAL STATUS EXAMINATION format.docx
MENTAL     STATUS EXAMINATION format.docxMENTAL     STATUS EXAMINATION format.docx
MENTAL STATUS EXAMINATION format.docxPoojaSen20
 

Recently uploaded (20)

Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
 
Science 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsScience 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its Characteristics
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Staff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSDStaff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSD
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
 
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfEnzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
 
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
MENTAL STATUS EXAMINATION format.docx
MENTAL     STATUS EXAMINATION format.docxMENTAL     STATUS EXAMINATION format.docx
MENTAL STATUS EXAMINATION format.docx
 

Reflections on transforming assessment and feedback: complexity and collaboration

  • 1. Reflections on transforming assessment and feedback: complexity and collaboration. Debbie Holley, Professor of Learning Innovation and Anne Quinney, University Lead for Pedagogical Innovations in Assessment and Feedback Bournemouth University Keynote: Medway 'Creative and Inclusive Assessment and Feedback' Festival September 10th 2020
  • 2. Anne Quinney • Senior Fellow of the HEA (Advance HE) • Leads the institutional Assessment and Feedback policies and practice for Learning and Teaching • Recently Programme Leader and unit leader for the PGCert/PGDip and MA Education Practice • Interests, in addition to assessment & feedback, include narrative and visual research methods Debbie Holley • National Teaching Fellow • Interested in digital assessment and feedback • Led the university Centre for promoting excellence in learning and teaching • Led the validation of our MA Education Practice, which included a specialist unit on Assessment and Feeback Please be aware …. Cough, voice loss and background noise warning. Anne is asthmatic and has builders in doing major renovations!
  • 3. Audience participation invitation What are the hot topics or sticky problems in assessment and feedback at your institution? Please respond in the chat facility. We will collate the anonymised responses, write a blog post and share it back to be disseminated to conference participants
  • 4. Assessment and feedback drivers National drivers for Assessment & Feedback • National Student Survey (NSS) • The Teaching Excellence and Student Outcomes Framework (TEF) • The ongoing ‘tilt to online’ as a response to Covid-19 (see Nordmann et al 2020)
  • 5. The challenge….. Assessment practices in most universities have not kept pace with the vast changes in the context, aims and structure of higher education. They can no longer do justice to the outcomes we expect from a university education in relation to wide-ranging knowledge, skills and employability. (Ball et al 2012 p7)
  • 6. Is a radical rethink overdue? Is a radical rethink overdue? • The HEA recommended "a radical rethink of assessment practices and regulations" and a "holistic and proactive approach (Ball et al 2012 p8) • "the greatest potential to improve student learning is a shift in the balance of summative and formative assessment (Ball et all, 2012 p9)
  • 7. The Bournemouth University response A year of Assessment and Feedback in 2017/2018 was launched which included events, resources, and policy re-design: Fundamental review and revision of the Principles of Assessment Design policy Worked in partnership with our Students Union, Academic Quality colleagues and Faculties Hosted an Assessment & Feedback Conference Dai Hounsell, an internationally renowned expert, joined us as a Visiting Professor Led workshops, and Masterclasses for credit and CPD An assessment & feedback pocket guide produced for all staff Curriculum design workshops were promoted to inform the programme review and revalidation cycle
  • 8. Key principles: • Adopt assessment for learning (Sambell et al 2012) as the key principle for policy and practice • Promote of a broader menu of innovative assessment tasks • Reduce the volume and number of assessment tasks • Recognise the role that Technology Enhanced Learning (TEL) can play
  • 9. Academic dilemma 1: Choosing an appropriate assessment method: How many different assessment methods are used on the programmes you are familiar with? Please respond with a number in the chat box
  • 10. Assessment & Feedback Toolkit Headings
  • 11. 50 ways - 4 types
  • 12. 50 ways - 4 types in more detail
  • 13. Aligned assessment Matching learning outcomes (graduate attributes) to innovative assessment options are emphasised at curriculum design and review phases
  • 14. Academic dilemma 2: Students don’t always understand how to use feedback What ideas do you use to help address this? Please respond in the chat box
  • 15. ‘Flipping’ feedback • A shift from retrospective feedback to prospective feedforward • Reconfiguring teaching and learning activities to create more opportunities for ‘real-time’ or ‘just-in-time’ feedback for learning • Embed opportunities for giving, receiving and responding to feedback These approaches emphasise feedback as a dialogue and an exchange of ideas, not only the comments on summative assignments.
  • 16. ‘Real-time’ feedback – online or on campus • ‘Boot-grit’ feedback at the end of session: what didn’t you understand; what needs more explanation. Responses, explanations, clarification can be posted in the VLE • In class quizzes and activities can provide rapid feedback on learning. Breaking into pairs or groups for ‘peer instruction’ can be used to discuss then revise answers. Team-based learning works well. • Adopt the ‘flipped classroom’. In-class time for engagement, collaboration, understanding is maximised.
  • 17. Feedback information for students (REAP project www.reap.ac.uk)
  • 19. Exploring Peer Feedback in depth (Hounsell 2020) Triggers for reflection…… Choose one of the headings from the Peer Feedback Resource and note your response The headings include: • How do students benefit from peer feedback? • Does peer feedback have to involve giving a grade? • What forms does peer feedback take?
  • 20. Authentic Assessments designed to prepare students for what they do next, using technology they will use in their careers Accessible Assessments designed with an accessibility-first principle Appropriately automated A balance found of automated and human marking to deliver maximum benefit to students Continuous Assessment data used to explore opportunities for continuous assessment to improve the learning experience Secure Authoring detection and biometric authentication adopted for identification and remote proctoring JISC 2020 Harnessing the power of new technologies technologies
  • 21. How might you use technology to support this? Please respond in the chat box Academic dilemma 3: How to adopt authentic learning experiences?
  • 22. Response: Augmented Reality/Virtual Reality • Heidi Singleton: doctoral work with a simulated diabetic patient • Virtual Technologies in Nurse Education : • Results from her Randomised Control Trial demonstrated that students retain the knowledge longer using technology! There is a youtube clip demo here
  • 23. Reflections on transforming pedagogic policy and practice Underpinned by a collaborative and trans-disciplinary approach Used the triple helix model of educational innovation (Hutchings and Quinney 2015, Quinney et al 2017) But…. Not everyone will embrace change and some will actively resist Our solution was a shared vision, a robust team approach, the need for ongoing horizon scanning and the application of soft skills to deliver ‘optimal disruption’
  • 24. Ball S et al (2012) A marked improvement: transforming assessment in higher education. York: HEA Boud D and Falkinov N. (2006) Aligning assessment with long term learning. Assessment and evaluationin higher education. 38(6) p698-712 Hounsell D. Flipping feedback. Undated. Wise Assessment Briefing 12. University of Hong Kong. https://www.cetl.hku.hk/teaching-learning-cop/wp-content/uploads/2015/08/wise-assessment-briefing12.pdf Hutchings M and Quinney A, (2015). The flipped classroom, disruptive pedagogies, enabling technologies and wicked problems: responding to the ‘bomb in the basement’. Electronic Journal of E-learning. 13(2) p106-119 Jessop T. (2017). Inspiring transformation through TESTA’s programme approach. In Carless D et al eds. Scaling up assessment for learning in higher education. Springer. Nicol D and McFarlane D (2006) Formative assessment and self-regulated learning; a model and seven principles of good feedback practice. Studies in Higher Education. 32(2) p199-21. Nordmann E, Horlin C, Hutchison J, Murray J-A, Robson L, Seery MK, and MacKay JRD. (2020). 10 simple rules for supporting a temporary online pivot in higher education. PsyArXiv Preprints https://psyarxiv.com/qdh25 Price M. undated. Promoting student assessment literacy. Wise Assessment Briefing 7. University of Hong Kong. https://www.cetl.hku.hk/teaching-learning-cop/wp-content/uploads/2015/08/wise-assessment-briefing7.pdf Quinney A, Lamont C, Biggins D and Holley D. (2017). Optimising disruptive approaches: extending academic roles and identities in higher education. Journal of Learning ~Development in Higher Education. Issue 12. Sambell K, McDowell L, and Montgomery, C. (2012). Assessment for learning in higher education. Routledge.
  • 25. Useful resources • The Bournemouth University Assessment and Feedback toolkit. (This externally facing version is incomplete as work halted to prioritise developments for the internal Toolkit). • Sally Brown’s blog https://sally-brown.net • FLIE blog https://microsites.bournemouth.ac.uk/flie/ • Winstone N and Carless D. 2019. Designing effective feedback processes in Higher Education: A learning- focused approach.