SlideShare a Scribd company logo
1 of 18
Closing the loop: using holistic rubrics for
effective assessment and feedback
Sarah Honeychurch
Teaching Fellow
Adam Smith Business School
University of Glasgow
Sarah.Honeychurch@Glasgow.ac.uk
@NomadWarMachine
1
Introduction
• What is a rubric?
• Why use a rubric?
• Adam Smith Business School: a case
study
2
Why use a rubric?
• Assurance of Learning
• NSS
• Student Experience: Post Pandemic Pedagogy
• Staff time: marking and feedback
“A good rubric allows me to provide individualized, constructive critique in
a manageable time frame.” (Andrade 2005)
3
What is a rubric?
• Evaluative criteria
• Definitions of quality at different levels
• Grading strategy (Dawson 2017)
A rubric is an assessment tool that lists the criteria for a
piece of work or what counts (for example, purpose,
organization, details, voice, and mechanics often are
what count in a written essay) and articulates
gradations of quality for each criterion, from excellent to
poor. (Andrade 2005)
4
What is a rubric?
• Different types of marking rubrics
– Analytic marking rubrics
– A marking grid determining a specific score, grade
or percentage
– Holistic marking rubrics
– A grid with criteria. These inform, but do not
determine, grading
– Make the students aware of the marking criteria in
advance
5
AoL Rubric
6
Management Pilot
• Semester 1 and 2, 2017/18
• All Honours courses: rubric for each piece of assessment
inserted into course handbook
• 1 hour staff sessions to introduce the use of rubrics
• Supplementing, not substituting or changing other
marking practices or policies
7
Management: Holistic rubric
8
• 2 rounds of EvaSys questionnaires
Survey results
9
Student comments
• “I have found marking rubrics to be extremely helpful for other classes though and I am sure
that they are part of the reason I secured excellent grades for these classes. I think the school
would benefit from using these as I felt the rubrics covered most of what I needed to know and
therefore minimised the need for me to contact the lecturer for help.”
• “Every single course in MGT should have required rubrics. My grades have clearly improved with
the introductions of rubrics because I better understand the assignment, expectations, and can
guide my work and editing with the aid of the rubric.”
• “I really appreciate that Management has started to use marking rubrics (I actually think other
subjects would benefit from this as well!) I believe it is an important part in conveying the
expectations of assignments for students and also help identifying areas for improvement for
the future.”
• “Extend them to cover every class. I felt they helped significantly to my understanding of each
assignment.”
• “Spread the use over the entire university.”
• “Assuring that rubrics are not generic and they include details for a specific assignment is very
important, otherwise they are not helpful at all.”
10
Taking the pilot forward
• Some students felt the rubrics were too generic
• Some students thought the rubrics lacked detail:
– What does “to expectations” mean?
– What does an X grade look like?
• Need to embed rubrics in School policies and
practices
• Need to reflect institution’s Code of Assessment
– 3 levels of AoL v 8 levels in CoA
11
UofG Code of Assessment
“Schedule A”
12
Rubric redesign
13
title
• Course ILOs
• Assessment ILO(s)
• Assessment Criteria
• Develop descriptors for “good” (use Blooms)
• Develop +/- descriptors
• Ask a colleague to sense check it
• Available for students at beginning of course
• Used for marking and feedback
14
Moving forward
• Coursework briefing template
– Must provide assessment criteria
– Opt in to develop rubric
• Rubrics toolkit:
– Template
– Worked example
– Rationale (staff and student feedback)
– Short “how to” (including Blooms)
– Practical workshops
– 1-1 support
• SoTL project
15
References
Heidi Goodrich Andrade (2005) Teaching With Rubrics: The Good, the Bad, and
the Ugly, College Teaching, 53:1, 27-31, DOI: 10.3200/CTCH.53.1.27-31
Phillip Dawson (2017) Assessment rubrics: towards clearer and more replicable
design, research and practice, Assessment & Evaluation in Higher Education, 4
2:3, 347-360, DOI: 10.1080/02602938.2015.1111294
Peter Grainger, Michael Christie, Glyn Thomas, Shelley Dole, Deborah Heck,
Margaret Marshman & Michael Carey (2017) Improving the quality of
assessment by using a community of practice to explore the optimal
construction of assessment rubrics, Reflective Practice, 18:3, 410-422, DOI:
10.1080/14623943.2017.1295931
Anastasiya A. Lipnevich, Leigh N. McCallen, Katharine Pace Miles and Jeffrey K.
Smith (2014) Mind the gap! Students' use of exemplars and detailed rubrics as
formative assessment. Instructional Science 42:4 539-559
https://www.jstor.org/stable/43575435
16
References
Y. Malini Reddy & Heidi Andrade (2010) A review of rubric use in higher
education, Assessment & Evaluation in Higher Education, 35:4, 435-448, DOI:
10.1080/02602930902862859
D. Royce Sadler, (1987) Specifying and promulgating achievement standards.
Oxford Review of Education, 13, 191–209.
D. Royce Sadler, D. R. (2009) Indeterminacy in the use of preset criteria for
assessment and grading in higher education. Assessment and Evaluation in
Higher Education, 34, 159–179.
17
Closing the loop: using holistic rubrics for
effective assessment and feedback
Sarah Honeychurch
Teaching Fellow
Adam Smith Business School
University of Glasgow
Sarah.Honeychurch@Glasgow.ac.uk
@NomadWarMachine
18

More Related Content

What's hot

Data and assessment powerpoint presentation 2015
Data and assessment powerpoint presentation 2015Data and assessment powerpoint presentation 2015
Data and assessment powerpoint presentation 2015Erica Zigelman
 
Oct 23 Using exemplars to develop student assessment literacy
Oct 23 Using exemplars to develop student assessment literacyOct 23 Using exemplars to develop student assessment literacy
Oct 23 Using exemplars to develop student assessment literacyDavid Carless
 
Summary of course curriculum evaluation
Summary of course curriculum evaluationSummary of course curriculum evaluation
Summary of course curriculum evaluationShafeeq Hussain
 
Assessment strategies for online learning
Assessment strategies for online learningAssessment strategies for online learning
Assessment strategies for online learningCaroline Conlon
 
2014.01.27 session 4 impact evaluation & evidence(1)
2014.01.27 session 4 impact evaluation & evidence(1)2014.01.27 session 4 impact evaluation & evidence(1)
2014.01.27 session 4 impact evaluation & evidence(1)robertdrummond
 
Implementing peer feedback
Implementing peer feedbackImplementing peer feedback
Implementing peer feedbackDavid Carless
 
Introduction to the evaluation of teaching and learning
Introduction to the evaluation of teaching and learningIntroduction to the evaluation of teaching and learning
Introduction to the evaluation of teaching and learningAnne-Mart Olsen
 
Effective feedback
Effective feedbackEffective feedback
Effective feedbackiBATEFL.COM
 
Action research: Basic Information on Action Research
Action research: Basic Information on Action ResearchAction research: Basic Information on Action Research
Action research: Basic Information on Action ResearchSameer Babu M
 
PASS @ Ulster
PASS @ UlsterPASS @ Ulster
PASS @ Ulstercampone
 
Evaluation of Student Learning Policy Feb. 2014
Evaluation of Student Learning Policy Feb. 2014Evaluation of Student Learning Policy Feb. 2014
Evaluation of Student Learning Policy Feb. 2014tymchatyn
 
NYSCOSS Conference Superintendents Training on Assessment 9 14
NYSCOSS Conference Superintendents Training on Assessment 9 14NYSCOSS Conference Superintendents Training on Assessment 9 14
NYSCOSS Conference Superintendents Training on Assessment 9 14NWEA
 
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...Kenji Lamb
 
Birmingham Assessment and Feedback Symposium
Birmingham Assessment and Feedback Symposium Birmingham Assessment and Feedback Symposium
Birmingham Assessment and Feedback Symposium Tansy Jessop
 
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...Neil G. McPherson
 
Qualitative and quantitative student assessment
Qualitative and quantitative student assessmentQualitative and quantitative student assessment
Qualitative and quantitative student assessmentGail Matthews-DeNatale
 
Action research In Research Methodology
Action research In Research MethodologyAction research In Research Methodology
Action research In Research MethodologyMuhammad Usman Awan
 

What's hot (20)

Data and assessment powerpoint presentation 2015
Data and assessment powerpoint presentation 2015Data and assessment powerpoint presentation 2015
Data and assessment powerpoint presentation 2015
 
Oct 23 Using exemplars to develop student assessment literacy
Oct 23 Using exemplars to develop student assessment literacyOct 23 Using exemplars to develop student assessment literacy
Oct 23 Using exemplars to develop student assessment literacy
 
TESTA Masterclass
TESTA MasterclassTESTA Masterclass
TESTA Masterclass
 
QIPP Presentation
QIPP PresentationQIPP Presentation
QIPP Presentation
 
Summary of course curriculum evaluation
Summary of course curriculum evaluationSummary of course curriculum evaluation
Summary of course curriculum evaluation
 
Assessment strategies for online learning
Assessment strategies for online learningAssessment strategies for online learning
Assessment strategies for online learning
 
2014.01.27 session 4 impact evaluation & evidence(1)
2014.01.27 session 4 impact evaluation & evidence(1)2014.01.27 session 4 impact evaluation & evidence(1)
2014.01.27 session 4 impact evaluation & evidence(1)
 
Implementing peer feedback
Implementing peer feedbackImplementing peer feedback
Implementing peer feedback
 
Introduction to the evaluation of teaching and learning
Introduction to the evaluation of teaching and learningIntroduction to the evaluation of teaching and learning
Introduction to the evaluation of teaching and learning
 
Effective feedback
Effective feedbackEffective feedback
Effective feedback
 
Action research: Basic Information on Action Research
Action research: Basic Information on Action ResearchAction research: Basic Information on Action Research
Action research: Basic Information on Action Research
 
PASS @ Ulster
PASS @ UlsterPASS @ Ulster
PASS @ Ulster
 
Evaluation of Student Learning Policy Feb. 2014
Evaluation of Student Learning Policy Feb. 2014Evaluation of Student Learning Policy Feb. 2014
Evaluation of Student Learning Policy Feb. 2014
 
NYSCOSS Conference Superintendents Training on Assessment 9 14
NYSCOSS Conference Superintendents Training on Assessment 9 14NYSCOSS Conference Superintendents Training on Assessment 9 14
NYSCOSS Conference Superintendents Training on Assessment 9 14
 
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
 
Birmingham Assessment and Feedback Symposium
Birmingham Assessment and Feedback Symposium Birmingham Assessment and Feedback Symposium
Birmingham Assessment and Feedback Symposium
 
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
 
Qualitative and quantitative student assessment
Qualitative and quantitative student assessmentQualitative and quantitative student assessment
Qualitative and quantitative student assessment
 
Action research In Research Methodology
Action research In Research MethodologyAction research In Research Methodology
Action research In Research Methodology
 
Role of a coach par onboarding
Role of a coach par onboardingRole of a coach par onboarding
Role of a coach par onboarding
 

Similar to Closing the loop: using holistic rubrics for effective assessment and feedback

TESTA, Kingston University Keynote
TESTA, Kingston University KeynoteTESTA, Kingston University Keynote
TESTA, Kingston University KeynoteTESTA winch
 
Feed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedbackFeed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedbackjisc-elearning
 
Assessment cpd
Assessment cpdAssessment cpd
Assessment cpdMrsMcGinty
 
TESTA to FASTECH Presentation
TESTA to FASTECH PresentationTESTA to FASTECH Presentation
TESTA to FASTECH PresentationTansy_Jessop
 
An evidence based model
An evidence based modelAn evidence based model
An evidence based modelJisc
 
Online assessment
Online assessmentOnline assessment
Online assessmentNisha Singh
 
Doctoral Education Online: What Should We Strive For? How Could It Be Better?
Doctoral Education Online: What Should We Strive For? How Could It Be Better?Doctoral Education Online: What Should We Strive For? How Could It Be Better?
Doctoral Education Online: What Should We Strive For? How Could It Be Better?Cynthia Agyeman
 
Competency Based Medical Education.pptx
Competency Based Medical Education.pptxCompetency Based Medical Education.pptx
Competency Based Medical Education.pptxRakeshKumarDixit3
 
TESTA to FASTECH (November 2011)
 TESTA to FASTECH (November 2011) TESTA to FASTECH (November 2011)
TESTA to FASTECH (November 2011)TESTA winch
 
Ash Samadi - Blueprint for curriculum instruction
Ash Samadi - Blueprint for curriculum instructionAsh Samadi - Blueprint for curriculum instruction
Ash Samadi - Blueprint for curriculum instructionSamadi Group Management
 
Proposing a model for the incremental development of peer assessment and feed...
Proposing a model for the incremental development of peer assessment and feed...Proposing a model for the incremental development of peer assessment and feed...
Proposing a model for the incremental development of peer assessment and feed...Laura Costelloe
 
Evaluation the many faces
Evaluation   the many facesEvaluation   the many faces
Evaluation the many facesleesha roberts
 
Governance Day 042718
Governance Day 042718Governance Day 042718
Governance Day 042718Deanna Romano
 
Designing effective assessment for students.ppt
Designing effective assessment for students.pptDesigning effective assessment for students.ppt
Designing effective assessment for students.pptRameshwariSinghal1
 
Chapter 10 (11 in my book)
Chapter 10 (11 in my book)Chapter 10 (11 in my book)
Chapter 10 (11 in my book)TerrellMcCall
 
Jace Hargis Designing Online Teaching
Jace Hargis Designing Online TeachingJace Hargis Designing Online Teaching
Jace Hargis Designing Online TeachingJace Hargis
 
7. assessment session slides
7. assessment session slides7. assessment session slides
7. assessment session slidesGrandnet
 
Step 1 Project Initiation and get organized Rev1_print.pptx
Step 1 Project Initiation and get organized Rev1_print.pptxStep 1 Project Initiation and get organized Rev1_print.pptx
Step 1 Project Initiation and get organized Rev1_print.pptxARNELUSMAN2
 

Similar to Closing the loop: using holistic rubrics for effective assessment and feedback (20)

TESTA, Kingston University Keynote
TESTA, Kingston University KeynoteTESTA, Kingston University Keynote
TESTA, Kingston University Keynote
 
Feed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedbackFeed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedback
 
Assessment cpd
Assessment cpdAssessment cpd
Assessment cpd
 
TESTA to FASTECH Presentation
TESTA to FASTECH PresentationTESTA to FASTECH Presentation
TESTA to FASTECH Presentation
 
An evidence based model
An evidence based modelAn evidence based model
An evidence based model
 
Online assessment
Online assessmentOnline assessment
Online assessment
 
Doctoral Education Online: What Should We Strive For? How Could It Be Better?
Doctoral Education Online: What Should We Strive For? How Could It Be Better?Doctoral Education Online: What Should We Strive For? How Could It Be Better?
Doctoral Education Online: What Should We Strive For? How Could It Be Better?
 
Competency Based Medical Education.pptx
Competency Based Medical Education.pptxCompetency Based Medical Education.pptx
Competency Based Medical Education.pptx
 
TESTA to FASTECH (November 2011)
 TESTA to FASTECH (November 2011) TESTA to FASTECH (November 2011)
TESTA to FASTECH (November 2011)
 
Ash Samadi - Blueprint for curriculum instruction
Ash Samadi - Blueprint for curriculum instructionAsh Samadi - Blueprint for curriculum instruction
Ash Samadi - Blueprint for curriculum instruction
 
Proposing a model for the incremental development of peer assessment and feed...
Proposing a model for the incremental development of peer assessment and feed...Proposing a model for the incremental development of peer assessment and feed...
Proposing a model for the incremental development of peer assessment and feed...
 
Evaluation the many faces
Evaluation   the many facesEvaluation   the many faces
Evaluation the many faces
 
Governance Day 042718
Governance Day 042718Governance Day 042718
Governance Day 042718
 
Designing effective assessment for students.ppt
Designing effective assessment for students.pptDesigning effective assessment for students.ppt
Designing effective assessment for students.ppt
 
Chapter 12
Chapter 12Chapter 12
Chapter 12
 
Assessment is More Than Data
Assessment is More Than DataAssessment is More Than Data
Assessment is More Than Data
 
Chapter 10 (11 in my book)
Chapter 10 (11 in my book)Chapter 10 (11 in my book)
Chapter 10 (11 in my book)
 
Jace Hargis Designing Online Teaching
Jace Hargis Designing Online TeachingJace Hargis Designing Online Teaching
Jace Hargis Designing Online Teaching
 
7. assessment session slides
7. assessment session slides7. assessment session slides
7. assessment session slides
 
Step 1 Project Initiation and get organized Rev1_print.pptx
Step 1 Project Initiation and get organized Rev1_print.pptxStep 1 Project Initiation and get organized Rev1_print.pptx
Step 1 Project Initiation and get organized Rev1_print.pptx
 

Recently uploaded

microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationnomboosow
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxiammrhaywood
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdfssuser54595a
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application ) Sakshi Ghasle
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxNirmalaLoungPoorunde1
 
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxRoyAbrique
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppCeline George
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesFatimaKhan178732
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxpboyjonauth
 

Recently uploaded (20)

microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application )
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptx
 
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website App
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and Actinides
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptx
 

Closing the loop: using holistic rubrics for effective assessment and feedback

  • 1. Closing the loop: using holistic rubrics for effective assessment and feedback Sarah Honeychurch Teaching Fellow Adam Smith Business School University of Glasgow Sarah.Honeychurch@Glasgow.ac.uk @NomadWarMachine 1
  • 2. Introduction • What is a rubric? • Why use a rubric? • Adam Smith Business School: a case study 2
  • 3. Why use a rubric? • Assurance of Learning • NSS • Student Experience: Post Pandemic Pedagogy • Staff time: marking and feedback “A good rubric allows me to provide individualized, constructive critique in a manageable time frame.” (Andrade 2005) 3
  • 4. What is a rubric? • Evaluative criteria • Definitions of quality at different levels • Grading strategy (Dawson 2017) A rubric is an assessment tool that lists the criteria for a piece of work or what counts (for example, purpose, organization, details, voice, and mechanics often are what count in a written essay) and articulates gradations of quality for each criterion, from excellent to poor. (Andrade 2005) 4
  • 5. What is a rubric? • Different types of marking rubrics – Analytic marking rubrics – A marking grid determining a specific score, grade or percentage – Holistic marking rubrics – A grid with criteria. These inform, but do not determine, grading – Make the students aware of the marking criteria in advance 5
  • 7. Management Pilot • Semester 1 and 2, 2017/18 • All Honours courses: rubric for each piece of assessment inserted into course handbook • 1 hour staff sessions to introduce the use of rubrics • Supplementing, not substituting or changing other marking practices or policies 7
  • 9. • 2 rounds of EvaSys questionnaires Survey results 9
  • 10. Student comments • “I have found marking rubrics to be extremely helpful for other classes though and I am sure that they are part of the reason I secured excellent grades for these classes. I think the school would benefit from using these as I felt the rubrics covered most of what I needed to know and therefore minimised the need for me to contact the lecturer for help.” • “Every single course in MGT should have required rubrics. My grades have clearly improved with the introductions of rubrics because I better understand the assignment, expectations, and can guide my work and editing with the aid of the rubric.” • “I really appreciate that Management has started to use marking rubrics (I actually think other subjects would benefit from this as well!) I believe it is an important part in conveying the expectations of assignments for students and also help identifying areas for improvement for the future.” • “Extend them to cover every class. I felt they helped significantly to my understanding of each assignment.” • “Spread the use over the entire university.” • “Assuring that rubrics are not generic and they include details for a specific assignment is very important, otherwise they are not helpful at all.” 10
  • 11. Taking the pilot forward • Some students felt the rubrics were too generic • Some students thought the rubrics lacked detail: – What does “to expectations” mean? – What does an X grade look like? • Need to embed rubrics in School policies and practices • Need to reflect institution’s Code of Assessment – 3 levels of AoL v 8 levels in CoA 11
  • 12. UofG Code of Assessment “Schedule A” 12
  • 14. title • Course ILOs • Assessment ILO(s) • Assessment Criteria • Develop descriptors for “good” (use Blooms) • Develop +/- descriptors • Ask a colleague to sense check it • Available for students at beginning of course • Used for marking and feedback 14
  • 15. Moving forward • Coursework briefing template – Must provide assessment criteria – Opt in to develop rubric • Rubrics toolkit: – Template – Worked example – Rationale (staff and student feedback) – Short “how to” (including Blooms) – Practical workshops – 1-1 support • SoTL project 15
  • 16. References Heidi Goodrich Andrade (2005) Teaching With Rubrics: The Good, the Bad, and the Ugly, College Teaching, 53:1, 27-31, DOI: 10.3200/CTCH.53.1.27-31 Phillip Dawson (2017) Assessment rubrics: towards clearer and more replicable design, research and practice, Assessment & Evaluation in Higher Education, 4 2:3, 347-360, DOI: 10.1080/02602938.2015.1111294 Peter Grainger, Michael Christie, Glyn Thomas, Shelley Dole, Deborah Heck, Margaret Marshman & Michael Carey (2017) Improving the quality of assessment by using a community of practice to explore the optimal construction of assessment rubrics, Reflective Practice, 18:3, 410-422, DOI: 10.1080/14623943.2017.1295931 Anastasiya A. Lipnevich, Leigh N. McCallen, Katharine Pace Miles and Jeffrey K. Smith (2014) Mind the gap! Students' use of exemplars and detailed rubrics as formative assessment. Instructional Science 42:4 539-559 https://www.jstor.org/stable/43575435 16
  • 17. References Y. Malini Reddy & Heidi Andrade (2010) A review of rubric use in higher education, Assessment & Evaluation in Higher Education, 35:4, 435-448, DOI: 10.1080/02602930902862859 D. Royce Sadler, (1987) Specifying and promulgating achievement standards. Oxford Review of Education, 13, 191–209. D. Royce Sadler, D. R. (2009) Indeterminacy in the use of preset criteria for assessment and grading in higher education. Assessment and Evaluation in Higher Education, 34, 159–179. 17
  • 18. Closing the loop: using holistic rubrics for effective assessment and feedback Sarah Honeychurch Teaching Fellow Adam Smith Business School University of Glasgow Sarah.Honeychurch@Glasgow.ac.uk @NomadWarMachine 18