SlideShare a Scribd company logo
1 of 9
OEB GLOBAL
FRIDAY 24TH NOVEMBER 2023
Assessing for a World Beyond
Assessment
Marieke Guy (Head of Digital Assessment)
University College
London (UCL)
• 11 faculties, 60+ departments
• 43,800 students, 14,300 employees, 440 UG,
675 PG programmes
• 53% international students, 150+ nationalities
• C520,000 student to assessment instances
• Variety of assessments but still majority exams
and coursework
• Procured assessment platform in 2021
Assessment – A wicked
problem?
• Multifaceted, many stakeholders, complex and difficult
to find a solution
• Challenges: Academic integrity, Generative AI, ensuring
students equipped for a life beyond assessment, equity
and inclusion, quality assurance, fairness, fostering
improvement (feedback), dealing with scale, staff
workload
• Assessment for learning
• Assessment drives learning
New ways of assessing:
Integrating AI
• Significant challenges for sector
• UCL AI experts’ group
• Resources created including
categorisation and menu of ideas
• AI hackathon & student panel
• Case study: Bartlett modules on machine
learning led by Dr Josep Grau-Bove
• Student change maker projects
New ways of assessing:
Optionality
• Offering choice in your assessment
• Challenges of fairness of equivalencies
and technical support
• QAA project with University of
Manchester, Imperial College London,
and University of York
• Case study: Institute of Education
modules led by Dr Nicole Brown
• Artefacts include video, collage, knitting,
baking, painting, installation
New ways of assessing:
Authentic assessment
• Dimensions include real world problems,
require collaboration, self-regulated,
varied audience, peer reviewed
• Case study 1: Physiotherapy module led
by Dr Jane Simmonds
• Case study 2: Health and wellbeing in
cites module led by Dr Gemma Moore
• Partnership approaches, wikis, non-
disposable assessments, employability,
Objective Structured Clinical
Examination (OSCEs)
Assessment – a sunny
future?
• Relevance: Personalise assessment, make it useful for a
world beyond assessment, future skills across
programmes. Problem-based. Build AI capability.
• Innovate: More creative ways to demonstrate
knowledge/skills – vivas, videos, eportfolios, technology.
Collaboration and team work.
• Affordances: Fully utilise technology – AR/VR/AI,
simulations and virtual labs
• Feedback: Rethink feedback – peer assessment
• Joy: Of learning, ungrading, engagement, transformative
experience,
Resources
• Digital Assessment at UCL blog: https://reflect.ucl.ac.uk/digital-assessment/
• Assessment optionality QAA report: https://www.qaa.ac.uk/membership/collaborative-
enhancement-projects/assessment/optionality-in-assessment
• Designing Authentic assessment: https://reflect.ucl.ac.uk/education-conference-
2022/2022/04/22/designing-authentic-assessment/
• UCL Generative AI hub: https://www.ucl.ac.uk/teaching-learning/generative-ai-hub
• An institutional environment that increases academic integrity:
https://blogs.ucl.ac.uk/digital-education/2022/11/25/an-institutional-environment-that-
increases-academic-integrity/
• How UCL is redesigning assessment for the AI age: https://beta.jisc.ac.uk/member-
stories/how-ucl-is-redesigning-assessment-for-the-ai-age
OEB GLOBAL
FRIDAY 24TH NOVEMBER 2023
Thanks!
Marieke Guy (Head of Digital Assessment) m.guy@ucl.ac.uk

More Related Content

Similar to Assessing for a World Beyond Assessment

Klaus Dieter Rossade online assessment
Klaus Dieter Rossade online assessmentKlaus Dieter Rossade online assessment
Klaus Dieter Rossade online assessment
EADTU
 
Next Steps for Excellence in the Quality of e-Learning
Next Steps for Excellence in the Quality of e-LearningNext Steps for Excellence in the Quality of e-Learning
Next Steps for Excellence in the Quality of e-Learning
Jon Rosewell
 
Quality e learning_africa_2013
Quality e learning_africa_2013Quality e learning_africa_2013
Quality e learning_africa_2013
Brenda Mallinson
 
Skills for Prosperity: Using OER to support nationwide change in Kenya
Skills for Prosperity: Using OER to support nationwide change in KenyaSkills for Prosperity: Using OER to support nationwide change in Kenya
Skills for Prosperity: Using OER to support nationwide change in Kenya
Fereshte Goshtasbpour
 

Similar to Assessing for a World Beyond Assessment (20)

Quality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality labelQuality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality label
 
Quality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality labelQuality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality label
 
Enhancement of teaching & Learning Methodology.pptx
Enhancement of teaching & Learning Methodology.pptxEnhancement of teaching & Learning Methodology.pptx
Enhancement of teaching & Learning Methodology.pptx
 
Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)
Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)
Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)
 
Klaus Dieter Rossade online assessment
Klaus Dieter Rossade online assessmentKlaus Dieter Rossade online assessment
Klaus Dieter Rossade online assessment
 
The OpenupEd quality label benchmarks for moocs
The OpenupEd quality label benchmarks for moocsThe OpenupEd quality label benchmarks for moocs
The OpenupEd quality label benchmarks for moocs
 
Next Steps for Excellence in the Quality of e-Learning
Next Steps for Excellence in the Quality of e-LearningNext Steps for Excellence in the Quality of e-Learning
Next Steps for Excellence in the Quality of e-Learning
 
Quality e learning_africa_2013
Quality e learning_africa_2013Quality e learning_africa_2013
Quality e learning_africa_2013
 
Tell me what you want and I’ll show you what you can have: who drives design ...
Tell me what you want and I’ll show you what you can have: who drives design ...Tell me what you want and I’ll show you what you can have: who drives design ...
Tell me what you want and I’ll show you what you can have: who drives design ...
 
MOOCs and Quality Issues
MOOCs and Quality IssuesMOOCs and Quality Issues
MOOCs and Quality Issues
 
Teacher Professional Development with a wow-factor: Innovative and emerging p...
Teacher Professional Development with a wow-factor: Innovative and emerging p...Teacher Professional Development with a wow-factor: Innovative and emerging p...
Teacher Professional Development with a wow-factor: Innovative and emerging p...
 
Embedding Quality Assurance in Online Course Design (An African Perspective)
Embedding Quality Assurance in Online Course Design (An African Perspective)Embedding Quality Assurance in Online Course Design (An African Perspective)
Embedding Quality Assurance in Online Course Design (An African Perspective)
 
Redesigning assessments for a world with artificial intelligence
Redesigning assessments for a world with artificial intelligenceRedesigning assessments for a world with artificial intelligence
Redesigning assessments for a world with artificial intelligence
 
Sloan-C Effective Practice Award Winners Webinars
Sloan-C Effective Practice Award Winners WebinarsSloan-C Effective Practice Award Winners Webinars
Sloan-C Effective Practice Award Winners Webinars
 
eAssessment in practice
eAssessment in practiceeAssessment in practice
eAssessment in practice
 
Transformingtechnologies session7
Transformingtechnologies session7Transformingtechnologies session7
Transformingtechnologies session7
 
Doctoral Education Online: What Should We Strive For? How Could It Be Better?
Doctoral Education Online: What Should We Strive For? How Could It Be Better?Doctoral Education Online: What Should We Strive For? How Could It Be Better?
Doctoral Education Online: What Should We Strive For? How Could It Be Better?
 
How to hit a moving target: developing evaluation instruments in an evolving ...
How to hit a moving target: developing evaluation instruments in an evolving ...How to hit a moving target: developing evaluation instruments in an evolving ...
How to hit a moving target: developing evaluation instruments in an evolving ...
 
Skills for Prosperity: Using OER to support nationwide change in Kenya
Skills for Prosperity: Using OER to support nationwide change in KenyaSkills for Prosperity: Using OER to support nationwide change in Kenya
Skills for Prosperity: Using OER to support nationwide change in Kenya
 
Skills for Prosperity: Using OER to support nationwide change in Kenya
Skills for Prosperity: Using OER to support nationwide change in KenyaSkills for Prosperity: Using OER to support nationwide change in Kenya
Skills for Prosperity: Using OER to support nationwide change in Kenya
 

More from Marieke Guy

More from Marieke Guy (20)

Ways to ensure “buy in” from the academics in the transition to digitised ass...
Ways to ensure “buy in” from the academics in the transition to digitised ass...Ways to ensure “buy in” from the academics in the transition to digitised ass...
Ways to ensure “buy in” from the academics in the transition to digitised ass...
 
The blandness is its formulaic style’: insights to help understand the impact...
The blandness is its formulaic style’: insights to help understand the impact...The blandness is its formulaic style’: insights to help understand the impact...
The blandness is its formulaic style’: insights to help understand the impact...
 
Closing remarks: Assessment with Phill Dawson
Closing remarks: Assessment with Phill DawsonClosing remarks: Assessment with Phill Dawson
Closing remarks: Assessment with Phill Dawson
 
The UCL assessment journey
The UCL assessment journeyThe UCL assessment journey
The UCL assessment journey
 
The UCL lockdown browser pilot
The UCL lockdown browser pilotThe UCL lockdown browser pilot
The UCL lockdown browser pilot
 
Assessment in the time of change
Assessment in the time of changeAssessment in the time of change
Assessment in the time of change
 
The Digital Assessment Marathon 
The Digital Assessment Marathon The Digital Assessment Marathon 
The Digital Assessment Marathon 
 
Inspired assessments
Inspired assessmentsInspired assessments
Inspired assessments
 
Designing alternative assessments
Designing alternative assessmentsDesigning alternative assessments
Designing alternative assessments
 
MCQs_ The joys of making your mind up.pdf
MCQs_ The joys of making your mind up.pdfMCQs_ The joys of making your mind up.pdf
MCQs_ The joys of making your mind up.pdf
 
Rubrics_ removing the glitch in the assessment matrix (1).pdf
Rubrics_ removing the glitch in the assessment matrix (1).pdfRubrics_ removing the glitch in the assessment matrix (1).pdf
Rubrics_ removing the glitch in the assessment matrix (1).pdf
 
Making your mind up: Formalising the evaluation of learning technologies 
Making your mind up: Formalising the evaluation of learning technologies Making your mind up: Formalising the evaluation of learning technologies 
Making your mind up: Formalising the evaluation of learning technologies 
 
Video assessment recipes
Video assessment recipesVideo assessment recipes
Video assessment recipes
 
Alternative assessments
Alternative assessmentsAlternative assessments
Alternative assessments
 
Connect more: Digital Culture forum - A thousand things, a thousand times
Connect more: Digital Culture forum - A thousand things, a thousand timesConnect more: Digital Culture forum - A thousand things, a thousand times
Connect more: Digital Culture forum - A thousand things, a thousand times
 
The Certainty of Uncertainty: Transnational Online Pivot in China
The Certainty of Uncertainty: Transnational Online Pivot in ChinaThe Certainty of Uncertainty: Transnational Online Pivot in China
The Certainty of Uncertainty: Transnational Online Pivot in China
 
The Transnational Online Pivot: A Case Study Exploring Online Delivery in China
The Transnational Online Pivot: A Case Study Exploring Online Delivery in ChinaThe Transnational Online Pivot: A Case Study Exploring Online Delivery in China
The Transnational Online Pivot: A Case Study Exploring Online Delivery in China
 
Making our students ‘appy – how we successfully rolled out our student mobile...
Making our students ‘appy – how we successfully rolled out our student mobile...Making our students ‘appy – how we successfully rolled out our student mobile...
Making our students ‘appy – how we successfully rolled out our student mobile...
 
The RAU Student digital experience tracker 2018
The RAU Student digital experience tracker 2018The RAU Student digital experience tracker 2018
The RAU Student digital experience tracker 2018
 
Multimedia
MultimediaMultimedia
Multimedia
 

Recently uploaded

Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 

Recently uploaded (20)

OSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & SystemsOSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & Systems
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 
How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17
 
Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptx
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
latest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answerslatest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answers
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Basic Intentional Injuries Health Education
Basic Intentional Injuries Health EducationBasic Intentional Injuries Health Education
Basic Intentional Injuries Health Education
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 

Assessing for a World Beyond Assessment

  • 1. OEB GLOBAL FRIDAY 24TH NOVEMBER 2023 Assessing for a World Beyond Assessment Marieke Guy (Head of Digital Assessment)
  • 2. University College London (UCL) • 11 faculties, 60+ departments • 43,800 students, 14,300 employees, 440 UG, 675 PG programmes • 53% international students, 150+ nationalities • C520,000 student to assessment instances • Variety of assessments but still majority exams and coursework • Procured assessment platform in 2021
  • 3. Assessment – A wicked problem? • Multifaceted, many stakeholders, complex and difficult to find a solution • Challenges: Academic integrity, Generative AI, ensuring students equipped for a life beyond assessment, equity and inclusion, quality assurance, fairness, fostering improvement (feedback), dealing with scale, staff workload • Assessment for learning • Assessment drives learning
  • 4. New ways of assessing: Integrating AI • Significant challenges for sector • UCL AI experts’ group • Resources created including categorisation and menu of ideas • AI hackathon & student panel • Case study: Bartlett modules on machine learning led by Dr Josep Grau-Bove • Student change maker projects
  • 5. New ways of assessing: Optionality • Offering choice in your assessment • Challenges of fairness of equivalencies and technical support • QAA project with University of Manchester, Imperial College London, and University of York • Case study: Institute of Education modules led by Dr Nicole Brown • Artefacts include video, collage, knitting, baking, painting, installation
  • 6. New ways of assessing: Authentic assessment • Dimensions include real world problems, require collaboration, self-regulated, varied audience, peer reviewed • Case study 1: Physiotherapy module led by Dr Jane Simmonds • Case study 2: Health and wellbeing in cites module led by Dr Gemma Moore • Partnership approaches, wikis, non- disposable assessments, employability, Objective Structured Clinical Examination (OSCEs)
  • 7. Assessment – a sunny future? • Relevance: Personalise assessment, make it useful for a world beyond assessment, future skills across programmes. Problem-based. Build AI capability. • Innovate: More creative ways to demonstrate knowledge/skills – vivas, videos, eportfolios, technology. Collaboration and team work. • Affordances: Fully utilise technology – AR/VR/AI, simulations and virtual labs • Feedback: Rethink feedback – peer assessment • Joy: Of learning, ungrading, engagement, transformative experience,
  • 8. Resources • Digital Assessment at UCL blog: https://reflect.ucl.ac.uk/digital-assessment/ • Assessment optionality QAA report: https://www.qaa.ac.uk/membership/collaborative- enhancement-projects/assessment/optionality-in-assessment • Designing Authentic assessment: https://reflect.ucl.ac.uk/education-conference- 2022/2022/04/22/designing-authentic-assessment/ • UCL Generative AI hub: https://www.ucl.ac.uk/teaching-learning/generative-ai-hub • An institutional environment that increases academic integrity: https://blogs.ucl.ac.uk/digital-education/2022/11/25/an-institutional-environment-that- increases-academic-integrity/ • How UCL is redesigning assessment for the AI age: https://beta.jisc.ac.uk/member- stories/how-ucl-is-redesigning-assessment-for-the-ai-age
  • 9. OEB GLOBAL FRIDAY 24TH NOVEMBER 2023 Thanks! Marieke Guy (Head of Digital Assessment) m.guy@ucl.ac.uk

Editor's Notes

  1. Title from Jan MacArthur
  2. In case people are unaware UCL is a large and broad institution with over 11 faculties, covering areas from brain science and maths and physical sciences, to social and historical sciences and the built environment. Also countless departments, some of which are research only. There are almost 45 thousand students, a large number of whom are postgraduate. We are very much an international institution with over 150 nationalities represented. All of this means that we are very sensitive to scale and large cohorts and have a lot of assessment instances. We are also still exam and course work heavy, though keen to diversify more in the future. In the picture you can see Jeremy Bentham, the philosopher who devised the doctrine of utilitarianism, arguing that the ‘greatest happiness of the greatest number is the only right and proper end of government’. He supported the idea of equal opportunity in education and his ideas contributed to the foundation of University College London in 1826. Bentham left his body to medical science and requested that his body be preserved and gifted to UCL.Today Bentham sits in UCL’s South Cloisters dressed in his own clothes and sitting in his chair
  3. A wicked problem is a concept that originated in the field of social planning and policy. The term was introduced by design theorists Horst Rittel and Melvin Webber in the 1970s. Wicked problems are complex, ambiguous, and difficult to define. They often lack clear boundaries and have numerous interconnected and interdependent factors.