SlideShare a Scribd company logo
ASSESSMENTUCL
Inspired assessment recipes
Marieke Guy, Digital Assessment Advisor
(m.guy@ucl.ac.uk)
Multiple choice with a difference
AssessmentUCL approach
• Dynamic data options in FLOWmulti – different questions for each student
• Use variables e.g. maths question generator
• Shuffle answers and sections
• Participant and assignment statistics
• Academic integrity at the core of multiple choice question writing
• Scenario based questions or Single Best Answer (SBA)
• Questions that require complex thinking processes e.g assertion
reasoning
• Use variables and parameters
• Use cloze, ranking, hotspot and drawing questions
• Time questions appropriately
Individual assessments
AssessmentUCL approach
• In FLOWassign opportunity to allocate students different papers, or
versions of the papers
• Groups can be set up to support this allocation and the marking process
• A series of assessments are written then distributed to students
• Distribution can be random or by groups
• Assessment question could be a variation on same question,
perhaps assigning students different roles or different data
• Students could reflect on their particular role, or the question
assigned
Video demo or presentation
AssessmentUCL approach
• FLOWhandin allows upload of files up to 5GB in size – only available
media lock space at UCL (stops modification)
• Additional appendix documents can be uploaded as supporting materials
• Videos could be shared with other students by collating – can be bulk
downloaded from AssessmentUCL
• Allows student to demonstrate their competency and skills
• Students pre-record a video of themselves presenting on a given
topic or carrying out a real world skill e.g. hand washing,
identifying species etc.
• Video can be talking head, of an external subject or use
PowerPoint
• Students could work with local organisation and produce a video
that fulfils a brief, or create a digital field guide, or 3 minute pitch,
or TED talk…
• Other option is audio files or podcasts
Commentary on video
AssessmentUCL approach
• Video integration available using the text editor – can link to YouTube,
Vimeo or other
• Video questions pre-recorded by academic
• Video or audio response question type
• A pre-recorded real world video is shared
• This could be a ‘how to do’ video with error or inconsistencies, or
a walkthrough of an area, 2D video or medical footage
• Video has no audio
• Students are asked to record press play on video and then record
an in time audio sound track
• A written text box can also be offered as an alternative to the
audio
Group activities
AssessmentUCL approach
• AssessmentUCL supports groups – students can choose own group and
invite other students with notification by email, or be allocated groups by
manager
• Hand in as a group paper (each group hands in one paper) or individual
papers (each participant in a group hands in an individual paper)
• Students work together on a report or presentation activity
• Activity could involve different roles and tasks
• Opportunity for some form of peer assessment activity and
reflection after the group activity has taken place
• Students can submit a group report or each submit sections of a
final report
Mock scenario
• Students are shown snippets of scenarios (video content, audio
files, images and reports)
• Allows students to respond to real-life scenarios
• Students asked for opinions on scenarios using multiple choice or
free text
• Examples could be court room scenarios, business meetings or
medical situations
• Some scenarios could use multiple video streams providing the
opportunity to see the situation from multiple angles
AssessmentUCL approach
• Video integration available using the text editor – can link to YouTube,
Vimeo or other
• Additional files can be linked to in question text or added in using the
question layout in FLOWmulti
Q&A session
AssessmentUCL approach
• Video integration available using the text editor – can link to YouTube,
Vimeo or other
• Video questions pre-recorded by academic
• Video question type
• Students record responses to a set of pre-recorded questions
• Could be used in a medical setting e.g. for pharmacy dispensing
• Responses are marked on set criteria
• Online role play activity with scenario
Industry case study
AssessmentUCL approach
• FLOWhandin allows upload of files up to 5GB in size – only available
media lock space at UCL (stops modification)
• Additional appendix documents can be uploaded as supporting materials
• Use of FLOWseries - several educational activities that culminate in a final
assessment
• Case study written for a programme video content, audio files,
images and reports)
• Industry relevant and authentic
• Can be reused in many ways across years and levels
• Journey through curriculum
• Fictionalised examples and tasks
Improved feedback
AssessmentUCL approach
• Use of rubrics for marking – standard or custom
• Audio or video feedback – added within rubric or as an uploaded file
• Feedback for paper or assessment
• FLOWsentiment analysis
• Students benefit from clear criteria and marking guidance
• Focused and intrinsic feedback
• Cohort feedback
• Digital literacy
• Compassionate feedback
Portfolio
AssessmentUCL approach
• Use of FLOWseries - several educational activities that culminate in a final
assessment. Series of flows over a period of time and a custom set of
requirements that the participants must fulfil to access the final flow
• Supports assessment platform stocking by offering a marking matrix for
assessments in other platforms (where student submits a URL to that
platform, e.g. Reflect, Mahara)
• Students collate and curate different content (digital files, report
etc.) and submit as a digital portfolio
• Portfolio includes final reflection piece on work
• Rationale for items collated
• Ideas include work placement diary
• Use of Mahara or Reflect blog
Infographic
AssessmentUCL approach
• FLOWhandin allows upload of files up to 5GB in size
• Additional appendix documents can be uploaded as supporting materials
• Drawing question type allows upload of images
• Students create infographic related to a specific theme or subject
• Use of data sources
• Need make design choices
• Use of Office tools to create
• Supplement infographic with narrative
Rethinking coursework
AssessmentUCL approach
• Use of FLOWassign for Turnitin integration
• Additional appendix documents can be uploaded as supporting materials
• FLOWmulti allows section based marking
• Moving away from essay questions to more authentic written
content e.g. email writing, report writing, data analysis, write a
press release, tweets, newspaper article
• Scenario based questions rather than googlable questions that
can be pre-written
• Analysis questions that have academics integrity as part of the
question
• Redesign of assessment using ABC model
Online marking
AssessmentUCL approach
• Marks uploaded directly to SITS/Portico
• Use of rubrics and marking sheets, audio feedback, cohort feedback using
comment on paper, upload files
• Granular settings - annotations can be shared with co-assesors and
students
• Assessor groups
• Mark online and share directly with the student
• Online annotation – comments, drawings, summaries
• Online marking can be viewed by co-markers, students and
External Examiners
• Feedback can be shared with cohorts

More Related Content

What's hot

Using Technology to Assess Student Learning
Using Technology to Assess Student LearningUsing Technology to Assess Student Learning
Using Technology to Assess Student Learning
Seth Allen
 
Design Method for ICDW
Design Method for ICDW Design Method for ICDW
Design Method for ICDW
LaWanda Thomas
 
05 adp domain_analysis_v0_5
05 adp domain_analysis_v0_505 adp domain_analysis_v0_5
05 adp domain_analysis_v0_5Giang Nguyễn
 
UDL and Active Learning Strategies
UDL and Active Learning StrategiesUDL and Active Learning Strategies
UDL and Active Learning Strategies
Amy Archambault
 
Assessing Online Courses - CA12
Assessing Online Courses - CA12Assessing Online Courses - CA12
Assessing Online Courses - CA12CETLA
 
ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session
ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus SessionENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session
ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session
Tanya Joosten
 
Working with a CMS (or CLE): Lessons We Can All Learn, Regardless of Platform
Working with a CMS (or CLE): Lessons We Can All Learn, Regardless of PlatformWorking with a CMS (or CLE): Lessons We Can All Learn, Regardless of Platform
Working with a CMS (or CLE): Lessons We Can All Learn, Regardless of Platform
Amber D. Marcu, Ph.D.
 
Choose your own Adventure, Increase Student Engagement in Brightspace
Choose your own Adventure, Increase Student Engagement in BrightspaceChoose your own Adventure, Increase Student Engagement in Brightspace
Choose your own Adventure, Increase Student Engagement in Brightspace
D2L Barry
 
Data (analytics) informed (e)teaching and (e)learning - 7 byte size ideas
Data (analytics) informed (e)teaching and (e)learning - 7 byte size ideasData (analytics) informed (e)teaching and (e)learning - 7 byte size ideas
Data (analytics) informed (e)teaching and (e)learning - 7 byte size ideas
Poh-Sun Goh
 
Creative uses of moodle modules 2010
Creative uses of moodle modules 2010Creative uses of moodle modules 2010
Creative uses of moodle modules 2010
Paula Clough
 
Learning Management Systems - Online Education
Learning Management Systems - Online EducationLearning Management Systems - Online Education
Learning Management Systems - Online Education
Brian Pichman
 
Gettingstartedwithmoodle
GettingstartedwithmoodleGettingstartedwithmoodle
Gettingstartedwithmoodleallisunelearns
 
Course (Re)design
Course (Re)designCourse (Re)design
Course (Re)design
Barbara Johnson
 
CHECET May 2013
CHECET May 2013CHECET May 2013
CHECET May 2013
VeronicaMitchell
 
Using the internet in the elementary schools
Using the internet in the elementary schoolsUsing the internet in the elementary schools
Using the internet in the elementary schoolsRaiza Roz Cipriano
 
Diversifying Immediate Feedback
Diversifying Immediate FeedbackDiversifying Immediate Feedback
Diversifying Immediate Feedbackguest13b4c6
 
Applied learning analytics to class and program learning activities
Applied learning analytics to class and program learning activitiesApplied learning analytics to class and program learning activities
Applied learning analytics to class and program learning activities
Poh-Sun Goh
 
What is an ePortfolio
What is an ePortfolioWhat is an ePortfolio
What is an ePortfolio
academictechwarwick
 
E assessment
E assessmentE assessment
E assessment
ayoub babar
 
Sunway University 12th Annual ESAP Symposium (E) Workshop J The Adoption of T...
Sunway University 12th Annual ESAP Symposium (E) Workshop J The Adoption of T...Sunway University 12th Annual ESAP Symposium (E) Workshop J The Adoption of T...
Sunway University 12th Annual ESAP Symposium (E) Workshop J The Adoption of T...
Stephen j Hall
 

What's hot (20)

Using Technology to Assess Student Learning
Using Technology to Assess Student LearningUsing Technology to Assess Student Learning
Using Technology to Assess Student Learning
 
Design Method for ICDW
Design Method for ICDW Design Method for ICDW
Design Method for ICDW
 
05 adp domain_analysis_v0_5
05 adp domain_analysis_v0_505 adp domain_analysis_v0_5
05 adp domain_analysis_v0_5
 
UDL and Active Learning Strategies
UDL and Active Learning StrategiesUDL and Active Learning Strategies
UDL and Active Learning Strategies
 
Assessing Online Courses - CA12
Assessing Online Courses - CA12Assessing Online Courses - CA12
Assessing Online Courses - CA12
 
ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session
ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus SessionENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session
ENSURING QUALITY AND DETERMINING EFFECTIVENESS, ELI Focus Session
 
Working with a CMS (or CLE): Lessons We Can All Learn, Regardless of Platform
Working with a CMS (or CLE): Lessons We Can All Learn, Regardless of PlatformWorking with a CMS (or CLE): Lessons We Can All Learn, Regardless of Platform
Working with a CMS (or CLE): Lessons We Can All Learn, Regardless of Platform
 
Choose your own Adventure, Increase Student Engagement in Brightspace
Choose your own Adventure, Increase Student Engagement in BrightspaceChoose your own Adventure, Increase Student Engagement in Brightspace
Choose your own Adventure, Increase Student Engagement in Brightspace
 
Data (analytics) informed (e)teaching and (e)learning - 7 byte size ideas
Data (analytics) informed (e)teaching and (e)learning - 7 byte size ideasData (analytics) informed (e)teaching and (e)learning - 7 byte size ideas
Data (analytics) informed (e)teaching and (e)learning - 7 byte size ideas
 
Creative uses of moodle modules 2010
Creative uses of moodle modules 2010Creative uses of moodle modules 2010
Creative uses of moodle modules 2010
 
Learning Management Systems - Online Education
Learning Management Systems - Online EducationLearning Management Systems - Online Education
Learning Management Systems - Online Education
 
Gettingstartedwithmoodle
GettingstartedwithmoodleGettingstartedwithmoodle
Gettingstartedwithmoodle
 
Course (Re)design
Course (Re)designCourse (Re)design
Course (Re)design
 
CHECET May 2013
CHECET May 2013CHECET May 2013
CHECET May 2013
 
Using the internet in the elementary schools
Using the internet in the elementary schoolsUsing the internet in the elementary schools
Using the internet in the elementary schools
 
Diversifying Immediate Feedback
Diversifying Immediate FeedbackDiversifying Immediate Feedback
Diversifying Immediate Feedback
 
Applied learning analytics to class and program learning activities
Applied learning analytics to class and program learning activitiesApplied learning analytics to class and program learning activities
Applied learning analytics to class and program learning activities
 
What is an ePortfolio
What is an ePortfolioWhat is an ePortfolio
What is an ePortfolio
 
E assessment
E assessmentE assessment
E assessment
 
Sunway University 12th Annual ESAP Symposium (E) Workshop J The Adoption of T...
Sunway University 12th Annual ESAP Symposium (E) Workshop J The Adoption of T...Sunway University 12th Annual ESAP Symposium (E) Workshop J The Adoption of T...
Sunway University 12th Annual ESAP Symposium (E) Workshop J The Adoption of T...
 

Similar to Inspired assessments

Task 4 final: Consultants-E E-Moderating Course Oct 2015
Task 4 final: Consultants-E E-Moderating Course Oct 2015Task 4 final: Consultants-E E-Moderating Course Oct 2015
Task 4 final: Consultants-E E-Moderating Course Oct 2015
brendawm
 
Exploring some features of moodle
Exploring some features of moodleExploring some features of moodle
Exploring some features of moodle
jyotitara
 
Online Teaching Best Practices
Online Teaching Best PracticesOnline Teaching Best Practices
Online Teaching Best Practices
Kristen Sosulski
 
Best practices for teaching online
Best practices for teaching onlineBest practices for teaching online
Best practices for teaching online
Ally Kimmel
 
Teaching with technology
Teaching with technologyTeaching with technology
Teaching with technology
Kristen Sosulski
 
Online approaches to marking and feedback summer 2012
Online approaches to marking and feedback   summer 2012Online approaches to marking and feedback   summer 2012
Online approaches to marking and feedback summer 2012
Roger Gardner
 
Focusing the Course Design Process on Alignment
Focusing the Course Design Process on AlignmentFocusing the Course Design Process on Alignment
Focusing the Course Design Process on Alignment
colleenfleming
 
Tips for using Brightspace in the Development and Delivery of a Fully Online ...
Tips for using Brightspace in the Development and Delivery of a Fully Online ...Tips for using Brightspace in the Development and Delivery of a Fully Online ...
Tips for using Brightspace in the Development and Delivery of a Fully Online ...
D2L Barry
 
The student data driven life... every teacher's dream
The student data driven life... every teacher's dreamThe student data driven life... every teacher's dream
The student data driven life... every teacher's dream
NavigatingNerdies
 
LIN3 2013: 5. technical and pedagogical assessment handout
LIN3 2013: 5. technical and pedagogical assessment handout LIN3 2013: 5. technical and pedagogical assessment handout
LIN3 2013: 5. technical and pedagogical assessment handout Anu Ylitalo
 
An interactive video based Environment supporting learning analytics
An interactive video based Environment supporting learning analyticsAn interactive video based Environment supporting learning analytics
An interactive video based Environment supporting learning analytics
Alexandros Kleftodimos
 
MOOCs
MOOCsMOOCs
Choose your Own Adventure with Brightspace
Choose your Own Adventure with BrightspaceChoose your Own Adventure with Brightspace
Choose your Own Adventure with Brightspace
D2L Barry
 
eClassRoom using Moodle
eClassRoom using Moodle eClassRoom using Moodle
eClassRoom using Moodle
Prakash Patil
 
10 Questions for Blended Course Design
10 Questions for Blended Course Design10 Questions for Blended Course Design
10 Questions for Blended Course Design
Tanya Joosten
 
What makes a great blended learning trainer and academic?
What makes a great blended learning trainer and academic?What makes a great blended learning trainer and academic?
What makes a great blended learning trainer and academic?
Yum Studio
 
Design a Course the Adler Online Way
Design a Course the Adler Online WayDesign a Course the Adler Online Way
Design a Course the Adler Online Way
colleenfleming
 
Engaged Learning Using Web 2.0 Technologies
Engaged Learning Using Web 2.0 TechnologiesEngaged Learning Using Web 2.0 Technologies
Engaged Learning Using Web 2.0 Technologies
Nanette Stillwell
 

Similar to Inspired assessments (20)

Task 4 final: Consultants-E E-Moderating Course Oct 2015
Task 4 final: Consultants-E E-Moderating Course Oct 2015Task 4 final: Consultants-E E-Moderating Course Oct 2015
Task 4 final: Consultants-E E-Moderating Course Oct 2015
 
Exploring some features of moodle
Exploring some features of moodleExploring some features of moodle
Exploring some features of moodle
 
Online Teaching Best Practices
Online Teaching Best PracticesOnline Teaching Best Practices
Online Teaching Best Practices
 
Best practices for teaching online
Best practices for teaching onlineBest practices for teaching online
Best practices for teaching online
 
Teaching with technology
Teaching with technologyTeaching with technology
Teaching with technology
 
Online approaches to marking and feedback summer 2012
Online approaches to marking and feedback   summer 2012Online approaches to marking and feedback   summer 2012
Online approaches to marking and feedback summer 2012
 
Focusing the Course Design Process on Alignment
Focusing the Course Design Process on AlignmentFocusing the Course Design Process on Alignment
Focusing the Course Design Process on Alignment
 
Tips for using Brightspace in the Development and Delivery of a Fully Online ...
Tips for using Brightspace in the Development and Delivery of a Fully Online ...Tips for using Brightspace in the Development and Delivery of a Fully Online ...
Tips for using Brightspace in the Development and Delivery of a Fully Online ...
 
The student data driven life... every teacher's dream
The student data driven life... every teacher's dreamThe student data driven life... every teacher's dream
The student data driven life... every teacher's dream
 
D2L1
D2L1D2L1
D2L1
 
LIN3 2013: 5. technical and pedagogical assessment handout
LIN3 2013: 5. technical and pedagogical assessment handout LIN3 2013: 5. technical and pedagogical assessment handout
LIN3 2013: 5. technical and pedagogical assessment handout
 
An interactive video based Environment supporting learning analytics
An interactive video based Environment supporting learning analyticsAn interactive video based Environment supporting learning analytics
An interactive video based Environment supporting learning analytics
 
MOOCs
MOOCsMOOCs
MOOCs
 
Blackboard
BlackboardBlackboard
Blackboard
 
Choose your Own Adventure with Brightspace
Choose your Own Adventure with BrightspaceChoose your Own Adventure with Brightspace
Choose your Own Adventure with Brightspace
 
eClassRoom using Moodle
eClassRoom using Moodle eClassRoom using Moodle
eClassRoom using Moodle
 
10 Questions for Blended Course Design
10 Questions for Blended Course Design10 Questions for Blended Course Design
10 Questions for Blended Course Design
 
What makes a great blended learning trainer and academic?
What makes a great blended learning trainer and academic?What makes a great blended learning trainer and academic?
What makes a great blended learning trainer and academic?
 
Design a Course the Adler Online Way
Design a Course the Adler Online WayDesign a Course the Adler Online Way
Design a Course the Adler Online Way
 
Engaged Learning Using Web 2.0 Technologies
Engaged Learning Using Web 2.0 TechnologiesEngaged Learning Using Web 2.0 Technologies
Engaged Learning Using Web 2.0 Technologies
 

More from Marieke Guy

Ways to ensure “buy in” from the academics in the transition to digitised ass...
Ways to ensure “buy in” from the academics in the transition to digitised ass...Ways to ensure “buy in” from the academics in the transition to digitised ass...
Ways to ensure “buy in” from the academics in the transition to digitised ass...
Marieke Guy
 
Assessing for a World Beyond Assessment
Assessing for a World Beyond AssessmentAssessing for a World Beyond Assessment
Assessing for a World Beyond Assessment
Marieke Guy
 
The blandness is its formulaic style’: insights to help understand the impact...
The blandness is its formulaic style’: insights to help understand the impact...The blandness is its formulaic style’: insights to help understand the impact...
The blandness is its formulaic style’: insights to help understand the impact...
Marieke Guy
 
Redesigning assessments for a world with artificial intelligence
Redesigning assessments for a world with artificial intelligenceRedesigning assessments for a world with artificial intelligence
Redesigning assessments for a world with artificial intelligence
Marieke Guy
 
Closing remarks: Assessment with Phill Dawson
Closing remarks: Assessment with Phill DawsonClosing remarks: Assessment with Phill Dawson
Closing remarks: Assessment with Phill Dawson
Marieke Guy
 
The UCL assessment journey
The UCL assessment journeyThe UCL assessment journey
The UCL assessment journey
Marieke Guy
 
The UCL lockdown browser pilot
The UCL lockdown browser pilotThe UCL lockdown browser pilot
The UCL lockdown browser pilot
Marieke Guy
 
Assessment in the time of change
Assessment in the time of changeAssessment in the time of change
Assessment in the time of change
Marieke Guy
 
Digital Assessment Team 2022 - a day in the life.pptx
Digital Assessment Team 2022 - a day in the life.pptxDigital Assessment Team 2022 - a day in the life.pptx
Digital Assessment Team 2022 - a day in the life.pptx
Marieke Guy
 
The Digital Assessment Marathon 
The Digital Assessment Marathon The Digital Assessment Marathon 
The Digital Assessment Marathon 
Marieke Guy
 
Designing alternative assessments
Designing alternative assessmentsDesigning alternative assessments
Designing alternative assessments
Marieke Guy
 
MCQs_ The joys of making your mind up.pdf
MCQs_ The joys of making your mind up.pdfMCQs_ The joys of making your mind up.pdf
MCQs_ The joys of making your mind up.pdf
Marieke Guy
 
Rubrics_ removing the glitch in the assessment matrix (1).pdf
Rubrics_ removing the glitch in the assessment matrix (1).pdfRubrics_ removing the glitch in the assessment matrix (1).pdf
Rubrics_ removing the glitch in the assessment matrix (1).pdf
Marieke Guy
 
Making your mind up: Formalising the evaluation of learning technologies 
Making your mind up: Formalising the evaluation of learning technologies Making your mind up: Formalising the evaluation of learning technologies 
Making your mind up: Formalising the evaluation of learning technologies 
Marieke Guy
 
Video assessment recipes
Video assessment recipesVideo assessment recipes
Video assessment recipes
Marieke Guy
 
Alternative assessments
Alternative assessmentsAlternative assessments
Alternative assessments
Marieke Guy
 
Connect more: Digital Culture forum - A thousand things, a thousand times
Connect more: Digital Culture forum - A thousand things, a thousand timesConnect more: Digital Culture forum - A thousand things, a thousand times
Connect more: Digital Culture forum - A thousand things, a thousand times
Marieke Guy
 
The Certainty of Uncertainty: Transnational Online Pivot in China
The Certainty of Uncertainty: Transnational Online Pivot in ChinaThe Certainty of Uncertainty: Transnational Online Pivot in China
The Certainty of Uncertainty: Transnational Online Pivot in China
Marieke Guy
 
The Transnational Online Pivot: A Case Study Exploring Online Delivery in China
The Transnational Online Pivot: A Case Study Exploring Online Delivery in ChinaThe Transnational Online Pivot: A Case Study Exploring Online Delivery in China
The Transnational Online Pivot: A Case Study Exploring Online Delivery in China
Marieke Guy
 
Making our students ‘appy – how we successfully rolled out our student mobile...
Making our students ‘appy – how we successfully rolled out our student mobile...Making our students ‘appy – how we successfully rolled out our student mobile...
Making our students ‘appy – how we successfully rolled out our student mobile...
Marieke Guy
 

More from Marieke Guy (20)

Ways to ensure “buy in” from the academics in the transition to digitised ass...
Ways to ensure “buy in” from the academics in the transition to digitised ass...Ways to ensure “buy in” from the academics in the transition to digitised ass...
Ways to ensure “buy in” from the academics in the transition to digitised ass...
 
Assessing for a World Beyond Assessment
Assessing for a World Beyond AssessmentAssessing for a World Beyond Assessment
Assessing for a World Beyond Assessment
 
The blandness is its formulaic style’: insights to help understand the impact...
The blandness is its formulaic style’: insights to help understand the impact...The blandness is its formulaic style’: insights to help understand the impact...
The blandness is its formulaic style’: insights to help understand the impact...
 
Redesigning assessments for a world with artificial intelligence
Redesigning assessments for a world with artificial intelligenceRedesigning assessments for a world with artificial intelligence
Redesigning assessments for a world with artificial intelligence
 
Closing remarks: Assessment with Phill Dawson
Closing remarks: Assessment with Phill DawsonClosing remarks: Assessment with Phill Dawson
Closing remarks: Assessment with Phill Dawson
 
The UCL assessment journey
The UCL assessment journeyThe UCL assessment journey
The UCL assessment journey
 
The UCL lockdown browser pilot
The UCL lockdown browser pilotThe UCL lockdown browser pilot
The UCL lockdown browser pilot
 
Assessment in the time of change
Assessment in the time of changeAssessment in the time of change
Assessment in the time of change
 
Digital Assessment Team 2022 - a day in the life.pptx
Digital Assessment Team 2022 - a day in the life.pptxDigital Assessment Team 2022 - a day in the life.pptx
Digital Assessment Team 2022 - a day in the life.pptx
 
The Digital Assessment Marathon 
The Digital Assessment Marathon The Digital Assessment Marathon 
The Digital Assessment Marathon 
 
Designing alternative assessments
Designing alternative assessmentsDesigning alternative assessments
Designing alternative assessments
 
MCQs_ The joys of making your mind up.pdf
MCQs_ The joys of making your mind up.pdfMCQs_ The joys of making your mind up.pdf
MCQs_ The joys of making your mind up.pdf
 
Rubrics_ removing the glitch in the assessment matrix (1).pdf
Rubrics_ removing the glitch in the assessment matrix (1).pdfRubrics_ removing the glitch in the assessment matrix (1).pdf
Rubrics_ removing the glitch in the assessment matrix (1).pdf
 
Making your mind up: Formalising the evaluation of learning technologies 
Making your mind up: Formalising the evaluation of learning technologies Making your mind up: Formalising the evaluation of learning technologies 
Making your mind up: Formalising the evaluation of learning technologies 
 
Video assessment recipes
Video assessment recipesVideo assessment recipes
Video assessment recipes
 
Alternative assessments
Alternative assessmentsAlternative assessments
Alternative assessments
 
Connect more: Digital Culture forum - A thousand things, a thousand times
Connect more: Digital Culture forum - A thousand things, a thousand timesConnect more: Digital Culture forum - A thousand things, a thousand times
Connect more: Digital Culture forum - A thousand things, a thousand times
 
The Certainty of Uncertainty: Transnational Online Pivot in China
The Certainty of Uncertainty: Transnational Online Pivot in ChinaThe Certainty of Uncertainty: Transnational Online Pivot in China
The Certainty of Uncertainty: Transnational Online Pivot in China
 
The Transnational Online Pivot: A Case Study Exploring Online Delivery in China
The Transnational Online Pivot: A Case Study Exploring Online Delivery in ChinaThe Transnational Online Pivot: A Case Study Exploring Online Delivery in China
The Transnational Online Pivot: A Case Study Exploring Online Delivery in China
 
Making our students ‘appy – how we successfully rolled out our student mobile...
Making our students ‘appy – how we successfully rolled out our student mobile...Making our students ‘appy – how we successfully rolled out our student mobile...
Making our students ‘appy – how we successfully rolled out our student mobile...
 

Recently uploaded

MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
bennyroshan06
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
Balvir Singh
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
siemaillard
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
RaedMohamed3
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
JosvitaDsouza2
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
MIRIAMSALINAS13
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
Celine George
 
PART A. Introduction to Costumer Service
PART A. Introduction to Costumer ServicePART A. Introduction to Costumer Service
PART A. Introduction to Costumer Service
PedroFerreira53928
 
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
Nguyen Thanh Tu Collection
 
Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
Sandy Millin
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
BhavyaRajput3
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
EverAndrsGuerraGuerr
 
Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)
rosedainty
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
Celine George
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
Vivekanand Anglo Vedic Academy
 
The Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve ThomasonThe Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve Thomason
Steve Thomason
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
beazzy04
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
joachimlavalley1
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
Delapenabediema
 

Recently uploaded (20)

MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
 
PART A. Introduction to Costumer Service
PART A. Introduction to Costumer ServicePART A. Introduction to Costumer Service
PART A. Introduction to Costumer Service
 
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
 
Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
 
Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
 
The Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve ThomasonThe Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve Thomason
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
 

Inspired assessments

  • 1. ASSESSMENTUCL Inspired assessment recipes Marieke Guy, Digital Assessment Advisor (m.guy@ucl.ac.uk)
  • 2. Multiple choice with a difference AssessmentUCL approach • Dynamic data options in FLOWmulti – different questions for each student • Use variables e.g. maths question generator • Shuffle answers and sections • Participant and assignment statistics • Academic integrity at the core of multiple choice question writing • Scenario based questions or Single Best Answer (SBA) • Questions that require complex thinking processes e.g assertion reasoning • Use variables and parameters • Use cloze, ranking, hotspot and drawing questions • Time questions appropriately
  • 3. Individual assessments AssessmentUCL approach • In FLOWassign opportunity to allocate students different papers, or versions of the papers • Groups can be set up to support this allocation and the marking process • A series of assessments are written then distributed to students • Distribution can be random or by groups • Assessment question could be a variation on same question, perhaps assigning students different roles or different data • Students could reflect on their particular role, or the question assigned
  • 4. Video demo or presentation AssessmentUCL approach • FLOWhandin allows upload of files up to 5GB in size – only available media lock space at UCL (stops modification) • Additional appendix documents can be uploaded as supporting materials • Videos could be shared with other students by collating – can be bulk downloaded from AssessmentUCL • Allows student to demonstrate their competency and skills • Students pre-record a video of themselves presenting on a given topic or carrying out a real world skill e.g. hand washing, identifying species etc. • Video can be talking head, of an external subject or use PowerPoint • Students could work with local organisation and produce a video that fulfils a brief, or create a digital field guide, or 3 minute pitch, or TED talk… • Other option is audio files or podcasts
  • 5. Commentary on video AssessmentUCL approach • Video integration available using the text editor – can link to YouTube, Vimeo or other • Video questions pre-recorded by academic • Video or audio response question type • A pre-recorded real world video is shared • This could be a ‘how to do’ video with error or inconsistencies, or a walkthrough of an area, 2D video or medical footage • Video has no audio • Students are asked to record press play on video and then record an in time audio sound track • A written text box can also be offered as an alternative to the audio
  • 6. Group activities AssessmentUCL approach • AssessmentUCL supports groups – students can choose own group and invite other students with notification by email, or be allocated groups by manager • Hand in as a group paper (each group hands in one paper) or individual papers (each participant in a group hands in an individual paper) • Students work together on a report or presentation activity • Activity could involve different roles and tasks • Opportunity for some form of peer assessment activity and reflection after the group activity has taken place • Students can submit a group report or each submit sections of a final report
  • 7. Mock scenario • Students are shown snippets of scenarios (video content, audio files, images and reports) • Allows students to respond to real-life scenarios • Students asked for opinions on scenarios using multiple choice or free text • Examples could be court room scenarios, business meetings or medical situations • Some scenarios could use multiple video streams providing the opportunity to see the situation from multiple angles AssessmentUCL approach • Video integration available using the text editor – can link to YouTube, Vimeo or other • Additional files can be linked to in question text or added in using the question layout in FLOWmulti
  • 8. Q&A session AssessmentUCL approach • Video integration available using the text editor – can link to YouTube, Vimeo or other • Video questions pre-recorded by academic • Video question type • Students record responses to a set of pre-recorded questions • Could be used in a medical setting e.g. for pharmacy dispensing • Responses are marked on set criteria • Online role play activity with scenario
  • 9. Industry case study AssessmentUCL approach • FLOWhandin allows upload of files up to 5GB in size – only available media lock space at UCL (stops modification) • Additional appendix documents can be uploaded as supporting materials • Use of FLOWseries - several educational activities that culminate in a final assessment • Case study written for a programme video content, audio files, images and reports) • Industry relevant and authentic • Can be reused in many ways across years and levels • Journey through curriculum • Fictionalised examples and tasks
  • 10. Improved feedback AssessmentUCL approach • Use of rubrics for marking – standard or custom • Audio or video feedback – added within rubric or as an uploaded file • Feedback for paper or assessment • FLOWsentiment analysis • Students benefit from clear criteria and marking guidance • Focused and intrinsic feedback • Cohort feedback • Digital literacy • Compassionate feedback
  • 11. Portfolio AssessmentUCL approach • Use of FLOWseries - several educational activities that culminate in a final assessment. Series of flows over a period of time and a custom set of requirements that the participants must fulfil to access the final flow • Supports assessment platform stocking by offering a marking matrix for assessments in other platforms (where student submits a URL to that platform, e.g. Reflect, Mahara) • Students collate and curate different content (digital files, report etc.) and submit as a digital portfolio • Portfolio includes final reflection piece on work • Rationale for items collated • Ideas include work placement diary • Use of Mahara or Reflect blog
  • 12. Infographic AssessmentUCL approach • FLOWhandin allows upload of files up to 5GB in size • Additional appendix documents can be uploaded as supporting materials • Drawing question type allows upload of images • Students create infographic related to a specific theme or subject • Use of data sources • Need make design choices • Use of Office tools to create • Supplement infographic with narrative
  • 13. Rethinking coursework AssessmentUCL approach • Use of FLOWassign for Turnitin integration • Additional appendix documents can be uploaded as supporting materials • FLOWmulti allows section based marking • Moving away from essay questions to more authentic written content e.g. email writing, report writing, data analysis, write a press release, tweets, newspaper article • Scenario based questions rather than googlable questions that can be pre-written • Analysis questions that have academics integrity as part of the question • Redesign of assessment using ABC model
  • 14. Online marking AssessmentUCL approach • Marks uploaded directly to SITS/Portico • Use of rubrics and marking sheets, audio feedback, cohort feedback using comment on paper, upload files • Granular settings - annotations can be shared with co-assesors and students • Assessor groups • Mark online and share directly with the student • Online annotation – comments, drawings, summaries • Online marking can be viewed by co-markers, students and External Examiners • Feedback can be shared with cohorts