This document announces a lunch and learn session on the impact of AI on assessments. It provides six small changes that can be made now to current assessments, such as discussing academic integrity with students and revising exam questions. Larger changes are presented in an assessment menu inspired by a card game. The session will discuss issues around ubiquitous AI tools enabling easy cheating, the purpose of assessment, and moving forward with generative AI. References are provided on related topics such as AI detecting cheating, a student using ChatGPT to cheat, and universities rejecting anti-plagiarism technology.

1. CHANGEMAKERS AI LUNCH & LEARN SESSIONS
WEDNESDAY 1ST NOVEMBER, 1-2PM
The blandness is its formulaic style’:
insights to help understand the impact
of AI on assessments
Marieke Guy, Head of Digital Assessment

2. You might remember this…

3. Followed by this…

4. Six changes you can
make now
• Designing assessment for an AI-
enabled world page
• Small-scale adaptations to current
assessments - can be integrated into
existing module descriptions
• Videos created by Isobel Bowditch &
Digital Assessment Team
1. Discuss Academic Integrity and AI with your
students
2. Feedback and formative assessment
3. Revise exam questions
4. Revise essay questions
5. Convert generic questions to scenario-based
questions
6. Upgrade your Multiple Choice Questions (MCQs)
https://www.ucl.ac.uk/teaching-learning/generative-ai-hub

5. Plan for larger
changes
• Assessment Menu for larger changes
• 40+ cards, use Lydia Arnold’s Top
Trumps for inspiration
• Supported by Assessment process
and review FAQs
• Jisc have now released searchable
interactive PPT version
https://www.ucl.ac.uk/teaching-learning/designing-assessment-ai-enabled-world

6. So, what next?
• Reality: Ubiquitous GenAI tools provide easy
opportunities to ‘cheat’
• Pen and paper? Invigilation? Has a place…
• What about learning? And knowledge?
• What is our role as educators?
• What is the purpose of assessment?
• Good assessment principles still stand
• From hype to despair and back again: Where
to next with generative AI and assessment?
• Generative AI and Academic Skills course now
live

7. References
• As AI cheating booms, so does the industry detecting it: ‘We couldn’t keep up with demand
https://www.theguardian.com/technology/2023/jul/05/as-ai-cheating-booms-so-does-the-industry-detecting-it-we-couldnt-keep-up-with-demand
• A Student Used ChatGPT to Cheat in an AI Ethics Class
https://gizmodo.com/ai-chatgpt-ethics-class-essay-cheating-bing-google-bard-1850129519
• Assessment redesign for generative AI: A taxonomy of options and their viability
https://www.linkedin.com/pulse/assessment-redesign-generative-ai-taxonomy-options-viability-lodge/
• Bar exam score shows AI can keep up with 'human lawyers,' researchers
https://www.reuters.com/technology/bar-exam-score-shows-ai-can-keep-up-with-human-lawyers-researchers-say-2023-03-15/
• Creative ideas to use AI in education https://docs.google.com/presentation/d/1wVgLWgeEvJm3fznlm0aV8ZiuWsW3o3aUQUCcvuM5vxQ/edit#slide=id.g252f294a89d_43_0
• Exclusive: Almost half of Cambridge students have used ChatGPT to complete university work
https://www.varsity.co.uk/news/25463
• Great Assessment rethink
https://www.timeshighereducation.com/campus/spotlight/great-assessment-rethink
• How can generative AI intersect with Bloom’s taxonomy?
https://www.timeshighereducation.com/campus/how-can-generative-ai-intersect-blooms-taxonomy
• Nearly 1 in 3 college students have used Chat GPT on written assignments Universities are accused of giving students the green light for cheating as they reject technology aimed at
tackling AI plagiarism
https://www.dailymail.co.uk/news/article-11928997/Universities-accused-giving-students-green-light-cheating-AI.html
• Postplagiarism: transdisciplinary ethics and integrity in the age of artificial intelligence and neurotechnology https://edintegrity.biomedcentral.com/articles/10.1007/s40979-023-
00144-1
• Russell Group principles on the use of generative AI tools in education
https://russellgroup.ac.uk/media/6137/rg_ai_principles-final.pdf
• The College Essay Is Dead
https://www.theatlantic.com/technology/archive/2022/12/chatgpt-ai-writing-college-student-essays/672371/
• We made the ChatGPT AI take a GCSE History exam, and had it marked by a teacher
https://inews.co.uk/news/education/what-happened-ai-gcse-history-homework-chatgpt-fears-death-essay-2013269

8. QAA ANNUAL CONFERENCE, THE FUTURE OF QUALITY:
WHAT’S NEXT?
WEDNESDAY 13 SEPTEMBER 2023
Thanks!
Marieke Guy (m.guy@ucl.ac.uk)