How should universities think about assessment and academic integrity in light of generative artificial intelligence. These slides from a keynote presentation continue a theme of recent ideas I've explored and also consider how tools like ChatGPT can enable students to succeed.

1. Protecting Academic
Integrity in the Age of
Artificial Intelligence
Dr Thomas Lancaster
Imperial College London
Keynote Presentation for CBASS Education
Day – Brunel University - 14 June 2023

2. Dr Thomas Lancaster
Computer Scientist at Imperial College
London
Academic integrity researcher and speaker
http://www.thomaslancaster.co.uk
Twitter: @DrLancaster
Machine generated image

4. overwhelm
misinformation
danger

5. A typical
request
found online
(contract
cheating)

6. A ChatGPT
version

7. Structured
ChatGPT
feedback

8. What Can Students Use Generative AI To Produce?
Essays
Presentation Slides
Scripts
(Fake) Research Data
Creative Writing
Computer Programs
Reflections
Marketing Plans
and much more…

9. What does this mean for the value
of this assessment process?

10. Academic
Integrity
Generative
Artificial
Intelligence
A Focus

11. • Not “intelligent” in the human sense
• Trained on large quantities of data
• Follows prompts and directions
• Can mimic structures and patterns
Generative Artificial Intelligence

12. ChatGPT has limitations…
Recent results
Using correct sources
Mathematics
But these limitations can be
overcome…

13. Academic Integrity
Not cheating

14. The Fundamental Values of Academic Integrity
(https://www.academicintegrity.org)
honesty respect fairness
responsibility trust
courage

15. Academic Integrity ?
• Doing what is right
• Avoiding an unfair advantage
• Learning and being prepared for the
future

16. Academic Integrity ?
• Doing what is right
• Not enabling an unfair advantage
• Supporting students to be prepared
for the future

17. What does this mean for how we
approach assessment for learning?

19. AI In Assessment
ban allow require

20. AI In Assessment
ban allow require
with
acknowledgement
without
acknowledgement

21. “I want to be able to use
AI for my assessment”

22. “I want to be
able to type in a
prompt and be
done”

23. What do students say they use ChatGPT for?

24. What do students say they use ChatGPT for?
editing learning ideas
translation time saving

25. Students will have to be
supported to use AI
• Ethically
• Effectively
• Within their field
• Aware of its limitations

26. typical range of
achievement
Without AI

27. typical range of
achievement
With AI

28. more opportunities
for students to
succeed
With AI

29. more opportunities
for students to excel
With AI

30. AI In Assessment
ban allow require
with
acknowledgement
without
acknowledgement

31. What type of
assessments work
in an AI focused
world?

32. Exams?

33. FAIR AI Use in Assessment
Foundational
Can work
without AI and
can demonstrate
core skills
Appreciative
Able to evaluate
the quality of
information
produced
Illuminative
Uses AI to learn,
suggest ideas,
clarify, and
improve
Replaceable
Directs AI to
complete
assessments,
and can evaluate
the output

34. Provide Guidance and Clarify Expectations
Specify what level of AI use
is acceptable in each
assignment
Determine how the use of
AI is to be acknowledged

35. Engaging Assessment
What would make a student
want to complete this
assessment?
How would a student see value
in completing this assessment?
How can this assessment help
them to add to their
professional portfolio?

36. Remove Temptation
Can AI be misused to
complete this assessment?
Can AI be used legitimately?

37. Focus on the process, not the product

38. “Sure, I primarily used an AI text generator to
help convert my scattered thoughts, ideas, and
notes into a more coherent and organized
draft. I would feed it specific topics or prompts,
and it would generate comprehensive text that
I then revised and incorporated into my thesis.”
“Could you briefly explain how you used AI
in writing your thesis?”
Ongoing Research
Interview With PhD Student Alice

39. There Is No Alice!

40. Verify Ability

41. Address Student Concerns
How would you react if a
student says they have
written a first draft – then
used software tools to
improve it?

42. Consider The Big Picture
Legislation
Equity
Environmental
Impact

43. The Future is Collaborative!

44. The Future is Not Static!

45. The Future is Exciting!

47. FAIR AI Use in Assessment
Foundational
Can work
without AI and
can demonstrate
core skills
Appreciative
Able to evaluate
the quality of
information
produced
Illuminative
Uses AI to learn,
suggest ideas,
clarify, and
improve
Replaceable
Directs AI to
complete
assessments,
and can evaluate
the output
all without cheating

50. My Email: thomas@thomaslancaster.co.uk
My Website: http://thomaslancaster.co.uk
My Blog: http://thomaslancaster.co.uk/blog
My LinkedIn: https://uk.linkedin.com/in/thomaslancaster
My Twitter: @DrLancaster
If I Can Assist…