During emergency remote learning it has been harder to control the circumstances students complete their assessments within, and harder to authenticate who is doing the work. There have been two main responses to these challenges. The first has been attempts to use technology to replicate the restrictions and surveillance approaches used face-to-face in an online world. These appear to have worked, to a degree, and they have provided a sort of ‘security theatre’ that has enabled something akin to business as usual. The second approach has been much more difficult and daring, and it has involved fundamentally reimagining what assessment needs to be and what it needs to do. This presentation explores what we have learnt from these two approaches that will continue to be useful when/if we enter a post-pandemic world.
Re-imagining assessment in higher education: Beyond restrictions and surveillance
1. Re-imagining assessment in
higher education: Beyond
restrictions and surveillance
Phillip (Phill) Dawson
Centre for Research in Assessment and
Digital Learning (CRADLE)
Deakin University, Melbourne, Australia
2.
3. 5 things to
take from this
presentation
1: Assessment is the site of mass
suspicionless surveillance
2: Assessment is also the site of mass
restriction
3: We need to balance academic
integrity and assessment security
4: We are at a critical juncture where
we can reimagine assessment
5: Let’s make our restrictions authentic
and minimize our surveillance
@phillipdawson
4.
5.
6.
7.
8. We need to balance academic
integrity and assessment security
• Academic integrity is positive,
educative and values-based
• Assessment security is
adversarial, punitive and
evidence-based
• In tension, but not a dichotomy
10. Assessment security:
“measures taken to harden assessment against
attempts to cheat. This includes approaches to
detect and evidence attempts to cheat, as well as
measures to make cheating more difficult.”
(Dawson, 2021)
Dawson, P. (2021). Defending Assessment Security in a Digital World: Preventing E-Cheating and Supporting Academic Integrity in Higher Education. Routledge.
11. Addressing cheating requires…
Academic Integrity
• Trusting
• Educative
• Proactive
Think ‘crime prevention’
Assessment security
• Detecting
• Punitive
• Proactive or reactive
‘policing’ or ‘surveillance’
It’s a balance, not a dichotomy
15. 0 5 10 15 20 25 30 35 40
Short turnaround time
Heavily weighted task
Series of small graded tasks
Research, analysis and thinking skills
No ‘right’ answer
Integrate knowledge/skills vital to programme
Relevant professional skills
Major part of nested task
Small part of nested task
In-class task
Personalised and unique
Viva
Reflection on practicum
Listen to students.
Students’ perceptions of the likelihood of contract cheating (%)
Bretag, T., Harper, R., Burton, M., Ellis, C., Newton, P., van Haeringen, K.,
et al. (2019). Contract cheating and assessment design: exploring the
relationship. Assessment & Evaluation in Higher Education, 44(5), 676-691.
17. Make restrictions authentic:
Authentic assessment is great but it
doesn’t stop cheating. Authentic
restrictions might.
Restrictions need to be enforced, and
therefore make assessment harder to
secure.
Authentic restrictions reduce the
‘attack surface’.
Allowing students tools, collaboration
and/or information reduces the options
for cheating.
https://teaching.unsw.edu.au/academic-integrity/case-studies
David Kellermann UNSW @DrKellermann
18. Talk with students
Our study using vivas with markers
across four diverse discipline found
100% cheating detection rate
(Too good to be true? Needs replication
before we publish but it’s a good sign)
(Too time consuming? Yes, but we need
to think programmatically…)
19. Make assessment security
programmatic
‘Cheat-proofing’ every act of
assessment is probably impossible
and definitely a bad idea.
Focus on securing those acts of
assessment that matter to the
degree program outcomes.
Focus on developing academic
integrity in the others.
20. Consider random audit
‘Cheat-proofing’ every act of
assessment is probably
impossible and definitely a bad
idea.
Consider random audit of
individual students’ work.
The possibility of an audit is
associated with more honest
behavior in other contexts (e.g.
tax)
21. 5 things to
take from this
presentation
1: Assessment is the site of mass
suspicionless surveillance
2: Assessment is also the site of mass
restriction
3: We need to balance academic
integrity and assessment security
4: We are at a critical juncture where
we can reimagine assessment
5: Let’s make our restrictions authentic
and minimize our surveillance
@phillipdawson
Indian army candidates sitting exam nude to stop cheating
https://time.com/4246170/india-army-strip-search/
https://majancollege.edu.om/component/k2/item/162-majan-college-leads-the-way-in-combating-contract-cheating