Choosing The Right Tool For The Job; How Maastricht University Is Selecting Its New Plagiarism Detection Tool

Plagiarism Detection: new tool for Maastricht University? Maarten v an Wesel Antoinette Vesseur Jeroen ten Haaf Full paper in the procedings on http://www.s-ict.org

Current situation
Safe Assign (since 2003)
25.000 papers (2009)
(unannounced) downtime

Pilot
Performance
Usability
Manageability

Two Questions
Is there a suitable product to use next to Safe Assign?
Is there a suitable product to replace Safe Assign with?

Why results differ
Difference in Algorithm
Difference in Sources

Assumptions
No false positives
Higher percentage = Better performance

Three candidates
Compatible with Blackboard
Ephorus
Turn-it-In
Urkund

Numbers
3,341 papers
Problems
1,779 papers accepted by all

Two Questions
Is there a suitable product to use next to Safe Assign
Difference between SA score and Candidate Score
Which product is most suitable to replace Safe Assign with
Papers per Threat level ( <15%, 15-40%, 40%>)

Answering Question 1 Urkund vs Safe Assign

Answering Question 1 Ephorus vs Safe Assign

Answering Question 1 Turnitin vs Safe Assign

Answering Question 1 21.7 24.7 Turn-it-in – SA 21.8 3.5 Ephorus – SA 25.3 6.6 Urkund – SA SD Mean

Answering Question 1
Paired sample T-test
Turn-it-In – SA vs Ephorus – SA;
t(1796) = 50.2, p = .000
Turn-it-In – SA vs Urkund – SA;
t(1796) = 39.3, p = .000

Sign Test
Turn-it-In – Urkund;
z = -34.9, p = .000
Urkund – Ephorus;
z = -5.8, p = .000
Turn-it-In – Ephorus
z = -32.0, p = .000

Conclusion
Is there a suitable product to use next to Safe Assign
Yes there is, Turn-it-In
Which product is most suitable to replace Safe Assign with
Turn-it-In

Questions?

Choosing The Right Tool For The Job; How Maastricht University Is Selecting Its New Plagiarism Detection Tool

by Maarten van Wesel

Accessibility

Categories

Upload Details

Usage Rights

3 Embeds 6

Statistics