karin slotman and harry aarts

1. DIGITAL TESTING MATH
HARRY AARTS EN KAREN SLOTMAN

2.  Digital testing: idea behind
 Pilot 1
 Pilot 2
 Test items and Exercise
 Your opinion
CONTENTS

3.  In MyLabsPlus digital testing LEERLIJN-> TEM + SDL
1. aligning test items with learning objectives (reliable test) – grading final answer
2. secure testing
 Advantages:
-> monitor progress
-> monitor level
-> weak and strong
-> adaptive testing/own level
-> frequent/immediate feedback
-> relative score
-> automatic grading
-> randomize (numbers, pool)
-> key steps if needed (less points)
IDEA BEHIND

4.  Digital test. But: Grading paper based test
 Own laptop and Respondus Lock Down Browser
 Results:
-> more complex items -> no reliable grading
-> less complex items -> reliable grading
-> students are not happy with grading the final answer only
-> taking MLP test with Respondus Lock Down Browser on own computer absolutely not fraudproof
 It would be fair if my final answers of the exam will be graded, and not my handwritten calculations
and argumentations. -> Students think it’s not fair: 4,4
PILOT 1

5.  Hybrid test
 Very much effort to create reliable test items
 UT Chromebooks
 Results:
-> students are more satisfied
-> UT chromebook fraudproof?
PILOT 2

6.  Exam pilot 2
 What do you think of the hybrid test
2/3 digital closed questions (MC and Fill in) AND 1/3 open questions (with written solutions)?
TEST ITEMS AND EXERCISE

7. VOTE: GO.VOXVOTE.COM
Question Result
I believe a hybrid Math exam with both short answer questions​ (e.g. multiple​ choice)
and open questions with written solutions​ (incl. calculations) is a good way to test
my knowledge and skills.
I believe a hybrid Math exam with both short answer questions​ (e.g. multiple​ choice)
and open questions with written solutions​ (incl. calculations) is a fair way to test my
knowledge and skills.

8. RESULTS)
Pilot 1 Pilot 2 Result
pilot 1
Result
pilot 2
I believe that a digital Math exam is a good
way to test my knowledge and skills.
I believe a hybrid Math exam with both
short answer questions​ (e.g.
multiple​ choice) and open questions with
written solutions​ (incl. calculations) is a
good way to test my knowledge and
skills.
2,4 2,9
I believe that a digital Math exam is a fair
way to test my math
I believe a hybrid Math exam with both
short answer questions​ (e.g.
multiple​ choice) and open questions with
written solutions​ (incl. calculations) is a
fair way to test my knowledge and skills.
2,5 2,9
I would have done better on a traditional
paper exam than the hybrid exam I took
today.
3,3
It would be fair if my final answers of the
exam will be graded, and not my handwritten
calculations and argumentations.
1.6
I believe that a digital Math exam on my own
laptop/device is fraudproof.
I believe that a digital exam in
MyLabsPlus on a Chromebook is fraud
proof.
3,1 3
Disagree (1) – Agree (5)

9.  Quote: ‘ I liked this type of test, it`s a step into the future. I would have liked to have more
checkpoints on the go, some exercises had complicated equations which i would have liked to
show.’
 Ideas Pilot 3:
- implementing keysteps: optional on request of student
- Giving feedback during test for less points
- Second try for less point......
-......
 Challenge: Involve students and teachers
HOW TO CONTINUE