Using Moodle quiz for assessments that begin to leverage the affordances of ICTs that go beyond the capabilities of paper equivalents - post paper assessment task design examples.

1. Moodle Quiz:
Towards post-paper
Mathew Hillier, Transforming Exams
Updated April 2020
TRANSFORMINGEXAMS.COM
A Scalable Examination Platform for BYOD Invigilated Assessment

2. 2
PDF
Scratch SDK
Start! Moodle quiz
Video
Specialist applications
Sims
Start simple and build up!
Spreadsheets for calculation
and analysis.
Towards ‘post-paper’ e-Exams using Moodle Quiz

3. Drag and drop questions.
Labels or markers onto an image:
Labels onto text:

4. Multi-part or Cloze questions
Multi-part question
is possible.
Free-text or numeric with multiple
possible answers.
Selected response by radio button or
drop-down list.
Each sub-question or response field
can carry a different weight in terms
of the question mark.

5. Calculated with random variables
Each student and attempt results the display of different variables in
the question.
Next student or attempt
sin({a}) + cos({b}*2)
Same formula used to
calculate each answer
based on variables a and
b within defined ranges.

6. Media in question stem
Image, video, audio.
Get students to use
earphones!

7. Monash University 2018.
Chinese language – two units
(1st year and 3rd Year).
Listening test.
Moodle quiz cloze question
with embedded audio.
Students used headsets to
listen.
Responses via cloze fields.
Audio prompt

8. Multimedia response – on the fly
Uses essay question type with “HTML editor
with file picker” enabled.
Manually marked by humans.
Audio recording - lower bandwidth for upload.
Examples:
Oral responses, viva voce, language speaking,
interpreting, music performance.
Video recording - more bandwidth for upload.
Examples:
Identity check or spatial context check.
Video performance, practical skills, speaking
test, sign language response.
Recording using Atto video or audio – Max 3 minutes

9. External software with quiz
Constructed response – Scratch programming
Student response file uploaded.
Scratch programming task

10. External software with quiz
Mathematics example. Use third party software to answer questions. In the case of
installed applications users will need to have and locate the software.
Provide instructions to
access the software.
Provide space for responses – these
can potentially be copy-pasted from
the software.

11. Programming e-Exam
Edith Cowan University. Teaching Python Programming exam.
Word document + Python IDLE
Question doc is attachment to essay question.
Respond with file upload.
11

12. Translation task with offline dictionary
This is an offline
dictionary tool
‘Dim Sum’.
Essay
question.
DIV and
inline CSS
used to
create scroll
box for
source text.

13. Linked interactive apps
13
1. Student clicks a link embedded
in the quiz to launch a
separate app.
2. Undertakes a task as
instructed.
3. Then responds using selected
response or numerical input to
suit.

14. Spreadsheet in quiz
14

15. Dataset for statistical analysis
1. Download CSV. 2. Open in Octave.
3. Conduct analysis. 4. respond in Moodle.

16. Random questions
Category Category 1
Topic A
Easy
Category 2
Topic A
Moderate
Category 3
Topic A
Hard
Category 4
Topic B
Easy
Category 5
Topic B
Moderate
Category 6
Topic B
Hard
Category 7
Integration
n/a
Standard
question
Total
Start Question 1 Question 2 Question 3 Question 4 Question 5 Question 6 Question 7 Question 8 Finish
Attempt
Quiz
Q1_01 Q2_01 Q3_01 Q4_01 Q5_01 Q6_01 Q7_01 Q8 Submit
Q1_02 Q2_02 Q3_02 Q4_02 Q5_02 Q6_02 Q7_02
Q1_03 Q2_03 Q3_03 Q4_03 Q5_03 Q6_03 Q7_03
Q1_04 Q2_04 Q3_04 Q4_04 Q5_04 Q6_04
Q1_05 Q3_05 Q4_05 Q6_05
Pool Five
multiple
choice
Four
matching
Five mixed
types
Five
multiple
choice
Four
matching
Five
numerical
Three
essay
questions
One essay
question
Moodle
quiz build
Random
question
Random
question
Random
question
Random
question
Random
question
Random
question
Random
question
Essay
question
Marks 1 2 3 1 2 3 4 4 20
Based on K.Shultz (University of Adelaide) post on LinkedIn 2020
https://www.linkedin.com/posts/kymschutz_assessment-in-these-times-can-be-tricky-if-activity-
1) Place multiple questions into a category in the
question bank, then,
2) Insert a 'random question' when building the quiz.
When doing so specify the category.
Student allocated questions from the various category
pools to progress through.
All question types can be used for random.

17. Certainty-Based marking
Confidence based approaches penalise guessing. Students need to choose a
response and declare their level of certainty. Available in Moodle now.
17
University College London
Certainty v Mark ExpectedCertainty levels and consequences
Tony Gardner-Medwin, UCL, TA Webinar 6 April 2011
http://transformingassessment.com/events_6_april_2011.php
https://docs.moodle.org/35/en/Using_certainty-based_marking

18. CSS and script tricks
Eliminate options.
Each distractor
also needs the
script.
Script in the question stem to
enable the user to double click
to grey out options.

19. Adding plugins
So far all the above examples have used the
standard Moodle quiz question types.
If you add plugins you gain a whole lot more!

20. Pattern match short answer – auto marked
Students type in a short sentence response which can be marked by
computer based on pattern matching.
Available in Moodle plugins.
Example question
Example settings
Sally Jordan, Open Uni UK, TA webinar, 5 June 2013 transformingassessment.com/events_5_june_2013.php
Kinetic energy will be at maximum
when at the bottom of the slide.
evaluation

21. Computer
programming
Code Runner question type:
Structured responses
evaluated against test
cases.
Examples:
programming languages
R statistics.
Note: Requires separate
‘Jobe’ server to evaluate
the code responses
submitted by students.
https://docs.moodle.org/38/en/CodeRunner_question_type

22. STACK Computer algebra system
Scriptable question type
(wx Maxima)
https://moodle.org/plugins/qtype_stack

23. Digital inking input - Poodll
Annotate an image or free hand drawing, writing formulae and diagrams.
Inking seems to be a ‘missing link’ for STEM to adopt e-exams.
Commodity USB graphics tablet works fine (with some practice) or touch screen
device (e.g. Surface). Can be used in all contexts.
But at this time it needs further refinement (and some persistence).

24. Moodle and OpenSim Working Together
Data flows as if the student was doing the
activity in the LMS
A set of scripts for
Moodle and VW
that acts as a
bridge.
Student undertakes
assessment in the
virtual world
Set up Quiz in the
LMS. Results are
stored in the in
grade book.
Videos: Transforming Assessment Youtube Channel
Undertaking an assessment activity in the
Virtual World initiates data transfers to
the LMS.

25. Case studies
More information and mini cases at
http://transformingexams.com
Contact:
Mathew Hillier
http://mathewhillier.com
mathew.hillier@gmail.com