Presentation @ joint Estonian-Georgian seaborne workshop 11 Nov 2014

1. Towards Online Exams in
Mathematics
Mart Laanpere, senior researcher
Institute of Informatics, Tallinn University
Head of the Centre for Educational Technology

2. Computers and mathematics education
• In 1960’s, mathematics was the only school subject
relevant for computing – not any more
• Math teachers are still among the most active users of
ICT in teaching and learning in schools
• Online exams in math fall behind languages (e.g.TOEFL)
• Lots of money invested in online math education:
– ActiveMath http://www.activemath.org
– PRIMAS http://www.primas-project.eu
– Fibonacci http://fibonacci.uni-bayreuth.de
– MCsquared: http://www.mc2-project.eu
– KeyCoMath http://keycomath.eu

3. Technology landscape is evolving
• Google: SOLVE TRIANGLE
• Apps: EzyTrig, MathWay
• Siri does math: http://tinyurl.com/siri-math
• PhotoMath: http://youtu.be/aJY2eDHvLSM
• This technology is not yet mature:
– It is faster to do math on paper
– Presentation: MathML (low acceptance, complex)
– Siri’s failure rate above 50%
• No 1 application is still the classic GeoGebra,
and most of the online tasks: multiple choice

4. Computer-Assisted Assessment
• Early applications: questions and tests integrated
into software
• The story of APStest in Estonia:
– Version 1: local install, floppy disk data transfer
– Version 2: LAN-based, WinNT4.0 database server
– Version 3: was planned as Web-based, failed
• Separating content (tests, questions) from the
code and following the standards helps us today
to avoid “vendor lock” and APStest-like failures

5. IMS Question & Test Interoperability
• De facto standard since 2002
• Final version (IMS QTI 2.1) published in 2012
• Item > Test > Assessment
http://www.imsglobal.org/question/

6. International experience
• PISA, TIMSS: based on open-source tool TAO
• Finland: DigabiOS on memory stick, national
exams will start 2019, pilots don’t include math
• USA: ETS Major Field Test in Mathematics, CSU
MathSuccess exam preparation
• UK: MathQuiz and NumercalReasoning online
services to prepare for GCSE and SAT exams
• Latvia: Uzdevumi.lv service

7. Online national exams
• If you want to change teaching, change exams
• Advantages of online exams:
– Faster delivery and assessment
– Quality assurance, monitoring, analytics
• Issues with online exams:
– Not all item types can be implemented online
– Safety, reliability, avoiding cheating
– Equal access, platform independence
– Technology failures

8. Thank you!
• Questions, comments?