eTest Solution: Software  for Integrating Large- and     Small-scale Assessment                                           ...
      still undeveloped Internet infrastructure      just adequate computer classrooms      MS Windows only      a...
Small-scale        Large-scaleSample size   classroom          hundreds of schoolsExample       final exam         standar...
Trial testing (or pilot-testing)   the same conditions as for final test   more-less the same questions   smaller sampl...
 Moodle testing machine, 2007 Moodle large-scale on-line test, 2009Prehistory of the project
   put Ttest instead of Quiz   adjust Moodle distribution   distribute Moodle installation to schools   encourage teac...
Moodle is not so good solution for on-line tests, after all.   memory leaking, again   unreliable Internet connections ...
   Microsoft technology   XML based interoperability (like IMS QTI)   Separate system components   On- and off-line te...
 2808 schools (95% of all schools in SRB) 30,000 working places                                                         ...
 eTest   Player eTest   School Portal                              http://mfc.rs/ eTest   Management Portal eTest   Qu...
Example of unexpected results
   Students prefer e-testing mode…   …and don’t have problem to communicate    with computers.   “collective behavior”...
   Teachers’ training   Installing software in    all digital classrooms   More training   Providing high-quality    t...
Upcoming SlideShare
Loading in …5
×

eTest Solution

748 views

Published on

Presentation of

eTest Solution: Software Integrating Large- and Small-scale Assessment
by Srdjan Verbic, Srdjan Božovic and Saša Velickovic

(Proceedings if the IADIS international conference e-learning 2012, Lisbon, Portugal, July 17 - 20, 2012, ed. Miguel Baptista Nunes and Maggie McPherson, ISBN: 978-972-8939-71-7, pages 441-444)

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
748
On SlideShare
0
From Embeds
0
Number of Embeds
47
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

eTest Solution

  1. 1. eTest Solution: Software for Integrating Large- and Small-scale Assessment 18th July 2012 @ Lisbon Srdjan Verbić1, Srdjan Božović2, Saša Veličković21 Institute for Education Quality and Evaluation, Belgrade2 MFC Mikrokomerc, Belgrade
  2. 2.   still undeveloped Internet infrastructure  just adequate computer classrooms  MS Windows only  available free software  lack of experience  curious students  unmotivated and untrained teachersContext of e-assessment project
  3. 3. Small-scale Large-scaleSample size classroom hundreds of schoolsExample final exam standards setting, PISA, TIMSSExaminees all students representative samplePurpose mostly summative mostly formativeMeasure how much student what competences knows students haveRisk-level high-stakes low-stakesTypical small- and large-scale tests
  4. 4. Trial testing (or pilot-testing) the same conditions as for final test more-less the same questions smaller sample (usually volunteers) (very) low-stakes looking for items’ characteristicsTrial-testing
  5. 5.  Moodle testing machine, 2007 Moodle large-scale on-line test, 2009Prehistory of the project
  6. 6.  put Ttest instead of Quiz adjust Moodle distribution distribute Moodle installation to schools encourage teachers to use it ask them to download test :) collect dataLarge-scale e-assessment 2007(the evil plan)
  7. 7. Moodle is not so good solution for on-line tests, after all. memory leaking, again unreliable Internet connections slow update of the awkward database …Never-ending series of problems
  8. 8.  Microsoft technology XML based interoperability (like IMS QTI) Separate system components On- and off-line testing Efficient use of multimediaNew system 2011
  9. 9.  2808 schools (95% of all schools in SRB) 30,000 working places http://digitalnaskola.rs/2 Multipoint Servers and16 workstations per clssrmDigital Schools Unfortunately, broadband connection is not included!
  10. 10.  eTest Player eTest School Portal http://mfc.rs/ eTest Management Portal eTest Question EditoreTest Solution
  11. 11. Example of unexpected results
  12. 12.  Students prefer e-testing mode… …and don’t have problem to communicate with computers. “collective behavior” Teachers agree that <30% of colleagues would be able to conduct e-testing. Main obstacle: untrained teachers Main challenge: to prepare enough high- quality tests ready for downloadQuestionnaires’ feedback
  13. 13.  Teachers’ training Installing software in all digital classrooms More training Providing high-quality testsFurther steps

×