Online Assessment Birmingham Mba


Published on

Presentation from EDiNEB 2008 about online assessment using WebCT

Published in: Business, Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Online Assessment Birmingham Mba

  1. 1. Online Assessment of the Birmingham MBA Joseph Berry Birmingham Business School June 2008
  2. 2. Contents <ul><li>Background </li></ul><ul><li>Choices </li></ul><ul><li>The Exam </li></ul><ul><li>Issues </li></ul><ul><li>Costs </li></ul><ul><li>Benefits </li></ul>
  3. 3. Background Photo from Flickr by rosefireraising
  4. 4. E-Learning at BBS <ul><li>Team structure </li></ul><ul><li>Admin integration </li></ul><ul><li>Central services – WebCT </li></ul><ul><li>Example projects </li></ul>
  5. 5. Module Details <ul><li>Accounting for Managers A module </li></ul><ul><li>FT MBA programme </li></ul><ul><li>First semester, mid-term exam </li></ul><ul><li>Originally examined by essay </li></ul><ul><li>Material </li></ul><ul><li>69 students </li></ul>
  6. 6. The problem Photos from Flickr by Corey Holms and ortizmj12 Marking Feedback
  7. 7. Feedback and resource issues <ul><li>“With reducing resources, giving students sufficient appropriate support and feedback is becoming more difficult. One solution is to use the web to deliver self assessment materials that allow the students to gain a measure on their understanding of course materials.” </li></ul><ul><li>Peat, 2000. </li></ul>
  8. 8. Importance of feedback <ul><li>“Computerized tests can be administered quickly with instantaneous feedback, allowing students to take appropriate remedial action before continuing with the course.” </li></ul><ul><li>Sangster, A. 1996. </li></ul>
  9. 9. Choices Photos from Flickr by john_bolin2002
  10. 10. Is online assessment feasible? <ul><li>Facilities </li></ul><ul><li>Levels of learning </li></ul><ul><li>Support </li></ul>Photos from Flickr by Brave Heart
  11. 11. Technology choices <ul><li>Question types </li></ul><ul><li>Feedback level </li></ul><ul><li>Presentation options </li></ul><ul><li>Delivery options (timer, password, random) </li></ul><ul><li>Question Mark Perception versus WebCT? </li></ul>
  12. 12. Technology choices – Saving time <ul><li>Respondus ( ) </li></ul><ul><li>Word-based MCQ conversion </li></ul><ul><li>Integration with WebCT </li></ul><ul><li>Screenshots - </li></ul>
  13. 13. The Exam Photos from Flickr by Stanford EdTech
  14. 14. Question Types used <ul><li>13 calculation questions </li></ul><ul><li>10 multiple choice questions (single or multiple answers) </li></ul><ul><li>2 paragraph questions </li></ul><ul><li>Total of 25 questions </li></ul>
  15. 15. Calculation Type
  16. 18. Practice exam <ul><li>Tech experience </li></ul><ul><li>International students </li></ul><ul><li>Bugs! </li></ul>Photos from Flickr by andrewhall
  17. 19. Delivery settings <ul><li>Use the timer </li></ul><ul><li>Apply a password </li></ul><ul><li>Do not allow marks to be released automatically </li></ul>Photos from Flickr by scottwills
  18. 20. Exam Procedure <ul><li>One technical support staff member per thirty students </li></ul><ul><li>10% additional PC capacity per cohort </li></ul><ul><li>Allow fifteen minutes before start of exam to iron out technical difficulties </li></ul><ul><li>Remind students to save after EVERY question </li></ul>
  19. 21. Issues encountered <ul><li>Dyslexic Student </li></ul><ul><li>Question Title versus Question Text </li></ul><ul><li>Technology failures mid-test </li></ul>
  20. 22. Summary Photos from Flickr by amish_shah
  21. 23. Costs <ul><li>E-Learning support </li></ul><ul><li>Technical support during exam </li></ul><ul><li>Question reworking </li></ul><ul><li>Preparation time </li></ul>Photos from Flickr by RVSV
  22. 24. Benefits <ul><li>Feedback </li></ul><ul><li>Automatic marking </li></ul><ul><li>Student revision aid </li></ul><ul><li>No paper is wasted </li></ul><ul><li>Reusable bank of questions </li></ul><ul><li>Question statistics </li></ul><ul><li>Scores can be released immediately, or delayed for moderation </li></ul>Photos from Flickr by carf
  23. 25. The Future Photo from Flickr by Nickster 2000
  24. 26. References <ul><li>Peat, M. (2000). Online assessment: The use of web based self assessment materials to support self directed learning. In A. Herrmann and M.M. Kulski (Eds), Flexible Futures in Tertiary Teaching. Proceedings of the 9th Annual Teaching Learning Forum, 2-4 February 2000. Perth: Curtin University of Technology. ) </li></ul><ul><li>Brown, S. Race, P. & Bull, J. 1999. Computer-assisted Assessment in Higher Education. Routledge. </li></ul><ul><li>Aisbitt, S. & Sangster, A. 2005. Using Internet-based On-line Assessment: A Case Study. Accounting Education: an international journal. Vol. 14, No. 4, 383-394, December 2005 </li></ul>