10glasgowtemp phil denton


Published on

Assignment Handler and Gradetime: Optimising a VLE and the MS Word reviewer tool for electronic marking and feedback

Published in: Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

10glasgowtemp phil denton

  1. 1. Assignment Handler and Gradetime*: Optimising a VLE and the MS Word reviewer tool for electronic marking and feedback. Philip Denton Faculty of Science Learning Development Manager Liverpool JMU *Not affiliated with ‘Grade Time Dreams’: The internet’s premier dream interpretation website.
  2. 2. How the process works e-submission e-collation e-marking e-feedback Assignment handler in Blackboard Download folder of Word files Mark work using Gradetime Upload marks and feedback JMU Email marks and feedback You? Assignment submission VLE tool Save email attachments to a folder
  3. 3. Previous work on e-feedback <ul><li>‘ 98: Electronic Feedback (EF) v1 developed in VBA: Emails feedback reports out to students with 4 comment types: </li></ul><ul><li>Inputted before marking ( Grade & Standard comments) </li></ul><ul><li>During marking (Personal comments) </li></ul><ul><li>After marking (General comments) </li></ul><ul><li>Standard comments may be inputted in Normal or Criterion style. </li></ul><ul><li>‘ 02: EF v9: Introduction of standard comment picking interface and comment import/export. </li></ul><ul><li>‘ 07: EF v14: Introduction of ‘append’ feature = Custom text added after a standard comment during marking. </li></ul>
  4. 4. e-Marking tools <ul><li>Students prefer EF over ‘red-pen’ annotations on paper . 1 </li></ul><ul><li>Can EF be adapted for e-marking? Why not use Grademark? </li></ul><ul><li>Assignment handler is JMU’s preferred e-submission tool as it “accepts all file types and does not rely on third party servers.” </li></ul><ul><li>There is no equivalent of ‘append’ in Turnitin Grademark: You cannot fine-tune standard comments for individual students on-the-fly. </li></ul><ul><li>Cannot link annotated comments on a script to % award mark: Grademark’s Rubric Library is linked to % mark, but this is used for generic marking criteria. </li></ul><ul><li>You have to be on-line to use it. Cannot annotate with audio clips. </li></ul><ul><li>Cannot add general comments, automatically, to all work after marking is complete. These may include the average mark, for example. </li></ul>
  5. 5. Why use Assignment Handler? <ul><li>Superior to the ‘native’ Blackboard assignment tool: </li></ul><ul><ul><li>Emailed receipting of successful coursework submissions </li></ul></ul><ul><ul><li>Forced file names when work is downloaded </li></ul></ul><ul><ul><li>‘ Rich’ feedback is possible: Feedback can be returned in the same file format as the submission e.g. </li></ul></ul><ul><ul><ul><li>feedback sheet </li></ul></ul></ul><ul><ul><ul><li>annotated version of the original work </li></ul></ul></ul><ul><ul><li>Bulk upload of marks and feedback to Grade Center </li></ul></ul>
  6. 6. The MS Word reviewer tool <ul><li>Can be used to add comment balloons in right hand margin, but: </li></ul><ul><ul><li>All inserted comments start with ‘Comment [s#]’, where s is your initial(s) and # is the index number of the comment. </li></ul></ul><ul><ul><li>The default font style/size is difficult to read and tricky to adjust manually. </li></ul></ul><ul><ul><li>Comments have ‘ meta data’ included = The author name, date and time of the comment. This can only be removed afterwards and again, it’s tricky. </li></ul></ul>
  7. 7. Gradetime v3 <ul><li>Solves deficiencies of the reviewer tool and addresses problems normally associated with Assignment Handler: </li></ul><ul><ul><li>Easy navigation between files </li></ul></ul><ul><ul><li>Identification of ‘bad’ submissions that are not a single docx, doc, rtf, wps or odt file </li></ul></ul><ul><ul><li>Emailing function = for marks/feedback and ‘bad’ work. </li></ul></ul><ul><ul><li>Free-text comments, typed by students during upload, are displayed upon opening work (and not hidden in an Excel file) </li></ul></ul><ul><li>Version 1 released 2 nd Nov 2010 within JMU only. </li></ul><ul><li>Demonstration of v3 (Beta) </li></ul>
  8. 8. … balloon type format was clear and easy to understand… … sometimes i struggle to understand peoples handwritting… … I found the feedback very helpful … Students’ reaction (n = 19) … this would be my prefered method of feedback… It is printer friendly … … The balloons highlight the area relating to the comment … … it’s easier to cross-reference with your work as it is marked on the same sheet… … I much prefer this kind of feedback, to written… … I like the fact that it's a bit more personal… … Getting it by e-mail is so much easyer… … i can clearly read the comments without having to struggle with handwriting … … personally i prefer hand written notes on my work… … you save paper this way … … i was able to identify the positive and negative points of my work in the correct sections… … my favourite way of receiving feedback so far… … I can save a copy to my desktop… … via email (so) you can contact the tutor directly about the assignment … … your feedback (is) a lesson in itself… … much more in depth marking. (Web)links could be embedded in the notes… … we can access it from anywhere at any time… … we need a hard copy for our records…
  9. 9. Staff reaction <ul><li>Limited pilot to date: n = 5 </li></ul><ul><li>The software is “seriously impressive” (a tutor who used GT to mark 65 lab reports) </li></ul><ul><li>Works much better than even I expected – Primarily due to scrolling with a wheel mouse. </li></ul><ul><li>Requires training within an IT suite to encourage further take-up? </li></ul><ul><li>For 2011/12: SCS staff should be encouraged to use either of the 2 ‘complete’ e-marking solutions available: </li></ul><ul><ul><li>Assignment Handler and Gradetime </li></ul></ul><ul><ul><li>Turnitin and Grademark </li></ul></ul>
  10. 10. Gradetime v4 and beyond <ul><li>Facility to automatically append a feedback summary sheet that presents students marks in each section (intro etc.). </li></ul><ul><li>Coloured comments: Red, amber, green? </li></ul><ul><li>Mark moderation options </li></ul><ul><li>Tailored versions of Gradetime to work in your institution? </li></ul>