Your SlideShare is downloading. ×
0
New Options for Online Student Feedback<br />Learning Technologies TeamInformation Technology Service<br />
Learning Technologies Team<br />Judith Jurowska<br />Faculty of Arts & Humanities<br />Martin Edney<br />Faculty of Scienc...
Session outline<br />Voting systems – Julie Mulvey<br />Excel Spreadsheet – Judith Jurowska<br />Blogs – Christine Bohland...
 New Options for Feedback<br />Using Voting Systems<br />Julie Mulvey<br />
Voting systems<br />Audience Response System (ARS)<br />www.keepad.co.uk<br />TurningPoint plug-in to Microsoft PowerPoint...
Voting Systems<br />Research by Marina Sawdon from Phase 1 Medicine in using an Audience Response System<br />Assess prior...
Voting Systems<br />
Voting Systems<br />Evaluation<br />The audience response system gives me feedback on my progress<br />99% student satisfa...
Voting Systems<br />“Use of KEEpads was excellent, getting instant feedback is a good learning tool”<br />“I liked the KEE...
Voting Systems<br />Marina’s Conclusions:<br />Improves and facilitates learning<br />Increases student participation “…it...
Voting Systems<br />KEEpad only one type of voting system<br />PollEverywhere.com  Online system<br />Informal SIG at Durh...
New Options for Feedback<br />Automated Excel Spreadsheet<br />Judith Jurowska<br />
Frederico Federici Spreadsheet<br />
Dr F M Federici Spreadsheet<br />
Creating criteria<br />
Entering the scale<br />
Pulling the comments together<br />
Enter Candidate details<br />
Printing the report<br />
Finished student sheet<br />
Results Summary<br />Marking time reduced by 60%<br />Setup time was considerable. (once only)<br />Double marking was pos...
Liverpool John Moores UniversityDr Phil Denton<br />
QED article by Kevin Hinde<br />QED Issue 8 Michaelmas Term 2008<br />
 New Options for Feedback<br />Using Blogs for feedback on written work<br />Christine Bohlander & David Tual<br />Centre ...
Problems related to feedback and possible solutions<br /><ul><li>Keeping track /a trace of past work and feedback
Students’ follow-up on feedback
Repetitive feedback to different students
Collecting work, keeping records, photocopying/filing
Ask student to re-write and resubmit
Provide feedback in plenary session</li></li></ul><li>A different solution: the blogs<br /><ul><li>What is it?!</li></li><...
The blogs in practice<br /><ul><li>Students are set homework to be submitted via the blogs on DUO
We feedback on their work using the following colour code: </li></ul>	- ‘slips/lapses’, ‘first-order mistakes’ and ‘second...
The blogs in practice<br /><ul><li>Students are invited to correct their mistakes in blue (and crossing out the original m...
Thanks to the colour code, we can then quickly check whether the students have accurately corrected their mistakes.</li></...
A different solution: the blogs<br /><ul><li>Keeping track /a trace of past work and feedback
Students’ follow-up on feedback
Repetitive feedback to different students
Collecting work, keeping records, photocopying/filing
Ask student to re-write and resubmit
Provide feedback in plenary session</li></li></ul><li>A different solution: the blogs<br />‘Unlimited’, easy-to-access vir...
Students’ feedback<br />
Students’ feedback<br />
Essential aspects<br /><ul><li>Definition of clear and concrete aims and learning outcomes for essay-writing
Emphasis on learning process and monitoring of progress
Collaborative aspect: peer feedback</li></li></ul><li>The blogs in practice<br />
The idea of a collaborative blog<br /><ul><li>Students cannot only read each others‘ entries, BUT
They can also post comments and
They can correct each others‘ mistakes</li></li></ul><li>The blogs in practice<br />
Anticipated problems<br /><ul><li>No anonymity possible</li></ul>	 embarrassment<br /><ul><li>Students’ feedback might no...
German umlauts (ä, ö, ü) </li></li></ul><li>Results of questionnaire<br />Over 80% of students (strongly) agreed:<br /><ul...
The opportunity to be able to go back for amendments and revision is important for me.
I can learn from reading my peers’ work and the tutor’s feedback on their work.
I am happy for my peers to comment on my work.</li></li></ul><li>Results of questionnaire<br />BUT only 50% (strongly) agr...
A continuous process of learning with easy monitoring
While receiving peer feedback is appreciated, students appear to be reluctant to give feedback</li></li></ul><li>Reference...
Klapper, J. (2006), Understanding and developing good practice, Language teaching in higher education, CILT: London</li></...
 Turnitin System used for:<br /><ul><li>  student education about plagiarism
  detecting text matches against a student    database, journals and the internet</li></ul>What is GradeMark?<br />GradeMa...
Create a GradeMark Assignment<br />Create a Turnitin assignment(you can turn off the plagiarism check if necessary)<br /> ...
How can GradeMark help?<br />save time marking <br />provide in context, legible feedback to your students <br />provide c...
Case Study – Steve Lyon<br />Steve Lyon<br />Senior Lecturer : Department of Anthropology<br />
Context<br />1st Year Social Anthropology course<br />Purpose (aims and objectives)<br />Assess understanding of the topic...
Rationale<br />…when we started doing this  [on paper] we had students coming and saying, “I got lots of comments and so a...
Rubric Criteria (6)<br />Answer: Does the essay answer the assigned essay question? <br />Sources: Does the essay properly...
Rubric weightings<br />5 weightings for the 6 criteria<br />Poor (10)<br />Fair (49)<br />Good (59)<br />Very good (69)<br...
Results: Staff perspective<br />Saved time for markers<br />Fatigue is less of an issue…  The twentieth bad essay no longe...
Results: Staff perspective<br />Saved time for markers<br /><ul><li>Fatigue is less of an issue…
 The ‘marking rubric’… helps automate the process of allocating marks against set criteria.  This was particularly helpful...
Results: Staff perspective<br />Saved time for markers<br /><ul><li> Fatigue is less of an issue…
A ‘rubric’… helps automate the marking process
 GradeMark allowed Steve to manage this process ensuring a higher degree of quality control and consistency despite the di...
Results: Student Perspective<br />Improved feedback<br />The student gets at least six comments even if the postgraduate m...
QED article<br />Lyon, Steve. “Making the grade: Helping postgraduate teaching assistants with their marking and feedback....
Example Rubric<br />
Comments options<br />
Quickmarks<br />
Accessing GradeMark<br />
Accessing GradeMark<br />
How it works<br />
How it works - Markup<br />
How it works – Student View<br />
Click on the Rubric to Mark<br />
 New Options for Feedback<br />Audio/Video<br />Martin Edney<br />
Audio / Video Feedback<br />What?<br />Lecturer records feedback as <br />sound file<br />video file (talking head)<br />v...
Audio / Video Feedback<br />Why?<br />Students like it – they report<br />They get more feedback<br />They get quicker fee...
Audio / Video Feedback<br />Why (continued)?<br />More effective<br />Students pay attention<br />Tone of voice / inflecti...
Audio / Video Feedback<br />How?<br />Record audio / video file<br />e.g. use headset, digital dictaphone, Camtasia, Jing<...
Audio / Video Feedback<br />Tips<br />Individual feedback to each student + generic feedback to group<br />Look through su...
Audio / Video Feedback<br />Some feedback from students<br />I think this is a much better system than paper feedback.  I ...
Examples<br />Audio example<br />Comment on draft dissertation work<br />Sound file available from “A Word In Your Ear 200...
Examples<br />Video example<br />English for Academic purposes course<br />Russell Stannard, University of Westminster<br ...
Jing for video feedback<br />David Tual<br />
My motivation to use Jing<br /><ul><li>The possibility to ‘talk’ the students through their work in an asynchronous manner...
It takes no space on my J: drive, and there is no need to email or post big files on DUO.
It can be accessed from any pc with an internet connection.
Upcoming SlideShare
Loading in...5
×

New Options for Online Student Feedback

4,128

Published on

A presentation given to members of the School of Modern Languages at Durham University, exploring different ways of providing student feedback using an online learning environment such as Blackboard.

Published in: Education, Technology, Business
1 Comment
2 Likes
Statistics
Notes
No Downloads
Views
Total Views
4,128
On Slideshare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
44
Comments
1
Likes
2
Embeds 0
No embeds

No notes for slide
  • Create Turnitin assignment Mark using GradeMark’s Rubrics Created by yourselves Comments Added by yourselves as you go and saved “Quick marks” Supplied by Turnitin with an American slant but can be copied and altered.
  • Comments typed in the box can be saved to the clipboard for future use using the clipboard with green plus button. Comment icon can be changed by clicking the speech bubble and selecting a different image. Click the Save button to add the comment to the document.
  • The Quick marks supplied. These use American formats so may need to be edited.
  • Transcript of "New Options for Online Student Feedback"

    1. 1. New Options for Online Student Feedback<br />Learning Technologies TeamInformation Technology Service<br />
    2. 2. Learning Technologies Team<br />Judith Jurowska<br />Faculty of Arts & Humanities<br />Martin Edney<br />Faculty of Science<br />Julie Mulvey<br />Faculty of Social Sciences & Health<br />Dr Malcolm Murray<br />Learning TechnologiesTeam Leader<br />
    3. 3. Session outline<br />Voting systems – Julie Mulvey<br />Excel Spreadsheet – Judith Jurowska<br />Blogs – Christine Bohlander & David Tual<br />GradeMark – Judith Jurowska<br />Audio/video – Martin Edney<br />Preview: Feedback Tool – Malcolm Murray<br />
    4. 4. New Options for Feedback<br />Using Voting Systems<br />Julie Mulvey<br />
    5. 5. Voting systems<br />Audience Response System (ARS)<br />www.keepad.co.uk<br />TurningPoint plug-in to Microsoft PowerPoint <br />
    6. 6. Voting Systems<br />Research by Marina Sawdon from Phase 1 Medicine in using an Audience Response System<br />Assess prior knowledgeBransford 1999<br />Question asked before lecture starts<br />‘Learning occurred’<br />Same question asked at the end of lecture<br />Knowledge retention/ decay at different time points<br />Question asked again at 1 week and 4 weeks after lecture<br />
    7. 7. Voting Systems<br />
    8. 8. Voting Systems<br />Evaluation<br />The audience response system gives me feedback on my progress<br />99% student satisfaction<br />The audience response system aids my knowledge recall<br />98% student satisfaction<br />The audience response system consolidates my knowledge<br />98% student satisfaction<br />
    9. 9. Voting Systems<br />“Use of KEEpads was excellent, getting instant feedback is a good learning tool”<br />“I liked the KEEpad system because it allows you to answer questions without anyone knowing if you got it wrong or not.”<br />“I liked the use of the KEEpads, it helped break up the lectures and gave feedback”<br />“KEEpad use…gave instant feedback and kept me focused and immediately applying the lecture content to new situations” <br />
    10. 10. Voting Systems<br />Marina’s Conclusions:<br />Improves and facilitates learning<br />Increases student participation “…it wakes me up!!!”<br />Improves knowledge retention<br />Instant feedback<br />Low cost<br />Students love it!<br />Sawdon, M. 2009. Improving Knowledge Retention using KEEpad. Medical Education43(5): 487-487<br />
    11. 11. Voting Systems<br />KEEpad only one type of voting system<br />PollEverywhere.com Online system<br />Informal SIG at Durham<br />ESTICT (Engaging Students through In-Class Technology) (http://estict.ning.com)<br />
    12. 12. New Options for Feedback<br />Automated Excel Spreadsheet<br />Judith Jurowska<br />
    13. 13. Frederico Federici Spreadsheet<br />
    14. 14. Dr F M Federici Spreadsheet<br />
    15. 15. Creating criteria<br />
    16. 16. Entering the scale<br />
    17. 17. Pulling the comments together<br />
    18. 18. Enter Candidate details<br />
    19. 19. Printing the report<br />
    20. 20. Finished student sheet<br />
    21. 21. Results Summary<br />Marking time reduced by 60%<br />Setup time was considerable. (once only)<br />Double marking was possible<br />Second marker was impressed by the volume of feedback provided<br />Needs further work before it can be used widely.<br />
    22. 22. Liverpool John Moores UniversityDr Phil Denton<br />
    23. 23. QED article by Kevin Hinde<br />QED Issue 8 Michaelmas Term 2008<br />
    24. 24. New Options for Feedback<br />Using Blogs for feedback on written work<br />Christine Bohlander & David Tual<br />Centre for Foreign Language Study<br />
    25. 25. Problems related to feedback and possible solutions<br /><ul><li>Keeping track /a trace of past work and feedback
    26. 26. Students’ follow-up on feedback
    27. 27. Repetitive feedback to different students
    28. 28. Collecting work, keeping records, photocopying/filing
    29. 29. Ask student to re-write and resubmit
    30. 30. Provide feedback in plenary session</li></li></ul><li>A different solution: the blogs<br /><ul><li>What is it?!</li></li></ul><li>
    31. 31.
    32. 32.
    33. 33.
    34. 34. The blogs in practice<br /><ul><li>Students are set homework to be submitted via the blogs on DUO
    35. 35. We feedback on their work using the following colour code: </li></ul> - ‘slips/lapses’, ‘first-order mistakes’ and ‘second-order mistakes’ <br /> - correction of ‘errors’<br />- word(s) or clusters to be deleted (because wrong or corrected in green)<br />
    36. 36. The blogs in practice<br /><ul><li>Students are invited to correct their mistakes in blue (and crossing out the original mistakes, but not to delete them) and to look at the rest of the corrections
    37. 37. Thanks to the colour code, we can then quickly check whether the students have accurately corrected their mistakes.</li></li></ul><li>The blogs in practice<br />
    38. 38. A different solution: the blogs<br /><ul><li>Keeping track /a trace of past work and feedback
    39. 39. Students’ follow-up on feedback
    40. 40. Repetitive feedback to different students
    41. 41. Collecting work, keeping records, photocopying/filing
    42. 42. Ask student to re-write and resubmit
    43. 43. Provide feedback in plenary session</li></li></ul><li>A different solution: the blogs<br />‘Unlimited’, easy-to-access virtual storage space<br />Students can concentrate on main issues and easily resubmit<br />Online feedback leading to a better use of teaching time<br />
    44. 44. Students’ feedback<br />
    45. 45. Students’ feedback<br />
    46. 46. Essential aspects<br /><ul><li>Definition of clear and concrete aims and learning outcomes for essay-writing
    47. 47. Emphasis on learning process and monitoring of progress
    48. 48. Collaborative aspect: peer feedback</li></li></ul><li>The blogs in practice<br />
    49. 49. The idea of a collaborative blog<br /><ul><li>Students cannot only read each others‘ entries, BUT
    50. 50. They can also post comments and
    51. 51. They can correct each others‘ mistakes</li></li></ul><li>The blogs in practice<br />
    52. 52. Anticipated problems<br /><ul><li>No anonymity possible</li></ul>  embarrassment<br /><ul><li>Students’ feedback might not be constructive
    53. 53. German umlauts (ä, ö, ü) </li></li></ul><li>Results of questionnaire<br />Over 80% of students (strongly) agreed:<br /><ul><li>Overall, I prefer posting my written work on the blog to handing in handwritten work because of its positive effect on my learning.
    54. 54. The opportunity to be able to go back for amendments and revision is important for me.
    55. 55. I can learn from reading my peers’ work and the tutor’s feedback on their work.
    56. 56. I am happy for my peers to comment on my work.</li></li></ul><li>Results of questionnaire<br />BUT only 50% (strongly) agreed:<br /><ul><li> I am happy to comment on my peers’ work.</li></li></ul><li>Conclusion<br /> <br /><ul><li>Students are encouraged to reflect on their own performance.
    57. 57. A continuous process of learning with easy monitoring
    58. 58. While receiving peer feedback is appreciated, students appear to be reluctant to give feedback</li></li></ul><li>References<br /><ul><li>James, Carl (1998), Errors in language learning and use, exploring error analysis, Longman: London and New-York
    59. 59. Klapper, J. (2006), Understanding and developing good practice, Language teaching in higher education, CILT: London</li></li></ul><li> New Options for Feedback<br />GradeMark<br />by <br />TurnitinUK<br />Judith Jurowska<br />
    60. 60. Turnitin System used for:<br /><ul><li> student education about plagiarism
    61. 61. detecting text matches against a student database, journals and the internet</li></ul>What is GradeMark?<br />GradeMark provides online marking and feedback <br />
    62. 62. Create a GradeMark Assignment<br />Create a Turnitin assignment(you can turn off the plagiarism check if necessary)<br /> Mark using GradeMark’s functions:<br /> Rubrics <br /> Comments<br /> ‘Quick marks’ <br />Composition<br />Format<br />Punctuation<br />Usage<br />
    63. 63. How can GradeMark help?<br />save time marking <br />provide in context, legible feedback to your students <br />provide consistent feedback for large numbers of assignments <br />manage the marking process where there is more than one marker<br />build a reusable comment resource<br />
    64. 64. Case Study – Steve Lyon<br />Steve Lyon<br />Senior Lecturer : Department of Anthropology<br />
    65. 65. Context<br />1st Year Social Anthropology course<br />Purpose (aims and objectives)<br />Assess understanding of the topic<br />Improve essay writing skills<br />Teaching method <br />lecture, seminars<br />formative essay with feedback<br />Resources: <br />Postgraduate teachers<br />Marking rubric <br />GradeMark software (available through Turnitin in duo)<br />Final assessment - summative essay<br />
    66. 66. Rationale<br />…when we started doing this [on paper] we had students coming and saying, “I got lots of comments and so and so only got two little lines.” <br />I wanted somehow to, not impose, but encourage a more consistent amount of feedback for everyone and ensure similar things were being flagged up. <br />Quote from Steve Lyon<br />
    67. 67. Rubric Criteria (6)<br />Answer: Does the essay answer the assigned essay question? <br />Sources: Does the essay properly cite all sources? Are all cited references included in the bibliography? <br />Logic: Does the answer, build a demonstrable argument based on credible and appropriate evidence? <br />Style: Is the essay articulate and coherent? Does it use appropriate language and vocabulary for the purpose? Is it too chatty and informal? Is it unnecessarily complicated? <br />Spelling: Are there spelling and grammatical errors? Do these impede communication of the ideas? <br />Presentation: Is the bibliography correctly formatted? Is the text in some unusual font? Are the margins correct<br />
    68. 68. Rubric weightings<br />5 weightings for the 6 criteria<br />Poor (10)<br />Fair (49)<br />Good (59)<br />Very good (69)<br />Excellent (80)<br />Grade by clicking the boxes in the rubric.<br />the maximum for each criteria is capped at 80%<br />can manually give more for something beyond the criteria.<br />
    69. 69. Results: Staff perspective<br />Saved time for markers<br />Fatigue is less of an issue… The twentieth bad essay no longer invokes lots of exclamation marks, ‘What is this!’<br />Paraphrased from Steve Lyon QED article<br />
    70. 70. Results: Staff perspective<br />Saved time for markers<br /><ul><li>Fatigue is less of an issue…
    71. 71. The ‘marking rubric’… helps automate the process of allocating marks against set criteria. This was particularly helpful to the teaching assistants.</li></ul>Paraphrased from Steve Lyon QED article<br />
    72. 72. Results: Staff perspective<br />Saved time for markers<br /><ul><li> Fatigue is less of an issue…
    73. 73. A ‘rubric’… helps automate the marking process
    74. 74. GradeMark allowed Steve to manage this process ensuring a higher degree of quality control and consistency despite the distributed approach to teaching and marking.</li></ul>Paraphrased from Steve Lyon QED article<br />
    75. 75. Results: Student Perspective<br />Improved feedback<br />The student gets at least six comments even if the postgraduate marker [is] less confident…<br />Students really like it especially as I give them the rubric before the assignment so they know what they are working to. <br />Students like being able to get the feedback online. <br />They get more feedback … the essays will be riddled with these little comments that are specific to a paragraph<br />Paraphrased from Steve Lyon QED article<br />
    76. 76. QED article<br />Lyon, Steve. “Making the grade: Helping postgraduate teaching assistants with their marking and feedback..” QED (Durham University), Michaelmas term 2008.<br />
    77. 77. Example Rubric<br />
    78. 78. Comments options<br />
    79. 79. Quickmarks<br />
    80. 80. Accessing GradeMark<br />
    81. 81. Accessing GradeMark<br />
    82. 82. How it works<br />
    83. 83. How it works - Markup<br />
    84. 84. How it works – Student View<br />
    85. 85. Click on the Rubric to Mark<br />
    86. 86. New Options for Feedback<br />Audio/Video<br />Martin Edney<br />
    87. 87. Audio / Video Feedback<br />What?<br />Lecturer records feedback as <br />sound file<br />video file (talking head)<br />video file (screen capture of submitted work, with audio commentary)<br />
    88. 88. Audio / Video Feedback<br />Why?<br />Students like it – they report<br />They get more feedback<br />They get quicker feedback<br />“it’s not face to face but it’s certainly one to one”<br />Speed (as quick as or quicker than writing)<br />
    89. 89. Audio / Video Feedback<br />Why (continued)?<br />More effective<br />Students pay attention<br />Tone of voice / inflection<br />Allows you to talk direct to student work<br />
    90. 90. Audio / Video Feedback<br />How?<br />Record audio / video file<br />e.g. use headset, digital dictaphone, Camtasia, Jing<br />one file per student<br />Deliver file to student<br />duo Grade Centre – feedback file option<br />shared area (e.g. duo Files tab)<br />email<br />
    91. 91. Audio / Video Feedback<br />Tips<br />Individual feedback to each student + generic feedback to group<br />Look through submitted work before you start recording<br />Say student name or number at the beginning<br />Summary / mark at end of recording<br />
    92. 92. Audio / Video Feedback<br />Some feedback from students<br />I think this is a much better system than paper feedback.  I know I got a lot more from it than if you had just had to tick boxes and given me a comment in that little box on the piece of paper.  It was also much easier to use than anticipated, and I definitely think you should recommend this to other lecturers <br />I found the feedback for the formative much better than 'normal' written feedback. <br />(reported by Ian Greener, Applied Social Sciences, Durham University)<br />Students from Sheffield Hallam & Chester giving their opinion on audio feedback at a MEL-SIG event in Glasgow [sound file link]<br />
    93. 93. Examples<br />Audio example<br />Comment on draft dissertation work<br />Sound file available from “A Word In Your Ear 2009” website. <br />Part of Davies, D. Rogerson-Revell, P. & Witthaus, G. An exploratory study of speech styles in audio feedback to M- level students<br />Presented at “A Word In Your Ear 2009”, see<br />http://research.shu.ac.uk/lti/awordinyourear2009/papers.html<br />
    94. 94. Examples<br />Video example<br />English for Academic purposes course<br />Russell Stannard, University of Westminster<br />Video file available from http://www.russellstannard.com/king/king.html<br />For full details, see http://www.english.heacademy.ac.uk/explore/publications/casestudies/technology/camtasia.php<br />
    95. 95. Jing for video feedback<br />David Tual<br />
    96. 96. My motivation to use Jing<br /><ul><li>The possibility to ‘talk’ the students through their work in an asynchronous manner, giving them the chance to stop and think as the feedback is being given to them.
    97. 97. It takes no space on my J: drive, and there is no need to email or post big files on DUO.
    98. 98. It can be accessed from any pc with an internet connection.
    99. 99. Fast and easy to send to the students.
    100. 100. Provide some extra listening practice for students.</li></li></ul><li>A quick example<br />Set a homework task to be submitted via email<br />Record my feedback with Jing<br />Copy the link to the video into the email reply and immediately send it to the student<br />Video file available from http://screencast.com/t/M2ZjMWZmO<br />
    101. 101. New Options for Feedback<br />Preview: Future Feedback Tool <br />in duo<br />Malcolm Murray<br />
    102. 102. Future Feedback tool<br />A work in progress...<br />
    103. 103. Future Feedback tool<br />
    104. 104. Select Assignment<br />
    105. 105. File Naming Policy<br />
    106. 106. Feedback Template<br />
    107. 107. Feedback Template - Excel<br />
    108. 108. Feedback Template - Text<br />
    109. 109. Downloading Files<br />
    110. 110. Student Work & Summary<br />
    111. 111. Marking & Feedback<br />
    112. 112. Marking & Feedback<br />
    113. 113. Marking & Feedback<br />
    114. 114. Individual Feedback Files<br />
    115. 115. One per Student<br />
    116. 116. Bulk Upload<br />
    117. 117. Grade Centre<br />
    118. 118. Contact<br />If you would like to know more <br />or have any questions <br />please contact us via<br />itservicedesk@durham.ac.uk<br />
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×