Improving
Assessment and
Feedback
Paul Hellwege
Twitter: @p_hellwege
Paul.Hellwege@monashcollege.edu.au
Monash College – Central eLearning Team
22
Introduction to Monash
• A fully owned subsidiary of Monash
University, providing pathways into
Monash University courses
• 8,000 students
• Over 1000 staff
• High growth numbers
• 5 divisions:
– Diplomas
– Foundation Year
– Professional Pathways
– Bachelor of International Business
– English Language Centre
3
Introduction to CeLT
• The Central eLearning team had its beginnings
in 2013
• Assisted in implementing both blended and
flipped learning models
• Assisted in 71 Learning Design Workshops in
2016-17 across all divisions that help shape
courses and identify areas of improvement
44
Problems Identified
• Teachers were losing a lot of time marking
• Marking was done in many different ways
• Student’s participation rates needed to improve
After speaking to teachers, a lack
of engagement with assessment
was identified
55
Problems Identified
• Students not participating
• Not receiving relevant or timely feedback
• Unable to submit drafts and check referencing
• Feedback was not consistent
66
Planning – How to address the problem
• Rollout feedback studio, to:
– Address student feedback issues
– Address marking time issues
– Move rubrics online
• Logistical plan
– 3 subjects per trimester across the business
division of Diplomas
– Train unit leaders and teachers in how to use
feedback studio
– Create resources for student use
77
Why Feedback Studio?
• Simplified, consistent marking
• Centralised assignment hub
• A range of feedback options
88
99
1010
1111
1212
Pre-Implementation
• Training sessions for Unit Leaders, on set up
side
• Training sessions for teachers, focused on
marking
• Roll out of iPads for marking at home (if
requested)
1313
Implementation
• Monitoring Turnitin set up
• Providing support for unit leaders
• Being available for training sessions for new
and sessional staff members
1414
Results and Statistics
• Verbal feedback from staff was very
positive
• Marking time reduced by 7 minutes per
assignment
– Across a 101 student subject, time saved
between the four teachers: ~12 hours
• Marks automatically loaded to Moodle
Gradebook was a big efficiency increase
• Linking comments to rubric was powerful
feedback for students
• Teachers could see improvement from
enabling drafting phase
1515
Results and Statistics
• Students received more consistent
feedback
• Students received a wider range of
feedback
• The amount of online feedback
tools used jumped significantly from
2016 to 2017
• In more detail…
1616
Results and Statistics
441
8
323
2643
462
2961
0
500
1000
1500
2000
2500
3000
3500
Total Submissions Submissions Marked With Rubric Similarity Reports Produced
Submission Statistics
2016 2017
1717
Results and Statistics
12 5 5
1284
3183
902
0
500
1000
1500
2000
2500
3000
3500
Bubble Comments Quickmarks Inline Text Comments
Feedback Statistics
2016 2017
1818
Where to next?
19
Any Questions?
Improving Assessment and Feedback | Paul Hellwage - Monash College | TLCANZ17

Improving Assessment and Feedback | Paul Hellwage - Monash College | TLCANZ17

  • 1.
    Improving Assessment and Feedback Paul Hellwege Twitter:@p_hellwege Paul.Hellwege@monashcollege.edu.au Monash College – Central eLearning Team
  • 2.
    22 Introduction to Monash •A fully owned subsidiary of Monash University, providing pathways into Monash University courses • 8,000 students • Over 1000 staff • High growth numbers • 5 divisions: – Diplomas – Foundation Year – Professional Pathways – Bachelor of International Business – English Language Centre
  • 3.
    3 Introduction to CeLT •The Central eLearning team had its beginnings in 2013 • Assisted in implementing both blended and flipped learning models • Assisted in 71 Learning Design Workshops in 2016-17 across all divisions that help shape courses and identify areas of improvement
  • 4.
    44 Problems Identified • Teacherswere losing a lot of time marking • Marking was done in many different ways • Student’s participation rates needed to improve After speaking to teachers, a lack of engagement with assessment was identified
  • 5.
    55 Problems Identified • Studentsnot participating • Not receiving relevant or timely feedback • Unable to submit drafts and check referencing • Feedback was not consistent
  • 6.
    66 Planning – Howto address the problem • Rollout feedback studio, to: – Address student feedback issues – Address marking time issues – Move rubrics online • Logistical plan – 3 subjects per trimester across the business division of Diplomas – Train unit leaders and teachers in how to use feedback studio – Create resources for student use
  • 7.
    77 Why Feedback Studio? •Simplified, consistent marking • Centralised assignment hub • A range of feedback options
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
    1212 Pre-Implementation • Training sessionsfor Unit Leaders, on set up side • Training sessions for teachers, focused on marking • Roll out of iPads for marking at home (if requested)
  • 13.
    1313 Implementation • Monitoring Turnitinset up • Providing support for unit leaders • Being available for training sessions for new and sessional staff members
  • 14.
    1414 Results and Statistics •Verbal feedback from staff was very positive • Marking time reduced by 7 minutes per assignment – Across a 101 student subject, time saved between the four teachers: ~12 hours • Marks automatically loaded to Moodle Gradebook was a big efficiency increase • Linking comments to rubric was powerful feedback for students • Teachers could see improvement from enabling drafting phase
  • 15.
    1515 Results and Statistics •Students received more consistent feedback • Students received a wider range of feedback • The amount of online feedback tools used jumped significantly from 2016 to 2017 • In more detail…
  • 16.
    1616 Results and Statistics 441 8 323 2643 462 2961 0 500 1000 1500 2000 2500 3000 3500 TotalSubmissions Submissions Marked With Rubric Similarity Reports Produced Submission Statistics 2016 2017
  • 17.
    1717 Results and Statistics 125 5 1284 3183 902 0 500 1000 1500 2000 2500 3000 3500 Bubble Comments Quickmarks Inline Text Comments Feedback Statistics 2016 2017
  • 18.
  • 19.