A scoring tool that lays out the specific expectations for an assignment. Marking criteria… Breaks down levels of achievement and lays out descriptions of what would constitute achievement of that grade. And weights the criteria…
Where as a lot of student feel that rubrics help with their learning by setting out goals, tutors perspectives of using rubrics tend to lean towards the grading advantages... they serve a good purpose of marking, enabling them to mark consistently and with more objective focus. It also enables the justification of grades more clearly Andrade reported that in areas where resistance/hesitation to rubrics existed resulted from a lack of understanding of the learning and teaching benefits of a rubric. It was felt that tutors would be more receptive if they understood how rubrics can enhance learning and teaching.
What affects reliability? To what extent could a grade be reproduced under different conditions? Holistic approaches (grading and feeding back without the use of a rubric) often produce a different grade to a more analytical approach (with a rubric). Which one should take precedent? Is tweaking the rubric to match the holistic grade ethical? Philosophically speaking, you're using rubrics anyway... How do you make a judgment without criteria? You're making a judgment, therefore criteria is involved. Your internal rubric, if not specific, could change from paper to paper.
Teaching model adapted slightly from Introduction to Rubrics by Stevens and Levi. Northampton CAIEROS - module development process - teaching teams start from scratch - learning and teaching specialist - learning technologist - librarian - student - support and align assessment with learning outcomes, activities - use a rubric to layout criteria, aligned with LOs * appropriate/understandable language A few studies that I've read promote the design of rubrics for assessment with the students. Positing that students are more likely to use one if they played a part in designing it than when it see it only as a way for the tutor generate grades. > takes us back to "emphasising the use of rubrics to students"... I would like to look into the use of a rubric for the module development process for programme/module design and evaluating programmes At Northampton we use a module development process where teaching teams start from scratch to develop a module. Throughout this process the teaching team, together with a learning and teaching specialist, learning technologist, student and librarian set out learning outcomes, activities etc to support and align assessment with outcomes. Using a rubric to lay out the criteria for the assessments - aligned with learning outcomes - makes everything really simple as long appropriate/understandable language is used in the marking criteria.
The definitions defined in the marking criteria provide detailed explanations of what a student must do to demonstrate a skill, proficiency, or criterion in order to attain a particular level of achievement. Excellent, very good, good satisfactory etc... Scoring, or marking, work based on these definitions makes the students job of interpreting the tutors judgment more easy to understand the targets for their learning When marking in teams consistency needs to be monitored. In the Tii case study on marker was marking much more harshly than the others which, because of problems with moderation (later), wasn't picked up until after grades were released.
Marking by more than one tutor – Bb - use smart views Tii – Turnitin groups Exporting Bb – No, reporting issue Tii – GradeMark paper download includes rubric Use either Blackboard or Turnitin rubrics for: Individual assignments Setting an indefinite number of criteria and score ranges Setting marks by points or percentage or no marks (feedback only) Specifying feedback for each possible score/criterion in advance Automatically adding up marks Manually overriding marks if required Re-use with future assessments Exporting and importing rubrics (to allow sharing with others) *Limitations Blackboard rubrics cannot be printed by academics once completed – for example – for moderation purposes. (A change request has been submitted to Blackboard for this but this will not be available until at least 2013.) If adding comments to a Blackboard rubric, remember to save your work often – it does not auto-save so will otherwise be lost in the event of a time-out or computer crash.
Online submission and Blackboard rubrics
Online submission andBlackboard rubricsAdel Gordon | @adelgordonLearning TechnologistUniversity of NorthamptonLondon BUG – 26 Apr 2013
Why rubrics?• Clarify learning goals from the offset• Design materials and activities that address those goals• Communicate those goals to students• Guide feedback on students’ progress• Assess products to degree to which the goals are metAndrade, 2005• Comparing the quality of a students work with fixed criteria and‘standards’ is educationally more defensible than makingcomparisons with how other students in the course perform onthe same or equivalent tasksSadler, 2009
The flip sideSource:http://introductiononlinepedagogy.pbworks.com/w/page/20123554/Rubrics
Recommended modelRubric design based onlearning outcomesRubric design based onlearning outcomesScore studentwork using rubricScore studentwork using rubricLook forpatternsLook forpatternsIdentify commonareas of strengthsand weaknessesIdentify commonareas of strengthsand weaknessesMake adjustments toteaching based onreflectionsMake adjustments toteaching based onreflectionsAdapted from Stevens & Levi, 2013Emphasisethe use ofrubricsEmphasisethe use ofrubrics
How were they used?• Blogs• Presentations• Media files• Turnitin
In practiceRubrics set outexpectations to aidthe student tounderstand whatthey’re being gradedagainstRubrics set outexpectations to aidthe student tounderstand whatthey’re being gradedagainstDevelops/drives alevel ofprofessionalism andenables me toprovide more timelyfeedbackDevelops/drives alevel ofprofessionalism andenables me toprovide more timelyfeedbackRubrics let studentsknow how theirgrade was calculatedand where theycould improve theirworkRubrics let studentsknow how theirgrade was calculatedand where theycould improve theirworkModeration can takeplace immediatelyand feedback isready to be releasedspeedilyModeration can takeplace immediatelyand feedback isready to be releasedspeedilyRubrics give themarker confidencethat you can beenmore objective thensubjectiveRubrics give themarker confidencethat you can beenmore objective thensubjectiveMakes calculatingthe overall gradeeasier when using amultifacetedapproach toassessment criteriaMakes calculatingthe overall gradeeasier when using amultifacetedapproach toassessment criteria
References− Andrade (2005), Teaching with Rubrics: The Good, the Bad, and the Ugly. College Teaching, [online]Available at: http://www.uri.edu/assessment/uri/guidance/documents/Andrade_2005_Teachingwithrubrics.pdf− McKinney, A (2009), Introduction to Online Pedagogy, Assessment and Evaluation, Rubrics. [online]Available at: http://introductiononlinepedagogy.pbworks.com/w/page/20123554/Rubrics− Sadler, R, D., 2009, Indeterminacy in the use of preset criteria for assessment and grading,Assessment and Evaluation, 34:2, 159-179− Stevens, D. D. and Levi, A. J., 2013. Introduction to Rubrics. Virginia: Stylus Publishing− University of Manchester, Rubrics – What are they? Why and how should I use them? [online]Available from: http://www.elearning.eps.manchester.ac.uk/rubrics-what-are-they-and-why-and-how-should-i-use-them/
Contact• Adel Gordon– University of Northampton– Adel.Gordon@northampton.ac.uk– @adelgordon– http://blogs.northampton.ac.uk/learntech