Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Creating Rubrics A Guide to Development and Use
Credits <ul><li>Materials in this handout were compiled from the following web sites. </li></ul><ul><ul><li>http://www. ca...
Introduction <ul><li>In this workshop we: </li></ul><ul><ul><li>Explore how to create tools for grading complex assignment...
Workshop Objectives <ul><li>By the end of the workshop you should be able to: </li></ul><ul><ul><li>Describe a rubric (wha...
What’s a rubric? <ul><li>Analytic rubrics have </li></ul><ul><ul><li>Levels of performance </li></ul></ul><ul><ul><li>Mult...
The TLT defines rubrics as: <ul><li>&quot;Rubrics&quot; explicitly state criteria for assignments.  </li></ul><ul><li>May ...
Another definition  ( Jon Mueller . Professor of Psychology, North Central College) <ul><li>Assess student performance alo...
Example:  Research Project   ( Jon Mueller . Professor of Psychology, North Central College) Contains very little informat...
One-Sentence Summary <ul><li>On a 3x5 note card: </li></ul><ul><li>Write a one-sentence summary that: </li></ul><ul><li>1....
Characteristics of Rubrics <ul><li>Increase an assessment's construct and content validity </li></ul><ul><li>Increase an a...
Characteristics Continued <ul><li>Help learners develop their ability to judge quality in their own and others' work </li>...
Characteristics Continued <ul><li>Learners and teachers monitor progress over a period of instruction </li></ul><ul><li>Re...
Which of these reasons are important to you? <ul><li>Importance   of Reliability </li></ul><ul><li>Validity of the assessm...
Types of Rubrics <ul><li>Ask yourself: </li></ul><ul><ul><li>For a particular task, do you want to be able to assess how w...
Holistic <ul><li>a holistic rubric does not list separate levels of performance for each criterion </li></ul><ul><li>a hol...
Holistic Example <ul><li>1 - Poor Researcher </li></ul><ul><li>included 1-4 sources </li></ul><ul><li>lots of historical i...
Analytic Rubric Contains very little information Contains most relevant information All relevant information is included X...
When to choose an analytic rubric <ul><li>Want to assess each criterion separately </li></ul><ul><li>Involve large number ...
Types of Rubrics Activity <ul><li>In the Lesson Builder materials, page 6, you will find a sorting activity. </li></ul>
Designing an Analytic Rubric <ul><li>Step 1.  Re-examine learning objective to be addressed by the task. </li></ul><ul><li...
Design Analytic Continued <ul><li>Step 4b .  Write thorough narrative description for excellent and poor work for each ind...
Hint:  Use Even Number of Levels <ul><li>Use an even number (4 or 6) of levels of performance on the scale.  </li></ul><ul...
Hint:  Arrange Levels High to Low <ul><li>High to low scale.  </li></ul><ul><li>Students read first the description of an ...
Sample High to Lows Needs work Fair Good Superior Not there yet Progressing Meets expectations Exceeds expectations Unacce...
More Hints <ul><li>Limited number of dimensions or criteria. </li></ul><ul><ul><li>The criteria are those components that ...
  Very limited Memorized; highly repetitive   Limited Lacks variety; repetitive   Adequate Varied; occasionally repetitive...
Chocolate Chip Cookies <ul><li>Break  into pairs. </li></ul><ul><li>Compete the worksheet  Creating a Rubric.  </li></ul><...
Using RubiStar <ul><li>These are some simple steps for getting started with Rubistar.   </li></ul><ul><li>Access the site ...
Rubistar Tips <ul><li>If you are using Internet Explorer, you can copy the rubric and paste it into a Word document where ...
Assignment <ul><li>Create a rubric for an objective/competency you have for a class you teach.  </li></ul><ul><li>Use the ...
Review <ul><li>Describe a rubric (what is it). </li></ul><ul><li>Describe the purpose of rubrics. </li></ul><ul><li>Descri...
Upcoming SlideShare
Loading in …5
×

Creating Rubrics

21,243 views

Published on

Presentation on how to create rubrics. Also uploaded is a handout to accompany the presentation.

Published in: Economy & Finance, Education

Creating Rubrics

  1. 1. Creating Rubrics A Guide to Development and Use
  2. 2. Credits <ul><li>Materials in this handout were compiled from the following web sites. </li></ul><ul><ul><li>http://www. carla . umn .edu/assessment/VAC/Evaluation/p_4.html </li></ul></ul><ul><ul><li>http: //jonathan . mueller .faculty. noctrl . edu/toolbox/rubrics . htm </li></ul></ul><ul><ul><li>http: //rubistar .4teachers.org </li></ul></ul><ul><ul><li>http: //valenciacc . edu/learningevidence/rubrics .asp </li></ul></ul><ul><ul><li>http://faculty. sacredheart . edu/stiltnerb/students/rubrics . htm </li></ul></ul>
  3. 3. Introduction <ul><li>In this workshop we: </li></ul><ul><ul><li>Explore how to create tools for grading complex assignments. </li></ul></ul><ul><ul><li>Explore the purpose and characteristics of rubrics. </li></ul></ul><ul><ul><li>Use RubiStar as a tool for creating a rubric. </li></ul></ul><ul><li>At the end of the session, </li></ul><ul><ul><li>You will have drafted a rubric for an assignment. </li></ul></ul><ul><ul><li>Given and received feedback from a colleague on your rubric. </li></ul></ul>
  4. 4. Workshop Objectives <ul><li>By the end of the workshop you should be able to: </li></ul><ul><ul><li>Describe a rubric (what is it?) </li></ul></ul><ul><ul><li>Describe the purpose of rubrics. </li></ul></ul><ul><ul><li>Describe the difference between holistic and analytic rubrics. </li></ul></ul><ul><ul><li>List the characteristics of good rubrics. </li></ul></ul><ul><ul><li>Develop a rubric for judging the quality of a product (chocolate chip cookie). </li></ul></ul><ul><ul><li>Create/modify a rubric for an assignment or activity in a class you teach. </li></ul></ul><ul><ul><li>Identify strengths and weaknesses in a rubric. </li></ul></ul>
  5. 5. What’s a rubric? <ul><li>Analytic rubrics have </li></ul><ul><ul><li>Levels of performance </li></ul></ul><ul><ul><li>Multiple criteria </li></ul></ul>
  6. 6. The TLT defines rubrics as: <ul><li>&quot;Rubrics&quot; explicitly state criteria for assignments. </li></ul><ul><li>May lead to a grade or be part of the grading process. </li></ul><ul><li>Are more specific, detailed, and disaggregated than a grade. </li></ul><ul><li>Show strengths and weaknesses in student work. </li></ul>
  7. 7. Another definition ( Jon Mueller . Professor of Psychology, North Central College) <ul><li>Assess student performance along a task-specific set of criteria </li></ul><ul><li>Measures performance against a predetermined criteria </li></ul><ul><li>Includes essential criteria for the task </li></ul><ul><li>Has multiple levels of performance </li></ul>
  8. 8. Example: Research Project ( Jon Mueller . Professor of Psychology, North Central College) Contains very little information Contains most relevant information All relevant information is included X1 Bibliography Cannot tell from which source information came from Can tell with difficulty where information came from Can easily tell which sources info was drawn from X1 Organization Lots of historical inaccuracies Few inaccuracies No apparent inaccuracies X3 Historical Accuracy 1-4 5-9 10-12 X1 Number of Sources 1 2 3 Criteria
  9. 9. One-Sentence Summary <ul><li>On a 3x5 note card: </li></ul><ul><li>Write a one-sentence summary that: </li></ul><ul><li>1. Defines a rubric. </li></ul><ul><li>2. Differentiates between performance levels and criteria. </li></ul><ul><li>3. Explains column weight. </li></ul><ul><li>When directed by facilitator, share your sentences with a partner. </li></ul><ul><li>Combine your two sentences into one that can be shared with the group. </li></ul>
  10. 10. Characteristics of Rubrics <ul><li>Increase an assessment's construct and content validity </li></ul><ul><li>Increase an assessment's reliability </li></ul><ul><ul><li>set criteria that raters can apply consistently and objectively </li></ul></ul><ul><li>Established criteria reduces bias </li></ul><ul><li>Can help teachers clarify goals and improve their teaching </li></ul><ul><li>Help learners set goals and assume responsibility for their learning </li></ul>
  11. 11. Characteristics Continued <ul><li>Help learners develop their ability to judge quality in their own and others' work </li></ul><ul><li>Provides specific feedback about areas of strength and weakness </li></ul><ul><li>Learners can use rubrics to assess their own effort and performance before submitting it </li></ul>
  12. 12. Characteristics Continued <ul><li>Learners and teachers monitor progress over a period of instruction </li></ul><ul><li>Reduces time spent grading </li></ul><ul><li>Engaging students in the design empowers them </li></ul><ul><li>Moves away from subjective grading </li></ul>
  13. 13. Which of these reasons are important to you? <ul><li>Importance of Reliability </li></ul><ul><li>Validity of the assessment </li></ul><ul><li>Reduction of bias in grading </li></ul><ul><li>Clarifying goals for you as the teacher </li></ul><ul><li>Communicating expectations to students </li></ul><ul><li>Improve students ability to judge their own performance </li></ul><ul><li>Means for providing better feedback to students </li></ul>
  14. 14. Types of Rubrics <ul><li>Ask yourself: </li></ul><ul><ul><li>For a particular task, do you want to be able to assess how well the students perform on each criterion, or do you want to get a more global picture of the students' performance on the entire task? </li></ul></ul>
  15. 15. Holistic <ul><li>a holistic rubric does not list separate levels of performance for each criterion </li></ul><ul><li>a holistic rubric assigns a level of performance by assessing performance across multiple criteria as a whole. </li></ul>
  16. 16. Holistic Example <ul><li>1 - Poor Researcher </li></ul><ul><li>included 1-4 sources </li></ul><ul><li>lots of historical inaccuracies </li></ul><ul><li>cannot tell from which source information came </li></ul><ul><li>bibliography contains very little information </li></ul><ul><li>2 - Good Researcher </li></ul><ul><li>included 5-9 sources </li></ul><ul><li>few historical inaccuracies </li></ul><ul><li>can tell with difficulty where information came from </li></ul><ul><li>bibliography contains most relevant information </li></ul><ul><li>3 - Excellent Researcher </li></ul><ul><li>included 10-12 sources </li></ul><ul><li>no apparent historical inaccuracies </li></ul><ul><li>can easily tell which sources information was drawn from </li></ul><ul><li>all relevant information is included </li></ul>
  17. 17. Analytic Rubric Contains very little information Contains most relevant information All relevant information is included X1 Bibliography Cannot tell from which source information came from Can tell with difficulty where information came from Can easily tell which sources info was drawn from X1 Organization Lots of historical inaccuracies Few inaccuracies No apparent inaccuracies X3 Historical Accuracy 1-4 5-9 10-12 X1 Number of Sources 1 2 3 Criteria
  18. 18. When to choose an analytic rubric <ul><li>Want to assess each criterion separately </li></ul><ul><li>Involve large number of criteria </li></ul><ul><li>More variance across the criteria </li></ul><ul><li>Need to weight criteria differently </li></ul>
  19. 19. Types of Rubrics Activity <ul><li>In the Lesson Builder materials, page 6, you will find a sorting activity. </li></ul>
  20. 20. Designing an Analytic Rubric <ul><li>Step 1. Re-examine learning objective to be addressed by the task. </li></ul><ul><li>Step 2. Identify observable attributes you want to see (as well as those you don’t want to see) your students demonstrate in the product, process, or performance. </li></ul><ul><li>Step 3. Brainstorm characteristics of each attribute. </li></ul>
  21. 21. Design Analytic Continued <ul><li>Step 4b . Write thorough narrative description for excellent and poor work for each individual attribute. </li></ul><ul><li>Step 5b. Complete the rubric by describing other levels on the continuum that ranges from excellent to poor for each attribute. </li></ul>
  22. 22. Hint: Use Even Number of Levels <ul><li>Use an even number (4 or 6) of levels of performance on the scale. </li></ul><ul><li>When there are an odd number of levels, the middle level tends to become a catch-all category. </li></ul><ul><li>With an even number of levels, raters have to make a more precise judgment about a performance when its quality is not at the top or bottom of the scale. </li></ul>
  23. 23. Hint: Arrange Levels High to Low <ul><li>High to low scale. </li></ul><ul><li>Students read first the description of an exemplary performance in each criterion. </li></ul>
  24. 24. Sample High to Lows Needs work Fair Good Superior Not there yet Progressing Meets expectations Exceeds expectations Unacceptable Acceptable Excellent Exemplary 1 2 3 4
  25. 25. More Hints <ul><li>Limited number of dimensions or criteria. </li></ul><ul><ul><li>The criteria are those components that are most important to evaluate in the given task and instructional context. </li></ul></ul><ul><ul><li>A rubric with too many dimensions may be unworkable in classroom assessment. </li></ul></ul><ul><li>Equal steps along the scale. </li></ul><ul><ul><li>The difference between 4 and 3 should be equivalent to the difference between 3 - 2 and 2 - 1. </li></ul></ul><ul><ul><li>&quot;Yes, and more&quot;, &quot;Yes&quot;, &quot;Yes, but&quot;, and &quot;No&quot; </li></ul></ul>
  26. 26.   Very limited Memorized; highly repetitive   Limited Lacks variety; repetitive   Adequate Varied; occasionally repetitive   Broad Highly varied; non-repetitive Vocabulary Range Variety Minimally developed, minimally supported Partially developed, partially supported Adequately developed, adequately supported Fully developed, fully supported Content coverage Isolated bits are comprehensible Gist and main ideas are comprehensible Almost always comprehensible Always comprehensible Comprehensibility Frequent errors Some errors Few errors No errors Accuracy Rarely or not at all Some of the time Usually Always Frequency Very few or none Some Most All Task 1 2 3 4  
  27. 27. Chocolate Chip Cookies <ul><li>Break into pairs. </li></ul><ul><li>Compete the worksheet Creating a Rubric. </li></ul><ul><li>Create a rubric for judging the quality of a chocolate chip cookie. </li></ul><ul><ul><li>-Be sure to decide if you want to do a holistic or analytic rubric!!!! </li></ul></ul><ul><ul><li>Be prepared to defend your decision. </li></ul></ul><ul><li>Use the handout on Rubric Examples to help you when you get stuck! </li></ul><ul><li>When you all finished, you will get to judge the cookies using the different rubrics. </li></ul>
  28. 28. Using RubiStar <ul><li>These are some simple steps for getting started with Rubistar.  </li></ul><ul><li>Access the site http: //rubistar .4teachers.org . </li></ul><ul><li>Take a moment to read about the different features. </li></ul><ul><li>When you are ready to get started, click on the tutorial and choose the option you prefer. </li></ul>
  29. 29. Rubistar Tips <ul><li>If you are using Internet Explorer, you can copy the rubric and paste it into a Word document where you can continue to edit. </li></ul><ul><li>When first getting started, you might want to choose an existing template. </li></ul><ul><li>You may find that you can create a rubric you like by combining existing rubrics into one of your own.  </li></ul><ul><ul><li>You can do this by opening two windows to Rubistar and copying and pasting between windows. </li></ul></ul>
  30. 30. Assignment <ul><li>Create a rubric for an objective/competency you have for a class you teach. </li></ul><ul><li>Use the worksheet on creating a rubric to get you started. </li></ul><ul><li>Divide into teams. </li></ul><ul><li>Exchange rubrics and use the Aunt Olive's Rubric on Rubrics to provide feedback to a colleague on their work. </li></ul>
  31. 31. Review <ul><li>Describe a rubric (what is it). </li></ul><ul><li>Describe the purpose of rubrics. </li></ul><ul><li>Describe the difference between holistic and analytic rubrics. </li></ul><ul><li>List the characteristics of good rubrics. </li></ul><ul><li>Develop a rubric for judging the quality of a product (chocolate chip cookie). </li></ul><ul><li>Create/modify a rubric for an assignment or activity in a class you teach. </li></ul><ul><li>Identify strengths and weaknesses in a rubric. </li></ul>

×