How Good is this Cookie?Briefly discuss with your neighbor.http://www.teachervision.fen.com/teaching-methods-and-management/rubrics/4522.html
3 2 1 0 Texture either Chewy in middle, Texture resembles aTexture Chewy crispy/crunchy or crisp on edges dog biscuit 50% uncooked Either light from Either dark brown overcooking or light from overcooking Color Golden brown Burned from being 25% or light from raw undercooking Store-bought flavor, Quality store- preservative Taste Home-baked taste Tasteless bought taste aftertaste – stale, hard, chalky Rich, creamy, high- Medium fatRichness Low-fat contents Nonfat contents fat flavor contents
What affects a score?
What is a Rubric? A rubric is a scoring guide. Tool that distinguishes teaching and learning by clearly stating criteria and describing levels of quality. A rubric is an authentic assessment tool used to measure students work. A rubric is a working guide for students and teachers, usually handed out before the assignment begins in order to get students to think about the criteria on which their work will be judged. Stein, M, D. Kinder, J. Slibert, & D.W. Carnine, 2006, ―Designing Assessment for8 Mathematics, pg. 1‖
Goal of a Rubric ―The purpose of the rubric is not only to evaluate but also to help students increase their level of performance by outlining a vision of success.‖ (M. Stein, etc., 2006, Designing Assessment9 for Mathematics)
―The rubric is the tool that binds assessment and student achievement by making students and parents aware of expectation from the onset. When this occurs, achievement at high level of performance is a natural outcome. There are no surprises for students during the evaluation process with the rubric. Rubrics also make grading easier and less messy for teachers.‖ (M. Stein, etc., 2006, Designing Assessment for Mathematics)10
Types of Rubrics (4) General Rubrics Specific Rubrics Basic. Give ‗general‘ Specific to the task. view. Can make assigning ―A teacher might use scores a general rubric to easier, faster, and review a sample of more consistent. papers for a task …‖ (Mathematics Assessment, 2005, pg . 120)11
Types of Rubrics Cont.Analytic Rubrics Holistic Rubrics Teacher scores A holistic rubric requires the separate, individual parts of teacher to score the overall process the product or performance or product as a whole, without first, then sums the individual judging the component parts scores to obtain a total score separately (Nitko, 2001) (Moskal, 2000; Nitko, 2001). Has one performance expectation Uses multiple descriptors for description at each numerical level. each criterion evaluated. The performance is evaluated as a Student has multiple whole and often given as a single opportunities to be evaluated score. within same rubric. ―A rubric used to obtain the overall ―A performance is assessed impression of the quality of a several times, using the lens of performance or product.‖ (McTighe a separate criterion each time.‖ & Wiggins, 1999, p. 277) (McTighe & Wiggins, 1999, p. 273)
Remember: Rubrics Can Be •A Complete Chart •Description of Math Involved •List of Possible Techniques Involved •Scale •Other: ______________ •THERE ARE MANY FORMATS FOR A RUBRIC!13
Rubric AnalyticOntarios Standards Pg. 16-17
Holistic Rubric Holistic Scale pg.2, 4, 6, 8, 21 DOROTHY IS RUNNINGFOR PRESIDENT pg 11-13
Kid Friendly Analytic RubricFromConstructiveAssessment inMathematics:How to Get ItGoing in YourDistrict(Anderson n.d.
Other Kid Friendly Rubrics
Scale 5 children went home in cars, 2 children rode home on bikes, 2 children walked. How many wheels took the children home? Draw or write to explain your answers.
(Base-ten block task on decimals.)Annotated Holistic RubricThis is a holistic rubric, but includes performance indicators for thetask. This helps teachers justify why a certain score was given. Reys, Lindquist, Lambdin, & Smith, 2006 “Helping Children Learn Mathematics,” pg. 77
Rubrics Can Be Used forAnything:
Advantages to Using a Rubric ―[Rubrics] can assess thinking skills, student understanding, and students‘ ability to apply their knowledge to mathematical tasks.‖ (Designing Assessment for Mathematics, pg. 1) Teachers can increase the quality of their direct in instruction by providing focus, emphasis, and attention to particular details as a model for students. Students, parents, and teachers know expectations. This includes how much effort and quality is expected. http://www.teachervision.fen.com/te aching-methods-and-27 management/rubrics/4522.html
Advantages to Using a Rubric Cont. Students can use rubrics as a tool to develop their abilities (self assessment & active involvement!). ―Rubrics can clarify for the students exactly what their strengths and weaknesses are and enable their self- assessment.‖ (Charlesworth, 2005, Experiences in Math, pg. 46) Teachers can reuse rubrics for various activities (some).28 Easy to adapt to different levels of learners.
What to Include in a Rubric (3) 1. ―Rubrics should be based developed based on what you are looking for in your class.‖ (Charlesworth, 2005, Experiences in Math, pg. 46) 2. Take categories from key steps, items that should always be in a problem/graph, neatness, or CORE standards. 3. Levels of quality that are expected. Students should be able to use the rubric to self assess their assignment prior to turning it in and get that score (or very29 close) when graded.
Levels of Success Level 4—Above expectations, outstanding. Level 3—Meets expectations, acceptable. Level 2—Needs revision or more work. Level 1—Shows need for31 reteaching.
Keys to Using Rubrics Determine what your goal is. Only have categories for things you want to see. Determine whether the rubric is formative or summative by how you use the data. (Will you reuse or is it specific to this time?) Determine the number of points on your rubric. Some say that it is important to have an even number of points possible, usually 4 or 6 because scorers are less discriminating with an even point system. (Stenmark, 1991; Danielson 1997) “Anchor Papers.‖ Have a good set of examples for each rubric level. Share these examples with students! If these are not32 shared, the rubric loses its effectiveness.
―Anchor Papers‖ It is crucial to show students examples of each rubric level. Many performance-based activities will come with a rubric. Begin with that and adapt as needed. Many also come with different examples of each quality level to help the teacher know how to properly score. Share these with students. Work with other grade level teachers to share samples. Let students practice scoring samples. (Peer & Self.) You may need to get permission from students and parents to use their paper as a sample. You may want to remove the name. ―Dorothy‖ Anchor Papers33 pg. 14-26
Let‘s take a look at this problem. (We will be scoring student samples.) Molly needs some green paper for her art project. She can get 2 sheets for 4 cents or 4 sheets for 6 cents at another store. Which is a better price? Explain your thinking at each step. 4 Sheets for 6 cents is a better deal.35 (Mathematics Assessment, 2005, pg.126-128)
Before Beginning to Score a Rubric Indentify: the essential mathematics the possible correct answers the practice implications of the problem (for example, in this problem the number of pieces of paper needed is known—students may or may not take this into account) What specifics, if any, you would add to the rubric(s).36
Idea for Scoring37
Let‘s Practice Scoring a Holistic Rubric Fully accomplishes the purpose of the task. Shows a good understanding and use of the main ideas of the problem.4 Communicates thinking clearly, using writing, calculations, diagrams and charts, or other representations. Substantially accomplishes the purposes of the task. Shows a reasonable understanding and use of the main ideas of the3 problems. Communicates thinking fairly well, but may use only one representation. Partially accomplishes the purpose of the task. Shows partial but limited grasp of the main mathematical ideas.2 Recorded work may be incomplete, misdirected, or not clearly represented. Shows little or no progress in accomplishing the purpose of the task.1 Shows little understanding of the main mathematical tasks. Work is almost or completely impossible to decipher. (Mathematics Assessment, 2005, pg.120)
Let‘s Practice Scoring an Analytic Rubric (Mathematics Assessment, 2005, pg.121, adapted) 0 Complete misunderstanding of the problem. 3 Part of the problem misunderstood orUnderstanding the Problem misinterpreted. 6 Complete understanding of the problem. 0 No attempt or totally inappropriate plan. 3 Partially correct plan based on part of thePlanning a Solution problem being interpreted correctly. 6 Plan could have led (or did lead) to a correct solution if implemented properly. 0 No answer or wrong answer based on inappropriate plan. 1 Copying error; computational error; partialGetting an Answer answer for a problem with multiple answers. 3 Correct answer and correct label for the answer.
Holistic Scores & Analytic Score & Student Comments Comments Jeanette 2—Substantially Understanding –3 (no price accomplishes the task, comparing recognizes getting more for Planning—0 (reasoning amount of money, missing) communication missing. Answer—3 Martha 4—Fully accomplishes the Understanding—6 task; shows a grasp of the Planning—6 concept, communication Correct Answer—3 clear. Michael 3—Partial understanding of Understanding—3 purpose of task, understood Planning—3 central idea. (Michael Answer—3 includes extra info that 4 is more than 2, does not explain.) Mashonna 1—Shows little or no Understanding—0(Mathematics Assessment, 2005, pg.129, progress, doesn‘t seem to Planning—0adapted) be getting it. Needs Answer—3 (No reasoning reteaching. given)
Designing a Rubric Criteria Checklist Levels of Objectives Success Rubric Use a variety of expectations already in place to41 create a rubric.
Criteria vs. Rubrics Criteria Rubric Describes intent of More detailed. standard. Tells levels of Similar to learning success. (MAIN objective. DIFFERENCE!) Easy to turn criteria into a rubric42
Turning a Checklist into a Rubric If you have a checklist, you can easily make it into a rubric. For example, a graph should always have 1. A title. 2. Labels on both axis. 3. Be accurate. 4. Be neat and readable. 5. Other ____________46
ACCURAC TITLE LABELS NEATNESS Y All parts of the The graph All data is graph (units of The graph is very contains a title that accurately3 measurement, neat and easy to clearly tells what represented on the rows, etc.) are read. the data shows. graph. correctly labeled. The graph Data Most parts of the The graph is contains a title that representation2 graph are correctly generally neat and suggests what the contains minor labeled. readable. data shows. errors. The data is The title does not The graph is The graph is inaccurately1 reflect what the sloppy and difficult incorrectly labeled. represented and data shows. to read. contains errors. The graph does The graph is not The data is The graph cannot047 not have a title labeled. missing. be read.
Keys to Design a Rubric 1. Decide the type of rubric. (chart, scale, list, etc.) 2. Determine what you would like to see in the task. These will be your categories. 3. Next you need to determine the quality levels acceptable ….. How many levels?48
Determining Levels of Success a) Identify the key mathematical elements that determine whether a paper is acceptable (4) or unacceptable (1). b) Identify specific differences between a paper that is barely unacceptable (2) and one that is clearly unacceptable (1). c) Give specific criteria for distinguishing between a paper that is acceptable, but just so-so (3), and one that clearly shows good understanding (4) in the task, correctly applies appropriate mathematical tools to the task, and uses clear mathematical reasoning to explain the solution process. (Huetink & Munshin, 2000, Teaching Mathematics for the 21st Century: Methods and Activities for Grades 6-12)49
Let‘s Practice Developing OurOwn Rubrics …. Take the remainder of the time (__ minutes) todiscover someof these sites.
Step by Step Help in Designing a Rubric A step-by-step process for designing scoring rubrics for classroom use is presented below. Information for these procedures was compiled from various sources (Airasian, 2000 & 2001; Mertler, 2001; Montgomery, 2001; Nitko, 2001; Tombari & Borich, 1999). The steps will be summarized and discussed, followed by presentations of two sample scoring rubrics. Step 1: Re-examine the learning objectives to be addressed by the task. This allows you to match your scoring guide with your objectives and actual instruction. Step 2: Identify specific observable attributes that you want to see (as well as those you don’t want to see) your students demonstrate in their product, process, or performance. Specify the characteristics, skills, or behaviors that you will be looking for, as well as common mistakes you do not want to see. Step 3: Brainstorm characteristics that describe each attribute. Identify ways to describe above average, average, and below average performance for each observable attribute identified in Step 2. Step 4a: For holistic rubrics, write thorough narrative descriptions for excellent work and poor work incorporating each attribute into the description. Describe the highest and lowest levels of performance combining the descriptors for all attributes.52 http://pareonline.net/getvn.asp?v=7&n=25
Step by Step Help in Designing a Rubric Cont. Step 4b: For analytic rubrics, write thorough narrative descriptions for excellent work and poor work for each individual attribute. Describe the highest and lowest levels of performance using the descriptors for each attribute separately. Step 5a: For holistic rubrics, complete the rubric by describing other levels on the continuum that ranges from excellent to poor work for the collective attributes. Write descriptions for all intermediate levels of performance. Step 5b: For analytic rubrics, complete the rubric by describing other levels on the continuum that ranges from excellent to poor work for each attribute. Write descriptions for all intermediate levels of performance for each attribute separately. Step 6: Collect samples of student work that exemplify each level. These will help you score in the future by serving as benchmarks. Step 7: Revise the rubric, as necessary. Be prepared to reflect on the effectiveness of the rubric and revise it prior to its next implementation.53 http://pareonline.net/getvn.asp?v=7&n=25
Summary of Steps54
Example Upper Elementary Math Mr. Harris, a fourth-grade teacher, is planning a unit on the topic of data analysis, focusing primarily on the skills of estimation and interpretation of graphs. Specifically, at the end of this unit, he wants to be able to assess his students mastery of the following instructional objectives: 1. Students will properly interpret a bar graph. 2. Students will accurately estimate values from within a bar graph. (step 1) Since the purpose of his performance task is summative in nature - the results will be incorporated into the students grades, he decides to develop a holistic rubric. He identifies the following four attributes on which to focus his rubric: estimation, mathematical computation, conclusions, and communication of explanations (steps 2 & 3). Finally, he begins drafting descriptions of the various levels of performance for the observable attributes (steps 4 & 5). The final rubric for his task appears in Table 4.55
Mr. Harris‘s Rubric Table 4: Math Performance Task – Scoring Rubric Data Analysis Name _____________________________ Date ___________ Score Description 4 Makes accurate estimations. Uses appropriate mathematical operations with no mistakes. Draws logical conclusions supported by graph. Sound explanations of thinking. 3 Makes good estimations. Uses appropriate mathematical operations with few mistakes. Draws logical conclusions supported by graph. Good explanations of thinking. 2 Attempts estimations, although many inaccurate. Uses inappropriate mathematical operations, but with no mistakes. Draws conclusions not supported by graph. Offers little explanation. 1 Makes inaccurate estimations. Uses inappropriate mathematical operations. Draws no conclusions related to graph. Offers no explanations of thinking. 0No response/task not attempted.56 http://pareonline.net/getvn.asp?v=7&n=25