SlideShare a Scribd company logo
Introduction to Rubrics
“Learning increases, even in its serendipitous aspects,
when learners have a sense of
what they are setting out to learn,
a statement of explicit standards they must meet,
and a way of seeing what they have learned.”
Loacker, Cromwell, & O’Brien in Huba and Freed, p. 151.
Presented by the CHFA SOA Committee, Spring 2007
Facilitator: Martha Reineke
Based on workshop bibliography listed at end of presentation.
Workshop Goals
 Obtain a working vocabulary for rubrics
 Determine ways in which rubrics contribute to participants’ courses
and assessment efforts.
 Identify parts of a rubric and steps for making a rubric.
 Make a rubric!
 Review and consolidate learning in order to make rubrics on your
own.
Do you need a rubric?
 Course Issues:
 you are four weeks behind on your grading.
 you have graded all your essays but you are afraid that you graded the last ones more
rigorously than the ones you graded two weeks ago.
 you have carefully described in class your expectations for an assignment but you
now have twenty e-mails from students who say, “I don’t know what you want on this
assignment.”
 Student Outcomes Assessment Concerns:
 You want to engage in meaningful assessment of student learning without making
this your life’s work.
 You wish that your conversations about student learning in your majors were more
focused and stayed on track from semester to semester.
 You lack confidence that your assessment efforts are yielding information that your
department can actually use to enhance your majors’ learning experiences.
- Stevens & Levi, pp. 4-6.
How rubrics help:
 For Courses:
 Rubrics enable faculty to clearly communicate expectations for student
performance to students. They support more consistent and objective
assessment of student work. They also facilitate detailed feedback to students.
When areas of strength and weakness in performance are marked on an essay
rubric, students more easily comprehend the reasoning behind their professor’s
assessment of their work.
 For Student Outcomes Assessment:
 Rubrics facilitate quality conversations among faculty about student learning,
shorten the time it takes to do SOA, and contribute to the validity and reliability of
the assessment process.
- Stevens and Levi, Ch. 2
A Rubrics Glossary
Rubrics
Goals
Outcomes
Criteria
Validity
Reliability
Analytic Rubrics
Holistic Rubrics
Developing a Rubric in Four Parts
 Task Description
What is the student supposed to do?
 Examples: write an essay, perform a concerto, make an
oral presentation.
 At the top of a sheet of paper, place the full description of
the assignment.
 Begin a grid that is headed by a descriptive title and blocks
out dimensions of the assignment.
- Next four slides: Stevens & Levi, Ch. 1
Developing a Rubric cont.
Scale
How well or poorly has the student done on the task?
 Sophisticated, competent, partly competent, not yet competent.
 Exemplary, proficient, marginal, unacceptable.
 Advanced, Intermediate, Novice.
 Distinguished, proficient, intermediate, novice.
 Accomplished, developing, beginning. (Huba and Freed, 2000)
Note: Consider whether a scale needs more than three levels. Some
research indicates that information about student learning obtained
from a three-level scale is comparable to that obtained from a five-
level scale. More levels typically means more time spent on
assessment.
Developing a Rubric cont.
Dimensions
 Dimensions break down a task into components and
identify the importance of these components.
 Dimensions are descriptive, not evaluative (e.g.,
“organization” not “good organization”).
 Dimensions help students see that the work they are
doing is multidimensional and draws on multiple
abilities.
Developing a Rubric cont.
Description of the Dimensions
 Rubrics should contain at least a description of the highest level
of performance.
 With experience and in response to the complexity of the
performance, descriptions of all levels can be written.
 Students need not fit cleanly into a single category. On oral
presentation skills, a student might speak in a clear voice but
lack eye contact.
 Descriptions for each level help students see that the work they
are doing does have varying levels of achievement. There is a
difference between poor and excellent work.
Reflections on making a rubric:
What are my reactions to making this
rubric?
How will my teaching change if I use
rubrics with my students?
How could I use rubrics to give students
feedback?
- Huba and Freed, p. 166
Creating Your First Rubric:
Is it worth the time?
 Experienced rubric makers can generate complex rubrics in less than an hour. They can update
rubrics in minutes.
 Beginning rubric making does take time.
 Even beginning rubric makers save actual grading time. We often write the same comments on
multiple pieces of student work. Transposing our advice to a rubric and circling it on the rubric
saves time.
 Most important, rubrics enhance the quality of our teaching. We become more aware of our
methods of teaching and of our expectations for students. We also provide feedback to students
that enables them to actually improve over time, reducing repetitive teaching in the classroom.
 Rubrics enable students to do better work if they are distributed to students at the beginning of an
assignment. Better work often takes less time to grade than poor work. Rubrics enable students
to see that their success in course work is developmental and incremental (many students do not
know this).
- Stevens & Levi, pp. 14-27; Huba and Freed, 169-174.
To Remember:
 Rubrics are written on paper, not stone.
 Start with a basic rubric and improve it with each
use.
 Discover new dimensions for the rubric while
grading current student work.
 Ex. Students were repeatedly missing a particular assignment goal. When their teacher went to the rubric
to circle the missing goal, she discovered that this goal was not on the rubric. For the following semester,
she added it to the rubric and incorporated a description of this goal explicitly into the assignment.
The Usefulness of Rubrics for
Assessment
“Strong presentation skills” = an outcome
for your major.
If all Seniors in your major were assessed
on presentation skills using the rubric you
just created, and 45 out of 60 scored in
the lowest level on Dimension 2, what
questions could you discuss at a faculty
meeting on assessing your major? What
might you do about these findings?
What does 75/100 mean to us and to our
students?
 A grade is one way to evaluate learning.
 Some persons wants grades--students, potential employers, graduate admissions
committees—and see meaningful information in grades.
 Grades are useful for marking summative, individual achievement in relation to other
summative, individual achievements on specific tasks.
 Assessment is diagnostic way to evaluate learning.
 NOT diagnostic: Students earned an average grade of C+ in this course.
 Diagnostic: “On their capstone projects, students were strong in identification of the
problem but weak in considering alternative solutions.”
 Data are aggregated to yield information about strengths/weaknesses in a group of
students. Aggregate data are anonymous (student and faculty names are removed).
 Data are used to suggest courses of action to improve learning.
- Sources: Barbara Walvood, presentation at the Higher Learning Commission 2005 Meeting, April 2, 2005,
Chicago, IL; http://www.umass.edu/oapa/oapa/publications/online_handbooks/program_based.pdf,
How do students
know whether they are learning?
 What does 75/100 mean for students? For which students? In
respect to what? An easy or difficult text? A class of strong or weak
students?
 Rubrics answer student questions about learning by:
 Making criteria for improvement visible.
 Revealing a process of learning (e.g. detailing skills and knowledge
[current, new, past]).
 Showing standards for a professional field or discipline, the qualities of
an educated person, and expectations of future employers.
- Huba and Freed, pp. 154-55; pp. 169-73.
Constructing a Rubric:
Building our skill-set in four stages
 Stage 1: Reflecting
 What do we want from our students? Why did we create this assignment? What happened the last time we
did this?
 Stage 2: Listing
 What are the learning outcomes we hope to see in the completed assignment?
 Stage 3: Grouping and Labeling
 Place similar outcomes together to comprise dimensions of the rubric.
 Stage 4: Application
 Form the actual rubric by deploying dimensions and levels along each side of the rubric.
- Stevens and Levi, Chapter 3.
Analytic and Holistic Rubrics
 An analytic rubric articulates levels of
performance for each criterion so the teacher
can assess student performance on each
criterion.
 In contrast to an analytic rubric, a holistic rubric
does not list separate levels of performance for
each criterion. Instead, a holistic rubric assigns a
level of performance by assessing performance
across multiple criteria as a whole.
How do I know
when I have a good rubric?
Ready to roll:
 The content has a “ring of truth:” You review the rubric and note that the
content states what you truly do look for when evaluating student work.
 Emphases seem right: things that are more important are stressed
more in the rubric than things that are less important.
 Levels of the scale make sense.
 Features of importance have been covered without overload.
 You are left with only a few questions about what is/is not on the rubric.
 The rubric is insightful. It helps you organize your thinking about what
counts as quality.
- Next two slides: Arter and McTighe, pp. 46-47.
How do I know continued:
 On the way:
 You still notice that some important things are not on the rubric or not on
it sufficiently.
 Balance is in question. Students might miscue on important vs. less
important features.
 The rubric sprawls – organization remains in question.
 Not ready:
 You can think of many things not on the rubric that should be.
 You find yourself asking, “Why assess this?” Why is this important?
 The rubric seems mixed up and random in its focus.
 The rubric seems out of balance.
 There are many features on which a student could miscue about the
importance of a dimension of the rubric.
How can Rubrics be Used to Assess
Program Learning Goals?
Embedded course assignments
Capstone experiences.
Field experiences.
Employer feedback.
Peer evaluations or self-evaluations.
Portfolios.
- Suskie, p. 137.
Workshop bibliography
 Scoring Rubrics in the Classroom. By Judith Arter and Jay McTighe.
Corwin Press, 2001.
 Learner-Centered Assessment on College Campuses by Mary E. Huba and
Jann E. Freed. Allyn and Bacon, 2000. *
 Introduction to Rubrics, by Dannelle D. Stevens and Antonia J. Levi. Stylus
Publications, 2005. *
 Assessing for Learning, by Peggy L. Maki. Stylus Publications, 2004.
 Assessing Student Learning by Linda Suskie. Anker, 2004.
 http://jonathan.mueller.faculty.noctrl.edu/toolbox/glossary.htm
* = most helpful sources.

More Related Content

What's hot

TESTA, Durham University (December 2013)
TESTA, Durham University (December 2013)TESTA, Durham University (December 2013)
TESTA, Durham University (December 2013)TESTA winch
 
Building Rubrics: The Easy Steps Way
Building Rubrics: The Easy Steps WayBuilding Rubrics: The Easy Steps Way
Building Rubrics: The Easy Steps WaySusan Lieberman
 
Effective feedback enhancing learning
Effective feedback enhancing learningEffective feedback enhancing learning
Effective feedback enhancing learningfcaristo
 
Lights, action, clapperboards: changing how students think and perform throug...
Lights, action, clapperboards: changing how students think and perform throug...Lights, action, clapperboards: changing how students think and perform throug...
Lights, action, clapperboards: changing how students think and perform throug...Tansy Jessop
 
Jk 2nd round student inquiry
Jk 2nd round   student inquiryJk 2nd round   student inquiry
Jk 2nd round student inquiryjacquiinnes
 
Writing Assignments in Large Lecture Classes
Writing Assignments in Large Lecture ClassesWriting Assignments in Large Lecture Classes
Writing Assignments in Large Lecture ClassesOscarfuzz
 
Igcse assessment method-jk
Igcse assessment method-jkIgcse assessment method-jk
Igcse assessment method-jkwils_ck
 
Jugyou kenyyuu (1)
Jugyou kenyyuu (1)Jugyou kenyyuu (1)
Jugyou kenyyuu (1)jacquiinnes
 
Tm heart of assessment evaluation
Tm heart of assessment evaluationTm heart of assessment evaluation
Tm heart of assessment evaluationJo-Anne LaForty
 
TESTA, Presentation to the SDG Course Leaders, University of West of Scotlan...
 TESTA, Presentation to the SDG Course Leaders, University of West of Scotlan... TESTA, Presentation to the SDG Course Leaders, University of West of Scotlan...
TESTA, Presentation to the SDG Course Leaders, University of West of Scotlan...TESTA winch
 
Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...
Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...
Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...Mark Eutsler
 
Process orientedperformance-basedassessment
Process orientedperformance-basedassessmentProcess orientedperformance-basedassessment
Process orientedperformance-basedassessmentjabello glaiza
 
A Standards Based Grading Case Study...Kinda
A Standards Based Grading Case Study...KindaA Standards Based Grading Case Study...Kinda
A Standards Based Grading Case Study...KindaGary Abud Jr
 
Dispelling myths; challenging traditions: TESTA evidence
Dispelling myths; challenging traditions: TESTA evidenceDispelling myths; challenging traditions: TESTA evidence
Dispelling myths; challenging traditions: TESTA evidenceTansy Jessop
 
Laos Session 4: Developing Quality Assessment Items (EN)
Laos Session 4:  Developing Quality Assessment Items (EN)Laos Session 4:  Developing Quality Assessment Items (EN)
Laos Session 4: Developing Quality Assessment Items (EN)NEQMAP
 

What's hot (20)

BackwardsDesignPedagogy_OUSD_Camargo
BackwardsDesignPedagogy_OUSD_CamargoBackwardsDesignPedagogy_OUSD_Camargo
BackwardsDesignPedagogy_OUSD_Camargo
 
TESTA, Durham University (December 2013)
TESTA, Durham University (December 2013)TESTA, Durham University (December 2013)
TESTA, Durham University (December 2013)
 
Building Rubrics: The Easy Steps Way
Building Rubrics: The Easy Steps WayBuilding Rubrics: The Easy Steps Way
Building Rubrics: The Easy Steps Way
 
Formative assessment
Formative assessmentFormative assessment
Formative assessment
 
Effective feedback enhancing learning
Effective feedback enhancing learningEffective feedback enhancing learning
Effective feedback enhancing learning
 
Lights, action, clapperboards: changing how students think and perform throug...
Lights, action, clapperboards: changing how students think and perform throug...Lights, action, clapperboards: changing how students think and perform throug...
Lights, action, clapperboards: changing how students think and perform throug...
 
Jk 2nd round student inquiry
Jk 2nd round   student inquiryJk 2nd round   student inquiry
Jk 2nd round student inquiry
 
Writing Assignments in Large Lecture Classes
Writing Assignments in Large Lecture ClassesWriting Assignments in Large Lecture Classes
Writing Assignments in Large Lecture Classes
 
Rubrics
RubricsRubrics
Rubrics
 
Formative Assessment
Formative AssessmentFormative Assessment
Formative Assessment
 
Igcse assessment method-jk
Igcse assessment method-jkIgcse assessment method-jk
Igcse assessment method-jk
 
Jugyou kenyyuu (1)
Jugyou kenyyuu (1)Jugyou kenyyuu (1)
Jugyou kenyyuu (1)
 
Tsg Aug 28 Presentation
Tsg   Aug  28 PresentationTsg   Aug  28 Presentation
Tsg Aug 28 Presentation
 
Tm heart of assessment evaluation
Tm heart of assessment evaluationTm heart of assessment evaluation
Tm heart of assessment evaluation
 
TESTA, Presentation to the SDG Course Leaders, University of West of Scotlan...
 TESTA, Presentation to the SDG Course Leaders, University of West of Scotlan... TESTA, Presentation to the SDG Course Leaders, University of West of Scotlan...
TESTA, Presentation to the SDG Course Leaders, University of West of Scotlan...
 
Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...
Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...
Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...
 
Process orientedperformance-basedassessment
Process orientedperformance-basedassessmentProcess orientedperformance-basedassessment
Process orientedperformance-basedassessment
 
A Standards Based Grading Case Study...Kinda
A Standards Based Grading Case Study...KindaA Standards Based Grading Case Study...Kinda
A Standards Based Grading Case Study...Kinda
 
Dispelling myths; challenging traditions: TESTA evidence
Dispelling myths; challenging traditions: TESTA evidenceDispelling myths; challenging traditions: TESTA evidence
Dispelling myths; challenging traditions: TESTA evidence
 
Laos Session 4: Developing Quality Assessment Items (EN)
Laos Session 4:  Developing Quality Assessment Items (EN)Laos Session 4:  Developing Quality Assessment Items (EN)
Laos Session 4: Developing Quality Assessment Items (EN)
 

Similar to Introductionto rubrics

Module 4: School Based Assessment
Module 4: School Based AssessmentModule 4: School Based Assessment
Module 4: School Based AssessmentNISHTHA_NCERT123
 
Assessment 07
Assessment 07Assessment 07
Assessment 07fogleman
 
Assessing student learning
Assessing student learningAssessing student learning
Assessing student learningsrinivaslalluri
 
Assessment Intro 3 19 10 B
Assessment Intro 3 19 10 BAssessment Intro 3 19 10 B
Assessment Intro 3 19 10 Bguest3289552d
 
Assessment Intro
Assessment IntroAssessment Intro
Assessment Introtsmyth2
 
Assessment intro 3 19 10 b
Assessment intro 3 19 10 bAssessment intro 3 19 10 b
Assessment intro 3 19 10 btsmyth2
 
Assessment plan
Assessment planAssessment plan
Assessment planmskmoss
 
Active learning & classroom assessment practices
Active learning & classroom assessment practicesActive learning & classroom assessment practices
Active learning & classroom assessment practicesKyawmoe Aung
 
Assessment for Learning I
Assessment for Learning IAssessment for Learning I
Assessment for Learning ICALT
 
Rubrics in teaching and learning
Rubrics in teaching and learningRubrics in teaching and learning
Rubrics in teaching and learningMayRul_215303
 
Rubrics in teaching and learning
Rubrics in teaching and learningRubrics in teaching and learning
Rubrics in teaching and learningMayRul_215303
 
Rubrics in teaching and learning
Rubrics in teaching and learningRubrics in teaching and learning
Rubrics in teaching and learningMayRul_215303
 
Providing the Spark for CCSS
Providing the Spark for CCSSProviding the Spark for CCSS
Providing the Spark for CCSSKristen Wheat
 
Rubric Development
Rubric DevelopmentRubric Development
Rubric DevelopmentSteven Baule
 
Assessment 072
Assessment 072Assessment 072
Assessment 072fogleman
 
Assessment primer
Assessment primerAssessment primer
Assessment primerCHARMY22
 

Similar to Introductionto rubrics (20)

Rubrics final 1
Rubrics final 1Rubrics final 1
Rubrics final 1
 
Module 4: School Based Assessment
Module 4: School Based AssessmentModule 4: School Based Assessment
Module 4: School Based Assessment
 
Assessment 07
Assessment 07Assessment 07
Assessment 07
 
Assessing student learning
Assessing student learningAssessing student learning
Assessing student learning
 
Assessment Intro 3 19 10 B
Assessment Intro 3 19 10 BAssessment Intro 3 19 10 B
Assessment Intro 3 19 10 B
 
Assessment Intro
Assessment IntroAssessment Intro
Assessment Intro
 
Assessment intro 3 19 10 b
Assessment intro 3 19 10 bAssessment intro 3 19 10 b
Assessment intro 3 19 10 b
 
Assessment plan
Assessment planAssessment plan
Assessment plan
 
Active learning & classroom assessment practices
Active learning & classroom assessment practicesActive learning & classroom assessment practices
Active learning & classroom assessment practices
 
Rubricbasics
RubricbasicsRubricbasics
Rubricbasics
 
Assessment for Learning I
Assessment for Learning IAssessment for Learning I
Assessment for Learning I
 
Rubrics in teaching and learning
Rubrics in teaching and learningRubrics in teaching and learning
Rubrics in teaching and learning
 
Rubrics in teaching and learning
Rubrics in teaching and learningRubrics in teaching and learning
Rubrics in teaching and learning
 
Rubrics in teaching and learning
Rubrics in teaching and learningRubrics in teaching and learning
Rubrics in teaching and learning
 
Providing the Spark for CCSS
Providing the Spark for CCSSProviding the Spark for CCSS
Providing the Spark for CCSS
 
Rubrics
RubricsRubrics
Rubrics
 
Rubric Development
Rubric DevelopmentRubric Development
Rubric Development
 
Assessment 072
Assessment 072Assessment 072
Assessment 072
 
Rubrics
RubricsRubrics
Rubrics
 
Assessment primer
Assessment primerAssessment primer
Assessment primer
 

Recently uploaded

Item # 4 -- 525 Argo Avenue ARB Case 926F
Item # 4 -- 525 Argo Avenue ARB Case 926FItem # 4 -- 525 Argo Avenue ARB Case 926F
Item # 4 -- 525 Argo Avenue ARB Case 926Fahcitycouncil
 
Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...
Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...
Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...Rahsaan L. Browne
 
一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单
一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单
一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单enbam
 
What is the point of small housing associations.pptx
What is the point of small housing associations.pptxWhat is the point of small housing associations.pptx
What is the point of small housing associations.pptxPaul Smith
 
一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单
一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单
一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单ehbuaw
 
Item # 6 - 7001 Broadway Significance Review
Item # 6 - 7001 Broadway Significance ReviewItem # 6 - 7001 Broadway Significance Review
Item # 6 - 7001 Broadway Significance Reviewahcitycouncil
 
一比一原版(UWA毕业证)西澳大学毕业证成绩单
一比一原版(UWA毕业证)西澳大学毕业证成绩单一比一原版(UWA毕业证)西澳大学毕业证成绩单
一比一原版(UWA毕业证)西澳大学毕业证成绩单enbam
 
一比一原版(UQ毕业证)昆士兰大学毕业证成绩单
一比一原版(UQ毕业证)昆士兰大学毕业证成绩单一比一原版(UQ毕业证)昆士兰大学毕业证成绩单
一比一原版(UQ毕业证)昆士兰大学毕业证成绩单enbam
 
Up the Ratios Bylaws - a Comprehensive Process of Our Organization
Up the Ratios Bylaws - a Comprehensive Process of Our OrganizationUp the Ratios Bylaws - a Comprehensive Process of Our Organization
Up the Ratios Bylaws - a Comprehensive Process of Our Organizationuptheratios
 
CourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJL
CourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJLCourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJL
CourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJLRohit Garg
 
PPT Item # 4 - 525 Argo Avenue ARB Case # 926F
PPT Item # 4 - 525 Argo Avenue ARB Case # 926FPPT Item # 4 - 525 Argo Avenue ARB Case # 926F
PPT Item # 4 - 525 Argo Avenue ARB Case # 926Fahcitycouncil
 
Advancing Impact Measurement | Public Good App House
Advancing Impact Measurement | Public Good App HouseAdvancing Impact Measurement | Public Good App House
Advancing Impact Measurement | Public Good App HouseTechSoup
 
一比一原版(QUT毕业证)昆士兰科技大学毕业证成绩单
一比一原版(QUT毕业证)昆士兰科技大学毕业证成绩单一比一原版(QUT毕业证)昆士兰科技大学毕业证成绩单
一比一原版(QUT毕业证)昆士兰科技大学毕业证成绩单aveka1
 
一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单
一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单
一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单ehbuaw
 
Elderly Persons Midday Meal Program kurnool
Elderly Persons Midday Meal Program kurnoolElderly Persons Midday Meal Program kurnool
Elderly Persons Midday Meal Program kurnoolSERUDS INDIA
 
PPT Item # 6 - 7001 Broadway ARB Case # 933F
PPT Item # 6 - 7001 Broadway ARB Case # 933FPPT Item # 6 - 7001 Broadway ARB Case # 933F
PPT Item # 6 - 7001 Broadway ARB Case # 933Fahcitycouncil
 
Item # 8 -- Tuxedo Columbine 3--way Stop
Item # 8 -- Tuxedo Columbine 3--way StopItem # 8 -- Tuxedo Columbine 3--way Stop
Item # 8 -- Tuxedo Columbine 3--way Stopahcitycouncil
 
一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单
一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单
一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单enbam
 
一比一原版(UOW毕业证)伍伦贡大学毕业证成绩单
一比一原版(UOW毕业证)伍伦贡大学毕业证成绩单一比一原版(UOW毕业证)伍伦贡大学毕业证成绩单
一比一原版(UOW毕业证)伍伦贡大学毕业证成绩单enbam
 
Presentation on RBI and its functions , advantage and disadvantage
Presentation on RBI and its functions , advantage and disadvantagePresentation on RBI and its functions , advantage and disadvantage
Presentation on RBI and its functions , advantage and disadvantageSwapnajitSahoo1
 

Recently uploaded (20)

Item # 4 -- 525 Argo Avenue ARB Case 926F
Item # 4 -- 525 Argo Avenue ARB Case 926FItem # 4 -- 525 Argo Avenue ARB Case 926F
Item # 4 -- 525 Argo Avenue ARB Case 926F
 
Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...
Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...
Writing Sample-Title: Pioneering Urban Transformation: The Collective Power o...
 
一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单
一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单
一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单
 
What is the point of small housing associations.pptx
What is the point of small housing associations.pptxWhat is the point of small housing associations.pptx
What is the point of small housing associations.pptx
 
一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单
一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单
一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单
 
Item # 6 - 7001 Broadway Significance Review
Item # 6 - 7001 Broadway Significance ReviewItem # 6 - 7001 Broadway Significance Review
Item # 6 - 7001 Broadway Significance Review
 
一比一原版(UWA毕业证)西澳大学毕业证成绩单
一比一原版(UWA毕业证)西澳大学毕业证成绩单一比一原版(UWA毕业证)西澳大学毕业证成绩单
一比一原版(UWA毕业证)西澳大学毕业证成绩单
 
一比一原版(UQ毕业证)昆士兰大学毕业证成绩单
一比一原版(UQ毕业证)昆士兰大学毕业证成绩单一比一原版(UQ毕业证)昆士兰大学毕业证成绩单
一比一原版(UQ毕业证)昆士兰大学毕业证成绩单
 
Up the Ratios Bylaws - a Comprehensive Process of Our Organization
Up the Ratios Bylaws - a Comprehensive Process of Our OrganizationUp the Ratios Bylaws - a Comprehensive Process of Our Organization
Up the Ratios Bylaws - a Comprehensive Process of Our Organization
 
CourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJL
CourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJLCourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJL
CourseHero 9KLDFSKJKSJDFKSDKFJSDKSLFJKSJL
 
PPT Item # 4 - 525 Argo Avenue ARB Case # 926F
PPT Item # 4 - 525 Argo Avenue ARB Case # 926FPPT Item # 4 - 525 Argo Avenue ARB Case # 926F
PPT Item # 4 - 525 Argo Avenue ARB Case # 926F
 
Advancing Impact Measurement | Public Good App House
Advancing Impact Measurement | Public Good App HouseAdvancing Impact Measurement | Public Good App House
Advancing Impact Measurement | Public Good App House
 
一比一原版(QUT毕业证)昆士兰科技大学毕业证成绩单
一比一原版(QUT毕业证)昆士兰科技大学毕业证成绩单一比一原版(QUT毕业证)昆士兰科技大学毕业证成绩单
一比一原版(QUT毕业证)昆士兰科技大学毕业证成绩单
 
一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单
一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单
一比一原版(ANU毕业证)澳大利亚国立大学毕业证成绩单
 
Elderly Persons Midday Meal Program kurnool
Elderly Persons Midday Meal Program kurnoolElderly Persons Midday Meal Program kurnool
Elderly Persons Midday Meal Program kurnool
 
PPT Item # 6 - 7001 Broadway ARB Case # 933F
PPT Item # 6 - 7001 Broadway ARB Case # 933FPPT Item # 6 - 7001 Broadway ARB Case # 933F
PPT Item # 6 - 7001 Broadway ARB Case # 933F
 
Item # 8 -- Tuxedo Columbine 3--way Stop
Item # 8 -- Tuxedo Columbine 3--way StopItem # 8 -- Tuxedo Columbine 3--way Stop
Item # 8 -- Tuxedo Columbine 3--way Stop
 
一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单
一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单
一比一原版(Adelaide毕业证)阿德莱德大学毕业证成绩单
 
一比一原版(UOW毕业证)伍伦贡大学毕业证成绩单
一比一原版(UOW毕业证)伍伦贡大学毕业证成绩单一比一原版(UOW毕业证)伍伦贡大学毕业证成绩单
一比一原版(UOW毕业证)伍伦贡大学毕业证成绩单
 
Presentation on RBI and its functions , advantage and disadvantage
Presentation on RBI and its functions , advantage and disadvantagePresentation on RBI and its functions , advantage and disadvantage
Presentation on RBI and its functions , advantage and disadvantage
 

Introductionto rubrics

  • 1. Introduction to Rubrics “Learning increases, even in its serendipitous aspects, when learners have a sense of what they are setting out to learn, a statement of explicit standards they must meet, and a way of seeing what they have learned.” Loacker, Cromwell, & O’Brien in Huba and Freed, p. 151. Presented by the CHFA SOA Committee, Spring 2007 Facilitator: Martha Reineke Based on workshop bibliography listed at end of presentation.
  • 2. Workshop Goals  Obtain a working vocabulary for rubrics  Determine ways in which rubrics contribute to participants’ courses and assessment efforts.  Identify parts of a rubric and steps for making a rubric.  Make a rubric!  Review and consolidate learning in order to make rubrics on your own.
  • 3. Do you need a rubric?  Course Issues:  you are four weeks behind on your grading.  you have graded all your essays but you are afraid that you graded the last ones more rigorously than the ones you graded two weeks ago.  you have carefully described in class your expectations for an assignment but you now have twenty e-mails from students who say, “I don’t know what you want on this assignment.”  Student Outcomes Assessment Concerns:  You want to engage in meaningful assessment of student learning without making this your life’s work.  You wish that your conversations about student learning in your majors were more focused and stayed on track from semester to semester.  You lack confidence that your assessment efforts are yielding information that your department can actually use to enhance your majors’ learning experiences. - Stevens & Levi, pp. 4-6.
  • 4. How rubrics help:  For Courses:  Rubrics enable faculty to clearly communicate expectations for student performance to students. They support more consistent and objective assessment of student work. They also facilitate detailed feedback to students. When areas of strength and weakness in performance are marked on an essay rubric, students more easily comprehend the reasoning behind their professor’s assessment of their work.  For Student Outcomes Assessment:  Rubrics facilitate quality conversations among faculty about student learning, shorten the time it takes to do SOA, and contribute to the validity and reliability of the assessment process. - Stevens and Levi, Ch. 2
  • 6. Developing a Rubric in Four Parts  Task Description What is the student supposed to do?  Examples: write an essay, perform a concerto, make an oral presentation.  At the top of a sheet of paper, place the full description of the assignment.  Begin a grid that is headed by a descriptive title and blocks out dimensions of the assignment. - Next four slides: Stevens & Levi, Ch. 1
  • 7. Developing a Rubric cont. Scale How well or poorly has the student done on the task?  Sophisticated, competent, partly competent, not yet competent.  Exemplary, proficient, marginal, unacceptable.  Advanced, Intermediate, Novice.  Distinguished, proficient, intermediate, novice.  Accomplished, developing, beginning. (Huba and Freed, 2000) Note: Consider whether a scale needs more than three levels. Some research indicates that information about student learning obtained from a three-level scale is comparable to that obtained from a five- level scale. More levels typically means more time spent on assessment.
  • 8. Developing a Rubric cont. Dimensions  Dimensions break down a task into components and identify the importance of these components.  Dimensions are descriptive, not evaluative (e.g., “organization” not “good organization”).  Dimensions help students see that the work they are doing is multidimensional and draws on multiple abilities.
  • 9. Developing a Rubric cont. Description of the Dimensions  Rubrics should contain at least a description of the highest level of performance.  With experience and in response to the complexity of the performance, descriptions of all levels can be written.  Students need not fit cleanly into a single category. On oral presentation skills, a student might speak in a clear voice but lack eye contact.  Descriptions for each level help students see that the work they are doing does have varying levels of achievement. There is a difference between poor and excellent work.
  • 10. Reflections on making a rubric: What are my reactions to making this rubric? How will my teaching change if I use rubrics with my students? How could I use rubrics to give students feedback? - Huba and Freed, p. 166
  • 11. Creating Your First Rubric: Is it worth the time?  Experienced rubric makers can generate complex rubrics in less than an hour. They can update rubrics in minutes.  Beginning rubric making does take time.  Even beginning rubric makers save actual grading time. We often write the same comments on multiple pieces of student work. Transposing our advice to a rubric and circling it on the rubric saves time.  Most important, rubrics enhance the quality of our teaching. We become more aware of our methods of teaching and of our expectations for students. We also provide feedback to students that enables them to actually improve over time, reducing repetitive teaching in the classroom.  Rubrics enable students to do better work if they are distributed to students at the beginning of an assignment. Better work often takes less time to grade than poor work. Rubrics enable students to see that their success in course work is developmental and incremental (many students do not know this). - Stevens & Levi, pp. 14-27; Huba and Freed, 169-174.
  • 12. To Remember:  Rubrics are written on paper, not stone.  Start with a basic rubric and improve it with each use.  Discover new dimensions for the rubric while grading current student work.  Ex. Students were repeatedly missing a particular assignment goal. When their teacher went to the rubric to circle the missing goal, she discovered that this goal was not on the rubric. For the following semester, she added it to the rubric and incorporated a description of this goal explicitly into the assignment.
  • 13. The Usefulness of Rubrics for Assessment “Strong presentation skills” = an outcome for your major. If all Seniors in your major were assessed on presentation skills using the rubric you just created, and 45 out of 60 scored in the lowest level on Dimension 2, what questions could you discuss at a faculty meeting on assessing your major? What might you do about these findings?
  • 14. What does 75/100 mean to us and to our students?  A grade is one way to evaluate learning.  Some persons wants grades--students, potential employers, graduate admissions committees—and see meaningful information in grades.  Grades are useful for marking summative, individual achievement in relation to other summative, individual achievements on specific tasks.  Assessment is diagnostic way to evaluate learning.  NOT diagnostic: Students earned an average grade of C+ in this course.  Diagnostic: “On their capstone projects, students were strong in identification of the problem but weak in considering alternative solutions.”  Data are aggregated to yield information about strengths/weaknesses in a group of students. Aggregate data are anonymous (student and faculty names are removed).  Data are used to suggest courses of action to improve learning. - Sources: Barbara Walvood, presentation at the Higher Learning Commission 2005 Meeting, April 2, 2005, Chicago, IL; http://www.umass.edu/oapa/oapa/publications/online_handbooks/program_based.pdf,
  • 15. How do students know whether they are learning?  What does 75/100 mean for students? For which students? In respect to what? An easy or difficult text? A class of strong or weak students?  Rubrics answer student questions about learning by:  Making criteria for improvement visible.  Revealing a process of learning (e.g. detailing skills and knowledge [current, new, past]).  Showing standards for a professional field or discipline, the qualities of an educated person, and expectations of future employers. - Huba and Freed, pp. 154-55; pp. 169-73.
  • 16. Constructing a Rubric: Building our skill-set in four stages  Stage 1: Reflecting  What do we want from our students? Why did we create this assignment? What happened the last time we did this?  Stage 2: Listing  What are the learning outcomes we hope to see in the completed assignment?  Stage 3: Grouping and Labeling  Place similar outcomes together to comprise dimensions of the rubric.  Stage 4: Application  Form the actual rubric by deploying dimensions and levels along each side of the rubric. - Stevens and Levi, Chapter 3.
  • 17. Analytic and Holistic Rubrics  An analytic rubric articulates levels of performance for each criterion so the teacher can assess student performance on each criterion.  In contrast to an analytic rubric, a holistic rubric does not list separate levels of performance for each criterion. Instead, a holistic rubric assigns a level of performance by assessing performance across multiple criteria as a whole.
  • 18. How do I know when I have a good rubric? Ready to roll:  The content has a “ring of truth:” You review the rubric and note that the content states what you truly do look for when evaluating student work.  Emphases seem right: things that are more important are stressed more in the rubric than things that are less important.  Levels of the scale make sense.  Features of importance have been covered without overload.  You are left with only a few questions about what is/is not on the rubric.  The rubric is insightful. It helps you organize your thinking about what counts as quality. - Next two slides: Arter and McTighe, pp. 46-47.
  • 19. How do I know continued:  On the way:  You still notice that some important things are not on the rubric or not on it sufficiently.  Balance is in question. Students might miscue on important vs. less important features.  The rubric sprawls – organization remains in question.  Not ready:  You can think of many things not on the rubric that should be.  You find yourself asking, “Why assess this?” Why is this important?  The rubric seems mixed up and random in its focus.  The rubric seems out of balance.  There are many features on which a student could miscue about the importance of a dimension of the rubric.
  • 20. How can Rubrics be Used to Assess Program Learning Goals? Embedded course assignments Capstone experiences. Field experiences. Employer feedback. Peer evaluations or self-evaluations. Portfolios. - Suskie, p. 137.
  • 21. Workshop bibliography  Scoring Rubrics in the Classroom. By Judith Arter and Jay McTighe. Corwin Press, 2001.  Learner-Centered Assessment on College Campuses by Mary E. Huba and Jann E. Freed. Allyn and Bacon, 2000. *  Introduction to Rubrics, by Dannelle D. Stevens and Antonia J. Levi. Stylus Publications, 2005. *  Assessing for Learning, by Peggy L. Maki. Stylus Publications, 2004.  Assessing Student Learning by Linda Suskie. Anker, 2004.  http://jonathan.mueller.faculty.noctrl.edu/toolbox/glossary.htm * = most helpful sources.

Editor's Notes

  1. From p. 25 in Intro to Rubrics: How do we know if we are effectively teaching our majors? How can we become more effective in preparing our majors for graduation? The previous exercise shows how we can pinpoint students’ strengths and weaknesses over time, using a rubric and aggregated the data. When majority of students show weak results in a particular dimension of the rubric, we need to talk with each other about how we can change our courses to give our students more experience in this areas. Subsequent rubric use should helps us determine if the changes we make are working. If all students excel on all dimensions of a rubric, we will want to change the goals and outcomes on which we are focusing for assessment in order to emphasize areas of learning in which students face the most challenges and about which we have the most questions about our teaching effectiveness.