SlideShare a Scribd company logo
1 of 37
Download to read offline
Quality
Assessment Design
Constructed Response Assessments:
● Take more time to grade
● Require a specific rubric
● Require inter-rater and intra-rater reliability
● Write descriptive rubrics: less than full credit should
point out misconceptions, next steps
● May not be appropriate for all ages or subjects
● Be consistent in administration technique (directions,
etc.)
Considerations in Selecting
Question Form
Constructed Response Assessments:
● Take more time to grade
● Require a specific rubric
● Require inter-rater and intra-rater reliability
● Write descriptive rubrics: less than full credit should
point out misconceptions, next steps
● May not be appropriate for all ages or subjects
● Be consistent in administration technique (directions,
etc.)
Considerations in Selecting
Question Form
We will discuss in detail
shortly...
Performance Assessments:
● Take more time to grade and administer
● Require a specific rubric
● Require inter-rater and intra-rater reliability
● Write descriptive rubrics: less than full credit should
point out misconceptions, next steps
● May not be appropriate for all ages or subjects
● Be consistent in administration technique (directions,
etc.)
Considerations in Selecting
Question Form
Performance Assessments:
● Take more time to grade and administer
● Require a specific rubric
● Require inter-rater and intra-rater reliability
● Write descriptive rubrics: less than full credit should
point out misconceptions, next steps
● May not be appropriate for all ages or subjects
● Be consistent in administration technique (directions,
etc.)
Considerations in Selecting
Question Form
Lets discuss this deeper
now...
Understanding Rubrics
Understanding Rubrics
ROWS:
Each of the criteria
you plan to measure.
Understanding Rubrics
ROWS:
Each of the criteria
you plan to measure.
COLUMNS:
Potential levels of
performance ranging
from “ideal” to not
evident.
Understanding Rubrics
ROWS:
Each of the criteria
you plan to measure.
COLUMNS:
Potential levels of
performance ranging
from “ideal” to not
evident.
Rating Boxes:
Detailed descriptions
of performance at
that level for that
skill.
Understanding Rubrics
Understanding Rubrics
ROWS:
Each of the criteria
you plan to measure.
Understanding Rubrics
COLUMNS:
Potential levels of
performance ranging
from “ideal” to not
evident.
ROWS:
Each of the criteria
you plan to measure.
Understanding Rubrics
Rating Boxes:
Detailed descriptions
of performance at
that level for that
skill.
COLUMNS:
Potential levels of
performance ranging
from “ideal” to not
evident.
ROWS:
Each of the criteria
you plan to measure.
Understanding Rubrics
Rating Boxes:
Detailed descriptions
of performance at
that level for that
skill.
COLUMNS:
Potential levels of
performance ranging
from “ideal” to not
evident.
ROWS:
Each of the criteria
you plan to measure.
This is NOT an example of a descriptive
rubric
Understanding Rubrics
Rating Boxes:
Detailed descriptions
of performance at
that level for that
skill.
COLUMNS:
Potential levels of
performance ranging
from “ideal” to not
evident.
ROWS:
Each of the criteria
you plan to measure.
This is NOT an example of a descriptive
rubric
Some of the time
Most of the time
Fair
Poor
Understanding Rubrics
ROWS:
Each of the criteria
you plan to measure.
Understanding Rubrics
ROWS:
Each of the criteria
you plan to measure.
Determining Appropriate Criteria:
● Areas key to student learning (essential skills)
● Definable & Observable
● Not generally characteristic of the task itself
but rather characteristics of the learning
outcomes the assessment is designed to
measure
Effective Rubrics do not list all possible criteria; they list the
right criteria for the assessment’s purpose
Understanding Rubrics
ROWS:
Each of the criteria
you plan to measure.
Determining Appropriate Criteria:
● Areas key to student learning (essential skills)
● Definable & Observable
● Not generally characteristic of the task itself
but rather characteristics of the learning
outcomes the assessment is designed to
measure
Effective Rubrics do not list all possible criteria; they list the
right criteria for the assessment’s purpose
Understanding Rubrics
ROWS:
Each of the criteria
you plan to measure.
Determining Appropriate Criteria:
● Areas key to student learning (essential skills)
● DOD: Definable, Observable & Distinct
● Not generally characteristic of the task itself
but rather characteristics of the learning
outcomes the assessment is designed to
measure
Effective Rubrics do not list all possible criteria; they list the
right criteria for the assessment’s purpose
Understanding Rubrics
ROWS:
Each of the criteria
you plan to measure.
Determining Appropriate Criteria:
● Areas key to student learning (essential skills)
● DOD: Definable, Observable & Distinct
● Not generally characteristic of the task itself
but rather characteristics of the learning
outcomes the assessment is designed to
measure
Effective Rubrics do not list all possible criteria; they list the
right criteria for the assessment’s purpose
Definable: Each Criterion has a clear, agreed upon
meaning that teacher and student understand.
Observable: Each criterion describes a quality in the
performance that can be perceived (seen, heard).
Distinct: Each Criterion identifies a separate aspecting of
the learning outcomes.
Understanding Rubrics
ROWS:
Each of the criteria
you plan to measure.
Determining Appropriate Criteria:
● Areas key to student learning (essential skills)
● DOD: Definable, Observable & Distinct
● Not generally characteristic of the task itself
but rather characteristics of the learning
outcomes the assessment is designed to
measure
Effective Rubrics do not list all possible criteria; they list the
right criteria for the assessment’s purpose
Definable: Each Criterion has a clear, agreed upon
meaning that teacher and student understand.
Observable: Each criterion describes a quality in the
performance that can be perceived (seen, heard).
Distinct: Each Criterion identifies a separate aspecting of
the learning outcomes.
Understanding Rubrics
ROWS:
Each of the criteria
you plan to measure.
Determining Appropriate Criteria:
● Areas key to student learning (essential skills)
● DOD: Definable, Observable & Distinct
● Not generally characteristic of the task itself
but rather characteristics of the learning
outcomes the assessment is designed to
measure
Effective Rubrics do not list all possible criteria; they list the
right criteria for the assessment’s purpose
Definable: Each Criterion has a clear, agreed upon
meaning that teacher and student understand.
Observable: Each criterion describes a quality in the
performance that can be perceived (seen, heard).
Distinct: Each Criterion identifies a separate aspecting of
the learning outcomes.
Understanding Rubrics
ROWS:
Each of the criteria
you plan to measure.
Determining Appropriate Criteria:
● Areas key to student learning (essential skills)
● DOD: Definable, Observable & Distinct
● Not generally characteristic of the task itself but
rather characteristics of the enduring learning
outcomes the assessment is designed to measure.
These measurement criteria could then apply to
several prompts, taks or performances.
Effective Rubrics do not list all possible criteria; they list the
right criteria for the assessment’s purpose
Understanding Rubrics
ROWS:
Each of the criteria
you plan to measure.
Determining Appropriate Criteria:
● Areas key to student learning (essential skills)
● DOD: Definable, Observable & Distinct
● Not generally characteristic of the task itself but
rather characteristics of the enduring learning
outcomes the assessment is designed to measure.
These measurement criteria could then apply to
several prompts, taks or performances.
Effective Rubrics do not list all possible criteria; they list the
right criteria for the assessment’s purpose.
Understanding Rubrics
COLUMNS:
Potential levels of
performance ranging
from “ideal” to not
evident.
ROWS:
Each of the criteria
you plan to measure.
Understanding Rubrics
COLUMNS:
Potential levels of
performance ranging
from “ideal” to not
evident.
ROWS:
Each of the criteria
you plan to measure.
Performance Level Descriptions:
Hint: Think--what does performance look like at high quality?
Work backwards.
Descriptive Descriptive language that depicts what one would
observe, NOT quality conclusions. (ex: good vs poor)
Clear Students and teachers both understand meanings of
descriptions. Teachers use in a repeatable fashion.
Whole Range &
Distinguishable
Levels
Performance descriptions are described from one
extreme to another extreme. Descriptions differ enough
from one level to another that work can be categorized.
(Ex: number of levels may be multiple or only 2)
Parallel
Descriptions
Performance descriptors at each level of the continuum
differ in the same aspects of the work and focus on
incremental improvements in a standard or skill.
Understanding Rubrics
COLUMNS:
Potential levels of
performance ranging
from “ideal” to not
evident.
ROWS:
Each of the criteria
you plan to measure.
Performance Level Descriptions:
Hint: Think--what does performance look like at high quality?
Work backwards.
Descriptive Descriptive language that depicts what one would
observe, NOT quality conclusions. (ex: good vs poor)
Clear Students and teachers both understand meanings of
descriptions. Teachers use in a repeatable fashion.
Whole Range &
Distinguishable
Levels
Performance descriptions are described from one
extreme to another extreme. Descriptions differ enough
from one level to another that work can be categorized.
(Ex: number of levels may be multiple or only 2)
Parallel
Descriptions
Performance descriptors at each level of the continuum
differ in the same aspects of the work and focus on
incremental improvements in a standard or skill.
Understanding Rubrics
COLUMNS:
Potential levels of
performance ranging
from “ideal” to not
evident.
ROWS:
Each of the criteria
you plan to measure.
Performance Level Descriptions:
Hint: Think--what does performance look like at high quality?
Work backwards.
Descriptive Descriptive language that depicts what one would
observe, NOT quality conclusions. (ex: good vs poor)
Clear Students and teachers both understand meanings of
descriptions. Teachers use in a repeatable fashion.
Levels:
Whole Range &
Distinguishable
Performance descriptions are described from one
extreme to another extreme. Descriptions differ enough
from one level to another that work can be categorized.
(Ex: number of levels may be multiple or only 2)
Parallel
Descriptions
Performance descriptors at each level of the continuum
differ in the same aspects of the work and focus on
incremental improvements in a standard or skill.
Understanding Rubrics
COLUMNS:
Potential levels of
performance ranging
from “ideal” to not
evident.
ROWS:
Each of the criteria
you plan to measure.
Performance Level Descriptions:
Hint: Think--what does performance look like at high quality?
Work backwards.
Descriptive Descriptive language that depicts what one would
observe, NOT quality conclusions. (ex: good vs poor)
Clear Students and teachers both understand meanings of
descriptions. Teachers use in a repeatable fashion.
Levels:
Whole Range &
Distinguishable
Performance descriptions are described from one
extreme to another extreme. Descriptions differ enough
from one level to another that work can be categorized.
(Ex: number of levels may be multiple or only 2)
Parallel
Descriptions
Performance descriptors at each level of the continuum
differ in the same aspects of the work and focus on
incremental improvements in a standard or skill.
Understanding Rubrics:
For Growth Data
COLUMNS:
Potential levels of
performance ranging
from “ideal” to not
evident.
ROWS:
Each of the criteria
you plan to measure.
Spotlight on Growth for Evaluations
COMPARABLE DATA:
● End of year Expectations
● Use Rubric Consistently
● High Reliability
Gradebook Problem:
How can I grade at week 2 with end of year expectations?
● Use a curve (“A” is not only for highest rating)
● Allow revisions
The Evaluation Connection: Student Growth
Understanding Rubrics:
For Growth Data
COLUMNS:
Potential levels of
performance ranging
from “ideal” to not
evident.
ROWS:
Each of the criteria
you plan to measure.
Spotlight on Growth for Evaluations
COMPARABLE DATA:
● End of year Expectations
● Use Rubric Consistently
● High Reliability
Gradebook Problem:
How can I grade at week 2 with end of year expectations?
● Use a curve (“A” is not only for highest rating)
● Allow revisions
The Evaluation Connection: Student Growth
Understanding Rubrics:
For Growth Data
COLUMNS:
Potential levels of
performance ranging
from “ideal” to not
evident.
ROWS:
Each of the criteria
you plan to measure.
Spotlight on Growth for Evaluations
COMPARABLE DATA:
● End of year Expectations
● Use Rubric Consistently
● High Reliability
Gradebook Problem:
How can I grade at week 2 with end of year expectations?
● Use a curve (“A” is not only for highest rating)
● Allow revisions
The Evaluation Connection: Student Growth
Performance Assessments:
Consider when
Collecting Baseline Data:
● Exasperation cut points
● Safety Issues
● Advertisement for class
Understanding Rubrics
The Evaluation Connection: Student Growth
Rubrics as Tools for Teacher:
● Defines “quality” for a process, product or behavior
● Powerful for teaching and learning
○ Descriptions help communicate what it takes to
succeed (This shouldn’t be a secret kept by the teachers!)
● Increase reliability of results
○ Increase consistency in grading between
students
○ Increase consistency in grading between
measurement points
Understanding Rubrics
Rubrics as Tools for Teacher:
● Defines “quality” for a process, product or behavior
● Powerful for teaching and learning
○ Descriptions help communicate what it takes to
succeed (This shouldn’t be a secret kept by the teachers!)
● Increase reliability of results
○ Increase consistency in grading between
students
○ Increase consistency in grading between
measurement points
Understanding Rubrics
Rubrics as Tools for Student:
● Defines “quality” for a process, product or behavior
● Encourage more thoughtful judgement of their own
(and others’) work.
● Increases ability to “self-assess”
● Increases student responsibility
Understanding Rubrics
Inter-Rater Reliability:
● Same/Repeatable results when
2+ people are using 1 rubric
● Practice as a team, share samples,
keep on file
Intra-Rater Reliability:
● Repeatable results when
1 person is using 1 rubric
● Photograph/record samples, keep on file
Understanding Rubrics

More Related Content

Similar to Quality Assessments-- Rubrics

Similar to Quality Assessments-- Rubrics (20)

The Rating Rubric: How to Create and Use Them Effectively in Your Performance...
The Rating Rubric: How to Create and Use Them Effectively in Your Performance...The Rating Rubric: How to Create and Use Them Effectively in Your Performance...
The Rating Rubric: How to Create and Use Them Effectively in Your Performance...
 
Presentation how to design rubrics
Presentation  how to design rubricsPresentation  how to design rubrics
Presentation how to design rubrics
 
Rubric with Rubistar
Rubric with RubistarRubric with Rubistar
Rubric with Rubistar
 
Rubrics
RubricsRubrics
Rubrics
 
What is a rubric
What is a rubricWhat is a rubric
What is a rubric
 
RUBRIC-BSED-III.pptx
RUBRIC-BSED-III.pptxRUBRIC-BSED-III.pptx
RUBRIC-BSED-III.pptx
 
Rating scale
Rating scaleRating scale
Rating scale
 
Assessment-in-Learning.pptx.............
Assessment-in-Learning.pptx.............Assessment-in-Learning.pptx.............
Assessment-in-Learning.pptx.............
 
Rubrics.pptx
Rubrics.pptxRubrics.pptx
Rubrics.pptx
 
Rubrics
RubricsRubrics
Rubrics
 
Rubrics
RubricsRubrics
Rubrics
 
Rubrics.pptx
Rubrics.pptxRubrics.pptx
Rubrics.pptx
 
Rubrics Overview
Rubrics OverviewRubrics Overview
Rubrics Overview
 
Assessment1
Assessment1Assessment1
Assessment1
 
Tamu rubric tips
Tamu rubric tipsTamu rubric tips
Tamu rubric tips
 
Rubrics final 1
Rubrics final 1Rubrics final 1
Rubrics final 1
 
Scoring Rubrics and Rating Scale
Scoring Rubrics and Rating ScaleScoring Rubrics and Rating Scale
Scoring Rubrics and Rating Scale
 
Performance based assessment
Performance based assessmentPerformance based assessment
Performance based assessment
 
Performance based assessment
Performance based assessmentPerformance based assessment
Performance based assessment
 
Scoring Rubric - Michael.pptx
Scoring Rubric - Michael.pptxScoring Rubric - Michael.pptx
Scoring Rubric - Michael.pptx
 

Recently uploaded

USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...Postal Advocate Inc.
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPCeline George
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Celine George
 
Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Mark Reed
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17Celine George
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4MiaBumagat1
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatYousafMalik24
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...JhezDiaz1
 
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdfLike-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdfMr Bounab Samir
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designMIPLM
 
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSGRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSJoshuaGantuangco2
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for BeginnersSabitha Banu
 
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Celine George
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptxmary850239
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTiammrhaywood
 
ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomnelietumpap1
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPCeline George
 

Recently uploaded (20)

USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERP
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17
 
Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice great
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
 
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdfLike-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-design
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSGRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for Beginners
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
 
ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choom
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERP
 

Quality Assessments-- Rubrics

  • 2. Constructed Response Assessments: ● Take more time to grade ● Require a specific rubric ● Require inter-rater and intra-rater reliability ● Write descriptive rubrics: less than full credit should point out misconceptions, next steps ● May not be appropriate for all ages or subjects ● Be consistent in administration technique (directions, etc.) Considerations in Selecting Question Form
  • 3. Constructed Response Assessments: ● Take more time to grade ● Require a specific rubric ● Require inter-rater and intra-rater reliability ● Write descriptive rubrics: less than full credit should point out misconceptions, next steps ● May not be appropriate for all ages or subjects ● Be consistent in administration technique (directions, etc.) Considerations in Selecting Question Form We will discuss in detail shortly...
  • 4. Performance Assessments: ● Take more time to grade and administer ● Require a specific rubric ● Require inter-rater and intra-rater reliability ● Write descriptive rubrics: less than full credit should point out misconceptions, next steps ● May not be appropriate for all ages or subjects ● Be consistent in administration technique (directions, etc.) Considerations in Selecting Question Form
  • 5. Performance Assessments: ● Take more time to grade and administer ● Require a specific rubric ● Require inter-rater and intra-rater reliability ● Write descriptive rubrics: less than full credit should point out misconceptions, next steps ● May not be appropriate for all ages or subjects ● Be consistent in administration technique (directions, etc.) Considerations in Selecting Question Form Lets discuss this deeper now...
  • 7. Understanding Rubrics ROWS: Each of the criteria you plan to measure.
  • 8. Understanding Rubrics ROWS: Each of the criteria you plan to measure. COLUMNS: Potential levels of performance ranging from “ideal” to not evident.
  • 9. Understanding Rubrics ROWS: Each of the criteria you plan to measure. COLUMNS: Potential levels of performance ranging from “ideal” to not evident. Rating Boxes: Detailed descriptions of performance at that level for that skill.
  • 11. Understanding Rubrics ROWS: Each of the criteria you plan to measure.
  • 12. Understanding Rubrics COLUMNS: Potential levels of performance ranging from “ideal” to not evident. ROWS: Each of the criteria you plan to measure.
  • 13. Understanding Rubrics Rating Boxes: Detailed descriptions of performance at that level for that skill. COLUMNS: Potential levels of performance ranging from “ideal” to not evident. ROWS: Each of the criteria you plan to measure.
  • 14. Understanding Rubrics Rating Boxes: Detailed descriptions of performance at that level for that skill. COLUMNS: Potential levels of performance ranging from “ideal” to not evident. ROWS: Each of the criteria you plan to measure. This is NOT an example of a descriptive rubric
  • 15. Understanding Rubrics Rating Boxes: Detailed descriptions of performance at that level for that skill. COLUMNS: Potential levels of performance ranging from “ideal” to not evident. ROWS: Each of the criteria you plan to measure. This is NOT an example of a descriptive rubric Some of the time Most of the time Fair Poor
  • 16. Understanding Rubrics ROWS: Each of the criteria you plan to measure.
  • 17. Understanding Rubrics ROWS: Each of the criteria you plan to measure. Determining Appropriate Criteria: ● Areas key to student learning (essential skills) ● Definable & Observable ● Not generally characteristic of the task itself but rather characteristics of the learning outcomes the assessment is designed to measure Effective Rubrics do not list all possible criteria; they list the right criteria for the assessment’s purpose
  • 18. Understanding Rubrics ROWS: Each of the criteria you plan to measure. Determining Appropriate Criteria: ● Areas key to student learning (essential skills) ● Definable & Observable ● Not generally characteristic of the task itself but rather characteristics of the learning outcomes the assessment is designed to measure Effective Rubrics do not list all possible criteria; they list the right criteria for the assessment’s purpose
  • 19. Understanding Rubrics ROWS: Each of the criteria you plan to measure. Determining Appropriate Criteria: ● Areas key to student learning (essential skills) ● DOD: Definable, Observable & Distinct ● Not generally characteristic of the task itself but rather characteristics of the learning outcomes the assessment is designed to measure Effective Rubrics do not list all possible criteria; they list the right criteria for the assessment’s purpose
  • 20. Understanding Rubrics ROWS: Each of the criteria you plan to measure. Determining Appropriate Criteria: ● Areas key to student learning (essential skills) ● DOD: Definable, Observable & Distinct ● Not generally characteristic of the task itself but rather characteristics of the learning outcomes the assessment is designed to measure Effective Rubrics do not list all possible criteria; they list the right criteria for the assessment’s purpose Definable: Each Criterion has a clear, agreed upon meaning that teacher and student understand. Observable: Each criterion describes a quality in the performance that can be perceived (seen, heard). Distinct: Each Criterion identifies a separate aspecting of the learning outcomes.
  • 21. Understanding Rubrics ROWS: Each of the criteria you plan to measure. Determining Appropriate Criteria: ● Areas key to student learning (essential skills) ● DOD: Definable, Observable & Distinct ● Not generally characteristic of the task itself but rather characteristics of the learning outcomes the assessment is designed to measure Effective Rubrics do not list all possible criteria; they list the right criteria for the assessment’s purpose Definable: Each Criterion has a clear, agreed upon meaning that teacher and student understand. Observable: Each criterion describes a quality in the performance that can be perceived (seen, heard). Distinct: Each Criterion identifies a separate aspecting of the learning outcomes.
  • 22. Understanding Rubrics ROWS: Each of the criteria you plan to measure. Determining Appropriate Criteria: ● Areas key to student learning (essential skills) ● DOD: Definable, Observable & Distinct ● Not generally characteristic of the task itself but rather characteristics of the learning outcomes the assessment is designed to measure Effective Rubrics do not list all possible criteria; they list the right criteria for the assessment’s purpose Definable: Each Criterion has a clear, agreed upon meaning that teacher and student understand. Observable: Each criterion describes a quality in the performance that can be perceived (seen, heard). Distinct: Each Criterion identifies a separate aspecting of the learning outcomes.
  • 23. Understanding Rubrics ROWS: Each of the criteria you plan to measure. Determining Appropriate Criteria: ● Areas key to student learning (essential skills) ● DOD: Definable, Observable & Distinct ● Not generally characteristic of the task itself but rather characteristics of the enduring learning outcomes the assessment is designed to measure. These measurement criteria could then apply to several prompts, taks or performances. Effective Rubrics do not list all possible criteria; they list the right criteria for the assessment’s purpose
  • 24. Understanding Rubrics ROWS: Each of the criteria you plan to measure. Determining Appropriate Criteria: ● Areas key to student learning (essential skills) ● DOD: Definable, Observable & Distinct ● Not generally characteristic of the task itself but rather characteristics of the enduring learning outcomes the assessment is designed to measure. These measurement criteria could then apply to several prompts, taks or performances. Effective Rubrics do not list all possible criteria; they list the right criteria for the assessment’s purpose.
  • 25. Understanding Rubrics COLUMNS: Potential levels of performance ranging from “ideal” to not evident. ROWS: Each of the criteria you plan to measure.
  • 26. Understanding Rubrics COLUMNS: Potential levels of performance ranging from “ideal” to not evident. ROWS: Each of the criteria you plan to measure. Performance Level Descriptions: Hint: Think--what does performance look like at high quality? Work backwards. Descriptive Descriptive language that depicts what one would observe, NOT quality conclusions. (ex: good vs poor) Clear Students and teachers both understand meanings of descriptions. Teachers use in a repeatable fashion. Whole Range & Distinguishable Levels Performance descriptions are described from one extreme to another extreme. Descriptions differ enough from one level to another that work can be categorized. (Ex: number of levels may be multiple or only 2) Parallel Descriptions Performance descriptors at each level of the continuum differ in the same aspects of the work and focus on incremental improvements in a standard or skill.
  • 27. Understanding Rubrics COLUMNS: Potential levels of performance ranging from “ideal” to not evident. ROWS: Each of the criteria you plan to measure. Performance Level Descriptions: Hint: Think--what does performance look like at high quality? Work backwards. Descriptive Descriptive language that depicts what one would observe, NOT quality conclusions. (ex: good vs poor) Clear Students and teachers both understand meanings of descriptions. Teachers use in a repeatable fashion. Whole Range & Distinguishable Levels Performance descriptions are described from one extreme to another extreme. Descriptions differ enough from one level to another that work can be categorized. (Ex: number of levels may be multiple or only 2) Parallel Descriptions Performance descriptors at each level of the continuum differ in the same aspects of the work and focus on incremental improvements in a standard or skill.
  • 28. Understanding Rubrics COLUMNS: Potential levels of performance ranging from “ideal” to not evident. ROWS: Each of the criteria you plan to measure. Performance Level Descriptions: Hint: Think--what does performance look like at high quality? Work backwards. Descriptive Descriptive language that depicts what one would observe, NOT quality conclusions. (ex: good vs poor) Clear Students and teachers both understand meanings of descriptions. Teachers use in a repeatable fashion. Levels: Whole Range & Distinguishable Performance descriptions are described from one extreme to another extreme. Descriptions differ enough from one level to another that work can be categorized. (Ex: number of levels may be multiple or only 2) Parallel Descriptions Performance descriptors at each level of the continuum differ in the same aspects of the work and focus on incremental improvements in a standard or skill.
  • 29. Understanding Rubrics COLUMNS: Potential levels of performance ranging from “ideal” to not evident. ROWS: Each of the criteria you plan to measure. Performance Level Descriptions: Hint: Think--what does performance look like at high quality? Work backwards. Descriptive Descriptive language that depicts what one would observe, NOT quality conclusions. (ex: good vs poor) Clear Students and teachers both understand meanings of descriptions. Teachers use in a repeatable fashion. Levels: Whole Range & Distinguishable Performance descriptions are described from one extreme to another extreme. Descriptions differ enough from one level to another that work can be categorized. (Ex: number of levels may be multiple or only 2) Parallel Descriptions Performance descriptors at each level of the continuum differ in the same aspects of the work and focus on incremental improvements in a standard or skill.
  • 30. Understanding Rubrics: For Growth Data COLUMNS: Potential levels of performance ranging from “ideal” to not evident. ROWS: Each of the criteria you plan to measure. Spotlight on Growth for Evaluations COMPARABLE DATA: ● End of year Expectations ● Use Rubric Consistently ● High Reliability Gradebook Problem: How can I grade at week 2 with end of year expectations? ● Use a curve (“A” is not only for highest rating) ● Allow revisions The Evaluation Connection: Student Growth
  • 31. Understanding Rubrics: For Growth Data COLUMNS: Potential levels of performance ranging from “ideal” to not evident. ROWS: Each of the criteria you plan to measure. Spotlight on Growth for Evaluations COMPARABLE DATA: ● End of year Expectations ● Use Rubric Consistently ● High Reliability Gradebook Problem: How can I grade at week 2 with end of year expectations? ● Use a curve (“A” is not only for highest rating) ● Allow revisions The Evaluation Connection: Student Growth
  • 32. Understanding Rubrics: For Growth Data COLUMNS: Potential levels of performance ranging from “ideal” to not evident. ROWS: Each of the criteria you plan to measure. Spotlight on Growth for Evaluations COMPARABLE DATA: ● End of year Expectations ● Use Rubric Consistently ● High Reliability Gradebook Problem: How can I grade at week 2 with end of year expectations? ● Use a curve (“A” is not only for highest rating) ● Allow revisions The Evaluation Connection: Student Growth
  • 33. Performance Assessments: Consider when Collecting Baseline Data: ● Exasperation cut points ● Safety Issues ● Advertisement for class Understanding Rubrics The Evaluation Connection: Student Growth
  • 34. Rubrics as Tools for Teacher: ● Defines “quality” for a process, product or behavior ● Powerful for teaching and learning ○ Descriptions help communicate what it takes to succeed (This shouldn’t be a secret kept by the teachers!) ● Increase reliability of results ○ Increase consistency in grading between students ○ Increase consistency in grading between measurement points Understanding Rubrics
  • 35. Rubrics as Tools for Teacher: ● Defines “quality” for a process, product or behavior ● Powerful for teaching and learning ○ Descriptions help communicate what it takes to succeed (This shouldn’t be a secret kept by the teachers!) ● Increase reliability of results ○ Increase consistency in grading between students ○ Increase consistency in grading between measurement points Understanding Rubrics
  • 36. Rubrics as Tools for Student: ● Defines “quality” for a process, product or behavior ● Encourage more thoughtful judgement of their own (and others’) work. ● Increases ability to “self-assess” ● Increases student responsibility Understanding Rubrics
  • 37. Inter-Rater Reliability: ● Same/Repeatable results when 2+ people are using 1 rubric ● Practice as a team, share samples, keep on file Intra-Rater Reliability: ● Repeatable results when 1 person is using 1 rubric ● Photograph/record samples, keep on file Understanding Rubrics