Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
An Empirical Investigation of Ohio’s
Educator Evaluation System
Overview …
• Two question motivate our study:
– What does Ohio’s educator evaluation system look like?
– Any systematic pa...
OTES (2014-2015)
(1) Performance Standards (50%)
-- Developed by OH Educator Standards Board
-- Seven components
-- Studen...
Student Growth Measures in OTES
(A) Value-Added
-- Grades 4th – 8th, ELA & Math
-- Until June 30, 2014, majority (>25%) of...
OPES (2014-2015)
(1) Performance Standards
-- Shared vision, establish goals,
continuous improvement
-- HQ instruction -> ...
Student Growth Measures in OPES
(A) Value-Added
-- School-level Value-Added
(B) Approved Vendor Assessments
-- School-leve...
… OTESOPES Final Rating Determination
Performance Standards

SGM Rating

4
Above

3

Accomplished Accomplished

2

1

Skil...
OTESOPES Data for 2012-2013
•

OTES – 26 LEAs = 23 PSDs + 1 JVSDs + 2 CSs

Ineffective

Skilled

Accomplished

Total

13 (...
OTESOPES Final Summative Ratings

NERA Annual Meeting (Rocky Hill, CT)

10/24/13

9
OTES Final Rating by SGM Rating

NERA Annual Meeting (Rocky Hill, CT)

10/24/13

10
OTES SGM Ratings by SGM Type

NERA Annual Meeting (Rocky Hill, CT)

10/24/13

11
OTES Value-Added Ratings by Weight

NERA Annual Meeting (Rocky Hill, CT)

10/24/13

12
SLO Ratings by Weight

NERA Annual Meeting (Rocky Hill, CT)

10/24/13

13
Initial Conclusions
• Value-Added fairly congruent with other evaluation measures
• Weight placed on Value-Added seems to ...
Upcoming SlideShare
Loading in …5
×

An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)

276 views

Published on

Presented at Northeastern Educational Research Association Annual Conference 2013 by Anirudh V.S. Ruhil, Marsha S. Lewis, Emily A. Price, and Suzanne Franco

Published in: Education, Health & Medicine
  • Be the first to comment

  • Be the first to like this

An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)

  1. 1. An Empirical Investigation of Ohio’s Educator Evaluation System
  2. 2. Overview … • Two question motivate our study: – What does Ohio’s educator evaluation system look like? – Any systematic patterns (conditionalunconditional)? • • • • OTESOPES eTPES Data Analysis and Findings Conclusions NERA Annual Meeting (Rocky Hill, CT) 10/24/13 2
  3. 3. OTES (2014-2015) (1) Performance Standards (50%) -- Developed by OH Educator Standards Board -- Seven components -- Students -- Content -- Assessment -- Instruction -- Learning Environment -- Collaboration and Communication -- Professional Responsibility and Growth (2) Student Growth Measures (50%) -- Value-Added -- Approved Vendor Assessments -- LEA Measures NERA Annual Meeting (Rocky Hill, CT) 10/24/13 3
  4. 4. Student Growth Measures in OTES (A) Value-Added -- Grades 4th – 8th, ELA & Math -- Until June 30, 2014, majority (>25%) of SGM shall be based on Value-Added -- On or after July 1, 2014, all (50%) of SGM shall be based on Value-Added. (B) Approved Vendor Assessments -- Terra Nova -- ACT End-of Course -- NWEA MAP -- STAR -- … (C) LEA Measures -- Student Learning Objectives -- Shared Attribution -- LEASchool-level Value-Added -- LEASchool-level SLO NERA Annual Meeting (Rocky Hill, CT) 10/24/13 4
  5. 5. OPES (2014-2015) (1) Performance Standards -- Shared vision, establish goals, continuous improvement -- HQ instruction -> increased student achievement -- Manage resourcesoperations -- Establish collaborating learning, shared leadership -- Engage parents, community (2) Student Growth Measures -- Value-Added -- Approved Vendor Assessments -- LEA Measures NERA Annual Meeting (Rocky Hill, CT) 10/24/13 5
  6. 6. Student Growth Measures in OPES (A) Value-Added -- School-level Value-Added (B) Approved Vendor Assessments -- School-level Composite Measure -- School level aggregate of AVA scores (C) LEA Measures -- District SLOs -- District Value-Added -- Aggregate of Teachers’ Value-Added Scores -- Student Achievement trends -- Progress on Improvement Plans -- Student course-taking trend (e.g., AP) NERA Annual Meeting (Rocky Hill, CT) 10/24/13 6
  7. 7. … OTESOPES Final Rating Determination Performance Standards SGM Rating 4 Above 3 Accomplished Accomplished 2 1 Skilled Developing Expected Skilled Skilled Developing Developing Below Developing Developing Ineffective Ineffective NERA Annual Meeting (Rocky Hill, CT) 10/24/13 7
  8. 8. OTESOPES Data for 2012-2013 • OTES – 26 LEAs = 23 PSDs + 1 JVSDs + 2 CSs Ineffective Skilled Accomplished Total 13 (0.6%) • Developing 298 (12.8%) 1,580 (67.8%) 441 (18.9%) 2,332 (100%) OPES – 27 LEAs = 24 PSDs + 1 JVSD + 2 CSs Ineffective Skilled Accomplished Total 0 (0%) • Developing 22 (12.9%) 98 (57.3%) 51 (29.8%) 171 (100%) After exclusions for LEAs piloting OTESOPES we have – 24 LEAs ~ 2,001 Teacher records – 15 LEAs ~ 62 Principal records – … These sub-sample sizes drop further once “Exempt” records are excluded NERA Annual Meeting (Rocky Hill, CT) 10/24/13 8
  9. 9. OTESOPES Final Summative Ratings NERA Annual Meeting (Rocky Hill, CT) 10/24/13 9
  10. 10. OTES Final Rating by SGM Rating NERA Annual Meeting (Rocky Hill, CT) 10/24/13 10
  11. 11. OTES SGM Ratings by SGM Type NERA Annual Meeting (Rocky Hill, CT) 10/24/13 11
  12. 12. OTES Value-Added Ratings by Weight NERA Annual Meeting (Rocky Hill, CT) 10/24/13 12
  13. 13. SLO Ratings by Weight NERA Annual Meeting (Rocky Hill, CT) 10/24/13 13
  14. 14. Initial Conclusions • Value-Added fairly congruent with other evaluation measures • Weight placed on Value-Added seems to be of no consequence for final summative rating • Our early results in line with NYC (http://bit.ly/16qYVYg) … possibly other states as well. • Strong Caveats – – – – Limited data at hand Potentially biased set of LEAs studied here Value-Added well studied but not so Vendor Assessments & SLOs Questions of OTESOPES reliability only answerable with multiple waves of data NERA Annual Meeting (Rocky Hill, CT) 10/24/13 14

×