Presented at the Mid-western Educational Research Association Annual Meeting Nov. 6-9 2013 by Anirudh V.S. Ruhil, Marsha S. Lewis, Lauren Porter, and Emily A. Price
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)
1. An Empirical Investigation of Ohio’s
Educator Evaluation System
Authors:
Anirudh V.S. Ruhil (Ohio University) <ruhil@ohio.edu>
Marsha S. Lewis (Ohio University) <lewism5@ohio.edu>
Lauren Porter (The Ohio State University) <porter.700@osu.edu>
Emily A. Price (Ohio University) < ep311508@ohio.edu>
2. Overview
• Two question motivate our study:
– What does Ohio’s educator evaluation system look like?
– Any systematic patterns (conditionalunconditional)?
•
•
•
•
OTESOPES
eTPES Data
Analysis and Findings
Conclusions
MWERA Annual Meeting 2013 (Evanston, IL)
11/08/13
3. OTES (2014-2015)
(1) Performance Standards (50%)
-- Developed by OH Educator Standards Board
-- Seven Components
1: Students
2: Content
3: Assessment
4: Instruction
5: Learning Environment
6: Collaboration and Communication
7: Professional Responsibility and Growth
(2) Student Growth Measures (50%)
-- Value-Added
-- Approved Vendor Assessments
-- LEA Measures
MWERA Annual Meeting 2013 (Evanston, IL)
11/08/13
4. Student Growth Measures in OTES
(A) Value-Added
-- Grades 4th – 8th, ELA & Math
-- Until June 30, 2014, majority (>25%) of SGM shall
be based on Value-Added
-- On or after July 1, 2014, all (50%) of SGM shall be
based on Value-Added.
(B) Approved Vendor Assessments
-- Terra Nova
-- ACT End-of Course
-- NWEA MAP
-- STAR
-- …
(C) LEA Measures
-- Student Learning Objectives
-- Shared Attribution
-- LEASchool-level Value-Added
-- LEASchool-level SLO
MWERA Annual Meeting 2013 (Evanston, IL)
11/08/13
5. OPES (2014-2015)
(1) Performance Standards
-- Shared vision, establish goals, and
continuous improvement
-- HQ instruction -> increased student
achievement
-- Manage resourcesoperations
-- Establish collaborating learning and
shared leadership
-- Engage parents and community
(2) Student Growth Measures
-- Value-Added
-- Approved Vendor Assessments
-- LEA Measures
MWERA Annual Meeting 2013 (Evanston, IL)
11/08/13
6. Student Growth Measures in OPES
(A) Value-Added
-- School-level Value-Added
(B) Approved Vendor Assessments
-- School-level Composite Measure
-- School-level Aggregate of AVA scores
(C) LEA Measures
-- District SLOs
-- District Value-Added
-- Aggregate of Teachers’ Value-Added Scores
-- Student Achievement Trends
-- Progress on Improvement Plans
-- Student Course-Taking Trend (e.g., AP)
MWERA Annual Meeting 2013 (Evanston, IL)
11/08/13
14. OTES: SLO Weight by Ratings
MWERA Annual Meeting 2013 (Evanston, IL)
11/08/13
15. Initial Conclusions
• Value-Added fairly congruent with other evaluation measures
• Weight placed on Value-Added seems to be of no consequence for final
summative rating
• Our early results in line with NYC (http://bit.ly/16qYVYg) … possibly other
states as well.
• Limitations
– Limited data at hand
– Potentially biased set of LEAs studied
– Value-Added has been well studied; More research is needed for Vendor Assessments &
SLOs
– Questions of OTESOPES reliability are only answerable with multiple waves of data
MWERA Annual Meeting 2013 (Evanston, IL)
11/08/13
Editor's Notes
NY findings: King presented preliminary numbers to the state Board of Regents Tuesday morning, announcing that nearly 50 percent of teachers received a “highly effective” rating, which is the top score. Another 42 percent were deemed “effective,” with only 4 percent as “developing” and 1 percent as “ineffective.”