Implementation of theMeasures of Student Learning Dr. Rebecca Garland Angela Quick Jennifer Preston July 31, 2012
Focusing on the WHYNC is implementing a new curriculum, new assessments, newtechnology tools to improve instruction, new ways of engagingstudents, and the list goes on So why is the State focusing on educator effectiveness in the face of so many other changes?Because all our efforts in other areas depend on an effectiveteacher in every classroom and an effective leader in every schoolbuilding
Focusing on the WHYThe work around educator effectiveness, including the Measures ofStudent Learning, is grounded in the belief that: Every student in North Carolina deserves an effective teacher in all courses and grades.Our students need to learn all of the standards in the NorthCarolina Standard Course of Study in order to be READY fortheirfutures.
Focusing on the WHYIn order to increase their effectiveness, teachers need access tohigh-quality data Every teacher in North Carolina deserves feedback on the growth of their students.It’s not about firing our way to a better teaching force. It’s aboutcreating a system that: Identifies the strongest teachers so that we can all learn from them, and Identifies those teachers who need additional support and targets that support to their needs
What is educator effectiveness? Results of Assessments The Tools We Observations to Measure Growth Need: End of Grade End of Course Tools CTE Post Assess. MSLs Assessments to Measure Standards 1-7 Standard 8 Growth End of Grade E nrd d e n of rae of End of Course G a Student Survey ee CTE Post Assess. Possible use of MSLs Tripod Survey pending SBE decision Standards 1-5 Standard 6
Standards 6 & 8 – The Basics Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲Teachers 1 2 3 4 5 6Demonstrat Establish e EnvironmentLeadership Know Content Facilitate Learning Reflect on Contribute Practice to Academic SuccessPrincipals (and other Administrators) 1 2 3 4 5 6 7 8 Human External Micro- Academic Strategic Instructional Strategic Cultural Resource Managerial Development political Leadership Leadership Leadership Leadership AchievementLeadership Leadership Leadership Leadership Leadership
Teacher Ratings Categories Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲Teachers 1 2 3 4 5Demonstrate Leadership Establish Environment Know Content Facilitate Learning Reflect on Practice 6 Contribute to Academic Success 5 Rating Categories 3 Rating Categories Not Demonstrated Does Not Meet Expected Growth Developing Meets Expected Growth Proficient Exceeds Expected Growth Accomplished Distinguished
Teacher Ratings in 2011-12Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ 6 Yearly RatingTeacher EVAAS School-wide • Does Not Meet EVAAS Growth Expected Growth Growth • Meets Expected Growth Weighted Average • Exceeds Expected Growth Why is school-wide EVAAS growth included? • To encourage collaboration and collective ownership of overall outcomes • Teacher = 70% and School-wide = 30% Note: In 2011-12, teachers without individual EVAAS growth will get school-wide growth for Standard 6.
Teacher Ratings in 2012-13 Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ We are piloting some additional elements for possible inclusion in Standard 6 in 2012-13 Possible additional elements Teacher Student EVAAS Surveys Growth (?) School- Team 6 Yearly Rating wide EVAAS • Does Not Meet Expected Growth EVAAS Growth (?) • Meets Expected Growth Growth • Exceeds Expected Growth Weighted AverageDraft – March 2012. Check http://www.ncpublicschools.org/ready/resources/ for Updates to this Presentation
Ratings Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ Teachers 1 2 3 4 5 6 Demonstrate Leadership Establish Environment Know Content Facilitate Learning Reflect on Practice Contribute to Academic Success Principals 1 2 3 4 5 6 7 8 Strategic Instructional Cultural Human Managerial External Micro- Academic Leadership Leadership Leadership Resource Leadership Development political Achievement Leadership Leadership Leadership Leadership Key Note on Ratings • Every educator is evaluated every year • Each standard and rating stands on its own (1 out of 6, not 1/6) • Ratings are used to create professional development plans each year • Ratings are used to determine statusDraft – March 2012. Check http://www.ncpublicschools.org/ready/resources/ for Updates to this Presentation
Status Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ Ratings Status • Teachers • A single overall status that is 6 separate ratings to determined once a principal help teachers grow each or teacher has three years of growth data to populate 6 year or 8 • Principals • Categories for Status 8 separate ratings to help principals grow 1. In Need of Improvement each year 2. Effective 3. Highly EffectiveDraft – March 2012. Check http://www.ncpublicschools.org/ready/resources/ for Updates to this Presentation
Teacher Status Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ In Need of Highly Effective Improvement Effective Standards 1-5 Any rating Proficient Accomplished In the year lower than or Higher or Higher proficient on Standards on Standards 1 2 3 4 5Demonstrate Establish Leadership Environment Know Content Facilitate Learning Reflect on Practice 1-5 1-5 And/Or And And Standard 6 Does Not Meets or Exceeds Three-year rolling average Meet Exceeds Expected Expected Expected Growth )/ 3 ) 6 2 years ago 6 + 1ago + year 6 This year Growth Growth Draft – March 2012. Check http://www.ncpublicschools.org/ready/resources/ for Updates to this Presentation
Status and Standard 6 & 8Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ • An educator receives an effectiveness status only once she has 3 years of data on standards 6 or 8 • A 3-year rolling average of growth data from standards 6 or 8 is used as part of determining overall status
North Carolina Educator Evaluation System Evaluation Summary Sheet Name: Martha Washington School: Independence Elementary School LEA: Freedom County Schools Licensure: Career-Status Overall Status: In Need of Improvement Standard One: Teachers demonstrate leadership. Not Demonstrated Developing Proficient Accomplished Distinguished Standard Two: Teachers establish a respectful environment. Not Demonstrated Developing Proficient Accomplished Distinguished Standard Three: Teachers know the content they teach. Not Demonstrated Developing Proficient Accomplished Distinguished DRAFT Standard Four: Teachers facilitate learning for their students. Not Demonstrated Developing Standard Five: Teachers reflect on their practice. Not Demonstrated Developing Proficient Proficient Accomplished Accomplished Distinguished Distinguished Standard Six: Teachers contribute to the academic success of students. *Only three-year rolling average is used to determine overall status* Year One (2009 – 2010) Year Two (2010 – 2011) Year Three (2011 – 2012) Three-Year Rolling Average* Individual Student Growth: -1.8 Individual Student Growth: 1.2 Individual Student Growth: .7 School-wide Student Growth: .1 Year One Growth: -1.23 School-wide Student Growth: .9 Year Two Growth: 1.11 School-wide Student Growth: .9 Year Three Growth: .76 .21 Does not Meets Exceeds Does not Meets Exceeds Does not Meets Exceeds Does not Meets Exceeds meet expected expected meet expected expected meet expected expected meet expected expected expected growth growth expected growth growth expected growth growth expected growth growth growth growth growth growth Overall In Need of Improvement Effective Highly Effective Status:
Focusing on the WHY So why have statewide Measures of Student Learning?1. North Carolina has a statewide evaluation system to ensure that every teacher receives a fair and consistent evaluation, regardless of his or her employing LEA2. Teachers in all content areas should receive a Standard Six rating based on the growth of their own students on their content-specific standards3. Most LEAs do not have the capacity to design their own assessments for all non state-tested grades and subjects
LEA-NCDPI PartnershipPrior to submitting a Race to the Top application, LEAsuperintendents and the NCDPI came to an agreement on how tomeasure student growth for the grades and subjects not assessedwith state exams:Step Description OwnerOne Design statewide NCDPI (with teacher assessments input)Two Administer new LEAs/Charter assessments SchoolsThree Determine growth with NCDPI data from new assessments
Four Buckets of Assessments for GrowthRationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ A B C D EOCs, Category Category Locally EOGs One of Two of Developed and MSLs MSLs Courses VoCATS With appropriate With the heavy resources and emphasis on time, these MSLs performance, the can be validated se MSLs cannot psychometrically be validated psychometrically
Implementation Guide Currently in DRAFT form Balances between LEA flexibility in implementation and the need tocollect secure data to send to EVAAS Will be revised after feedback from testing coordinators andsuperintendents (feedback due by August 15; updated version posted bySeptember 15) Will also be revised after Fall 2012 administration prior to launch ofSpring 2013 administration Outlines decisions that LEAs need to make about implementation of theMSLs
LEA Expectations… Plans should include: Training for teachers and school administrators on the MSLs (in conjunction with Human Resources staff) How/if MSLs will be used for student accountability (i.e. as final exam grades) How/if parents and guardians will be notified of the MSLs Testing window
LEA Expectations… Training for teachers on how to score the performance-based items (NCDPI module released in early Fall 2012) Administration mode and security Uniform procedures for administration Procedures for the distribution, collection, storage, destruction, or recycling of MSL materials Roles and responsibilities for LEA and school-level staff members
Wilkes County Schools• Proposed Implementation Plan Final Draft by October 1• MSL’s Timeline• Questions
Resources NCEES Wikihttp://ncees.ncdpi.wikispaces.net/NCEES+Wiki Region 7 Support Wiki http://rt3region7.ncdpi.wikispaces.net DPI Educator Effectiveness Websitehttp://www.ncpublicschools.org/educatoreffect/
A particular slide catching your eye?
Clipping is a handy way to collect important slides you want to go back to later.