SlideShare a Scribd company logo
September 2015
Engaging Teachers in Student Surveys
By Ryan Balch, Ph.D.
This white paper is part of a series on student surveys by Ryan Balch, CEO/Founder of My
Student Survey (www.mystudentsurvey.com). My Student Survey is a leading provider of
stakeholder surveys for schools and districts across the country. The goal of this series is to
highlight key research related to student surveys, share best practices, and provide technical
assistance for schools and districts using student surveys.
A primary challenge in adopting student surveys comes from developing buy-in and
engagement from teachers. Placing a value on student voice upsets the normal hierarchy within
schools and therefore requires a culture shift for teachers to gain comfort with students providing
feedback. In some circumstances, resistance to this shift can lead to teachers being less receptive
to results and the instructional adjustments suggested by feedback reports. There are, however,
several methods by which policymakers can increase engagement in student surveys. These
include developing a communication strategy, providing high-quality feedback reports, and
utilizing screening procedures to eliminate invalid surveys.
The first method of fostering a sense of engagement involves the creation of a strategic
communication strategy. Frequent and two-way communication about student surveys allows
teachers to know the plan for the results, express concerns, highlight misunderstandings, and feel
prepared in advance. This may start with information in newsletters/emails as well as
communication through principals and survey coordinators, but should also include district-
sponsored Q&A sessions and webinars (both of which can be online) where teachers can ask
questions. Union representatives can play a key role in publicizing these events.
Ryan Balch - My Student Survey
ryanbalch@mystudentsurvey.com
September 2015
An important component of a communication strategy is fully sharing all survey items prior
to administration. This allows teachers to recognize that the behaviors asked about in the survey
are familiar teaching practices. As an example, our STeP survey was derived from research-
based practices and standards within common observation rubrics (such as Danielson, Marzano,
CLASS, etc.), so the behaviors are generally ones that teachers have previously encountered. In
the absence of sharing survey items, teachers may start with a different understanding of the
content of student survey items. In reality, student surveys are not asking questions such as ‘My
teachers is the best’ or ‘My teacher wears nice shoes’. Instead, they ask questions about the
frequency of a teacher’s practice such as ‘When we learn something new, my teacher does a few
examples with the class’ and ‘My teacher corrects students when they do not follow the rules of
the class’. To aid with transparency, districts and/or states implementing surveys should provide
easy access to survey items for teachers through public websites affiliated with the district. This
access should be highlighted and linked in regular school and district communications.
Second, user-friendly feedback reports provide a method for teachers to take advantage of the
instructional benefits of student surveys. Reports should be easy for teachers to navigate but also
facilitate change in instruction, goal setting, and answer the question of ‘Now What?’ To help
build teacher engagement, feedback reports should contain the following features:
1. Secure, unique logins to access reports
2. Inclusion of overall and scale results as well as item-level information
3. Identification of areas of strength and areas of focus using comparison methods
4. Templates that teachers can use to create an action plan
5. The ability for principals to easily identify high-scoring teachers in the building on each
item/instructional practice (to serve as models for other teachers)
Ryan Balch - My Student Survey
ryanbalch@mystudentsurvey.com
September 2015
An example feedback report that incorporates these principles can be viewed at
www.mystudentsurvey.com/reports
The final method for building engagement comes from identifying and eliminating invalid
surveys. Previous studies have indicated that invalid surveys exist for roughly 5 to 8% of surveys
(Balch, 2012). However, the perception of teachers is often greater than the reality and therefore
needs to be addressed for teachers to place credibility in the results. Teachers are specifically and
legitimately worried about the student in the classroom who has “an ax to grind” and will use the
survey as an opportunity for retribution. In reality, the surveys that are eliminated are primarily
from students who raced through the survey.
To address these issues, schools and districts should employ screening procedures to identify
invalid responses. The presence of these safeguards can have a dramatic impact on teacher
comfort with student survey and confidence in the results. Current research is underway on the
best method for incorporating screening procedures, varying from outlier removal to minimum
time spent on surveys, with the goal of strengthening the relationship between student surveys
and achievement (Balch & Robinson-Cimpian, 2014).
As schools and districts plan for engaging teachers in student surveys, there are a variety of
considerations that should be discussed:
Readiness Questions:
 Does your school or district have a communication strategy for informing teachers about
student surveys?
 Does your school or district have a regular method of communicating with teachers
(which they regularly use) in which to link your district’s information page on student
surveys that contains survey items?
Ryan Balch - My Student Survey
ryanbalch@mystudentsurvey.com
September 2015
 Do feedback reports contain the important elements listed? What needs to be added?
 How does your school or district identify invalid responses? If there is a process, how
does your school or district communicate that you use this process to teachers?
Next Steps:
 Develop a communications plan for student surveys that includes teachers. This includes
creating a website that contains full versions of your student survey and scheduling Q&A
sessions and/or webinars on student surveys.
 Create teacher feedback reports that allow student survey results to drive instructional
choices. Be sure to have multiple resources for growth (e.g. video libraries) available and
linked to these reports.
 Provide time, structures, and opportunities for teachers to analyze results and learn from
one another. This could be training sessions on using student survey data for goal setting
or encouraging sharing within existing professional learning communities.
 Use available research or experts to identify processes for screening invalid responses.
About Ryan Balch
Ryan Balch is a national thought leader on using student surveys at the elementary and
secondary level has expertise in measurement development. Before founding My Student
Survey, Ryan Balch completed his Ph.D. in Education Policy at Vanderbilt University as an
Institute of Education Sciences (IES) Fellow, where his dissertation focused on the development
Ryan Balch - My Student Survey
ryanbalch@mystudentsurvey.com
September 2015
and validation of student surveys on teacher practice. He was the principal investigator for the
student survey pilot of more than 15,000 students in 7 districts as part of Georgia’s Race to the
Top initiative and worked for the National Center on Performance Incentives. In addition, Ryan
was the director of teacher and principal evaluation for Baltimore City Schools. During this
time, he oversaw the creation and implementation of the district’s new systems of evaluation.
Previously, Ryan worked as a science teacher and administrator for seven years at Riverwood
High School in Atlanta, Georgia. He has a B.A. in Psychology from Duke University and a
M.A. in Science Education from Georgia State University.
Ryan Balch - My Student Survey
ryanbalch@mystudentsurvey.com

More Related Content

What's hot

Primary school testing in England - life after levels
Primary school testing in England - life after levelsPrimary school testing in England - life after levels
Primary school testing in England - life after levels
CILIP the library and information association
 
Adapting Assessment Practices for Student Leaders
Adapting Assessment Practices for Student LeadersAdapting Assessment Practices for Student Leaders
Adapting Assessment Practices for Student Leaders
Amma Marfo
 
Providing specific, descriptive feedback
Providing specific, descriptive feedbackProviding specific, descriptive feedback
Providing specific, descriptive feedbackrlhoffma
 
Providing specific, descriptive feedback
Providing specific, descriptive feedbackProviding specific, descriptive feedback
Providing specific, descriptive feedbackshshewbr
 
High Stakes Standardize Testing Keck Pp 3
High Stakes Standardize Testing Keck Pp 3High Stakes Standardize Testing Keck Pp 3
High Stakes Standardize Testing Keck Pp 3amate1cl
 
Iasb student growth presentation
Iasb student growth presentationIasb student growth presentation
Iasb student growth presentation
Richard Voltz
 
Action Research Proposal Presentation [Autosaved].pptx
Action Research Proposal  Presentation [Autosaved].pptxAction Research Proposal  Presentation [Autosaved].pptx
Action Research Proposal Presentation [Autosaved].pptx
StephanieWillis11
 
IASB Student Growth Presentation
IASB Student Growth PresentationIASB Student Growth Presentation
IASB Student Growth Presentation
Richard Voltz
 
ABLE - Learner Analytics Symposium - Rebecca Edwards
ABLE - Learner Analytics Symposium - Rebecca EdwardsABLE - Learner Analytics Symposium - Rebecca Edwards
ABLE - Learner Analytics Symposium - Rebecca Edwards
Ed Foster
 
Program ID #48: Dancing with Data
Program ID #48: Dancing with DataProgram ID #48: Dancing with Data
Program ID #48: Dancing with Datatcaconference
 
Hammond slides
Hammond slidesHammond slides
Hammond slideslguzniczak
 
Donatoni_A_Week6_AssessmentsPP
Donatoni_A_Week6_AssessmentsPPDonatoni_A_Week6_AssessmentsPP
Donatoni_A_Week6_AssessmentsPP
angeladonatoni
 
Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...
Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...
Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...
Blackboard APAC
 
Australian university teacher’s engagement with learning analytics: Still ea...
Australian university teacher’s engagement with learning analytics:  Still ea...Australian university teacher’s engagement with learning analytics:  Still ea...
Australian university teacher’s engagement with learning analytics: Still ea...
Blackboard APAC
 
Teacher evaluation presentation3 mass
Teacher evaluation presentation3  massTeacher evaluation presentation3  mass
Teacher evaluation presentation3 mass
John Cronin
 
REACH 2.0 Incorporating Peer Feedback and Peer Evaluation Policy Brief Teach ...
REACH 2.0 Incorporating Peer Feedback and Peer Evaluation Policy Brief Teach ...REACH 2.0 Incorporating Peer Feedback and Peer Evaluation Policy Brief Teach ...
REACH 2.0 Incorporating Peer Feedback and Peer Evaluation Policy Brief Teach ...Micah Miner
 
Student Assessment
Student AssessmentStudent Assessment
Student Assessmentcgamble
 
ABLE - NTU Eunis case study - Nov 2017
ABLE - NTU Eunis case study - Nov 2017ABLE - NTU Eunis case study - Nov 2017
ABLE - NTU Eunis case study - Nov 2017
Ed Foster
 
Value-Added Assessment
Value-Added AssessmentValue-Added Assessment
Value-Added Assessmentswoodring
 

What's hot (20)

Primary school testing in England - life after levels
Primary school testing in England - life after levelsPrimary school testing in England - life after levels
Primary school testing in England - life after levels
 
Adapting Assessment Practices for Student Leaders
Adapting Assessment Practices for Student LeadersAdapting Assessment Practices for Student Leaders
Adapting Assessment Practices for Student Leaders
 
Providing specific, descriptive feedback
Providing specific, descriptive feedbackProviding specific, descriptive feedback
Providing specific, descriptive feedback
 
Providing specific, descriptive feedback
Providing specific, descriptive feedbackProviding specific, descriptive feedback
Providing specific, descriptive feedback
 
News story template
News story templateNews story template
News story template
 
High Stakes Standardize Testing Keck Pp 3
High Stakes Standardize Testing Keck Pp 3High Stakes Standardize Testing Keck Pp 3
High Stakes Standardize Testing Keck Pp 3
 
Iasb student growth presentation
Iasb student growth presentationIasb student growth presentation
Iasb student growth presentation
 
Action Research Proposal Presentation [Autosaved].pptx
Action Research Proposal  Presentation [Autosaved].pptxAction Research Proposal  Presentation [Autosaved].pptx
Action Research Proposal Presentation [Autosaved].pptx
 
IASB Student Growth Presentation
IASB Student Growth PresentationIASB Student Growth Presentation
IASB Student Growth Presentation
 
ABLE - Learner Analytics Symposium - Rebecca Edwards
ABLE - Learner Analytics Symposium - Rebecca EdwardsABLE - Learner Analytics Symposium - Rebecca Edwards
ABLE - Learner Analytics Symposium - Rebecca Edwards
 
Program ID #48: Dancing with Data
Program ID #48: Dancing with DataProgram ID #48: Dancing with Data
Program ID #48: Dancing with Data
 
Hammond slides
Hammond slidesHammond slides
Hammond slides
 
Donatoni_A_Week6_AssessmentsPP
Donatoni_A_Week6_AssessmentsPPDonatoni_A_Week6_AssessmentsPP
Donatoni_A_Week6_AssessmentsPP
 
Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...
Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...
Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...
 
Australian university teacher’s engagement with learning analytics: Still ea...
Australian university teacher’s engagement with learning analytics:  Still ea...Australian university teacher’s engagement with learning analytics:  Still ea...
Australian university teacher’s engagement with learning analytics: Still ea...
 
Teacher evaluation presentation3 mass
Teacher evaluation presentation3  massTeacher evaluation presentation3  mass
Teacher evaluation presentation3 mass
 
REACH 2.0 Incorporating Peer Feedback and Peer Evaluation Policy Brief Teach ...
REACH 2.0 Incorporating Peer Feedback and Peer Evaluation Policy Brief Teach ...REACH 2.0 Incorporating Peer Feedback and Peer Evaluation Policy Brief Teach ...
REACH 2.0 Incorporating Peer Feedback and Peer Evaluation Policy Brief Teach ...
 
Student Assessment
Student AssessmentStudent Assessment
Student Assessment
 
ABLE - NTU Eunis case study - Nov 2017
ABLE - NTU Eunis case study - Nov 2017ABLE - NTU Eunis case study - Nov 2017
ABLE - NTU Eunis case study - Nov 2017
 
Value-Added Assessment
Value-Added AssessmentValue-Added Assessment
Value-Added Assessment
 

Similar to Engaging Teachers in Student Surveys - White Paper for September 2015

Teacher opinions about the use of Value-Added models
Teacher opinions about the use of Value-Added models Teacher opinions about the use of Value-Added models
Teacher opinions about the use of Value-Added models llee18
 
Guide Assessment4learning
Guide Assessment4learningGuide Assessment4learning
Guide Assessment4learningDai Barnes
 
Data Summer
Data SummerData Summer
Data Summer
mark.richardson
 
Collecting Information Please respond to the followingUsi.docx
Collecting Information Please respond to the followingUsi.docxCollecting Information Please respond to the followingUsi.docx
Collecting Information Please respond to the followingUsi.docx
mary772
 
Nyinst
NyinstNyinst
Nyinst
John Cronin
 
New ways to think about framing accountability to your community
New ways to think about framing accountability to your communityNew ways to think about framing accountability to your community
New ways to think about framing accountability to your community
John Cronin
 
Formative Reflective Assessment
Formative Reflective AssessmentFormative Reflective Assessment
Formative Reflective Assessment
Christina Valadez
 
Summative Assessment
Summative AssessmentSummative Assessment
Summative Assessment
Custom Paper Writing UK
 
Role on standarized and non standarized test in guidance on counseling
Role on standarized and non standarized test in guidance on counselingRole on standarized and non standarized test in guidance on counseling
Role on standarized and non standarized test in guidance on counseling
UmaRani841531
 
Essay On Assessment For Learning
Essay On Assessment For LearningEssay On Assessment For Learning
Essay On Assessment For Learning
Best Paper Writing Services
 
Seven purposes presentation
Seven purposes presentationSeven purposes presentation
Seven purposes presentation
John Cronin
 
Teacher Observations: The Case for Arts for All Public Charter School Policy ...
Teacher Observations: The Case for Arts for All Public Charter School Policy ...Teacher Observations: The Case for Arts for All Public Charter School Policy ...
Teacher Observations: The Case for Arts for All Public Charter School Policy ...
Tiffany Brooks
 
Data Driven Instrruction
Data Driven InstrructionData Driven Instrruction
Data Driven Instrruction
Tman
 
Data Driven Instruction
Data Driven InstructionData Driven Instruction
Data Driven Instruction
Tman
 
How to Develop a Response to Intervention Model
How to Develop a Response to Intervention ModelHow to Develop a Response to Intervention Model
How to Develop a Response to Intervention Model
Amy Robertson
 
Life Without Levels INSET
Life Without Levels INSETLife Without Levels INSET
Life Without Levels INSET
Alex Gingell
 
California administrator symposium nwea
California administrator symposium nweaCalifornia administrator symposium nwea
California administrator symposium nwea
John Cronin
 

Similar to Engaging Teachers in Student Surveys - White Paper for September 2015 (20)

Teacher opinions about the use of Value-Added models
Teacher opinions about the use of Value-Added models Teacher opinions about the use of Value-Added models
Teacher opinions about the use of Value-Added models
 
Guide Assessment4learning
Guide Assessment4learningGuide Assessment4learning
Guide Assessment4learning
 
Data Summer
Data SummerData Summer
Data Summer
 
Collecting Information Please respond to the followingUsi.docx
Collecting Information Please respond to the followingUsi.docxCollecting Information Please respond to the followingUsi.docx
Collecting Information Please respond to the followingUsi.docx
 
Nyinst
NyinstNyinst
Nyinst
 
New ways to think about framing accountability to your community
New ways to think about framing accountability to your communityNew ways to think about framing accountability to your community
New ways to think about framing accountability to your community
 
Formative Reflective Assessment
Formative Reflective AssessmentFormative Reflective Assessment
Formative Reflective Assessment
 
Fs
FsFs
Fs
 
Summative Assessment
Summative AssessmentSummative Assessment
Summative Assessment
 
Role on standarized and non standarized test in guidance on counseling
Role on standarized and non standarized test in guidance on counselingRole on standarized and non standarized test in guidance on counseling
Role on standarized and non standarized test in guidance on counseling
 
Essay On Assessment For Learning
Essay On Assessment For LearningEssay On Assessment For Learning
Essay On Assessment For Learning
 
Seven purposes presentation
Seven purposes presentationSeven purposes presentation
Seven purposes presentation
 
Teacher Observations: The Case for Arts for All Public Charter School Policy ...
Teacher Observations: The Case for Arts for All Public Charter School Policy ...Teacher Observations: The Case for Arts for All Public Charter School Policy ...
Teacher Observations: The Case for Arts for All Public Charter School Policy ...
 
Data Driven Instrruction
Data Driven InstrructionData Driven Instrruction
Data Driven Instrruction
 
Data Driven Instruction
Data Driven InstructionData Driven Instruction
Data Driven Instruction
 
How to Develop a Response to Intervention Model
How to Develop a Response to Intervention ModelHow to Develop a Response to Intervention Model
How to Develop a Response to Intervention Model
 
Valueadded
ValueaddedValueadded
Valueadded
 
Valueadded
ValueaddedValueadded
Valueadded
 
Life Without Levels INSET
Life Without Levels INSETLife Without Levels INSET
Life Without Levels INSET
 
California administrator symposium nwea
California administrator symposium nweaCalifornia administrator symposium nwea
California administrator symposium nwea
 

Engaging Teachers in Student Surveys - White Paper for September 2015

  • 1. September 2015 Engaging Teachers in Student Surveys By Ryan Balch, Ph.D. This white paper is part of a series on student surveys by Ryan Balch, CEO/Founder of My Student Survey (www.mystudentsurvey.com). My Student Survey is a leading provider of stakeholder surveys for schools and districts across the country. The goal of this series is to highlight key research related to student surveys, share best practices, and provide technical assistance for schools and districts using student surveys. A primary challenge in adopting student surveys comes from developing buy-in and engagement from teachers. Placing a value on student voice upsets the normal hierarchy within schools and therefore requires a culture shift for teachers to gain comfort with students providing feedback. In some circumstances, resistance to this shift can lead to teachers being less receptive to results and the instructional adjustments suggested by feedback reports. There are, however, several methods by which policymakers can increase engagement in student surveys. These include developing a communication strategy, providing high-quality feedback reports, and utilizing screening procedures to eliminate invalid surveys. The first method of fostering a sense of engagement involves the creation of a strategic communication strategy. Frequent and two-way communication about student surveys allows teachers to know the plan for the results, express concerns, highlight misunderstandings, and feel prepared in advance. This may start with information in newsletters/emails as well as communication through principals and survey coordinators, but should also include district- sponsored Q&A sessions and webinars (both of which can be online) where teachers can ask questions. Union representatives can play a key role in publicizing these events. Ryan Balch - My Student Survey ryanbalch@mystudentsurvey.com
  • 2. September 2015 An important component of a communication strategy is fully sharing all survey items prior to administration. This allows teachers to recognize that the behaviors asked about in the survey are familiar teaching practices. As an example, our STeP survey was derived from research- based practices and standards within common observation rubrics (such as Danielson, Marzano, CLASS, etc.), so the behaviors are generally ones that teachers have previously encountered. In the absence of sharing survey items, teachers may start with a different understanding of the content of student survey items. In reality, student surveys are not asking questions such as ‘My teachers is the best’ or ‘My teacher wears nice shoes’. Instead, they ask questions about the frequency of a teacher’s practice such as ‘When we learn something new, my teacher does a few examples with the class’ and ‘My teacher corrects students when they do not follow the rules of the class’. To aid with transparency, districts and/or states implementing surveys should provide easy access to survey items for teachers through public websites affiliated with the district. This access should be highlighted and linked in regular school and district communications. Second, user-friendly feedback reports provide a method for teachers to take advantage of the instructional benefits of student surveys. Reports should be easy for teachers to navigate but also facilitate change in instruction, goal setting, and answer the question of ‘Now What?’ To help build teacher engagement, feedback reports should contain the following features: 1. Secure, unique logins to access reports 2. Inclusion of overall and scale results as well as item-level information 3. Identification of areas of strength and areas of focus using comparison methods 4. Templates that teachers can use to create an action plan 5. The ability for principals to easily identify high-scoring teachers in the building on each item/instructional practice (to serve as models for other teachers) Ryan Balch - My Student Survey ryanbalch@mystudentsurvey.com
  • 3. September 2015 An example feedback report that incorporates these principles can be viewed at www.mystudentsurvey.com/reports The final method for building engagement comes from identifying and eliminating invalid surveys. Previous studies have indicated that invalid surveys exist for roughly 5 to 8% of surveys (Balch, 2012). However, the perception of teachers is often greater than the reality and therefore needs to be addressed for teachers to place credibility in the results. Teachers are specifically and legitimately worried about the student in the classroom who has “an ax to grind” and will use the survey as an opportunity for retribution. In reality, the surveys that are eliminated are primarily from students who raced through the survey. To address these issues, schools and districts should employ screening procedures to identify invalid responses. The presence of these safeguards can have a dramatic impact on teacher comfort with student survey and confidence in the results. Current research is underway on the best method for incorporating screening procedures, varying from outlier removal to minimum time spent on surveys, with the goal of strengthening the relationship between student surveys and achievement (Balch & Robinson-Cimpian, 2014). As schools and districts plan for engaging teachers in student surveys, there are a variety of considerations that should be discussed: Readiness Questions:  Does your school or district have a communication strategy for informing teachers about student surveys?  Does your school or district have a regular method of communicating with teachers (which they regularly use) in which to link your district’s information page on student surveys that contains survey items? Ryan Balch - My Student Survey ryanbalch@mystudentsurvey.com
  • 4. September 2015  Do feedback reports contain the important elements listed? What needs to be added?  How does your school or district identify invalid responses? If there is a process, how does your school or district communicate that you use this process to teachers? Next Steps:  Develop a communications plan for student surveys that includes teachers. This includes creating a website that contains full versions of your student survey and scheduling Q&A sessions and/or webinars on student surveys.  Create teacher feedback reports that allow student survey results to drive instructional choices. Be sure to have multiple resources for growth (e.g. video libraries) available and linked to these reports.  Provide time, structures, and opportunities for teachers to analyze results and learn from one another. This could be training sessions on using student survey data for goal setting or encouraging sharing within existing professional learning communities.  Use available research or experts to identify processes for screening invalid responses. About Ryan Balch Ryan Balch is a national thought leader on using student surveys at the elementary and secondary level has expertise in measurement development. Before founding My Student Survey, Ryan Balch completed his Ph.D. in Education Policy at Vanderbilt University as an Institute of Education Sciences (IES) Fellow, where his dissertation focused on the development Ryan Balch - My Student Survey ryanbalch@mystudentsurvey.com
  • 5. September 2015 and validation of student surveys on teacher practice. He was the principal investigator for the student survey pilot of more than 15,000 students in 7 districts as part of Georgia’s Race to the Top initiative and worked for the National Center on Performance Incentives. In addition, Ryan was the director of teacher and principal evaluation for Baltimore City Schools. During this time, he oversaw the creation and implementation of the district’s new systems of evaluation. Previously, Ryan worked as a science teacher and administrator for seven years at Riverwood High School in Atlanta, Georgia. He has a B.A. in Psychology from Duke University and a M.A. in Science Education from Georgia State University. Ryan Balch - My Student Survey ryanbalch@mystudentsurvey.com