Evaluation Plan for:
New State Standards for Mathematics and Problem-based Learning
A Grant Funded Project
FRIT 7237
Addy Baker
Meagan Harrelson
Victorie Penn
Implementation Evaluation
This implementation evaluation is intended to evaluate the implementation project
between Great Southern University and Braxton County Schools. The project intends to prepare
teachers from Braxton County Schools to implement the New State Standards for Mathematics
(NSSM). In order to properly evaluate the project the following questions must be answered: P1:
Were the initial experience and follow up activities implemented as planned? P2: What is the
quality of the initial program activities? P3: Who are the program participants and how were they
recruited? P4: What is the quality of follow up and support activities? These questions will be
answered using a variety of means including focus groups, surveys, interview, observations, and
questionnaires. Using a comprehensive approach will ensure the ability to form a complete idea
of the strengths and weaknesses of the project and highlight areas for improvement.
Implementation
Questions
Data
Collection
Methods
And Sources
Procedures Schedule
P1: Were the initial
experience and follow
up activities
implemented as
planned?
*Focus Group
*Survey
*Observation
with lesson
plan collection
*A focus group will be formed
of randomly chosen participants
to collect their personal
experiences with the
implementation of activities.
*All participants will complete
a survey asking questions on
their implementation
experience.
*Teacher lesson plans will be
collected and evaluated based
on the qualities of PBL and
adherence to the NSSM. These
lessons will be observed by a
trained evaluator.
*Mid project- October
2015
*End of Project- January
2016
P2: What is the
quality of the initial
program activities?
*Survey
*Observation
*Participants and project
administrators will receive an
exit survey on their view of the
quality workshop and additional
activities.
*During and immediately
following initial program
activities
*An evaluator will be present to
observe and evaluate the initial
program workshop.
P3: Who are the
program participants
and how were they
recruited?
*Interviews
*Questionnaire
*Upon finalization
of selections Ms. Carla Lawton
and the Project Director will be
interviewed in person about the
procedure with which they
chose participants.
*A questionnaire will be
distributed by email to all
eligible teachers and
administrators.
*Within the first 2 weeks
of selection finalization
P4: What is the
quality of follow up
and support activities?
*Survey
*Focus Group
*A focus group will be formed
of randomly chosen participants
to collect their personal
experiences of follow up and
support activities.
*All participants will complete
a survey asking questions about
follow up and support activities.
*Mid project- October
2015
*End of Project- January
2016
Summative Evaluation
The summative evaluation report is represented by 4 objectives within 2 different
questions. The first question, “To what extent were teachers able to develop PBL modules that
were connected to local business and industries, aligned with NSSM, and incorporated
appropriate uses of technology,” is associated with objectives 1,2,3 and the second question, “To
what extent were teachers able to implement and evaluate those modules,” is associated with
objective #4.
The project will begin on the date of June 25th. At this point, the introduction of new
standards to the Great Southern faculty and Braxton County teaching staff will be presented and
this will lead to the two staffs working through a PBL refinement period which will be the dates
of July 2nd through July 20th. During the refinement period, the faculty of Great Southern
University will help the teacher staff from Braxton County to refine their PBL modules using
electronic communication. The data that will be observed will come from post and pre-project
surveys, student work samples, basic observation rubrics, alignment of standards checklists, and
module rubrics.
During the fall term of the school year, the Braxton County teachers will implement their
modules and meet with the Great Southern faculty for a mid-year implementation meeting. Once
the mid-year meeting is completed the Braxton County teachers will have a self-evaluation
period.
Evaluation Questions Objective Indicator Data Source
To what extent were
teachers able to develop
PBL modules that were
connected to local business
and industries, aligned with
NSSM, and incorporated
appropriate uses of
technology?
Using local business
numerical data create a
PBL module that would
use the given data.
Modules refined
and uses
information from
local businesses.
*Module Rubric
*Pre-Project
Survey
To what extent were
teachers able to develop
PBL modules that were
connected to local business
and industries, aligned with
NSSM, and incorporated
appropriate uses of
technology
Using NSSM Standards
to align PBL modules.
Task and
assessment
refined and
aligned to NSSM
standards.
*Standards
Alignment
Checklist
To what extent were
teachers able to develop
PBL modules that were
connected to local business
and industries, aligned with
NSSM, and incorporated
appropriate uses of
technology
Create PBL Modules
that align with NSSM
standards and integrate
these modules into the
technology of local
businesses
Local business
aid in using
technology
effectively
during PBL
module.
*Observation
Rubric
*Activity Portfolio
*Teacher
Walkthroughs
To what extent were
teachers able to implement
and evaluate those
modules?
Self-evaluation of
modules implemented
during course.
Post survey data
and
walkthroughs to
determine the
overall use of
technology
*Post-Project
Surveys
*Student Work
Samples
Data Collection Schedule and Summary
Data Set Date of Collection
Instrument
Already
Developed?
Data Collected By
Pre and Post Surveys June 25, 2015 and
January 2016
No Great Southern
Faculty
Observation of Workshop June 29, 2015 No Outside Evaluator
Teacher Observation and
Self-Evaluation
January 2016 Yes Great Southern
Faculty and Teachers
Focus Group October 2015 No Great Southern
Faculty
Interviews with Ms. Lawton
and Project Director
Following selection
of participants
No Great Southern
Faculty
Student Work Samples January 2015 Yes Teachers

Technology Evaluation Plan

  • 1.
    Evaluation Plan for: NewState Standards for Mathematics and Problem-based Learning A Grant Funded Project FRIT 7237 Addy Baker Meagan Harrelson Victorie Penn Implementation Evaluation
  • 2.
    This implementation evaluationis intended to evaluate the implementation project between Great Southern University and Braxton County Schools. The project intends to prepare teachers from Braxton County Schools to implement the New State Standards for Mathematics (NSSM). In order to properly evaluate the project the following questions must be answered: P1: Were the initial experience and follow up activities implemented as planned? P2: What is the quality of the initial program activities? P3: Who are the program participants and how were they recruited? P4: What is the quality of follow up and support activities? These questions will be answered using a variety of means including focus groups, surveys, interview, observations, and questionnaires. Using a comprehensive approach will ensure the ability to form a complete idea of the strengths and weaknesses of the project and highlight areas for improvement. Implementation Questions Data Collection Methods And Sources Procedures Schedule P1: Were the initial experience and follow up activities implemented as planned? *Focus Group *Survey *Observation with lesson plan collection *A focus group will be formed of randomly chosen participants to collect their personal experiences with the implementation of activities. *All participants will complete a survey asking questions on their implementation experience. *Teacher lesson plans will be collected and evaluated based on the qualities of PBL and adherence to the NSSM. These lessons will be observed by a trained evaluator. *Mid project- October 2015 *End of Project- January 2016 P2: What is the quality of the initial program activities? *Survey *Observation *Participants and project administrators will receive an exit survey on their view of the quality workshop and additional activities. *During and immediately following initial program activities
  • 3.
    *An evaluator willbe present to observe and evaluate the initial program workshop. P3: Who are the program participants and how were they recruited? *Interviews *Questionnaire *Upon finalization of selections Ms. Carla Lawton and the Project Director will be interviewed in person about the procedure with which they chose participants. *A questionnaire will be distributed by email to all eligible teachers and administrators. *Within the first 2 weeks of selection finalization P4: What is the quality of follow up and support activities? *Survey *Focus Group *A focus group will be formed of randomly chosen participants to collect their personal experiences of follow up and support activities. *All participants will complete a survey asking questions about follow up and support activities. *Mid project- October 2015 *End of Project- January 2016 Summative Evaluation The summative evaluation report is represented by 4 objectives within 2 different questions. The first question, “To what extent were teachers able to develop PBL modules that were connected to local business and industries, aligned with NSSM, and incorporated appropriate uses of technology,” is associated with objectives 1,2,3 and the second question, “To what extent were teachers able to implement and evaluate those modules,” is associated with objective #4. The project will begin on the date of June 25th. At this point, the introduction of new standards to the Great Southern faculty and Braxton County teaching staff will be presented and this will lead to the two staffs working through a PBL refinement period which will be the dates of July 2nd through July 20th. During the refinement period, the faculty of Great Southern
  • 4.
    University will helpthe teacher staff from Braxton County to refine their PBL modules using electronic communication. The data that will be observed will come from post and pre-project surveys, student work samples, basic observation rubrics, alignment of standards checklists, and module rubrics. During the fall term of the school year, the Braxton County teachers will implement their modules and meet with the Great Southern faculty for a mid-year implementation meeting. Once the mid-year meeting is completed the Braxton County teachers will have a self-evaluation period. Evaluation Questions Objective Indicator Data Source To what extent were teachers able to develop PBL modules that were connected to local business and industries, aligned with NSSM, and incorporated appropriate uses of technology? Using local business numerical data create a PBL module that would use the given data. Modules refined and uses information from local businesses. *Module Rubric *Pre-Project Survey To what extent were teachers able to develop PBL modules that were connected to local business and industries, aligned with NSSM, and incorporated appropriate uses of technology Using NSSM Standards to align PBL modules. Task and assessment refined and aligned to NSSM standards. *Standards Alignment Checklist
  • 5.
    To what extentwere teachers able to develop PBL modules that were connected to local business and industries, aligned with NSSM, and incorporated appropriate uses of technology Create PBL Modules that align with NSSM standards and integrate these modules into the technology of local businesses Local business aid in using technology effectively during PBL module. *Observation Rubric *Activity Portfolio *Teacher Walkthroughs To what extent were teachers able to implement and evaluate those modules? Self-evaluation of modules implemented during course. Post survey data and walkthroughs to determine the overall use of technology *Post-Project Surveys *Student Work Samples Data Collection Schedule and Summary Data Set Date of Collection Instrument Already Developed? Data Collected By Pre and Post Surveys June 25, 2015 and January 2016 No Great Southern Faculty Observation of Workshop June 29, 2015 No Outside Evaluator Teacher Observation and Self-Evaluation January 2016 Yes Great Southern Faculty and Teachers Focus Group October 2015 No Great Southern Faculty Interviews with Ms. Lawton and Project Director Following selection of participants No Great Southern Faculty Student Work Samples January 2015 Yes Teachers