1. Evaluation Plan for:
New State Standards for Mathematics and Problem-based Learning
A Grant Funded Project
FRIT 7237
Addy Baker
Meagan Harrelson
Victorie Penn
2. Implementation Evaluation
This implementation evaluation is intended to evaluate the implementation project
between Great Southern University and Braxton County Schools. The project intends to prepare
teachers from Braxton County Schools to implement the New State Standards for Mathematics
(NSSM). In order to properly evaluate the project the following questions must be answered: P1:
Were the initial experience and follow up activities implemented as planned? P2: What is the
quality of the initial program activities? P3: Who are the program participants and how were they
recruited? P4: What is the quality of follow up and support activities? These questions will be
answered using a variety of means including focus groups, surveys, interview, observations, and
questionnaires. Using a comprehensive approach will ensure the ability to form a complete idea
of the strengths and weaknesses of the project and highlight areas for improvement.
Implementation
Questions
Data
Collection
Methods
And Sources
Procedures Schedule
P1: Were the initial
experience and
follow up activities
implemented as
planned?
*Focus Group
*Survey
*Observation
with lesson
plan collection
*A focus group will be formed
of randomly chosen participants
to collect their personal
experiences with the
implementation of activities.
*All participants will complete
a survey asking questions on
their implementation
experience.
*Teacher lesson plans will be
collected and evaluated based
on the qualities of PBL and
adherence to the NSSM. These
lessons will be observed by a
trained evaluator.
*Mid project-
October 2015
*End of Project-
January 2016
P2: What is the
quality of the initial
program activities?
*Survey
*Observation
*Participants and project
administrators will receive an
exit survey on their view of the
*During and
immediately
following initial
3. quality workshop and additional
activities.
*An evaluator will be present to
observe and evaluate the initial
program workshop.
program activities
P3: Who are the
program
participants and
how were they
recruited?
*Interviews
*Questionnaire
*Upon finalization
of selections Ms. Carla Lawton
and the Project Director will be
interviewed in person about the
procedure with which they
chose participants.
*A questionnaire will be
distributed by email to all
eligible teachers and
administrators.
*Within the first 2
weeks of selection
finalization
P4: What is the
quality of follow up
and support
activities?
*Survey
*Focus Group
*A focus group will be formed
of randomly chosen participants
to collect their personal
experiences of follow up and
support activities.
*All participants will complete
a survey asking questions about
follow up and support activities.
*Mid project-
October 2015
*End of Project-
January 2016
Summative Evaluation
The summative evaluation report is represented by 4 objectives within 2 different
questions. The first question, “To what extent were teachers able to develop PBL modules that
were connected to local business and industries, aligned with NSSM, and incorporated
appropriate uses of technology,” is associated with objectives 1,2,3 and the second question, “To
what extent were teachers able to implement and evaluate those modules,” is associated with
objective #4.
The project will begin on the date of June 25th. At this point, the introduction of new
standards to the Great Southern faculty and Braxton County teaching staff will be presented and
this will lead to the two staffs working through a PBL refinement period which will be the dates
4. of July 2nd through July 20th. During the refinement period, the faculty of Great Southern
University will help the teacher staff from Braxton County to refine their PBL modules using
electronic communication. The data that will be observed will come from post and pre project
surveys, student work samples, basic observation rubrics, alignment of standards checklists, and
module rubrics.
During the fall term of the school year, the Braxton County teachers will implement their
modules and meet with the Great Southern faculty for a mid-year implementation meeting. Once
the mid-year meeting is completed the Braxton County teachers will have a self-evaluation
period.
Evaluation Questions Objective Indicator Data Source
To what extent were
teachers able to develop
PBL modules that were
connected to local business
and industries, aligned with
NSSM, and incorporated
appropriate uses of
technology?
Using local business
numerical data create a
PBL module that would
use the given data.
Modules refined
and uses
information from
local businesses.
*Module Rubric
*Pre-Project
Survey
To what extent were
teachers able to develop
PBL modules that were
connected to local business
and industries, aligned with
NSSM, and incorporated
appropriate uses of
technology
Using NSSM Standards
to align PBL modules.
Task and
assessment
refined and
aligned to NSSM
standards.
*Standards
Alignment
Checklist
5. To what extent were
teachers able to develop
PBL modules that were
connected to local business
and industries, aligned with
NSSM, and incorporated
appropriate uses of
technology
Create PBL Modules
that align with NSSM
standards and integrate
these modules into the
technology of local
businesses
Local business
aid in using
technology
effectively
during PBL
module.
*Observation
Rubric
*Activity Portfolio
*Teacher
Walkthroughs
To what extent were
teachers able to implement
and evaluate those
modules?
Self-evaluation of
modules implemented
during course.
Post survey data
and
walkthroughs to
determine the
overall use of
technology
*Post-Project
Surveys
*Student Work
Samples
Data Collection Schedule and Summary
Data Set Date of Collection
Instrument
Already
Developed?
Data Collected By
Pre and Post Surveys June 25, 2015 and
January 2016
No Great Southern
Faculty
Observation of Workshop June 29, 2015 No Outside Evaluator
Teacher Observation and
Self-Evaluation
January 2016 Yes Great Southern
Faculty and Teachers
Focus Group October 2015 No Great Southern
Faculty
Interviews with Ms. Lawton
and Project Director
Following selection
of participants
No Great Southern
Faculty
Student Work Samples January 2015 Yes Teachers
