1. First Day Shoe Program
Collaboration Between EMR 6420 & EMR 6500
Final Presentation
Mike Romano & Mike Joynt
2. What The Program Does
The Four
Elements
Purchases New Shoes
Recruits and Trains Volunteers
Sort & Storage of Shoes
Shoe Distribution
The first day shoe program seeks to identify students who participate in
the federal school lunch program. Then the identified students are given
a new pair of shoes on the first day of school. The students are
monitored as to the effects of the new pair of shoes. Both social /
academic data is collect and analyzed for program impact and
effectiveness.
3. What the Evaluation Seeks to Answer
How Efficient is the Program?
Are All Needy KPS Students Served?
Are volunteers pleased with the distribution
process?
How can the program most effectively
expand?
What are teachers perceptions about the
program?
4. The Collaborative Process
We were initially assigned to a classroom
behavior / conduct program. Less than a week
before the surveys were due, we were
contacted by Patricia Moore from the
evaluation class and told of the First Day Shoe
Program. We did not ever get a chance to meet
face to face nor get a sense for where they
were in the evaluation process. Patricia emailed
a copy of the evaluation procedure. During our
only phone call, she suggested we write a
survey to support an evaluation question. No
further contact was made or received after
the initial phone call. An email copy of the
surveys were sent out upon completion.
5. The Purpose of the Survey
The survey was designed to measure
teachers perceptions about the program.
1. Does it improve attendance?
2.Does it improve test scores?
3.Does it improve summer school
retention?
To compile useful perceptions that may assist
in drawing some conclusions about how
efficient the program is run and how
effective it is.
6. The Purpose (con’t)
-In addition-
Observe various methods and approaches to
writing survey questions and applying
associated rating scales.
To learn proper instrumentation techniques
and apply them in a real world setting.
Work collaboratively and provide support for
EMR 6420 evaluation projects.
Learn to identify and resect the intricacies,
organization, nuance and difficulty of well
written survey questions.
7. Survey Intent
To produce useful data / information that
leads to a strengthening of the program.
To provide accurate teacher observations /
perceptions and help gauge morale.
Provide an outlet for constructive criticism
and potential program improvements to
streamline the process.
8. How We Contributed
(What did we do...What did we expect to do)
In this case, a 15 item survey may not be
thorough enough and may also make it difficult
to gain great amounts of meaningful
analyzable data. I am glad we submitted four
copies to chose from, as some of the questions
were very recently pointed out as having an
incomplete or erroneous rating scale. I
expected to have much more collaboration or
even interest in our potential contribution. We
did not feel part of a team or even valued in
any way. I expected our contribution to effect
some aspect of the program evaluation. I have
no way of even knowing as I have received no
feedback to date.
9. Improvement Suggestions
Time to learn about the programs
More face to face time in class, maybe
having a short presentation of what they are
doing and what they are looking for before
we pick groups.
Feedback from all stake holders
Clearer understanding of expectations
At least one mandatory, in person meeting
Create more coordinated surveys
10. Wrapping It All Up
Lessons Learned
✓ The first lesson that we are coming away with
is that without communication between the two
groups, the assignment has less value. I would
like to have seen more emphasis and practice on
proper question writing and the various
modalities for writing good questions.
✓ The biggest lesson we have learned in the
process is that creating an instrument from
scratch is a more difficult process than we had
anticipated.
