First Day Shoe Program
Collaboration Between EMR 6420 & EMR 6500
               Final Presentation

        Mike Romano & Mike Joynt
What The Program Does
                            The Four
                            Elements

                          Purchases New Shoes

                      Recruits and Trains Volunteers

                        Sort & Storage of Shoes

                            Shoe Distribution


The first day shoe program seeks to identify students who participate in
the federal school lunch program. Then the identified students are given
    a new pair of shoes on the first day of school. The students are
  monitored as to the effects of the new pair of shoes. Both social /
     academic data is collect and analyzed for program impact and
                              effectiveness.
What the Evaluation Seeks to Answer

   How Efficient is the Program?

   Are All Needy KPS Students Served?

   Are volunteers pleased with the distribution
   process?

    How can the program most effectively
   expand?

   What are teachers perceptions about the
   program?
The Collaborative Process
We were initially assigned to a classroom
behavior / conduct program. Less than a week
before the surveys were due, we were
contacted by Patricia Moore from the
evaluation class and told of the First Day Shoe
Program. We did not ever get a chance to meet
face to face nor get a sense for where they
were in the evaluation process. Patricia emailed
a copy of the evaluation procedure. During our
only phone call, she suggested we write a
survey to support an evaluation question. No
further contact was made or received after
the initial phone call. An email copy of the
surveys were sent out upon completion.
The Purpose of the Survey
The survey was designed to measure
teachers perceptions about the program.

  1. Does it improve attendance?

  2.Does it improve test scores?

  3.Does it improve summer school
    retention?

To compile useful perceptions that may assist
   in drawing some conclusions about how
    efficient the program is run and how
               effective it is.
The Purpose (con’t)
             -In addition-
Observe various methods and approaches to
writing survey questions and applying
associated rating scales.

To learn proper instrumentation techniques
and apply them in a real world setting.

Work collaboratively and provide support for
EMR 6420 evaluation projects.

Learn to identify and resect the intricacies,
organization, nuance and difficulty of well
written survey questions.
Survey Intent


To produce useful data / information that
leads to a strengthening of the program.

To provide accurate teacher observations /
perceptions and help gauge morale.

Provide an outlet for constructive criticism
and potential program improvements to
streamline the process.
How We Contributed
(What did we do...What did we expect to do)
 In this case, a 15 item survey may not be
 thorough enough and may also make it difficult
 to gain great amounts of meaningful
 analyzable data. I am glad we submitted four
 copies to chose from, as some of the questions
 were very recently pointed out as having an
 incomplete or erroneous rating scale. I
 expected to have much more collaboration or
 even interest in our potential contribution. We
 did not feel part of a team or even valued in
 any way. I expected our contribution to effect
 some aspect of the program evaluation. I have
 no way of even knowing as I have received no
 feedback to date.
Improvement Suggestions

Time to learn about the programs

More face to face time in class, maybe
having a short presentation of what they are
doing and what they are looking for before
we pick groups.

Feedback from all stake holders

Clearer understanding of expectations

At least one mandatory, in person meeting

Create more coordinated surveys
Wrapping It All Up
               Lessons Learned
✓ The first lesson that we are coming away with
    is that without communication between the two
      groups, the assignment has less value. I would
    like to have seen more emphasis and practice on
         proper question writing and the various
          modalities for writing good questions.

✓      The biggest lesson we have learned in the
      process is that creating an instrument from
    scratch is a more difficult process than we had
                       anticipated.
Please Ask Questions




        ?
       Thank You!

Emr6500 final presentation

  • 1.
    First Day ShoeProgram Collaboration Between EMR 6420 & EMR 6500 Final Presentation Mike Romano & Mike Joynt
  • 2.
    What The ProgramDoes The Four Elements Purchases New Shoes Recruits and Trains Volunteers Sort & Storage of Shoes Shoe Distribution The first day shoe program seeks to identify students who participate in the federal school lunch program. Then the identified students are given a new pair of shoes on the first day of school. The students are monitored as to the effects of the new pair of shoes. Both social / academic data is collect and analyzed for program impact and effectiveness.
  • 3.
    What the EvaluationSeeks to Answer How Efficient is the Program? Are All Needy KPS Students Served? Are volunteers pleased with the distribution process? How can the program most effectively expand? What are teachers perceptions about the program?
  • 4.
    The Collaborative Process Wewere initially assigned to a classroom behavior / conduct program. Less than a week before the surveys were due, we were contacted by Patricia Moore from the evaluation class and told of the First Day Shoe Program. We did not ever get a chance to meet face to face nor get a sense for where they were in the evaluation process. Patricia emailed a copy of the evaluation procedure. During our only phone call, she suggested we write a survey to support an evaluation question. No further contact was made or received after the initial phone call. An email copy of the surveys were sent out upon completion.
  • 5.
    The Purpose ofthe Survey The survey was designed to measure teachers perceptions about the program. 1. Does it improve attendance? 2.Does it improve test scores? 3.Does it improve summer school retention? To compile useful perceptions that may assist in drawing some conclusions about how efficient the program is run and how effective it is.
  • 6.
    The Purpose (con’t) -In addition- Observe various methods and approaches to writing survey questions and applying associated rating scales. To learn proper instrumentation techniques and apply them in a real world setting. Work collaboratively and provide support for EMR 6420 evaluation projects. Learn to identify and resect the intricacies, organization, nuance and difficulty of well written survey questions.
  • 7.
    Survey Intent To produceuseful data / information that leads to a strengthening of the program. To provide accurate teacher observations / perceptions and help gauge morale. Provide an outlet for constructive criticism and potential program improvements to streamline the process.
  • 8.
    How We Contributed (Whatdid we do...What did we expect to do) In this case, a 15 item survey may not be thorough enough and may also make it difficult to gain great amounts of meaningful analyzable data. I am glad we submitted four copies to chose from, as some of the questions were very recently pointed out as having an incomplete or erroneous rating scale. I expected to have much more collaboration or even interest in our potential contribution. We did not feel part of a team or even valued in any way. I expected our contribution to effect some aspect of the program evaluation. I have no way of even knowing as I have received no feedback to date.
  • 9.
    Improvement Suggestions Time tolearn about the programs More face to face time in class, maybe having a short presentation of what they are doing and what they are looking for before we pick groups. Feedback from all stake holders Clearer understanding of expectations At least one mandatory, in person meeting Create more coordinated surveys
  • 10.
    Wrapping It AllUp Lessons Learned ✓ The first lesson that we are coming away with is that without communication between the two groups, the assignment has less value. I would like to have seen more emphasis and practice on proper question writing and the various modalities for writing good questions. ✓ The biggest lesson we have learned in the process is that creating an instrument from scratch is a more difficult process than we had anticipated.
  • 11.