Via Evaluation's Jessica Weitzel and Caroline Taggart give you the tools and techniques for maximizing the usefulness of data that most organizations already collect, or could easily begin to collect. More information: viaevaluation.com

1. Make Your Data
Work for You

3. I. WHY do we measure?
III. WHICH data do we collect?
IV. Q&A and Discussion
II. WHAT do we measure?
a. The Logic Model in theory…
b. and in practice
IV. HOW can we collect data?
V. HOW can we share our results?

4. Why do we
measure?

5. Prove that you are
making a difference!

6. 1. More Funding

7. 2. Participant Impact

9. What do we measure?

10. BIG Goals

12. What do we do?
What results do we expect?

13. Theory of Change/
Logic Model

15. Inputs Activities Outputs Outcomes Impact

16. Inputs Activities Outputs Outcomes Impact
What do we need to
implement the program?
Funding
Space
Curricula
Training
Participants
Staff

17. Inputs Activities Outputs Outcomes Impact
What activities need to be
offered to help us achieve
our intended results?
Tutoring
Curricula
Find Homes
Distribute Food
Provide Counseling
Education

18. Inputs Activities Outputs Outcomes Impact
How will we know that our
activities happened?
# of Hours
# of Participants
# Distributed
# Housed
# of Counseling
# Completed
# Contacted

19. Inputs Activities Outputs Outcomes Impact
What results do we expect?
Change in Knowledge
Change in Skills
Change in Attitude
Change in Behaviors

20. Inputs Activities Outputs Outcomes Impact
What do we ultimately
want to change?
Conditions in Life, such as:
Graduation
College Entry
Stable Housing
Earnings
Obesity

21. Inputs Activities Outputs Outcomes Impact

22. Based on Needs and Goals

23. My Goal: Healthy Heart

25. Inputs Activities Outputs Outcomes Impact
Eat less
fat
Vigorous
Physical
activity
Lose
Weight
Lower
LDL
Healthy
Heart
# meals
low sat.
fat
# mins
vig.
activity
/wk
Healthy
Recipes
Sneakers
Gym
Member
ship

26. How do we know if we’re
on track?

27. Inputs Activities Outputs Outcomes Impact
Program
Monitoring

28. The systematic and
continual documentation
of key aspects of a program
in order to assess whether
the program is being
implemented as intended.
Program Monitoring
Quality
Improvement
Process
Monitoring
Fidelity of
Implementation
Performance
Management
Process
Evaluation

29. Inputs Activities Outputs Outcomes Impact
Eat less
fat
Lose
Weight
Lower
LDL
Healthy
Heart
# meals
low sat.
fat
# mins
vig.
activity
/wk
Healthy
Recipes
Sneakers
Gym
Member
ship
Vigorous
Physical
Activity

30. How do we know if we
achieved our results?

31. Inputs Activities Outputs Outcomes Impact
Program
Evaluation

32. The systematic method
for collecting, analyzing,
and using information to
answer questions about a
program’s effectiveness.
Program Evaluation
Program
Outcomes
Impact
Evaluation
Outcome
Evaluation

33. Inputs Activities Outputs Outcomes Impact
Eat less
fat
Vigorous
Physical
Activity
Lose
Weight
Lower
LDL
Healthy
Heart
# meals
low sat.
fat
# mins
vig.
activity
/wk
Healthy
Recipes
Gym
Member
ship
Sneakers

34. Putting it Together

35. Inputs Activities Outputs Outcomes Impact
Eat less
fat
Vigorous
Physical
Activity
Lose
Weight
Lower
LDL
Healthy
Heart
# meals w/
low sat. fat
# mins vig.
activity/wk
Healthy
Recipes
Sneakers
Gym
Member
ship
= -1 lb
15 wks >
90 min.
(29%)
= 300
(27%)

36. Inputs Activities Outputs Outcomes Impact
Eat less
fat
Vigorous
Physical
Activity
Lose
Weight
Lower
LDL
Healthy
Heart
Healthy
Recipes
Sneakers
Gym
Member
ship
# mins vig.
activity/wk
42 wks >
90 min.
(81%)
# meals w/
low sat. fat
= -9 lbs
= 820
(75%)

37. Inputs Activities Outputs Outcomes Impact
Daily
Meds
Lose
Weight
Lower
LDL
Healthy
Heart
# days
with
meds
Meds
Modify Program

38. Which data do we
collect?
Which data should we
collect?

39. Inputs Activities Outputs Outcomes Impact

40. Complex
Simple

41. Inputs Activities Outputs Outcomes Impact
# of Attendees
Hours of Counseling
Hours by Type of Counseling

42. Simple: Attendance

43. Complex: Service Records

44. Inputs Activities Outputs Outcomes Impact
# meals low sat. fat

45. Simple:
Tally
Complex:
Meal Log

46. Inputs Activities Outputs Outcomes Impact
Change in Knowledge
Increase Positive Behaviors

47. Simple: Surveys

48. Complex: Observations

49. Inputs Activities Outputs Outcomes Impact
Lose Weight
Lower LDL

50. Complex: Blood Test
Simple: Weight

51. Inputs Activities Outputs Outcomes Impact
Increased Graduation
Reduced Poverty
Less Teen Pregnancy
Increased Earnings
Reduction in Obesity

52. Simple: Census Data

53. Complex: Participant Data

54. Inputs Activities Outputs Outcomes Impact
Healthy Heart

55. Simple:
Checklist
Complex:
Stress Test

56. So, you’re
convinced…
But how do we
measure?

57. Google is Your Friend

58. …And So is YouTube

59. Attendance

60. Survey Basics

61. Why a survey?
What do you want to know?
Who is your audience?
How will it be administered?

63. Do you think this program
helps you to connect with
adults and be a better
student?

64. How many siblings do you
have?
 1-2
 2-3
 4 or more

65. Did you like the program?
1 2 3 4 5

66. Did you like the program?
1 2 3 4 5
Are you a hapy person?
Strongly Disagree disagree agree Strongly Agree
Is this your favorite place to be all the time or do you like being with
your parents instead?
Yes No
Did you like the snacks?
Yes No
Did you have fun when you were here and talking to your friends?
Strongly Disagree disagree agree Strongly Agree
Did you like the snacks?
Yes No
And on and on for 10 pages…

70. Reporting (and collecting) data:
Who is your audience?
Will they read it?
Will they understand it?
How will they use it?

71. Easy to Understand? (BEFORE)

72. Color, Tables, Stick to Key Info

73. Provide Summaries

74. Create Summary Sheets

75. Individualize Reports

76. Reduce Clutter/Increase Visuals

77. Consider Infographics

78. Consider Infographics

79. Use Dashboards

80. Inputs Activities Outputs Outcomes Impact

82. Q & A

83. Jessica Aungst Weitzel, MPH
jessica@viaeval.com
@usefuleval
viaevaluation.com
@viaevaluation
Caroline Taggart, MPH
caroline@viaeval.com