This document summarizes a webinar on program evaluation. It provides instructions for participants, including noting that the webinar will be recorded. It outlines that the webinar will cover logic models, outcome evaluation, indicators, measures and toolkits. It will also provide a case example from the Visions of Science Network for Learning. Participants are polled on what areas they are most interested in learning about. The webinar then goes into further detail on each of the outlined topics, providing examples and tips for developing logic models, indicators, and outcome measures for programs.

1. vv

2. THINGSTO KEEP IN MIND
• This webinar will be recorded and available on
our website along with the presentation slides
and other resources about the topic
• If you have trouble with the audio quality,
please try calling in with a phone
• Please be sure to fill out the evaluation that will
be sent to you following the webinar

5. Copyright
Lions
Quest
Canada
2014
@ CERPYD
Lakehead University

7. Poll #1
What you most interested in learning about today?
a) Logic models
b) Indicators
c) Outcome measures

8. GUEST PRESENTERS
Jessica Noble
Central Hub Manager
YouthREX
York University
Corliss Bean
Research and Evaluation Specialist
YouthREX
York University
Eugenia Duodu
Visions of Science Network
of Learning

9. Outline
1. Logic Models
• Template available
2. OutcomeEvaluation
3. Indicators
4. Measures & Toolkit
5. CES Example

10. Why Evaluate?
• Supports program and strategic
planning
• Helps communicate your program
goals and progress
• Serves as a basis for ongoing learning
to make your program more effective

11. What is a Logic Model?
“… a picture of how your program works –
the theory and assumptions underlying the
program. This model provides a road map of
your program, highlighting how it is expected
to work, what activities need to come before
others, and how desired outcomes are
achieved.”
- W.K. Kellogg Foundation Evaluation Handbook, 1998

12. Poll # 2
Have you created a logic model for your program?
qYES
qNO

13. Logic Models
• Summarize the key elements of your program
• Explain the rationale behind program activities
• Describe the link between activities and outcomes
• Provide an opportunity for stakeholders to discuss the
program and agree on its description and intended results
• Serve as a useful communication tool to describe your
program to others

15. Logic Model Template Available

16. Quick Tips Before We Begin:
Tip #1- When beginning to create your logic model you may want to consider-
What stakeholders should I involve?
• Stakeholders might include program staff, program clients, funders,
community representatives, and volunteers
• Their perspectives can enrich your program logic model by clarifying
expectations for the program.
Tip #2- Logic models take time!
• It is important to gather the feedback of your programs key stakeholders
• Take time to create, review, and revise your logic model

17. Logic Model Template Available

18. Elements of Logic Models
Resources/
Inputs
Activities Participation Outcomes Impact
Outputs Intended Outcomes

19. Who participates in
these activities?

20. What are the
outcomes and long
term impacts
associated with
these activities?

21. Create, Review, Revise, Update!
ü Does your organization have adequate resourcesto implementthe
activitiesand achieve the desired outcomes?
ü Have you included all the major activitiesneeded to implementyour
program and achieve expected outcomes?
ü Would the activitieslist enable someone who is unfamiliar with your
program to understand its scope?
ü Have you expressed your outcomesin terms of change?
ü Have you identified who/what will experience that change, and over
what time period?
ü Have you considered a variety of perspectives?

22. Linking Logic Model to
Outcome Evaluations

23. What is Outcome Evaluation?
• Helps assess a program’s
effectiveness at achieving its
intended outcomes

24. Next steps: Moving from outcomes to
indicators to measurement
• How do I measure the outcomes in my logic model?
• How do I select appropriate indicators for my expected
outcomes?

25. What is an indicator?
• Observable and measurable
“milestones” of the intended
outcome
– What you see, hear, read, etc.,
that indicates whether you're
making progress toward your
outcome target
Outcomes
Measures
Indicators

26. Examples of Indicators
Outcome Indicator Measure
Engagement in
School
Increased school
attendance
• Number of full days one has
attended school for year/month
• Change in number of full days
attended school over time
Increased
homework
completion
• Frequency of on-time
homework completion
Improved Academic
Performance
Increased test
scores
• In-class test scores
• Standardized test scores
Improved grades • Test grades
• Report card

27. Get SMART
• Quantitative indicators should be SMART:
–Specific
–Measurable
–Attainable
–Relevant
–Timely

28. Qualitative Model
SPICED
–Subjective
–Participatory
–Interpreted and Communicable
–Cross-checked and Compared
–Empowered
–Diverse and Disaggregated

29. YouthREX Inventory of Measures
• Developed based on the Stepping Up 7 themes and 20
outcomes to foster well-being in youth
• WWW.YOUTHREX.COM/MEASURES

30. CES CASE EXAMPLE:
Visions of Science Network
for Learning

35. Lessons Learned
Measure selection
o Program Involvement
o Ongoing collaboration with frontline staff
o Relevant to youth
Transparency
o Accountable to youth
Critical of your own organization
o How do you know your program is working?
Ongoing reflection
o Program Improvement based on youth voice

36. Questions?

37. Join Us!
Thursday AUGUST 18
11:00am – 12:00pm
Ask Us Anything About
Program Evaluation
Thursday SEPTEMBER 1
12:00pm – 1:00pm
Supporting trans youth
wellbeing