How the Tote Board-Enabling Lives Initiative Grant has shifted from measurement of project output to social outcomes

1. TB-ELI Outcome
Evaluation
Framework &
Toolkitd
September 1st 2016

2. Agenda
• Introduce impact measurement – moving from traditional output
measurement to outcome measurement
• Collective impact model – TB-ELI’s 8 shared outcomes and how each
project can contribute to those outcomes.
• Social outcomes measurement toolkit – brief intro of the prototype
including screenshots

3. How Do We Measure Impact?
TB ELI Projects
Activity
+ve
Social
Impacts
Desired
Outcome

4. Traditionally, many social projects measured
Outputs onlyOutputs onlyOutputs onlyOutputs only but OutcomesOutcomesOutcomesOutcomes can also be measured
Project Activity
• Training
Course for
Care Givers
Outputs
• Number of
Training
Courses Run
• Number of
trainees
• Feedback
Scores on
Trainers
Outcomes
• Improvement
in emotional
wellbeing of
caregiver
• Care giver
feeling
confident in
their ability to
care

5. 8 TB-ELI Shared Outcomes for Projects
1. Persons with disabilities experience increased psychological and emotional well-being.
2. Persons with disabilities improve in their life skills (i.e. independent living skills, functional skills etc.) as
much as their potential allows.
3. Persons with disabilities (or their proxies) are able to make informed decisions and planning via better
support and access to information, programme and product navigation.
4. Persons with disabilities have more opportunities to participate in social, family, economic and
community life.
5. Caregivers experience increased psychological and emotional well-being.
6. Caregivers feel confident of their ability to provide competent care and support to persons with
disabilities.
7. Caregivers have greater access to support services, network and structure that sustain caregiving.
8. Caregivers have more opportunities to participate in social, family, economic and community life.

6. Example OutcomeOutcomeOutcomeOutcome Indicators
Stated Shared Outcome Example Outcome Indicator
Persons with disabilities experience
increased psychological and emotional
well-being.
Improved psychological and emotional state in person with disability
Decreased use of psychological and emotional support by person with disability
Persons with disabilities improve in
their life skills (i.e. independent living
skills, functional skills etc.) as much as
their potential allows.
Increased length of time spent living independently experienced by person with disability
Increased length of free time experienced by caregiver
Decreased use of support by person with disability
Increased length of time spent on a specified "independent living" activity by person with disability
Persons with disabilities (or their
proxies) are able to make informed
decisions and planning via better
support and access to information,
programme and product navigation.
Increased take up of care or support services by person with disability
Increased satisfaction with care or support provision by person with disability
Decreased complaints associated with inappropriate care or support from person with disability
Increased knowledge of available care and support for person with disability
Decreased returns or cancellations of inappropriate care or support services by person with disability
Persons with disabilities have more
opportunities to participate in social,
family, economic and community life.
Increased length of time engaged in social, family, economic and community life activities by person with
disability
Increased length of time spent working by person with disability
Decreased length of time spent alone by person with disability

7. Example OutcomeOutcomeOutcomeOutcome Indicators
Stated Shared Outcome Outcome Indicator
Caregivers experience increased
psychological and emotional well-being.
Improved psychological and emotional state in caregiver
Decreased use of psychological and emotional support by caregiver
Caregivers feel confident of their ability
to provide competent care and support
to persons with disabilities.
Increased knowledge of available care and support for person with disability
Increased take up of appropriate care or support services for person with disability
Decreased take up of inappropriate care or support services for person with disability
Decreased use of selection support services by caregiver
Caregivers have greater access to
support services, network and structure
that sustain caregiving.
Increased take up of appropriate care or support services for person with disability
Increased knowledge of available care and support for person with disability
Caregivers have more opportunities to
participate in social, family, economic
and community life.
Increased length of time engaged in social, family, economic and community life activities by caregiver
Increased length of time spent working by caregiver
Decreased length of time spent caring by person by caregiver

8. Social Outcomes Measurement – Simple 4 Step
Process
Stage 1:
Preparation
Funding Awarded
Project Team
Completes the
“Preparation Survey”*
“Preparation Survey”
submitted to SG
Enable for review
and approval
“Preparation Survey”
defines the
indicators to be
tracked for the
specific project
Stage 2:
Before
Project Team
executes
“Before Survey”
Stage 3:
During
Project Team
completes the
‘Progress Survey”
“Progress Survey”
tracks Activity
Indicators defined by
the Project Team in
the “Preparation
Survey”
Stage 4:
After
Project Team
completes the “After
Survey” at the
“Impact Horizon”
Project Team
produces “Impact
Case Studies”
Project Team
reports performance
in terms of:
Outcome Indicators,
Activity Indicators,
and Case Study
Additionality
determined using the
baseline established
using the “Before
Survey”

9. Supporting Toolkit & Capability Development

10. Supporting Tool Kit & Capability Development

11. Supporting Toolkit & Capability Development
Toolkit auto-generates a dashboard
of indicators that a project can use
to measure social outcomes

12. Supporting Toolkit & Capability Development
Toolkit will also assist the project in
selecting the most appropriate source of
data to track and measure the indicator. It
will also allow project to track data in the
tool

13. Toolkit Training Course
• Successful Grant recipients will
also attend training sessions at
NUS
• In addition, ad-hoc support will
be made available throughout
• All training sessions are practical,
hands on and focus on using the
toolkit and helping each project