2016 cause conference farron levy practical techniques for measuring social impact

1. Practical Techniques for Impact Measurement
May 19, 2016
Susan Pollara
617.305.7501
spollara@trueimpact.com
Farron Levy
flevy@trueimpact.com
617.903.0210

2. © True Impact LLC - 2
Agenda
9:20 – 10:00
Introduction & Overview
Principles of Impact Measurement:
- What to measure
- How to measure
- When to measure
- How much to claim
Q & A
10:15 – 10:30 Break
10:30 – 11:00 Workshopping: Applying Principles
11:00 – 12:00 Reporting Out / Discussion

3. © True Impact LLC - 3
About Us – Measurement Experience
 Education, Income, Health
 Civic Engagement
(100+ companies)
 Health impacts of clinical
research
 Safe water access
 $100MM early childhood
education
 Envt’l Innovation Grants,
Diversity, Green Teams
 EarthSmart Outreach
(global CO2 reduction)
 Global Health Fellows
 College access, arts &
culture, etc.
 Global volunteerism
 US portfolio & $100MM
pro bono program
 Full $60MM corporate
philanthropic portfolio
 Domestic violence, teen
safe driving, etc.
 Nutrition, Military, Pub
Broadcasting; Partners
 $13MM Literacy Portfolio
 Civics, arts, environment,
STEM education
 Youth financial education  Youth internet safety

4. © True Impact LLC - 4
Measurement is a Means to an End
Prove Value
→ Validate success
→ Build/retain support among
internal/external stakeholders
→ If they’re not asking now –
they will be soon
Improve Value
→ Identify what’s working (replicate)
and what’s not (intervene)
→ Steer investment to highest social
ROI interventions

5. © True Impact LLC - 5
1. What to measure
2. How to measure
3. When to measure
4. How much to claim
Overview
Principles of Practical Measurement

6. © True Impact LLC - 6
What to Measure: Can Measure ≠ Should Measure
INPUTS OUTPUTS OUTCOMES
Resources invested
(time, materials, cash)
Services delivered
(and to whom)
Resulting improvement in
targeted social condition
(e.g., literacy, hunger, homelessness)

7. © True Impact LLC - 7
What to Measure: Can Measure ≠ Should Measure
INPUTS OUTPUTS OUTCOMES
Resources invested
(time, materials, cash)
Services delivered
(and to whom)
Resulting improvement in
targeted social condition
(e.g., literacy, hunger, homelessness)

8. © True Impact LLC - 8
What to Measure: Can Measure ≠ Should Measure
INPUTS OUTPUTS OUTCOMES
Resources invested
(time, materials, cash)
Services delivered
(and to whom)
Resulting improvement in
targeted social condition
(e.g., literacy, hunger, homelessness)
Manager Focus
“Investor” Focus:
Social Impact
(End Outcome)

9. © True Impact LLC - 9
What to Measure: Core Investor Metrics
1. Social Impact. How much are we solving the
social problem we care about? (End Outcome)
– X inner-city adults gain living-wage employment
– X low-income children attain healthy weight
2. (Contextual) Cost Per Outcome. How efficiently are
we creating that social value?
– Option A: $300 = 1 child gains reading proficiency
– Option B: $200 = 1 child gains reading proficiency

10. © True Impact LLC - 10
What to Measure: Core Investor Metrics
1. Social Impact. How much are we solving the
social problem we care about? (End Outcome)
– X inner-city adults gain living-wage employment
– X low-income children attain healthy weight
o Types of services
delivered to whom
o Resulting changes in
skills, knowledge,
resources, attitudes
o Resulting change
in behavior
o Resulting state
of being
Reach Preparation Mobilization
Condition
(Social Impact)
Outcomes
Interim Outcomes End Outcome
Capacity

11. © True Impact LLC - 11
What to Measure: Core Investor Metrics
1. Social Impact. How much are we solving the
social problem we care about? (End Outcome)
– X inner-city adults gain living-wage employment
– X low-income children attain healthy weight
o Types of services
delivered to whom
o Resulting changes in
skills, knowledge,
resources, attitudes
o Resulting change
in behavior
o Resulting state
of being
− Receive career
training, mentoring
− Gain industry-specific
skills; interview tactics
− Actively job hunting;
secure offer
− Gain living-wage
employment
− Participate in healthy
eating workshop
− Gain food preparation
skills; health insights
− Eating healthy − Improve health
(e.g., reduce BMI)
Reach Preparation Mobilization
Condition
(Social Impact)
Outcomes
Interim Outcomes End Outcome
Capacity

12. © True Impact LLC - 12
What to Measure: Core Investor Metrics
1. Social Impact. How much are we solving the
social problem we care about? (End Outcome)
– X inner-city adults gain living-wage employment
– X low-income children attain healthy weight
2. (Contextual) Cost Per Outcome. How efficiently are
we creating that social value?
– Option A: $1,500 = 1 adult gains employment
– Option B: $1,200 = 1 adult gains employment

13. © True Impact LLC - 13
What to Measure: Core Investor Metrics
Equivalent? Account for differences
in cost, difficulty, priorities, etc.
1. Social Impact. How much are we solving the
social problem we care about? (End Outcome)
– X inner-city adults gain living-wage employment
– X low-income children attain healthy weight
2. (Contextual) Cost Per Outcome. How efficiently are
we creating that social value?
– Option A: $1,500 = 1 adult gains employment
– Option B: $1,200 = 1 adult gains employment

14. © True Impact LLC - 14
How to Measure: Ideal ≠ Practical

15. © True Impact LLC - 15
How to Measure: Best Available Data
Reach Preparation Mobilization Condition
100 people
trained
?? people
learned skills
?? people
changed behavior
?? people
achieved success
Data Sources & Assumptions
Tracking
− Randomized controlled trial
(scientific confirmation)
− Compare program
participants with similar
population not receiving
services
− Systematic outcome
tracking
Estimation
− Sampling, piloting
− Previous results
− External studies
Speculation
− Logical assumptions

16. © True Impact LLC - 16
How to Measure: Best Available Data
Reach Preparation Mobilization Condition
100 people
trained
90 people
learned skills
?? people
changed behavior
?? people
achieved success
Data Sources & Assumptions
Tracking
− Randomized controlled trial
(scientific confirmation)
− Compare program
participants with similar
population not receiving
services
− Systematic outcome
tracking
Estimation
− Sampling, piloting
− Previous results
− External studies
Speculation
− Logical assumptions
90%

17. © True Impact LLC - 17
How to Measure: Best Available Data
Reach Preparation Mobilization Condition
100 people
trained
90 people
learned skills
68 people
changed behavior
51 people
achieved success
Data Sources & Assumptions
Tracking
− Randomized controlled trial
(scientific confirmation)
− Compare program
participants with similar
population not receiving
services
− Systematic outcome
tracking
Estimation
− Sampling, piloting
− Previous results
− External studies
Speculation
− Logical assumptions
90% 75% 75%

18. © True Impact LLC - 18
When to Measure: Later
Your Focus Measurement

19. © True Impact LLC - 19
When to Measure: Now
Integrate into initial planning Avoid foreseeable failures
Embed in existing systems Highest quality data / least effort
Integrate into grant applications
Increase alignment, promote
accountability
The first – and most crucial – measurement step:
forecasting impact (i.e., who, what, how much, when)

20. © True Impact LLC - 20
How much to claim: Contribution vs. Attribution

21. © True Impact LLC - 21
Project
Impact
100 adults gain
employment
Portion
Funded X 75%
Funder’s
Claim
Funded 75 adults to
gain employment
How much to claim: A 3-Tier Claim Structure
Social Impact. How much are we solving the social
problem we care about? (End Outcomes)
– X inner-city adults gain living-wage employment
– X low-income children attain healthy weight
Share. An allocation of a
program’s impact equal
to the portion funded.

22. © True Impact LLC - 22
Project
Impact
100 adults gain
employment
Portion
Funded X 75%
Funder’s
Claim
Funded 75 adults to
gain employment
 Yes
 No
Instrumental to ensuring
program implementation
(a “foundational” investor)?
Enabled 100 adults to
gain employment

How much to claim: A 3-Tier Claim Structure
Social Impact. How much are we solving the social
problem we care about? (End Outcomes)
– X inner-city adults gain living-wage employment
– X low-income children attain healthy weight
Share. An allocation of a
program’s impact equal
to the portion funded.
Program. The total impact
resulting from the program
the funder enabled.

23. © True Impact LLC - 23
Project
Impact
100 adults gain
employment
Portion
Funded X 75%
Funder’s
Claim
Funded 75 adults to
gain employment
 Yes
 No
Instrumental to ensuring
program implementation
(a “foundational” investor)?
Enabled 100 adults to
gain employment
 Yes
 No
Program inspired or enabled
other similar programs?
Catalyzed 1,000 adults to
gain employment
 
Catalyzed. Impacts from
program enabled by a
funder-enabled program.
How much to claim: A 3-Tier Claim Structure
Social Impact. How much are we solving the social
problem we care about? (End Outcomes)
– X inner-city adults gain living-wage employment
– X low-income children attain healthy weight
Share. An allocation of a
program’s impact equal
to the portion funded.
Program. The total impact
resulting from the program
the funder enabled.

24. © True Impact LLC - 24
Program Location Cost
Gain Employment
(# beneficiaries)
$ per
Outcome
Intervention A Locale 1 $75,000 179 $419
Intervention A Locale 2 $75,000 344 $218
Intervention A Locale 3 $100,000 111 $901
Intervention B Locale 4 $20,000 11 $1,818
Intervention C Locale 5 $5,000 57 $88
Intervention C Locale 6 $5,000 55 $91
Grand Total $280,000 757 $370
Social Objective: Helping inner-city adults gain living-wage employment
Proving & Improving Value

25. © True Impact LLC - 25
Program Location Cost
Gain Employment
(# beneficiaries)
$ per
Outcome
Intervention A Locale 1 $75,000 179 $419
Intervention A Locale 2 $75,000 344 $218
Intervention A Locale 3 $100,000 111 $901
Intervention B Locale 4 $20,000 11 $1,818
Intervention C Locale 5 $5,000 57 $88
Intervention C Locale 6 $5,000 55 $91
Grand Total $280,000 757 $370
Social Objective: Helping inner-city adults gain living-wage employment
Proving Value
 We helped 757 people gain
employment
Proving & Improving Value

26. © True Impact LLC - 26
Program Location Cost
Gain Employment
(# beneficiaries)
$ per
Outcome
Intervention A Locale 1 $75,000 179 $419
Intervention A Locale 2 $75,000 344 $218
Intervention A Locale 3 $100,000 111 $901
Intervention B Locale 4 $20,000 11 $1,818
Intervention C Locale 5 $5,000 57 $88
Intervention C Locale 6 $5,000 55 $91
Grand Total $280,000 757 $370
Social Objective: Helping inner-city adults gain living-wage employment
Improving Value
 Intervention A /Locale 2 is 2-4x as
cost effective as the others.
→What best practices can we learn?
Proving Value
 We helped 757 people gain
employment
Proving & Improving Value

27. © True Impact LLC - 27
Program Location Cost
Gain Employment
(# beneficiaries)
$ per
Outcome
Intervention A Locale 1 $75,000 179 $419
Intervention A Locale 2 $75,000 344 $218
Intervention A Locale 3 $100,000 111 $901
Intervention B Locale 4 $20,000 11 $1,818
Intervention C Locale 5 $5,000 57 $88
Intervention C Locale 6 $5,000 55 $91
Grand Total $280,000 757 $370
Social Objective: Helping inner-city adults gain living-wage employment
Improving Value
 Intervention A /Locale 2 is 2-4x as
cost effective as the others.
→What best practices can we learn?
 Intervention C is the most cost-
effective strategy at $88-$91/person.
→Worth additional investment?
Proving Value
 We helped 757 people gain
employment
Proving & Improving Value

28. © True Impact LLC - 28
Measurement Principles
1. What to measure
Investor metrics
(outcome / cost per outcome)
2. How to measure Use best available data
3. When to measure Now
4. How much to claim
3-Tier Structure
(funded, enabled, catalyzed)

29. © True Impact LLC - 29
Measurement Principles
Q & A

30. © True Impact LLC - 30
Workshopping: What to Measure – Core Investor Metrics
1. Social Impact. How much are we solving the
social problem we care about? (End Outcome)
– X inner-city adults gain living-wage employment
– X low-income children attain healthy weight
o Types of services
delivered to whom
o Resulting changes in
skills, knowledge,
resources, attitudes
o Resulting change
in behavior
o Resulting state
of being
− Receive career
training, mentoring
− Gain industry-specific
skills; interview tactics
− Actively job hunting;
secure offer
− Gain living-wage
employment
− Participate in healthy
eating workshop
− Gain food preparation
skills; health insights
− Eating healthy − Improve health
(e.g., reduce BMI)
Reach Preparation Mobilization
Condition
(Social Impact)
Outcomes
Interim Outcomes End Outcome

31. © True Impact LLC - 31
Program:
Types of services
delivered to whom
Resulting change in skills,
knowledge, resources,
and/or attitudes
Resulting change
in behavior
Resulting state
of being
Success Criteria (what to measure)
How to Measure
Reach Preparation Mobilization
Condition
(Social Impact)
Outcomes
Interim Outcomes End Outcome
Capacity

32. © True Impact LLC - 32
Program:
Reach Preparation Mobilization
Condition
(Social Impact)
Outcomes
Interim Outcomes End Outcome
Types of services
delivered to whom
Resulting change in skills,
knowledge, resources,
and/or attitudes
Resulting change
in behavior
Resulting state
of being
Success Criteria
How to Measure
Environment
• Volunteer
engagement
• Education
• Service projects
• Inspired and prepared to
become environmental
steward
• Take environmental action
• Increase patronage of
parks, natural resources
• Evangelize others
• Environmental
improvement
• Increased enjoyment of
parks, natural resources
Civics
• Education
• Service projects
• Inspired and prepared to
become civically engaged
• Take civic action
• Evangelize others
• Social improvement
Arts&
Culture
• Arts Education
• Arts Access
• Learn concepts
(art-related or otherwise)
• Value the arts
• Arts engagement
(as a consumer, patron,
and/or practitioner)
• Enjoyment/fulfillment
• Increased arts support
• Improved education
Education
(STEM,etc.)
• Competitions
• Education
• Service projects
• Training
• Gain skills/confidence
• Awareness/appreciation for
career paths
• Pursue career paths
• Apply for jobs
• Interview better
• Stay in school
• Academic achievement
• Employment (STEM,
other)
Capacity

33. o Funder’s claim
(social impact)
o Profile Content
Individual Program Profiles
Universal Reporting Tool for Social Investments
Investment
Impact Receipt®
Grants + Volunteerism +
In-kind Donation
Donor
Donor
Donor
Donor
Prove Value Improve ROI Save Time
• Quantitative outcomes
• Rollups
• Allocates “claim”
• Translates cash, in-kind
• Benchmarking
• Best practices
identification
• Single report to update
• Automatic reporting
• Integrates with
existing systems
Grantee
Grantee
Grantee
Grantee

34. Thank you!
Farron Levy
flevy@trueimpact.com
617.903.0210