Outcomes Measurement
Carl Thompson
President
Counting Opinions (SQUIRE) Ltd
What is Outcome-based measurement
Why Outcomes?
Better Services
Aligned with Community
Demonstrate Accountability
Enhance Reputation
Secure Funding
Some Context
Inputs
• Acquire
Activities
• Develop
Outputs
• Deliver
Outcomes
• value for
users
Impacts
• societal
effects
Project Outcome (projectoutcome.org)
How Measured
What’s Next
• https://projectoutcome.org/
• http://publiclibrariesonline.org/2015/09/proj
ect-outcome-helping-libraries-capture-their-
community-impact/
• http://www.yourunitedway.org/outcome-
measurements

Outcomes measurement

Editor's Notes

  • #3 Are NOT internally focused -- it is about the user and the outcomes they realize and the impacts on users collectively so need to measure the outcomes of users/customers means you need to either ask them, observe them or have relevant results data about them although an ancillary aspect of measuring service-based outcomes is program evaluation it is not the primary objective, just a valuable component of a continuous improvement both in terms of service delivery, but also in terms of better quality/more user Outcomes
  • #4 Plan/Manage/Evaluate Services aligned to the goals and objectives of the community you serve Assess the Effectiveness outcomes and impacts of delivered services Need to measure Outcomes for several reasons meet the objectives of Stakeholders Continuous Improvement / Learning-based-organization to demonstrate Value (not JUST demonstrating what you are doing and how often) Ensure a foundation for Advocacy in an increasingly challenging funding environment that is increasingly looking for evidence -- more often in the form of measured outcomes Dare I say it -- an effective way to demonstrate Competency / Due Diligence of the organization and build trust with stakeholders and especially funders
  • #5 Logic Model - extending traditional Input, Activity and Output measures (used to measure and compare efficiencies) Outcomes are used to measure effectiveness across multiple levels -- Individual, Group, Community and beyond At the broader and typically longer term Community/Societal levels we refer to these as Impacts -- the consequence of achieving long-term and cumulative outcomes Projectoutcome.org currently provides tools for measurement at the individual level
  • #6 Originating as a PLA project during Carolyn Anthony's tenure as president of PLA, a Performance Measures Task Force was assembled to address the lack of standardized outcome measures for PL's With the support of the PMTF and the Gates Foundation, Project Outcome.org was born with a mandate to provide PLs with standardized outcomes measures and resources to assist with everything from understanding WHAT Outcomes are, WHY they are important, HOW/WHEN to CAPTURE and USE them So far, projectoutcome.org has been used to some extent by about 100 PLs
  • #7 Projectoutcome.org measures are focused on capturing results from attendees at programs provided by libraries This currently involves asking attendees to provide their feedback upon conclusion of the program Their feedback follows a standardized and structured feedback form that can be delivered online, on paper and/or via an interview with attendees Results captured offline are entered and tabulated so that they then can be analyzed across programs, organizations and eventually longitudinally
  • #8 Projectoutcome.org measures are focused on capturing results from attendees at programs provided by libraries The results include measurements of changes in awareness, knowledge, intention – leading to eventual change in behaviour and/or status This currently involves asking attendees to provide their feedback upon conclusion of the program Their feedback follows a standardized and structured feedback form that can be delivered online, on paper and/or via an interview with attendees Results captured offline are entered and tabulated so that they then can be analyzed across programs, organizations and eventually longitudinally
  • #9 Explore the available resources