Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Measuring & Compelling                                       Communicating Outcomes                                       ...
Agenda!!   Current Context!!   Is it Worth It? !!   Framework!!   Making it Happen!© 2013 | www.getcollaborative.com	   2
Definitions!!   Outcomes: A measurement of the impact you create as a result    of serving a customer.!!   Other:!        !...
Changing Funding Landscape!!   There is a growing need for funding outside the Federation    system.!!   Evolving donor de...
Which of the following statements best characterizes your outcomesmeasurement efforts to date?!                           ...
Which of the following types of donors have asked you for outcomes reports?!80%60%40%              79%                    ...
Current JCC Outcomes Efforts!                                        (Survey Comments)!!   For most of our programs, parti...
Tracking Programs and OutcomesTracking program and outcome-related data should be the bread-and-butter for nonprofits beca...
Agenda!!   Current Context!!   Is it Worth It? !!   Framework!!   Making it Happen!© 2013 | www.getcollaborative.com	   9
Order of Operations!                                TYPICAL!        RIGHT!                                How?            ...
Two General Reasons!                                                 Set Program                                          ...
Aggregate Funding by Source & Benchmarking Peer Group!                                United Way!   Foundations!        Fe...
Where Does Outcomes Measurement Make Sense? !                                                    Right Program?!          ...
Agenda!!   Current Context!!   Is it Worth It? !!   Framework!!   Making it Happen!© 2013 | www.getcollaborative.com	   14
Two Levels!                                        Overarching!                                        Jewish Impact!     ...
(Survey Comments)!How do you assess effectiveness in community-building?!!   Effectiveness of a JCC in building community ...
Set aside all limitations associated with data, technology and practicality. What wouldbe the most powerful, most compelli...
Agenda!!   Current Context!!   Is it Worth It? !!   Framework!!   Making it Happen!© 2013 | www.getcollaborative.com	   18
Biggest Obstacles! he following section explores these challenges in greater detail.   30%   25%              27%   20%   ...
(Survey Comments)!What is the single biggest obstacle preventing your JCC frommore effectively measuring outcomes?!!   Dec...
Are We Focused on the Right Things?!!“The challenge of managing to outcomes has little to dowith systems, processes, or te...
Implementing Outcomes Measurement!                                        Do: Measure & Adapt!                            ...
Readiness Quiz!                 Board!                Professional Leadership!                  Culture!Does your board ac...
Document Your “Theory of Change”!!   How does the JCC create the desired outcomes? !        !   What are the inputs?!     ...
Theory of Change: Logic Model!INPUTS/RESOURCES                     STRATEGIES/                   OUTPUTS                  ...
Theory of Change: Systems Dynamic Model!© 2013 | www.getcollaborative.com	   26
Developing a Logic Model!!   Great activity for the “Program Committee” of the board.!!   Identify a senior staff champion...
Ongoing Measurement - Technology!!   Identify the technology infrastructure!        !   Standalone system? (e.g. Efforts t...
Regarding the Challenge of Longitudinal Analysis !    Benchmarking: Member Duration!                                      ...
Ongoing Measurement: People & Process!!   Who’s the champion?!!   Train front line staff in gathering data. !!   Train man...
Questions?© 2012 | www.getcollaborative.com
Upcoming SlideShare
Loading in …5
×

Outcomes strategies metros v2

302 views

Published on

Brian Hayden

  • Be the first to comment

  • Be the first to like this

Outcomes strategies metros v2

  1. 1. Measuring & Compelling Communicating Outcomes JCC Association Executive Seminar 2013 Brian Hayden Collaborative Strategies, Inc. © 2013 | www.getcollaborative.com 1
  2. 2. Agenda!!   Current Context!!   Is it Worth It? !!   Framework!!   Making it Happen!© 2013 | www.getcollaborative.com 2
  3. 3. Definitions!!   Outcomes: A measurement of the impact you create as a result of serving a customer.!!   Other:! !   Participation Measures: the number and kinds of people who come to an event! !   Demographic Measures: Age, income, religion of a population! !   …!!   It’s all good, but it’s not all outcomes…!© 2013 | www.getcollaborative.com 3
  4. 4. Changing Funding Landscape!!   There is a growing need for funding outside the Federation system.!!   Evolving donor demands:! !   You want people to give you money because you are good – not because you need it. (Jim Collins: Good to Great in the Social Sector)! !   Funders “will migrate away from organizations with stirring stories alone, toward well-managed organizations that can also demonstrate meaningful, lasting impact.” (Mario Morino: Leap of Reason)!© 2013 | www.getcollaborative.com 4
  5. 5. Which of the following statements best characterizes your outcomesmeasurement efforts to date?! Almost all our programs track outcomes.! 21%! We dont track outcomes in any meaningful way.! 43%! A few of our programs track outcomes.! 36%! N=15!© 2013 | www.getcollaborative.com 5
  6. 6. Which of the following types of donors have asked you for outcomes reports?!80%60%40% 79% 50% 20% 36% 29% 0% 14% Foundation y United Wa ederation 0% F n 0% Corporatio jor donor Ma Board None © 2013 | www.getcollaborative.com 6
  7. 7. Current JCC Outcomes Efforts! (Survey Comments)!!   For most of our programs, participation and financial outcomes are most relevant.!!   Until recently we were required to report on outcomes to United Way as part of the annual funding cycle. Two areas were reviewed each year: Early Childhood and senior services. Outcome measurements focused on pre-school readiness and social skill development for young children and the benefits of social engagement for seniors. !!   1) Acquisition of skills (both physical and emotional). 2) Increased connections, friends, some feeling of community. 3) Increased identification with Jewish experiences. 4) Increased philanthropic support directly related to program experience and satisfaction!!   Ability of senior adults to maintain living independently based on services provided!!   How does the program impact users in their Jewish life---be it meeting Jewish friends, connecting w/Judaism, learning new Jewish rituals.!© 2013 | www.getcollaborative.com 7
  8. 8. Tracking Programs and OutcomesTracking program and outcome-related data should be the bread-and-butter for nonprofits because it’s oneof the best ways to articulate what they are delivering and the extent to which they are delivering on their Other Not-for-Profits!mission. However, fewer than two-thirds of survey respondents said they were measuring information aboutprograms in which their clients or constituents take part, and just half reported tracking information aboutclient or constituent outcomes. 90% Tracking Finding it Useful for Spending or 80% 89% Budgeting Decisions 85% Finding it Useful for Programming 70% Decisions 73% 60% 50% 59% 59% 49% 50% 49% 40% 41% 30% 20% 10% 0% Your financial actuals vs budget Information about what programs Information about outcomes specific clients/constituents take part in of clients/constituentsThe ones who are tracking this information find it useful for making decisions about programs, and most of N=398!them find it useful for budgeting purposes as well.As the focus groups showed, the range of programmatic 8 © 2013 | www.getcollaborative.com data that nonprofits track runs the gamut of
  9. 9. Agenda!!   Current Context!!   Is it Worth It? !!   Framework!!   Making it Happen!© 2013 | www.getcollaborative.com 9
  10. 10. Order of Operations! TYPICAL! RIGHT! How? Why? What? What? Why? How?© 2013 | www.getcollaborative.com 10
  11. 11. Two General Reasons! Set Program Strategy! Attract 
 Funders!© 2013 | www.getcollaborative.com 11
  12. 12. Aggregate Funding by Source & Benchmarking Peer Group! United Way! Foundations! Federation!14%!12%!10%!8%!6%!4%!2%!0%! Small! Medium! Large! Very Large! © 2013 | www.getcollaborative.com 12
  13. 13. Where Does Outcomes Measurement Make Sense? ! Right Program?! No ! ! ! ! !Yes! !Yes! Right Funders?! No ! ! ! !© 2013 | www.getcollaborative.com 13
  14. 14. Agenda!!   Current Context!!   Is it Worth It? !!   Framework!!   Making it Happen!© 2013 | www.getcollaborative.com 14
  15. 15. Two Levels! Overarching! Jewish Impact! Functional! Early Childhood, Wellness, Senior Programs, etc.!© 2013 | www.getcollaborative.com 15
  16. 16. (Survey Comments)!How do you assess effectiveness in community-building?!!   Effectiveness of a JCC in building community should be assessed based on its reach across the community and connection to different and diverse constituent groups. Its ability to connect with and engage individuals and groups that affiliate with the organizations of the Jewish community as well as with unaffiliated segments of the community.!!   I am no longer sure what "building Jewish community" actually means. The question should be whether we effectively build connection to a variety of communities, and how does that help people live the kind of lives they aspire to live.!!   Talking to users, gauging interactions with other users and staff, measuring attendance, turnout at events. Tracking the buzz on webpages.!!   We are effective when we engage an ever increasing number of diverse participants through multiple touchpoints over time such that they feel more connected to each other, Israel and the broader community because of their participation in our programs.!!   Our language is changing. We are not looking to build Jewish community as much as we are embarking on a mission which enables life to flourish utilizing Jewish tradition, values and modalities.!© 2013 | www.getcollaborative.com 16
  17. 17. Set aside all limitations associated with data, technology and practicality. What wouldbe the most powerful, most compelling outcome you would like to track at the JCC?! “Dream Measure”! !   How have we enriched your life and meaningfully connected you to Judaism?! !   The depth of member engagement within the JCC. JCCA Benchmarking gets at some of this when looking at the number of touch points that members have throughout the organization…! !   How ones choice to participate in a program at the JCC, that is in some way informed by "Jewish," led directly to an improved, happier, better life as defined on ones own terms. I want everyone to say, " my life is definitely better because I go to the JCC and the JCCs approach to Jewish has certainly been a part of that.”! !   1) That our members feel a stronger connection to being Jewish 2) better health 3) a greater feeling of well being! !   The impact our programs have on individuals and families in how they live meaningful Jewish lives.! © 2013 | www.getcollaborative.com 17
  18. 18. Agenda!!   Current Context!!   Is it Worth It? !!   Framework!!   Making it Happen!© 2013 | www.getcollaborative.com 18
  19. 19. Biggest Obstacles! he following section explores these challenges in greater detail. 30% 25% 27% 20% 24% 23% 22% 15% 10% 5% 6% 0% Data Expertise Technology Prioritization and Money Collection/Quality TimeData Collection he ability to collect and work with data is a barrier reported by many nonprofits. In the course of the 19 urvey,©we asked specific questions about organizations’ abilities to collect data on programs and on 2013 | www.getcollaborative.com
  20. 20. (Survey Comments)!What is the single biggest obstacle preventing your JCC frommore effectively measuring outcomes?!!   Deciding how to survey. Do we do each and every program, as our federation requests creating overkill, or do we survey a family for the individual feedback.!!   We do not have the expertise available to adequately frame up an outcomes measurement paradigm!!   Hard to get a common definition to measure. Hard to track longitudinally.!!   The ability to collect and analyze meaningful data.!!   Discipline and training!!   Culture!!   The level of human, financial and time resources necessary to effectively track pre and post outcome behavior is literally incapacitating!!   Time to establish quantifiable and measurable performance goals with defined outcomes and the time to gather necessary information to measure and assess performance impact based on real time results.!!   N/A - we do measure. Very time consuming and labor intensive but well worth it.!© 2013 | www.getcollaborative.com 20
  21. 21. Are We Focused on the Right Things?!!“The challenge of managing to outcomes has little to dowith systems, processes, or technology. The realchallenge is that organizations cannot hope to manageto outcomes unless they have in place an engagedboard; leadership with conviction; clarity of purpose;and a supportive performance culture.”!! -- Mario Morino: Leap of Reason: Managing to Outcomes In an Era of Scarcity !© 2013 | www.getcollaborative.com 21
  22. 22. Implementing Outcomes Measurement! Do: Measure & Adapt! Plan: Theory of Change! Foundation! Board! Executive! Culture!© 2013 | www.getcollaborative.com 22
  23. 23. Readiness Quiz! Board! Professional Leadership! Culture!Does your board accept Do you have enough people Does your team valueresponsibility for overseeing on your SMT who share a “keeping score”?!the JCC’s quality and commitment to manage to !ensure that what you do outcomes? ! Is the mission more than justbenefits those you serve in ! words to the team? Doesmaterial, measurable, and Are the individuals who the team understand howsustainable ways? ! share a commitment to they contribute to it? ! managing to outcomes the !Does your board know what type who “get things done” Does the team have a track-the organization does to and have the stature within record of openness toproduce positive results, the JCC to influence others? ! change? !how the JCC actually !delivers its services?! !© 2013 | www.getcollaborative.com 23
  24. 24. Document Your “Theory of Change”!!   How does the JCC create the desired outcomes? ! !   What are the inputs?! !   What are the key activities? !© 2013 | www.getcollaborative.com 24
  25. 25. Theory of Change: Logic Model!INPUTS/RESOURCES STRATEGIES/ OUTPUTS OUTCOMES IMPACTPEOPLE: ACTIVITIES For all children•  Board of Directors Vol. Recruitment # of volunteers Short term: Abused,•  Staff Vol. Screening (2010 goal = X50) •  100% of children CASA neglected•  Qualified Volunteers (assessment) serves are free from children have a•  Children & Families Vol. Training # of children served abuse while in FC safe andORGANIZATION: (2010 goal = X15) •  100% of children lived permanent Pre-service &•  NCASA with siblings (unless home•  MOCASA Continuing Education Units of service: detrimental) while in FC•  Children’s Division Case Assignment •  Volunteer hours •  95% of children in FC•  Family Court Vol. Support & •  Face to face visits received services toSUPPORT: Supervision •  Court report grow and develop as•  United Way (vol. management, (submission) court ordered•  Deaconess coaching, referrals) •  Recommendations •  95% of children in FC Foundation Individual Advocacy Plan accepted by visited their parents as•  Donor Staff Development (team hearing officer court orderedOTHER: meetings, case Long term:•  Time consultation with group, 70% of children will be•  Facilities prof. development) placed in a permanent•  Equipment (Court hearings, FST’s, home within 18 months ofSupplies monthly visit to child, etc.) CASA appointment © 2013 | www.getcollaborative.com 25
  26. 26. Theory of Change: Systems Dynamic Model!© 2013 | www.getcollaborative.com 26
  27. 27. Developing a Logic Model!!   Great activity for the “Program Committee” of the board.!!   Identify a senior staff champion. !!   Work backwards.!!   Get lots of input (think workshops with those interacting with users)!!   Consider outside help (a program evaluator or graduate students from a local university).!!   What indicators suggest the JCC is on the right track? !!© 2013 | www.getcollaborative.com 27
  28. 28. Ongoing Measurement - Technology!!   Identify the technology infrastructure! !   Standalone system? (e.g. Efforts to Outcomes, Apricot, etc.)! !   Adapt an existing system?!!   How will you keep score?! !   Surveys! !   Standardized tests! !   …!© 2013 | www.getcollaborative.com 28
  29. 29. Regarding the Challenge of Longitudinal Analysis ! Benchmarking: Member Duration! Participant Duration! (N=22,883)! (N=3,612)! <1 year! 10+ years! 10+ years! <1 year! 17%! 27%! 21%! 20%! 1-2 years! 13%! 6-10 years! 12%! 1-2 years! 6-10 years! 2-5 years! 19%! 15%! 2-5 years! 28%! 28%!© 2013 | www.getcollaborative.com 29
  30. 30. Ongoing Measurement: People & Process!!   Who’s the champion?!!   Train front line staff in gathering data. !!   Train managers in using data. !!   Expect that the data will be used.!!   Train the board to hold professionals accountable.!© 2013 | www.getcollaborative.com 30
  31. 31. Questions?© 2012 | www.getcollaborative.com

×