Coalition Assessment: Approaches for Measuring Capacity and Impact
Innovation Network
by Veena Pankaj, Kat Athanasiades, and Ann Emery
February 2014
Download the paper here: www.innonet.org/research
Why assess coalition capacity? How should a coalition be assessed? How can coalition assessment data be analyzed and used?
Coalitions are an important tool in the advocacy and policy change toolbox. They can be used to promote an issue, increase visibility, and eventually propel an issue to the forefront of a political or social agenda. They can provide a lot of horsepower—harnessing the combined power and expertise of many entities all at once. And they are a valuable technique for crafting more durable solutions generated by a broad constituency. For all of these reasons, developing and strengthening coalitions is a common strategy among advocates and advocacy funders.
For evaluators, coalition assessment is a growing field of experimentation and learning. Innovation Network has been evaluating coalitions since 2006, beginning with the Coalition for Comprehensive Immigration Reform, a national effort to secure passage by the U.S. Congress for comprehensive immigration reform. Over the years, we have evaluated many different types of coalitions throughout the United States. Our coalition partners have worked at national, state, regional, and local levels on a variety of advocacy and policy change goals, such as healthy community design or childhood nutrition. This white paper provides practitioners and funders with insights into the coalition assessment process along with concrete examples and lessons we’ve learned from our own work.
Innovation Network's own workbook on evaluation planning. Can be used alone or in conjunction with the Evaluation Plan Builder at the Point K Learning Center.
Innovation Network's Veena Pankaj and ORS Impact's Mel Howlett share dataviz products that can be used throughout the evaluation lifecycle, including theory of change, social network analysis, data placemat, strategic debrief deck, H-form, visual report deck, visual executive summary, and timeline.
CSU Extension, Engagement and the Logic modelSteven Newman
Presentation delivered to graduate class Principles of Extension.
Much of the material generated in this lecture were from the extension, logic model, scholarship of engagement were taken from the University of Wisconsin-Extension, Program Development and Evaluation program.
http://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html
Innovation Network's own workbook on evaluation planning. Can be used alone or in conjunction with the Evaluation Plan Builder at the Point K Learning Center.
Innovation Network's Veena Pankaj and ORS Impact's Mel Howlett share dataviz products that can be used throughout the evaluation lifecycle, including theory of change, social network analysis, data placemat, strategic debrief deck, H-form, visual report deck, visual executive summary, and timeline.
CSU Extension, Engagement and the Logic modelSteven Newman
Presentation delivered to graduate class Principles of Extension.
Much of the material generated in this lecture were from the extension, logic model, scholarship of engagement were taken from the University of Wisconsin-Extension, Program Development and Evaluation program.
http://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html
Federal, state, provincial and foundation grant applications in both the United States and Canada are increasingly requiring the use of logic models in their grant applications. Depending on the level of complexity required, these can prove a major stumbling block, especially with looming deadlines. The purpose of this seminar is to unlock the mystery surrounding their development and use. At the conclusion, we will not promise that you will like them any better, just understand them and fear them less.
2. grantseeking creating a program logic modelRebecca White
Grants for beginners. Module 2 of grant seeking series. Covers how to develop a program logic model for grant development. Basic program logic models include highlighting the situation and priorities; development of overall program goal; determining program outcomes, outputs and inputs; identifying any assumptions and external factors that are in play; and developing an program evaluation plan.
Program Planning Workshop with Mr. Caloy DiñoMights Rasing
Mr. Caloy Diño of FEBC Philippines shares the process of Program Planning and Implementation at the Young Leaders Summit 2014, organized by Young People's Ministries
http://pinoyyouth.org
Lessons from designing and implementing a monitoring strategy for the PRISE research programme. Focussing on monitoring behaviour change results from stakeholder engagement.
Evaluating Communication Programmes, Products and Campaigns: Training workshopGlenn O'Neil
A one day workshop on evaluating communication programmes, products and campaigns. The main steps and methods are covered with real life examples given. This workshop was originally conducted by Glenn O'Neil of Owl RE for Gellis Communications in Brussels in October
A one day workshop on surveys for communicators. Increasingly communicators need the ability to evaluate their activities and know what their audiences think and desire. Being able to design and set-up online surveys is a key tool for communicators for soliciting feedback and interacting with audiences. These slides from the workshop will take participants from the design to the analysis stage. Workshop originally conducted on 14 June 2013 for the Geneva Communicators Network.
An Insight into Internal Cross Functional Stakeholder Engagement. References from Online data & my professional experience of 14 Years in various roles
Federal, state, provincial and foundation grant applications in both the United States and Canada are increasingly requiring the use of logic models in their grant applications. Depending on the level of complexity required, these can prove a major stumbling block, especially with looming deadlines. The purpose of this seminar is to unlock the mystery surrounding their development and use. At the conclusion, we will not promise that you will like them any better, just understand them and fear them less.
2. grantseeking creating a program logic modelRebecca White
Grants for beginners. Module 2 of grant seeking series. Covers how to develop a program logic model for grant development. Basic program logic models include highlighting the situation and priorities; development of overall program goal; determining program outcomes, outputs and inputs; identifying any assumptions and external factors that are in play; and developing an program evaluation plan.
Program Planning Workshop with Mr. Caloy DiñoMights Rasing
Mr. Caloy Diño of FEBC Philippines shares the process of Program Planning and Implementation at the Young Leaders Summit 2014, organized by Young People's Ministries
http://pinoyyouth.org
Lessons from designing and implementing a monitoring strategy for the PRISE research programme. Focussing on monitoring behaviour change results from stakeholder engagement.
Evaluating Communication Programmes, Products and Campaigns: Training workshopGlenn O'Neil
A one day workshop on evaluating communication programmes, products and campaigns. The main steps and methods are covered with real life examples given. This workshop was originally conducted by Glenn O'Neil of Owl RE for Gellis Communications in Brussels in October
A one day workshop on surveys for communicators. Increasingly communicators need the ability to evaluate their activities and know what their audiences think and desire. Being able to design and set-up online surveys is a key tool for communicators for soliciting feedback and interacting with audiences. These slides from the workshop will take participants from the design to the analysis stage. Workshop originally conducted on 14 June 2013 for the Geneva Communicators Network.
An Insight into Internal Cross Functional Stakeholder Engagement. References from Online data & my professional experience of 14 Years in various roles
Collecting and analyzing data in real time doesn't have to be as stressful or hard as it sounds, especially if you want to collect real time data using surveys. There is a short way and a long way to collect real time survey data. The short way of collecting and analyzing survey data is to use software that has the capability of collecting and analyzing survey data when embedded into powerpoints or webinars. The long way is to use hard copies of surveys to collect data, and Excel to analyze. This document will show you step by step how to collect and analyze survey data the long way.
Assessing the Capacity of Community Coalitions to Advocate for Change (Presen...Innovation Network
Research has shown that high-capacity coalitions are more successful in effecting community change. But what does “high capacity” mean? Evaluators have developed tools to provide an answer, but documentation is scarce regarding how they are implemented, how the results are used, and whether they predict coalition success in collaborative community change efforts. This breakfast talk will focus on a coalition assessment tool designed by Innovation Network to assess changes in coalition capacity over time.
Developed for a health promotion initiative of the Kansas Health Foundation, this tool is designed to assess coalition progress in seven key areas across twelve different community coalitions, over the course of a four-year initiative. The Innovation Network team will share lessons learned from the first year of the initiative about developing and deploying the assessment tool, as well as what these tools can—and can’t—tell us about a coalition’s capacity to conduct community change work. They will also present some data visualization techniques for effectively communicating results back to coalitions.
Organisations are increasingly realising the power of networks to create the greatest impact for society. Working collaboratively with a network of partners can increase your reach, generate efficiencies and stimulate innovation.
Yet, approaches to working in networks vary widely and each approach has a unique set of associated challenges. In our latest Briefing Paper, Aleron brings together the insight of expert practitioners in the field to bring clarity to the complex area of network working in the social sector.
Organisations are increasingly realising the power of networks to create the greatest impact for society. Working collaboratively with a network of partners can increase your reach, generate efficiencies and stimulate innovation.
Yet, approaches to working in networks vary widely and each approach has a unique set of associated challenges. In our latest Briefing Paper, Aleron brings together the insight of expert practitioners in the field to bring clarity to the complex area of network working in the social sector.
Economics Foubndation of Sustaiable Business —Multiple-Stakeholder.docxshandicollingwood
Economics Foubndation of Sustaiable Business
—Multiple-Stakeholder Process
Review the following:
Management at Top Shelf has determined that the company doesn’t need another top-down singularly focused recycling program. Instead, it wants to include a wide spectrum of views and inputs in the development of a sustainability mission and program that the company and the community can believe in.
Attached are
the Top Shelf scenario so far.Part I and Part II
Using the module readings, online library resources, and the Internet, research the impact of public advocacy groups on sustainable business practice and the multiple-stakeholder process.
Write a paper addressing the following:
Identify and research at least two examples of companies that have been impacted by the campaigns of public advocacy groups. What is the value of democratic inputs in business decision making?
Identify and list all of the sustainability stakeholders at Top Shelf. Does each group have equal weight throughout the program development process? When should each be brought into the discussion?
Explain the advantages of implementing a multiple-stakeholder process that significantly influences a company’s agenda for sustainability.
Describe the challenges in a multiple-stakeholder process for developing a sustainable business plan. Do the interests of one group outweigh the others?
Develop a step-by-step plan for implementing a multiple-stakeholder process. Your plan should assure the credibility of Top Shelf’s sustainability plan in the public sphere and also be effective in meeting the goal of sustainability.
Suggest metrics for tracking the progress.
Write a 5–6-page paper in Word format. Apply APA standards to citation of sources. By
Saturday,
March 7, 2015
.
Assignment 2 Grading Criteria
Described at least two examples of companies that have been impacted by the campaigns of public advocacy groups demonstrating in-depth research.
Identified all of the sustainability stakeholders at Top Shelf and provided recommendations for when they should be included in the discussion.
Explained the advantages and challenges of implementing a multiple-stakeholder process that significantly influences a company’s agenda for sustainability.
Developed a step-by-step plan for implementing a multiple-stakeholder process that would assure the credibility of Top Shelf’s sustainability plan in the public sphere.
Assured that the step-by-step plan for implementing a multiple-stakeholder process is effective in meeting the goal of sustainability by providing metrics for tracking progress.
Wrote in a clear, concise, and organized manner; demonstrated ethical scholarship in accurate representation and attribution of sources; displayed accurate spelling, grammar, and punctuation.
.
Sustainability Through Partnerships Report - A Guide for Executives | Network...Sustainable Brands
Partnerships are a natural way to address sustainability issues. They can enable your business to innovate, improve society and the environment, increase legitimacy and acquire new skills and resources.
But partnerships are also a new way of operating – and not all are successful. This report identifies steps for success. It provides the best research-based advice on planning and executing effective partnerships.
In Spring 2013, we are on the precipice of dramatic, disruptive change in the health field that offers an unprecedented opportunity and challenge to transform health care and population health.
We know that traditional public health approaches along with more and better health care are not enough to improve health outcomes, equity, and cost. We must also:
- implement sustainable, fundamental "upstream" changes that address the root causes of disease and disability; and
- transform the way we deliver health care to ensure access to quality, affordable health care for all.
Enjoy this Bright Spot presentation from Sana Chehimi of the Prevention Institute, which was presented at the 2013 Annual Leadership Conference, co-sponsored by the Center for Health Leadership (CHL) and the California Pacific Public Health Training Center (CALPACT) at UC Berkeley's School of Public Health.
To learn more about this event, please visit:
http://calpact.org/index.php/en/events/leadership-conference
Learn more about CALPACT:
http://calpact.org/
Learn more about the CHL:
http://chl.berkeley.edu/
Presented during Tshikululu Social Investments' second annual Serious Social Investing workshop, which took place on 17 and 18 March 2011.
Andre Proctor (Programme director: Keystone) will share some examples of successful
Collective Impact initiatives and discuss the five conditions
of collective success that have emerged from this experience. We can do it too. Participants will apply some innovative tools to sketch out a possible Collective Impact solution to address a key social problem.
Refreshing Evaluation in Support of the Social Movements RevivalInnovation Network
There is a growing social consciousness in America and a revival of using social movements as a vehicle for social change—with increasing nonprofit involvement and philanthropic funding support. Since the mid-2000’s there have been several notable movements that have taken hold of the public consciousness: the immigration reform movement and DREAMers, The Occupy Movement, Gay Marriage, climate change movement, Black Lives Matter, and a nascent, potential movement developing in protest of the Trump Administration. While evaluating movements has some parallels to established evaluation practice, it also represents some thorny challenges. In a session presented at the American Evaluation Association Conference on November 10, 2017, we explore and share what we are learning about evaluating social movements, including: what we know about social movements, their components, characteristics, and types; what aspects of social movements are ripe for evaluation; and what existing evaluation approaches are well suited to evaluating social movements.
During the 2015 American Evaluation Association's Annual Conference in Chicago, Katherine Haugh and Deborah Grodzicki conducted a real time data mini-study to see which evaluation approaches evaluators at #eval15 use most frequently in their work. Basing their mini-study off of Marvin C. Alkin's "Evaluation Roots: A Wider Perspective of Theorists’ Views and Influences," they asked evaluators to vote for the top two approaches they used most often. This handout accompanied the real time data mini-study to provide more information about the formation of the evaluation theory tree, it's three branches, and definitions of the evaluation approaches associated with each branch.
Putting Data in Context: Timelining for Evaluators (HANDOUT)Innovation Network
Creating a timeline is a method for picturing or seeing events as they take place over time. The full PowerPoint slides of this presentation are also available in SlideShare. Search for the title "Putting Data in Context: Timelining for Evaluators".
[Link: http://www.slideshare.net/InnoNet_Eval/putting-data-in-context-timelining-for-evaluators ]
Creating a timeline is a method for picturing or seeing events as they take place over time. By documenting major occurrences in chronological order, evaluators are able to identify patterns, themes, or trends that they may not have seen otherwise. A timeline allows evaluators to “zoom out” and look at the broader landscape, so that they are better positioned to think through and understand the context in which events occur. Having a timeline is especially useful for complex, multi-year evaluation projects with several threads of evaluation, where documenting the process is just as important as measuring the outcome itself. Creating a timeline has three key components: planning, populating, and revising. This presentation shows how to incorporate a timeline into a report, how to use a timeline to track progress internally, and how to utilize data visualization principles to create a visual timeline.
Highlights of this presentation are also available in our handout titled "Putting Data in Context: Timelining for Evaluators (HANDOUT)".
[Link: http://www.slideshare.net/InnoNet_Eval/putting-data-in-context-timelining-for-evaluators-handout ]
Data Placemats: Construction and Practical Design TipsInnovation Network
Increasing stakeholder involvement throughout the evaluation lifecycle, not only enhances stakeholder buy-in to the final evaluation results, but it also ensures that the evaluator is taking into consideration multiple viewpoints to be able to provide a more comprehensive picture of a program or initiative. Data placemats, a data viz technique to improve stakeholder understanding of data, can be used to communicate preliminary evaluation results during the analysis phase of the evaluation life cycle. When done correctly, it offers stakeholders an opportunity to form their own judgments about the data and weigh in prior to the final report. In this session, the presenter will review the concept of data placemats, focusing specifically on the nuts and bolts of constructing a data placemat.
Real Time Evaluation: Tips, Tools, and Tricks of the TradeInnovation Network
How can an evaluator meaningfully convey findings to stakeholders based on data collected that same day? How can real time evaluation really be done in real time? This Ignite talk is based on Innovation Network’s experiences with facilitating real time evaluation in health policy settings, and will introduce AEA participants to three tools that can be used as part of any evaluator’s real time evaluation toolbox: surveys, H-forms, and timelines. Yuqi Wang from Innovation Network will provide an overview of each tool; show how these tools can aid data collection, analysis, and communication of findings in real time; and lessons learned from Innovation Network’s experiences with these three tools during the evaluation process.
Make Your Data Count: Tips & Tools for Visual Reporting Innovation Network
In their session at YNPNdc's 2015 Annual Conference in Washington, DC, Johanna Morariu and Katherine Haugh presented on helpful tips and tools for visual reporting. This handout includes their suggestions, great examples of visual reports, and tools anyone can access to create powerful visual reports.
Make Your Data Count: New, Visual Approaches to Evaluation Reporting Innovation Network
Charts and graphs built on dataviz principles are transforming evaluation reporting and increasing the evaluator's communication power. At YNPNdc's 2015 Annual Conference in Washington DC, Johanna Morariu and Katherine Haugh will provide principles and case studies of new, visual approaches to evaluation reporting. The session will provide examples, such as incorporating a wealth of visuals in text reports, using large format hand-outs to emphasize findings, and designing slide reports.
Success and Failure in the Evaluation Process
What do the terms “success” and “failure” really mean in the philanthropic world? Funders have taken different approaches to learning from initiatives that haven’t gone quite as they had hoped. Some funders want to learn from their mistakes, some provide technical assistance to lagging grantees, and some want to focus their light on “bright spots” and grantee successes. In this session, Kat Athanasiades from Innovation Network will discuss how and when her organization uses grant reports in evaluation; how and why getting good evaluation data from grant reports is difficult; and potential ways to make it easier for grantees to report on failure in a way that could be useful to evaluators.
Session participants will:
•Know how funders can embed “failure reporting” into grant reports in ways that are useful to evaluators.
•Learn ways a foundation can combat some of the "structural" impediments, e.g., trust and communication, that may prevent proper reporting on failure.
•Gain ideas from fellow participants on how to understand and appreciate grantmaking "failures" as well as successes.
Since its inception in 2000, the Missouri Foundation for Health (MFH) has invested in policy change in Missouri. Recognizing a dearth of organizations with the capacity to advocate for Missouri health consumers, MFH broadened its grantmaking vision to building a field of consumer health advocates. Using the Framework for Evaluating Advocacy Field Building, Innovation Network and the Center for Evaluation Innovation are currently gauging how MFH shapes this field through its grantmaking. This presentation will focus on evaluating two dimensions of the Framework of this field: Adaptive Capacity and Skills & Resources. A discussion of data collection activities will give the audience ideas about how to evaluate these dimensions, lessons learned from the process, and what has been revealed through the evaluation about Skills & Resources and Adaptive Capacity in a field.
Handout for the session, "Data Placemats: A DataViz Technique to Improve Stakeholder Understanding of Evaluation Results" presented at the American Evaluation Association's 2014 conference.
#JAGUnity2014: Innovations in Evaluating Social MovementsInnovation Network
Today, social movement organizers are grappling with big questions: What is the long-term impact we are hoping to make? How can we measure the progress we've made thus far? How can we learn from past practice?
On June 7, 2014, Innovation Netowrk's William Fenn spoke on a panel with with Deepak Pateriya and Sian O'Faolain of the Center for Community Change and Hillary Klein of Make the Road New York to try and answer some of these questions. The presentation highlighted specific ways in which social movement organizers can evaluate the impact of their work.
Evaluation Essentials for Nonprofits: Terms, Tips, and TrendsInnovation Network
These slides are an excerpt from an evaluation session for the Young Nonprofit Professionals Network (YNPN), which was held in June 2014 in Washington, DC.
#JAGUnity2014: DataViz for Philanthropists! Tips, Tools, and How-Tos for Comm...Innovation Network
Presentation by Innovation Network's Johanna Morariu and Ann K. Emery at the Joint Affinity Groups Unity Conference, held June 6, 2014 in Washington, DC.
#JAGUnity2014: DataViz for Philanthropists! Tips, Tools, and How-Tos for Comm...Innovation Network
Presentation by Innovation Network's Johanna Morariu and Ann K. Emery at the Joint Affinity Groups Unity Conference, held June 6, 2014 in Washington, DC.
Innovation Network's own workbook (revised in 2010), offering an introduction to the processes and concepts of the logic model. This workbook can be used alone or in conjunction with the Logic Model Builder at the Point K Learning Center.
#YNPNdc14: DataViz! Tips, Tools, and How-tos for Visualizing Your Data (Slides)Innovation Network
Innovation Network's Johanna Morariu and Ann K. Emery presented at the Young Nonprofit Professionals Network 2014 Annual Leadership Conference, which was held on May 9, 2014 in Washington, DC.
In a May 9, 2024 paper, Juri Opitz from the University of Zurich, along with Shira Wein and Nathan Schneider form Georgetown University, discussed the importance of linguistic expertise in natural language processing (NLP) in an era dominated by large language models (LLMs).
The authors explained that while machine translation (MT) previously relied heavily on linguists, the landscape has shifted. “Linguistics is no longer front and center in the way we build NLP systems,” they said. With the emergence of LLMs, which can generate fluent text without the need for specialized modules to handle grammar or semantic coherence, the need for linguistic expertise in NLP is being questioned.
‘वोटर्स विल मस्ट प्रीवेल’ (मतदाताओं को जीतना होगा) अभियान द्वारा जारी हेल्पलाइन नंबर, 4 जून को सुबह 7 बजे से दोपहर 12 बजे तक मतगणना प्रक्रिया में कहीं भी किसी भी तरह के उल्लंघन की रिपोर्ट करने के लिए खुला रहेगा।
role of women and girls in various terror groupssadiakorobi2
Women have three distinct types of involvement: direct involvement in terrorist acts; enabling of others to commit such acts; and facilitating the disengagement of others from violent or extremist groups.
31052024_First India Newspaper Jaipur.pdfFIRST INDIA
Find Latest India News and Breaking News these days from India on Politics, Business, Entertainment, Technology, Sports, Lifestyle and Coronavirus News in India and the world over that you can't miss. For real time update Visit our social media handle. Read First India NewsPaper in your morning replace. Visit First India.
CLICK:- https://firstindia.co.in/
#First_India_NewsPaper
03062024_First India Newspaper Jaipur.pdfFIRST INDIA
Find Latest India News and Breaking News these days from India on Politics, Business, Entertainment, Technology, Sports, Lifestyle and Coronavirus News in India and the world over that you can't miss. For real time update Visit our social media handle. Read First India NewsPaper in your morning replace. Visit First India.
CLICK:- https://firstindia.co.in/
#First_India_NewsPaper
01062024_First India Newspaper Jaipur.pdfFIRST INDIA
Find Latest India News and Breaking News these days from India on Politics, Business, Entertainment, Technology, Sports, Lifestyle and Coronavirus News in India and the world over that you can't miss. For real time update Visit our social media handle. Read First India NewsPaper in your morning replace. Visit First India.
CLICK:- https://firstindia.co.in/
#First_India_NewsPaper
हम आग्रह करते हैं कि जो भी सत्ता में आए, वह संविधान का पालन करे, उसकी रक्षा करे और उसे बनाए रखे।" प्रस्ताव में कुल तीन प्रमुख हस्तक्षेप और उनके तंत्र भी प्रस्तुत किए गए। पहला हस्तक्षेप स्वतंत्र मीडिया को प्रोत्साहित करके, वास्तविकता पर आधारित काउंटर नैरेटिव का निर्माण करके और सत्तारूढ़ सरकार द्वारा नियोजित मनोवैज्ञानिक हेरफेर की रणनीति का मुकाबला करके लोगों द्वारा निर्धारित कथा को बनाए रखना और उस पर कार्यकरना था।
Coalition Assessment: Approaches for Measuring Capacity and Impact
1. C OALITION A SSESSMENT
Approaches for Measuring Capacity
and Impact
Veena Pankaj
Kat Athanasiades
Ann Emery
February 2014
2014 Innovation Network, Inc.
You may remix, tweak, and build upon this work for
non-commercial purposes, as long as you give credit
and license new creations under identical terms.
Any other use requires written permission.
www.innonet.org
2. Coalition Assessment:
Approaches for Measuring Capacity and Impact
Veena Pankaj, Kat Athanasiades, and Ann Emery
Why assess coalition capacity? How should a coalition be assessed? How can coalition assessment data
be analyzed and used?
Coalitions are an important tool in the
advocacy and policy change toolbox. They
can be used to promote an issue, increase
visibility, and eventually propel an issue to
the forefront of a political or social agenda.
They can provide a lot of horsepower—
harnessing the combined power and
expertise of many entities all at once. And
they are a valuable technique for crafting
more durable solutions generated by a broad
constituency. For all of these reasons,
developing and strengthening coalitions is a
common strategy among advocates and
advocacy funders.
Coalitions
A coalition is an alliance for combined action.
In the social sector, coalitions may be formal
(with membership criteria and bylaws) or
informal. Participation or membership may
be of individuals or organizations. Coalitions
may be at a local, regional, state, national, or
international-level. In the past few years,
coalitions have become an increasingly
common strategy for advocacy and policy
change.
For evaluators, coalition assessment is a growing field of experimentation and learning. Innovation
Network has been evaluating coalitions since 2006, beginning with the Coalition for Comprehensive
Immigration Reform, a national effort to secure passage by the U.S. Congress for comprehensive
immigration reform. Over the years, we have evaluated many different types of coalitions throughout
the United States. Our coalition partners have worked at national, state, regional, and local levels on a
variety of advocacy and policy change goals, such as healthy community design or childhood nutrition.
This white paper provides practitioners and funders with insights into the coalition assessment process
along with concrete examples and lessons we’ve learned from our own work.
Why assess coalition capacity?
Coalition capacity matters. High-capacity coalitions are more successful than low-capacity coalitions in
effecting advocacy and policy change.1 But coalitions—like other types of advocacy strategies—take a
while to achieve big wins or actual policy changes. In the interim, coalition capacity assessments
determine whether coalitions are healthy, high-functioning, and on track for success. Assessments
provide opportunities for coalition members to discuss results, make improvements, and build stronger
coalitions. In turn, these strengthened coalitions are better situated to take advantage of opportunity
windows than one that is unprepared.2
1
Sarah M. Moreland-Russell et al. (2007). Coalitions: State and Community Interventions. Prepared for the U.S.
Department of Health and Human Services, Centers for Disease Control and Prevention.
2
Jared Raynor. (2011). What Makes an Effective Coalition? Evidence-Based Indicators of Success. Prepared by the
TCC Group for The California Endowment.
I n n o v a t i o n N e t w o r k , I n c . | www.innonet.org/research
Page 1 of 7
3. Coalition Assessment: Approaches for Measuring Capacity and Impact
How should a coalition be assessed?
Building on our years of experience evaluating coalitions, Innovation Network developed a coalition
assessment process and tool. Coalitions should be assessed relative to their goals. Every coalition we
have worked with has had different capacity and policy change goals. The steps outlined below provide
a high level overview of key stages in the coalition assessment development process.
Step 1: Identify the coalition’s goals
The first step in the process is to identify the capacities needed for the coalition to advance toward their
advocacy and policy change goals. These capacities are vital to the overall functioning of the coalition
and its ability to implement its advocacy and policy change strategies.
Step 2: Develop a comprehensive set of criteria
Next, based on these capacities, a comprehensive set of criteria is developed for each identified capacity
to capture a detailed picture of the coalition’s health and functioning.
In a recent project, Innovation Network was tasked with developing a coalition assessment for a
statewide community change effort focused on changing systems and policies to improve access to
healthy foods and healthy community design. Given the advocacy goals of the project, seven relevant
capacities were selected.
1
Basic Functioning and
Structure
The basic structures and processes inherent to the functioning of the
coalition. The coalition’s ability to function effectively and efficiently.
2
Ability to Cultivate and
Develop Champions
The coalition’s ability to cultivate awareness about the advocacy
issue, to garner supporters, and to cultivate champions.
3
Coalition Leadership
The skills, relationships, and vision of coalition leadership. The
leadership’s contribution to coalition functioning and success.
4
Ability to Develop Allies
and Partnerships
The coalition’s overall ability to build relationships with individuals
and organizations outside of the coalition. The growing power of the
coalition through relationships, networks, fields, etc.
5
Reputation and Visibility
The coalition’s visibility with stakeholders and target audiences.
6
Ability to Learn and
Improve
The coalition’s ability to systematically scan the environment and
collect data to inform decisionmaking. The coalition’s ability to learn
and improve over time.
7
Sustainability
The groundwork being laid by the coalition to ensure a long-term life
span.
Research and an extensive literature review contributed to the development of the supporting criteria
within the seven capacity areas. In this application each capacity area included approximately eight to
12 criteria. For example, the coalition increases the awareness of diverse groups within target audiences,
illustrates one of the criteria used to assess the coalition’s ability to cultivate and develop champions.
Coalition members are seen as knowledgeable about their issues by target audiences is another example
I n n o v a t i o n N e t w o r k , I n c . | www.innonet.org/research
Page 2 of 7
4. Coalition Assessment: Approaches for Measuring Capacity and Impact
of a criterion used to assess the coalition’s reputation and visibility. Each item is rated on a four-point
scale from strongly agree to strongly disagree.
We recommend including a demographics section in the coalition assessment. For example, it may be
helpful to ask respondents to indicate how long the coalition has been in existence and how long they
have been a member of the coalition. The demographics section should be adapted for each project,
and typically includes five to 10 items.
Step 3: Include a variety of perspectives in the vetting process
The vetting process should include a variety of perspectives: the funder, technical assistance providers
who work closely with coalitions, other local experts on the advocacy issue, and coalition members. It is
also a good practice to pilot test the questionnaire with a small sample of coalition members to ensure
that the assessment is aligned with the initiative it was designed to support, and that the language is
accessible and meaningful to respondents.
How should learnings be shared?
One of the main values of this type of coalition assessment process is the opportunity to share results
with coalition members and use the results to make improvements going forward. We often share the
coalition assessment results with each coalition in the form of a one or two-page snapshot, which are
discussed during in-person convenings.
During the convenings, we ask coalition members
to reflect upon a series of discussion questions. These questions… are good questions for us
For example, they discuss whether overall and to have as a guide for our work… It is a goal
section scores are higher or lower than they to strive towards.
anticipated. They also discuss where they are
– Coalition member
doing well (and how to continue doing well in
these areas) and where they are not doing well
(and how they can strengthen these areas during the next grant year). Coalition members often remark
that these discussions help them plan for the upcoming year because the Coalition Assessment Tool is a
rubric or guide for their work; the Tool specifies best practices to strive toward.
How often should coalitions be assessed?
A coalition assessment can be used for one coalition at a point in time, for one coalition across several
points in time, or to compare a cohort of coalitions. In the previously mentioned example, Innovation
Network was charged with assessing 12 different coalitions at multiple points in time over the duration
of a four-year grant. By administering our coalition assessment to all 12 coalitions on an annual basis,
we are measuring how each of the individual coalitions progress over time.
How is the tool adapted?
Although standard tools for evaluating coalition capacity provide value to the sector by making basic
assessment within reach for all, we advocate for situation-specific assessment whenever possible. The
Coalition Assessment Tool is modular; that is, we add or remove items in each section to match that
coalition’s unique goals. We also modify wording within items to match that coalition’s common
language and terminology. In other cases, we may add or remove entire sections.
I n n o v a t i o n N e t w o r k , I n c . | www.innonet.org/research
Page 3 of 7
5. Coalition Assessment: Approaches for Measuring Capacity and Impact
Who should provide a perspective on the coalition?
Coalition assessments are strongest when multiple perspectives are included, both internal and external
to the coalition. We see value in including an array of voices from within the coalition: leaders, general
members, senior participants, junior participants, and representation from a range of skill areas. In our
example, an outsider perspective was also included; one technical assistance provider per coalition was
included as a respondent to further ground the results and enhance the overall meaning of the data. The
technical assistance provider’s perspective allows us to triangulate the information, as shown in the dot
plots below.
Coalition members might
be more optimistic in how
they perceive themselves
compared to external
raters.
In slightly more than half
of the coalitions in our
example, the coalition
members rated
themselves higher than
technical assistance
providers.
Technical Assistance
Provider’s Scores
Basic Functioning and Structure
43%
79%
Coalition Leadership
44%
80%
Learn from the Community
40%
73%
Allies and Partnerships
47%
Reputation and Visibility
47%
77%
69%
38%
Champions
61%
33%
Sustainability
Sometimes, few
differences exist between
coalition members and
technical assistance
providers.
For the remaining
coalitions, the results are
typically mixed—
sometimes the coalition
members view themselves
in the capacity areas than
the technical assistance
providers; other times, the
technical assistance
providers give higher
ratings.
Coalition Members’
Scores
70%
Basic Functioning and Structure
60%
Coalition Leadership
60%
Learn from the Community
67%
63%
50%
Allies and Partnerships
57%
46%
Reputation and Visibility
53%
40%
44%
Champions
59%
Sustainability
60%
0%
20%
40%
64%
68%
60%
80%
100%
Occasionally, the coalition members score themselves lower than the technical assistance providers—
but this situation is uncommon. Regardless of the scenario, the charts are used as a discussion starter;
the coalition members and technical assistance providers spend time discussing where and why
differences in perspective exist.
I n n o v a t i o n N e t w o r k , I n c . | www.innonet.org/research
Page 4 of 7
6. Coalition Assessment: Approaches for Measuring Capacity and Impact
What information can the tool provide?
The coalition assessment generates a broad array of rich information. Data from the tool can be
analyzed at the level of each capacity, or as an aggregate score of all capacities. Before spending too
much time exploring the data, revisit the purpose of the coalition assessment: What are the evaluation
questions the assessment is designed to answer? Then, depending on how you intend to use the
information, select the most appropriate level of analysis.
Looking across coalitions:
This bar chart shows how five
fictional coalitions scored on
Basic Functioning and
Structure. Coalition 1 may
have tips to share with the
other coalitions.
Coalition 1
Looking at capacities
within one coalition:
This chart shows how a single
coalition scored on each of
the seven capacities.
Coalitions often score highest
on Basic Functioning and
Structure and lowest on
Sustainability.
Basic Functioning and Structure
Looking at variability
within one coalition:
Each circle represents one of
20 coalition member’s
individual scores on Basic
Functioning and Structure.
Overall, this coalition scored
high—a median score of
81%—but scores ranged from
55 to 95%.
81%
2
78%
3
75%
4
67%
5
55%
81%
Coalition Leadership
79%
Learn from the Community
78%
Allies and Partnerships
75%
Reputation and Visibility
73%
Champions
61%
Sustainability
0%
20%
I n n o v a t i o n N e t w o r k , I n c . | www.innonet.org/research
52%
40%
60%
80%
Page 5 of 7
100%
7. Coalition Assessment: Approaches for Measuring Capacity and Impact
Lessons Learned
Tailor assessment to fit coalition priorities. This process of coalition assessment enables evaluators to
select capacities and modify criteria. When putting together the list of coalition capacities it’s important
to think through and select those that are most relevant to the functioning and goals of the coalitions
you are trying to evaluate. This is particularly important because coalitions often consider the
assessment tool as a checklist to work toward.
Understand the type of coalition you are trying to assess. Coalitions are not created equal. Think about
the relative size and composition of the coalition, the governing body, impetus for formation, and/or
membership cohesion; their unique characteristics are likely to affect the type of assessment that is
useful—and possible.
Value of the participatory approach. There is incredible value in including stakeholders—coalition
members, technical assistance providers, funders, and other stakeholders—in the development and
vetting process. In addition to increasing the quality of the assessment, a participatory approach
establishes buy-in and increases the likelihood that the results will be used.
Make the data actionable. This involves reporting relevant information back to key stakeholders in a
meaningful and timely way. Figure out who needs which types of information to learn, adapt, and
improve. Return results within weeks rather than months or years.
Revisit the coalition assessment capacities and criteria each time it is used. This is especially important
for multi-year projects. Coalitions may change, or their priorities may shift. Providing an opportunity for
key stakeholders to re-engage or reflect on the assessment priorities contributes to understanding and
buy-in.
I n n o v a t i o n N e t w o r k , I n c . | www.innonet.org/research
Page 6 of 7
8. Coalition Assessment: Approaches for Measuring Capacity and Impact
Coalition Assessment: Getting Started
Coalition assessment is a valuable approach that when done correctly, can enhance
understanding about progress toward advocacy/policy change goals. As you contemplate
coalition assessment, consider the following questions:
1. What is the purpose of the coalition assessment? How is it intended to
strengthen the coalition? Think critically about what types of information
coalition members and other stakeholders will want and be able to use.
2. Given the coalition’s goals and strategies, which capacities are likely to be
important? In the example we shared, there were seven capacities that were
identified as important: Basic Functioning and Structure; Ability to Cultivate and
Develop Champions; Coalition Leadership; Ability to Develop Allies and
Partnerships; Reputation and Visibility; Ability to Learn and Improve; and
Sustainability. Your coalition’s capacity needs may be similar—or they might be
different.
3. Which individuals—internal and external to the coalition—might have a
valuable perspective to include? (Also, who should be included throughout the
assessment process to build buy-in and support?)
Veena Pankaj (vpankaj@innonet.org) is a Director of Innovation Network.
Kat Athanasiades (kathanasiades@innonet.org) is an Associate with Innovation Network.
Ann Emery (aemery@innonet.org) is an Associate with Innovation Network.
Innovation Network is an evaluation, research, and consulting firm. We provide knowledge and expertise to help
nonprofits and funders learn from their work to improve their results.
2014 Innovation Network, Inc.
You may remix, tweak, and build upon this work for non-commercial purposes, as long as you give
credit and license new creations under identical terms. Any other use requires written permission.
I n n o v a t i o n N e t w o r k , I n c . | www.innonet.org/research
Page 7 of 7