Evaluation:
Finding a Common Ground
Kat Athanasiades
Veena Pankaj
Forum of Regional Associations of Grantmakers
Milwaukee, WI
Tuesday, July 30, 2013
www.innonet.org
#evalRA
www.innonet.org | #evalRA
Mission: building evaluation capacity
Evaluation and strategy consulting
Nonprofit, philanthropic, and
governmental organizations
Kat Veena
Wide range of evaluation experience
We consult on evaluation projects
We also provide resources and training
to share evaluation know how
Who are we?
www.innonet.org | #evalRA
Why evaluate?
Setting the context
www.innonet.org | #evalRA
Setting the context
www.innonet.org | #evalRA
Why evaluate?
What are some of the challenges to
conducting evaluation?
Setting the context
www.innonet.org | #evalRA
Setting the context
www.innonet.org | #evalRA
Setting the context
Many evaluation
tools have been
developed in the
social sector for
philanthropic donors
and nonprofits.
nonprofit
philanthropic donor
www.innonet.org | #evalRA
Setting the context
However, there are
not many tools that
exist for regional
associations to
evaluate their work.
nonprofit
philanthropic donor
regional association
Advocacy and Policy Change Composite Logic Model
Infrastructure
Development
Capacity Building
Policy Proposal
Development
Organizational
Capacity
Media
Coverage
Partnerships or
Alliances
Collaboration
and Alignment
(including
messaging)
Constituency or
Support Base
Growth
Public Will
Awareness
Attitudes or
Beliefs
Policy
Development
Policy Adoption
Policy
Implementation
Policy Monitoring
and Evaluation
Issue/Policy
Analysis and
Research
New Advocates
(including unlikely
or nontraditional)
Salience
Issue
Reframing
Skills
Development
Strategy
Development
Data Collection
Partner
Development
Preparation/Planning
Staffing and
Leadership
Development
Lobbying
Policymaker and
Candidate
Education
Litigation or
Legal Advocacy
Relationship
Building with
Decision Makers
Goal Setting
Placement on the
Policy Agenda
New Donors
Policy Blocking
More or
Diversified
Funding
Organizational
Visibility or
Recognition
Fund Raising
Policy
Maintenance
Landscape
Mapping
New
Champions
(including
policymakers)
Problem
Assessment
Activities/Tactics Interim Outcomes Policy Goals
Impacts
Inputs
Political Climate
Economic Climate
Social Climate
Prior Experience Elected Officials
Public
Administrators
Candidates
MediaVoters Community
Leaders
Other Audiences
Business
Courts
Potential Partners/
Competitors/ Opponents
Issue Competition
Specific
Constituencies
Contextual Factors
Audiences
Improved
Services
And Systems
Positive Social
And Physical
Conditions
Political Will
Policy and Politics Advocacy
Capacity
Policy
Media
Partnerships
Grassroots
Organizing and
Mobilization
Coalition and
Network Building
Briefings/
Presentations
Demonstration
Projects or Pilots
Polling
Rallies and
Marches
Paid Media
Voter Education
Public Service
Announcements
Communications and Outreach
Policy
Assessment Message
Development
Materials
Development
Electronic
Outreach
Earned Media
Popular Culture
Artists/Gate-
keepers
Political Donors
www.innonet.org | #evalRA
Setting the context
www.innonet.org | #evalRA
Today’s objectives
 Logic Models: Nuts and Bolts
www.innonet.org | #evalRA
Today’s objectives
 Logic Models: Nuts and Bolts
 Building our Logic Model Together
www.innonet.org | #evalRA
 Logic Models: Nuts and Bolts
 Reflections and Thoughts
 Building our Logic Model Together
Today’s objectives
http://www.flickr.com/photos/mag3737/1997114236
/
www.innonet.org | #evalRA
What is evaluation?
The systematic collection of information
about a program that enables stakeholders to
better understand the program, improve its
effectiveness, and/or make decisions about
future programming.
Logic Models: Nuts and Bolts
www.innonet.org | #evalRA
Planning
Data
collection
Analysis &
Reflection
Action &
Improvement
Logic Models: Nuts and Bolts
www.innonet.org | #evalRA
Planning
Data
collection
Analysis &
Reflection
Action &
Improvement
Logic Models: Nuts and Bolts
http://www.flickr.com/photos/sidelong/234192777/
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
What is a logic model?
A visual display of connections between what
you do and the results you hope to achieve.
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
How is a logic
model used? Program Planning
Program Management
Communications
Fundraising
Evaluation
Consensus-building
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
Problem Statement
Goal
Resources Activities Outputs
Outcomes
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
Resources
If…
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
Resources Activities
Then
If…
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
Resources Activities Outputs
Then
If…
Then
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
Resources Activities Outputs Outcomes
Then
If…
Then Then
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
Problem Statement
Goal
Resources Activities Outputs
Outcomes
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
Problem Statement
Resources Activities Outputs
Outcomes
Goal = Objectives, long-term outcomes
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
Goal
Problem Statement
Activities Outputs
Outcomes
Resources =
Inputs, program
investments
Outputs
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
Outcomes
Activities =
Strategies, actio
n steps
Problem Statement
Goal
Resources
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
Outcomes
Outputs =
Deliverables, products,
units of service
Problem Statement
Goal
Resources Activities
Outputs
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
Outcomes =
Results, impact,
objectives
Problem Statement
Goal
Resources Activities
www.innonet.org | #evalRA
Resources Activities Outputs Outcomes
Building our Logic Model Together
www.innonet.org | #evalRA
Resources Activities Outputs Outcomes
Building our Logic Model Together
www.innonet.org | #evalRA
Activities
Building our Logic Model Together
Activity groups
www.innonet.org | #evalRA
Activities
Building our Logic Model Together
Activity groups
www.innonet.org | #evalRA
What are the main 3-5
activity groups of an
RA’s work?
Table Exercise #1
Which of those activity
groups are given
highest priority?
Which activity groups
are most common
across RAs?
www.innonet.org | #evalRA
Activities
Table Exercise # 2
For your activity
group, what are at least
3 activities that you do?
How do activities stay
the same across RAs?
How do they differ?
www.innonet.org | #evalRA
Resources Activities Outputs Outcomes
Building our Logic Model Together
www.innonet.org | #evalRA
Resources Activities Outputs Outcomes
Building our Logic Model Together
www.innonet.org | #evalRA
Building our Logic Model Together
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
Outcomes
Short-term Long-term
http://www.flickr.com/photos/ellasdad/457521627/
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
Outcomes chain
Outcomes
www.innonet.org | #evalRA
Logic Models: Nuts and Bolts
Short-term
Changes in
knowledge, awarenes
s and attitude
Long-term
Changes in
conditions, practices
and norms
Intermediate
Changes in behavior
For your activity
group, what outcomes
do you expect to
result…
…in the short-term?
…in the long-term?
www.innonet.org | #evalRA
Outcomes
Table Exercise # 3
What kinds of things
might indicate your
success?
http://www.flickr.com/photos/seatbelt67/502255276/
www.innonet.org | #evalRA
Reflections and Thoughts
What’s next?
www.innonet.org | #evalRA
Reflections and Thoughts
Evaluation:
Finding a Common Ground
Thank you!
For more information, please contact:
www.innonet.org
#evalRA
Kat Athanasiades
kathanasiades@innonet.org
Veena Pankaj
vpankaj@innonet.org

Evaluation: Finding a Common Ground