Your SlideShare is downloading. ×
Understanding the
Public Policy Landscape
Lessons from a Retrospective Evaluation

Veena Pankaj
Kat Athanasiades

Innovati...
Agenda

1

Setting the Stage

2

Process

3

Key Insights
Agenda

1

Setting the Stage

2

Process

3

Key Insights
WHAT I REALLY DO
Agenda

1

Setting the Stage

2

Process

3

Key Insights
ACTION

Framework for Public Policy Advocacy
Litigation
Community Mobilization

Model Legislation
Coalition Building

WILL...
Grant Amount: __________________________
Grant Number(s): ________________________

Key outcomes areas addressed:

Strateg...
Basic Grantee Information
Grantee Name:
Organization X

Grant Amount: $300,000

Grant Term(s):
January 1, 2009-December 31...
Basic Grantee Information
Grantee Name:
Organization X

Grant Amount: $300,000

Grant Term(s):
January 1, 2009-December 31...
Grant Amount: __________________________
$300,000
OrgX20090112
Grant Number(s): ________________________

Key outcomes are...
Grant Amount: __________________________
$300,000
OrgX20090112
Grant Number(s): ________________________

Key outcomes are...
ACTION

Organization X

WILL

Media Advocacy
Communications and
Messaging

Public Forums

AWARENESS

Outcomes

Model Legis...
All Grants

WILL
AWARENESS

Outcomes

ACTION

(n = 110)

Community Mobilization
18
Community Organizing
10
Public Will Cam...
Potential Case Study Grantees

WILL
AWARENESS

Outcomes

ACTION

(n = 38)

Community Mobilization
11
Community Organizing
...
Repeat grantees
ACTION

(n = 75)

Community Mobilization
14

WILL
AWARENESS

Outcomes

Coalition Building
16

Model Legisl...
Grantees receiving >$300,000
ACTION

(n = 69)

Community Mobilization
17

WILL
AWARENESS

Outcomes

Coalition Building
16
...
Grantees receiving $300,000
ACTION

(n = 59)

Community Mobilization
5

WILL
AWARENESS

Outcomes

Coalition Building
9

Mo...
How do you

operationalize
this information?
ACTION

Framework for Public Policy Advocacy
Litigation
Community Mobilization

Model Legislation
Coalition Building

WILL...
ACTION
WILL
AWARENESS

OUTCOMES

Media
Tracking

PUBLIC

INFLUENCERS
AUDIENCES

DECISION MAKERS
ACTION
WILL
AWARENESS

OUTCOMES

Legislative
Assessment
Checklist

PUBLIC

INFLUENCERS
AUDIENCES

DECISION MAKERS
ACTION
WILL
AWARENESS

OUTCOMES

Bellwether
Interviews

PUBLIC

INFLUENCERS
AUDIENCES

DECISION MAKERS
ACTION
WILL
AWARENESS

OUTCOMES

Peer Perception
Interviews

PUBLIC

INFLUENCERS
AUDIENCES

DECISION MAKERS
ACTION
OUTCOMES

WILL
AWARENESS

Context Mapping

PUBLIC

INFLUENCERS
AUDIENCES

DECISION MAKERS
ACTION
OUTCOMES

WILL
AWARENESS

Advocacy Timeline

PUBLIC

INFLUENCERS
AUDIENCES

DECISION MAKERS
ACTION
OUTCOMES

WILL
AWARENESS

Strategy Module Protocol
PUBLIC

INFLUENCERS
AUDIENCES

DECISION MAKERS
ACTION
OUTCOMES

WILL
AWARENESS

Process Tracing
PUBLIC

INFLUENCERS
AUDIENCES

DECISION MAKERS
ACTION

Bellwether
Interviews

Media
Tracking

WILL
AWARENESS

OUTCOMES

Peer Perception
Interviews

Legislative
Assessmen...
Summary/
Wrap up

General

Policy
Analysis &
Research
Public
Awareness/
Education

Legislation
Assistance

Strategy
Module...
Summary/
Wrap up

General

Policy
Analysis &
Research
Public
Awareness/
Education

Legislation
Assistance

Strategy
Module...
Summary/
Wrap up

General

Policy
Analysis &
Research
Public
Awareness/
Education

Legislation
Assistance

Strategy
Module...
Summary/
Wrap up

General

Policy
Analysis &
Research
Public
Awareness/
Education

Legislation
Assistance

Strategy
Module...
Media
Campaign
Media
Campaign

Did your organization
specifically target the media in
your outreach?
Media
Campaign

Did your organization
specifically target the media in
your outreach?
Which types of media outlets
were yo...
Media
Campaign

Did your organization
specifically target the media in
your outreach?
Which types of media outlets
were yo...
Agenda

1

Setting the Stage

2

Process

3

Key Insights
Landscape

http://www.flickr.com/x/t/0090009/photos/mdpettitt/4809326421/
Sub-group
strategies

http://www.flickr.com/x/t/0090009/photos/mdpettitt/4809326421/

http://www.flickr.com/x/t/0099009/ph...
Strategies of each
grantee

http://www.flickr.com/x/t/0090009/photos/mdpettitt/4809326421/

http://www.flickr.com/x/t/0099...
ACTION

Bellwether
Interviews

Media
Tracking

WILL
AWARENESS

OUTCOMES

Peer Perception
Interviews

Legislative
Assessmen...
Thank You!

Innovation Network

Veena Pankaj

Kat Athanasiades

Director
vpankaj@innonet.org

Associate
kathanasiades@inno...
Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation
Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation
Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation
Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation
Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation
Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation
Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation
Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation
Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation
Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation
Upcoming SlideShare
Loading in...5
×

Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation

1,642

Published on

These slides accompanied a presentation at the American Evaluation Association's annual conference in October 2013 in Washington, DC.

Innovation Network evaluators Veena Pankaj and Kat Athanasiades discussed how the Framework for Public Policy Advocacy was used in a retrospective evaluation of a large scale philanthropic public policy campaign. The framework helped to identify and plot grantee strategies across two dimensions - target audience(s) and desired outcomes. Using bubble charts to illustrate the strategic focus of each grantee, the evaluation team was able to recognize trends among the grantee partners, identify gaps and provide an aggregate overview of the types of strategies being supported. Presenters highlighted how the framework was used in selecting and developing appropriate data collection methodologies based on the strategic focus of the grantees. These methodologies were created to specifically correspond to the outcome areas and target audience(s) highlighted by the framework. Finally, the presenters reflected on lessons learns and share insights for improving advocacy evaluation at the portfolio level.

The presentation's handout is available here: http://www.innonet.org/resources/node/728

Innovation Network is a nonprofit evaluation, research, and consulting firm. We provide knowledge and expertise to help nonprofits and funders learn from their work to improve their results. To learn more, visit www.innonet.org.

Published in: News & Politics, Education
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,642
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Transcript of "Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation"

  1. 1. Understanding the Public Policy Landscape Lessons from a Retrospective Evaluation Veena Pankaj Kat Athanasiades Innovation Network www.innonet.org
  2. 2. Agenda 1 Setting the Stage 2 Process 3 Key Insights
  3. 3. Agenda 1 Setting the Stage 2 Process 3 Key Insights
  4. 4. WHAT I REALLY DO
  5. 5. Agenda 1 Setting the Stage 2 Process 3 Key Insights
  6. 6. ACTION Framework for Public Policy Advocacy Litigation Community Mobilization Model Legislation Coalition Building WILL Champion Development Media Advocacy Public Will Campaigns Political Will Campaigns Communications and Messaging Advocacy Capacity Building AWARENESS OUTCOMES Community Organizing Regulatory Feedback Leadership Development Voter Outreach Public Forums Demonstration Programs Public Awareness Campaigns Public Polling Public Education PUBLIC Policy Analysis/Research Influencer Education INFLUENCERS AUDIENCES Policymaker Education DECISION MAKERS
  7. 7. Grant Amount: __________________________ Grant Number(s): ________________________ Key outcomes areas addressed: Strategies relevant to this grant(s): ACTION 1: Knowledge and Understanding for Action Litigation Community Mobilization Model Legislation Coalition Building WILL Community Organizing Media Advocacy Public Will Campaigns Regulatory Feedback 2: Partnerships Champion Development Political Will Campaigns 3: Policy Innovation Communications and Messaging Advocacy Capacity Building Leadership Development Voter Outreach AWARENESS OUTCOMES Content area: ___________________________ Grantee Name: __________________________ Grant Term(s): __________________________ Public Forums Targets: Demonstration Programs Public Awareness Campaigns Public Polling Public Education PUBLIC Strategy framework c/o: Policy Analysis/Research Influencer Education INFLUENCERS AUDIENCES Policymaker Education DECISION MAKERS 14 INNOVATION NETWORK, INC.
  8. 8. Basic Grantee Information Grantee Name: Organization X Grant Amount: $300,000 Grant Term(s): January 1, 2009-December 31, 2009 If multiple grants, reason for grouping: ☐ Same grant activity (i.e. a renewed or extended grant) ☐ Same topic/approach with related grant activities Topic Area: ☒Area A ☐ Area B ☐ Area C ☐ Area D ☐ Other Assessment This grant focuses on a tax coalition, which is comprised of 500 community asset-building organizations and pro bono tax sites across the county. With the funding, Organization X intended to launch a national advocacy campaign to inform policymakers, and do the following to advance its agenda: Build the affiliate base: Significantly increase the number of affiliates involved in the network from around 50 to over 100 Deliverable (2009): In first narrative report, Organization X indicates that # of affiliates reached 114 Create a comprehensive strategic communications plan. Focus on developing messages and eliciting stories to effectively and compellingly disseminate its core messages Deliverable (2009): Some client stories elicited in 2009, and planned to test a key message at local sites. Hire communications and political consultants Delayed in 2009. No info on this in 2010. Redesign the website Deliverable (2010): Redesigned website launched in Feb 2010 with a more robust set of advocacy tools for clients. Submit quarterly policy briefs and/or publish issue papers and disseminate to elected officials and their staffs and other policymakers Deliverable (2009): Wrote in-depth policy paper. Distributed paper to field partners and members of Congress on Day of Action Oct 2009. Also released a policy brief on VITA and two position statements. Deliverable (2010): Produced policy brief on refundable tax credits, distributed to partners and Congressional offices. Produced targeted fact sheets with locally-focused information to distribute to members of Congress. Organization X president testified during hearing for ☒Deliverables met ☐ Deliverables not met ☐ General operating support (no specific deliverables)
  9. 9. Basic Grantee Information Grantee Name: Organization X Grant Amount: $300,000 Grant Term(s): January 1, 2009-December 31, 2009 If multiple grants, reason for grouping: ☐ Same grant activity (i.e. a renewed or extended grant) ☐ Same topic/approach with related grant activities Topic Area: ☒Area A ☐ Area B ☐ Area C ☐ Area D ☐ Other Assessment This grant focuses on a tax coalition, which is comprised of 500 community asset-building organizations and pro bono tax sites across the county. With the funding, Organization X intended to launch a national advocacy campaign to inform policymakers, and do the following to advance its agenda: Build the affiliate base: Significantly increase the number of affiliates involved in the network from around 50 to over 100 Deliverable (2009): In first narrative report, Organization X indicates that # of affiliates reached 114 Create a comprehensive strategic communications plan. Focus on developing messages and eliciting stories to effectively and compellingly disseminate its core messages Deliverable (2009): Some client stories elicited in 2009, and planned to test a key message at local sites. Hire communications and political consultants Delayed in 2009. No info on this in 2010. Redesign the website Deliverable (2010): Redesigned website launched in Feb 2010 with a more robust set of advocacy tools for clients. Submit quarterly policy briefs and/or publish issue papers and disseminate to elected officials and their staffs and other policymakers Deliverable (2009): Wrote in-depth policy paper. Distributed paper to field partners and members of Congress on Day of Action Oct 2009. Also released a policy brief on VITA and two position statements. Deliverable (2010): Produced policy brief on refundable tax credits, distributed to partners and Congressional offices. Produced targeted fact sheets with locally-focused information to distribute to members of Congress. Organization X president testified during hearing for Media Advocacy Public/Influencer Education Public Education Policymaker Education ☒Deliverables met ☐ Deliverables not met ☐ General operating support (no specific deliverables)
  10. 10. Grant Amount: __________________________ $300,000 OrgX20090112 Grant Number(s): ________________________ Key outcomes areas addressed: Strategies relevant to this grant(s): ACTION 1: Knowledge and Understanding for Action Litigation Community Mobilization Model Legislation Coalition Building WILL Community Organizing Media Advocacy Public Will Campaigns Regulatory Feedback 2: Partnerships Champion Development Political Will Campaigns 3: Policy Innovation Communications and Messaging Advocacy Capacity Building Leadership Development Voter Outreach AWARENESS OUTCOMES Content area: ___________________________ Area A Organization X Grantee Name: __________________________ Grant Term(s): __________________________ 1/1/09-12/31/09 Public Forums Targets: Demonstration Programs Public Awareness Campaigns Public Polling Public Education PUBLIC Strategy framework c/o: Policy Analysis/Research Influencer Education INFLUENCERS AUDIENCES Policymaker Education DECISION MAKERS 17 INNOVATION NETWORK, INC.
  11. 11. Grant Amount: __________________________ $300,000 OrgX20090112 Grant Number(s): ________________________ Key outcomes areas addressed: Strategies relevant to this grant(s): ACTION 1: Knowledge and Understanding for Action Litigation Community Mobilization Model Legislation Coalition Building WILL Community Organizing Media Advocacy Public Will Campaigns Regulatory Feedback 2: Partnerships Champion Development Political Will Campaigns 3: Policy Innovation Communications and Messaging Advocacy Capacity Building Leadership Development Voter Outreach AWARENESS OUTCOMES Content area: ___________________________ Area A Organization X Grantee Name: __________________________ Grant Term(s): __________________________ 1/1/09-12/31/09 Public Forums Targets: Demonstration Programs Policymakers Public Awareness Campaigns Public Polling Public Education PUBLIC Strategy framework c/o: Policy Analysis/Research Influencer Education INFLUENCERS AUDIENCES Advocates Policymaker Education DECISION MAKERS INNOVATION NETWORK, INC.
  12. 12. ACTION Organization X WILL Media Advocacy Communications and Messaging Public Forums AWARENESS Outcomes Model Legislation Policy Analysis/Research Public Education PUBLIC Influencer Education INFLUENCERS Audiences Policymaker Education DECISION MAKERS
  13. 13. All Grants WILL AWARENESS Outcomes ACTION (n = 110) Community Mobilization 18 Community Organizing 10 Public Will Campaigns 3 Coalition Building 21 Media Advocacy 36 Communications and Model Legislation 29 Regulatory Feedback 14 Champion Development 15 Political Will Campaigns 1 Messaging Advocacy Capacity 36 Public Forums Building 27 9 Leadership Development Voter Outreach 6 Demonstration Programs 1 18 Public Awareness Campaigns 21 Public Polling Policy Analysis/Research 22 90 Public Education Influencer Education Policymaker Education 63 81 71 PUBLIC INFLUENCERS Audiences DECISION MAKERS
  14. 14. Potential Case Study Grantees WILL AWARENESS Outcomes ACTION (n = 38) Community Mobilization 11 Community Organizing 9 Public Will Campaigns 3 Coalition Building 12 Media Advocacy 17 Communications and Model Legislation 11 Regulatory Feedback 8 Champion Development 9 Political Will Campaigns 1 Messaging Advocacy Capacity 11 Public Forums Building 10 5 Leadership Development Voter Outreach 4 Demonstration Programs 1 7 Public Awareness Campaigns 11 Public Polling Policy Analysis/Research 6 30 Public Education Influencer Education Policymaker Education 26 31 25 PUBLIC INFLUENCERS Audiences DECISION MAKERS
  15. 15. Repeat grantees ACTION (n = 75) Community Mobilization 14 WILL AWARENESS Outcomes Coalition Building 16 Model Legislation 19 Regulatory Feedback 8 Community Organizing Champion Development 9 10 Media Advocacy Public Will Campaigns Political Will Campaigns 22 3 1 Communications and Messaging Advocacy Capacity 22 Public Forums Building 15 6 Leadership Development Voter Outreach 4 Demonstration Programs 1 10 Public Awareness Campaigns 17 Public Polling Policy Analysis/Research 16 61 Public Education Influencer Education Policymaker Education 43 54 45 PUBLIC INFLUENCERS Audiences DECISION MAKERS
  16. 16. Grantees receiving >$300,000 ACTION (n = 69) Community Mobilization 17 WILL AWARENESS Outcomes Coalition Building 16 Model Legislation 22 Regulatory Feedback 17 Community Organizing Champion Development 7 13 Media Advocacy Public Will Campaigns Political Will Campaigns 31 1 2 Communications and Messaging Advocacy Capacity 27 Public Forums Building 25 4 Leadership Development Voter Outreach 5 Demonstration Programs 1 17 Public Awareness Campaigns 13 Public Polling Policy Analysis/Research 10 55 Public Education Influencer Education Policymaker Education 44 54 51 PUBLIC INFLUENCERS Audiences DECISION MAKERS
  17. 17. Grantees receiving $300,000 ACTION (n = 59) Community Mobilization 5 WILL AWARENESS Outcomes Coalition Building 9 Model Legislation 13 Regulatory Feedback 3 Community Organizing Champion Development 4 8 Media Advocacy Public Will Campaigns 15 2 Communications and Messaging Advocacy Capacity 16 Public Forums Building 9 7 Leadership Development 2 Demonstration Programs 6 Public Awareness Campaigns 12 Public Polling Policy Analysis/Research 16 51 Public Education Influencer Education Policymaker Education 30 42 35 PUBLIC INFLUENCERS Audiences DECISION MAKERS
  18. 18. How do you operationalize this information?
  19. 19. ACTION Framework for Public Policy Advocacy Litigation Community Mobilization Model Legislation Coalition Building WILL Champion Development Media Advocacy Public Will Campaigns Political Will Campaigns Communications and Messaging Advocacy Capacity Building AWARENESS OUTCOMES Community Organizing Regulatory Feedback Leadership Development Voter Outreach Public Forums Demonstration Programs Public Awareness Campaigns Public Polling Public Education PUBLIC Policy Analysis/Research Influencer Education INFLUENCERS AUDIENCES Policymaker Education DECISION MAKERS
  20. 20. ACTION WILL AWARENESS OUTCOMES Media Tracking PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
  21. 21. ACTION WILL AWARENESS OUTCOMES Legislative Assessment Checklist PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
  22. 22. ACTION WILL AWARENESS OUTCOMES Bellwether Interviews PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
  23. 23. ACTION WILL AWARENESS OUTCOMES Peer Perception Interviews PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
  24. 24. ACTION OUTCOMES WILL AWARENESS Context Mapping PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
  25. 25. ACTION OUTCOMES WILL AWARENESS Advocacy Timeline PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
  26. 26. ACTION OUTCOMES WILL AWARENESS Strategy Module Protocol PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
  27. 27. ACTION OUTCOMES WILL AWARENESS Process Tracing PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
  28. 28. ACTION Bellwether Interviews Media Tracking WILL AWARENESS OUTCOMES Peer Perception Interviews Legislative Assessment Checklist Context Mapping Advocacy Timeline Strategy Module Protocol Process Tracing PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
  29. 29. Summary/ Wrap up General Policy Analysis & Research Public Awareness/ Education Legislation Assistance Strategy Module Protocol Coalition Building Policymaker Education Community Organizing Community Mobilization Governmental Forums Media Campaign Advocacy Capacity Building
  30. 30. Summary/ Wrap up General Policy Analysis & Research Public Awareness/ Education Legislation Assistance Strategy Module Protocol Coalition Building Policymaker Education Community Organizing Community Mobilization Governmental Forums Media Campaign Advocacy Capacity Building
  31. 31. Summary/ Wrap up General Policy Analysis & Research Public Awareness/ Education Legislation Assistance Strategy Module Protocol Coalition Building Policymaker Education Community Organizing Community Mobilization Governmental Forums Media Campaign Advocacy Capacity Building
  32. 32. Summary/ Wrap up General Policy Analysis & Research Public Awareness/ Education Legislation Assistance Strategy Module Protocol Coalition Building Policymaker Education Community Organizing Community Mobilization Governmental Forums Media Campaign Advocacy Capacity Building
  33. 33. Media Campaign
  34. 34. Media Campaign Did your organization specifically target the media in your outreach?
  35. 35. Media Campaign Did your organization specifically target the media in your outreach? Which types of media outlets were you targeting?
  36. 36. Media Campaign Did your organization specifically target the media in your outreach? Which types of media outlets were you targeting? To what extent did your efforts enhance visibility of your issue?
  37. 37. Agenda 1 Setting the Stage 2 Process 3 Key Insights
  38. 38. Landscape http://www.flickr.com/x/t/0090009/photos/mdpettitt/4809326421/
  39. 39. Sub-group strategies http://www.flickr.com/x/t/0090009/photos/mdpettitt/4809326421/ http://www.flickr.com/x/t/0099009/photos/dangwynne/9342745130/
  40. 40. Strategies of each grantee http://www.flickr.com/x/t/0090009/photos/mdpettitt/4809326421/ http://www.flickr.com/x/t/0099009/photos/dangwynne/9342745130/ http://www.flickr.com/x/t/0099009/photos/rutgersmit/38040046/
  41. 41. ACTION Bellwether Interviews Media Tracking WILL AWARENESS OUTCOMES Peer Perception Interviews Legislative Assessment Checklist Context Mapping Advocacy Timeline Strategy Module Protocol Process Tracing PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
  42. 42. Thank You! Innovation Network Veena Pankaj Kat Athanasiades Director vpankaj@innonet.org Associate kathanasiades@innonet.org

×