• Save
Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation
Upcoming SlideShare
Loading in...5
×
 

Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation

on

  • 910 views

These slides accompanied a presentation at the American Evaluation Association's annual conference in October 2013 in Washington, DC. ...

These slides accompanied a presentation at the American Evaluation Association's annual conference in October 2013 in Washington, DC.

Innovation Network evaluators Veena Pankaj and Kat Athanasiades discussed how the Framework for Public Policy Advocacy was used in a retrospective evaluation of a large scale philanthropic public policy campaign. The framework helped to identify and plot grantee strategies across two dimensions - target audience(s) and desired outcomes. Using bubble charts to illustrate the strategic focus of each grantee, the evaluation team was able to recognize trends among the grantee partners, identify gaps and provide an aggregate overview of the types of strategies being supported. Presenters highlighted how the framework was used in selecting and developing appropriate data collection methodologies based on the strategic focus of the grantees. These methodologies were created to specifically correspond to the outcome areas and target audience(s) highlighted by the framework. Finally, the presenters reflected on lessons learns and share insights for improving advocacy evaluation at the portfolio level.

The presentation's handout is available here: http://www.innonet.org/resources/node/728

Innovation Network is a nonprofit evaluation, research, and consulting firm. We provide knowledge and expertise to help nonprofits and funders learn from their work to improve their results. To learn more, visit www.innonet.org.

Statistics

Views

Total Views
910
Views on SlideShare
663
Embed Views
247

Actions

Likes
1
Downloads
0
Comments
0

1 Embed 247

http://www.innonet.org 247

Accessibility

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

CC Attribution-ShareAlike LicenseCC Attribution-ShareAlike License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation Understanding the Public Policy Landscape: Lessons From a Retrospective Evaluation Presentation Transcript

    • Understanding the Public Policy Landscape Lessons from a Retrospective Evaluation Veena Pankaj Kat Athanasiades Innovation Network www.innonet.org
    • Agenda 1 Setting the Stage 2 Process 3 Key Insights
    • Agenda 1 Setting the Stage 2 Process 3 Key Insights
    • WHAT I REALLY DO
    • Agenda 1 Setting the Stage 2 Process 3 Key Insights
    • ACTION Framework for Public Policy Advocacy Litigation Community Mobilization Model Legislation Coalition Building WILL Champion Development Media Advocacy Public Will Campaigns Political Will Campaigns Communications and Messaging Advocacy Capacity Building AWARENESS OUTCOMES Community Organizing Regulatory Feedback Leadership Development Voter Outreach Public Forums Demonstration Programs Public Awareness Campaigns Public Polling Public Education PUBLIC Policy Analysis/Research Influencer Education INFLUENCERS AUDIENCES Policymaker Education DECISION MAKERS
    • Grant Amount: __________________________ Grant Number(s): ________________________ Key outcomes areas addressed: Strategies relevant to this grant(s): ACTION 1: Knowledge and Understanding for Action Litigation Community Mobilization Model Legislation Coalition Building WILL Community Organizing Media Advocacy Public Will Campaigns Regulatory Feedback 2: Partnerships Champion Development Political Will Campaigns 3: Policy Innovation Communications and Messaging Advocacy Capacity Building Leadership Development Voter Outreach AWARENESS OUTCOMES Content area: ___________________________ Grantee Name: __________________________ Grant Term(s): __________________________ Public Forums Targets: Demonstration Programs Public Awareness Campaigns Public Polling Public Education PUBLIC Strategy framework c/o: Policy Analysis/Research Influencer Education INFLUENCERS AUDIENCES Policymaker Education DECISION MAKERS 14 INNOVATION NETWORK, INC.
    • Basic Grantee Information Grantee Name: Organization X Grant Amount: $300,000 Grant Term(s): January 1, 2009-December 31, 2009 If multiple grants, reason for grouping: ☐ Same grant activity (i.e. a renewed or extended grant) ☐ Same topic/approach with related grant activities Topic Area: ☒Area A ☐ Area B ☐ Area C ☐ Area D ☐ Other Assessment This grant focuses on a tax coalition, which is comprised of 500 community asset-building organizations and pro bono tax sites across the county. With the funding, Organization X intended to launch a national advocacy campaign to inform policymakers, and do the following to advance its agenda: Build the affiliate base: Significantly increase the number of affiliates involved in the network from around 50 to over 100 Deliverable (2009): In first narrative report, Organization X indicates that # of affiliates reached 114 Create a comprehensive strategic communications plan. Focus on developing messages and eliciting stories to effectively and compellingly disseminate its core messages Deliverable (2009): Some client stories elicited in 2009, and planned to test a key message at local sites. Hire communications and political consultants Delayed in 2009. No info on this in 2010. Redesign the website Deliverable (2010): Redesigned website launched in Feb 2010 with a more robust set of advocacy tools for clients. Submit quarterly policy briefs and/or publish issue papers and disseminate to elected officials and their staffs and other policymakers Deliverable (2009): Wrote in-depth policy paper. Distributed paper to field partners and members of Congress on Day of Action Oct 2009. Also released a policy brief on VITA and two position statements. Deliverable (2010): Produced policy brief on refundable tax credits, distributed to partners and Congressional offices. Produced targeted fact sheets with locally-focused information to distribute to members of Congress. Organization X president testified during hearing for ☒Deliverables met ☐ Deliverables not met ☐ General operating support (no specific deliverables)
    • Basic Grantee Information Grantee Name: Organization X Grant Amount: $300,000 Grant Term(s): January 1, 2009-December 31, 2009 If multiple grants, reason for grouping: ☐ Same grant activity (i.e. a renewed or extended grant) ☐ Same topic/approach with related grant activities Topic Area: ☒Area A ☐ Area B ☐ Area C ☐ Area D ☐ Other Assessment This grant focuses on a tax coalition, which is comprised of 500 community asset-building organizations and pro bono tax sites across the county. With the funding, Organization X intended to launch a national advocacy campaign to inform policymakers, and do the following to advance its agenda: Build the affiliate base: Significantly increase the number of affiliates involved in the network from around 50 to over 100 Deliverable (2009): In first narrative report, Organization X indicates that # of affiliates reached 114 Create a comprehensive strategic communications plan. Focus on developing messages and eliciting stories to effectively and compellingly disseminate its core messages Deliverable (2009): Some client stories elicited in 2009, and planned to test a key message at local sites. Hire communications and political consultants Delayed in 2009. No info on this in 2010. Redesign the website Deliverable (2010): Redesigned website launched in Feb 2010 with a more robust set of advocacy tools for clients. Submit quarterly policy briefs and/or publish issue papers and disseminate to elected officials and their staffs and other policymakers Deliverable (2009): Wrote in-depth policy paper. Distributed paper to field partners and members of Congress on Day of Action Oct 2009. Also released a policy brief on VITA and two position statements. Deliverable (2010): Produced policy brief on refundable tax credits, distributed to partners and Congressional offices. Produced targeted fact sheets with locally-focused information to distribute to members of Congress. Organization X president testified during hearing for Media Advocacy Public/Influencer Education Public Education Policymaker Education ☒Deliverables met ☐ Deliverables not met ☐ General operating support (no specific deliverables)
    • Grant Amount: __________________________ $300,000 OrgX20090112 Grant Number(s): ________________________ Key outcomes areas addressed: Strategies relevant to this grant(s): ACTION 1: Knowledge and Understanding for Action Litigation Community Mobilization Model Legislation Coalition Building WILL Community Organizing Media Advocacy Public Will Campaigns Regulatory Feedback 2: Partnerships Champion Development Political Will Campaigns 3: Policy Innovation Communications and Messaging Advocacy Capacity Building Leadership Development Voter Outreach AWARENESS OUTCOMES Content area: ___________________________ Area A Organization X Grantee Name: __________________________ Grant Term(s): __________________________ 1/1/09-12/31/09 Public Forums Targets: Demonstration Programs Public Awareness Campaigns Public Polling Public Education PUBLIC Strategy framework c/o: Policy Analysis/Research Influencer Education INFLUENCERS AUDIENCES Policymaker Education DECISION MAKERS 17 INNOVATION NETWORK, INC.
    • Grant Amount: __________________________ $300,000 OrgX20090112 Grant Number(s): ________________________ Key outcomes areas addressed: Strategies relevant to this grant(s): ACTION 1: Knowledge and Understanding for Action Litigation Community Mobilization Model Legislation Coalition Building WILL Community Organizing Media Advocacy Public Will Campaigns Regulatory Feedback 2: Partnerships Champion Development Political Will Campaigns 3: Policy Innovation Communications and Messaging Advocacy Capacity Building Leadership Development Voter Outreach AWARENESS OUTCOMES Content area: ___________________________ Area A Organization X Grantee Name: __________________________ Grant Term(s): __________________________ 1/1/09-12/31/09 Public Forums Targets: Demonstration Programs Policymakers Public Awareness Campaigns Public Polling Public Education PUBLIC Strategy framework c/o: Policy Analysis/Research Influencer Education INFLUENCERS AUDIENCES Advocates Policymaker Education DECISION MAKERS INNOVATION NETWORK, INC.
    • ACTION Organization X WILL Media Advocacy Communications and Messaging Public Forums AWARENESS Outcomes Model Legislation Policy Analysis/Research Public Education PUBLIC Influencer Education INFLUENCERS Audiences Policymaker Education DECISION MAKERS
    • All Grants WILL AWARENESS Outcomes ACTION (n = 110) Community Mobilization 18 Community Organizing 10 Public Will Campaigns 3 Coalition Building 21 Media Advocacy 36 Communications and Model Legislation 29 Regulatory Feedback 14 Champion Development 15 Political Will Campaigns 1 Messaging Advocacy Capacity 36 Public Forums Building 27 9 Leadership Development Voter Outreach 6 Demonstration Programs 1 18 Public Awareness Campaigns 21 Public Polling Policy Analysis/Research 22 90 Public Education Influencer Education Policymaker Education 63 81 71 PUBLIC INFLUENCERS Audiences DECISION MAKERS
    • Potential Case Study Grantees WILL AWARENESS Outcomes ACTION (n = 38) Community Mobilization 11 Community Organizing 9 Public Will Campaigns 3 Coalition Building 12 Media Advocacy 17 Communications and Model Legislation 11 Regulatory Feedback 8 Champion Development 9 Political Will Campaigns 1 Messaging Advocacy Capacity 11 Public Forums Building 10 5 Leadership Development Voter Outreach 4 Demonstration Programs 1 7 Public Awareness Campaigns 11 Public Polling Policy Analysis/Research 6 30 Public Education Influencer Education Policymaker Education 26 31 25 PUBLIC INFLUENCERS Audiences DECISION MAKERS
    • Repeat grantees ACTION (n = 75) Community Mobilization 14 WILL AWARENESS Outcomes Coalition Building 16 Model Legislation 19 Regulatory Feedback 8 Community Organizing Champion Development 9 10 Media Advocacy Public Will Campaigns Political Will Campaigns 22 3 1 Communications and Messaging Advocacy Capacity 22 Public Forums Building 15 6 Leadership Development Voter Outreach 4 Demonstration Programs 1 10 Public Awareness Campaigns 17 Public Polling Policy Analysis/Research 16 61 Public Education Influencer Education Policymaker Education 43 54 45 PUBLIC INFLUENCERS Audiences DECISION MAKERS
    • Grantees receiving >$300,000 ACTION (n = 69) Community Mobilization 17 WILL AWARENESS Outcomes Coalition Building 16 Model Legislation 22 Regulatory Feedback 17 Community Organizing Champion Development 7 13 Media Advocacy Public Will Campaigns Political Will Campaigns 31 1 2 Communications and Messaging Advocacy Capacity 27 Public Forums Building 25 4 Leadership Development Voter Outreach 5 Demonstration Programs 1 17 Public Awareness Campaigns 13 Public Polling Policy Analysis/Research 10 55 Public Education Influencer Education Policymaker Education 44 54 51 PUBLIC INFLUENCERS Audiences DECISION MAKERS
    • Grantees receiving $300,000 ACTION (n = 59) Community Mobilization 5 WILL AWARENESS Outcomes Coalition Building 9 Model Legislation 13 Regulatory Feedback 3 Community Organizing Champion Development 4 8 Media Advocacy Public Will Campaigns 15 2 Communications and Messaging Advocacy Capacity 16 Public Forums Building 9 7 Leadership Development 2 Demonstration Programs 6 Public Awareness Campaigns 12 Public Polling Policy Analysis/Research 16 51 Public Education Influencer Education Policymaker Education 30 42 35 PUBLIC INFLUENCERS Audiences DECISION MAKERS
    • How do you operationalize this information?
    • ACTION Framework for Public Policy Advocacy Litigation Community Mobilization Model Legislation Coalition Building WILL Champion Development Media Advocacy Public Will Campaigns Political Will Campaigns Communications and Messaging Advocacy Capacity Building AWARENESS OUTCOMES Community Organizing Regulatory Feedback Leadership Development Voter Outreach Public Forums Demonstration Programs Public Awareness Campaigns Public Polling Public Education PUBLIC Policy Analysis/Research Influencer Education INFLUENCERS AUDIENCES Policymaker Education DECISION MAKERS
    • ACTION WILL AWARENESS OUTCOMES Media Tracking PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
    • ACTION WILL AWARENESS OUTCOMES Legislative Assessment Checklist PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
    • ACTION WILL AWARENESS OUTCOMES Bellwether Interviews PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
    • ACTION WILL AWARENESS OUTCOMES Peer Perception Interviews PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
    • ACTION OUTCOMES WILL AWARENESS Context Mapping PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
    • ACTION OUTCOMES WILL AWARENESS Advocacy Timeline PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
    • ACTION OUTCOMES WILL AWARENESS Strategy Module Protocol PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
    • ACTION OUTCOMES WILL AWARENESS Process Tracing PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
    • ACTION Bellwether Interviews Media Tracking WILL AWARENESS OUTCOMES Peer Perception Interviews Legislative Assessment Checklist Context Mapping Advocacy Timeline Strategy Module Protocol Process Tracing PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
    • Summary/ Wrap up General Policy Analysis & Research Public Awareness/ Education Legislation Assistance Strategy Module Protocol Coalition Building Policymaker Education Community Organizing Community Mobilization Governmental Forums Media Campaign Advocacy Capacity Building
    • Summary/ Wrap up General Policy Analysis & Research Public Awareness/ Education Legislation Assistance Strategy Module Protocol Coalition Building Policymaker Education Community Organizing Community Mobilization Governmental Forums Media Campaign Advocacy Capacity Building
    • Summary/ Wrap up General Policy Analysis & Research Public Awareness/ Education Legislation Assistance Strategy Module Protocol Coalition Building Policymaker Education Community Organizing Community Mobilization Governmental Forums Media Campaign Advocacy Capacity Building
    • Summary/ Wrap up General Policy Analysis & Research Public Awareness/ Education Legislation Assistance Strategy Module Protocol Coalition Building Policymaker Education Community Organizing Community Mobilization Governmental Forums Media Campaign Advocacy Capacity Building
    • Media Campaign
    • Media Campaign Did your organization specifically target the media in your outreach?
    • Media Campaign Did your organization specifically target the media in your outreach? Which types of media outlets were you targeting?
    • Media Campaign Did your organization specifically target the media in your outreach? Which types of media outlets were you targeting? To what extent did your efforts enhance visibility of your issue?
    • Agenda 1 Setting the Stage 2 Process 3 Key Insights
    • Landscape http://www.flickr.com/x/t/0090009/photos/mdpettitt/4809326421/
    • Sub-group strategies http://www.flickr.com/x/t/0090009/photos/mdpettitt/4809326421/ http://www.flickr.com/x/t/0099009/photos/dangwynne/9342745130/
    • Strategies of each grantee http://www.flickr.com/x/t/0090009/photos/mdpettitt/4809326421/ http://www.flickr.com/x/t/0099009/photos/dangwynne/9342745130/ http://www.flickr.com/x/t/0099009/photos/rutgersmit/38040046/
    • ACTION Bellwether Interviews Media Tracking WILL AWARENESS OUTCOMES Peer Perception Interviews Legislative Assessment Checklist Context Mapping Advocacy Timeline Strategy Module Protocol Process Tracing PUBLIC INFLUENCERS AUDIENCES DECISION MAKERS
    • Thank You! Innovation Network Veena Pankaj Kat Athanasiades Director vpankaj@innonet.org Associate kathanasiades@innonet.org