This document provides an interim summary of findings from an evaluation of nuclear security communications. It summarizes data collected from grantee surveys and interviews, as well as interviews with 24 policymakers. Key findings include:
- Policymakers see value in external communications for informing those in government and validating government efforts.
- The most useful communications come in a variety of formats, are concise, and utilize credible external validators like those with government experience.
- There is a disconnect between how grantees rate their own effectiveness and what policymakers say they find useful. Grantees could better tune into the current policy context and frame messages proactively.
- Action is needed to strengthen grantee communications and for grantees to utilize
Working with complexity: Six steps to enhance researchODI_Webmaster
John Young's presentation at the GDN workshop on 'Maximizing the Impact of Agricultural Research in Africa' held in Addis Ababa, Ethiopia in October 2008. In his talk, he outlines how organisations can work within complex policy processes to achieve impact and expands on several tools that can be used as part of this process.
Planning for impact: Basic communication strategiesODI_Webmaster
This presentation from Jeff Knezovich of the Overseas Development Institute was given at a workshop held on research packaging at ESRF in Tanzania in August 2008. It was prepared for the Micro-level Perspectives of Growth project currently being undertaken by the University of Dar es Salaam Department of Economics. More information on the project can be found at http://www.esrftz.org/mlpg
Advocacy and Lobbying from a Local and Global prospectiveAdnan Khuram Hayat
Quick guide for small and mid-sized Non-governmental Organizations' (NGOs'), Civil Society Organizations' (CSOs'), Community Based Organizations (CBOs'), Charities & Causes
Review of Communications in DFID-funded Research Programme Consortia (RPCs)ODI_Webmaster
A presentation given by John Young, director of the Research and Policy in Development (RAPID) group at ODI, at the 3rd Annual Research Communications Workshop for RPCs at DFID in July 2008. The presentation outlines initial research findings about the role of DFID's '10% for communications' rule.
Working with complexity: Six steps to enhance researchODI_Webmaster
John Young's presentation at the GDN workshop on 'Maximizing the Impact of Agricultural Research in Africa' held in Addis Ababa, Ethiopia in October 2008. In his talk, he outlines how organisations can work within complex policy processes to achieve impact and expands on several tools that can be used as part of this process.
Planning for impact: Basic communication strategiesODI_Webmaster
This presentation from Jeff Knezovich of the Overseas Development Institute was given at a workshop held on research packaging at ESRF in Tanzania in August 2008. It was prepared for the Micro-level Perspectives of Growth project currently being undertaken by the University of Dar es Salaam Department of Economics. More information on the project can be found at http://www.esrftz.org/mlpg
Advocacy and Lobbying from a Local and Global prospectiveAdnan Khuram Hayat
Quick guide for small and mid-sized Non-governmental Organizations' (NGOs'), Civil Society Organizations' (CSOs'), Community Based Organizations (CBOs'), Charities & Causes
Review of Communications in DFID-funded Research Programme Consortia (RPCs)ODI_Webmaster
A presentation given by John Young, director of the Research and Policy in Development (RAPID) group at ODI, at the 3rd Annual Research Communications Workshop for RPCs at DFID in July 2008. The presentation outlines initial research findings about the role of DFID's '10% for communications' rule.
Public relations in policy evaluation and implementationBolaji Okusaga
The role of Public Relations in helping to create an ambient environment for policy discussions and policy engagement continues to come under focus. This presentation discusses best practice route to attaining that objective.
How can NGOs and civil society organisations enhance their production and use...Sarah King
Ruth Mayne is Oxfam’s Senior Researcher on Influencing and its Effectiveness. She has an interdisciplinary background and a long experience working as a researcher, policy advisor and practitioner on humanitarian, development and environmental issues.
This is the paper for the session given at the Health Psychology in Public Health Network Symposium in February 2015 on bridging the gap between policy, practice and research
The failure of researchers to link evidence to policy and practice produces evidence that no one uses, impedes innovation, and leads to mediocre or even detrimental development policies. To help improve the definition, design, and implementation of policy research, researchers should adopt a strategic outcome-oriented approach.
Strategies to enhance research impact: Six lessonsODI_Webmaster
John Young's presentation at the GDN workshop on 'Maximizing the Impact of Agricultural Research in Africa' held in Addis Ababa, Ethiopia in October 2008. In his talk, he reviews and expands upon the six lessons that ODI's RAPID programme has learned about helping research inform policy and practice.
This presentation describes the findings from The California Endowment Clinic Consortia Policy and Advocacy Program Evaluation, including: activities to increase clinic consortia advocacy capacity; expanded decision maker support for key policies benefiting clinics and their target populations; and expanded access to health care care for vulnerable populations. Summary findings and lessons for evaluators are included.
Randomised control trials: lessons for Civic Tech - Andrew Westbury (Center f...mysociety
This was presented by Andrew Westbury from the Center for Effective Global Action at the Impacts of Civic Technology Conference (TICTeC 2017) in Florence on 25th April. You can find out more information about the conference here: http://tictec.mysociety.org
Session description: Randomised controlled trials have dramatically changed the development landscape, casting doubt on the effectiveness of accepted strategies, and identifying the value of less orthodox activities.
Randomized Controlled Trials: Insights for Civic Tech Andrew Westbury
Randomized controlled trials – or RCTs – have dramatically changed the development landscape, casting doubt on the effectiveness of accepted strategies – like microfinance – and identifying the value of previously-unorthodox activities, like unconditional cash transfers.
However, what have these powerful tools taught us about state capacity, government accountability, and responsiveness? Moreover, what does the RCT literature tell us about the use of technology to improve public services and galvanize citizen groups?
Unfortunately, state capacity and government accountability are some of the least-researched areas of international development. The International Initiative for Impact Evaluation (3ie) reports that less than 3% of registered impact evaluations focus on governance-related issues.
Moreover, a review of 175 recent RCTs identified only approximately 30 that included a specific tech-focus and few of these evaluated used tech from the “bottom-up” to catalyse community-action, peer-to-peer collaboration, and citizen-led efforts to address civic issues.
The Center for Effective Global Action (CEGA) at UC-Berkeley has recently launched a multi-year effort to support randomised evaluations of governance interventions around the world. As a part of this process, CEGA this year published a white paper, surveying over 200 recent impact evaluations on governance issues to identify “what works” and highlight open research questions.
Presentation by Rachel Holloway, Department for Business, Energy, & Industrial Strategy, United Kingdom, at the RIA workshop which took place in Lima on 22-24 May 2017. Further information is available at www.oecd.org/gov/regulatory-policy/.
Public relations in policy evaluation and implementationBolaji Okusaga
The role of Public Relations in helping to create an ambient environment for policy discussions and policy engagement continues to come under focus. This presentation discusses best practice route to attaining that objective.
How can NGOs and civil society organisations enhance their production and use...Sarah King
Ruth Mayne is Oxfam’s Senior Researcher on Influencing and its Effectiveness. She has an interdisciplinary background and a long experience working as a researcher, policy advisor and practitioner on humanitarian, development and environmental issues.
This is the paper for the session given at the Health Psychology in Public Health Network Symposium in February 2015 on bridging the gap between policy, practice and research
The failure of researchers to link evidence to policy and practice produces evidence that no one uses, impedes innovation, and leads to mediocre or even detrimental development policies. To help improve the definition, design, and implementation of policy research, researchers should adopt a strategic outcome-oriented approach.
Strategies to enhance research impact: Six lessonsODI_Webmaster
John Young's presentation at the GDN workshop on 'Maximizing the Impact of Agricultural Research in Africa' held in Addis Ababa, Ethiopia in October 2008. In his talk, he reviews and expands upon the six lessons that ODI's RAPID programme has learned about helping research inform policy and practice.
This presentation describes the findings from The California Endowment Clinic Consortia Policy and Advocacy Program Evaluation, including: activities to increase clinic consortia advocacy capacity; expanded decision maker support for key policies benefiting clinics and their target populations; and expanded access to health care care for vulnerable populations. Summary findings and lessons for evaluators are included.
Randomised control trials: lessons for Civic Tech - Andrew Westbury (Center f...mysociety
This was presented by Andrew Westbury from the Center for Effective Global Action at the Impacts of Civic Technology Conference (TICTeC 2017) in Florence on 25th April. You can find out more information about the conference here: http://tictec.mysociety.org
Session description: Randomised controlled trials have dramatically changed the development landscape, casting doubt on the effectiveness of accepted strategies, and identifying the value of less orthodox activities.
Randomized Controlled Trials: Insights for Civic Tech Andrew Westbury
Randomized controlled trials – or RCTs – have dramatically changed the development landscape, casting doubt on the effectiveness of accepted strategies – like microfinance – and identifying the value of previously-unorthodox activities, like unconditional cash transfers.
However, what have these powerful tools taught us about state capacity, government accountability, and responsiveness? Moreover, what does the RCT literature tell us about the use of technology to improve public services and galvanize citizen groups?
Unfortunately, state capacity and government accountability are some of the least-researched areas of international development. The International Initiative for Impact Evaluation (3ie) reports that less than 3% of registered impact evaluations focus on governance-related issues.
Moreover, a review of 175 recent RCTs identified only approximately 30 that included a specific tech-focus and few of these evaluated used tech from the “bottom-up” to catalyse community-action, peer-to-peer collaboration, and citizen-led efforts to address civic issues.
The Center for Effective Global Action (CEGA) at UC-Berkeley has recently launched a multi-year effort to support randomised evaluations of governance interventions around the world. As a part of this process, CEGA this year published a white paper, surveying over 200 recent impact evaluations on governance issues to identify “what works” and highlight open research questions.
Presentation by Rachel Holloway, Department for Business, Energy, & Industrial Strategy, United Kingdom, at the RIA workshop which took place in Lima on 22-24 May 2017. Further information is available at www.oecd.org/gov/regulatory-policy/.
Stakeholder Engagement in the Context of Conflict Analysis and InterventionSharon McCarthy
Royal Roads University
Program: Graduate Diploma in Conflict Analysis and Management
Lecture: Stakeholder Engagement, (a how-to guide for undertaking this aspect of project planning)
Understanding the Challenges of Street ChildrenSERUDS INDIA
By raising awareness, providing support, advocating for change, and offering assistance to children in need, individuals can play a crucial role in improving the lives of street children and helping them realize their full potential
Donate Us
https://serudsindia.org/how-individuals-can-support-street-children-in-india/
#donatefororphan, #donateforhomelesschildren, #childeducation, #ngochildeducation, #donateforeducation, #donationforchildeducation, #sponsorforpoorchild, #sponsororphanage #sponsororphanchild, #donation, #education, #charity, #educationforchild, #seruds, #kurnool, #joyhome
Jennifer Schaus and Associates hosts a complimentary webinar series on The FAR in 2024. Join the webinars on Wednesdays and Fridays at noon, eastern.
Recordings are on YouTube and the company website.
https://www.youtube.com/@jenniferschaus/videos
Monitoring Health for the SDGs - Global Health Statistics 2024 - WHOChristina Parmionova
The 2024 World Health Statistics edition reviews more than 50 health-related indicators from the Sustainable Development Goals and WHO’s Thirteenth General Programme of Work. It also highlights the findings from the Global health estimates 2021, notably the impact of the COVID-19 pandemic on life expectancy and healthy life expectancy.
This session provides a comprehensive overview of the latest updates to the Uniform Administrative Requirements, Cost Principles, and Audit Requirements for Federal Awards (commonly known as the Uniform Guidance) outlined in the 2 CFR 200.
With a focus on the 2024 revisions issued by the Office of Management and Budget (OMB), participants will gain insight into the key changes affecting federal grant recipients. The session will delve into critical regulatory updates, providing attendees with the knowledge and tools necessary to navigate and comply with the evolving landscape of federal grant management.
Learning Objectives:
- Understand the rationale behind the 2024 updates to the Uniform Guidance outlined in 2 CFR 200, and their implications for federal grant recipients.
- Identify the key changes and revisions introduced by the Office of Management and Budget (OMB) in the 2024 edition of 2 CFR 200.
- Gain proficiency in applying the updated regulations to ensure compliance with federal grant requirements and avoid potential audit findings.
- Develop strategies for effectively implementing the new guidelines within the grant management processes of their respective organizations, fostering efficiency and accountability in federal grant administration.
Presentation by Jared Jageler, David Adler, Noelia Duchovny, and Evan Herrnstadt, analysts in CBO’s Microeconomic Studies and Health Analysis Divisions, at the Association of Environmental and Resource Economists Summer Conference.
Jennifer Schaus and Associates hosts a complimentary webinar series on The FAR in 2024. Join the webinars on Wednesdays and Fridays at noon, eastern.
Recordings are on YouTube and the company website.
https://www.youtube.com/@jenniferschaus/videos
Donate to charity during this holiday seasonSERUDS INDIA
For people who have money and are philanthropic, there are infinite opportunities to gift a needy person or child a Merry Christmas. Even if you are living on a shoestring budget, you will be surprised at how much you can do.
Donate Us
https://serudsindia.org/how-to-donate-to-charity-during-this-holiday-season/
#charityforchildren, #donateforchildren, #donateclothesforchildren, #donatebooksforchildren, #donatetoysforchildren, #sponsorforchildren, #sponsorclothesforchildren, #sponsorbooksforchildren, #sponsortoysforchildren, #seruds, #kurnool
1. 1
Interim Presentation of Findings from the
Evaluation of Nuclear Security Communications
Prepared by ORS Impact, with Joy Drucker
Prepared for Carnegie Corporation of New York, Colombe
Foundation, John D. and Catherine T. MacArthur Foundation, and
The William & Flora Hewlett Foundation
June 2014
2. 2
Purpose of Today’s Discussion
• Provide a status update
Interviews completed
Analysis completed
• Share draft findings
June 26th webinar
Seek feedback from the funders
Lift up questions
Identify actionable areas that inform grantmaking
• Discuss plans for finalizing presentation and reporting
4. 4
• Improve understanding of how foundations might target grant support
in order to increase the influence of grantees’ communications
approaches
Evaluation Purpose
5. Joy Drucker
engaged in advisory
role by funders as
content expert
Grantee Data
• Surveys (n=22) and interviews (n=23) with grantees conducted by Fenton
Communications
• Grantee data was used to develop the sample of policy makers, develop
policy maker interview guide, identify key themes and triangulate findings
Policy Maker Data
• Confidential interviews (n=24) with policy makers
• Policy maker data was used to address research questions related to grantee
communications
Evaluation Design
Oct Nov Dec Jan Feb Mar Apr May June July
Fenton
Communications
conducts Grantee
Surveys and Interviews
Conduct
Policy
Maker
Interviews
2014
ORS Impact
engaged
Review and
analyze grantee
data
Interim
presentation to
funders
Final
presentation
and report
6. 6
Data Analysis
The ORS Impact team
• Summarized descriptive information from grantee surveys and themes
from grantees interviews
• Created descriptive categories to describe policy makers (e.g. branch
of government, political party, length of career, gender)
• Coded policy maker interviews and extracted key themes
• Themes reflect a weight of evidence as well as unique perspectives that
provide actionable insights
• Examined policy maker interview data to determine any differences
based on descriptive characteristics
7. 7
Grantee Data
• Characterization of grantees based on Fenton Communications’
description:
32%
36%
14%
18%
FTEs working on Nuclear
Security (n=22)
Very few FTEs working on nuclear
security, esp given the size of
organizations
0 to 5 6 to 10 11 to 15 >15
50%
25%
25%
Type of Organization (n=22)
Half are focused on advocacy; the other half
are divided between think tanks and
academia
Advocacy Organizations Think Tanks
Academic Institutions
5%
18%
45%5%
27%
Budgets (n=23)
All but one have budgets over $500,000
Under $100,000 $100,000 to $499,000 $500,000 to $999,999
$1 million to $4.99 million $5 million to $9.99 million $10 million or more
8. 8
Policy Maker Data
• Characterization of policy makers that participated in interviews were as follows:
*”Narrow aperture” denotes policy makers focused on nuclear issues; “wide aperture” refers to policy
makers focused on a wider set of issues.
58%
42%
Aperture* (n=24)
Interviews are divided between narrow
and wide focus
Wide Aperture Narrow Aperture
46%
29%
25%
Current Role (n=24)
Split between current and former policy maker roles
Former High-Level Position(s) in Government
Executive Branch
Legislative Branch 21%
79%
Length of Career (n=24)
Majority of respondents are post-Cold War
Pre-1980s Post 1980s
9. 9
Policy Maker Data
• Characterization of policy makers that participated in interviews were as follows:
*These numbers are reflective of the overall sample that we approached for interviews. Of the
36 policymakers identified in the process that ORS Impact reached out to, eight were female
and seven were republicans
79%
21%
Gender* (n=24)
More women than men
Male Female
83%
17%
Party Affiliation* (n=24)
More democrats than republicans
Democrat Republican
10. 10
Seeking Reactions and Feedback from Funders
• What resonates?
• Anything surprising?
• Need for clarification?
• Key take-aways?
• What are the implications of these findings?
• E.g. how can funders deliver the most effective grant making
approach in the area of nuclear security communications?
11. Grantee Self Report of their
Communication Efforts
Grantee Survey
and Interview
Findings:
12. 12
Grantee Self Report of their Communication Efforts
• Majority report having small communications shops
• Majority report having a strong understanding of policymaker’s
unique needs and the political environment
• Majority rate themselves very high on effectively influencing
legislative and executive outcomes
• Majority rate themselves highest around influencing the nuclear security
policy discourse
• Grantees report targeting both legislative and executive branches
with their communications
13. 13
Grantee Self Report of their Communication Efforts (cont)
• 74% of grantees report having some type of communications plan
• Most popular common grantee communication products include full
reports, policy briefs, lectures/briefings and editorials
• Majority of grantees rely on personal relationships and connections
within government to augment their communication efforts
14. 14
Grantee Self Report of their Communication Efforts (cont)
• Grantees report four primary limitations emerged from the grantee
data that inhibits the effectiveness of grantee communications:
• Nuclear security issues have been deprioritized in the current policy
discourse
• Opponents have the liberty to criticize a proposed nuclear security
policy with little repercussion
• Polling indicates that salience of nuclear issues is very low amongst the
general public
• Increased partisanship has made it very difficult to find Republican
champions
16. 16
Perspectives About the Relative Value of External
Communications
Value of external communications:
1) Educates and informs those inside
government
2) Informs the public
3) Frames issues
4) Supports government efforts to
communicate with key audiences
5) Breaks through “group think”
6) Provides “cover” or “validation”
• Weight of evidence strongly indicates that policy makers’ view
external communications as valuable for those in government.
18. 18
Elements of Useful Communications
• Weight of evidence indicates the most useful communications
come via a variety of formats, are simple, and utilize credible
external validators.
1) No single communications approach is
sufficient to reach all policy makers;
multiple platforms are needed.
2) Those inside government have limited
bandwidth; clear messages, brevity and
(relative) simplicity are important.
3) Credible external validators improve
influence and persuasion.
4) Reports are important, but alone are not
sufficient for a policy maker audience.
5) Communications can be more useful if
made relevant to the current policy context
and/or policy makers’ agendas and needs.
6) Useful communications utilize a strong,
unifying frame.
20. 20
Credible and influential individuals
Characteristics of credible and influential individuals:
• Past government experience (15+years)
• High level government experience
• Prominent journalists
• Current or former high-ranking military officials
*The size of the name is representative of the frequency that each individual was
mentioned in the policymaker interviews.
21. 21
Credible and influential organizations
The size of the name is representative of the frequency that each organization
was mentioned in the policymaker interviews.
23. 23
Actionable Implications
1) There is considerable work to do to
strengthen grantee communications
• Gap between the current status of
grantee communications and what
policy makers report as useful and
effective
• Need to “serve it up right”
Disconnect; grantees reported
that they feel they effectively
influence the nuclear security
policy discourse
24. 24
Actionable Implications (cont)
2) Grantees need to be tuned in and
additive to the current policy
context
• What is currently moving
• Recognition of policy maker needs,
perceptions and constraints (e.g.,
trade-offs)
• Find openings based on what is of
highest priority to certain individuals
Disconnect; grantees report a strong
understanding of policy makers’ unique
needs and the political environment
25. 25
Actionable Implications (cont)
3) Frame message proactively and
strongly
• Policy makers have limited bandwidth
• Policy makers are looking for actionable
information
• New START Treaty as an exemplar
• Drive new thinking on long-term
issues– help policy makers break out of
groupthink
Disconnect; policy makers report grantees
often provide dense reports – policy
makers would prefer shorter, more
targeted communications
26. 26
4) It is important that grantees show up in person and not fear being
seen as lobbying.
• Policy makers felt the nuclear security community seemed afraid of
“crossing the line,” and indicated that nuclear security community can and
should be more visible and assertive and that doing so does not “cross the
line.”
• Policy makers noted that as a general rule progressive groups generally
self-impose greater constraints, perhaps because they have an incorrect
understanding of the law, and more right-leaning groups are less
constrained and therefore make more of their advocacy efforts.
• Grantees may need clarity that their work reflects education. Non-
profits are permitted under U.S. law to educate and inform about
treaties and legislation, e.g. explain the value of a treaty like New
START but not say “please vote for this treaty.”
Actionable Implications (cont)
Disconnect; policy makers express preference for direct contact and
communication and grantees keep a distance
27. 27
5) Utilize credible external validators
• Credibility is based on many factors,
including trust, prestige, unlikely allies,
unexpected voices
• External validators may write articles or
op-eds, testify, make personal contact
Actionable Implications (cont)
Opportunity; while grantees use
validators, it could happen more often
and/or grantees could more frequently
utilize the most credible voices
28. 28
6) Aim communications at those that
aren’t in government now but will be
someday, or people who serve in
more junior positions who might be
promoted in the future.
• Many policy makers new to
foreign relations and nuclear
security
• Nuclear security “not sexy” to
young people
Actionable Implications (cont)
Disconnect; limited outreach to
younger/newer policy makers and youth;
tightly knit and aging nuclear security
community
30. 30
Jane Reisman, jreisman@orsimpact.com
Anne Gienapp, agienapp@orsimpact.com
Cameron Clark, cclark@orsimpact.com
Jill Hurson, jhurson@orsimpact.com
With Joy Drucker, joydrucker@msn.com
Editor's Notes
Of the 48 individuals mentioned
-32 had government experience,
-22 of the 32 had 20 or more years of government experience
-9 journalists were referenced
-almost all were widely published
-those who didn’t have a long history often had another important piece of knowledge e.g. specific expertise in foreign affairs in Iran/Russia
There were no discernible differences when looking at the data by party affiliation, current/past position, or branch of government
Looking at creating another wordle—website was crashing on 6/17