Communicating science information is vital for supporting policy and decision-making in forestry, because there is still a sizeable gap between knowledge and uptake/adoption. This presentation explores the impact pathway, particularly in relation to CRP6 (the CGIAR Research Program on Forests, Trees and Agroforestry), emphasising that policy knowledge is only effective when shared appropriately.
CIFOR scientist and CRP6 Director Robert Nasi gave this presentation on 28 June 2012 at the International Tropical Timber Organization (ITTO) and African Forest Forum (AFF) Forest Policy Day, held in Nairobi, Kenya, in conjunction with the IUFRO-FORNESSA Regional Congress. The theme of the forest policy day was “The policy-science interface for sustainable forest management in Africa”. For more information about CRP6, please visit www.cifor.org/crp6
2. The policy change
process
‘The whole life of policy is
a chaos of purposes and
accidents. It is not at all a
matter of the rational
implementation of the so-
called decisions through
selected strategies.’
Clay and Schaffer (1984).
3. The gap between
knowledge and
practice
‘Constraints to successful
management of sustainable
forest management over
the years largely relate to
the adoption of
recommendations - not the
generation of ‘best
practice’. Dawkins & Phillip (1998).
4. Who needs to know?
Policy knowledge . . . is not effective if retained in the
hands of the producer.
Policy makers . . . do not generally go about seeking
knowledge to assist them in understanding every
decision they must make.
Policy knowledge . . . must be expressed,
communicated, channeled, explained or otherwise
distributed to policymakers if it is to affect policy
decisions' (Webber 1991).
6. Uptake / Adoption Curves
Research shows that when 10 to 25% of a target ‘population’
has adopted an innovation, the whole process becomes self-
sustaining.
ONLY THEN DO ‘GOOD PRODUCTS SELL THEMSELVES’
Cumulative
Early Late
Majority Majority
Number
of
users Early Adopters Laggards
Frequency
Pioneers
Time
7. The Impact Pathway model
Inputs
(e.g. finance, staff, equipment,
systems, etc…)
Outputs
(e.g. publication, training,
databases)
Impacts SRF
(e.g. reduced deforestation 4 system-level
Outcomes and degradation)
(e.g. forests and tree outcomes
resources are better
managed)
8. In fact it is probably more like this…
KASA: knowledge, attitudes,
skills, aspirations
From http://boru.pbworks.com/w/page/13774906/Learning-Selection-Change-Model
10. Impact Pathway
The bushmeat issue
Keynote to CBD
(2001)
Liaison group Support from Bushmeat CBD
on NTFP African Parties priority at COP 9
(2008)
Scientific work: Liaison group
PhDs, review, on bushmeat
papers, etc. (2009)
(2002-2008)
Recommendation COP 10 Decision
to SBSTTA (2010) (2010)
Scientific work
with actors Tools, guidelines
(2012, OT) Policy changes
(2009-2011)
(2011-2012)
Improved, more sustainable
practices (2012-)
11. Impact Pathway: inputs to outputs
Inputs: CRP6
5 components
15 research themes
+ Gender, Capacity building,
Sentinel landscapes
Original research and
capacity building with
research partners
Outputs Outcomes
(e.g. publication, training, (e.g. forests and tree
resources are better Impacts
databases) (e.g. reduced deforestation
managed)
and degradation)
SRF
4 system-level
outcomes
12. Research outputs
Overall, the production
of science outputs is not
a major issue
but
Publication results can
be improved in terms of
quality and quantity
Other types of outputs
(e.g. capacity building,
gender) are not yet
adequately considered
and/or recorded
THINKING beyond the canopy
13. Research outputs: New (?) Thinking
10000 Original scientific pieces
H factor:
D. Tilman 51
in reputable journals with
N. Stern 19 good research partners
B. Lomborg 09
1000
Syntheses pieces
channeled through “big”
Number of citations
100
players (e.g. WB)
Communication strategy
in place before publishing
10
• “Derived” products for non-
science users (policy briefs,
blogs, etc.)
1
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 New incentive structures
Stern Lomborg Tilman
for rewarding outputs
THINKING beyond the canopy
14. Impact Pathway: outputs to outcomes
Inputs: CRP6
5 components
15 research themes
+ Gender, Capacity building,
Sentinel landscapes
Original research
with partners
Outputs Outcomes
(e.g. publication, training, (e.g. forests and tree
resources are better Impacts
databases) (e.g. reduced deforestation
managed)
and degradation)
Synthesis research
and outreach
SRF
4 system-level
outcomes
15. Outputs to outcomes
We are generally able Why?
to claim a few • Improper project design
significant outcomes
per year • Passive expectations of
outcomes
but • Inappropriate
This is a painful communication or outreach
exercise • Lag time between outputs
and adoption
Few of these outcomes • Change in donor or societal
are real IPGs interests
Supporting evidence is • “It simply didn’t work…”
somewhat scant and/or
attribution disputable
THINKING beyond the canopy
16. Outputs to outcomes: “Forcing”
Opportunities
Project for change -
Improved certification schemes
FSC, UNEP, CIFOR; GEF funded
Write for “impact” - Brazil, Mexico, Cameroon
-
Preparation phase 2002-2004
Do not over-commit -
-
Several stakeholder workshops
Agreement on what needs to change (e.g. SLIMF certification
standards)
Plan M&E properly - Selection of right partners (CIFOR: backstopping research;
FSC-IC: develop approve standards; country partners and
certification bodies: develop and test new standards)
“Force” recognition - Implementation 2005-2009
-
Production of several outputs
Work with the right - Database for monitoring aspects of HCVF and biodiversity in
FSC certified forests
partners (research - FSC step-by-step guide - Good practice guide to meeting FSC
certification requirements for biodiversity and HCV Forests in
SLIMF
partners for research; - Guide to markets for forest products and services for
smallholders
development partners for - FSC guide to certification for smallholders
outcomes…) - National SLIMF standards for Mexico, Brazil and Cameroon
- Outcome 2010: endorsement of the
Use PIPA methods new SLIMFs standards for the 3
(http://boru.pbworks.com/w/pa countries by FSC
ge/13774889/Background)
THINKING beyond the canopy
17. Impact Pathway: outcomes to
impacts
Inputs: CRP6
5 components
15 research themes
+ Gender, Capacity building,
Sentinel landscapes
Original research
with partners
Outputs Outcomes
(e.g. publication, training, (e.g. forests and tree
resources are better Impacts
databases) (e.g. reduced deforestation
managed)
and degradation)
Synthesis research
and outreach
???
SRF
4 system-level
outcomes
18. Outcomes to impacts: ouch!
“The evidence of impacts of CGIAR
Quantification of impact research on new or improved
is difficult; all the more management practices and on
natural resource management is
for policy research insignificant.”
(Science Council, 2006)
Attribution is generally
multiple and non
documented
Causality links between
outcomes and impacts
are weak or unclear
Lack of proper methods
to assess NRM and
policy research impacts THINKING beyond the canopy
19. Outcomes to impacts: Some Hints
Specific research Outcomes as impacts
linking outcomes to on a different scale
impacts Carefully disaggregate
• Systematic reviews impact:
• Long-term monitoring • Via adoption of specific
experiments (Sentinel outputs by farmers
Landscapes) • Via institutional
New monitoring & innovation or policy-
evaluation methods influence
Impact evaluation as Increase our capacity in
integral part of project research about impact
design of research
THINKING beyond the canopy
20. How to foster
adoption and
implementation
of good
research based
practices and
policies?
21. Outreach and uptake efforts that
have little or no effect
Educational materials (distribution of
recommendations for changed practice;
including practical guidelines,
audiovisual materials, and electronic
publications)
Didactic educational meetings
(lectures like this one!!)
Pile of 855 guidelines in general practices in the Cambridge and
Huntingdon Health Authority : “The mass of paper we collected
represents a large amount of information, but it is in an unmanageable
form that does little to aid decision making”
22. Interventions of variable
effectiveness
Audit and feedback (or any summary of
performance)
The use of local opinion leaders (practitioners
identified by their colleagues as influential)
Local consensus processes (inclusion of
participating practitioners in discussions -
problem focus & appropriateness of solutions)
23. Consistently effective outreach
efforts.
Educational outreach ‘visits’
‘Social’ media (blogs, twitter, facebook, website).
Repeated reminders (manual or computerized).
Multifaceted interventions a combination that
includes two or more of the following: ‘audit’ and
feedback, reminders, local consensus processes,
or marketing).
Interactive educational meetings (participation of
intended users in workshops that include
discussion or practice).
UNFF 4, Brazzaville 2004
26. Publications
Download
Title (2005 - 2011)
Realising REDD+: national strategy and policy options 46,793
Hutan pasca pemanenan: melindungi satwa liar dalam kegiatan hutan 38,947
produksi di Kalimantan
Moving ahead with REDD: issues, options and implications 29,252
Dari desa ke desa: dinamika gender dan pengelolaan kekayaan alam 28,974
Belajar dari Bungo: mengelola sumberdaya alam di era desentralisasi 22,992
Payments for environmental services: some nuts and bolts 22,350
Plantulas de 60 especies forestales de Bolivia: guia Ilustrada 22,035
Panduan singkat cara pembuatan arang kayu: alternatif pemanfaatan 21,875
limbah kayu oleh masyarakat
Atlas industri mebel kayu di Jepara, Indonesia 20,014
Partisipasi masyarakat dalam pembuatan kebijakan daerah di kabupaten 19,712
Tanjung Jabung Barat, Jambi: ketidakpastian, tantangan, dan harapan
Menuju kesejahteraan dalam masyarakat hutan: buku panduan untuk 19,160
pemerintah daerah
Riquezas da floresta: frutas, plantas medicinais e artesanato na América 18,623
Latina
28. Web-based outreach
4,000,000 New Blog
3,500,000 3,374,799
3,000,000
2,500,000
2,000,000
Social Media
1,500,000 Page views
1,000,000
754,017
500,000
Launch of new CIFOR website
0
1st 2nd 3rd 4th 1st 2nd 3rd 4th 1st 2nd 3rd 4th 1st 2nd 3rd
2008 2008 2008 2008 2009 2009 2009 2009 2010 2010 2010 2010 2011 2011 2011
Quarter
29. Journalist workshops
• 2011: 2 media workshops in Indonesia trained 37
journalists (Bali & Central Kalimantan)
• 2012: 3 media workshops in Vietnam training 40
journalists + 12 editors – Workshops planned in Peru
and Papua
30. Conclusions
• Passive dissemination of information is generally
ineffective
• Best practice for dissemination and promoting
effective diffusion is well known but seldom
implemented by research institutions
• Applied and strategic research institutions must
reward success in uptake / adoption not just count
publications
• Further empirical studies on the relative
effectiveness and efficiency of different
dissemination and uptake strategies is required –
build this into the research process