A Two-Dimension Evaluation of CSA Practices. Evaluating Practices by Indicators and Reduce Non-Observable Variable Bias Poster presented by John Gomez at the 3rd Global Science Conference on Climate-Smart Agriculture in Montpellier. Read more: http://ccafs.cgiar.org/3rd-global-science-conference-%E2%80%9Cclimate-smart-agriculture-2015%E2%80%9D#.VRurLUesXX4

1. Zero Stage:
CSA practice
compendium
First Stage:
Indicators
approach.
Filter the
possibilities
Second Stage:
Economic CBA
approach.
strength the
conclusions
Prioritization
Tool
Figure 1. The Prioritization Framework
To maximize the complementarities between first and second stage, each of them should be designed
such that both give similar results. That is, we should maximize the likelihood that a practice that is
selected in the first stage will have outstanding results in the second. In this sense, two problematics
should be considered. The indicator analysis should ensure to cover the same dimensions that the
Economic CBA (financial, social and environmental performance) and should reduce the non
observable bias so common in analysis by indicators.
Performance Areas
Social Environmental Economic
CSAPillars
Food
Security
To what extent do CSA
practices improve
livelihoods in terms of
food security?
Are CSA practices that
improve food security eco-
efficient?
To what extent do CSA
practices generate
additional income or
welfare?
Adaptation
Do CSA adaptation
practices improve
livelihoods?
To what extent do CSA
practices aim to adapt to
climate change?
To what extent do CSA
practices generate
additional income or
welfare?
Mitigation
Do CSA mitigation
practices improve
livelihoods?
To what extent do CSA
practices aim to reduce or
capture emissions?
To what extent do CSA
practices generate
additional income or
welfare?
About the project
Since mid-2013 the International Center of Tropical
Agriculture (CIAT) - member of the CGIAR
Consortium - has been leading the development of a
CSA Practices Prioritization Tool as part of the
research program CCAFS. Based on current interests
in developing, promoting and evaluating desirable
agriculture practices (i.e. CSA practices) and the
limited resources for their implementation,
selection criteria and strategies are important in
order to promote the implementation of the more
desirable and efficient practices. CCAFS aims to
prepare a methodology to compare practices and
organize them on a priority list according to their
qualities. The idea is to arrive to a procedure that
supports the national adaptation plans for the
A Two-Dimension Evaluation of CSA Practices. Evaluating Practices by Indicators
and Reduce Non-Observable Variable Bias.
Maldonado, Jorge (Assosiate professor, Universidad de los Andes); Gómez, John (Research assistant, Universidad de los Andes); Corner-Dolloff, Caitlin (Project leader, International Center for
Tropical Agriculture CIAT) & Lizarazo, Miguel (Research assistant, International Center for Tropical Agriculture CIAT)
I1 I2
I3 I4
I5 I6
Food
Security/
Productivity
Adaptation
Mitigation
I1 I2
I3
I4
I5
I6
By weighting by indicator the novelty of the
information given by a particular indicator would
be lost. By weighting each indicator the
information is duplicated in importance,
especially of those indicators that are observed
and calculated easily.
If weighting is done based on classifying the
information in given dimensions (with which the
indicators are related), increases the weights of
novel information and the non-observable
variables bias is reduced.
The whole methodology seeks to create a prioritization tool of CSA
practices, based on the three pillars of CSA, the expected limitations of
resources and high standards of stringency. Some particular procedures of
the prioritization methodology were implemented so results were more
reliable. One of these was the two-dimension indicator analysis.
The prioritization methodology - A
two step strategy.
An approach suggested and widely used in practice
is the use of prioritization methodologies based on
indicators that are aggregated in a particular way to
generate a score that reflects the performance of a
practice. In general, there is an idea of the attributes
to be measured but just exist proposed indicators.
The indicators approach might be useful but it
produces doubts about its precision.
The proposed strategy was to use the indicators
analysis (Stage 1) as a filter of an initial list of
practices (Stage 0), with a subsequent Economic
Cost Benefit Analysis – CBA of those selected as best
practices (Stage 2). The proposal aim to achieve
complementarities between both methodologies.
agricultural sector by improving the focalization of
potential investment resources.
The performance of CSA practices should be
considered before they are implemented, although
traditional investment decisions criteria (which at
the end is a prioritization measure) may sub-
estimate their expected returns. Particularly, almost
all "decision indicators" available and easily applied,
rest on the financial performance of the specific
project which may not be the best option for the
CSA practices and their three pillars. More complex
indicators, that take into account a broader
spectrum of analysis, could be more useful but their
use may not be feasible when several practices
should be considered.
Like this, it would be possible to reduce the efforts
of deriving social costs and benefits of a complete
list of CSA practices and, at the same time, results
will gain from the precision and advantages of a
CBA. Various authors support that CBA must be a
fundamental part in the best practices' selection
process, but it has not to be done necessarily for
each practice. This has been also the proposed
approach for other prioritization projects.
The proposed strategy was to use the indicators analysis (Stage 1) as a filter
of an initial list of practices (Stage 0), with a subsequent Economic Cost
Benefit Analysis – CBA of those selected as best practices (Stage 2). The
proposal aims to achieve complementarities between both methodologies.
Defining the weights by the interactions of the dimensions and the pillar
should help for assessing for the best practices (in CBA terms) as well as
reducing the Non–Observable Bias
• Create a conceptual framework for a Prioritization Tool of
CSR practices that achieves to handle a significant
number of practices and be able to evaluate them and
reduce the available practices to the most relevant
options.
What we
want?
• Combine the flexibility of the indicator analysis with the
stringency of the economic CBA in a two-stage approach.
• A two-dimensional weighting procedure for reducing the
dependence of the indicator analysis to easily capture
information.
What we do?
• A conceptual framework for a Prioritization Tool of CSA
practices.
• An expected reduction of the non-observable variable
bias.
What we get?
Contact: ja.gomez44@uniandes.edu.co
1
2
3
How does it works a two dimension strategy? - The Non Observable
Bias in analyses with indicators.