Transitions in M&E of SBC: Measuring the Hard to Measure with Complexity Awareness - Lenette Golding

1. Transitions in M&E of SBC: Measuring the Hard to
Measure with Complexity Awareness

2. Complex Projects
Patton, M.Q. (2011). Developmental Evaluation:
Applying Complexity Concepts to Enhance
Innovation and Use. New York: The Guildford Press,
p. 94.
• Characterized by high degree of
uncertainty
• Uncertainty as go how to go
about solving a problem
• Characterized by a low degree
of agreement among
stakeholders
• Desired results may change
over time

3. • Careful planning does not reduce the likelihood of
programs encountering unexpected obstacles and
opportunities
• Reliance of monitoring and evaluation plans with
high level annual review to guide program
implementation and oversight does not facilitate
timely adaptation when programs are not working
well
• Emphasis on celebrating success rather than learning
from failure makes it hard to recognise what should
be changed
• Use of short time frames and rigid budgets to reduce
risk actually makes it more difficult to achieve an
outcome
Some
common
approaches
to deal with
complexity
…
that are not
working
Source: Ann Larson, PhD
Senior International Health Specialist
Specialist Health Service

4. Table exercise– 30 mins
1. Read provided scenario.
2. Develop research
questions and match them
with appropriate research
approaches and methods
according to the level of
complexity.
3. Write RQs and research
approaches/methods on
flip chart paper
Complex
Complicated
Simple

5. The DC-based NGO Crusade for Good Behavior has recently been awarded a $3.5M
contract to implement a broad-spectrum Zika prevention program for three years with an
emphasis on sexual and reproductive health-related behavior change. The project will be
delivered to resistant communities through a weak health system in a large state (12M
people) in a Latin American country. The project will be implemented in the entire state
and focus on interpersonal communication and community mobilization. In Year 1
approximately 450 frontline health workers (e.g., public health nurses, doctors, midwives
and community health workers (CHWs)) will be trained as Zika prevention educators. Once
a cohort is trained, community meetings will be held in villages in the state to orient, train,
and get the commitment of community leaders to take action in support of Zika
prevention. Each CHW is responsible for 150 homes will visit at least five homes each day
for a period of 2 years. All frontline health workers will personalize messages, introduce
priority practices and provide encouragement on ways to prevent Zika during home visits,
support group meetings, and sessions at health centers. Successful strategies will be
identified in Year 1 that lend themselves to rapid scale-up in the second year. The donor is
adamant that the evaluation approach be improvement driven and innovative. In
particular, the donor is interested in learning about the interrelationships between actors
and the path leading from the programs’ actions to influence on each actor alone and on
the way actors influence each other.

6. Research questions
• Help define the purpose of your research--Not questions you would
directly ask
• Helpful once you begin developing an instrument.
• Can be formulated based on theories, past research, previous
experience, or the practical need to make data-driven decisions
• The more clearly you can articulate your RQs, the easier it will be to
develop your research instruments
guide or interview questions.