Our presentation on M&E for the Strengthening the Dairy Value Chain project in Bangladesh, delivered at the Market Engagement and Learning Event, September 2012.

1. Strengthening the Dairy Value Chain Project
CARE Bangladesh
Presented By
Toufique Ahmed
Apurba Kumar Datta
5th September 2012

2. SDVC M&E System
Data Sources
Evaluation (For all Indicators) Project Monitoring
• Baseline Survey • TPF- Monthly
• Mid-Term • LPF- Monthly
Evaluation • CPF- Quarterly
• End line • GPF- Semi-
Evaluation Annually
Outcome and • PPT- Semi-
Impact Indicators Annually
• Case-Study- Need Base
Inputs, Progress,
Project M&E
output and Outcome
Unit Indicators
(Analyzed By)
Donor Report
Information (Progress update)
Product Project
Management
(MIS Support)
Partnership
IFPRI  Schulich School of Business  Individual Researcher

3. SDVC Information Flow
Project participants Field level
Field Facilitators
Team level
Project Officers
M&E Support Officer Technical Officer-M&E
Region &
National level
Technical Coordinator- SDVC Staffs GOB/Private
CARE-B
M&E & Mgt. sectors/INGO
International
CARE-USA DONOR Other International Audiences level

4. Tools Used
Tools Respo. Coverage Freq.
Team Progress Project Teams’ activity Monthly
Assessment Participants progress and
output
Format (TPF)
Livestock Health Livestock Health Service, Income, Monthly
Workers Progress Worker (LHW) expenditure,
linkages
Assessment (LPF)
Collectors’ Collector Collection, service Quarterly
Progress area, Income
Assessment (CPF)
Cont…

5. Tools Used
Tools Respo. Coverage Freq.
Participatory Producer Group Individual practice tracking and groups’ Semi-annually
maturity scoring
Performance members
Tracking (PPT)
Group Members’ Producer Group  Production, consumption & sales, Semi-annually
Income
Progress members  Farm mgt. technical Knowledge &
Assessment (GPF) Practice
 Input Service used
 Client satisfaction- LHW, collector
 Women access and control over
resources
 Unintended success
Case Study Producer, LHW,  Success and failure of System , Need based
progress.
Collector, Farmer
Leader, others
Videos, Photos Successful and  Success and failure of System , Need based
progress.
challenging actors

6. How do we support to integrate
TASKS FREQUENCY
Collecting information through- As per M&E
M&E formats, Other formats & Other
Success case, learning & Challenges (Qualitative Information) schedule
Team level Documenting & Learning
M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT) Monthly
Other formats (Price, Training, Etc.)
Regional mgt. team documentation & Learning
M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT) By-monthly
Other formats (Price, Training, Etc.)
Regional all staff level documentation & Learning
M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT) Quarterly
Other formats (Price, Training, Etc.)
SDVC Key Mgt. level documentation & Learning
M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT) Six-monthly
Other formats (Price, Training, Etc.)
[
CARE-Bangladesh
UBORA – PQAT Six-monthly 6
30-minutes or other informal way of reflection

7. SDVC M&E System
Data Sources
Evaluation (For all Indicators) Project Monitoring
• Baseline Survey • GPF- Semi-
• Mid-Term Annually
Evaluation • TPF- Monthly
• End line • LPF- Monthly
Evaluation • CPF- Quarterly
Outcome and • PPT- Semi-
Impact Indicators Annually
• Case-Study- Need Base
Inputs, Progress,
Project M&E output and Outcome
Unit Indicators
(Analyzed By)
Donor Report
Information (Progress update)
Product Project
Management
(MIS Support)
Partnership
IFPRI  Schulich School of Business  Individual Researcher

8. SDVC M&E Partnership
Schulich School of ILRI-IFPRI University of Georgia Tech
Business, York Michigan Business University
University
Analyze SDVC Gender Worked for Develop and
findings and Agriculture and developing implement EMS
Showcasing the Asset project Business plan for system for shop
success stories (GAAP). To Krishi Utsho. 4 performance
and learning enhance control MBA student reporting
globally through a over resource and came here and
win-win access to resource did the rigorous
partnership with by women and things for SDVC.
SCHULICH PhD measuring the
scholar and contribution
faculty. factor in achieving
the target.
Partnership help us to learn different new things and bring our
learning into working strategy.

9. SDVC M&E Partnership
Partnership Model

10. Gender, Agriculture and Asset Project ( GAAP)

11. GAAP Focus Area
• How the project is impacting key, tangible asset ownership
(livestock, cash) for men and women
• How the project is impacting asset disparities
• How the project modalities (for example group mobilization and
farmer education) impact intangible assets
• How these impacts combine to sustainably effect household and
community gender norms and women’s empowerment

12. The Tools We Used to research
Tools Purpose Tool type
FGD Explore women’s access to asset ownership, to mkt & Research and M&E
credit and project impact on WE
Life History Analysis Explore project impact and WE process Research and M&E
PPT Group performance assessment (ranking) by members & Research and M&E
develop improvement plan
Group Progress Survey Regular monitoring on milestones including gender Research and M&E
Gender equity format To aware on gender discrimination and importance of Gender Awareness
analysis equity
24 hr clock analysis To reduce women’s workload Gender Awareness
Asset ownership To aware on importance of asset ownership and access Gender Awareness
pattern analysis to income
Women barrier Follow up on barriers for women in DVC Gender Awareness,
Checklist research /M&E
Barrier Tree analysis To aware on barrier, its cause, consequences Gender Awareness
Peer review To assess men and women’s perception on their need Gender Awareness,
and document project impact on the change research and M&E

13. The Major challenges for SDVC
Social norms and customs of rural community limits women with some
barriers for that SDVC face challenges to include women in VC
Barriers Affects
Barriers with women’s mobility • Face difficulty to join jobs outside home
• Difficulty to purchase input and services , sale
milk
• To join training, meeting workshop
Lack of recognition of women’s • Lose of encourage in dairying
contribution
Limited access to asset and • Can hardly make any vital decision
income management • Face difficulty in purchasing input and services
Overburdened with Household • Can allocate less time for IGA
work • Can’t take care of child and personal health

14. Key Findings
Economic interventions have high spillover ratio, empowerment
interventions do not – IFPRI MTE
Change at agency level fosters an increase in asset ownership ( 7.4%
increase in cattle owner ship)
Cattle keeping can be used to empower women to step into new spaces
traditionally closed off by ensuring participation in various parts of the value
chain. (GAAP baseline study)
Men’s engagement can be the strategy to ensure women’s participation

15. Challenges we have experienced
• Project theme new, thus needed to set M&E by trial & error method.
• Project strategy changed over time.
• Large area covered vs. previously M&E staffing strength
• Respondents (Collector, LHW) are mostly indirect participants, hesitates in
giving correct data
• Various dairy-related registry systems not strong, thus info flow not systematic
and reliable and SDVC needs to invest directly, distracting field staff from
implementation
• Collectors are not fully dependent on SDVC participants, so their register don’t
reflect full picture
• Collectors and LHWs don’t want to disclose their business secrecy
• Group members are not literate and aware enough to keep their records
• Institution based M&E-PM&E system introduction
• Donor focused more with numbers, thus required more info as per milestones.

16. Learning about M&E for VC projects
 Track market trends and secondary data not only project
performance
 When in doubt, triangulate
 Design data collection tools to make it easy and valuable for
participants
 Align data collection processes with partner – or target partner –
priorities and project needs
 Value chain projects evolve and learn over time. The M&E system
needs to be flexible and dynamic.
 All project staff are the part of the M&E Team.
 Use M&E data to guide implementation and project strategy
purpose

17. SDVC M&E Cost
Cost Area Cost Share (%)
Monitoring 3%
Evaluation 10%
Total 13%

18. THANKS

19. SDVC Evaluation System
• International Food Policy Research Institute (IFPRI) is our
evaluation partner
• They completed Baseline survey and produced report
• Double-difference method used to compare the change
between project participants and non participant
• Propensity Score Matching (PSM) approach will be used for
constructing the comparison.
• For better comparison the study took the following system-
Treatment Group Control-1 Control-2
SDVC Group which Village nearer to Village from
was developed on SDVC group another Upazila of
Year 1 the SDVC working
district

20. Tool Description - TPF
Description
• Overall activity progress information collected.
• First introduced May 2009.
• Format revised 2 time.
Outcome
• Overall project activity progress

21. Tool Description - LPF
Description
• Used to collect LHWs’ overall progress.
• All trained LHW covered.
• First introduced January 2009.
• Format revised 2 time. Also frequency changed.
Outcome
• Service coverage and linkage
• Income growth

22. Tool Description - CPF
Description
• Used to track collectors overall progress.
• All collector (trained or not) engaged with SDVC
group to purchase milk covered.
• First introduced February 2009.
• Format revised 2 time. Also frequency changed.
Outcome
• Income and milk collection growth

23. Tool Description - GPF
Description
• To Grab Household level overall progress
• Questionnaire survey. Mostly quantitative and proxy
qualitative
• First introduced March 2009.
• Revised 2 time. Frequency- 3 month to 6 month. Content
based on requirement.
• Used Multi-Stage Random Sampling. 1st Group, 2nd
member
• External people done survey and data entry. SDVC M&E
done analysis and reporting
Outcome
• Household dairy income expenditure
• Other achievement

24. Tool Description - PPT
Description
• Participatory Performance Tracking (PPT)
• Done in semi-annually by group members.
CARE staff only facilitate it.
• First introduced on March 2010.
• Two major revision done. Frequency And
scoring guideline.
Outcome
• Overall practice level of individual producer
• Group Maturity score
Cont…

25. Tool Description – PPT Step- 1
Cont…

26. Tool Description - PPT Step- 2
• A Category- 70% & above
• B Category- 50% 69%
• C Category- 30% - 49%
• D Category- 0 - 29%

27. eMIS-Krishi Utsho M&E
Shop Owners Field Staff
Routine shop performance
Sales & Clients
monitoring on smart
submitted each week
phones