Published on

Our presentation on M&E for the Strengthening the Dairy Value Chain project in Bangladesh, delivered at the Market Engagement and Learning Event, September 2012.

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Evaluation, staff, implementation
  • MELE: M&E

    1. 1. Strengthening the Dairy Value Chain Project CARE Bangladesh Presented By Toufique Ahmed Apurba Kumar Datta 5th September 2012
    2. 2. SDVC M&E System Data Sources Evaluation (For all Indicators) Project Monitoring• Baseline Survey • TPF- Monthly• Mid-Term • LPF- Monthly Evaluation • CPF- Quarterly• End line • GPF- Semi- Evaluation Annually Outcome and • PPT- Semi- Impact Indicators Annually • Case-Study- Need Base Inputs, Progress, Project M&E output and Outcome Unit Indicators (Analyzed By) Donor Report Information (Progress update) Product Project Management (MIS Support) PartnershipIFPRI  Schulich School of Business  Individual Researcher
    3. 3. SDVC Information Flow Project participants Field level Field Facilitators Team level Project Officers M&E Support Officer Technical Officer-M&E Region & National level Technical Coordinator- SDVC Staffs GOB/PrivateCARE-B M&E & Mgt. sectors/INGO International CARE-USA DONOR Other International Audiences level
    4. 4. Tools Used Tools Respo. Coverage Freq.Team Progress Project Teams’ activity MonthlyAssessment Participants progress and outputFormat (TPF)Livestock Health Livestock Health Service, Income, MonthlyWorkers Progress Worker (LHW) expenditure, linkagesAssessment (LPF)Collectors’ Collector Collection, service QuarterlyProgress area, IncomeAssessment (CPF) Cont…
    5. 5. Tools Used Tools Respo. Coverage Freq.Participatory Producer Group Individual practice tracking and groups’ Semi-annually maturity scoringPerformance membersTracking (PPT)Group Members’ Producer Group  Production, consumption & sales, Semi-annually IncomeProgress members  Farm mgt. technical Knowledge &Assessment (GPF) Practice  Input Service used  Client satisfaction- LHW, collector  Women access and control over resources  Unintended successCase Study Producer, LHW,  Success and failure of System , Need based progress. Collector, Farmer Leader, othersVideos, Photos Successful and  Success and failure of System , Need based progress. challenging actors
    6. 6. How do we support to integrate TASKS FREQUENCY Collecting information through- As per M&E M&E formats, Other formats & Other Success case, learning & Challenges (Qualitative Information) schedule Team level Documenting & Learning M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT) Monthly Other formats (Price, Training, Etc.) Regional mgt. team documentation & Learning M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT) By-monthly Other formats (Price, Training, Etc.) Regional all staff level documentation & Learning M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT) Quarterly Other formats (Price, Training, Etc.) SDVC Key Mgt. level documentation & Learning M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT) Six-monthly Other formats (Price, Training, Etc.) [ CARE-Bangladesh UBORA – PQAT Six-monthly 6 30-minutes or other informal way of reflection
    7. 7. SDVC M&E System Data Sources Evaluation (For all Indicators) Project Monitoring• Baseline Survey • GPF- Semi-• Mid-Term Annually Evaluation • TPF- Monthly• End line • LPF- Monthly Evaluation • CPF- Quarterly Outcome and • PPT- Semi- Impact Indicators Annually • Case-Study- Need Base Inputs, Progress, Project M&E output and Outcome Unit Indicators (Analyzed By) Donor Report Information (Progress update) Product Project Management (MIS Support) PartnershipIFPRI  Schulich School of Business  Individual Researcher
    8. 8. SDVC M&E PartnershipSchulich School of ILRI-IFPRI University of Georgia Tech Business, York Michigan Business University UniversityAnalyze SDVC Gender Worked for Develop andfindings and Agriculture and developing implement EMSShowcasing the Asset project Business plan for system for shopsuccess stories (GAAP). To Krishi Utsho. 4 performanceand learning enhance control MBA student reportingglobally through a over resource and came here andwin-win access to resource did the rigorouspartnership with by women and things for SDVC.SCHULICH PhD measuring thescholar and contributionfaculty. factor in achieving the target.Partnership help us to learn different new things and bring ourlearning into working strategy.
    9. 9. SDVC M&E Partnership Partnership Model
    10. 10. Gender, Agriculture and Asset Project ( GAAP)
    11. 11. GAAP Focus Area• How the project is impacting key, tangible asset ownership (livestock, cash) for men and women• How the project is impacting asset disparities• How the project modalities (for example group mobilization and farmer education) impact intangible assets• How these impacts combine to sustainably effect household and community gender norms and women’s empowerment
    12. 12. The Tools We Used to research Tools Purpose Tool typeFGD Explore women’s access to asset ownership, to mkt & Research and M&E credit and project impact on WELife History Analysis Explore project impact and WE process Research and M&EPPT Group performance assessment (ranking) by members & Research and M&E develop improvement planGroup Progress Survey Regular monitoring on milestones including gender Research and M&EGender equity format To aware on gender discrimination and importance of Gender Awarenessanalysis equity24 hr clock analysis To reduce women’s workload Gender AwarenessAsset ownership To aware on importance of asset ownership and access Gender Awarenesspattern analysis to incomeWomen barrier Follow up on barriers for women in DVC Gender Awareness,Checklist research /M&EBarrier Tree analysis To aware on barrier, its cause, consequences Gender AwarenessPeer review To assess men and women’s perception on their need Gender Awareness, and document project impact on the change research and M&E
    13. 13. The Major challenges for SDVC Social norms and customs of rural community limits women with somebarriers for that SDVC face challenges to include women in VC Barriers Affects Barriers with women’s mobility • Face difficulty to join jobs outside home • Difficulty to purchase input and services , sale milk • To join training, meeting workshop Lack of recognition of women’s • Lose of encourage in dairying contribution Limited access to asset and • Can hardly make any vital decision income management • Face difficulty in purchasing input and services Overburdened with Household • Can allocate less time for IGA work • Can’t take care of child and personal health
    14. 14. Key Findings Economic interventions have high spillover ratio, empowermentinterventions do not – IFPRI MTE Change at agency level fosters an increase in asset ownership ( 7.4%increase in cattle owner ship) Cattle keeping can be used to empower women to step into new spacestraditionally closed off by ensuring participation in various parts of the valuechain. (GAAP baseline study) Men’s engagement can be the strategy to ensure women’s participation
    15. 15. Challenges we have experienced• Project theme new, thus needed to set M&E by trial & error method.• Project strategy changed over time.• Large area covered vs. previously M&E staffing strength• Respondents (Collector, LHW) are mostly indirect participants, hesitates in giving correct data• Various dairy-related registry systems not strong, thus info flow not systematic and reliable and SDVC needs to invest directly, distracting field staff from implementation• Collectors are not fully dependent on SDVC participants, so their register don’t reflect full picture• Collectors and LHWs don’t want to disclose their business secrecy• Group members are not literate and aware enough to keep their records• Institution based M&E-PM&E system introduction• Donor focused more with numbers, thus required more info as per milestones.
    16. 16. Learning about M&E for VC projects Track market trends and secondary data not only project performance When in doubt, triangulate Design data collection tools to make it easy and valuable for participants Align data collection processes with partner – or target partner – priorities and project needs Value chain projects evolve and learn over time. The M&E system needs to be flexible and dynamic. All project staff are the part of the M&E Team. Use M&E data to guide implementation and project strategy purpose
    17. 17. SDVC M&E Cost Cost Area Cost Share (%)Monitoring 3%Evaluation 10%Total 13%
    18. 18. THANKS
    19. 19. SDVC Evaluation System • International Food Policy Research Institute (IFPRI) is our evaluation partner • They completed Baseline survey and produced report • Double-difference method used to compare the change between project participants and non participant • Propensity Score Matching (PSM) approach will be used for constructing the comparison. • For better comparison the study took the following system- Treatment Group Control-1 Control-2SDVC Group which Village nearer to Village fromwas developed on SDVC group another Upazila ofYear 1 the SDVC working district
    20. 20. Tool Description - TPFDescription• Overall activity progress information collected.• First introduced May 2009.• Format revised 2 time.Outcome• Overall project activity progress
    21. 21. Tool Description - LPFDescription• Used to collect LHWs’ overall progress.• All trained LHW covered.• First introduced January 2009.• Format revised 2 time. Also frequency changed.Outcome• Service coverage and linkage• Income growth
    22. 22. Tool Description - CPFDescription• Used to track collectors overall progress.• All collector (trained or not) engaged with SDVC group to purchase milk covered.• First introduced February 2009.• Format revised 2 time. Also frequency changed.Outcome• Income and milk collection growth
    23. 23. Tool Description - GPFDescription• To Grab Household level overall progress• Questionnaire survey. Mostly quantitative and proxy qualitative• First introduced March 2009.• Revised 2 time. Frequency- 3 month to 6 month. Content based on requirement.• Used Multi-Stage Random Sampling. 1st Group, 2nd member• External people done survey and data entry. SDVC M&E done analysis and reportingOutcome• Household dairy income expenditure• Other achievement
    24. 24. Tool Description - PPTDescription• Participatory Performance Tracking (PPT)• Done in semi-annually by group members. CARE staff only facilitate it.• First introduced on March 2010.• Two major revision done. Frequency And scoring guideline.Outcome• Overall practice level of individual producer• Group Maturity score Cont…
    25. 25. Tool Description – PPT Step- 1 Cont…
    26. 26. Tool Description - PPT Step- 2 • A Category- 70% & above • B Category- 50% 69% • C Category- 30% - 49% • D Category- 0 - 29%
    27. 27. eMIS-Krishi Utsho M&EShop Owners Field Staff Routine shop performance Sales & Clients monitoring on smartsubmitted each week phones