Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Monitoring and Evaluation 2019 activities and workplan for 2020


Published on

Presentation by Anicet Sambala at the Africa RISING ESA Project Review and Planning Meeting, Dar es Salaam, Tanzania, 11-12 September 2019.

Published in: Science
  • Be the first to comment

  • Be the first to like this

Monitoring and Evaluation 2019 activities and workplan for 2020

  1. 1. Monitoring and Evaluation 2019 activities and workplan for 2020 Anicet Sambala International Institute of Tropical Agriculture (IITA) Africa RISING ESA Project review and planning meeting 11 – 12 September 2019, Dar es Salaam, Tanzania
  2. 2. Outline 1. Main M&E activities in 2019 2. Key project results (Targets & outcomes) 3. Data management in Dataverse 4. Workplan for 2020
  3. 3. M&E activities in 2019 1. Reviewed research protocols & workplans and defined the critical dataset of FtF indicators for each research activity 2. Conducted M&E support visits to Karatu, Kongwa & Malawi, also to Provide definition and guidance on FtF & custom indicators Support data collection (FtF, exposure & scaling-up) Collect basic information on beneficiaries 3. Updating the Beneficiary and Technology Tracking Tool (BTTT) 4. Tracking & reviewing data quality and process requests in Dataverse 5. Updated PMMT 6. Reviewed the ESA M&E framework
  4. 4. Project beneficiaries/1 Target HH participating directly in AR research Phase II Direct beneficiaries from BTTT update 2019 2019 2020 2021 Total 7,338 8,259 9,410 Tanzania 1,950 2,073 2,228 Malawi 3,188 3,986 4,982 Zambia 2,200 2,200 2,200 • Malawi: 4,649 • Tanzania: Update going on • Zambia: Update going on
  5. 5. Project beneficiaries/2 Targets HH in AR development partner activities phase II Targets and Achievement with the current partnerships 2019 2020 2021 Total 242,851 275,197 298,038 Tanzania 100,188 110,207 121,227 Malawi 95,907 118,234 130,055 Zambia 46,756 46,756 46,756 Targets Training Actual Total 74,066 22,371 Tanzania 4,066 2,371 Malawi 70,000 20,000 Zambia Achievment
  6. 6. Key project outcomes- 2019 Tanzania Malawi Zambia Farmers worked with to validate tech/s 8,466 6,400 50,000 Technologies validated 53 10 13 Longterm trainings (PhD's ) 4 4 Longterm trainings (MScs) 11 9 2 Number of development partners 52 6 12
  7. 7. Scaling-up farmers – breakdown/1 AR Research Partner Development partner Partner identified responsibilities Target HH Individuals reached MoU status Dr. Christopher-IITA Islands of Peace (IoP) Scaling Post-harvest technologies (Harvesting, Storage and low-cost mechanisation IITA and IoP Dr. Job Kihara-CIAT Tanzania Agriculture Research Institute (TARI) Participate in testing technologies 150 by 2021 4000 CIAT and TARI District extension office- Babati District Council Participate in testing technologies 600 by 2021 650 persons & 98 farmers CIAT and Babati District Council Dr. Wanjiku Gichohi (ICRISAT) WFP Scaling up of nutrition interventions on complementary food and food safety NIL NIL Under discussion Dr. Justus Ochieng (WorldVeg) Islands of Peace (IoP) Scaling of technologies (ONGOING) 818 by 2021 262 CIAT and Babati District Council
  8. 8. Scaling-up farmers – breakdown/2 AR Research Partner Development partner Partner identified responsibilities Target HH Individuals reached MoU status Dr. Regis Chikoyo (Malawi) Malawi Ministry of Agriculture and irrigation development- district offices Co- implementation of field days & Expansion 40,000 by 2021 20,000 Not completed SANE (Strengthening Agriculture and Nutrition Extension) Training of Extension workers & Lead Farmers through exchange visit 30,000 by 2021 Under discussion Prof. Muzanila-SUA Not done NIL NIL NIL Once released Dr. Elirehema Swai (HOMBOLO) LEAD Foundation Scaling of terrace technologies (ONGOING) 20,000 by 2021 815 champion farmers F=353; M=462 Africa RISING implementers and LEAD Foundation Dr. Jumbo Bright (CIMMYT) Meru Agro tours and Consultants Seed multiplication and retail 300 by 2021 Nil Under discussion
  9. 9. Scaling-up farmers – breakdown/3 AR Research Partner Development partner Partner identified responsibilities Target HH Individuals reached MoU status Dr. Jumbo Bright (CIMMYT) Aminata Quality Seeds Interested in new QPM hybrid varieties Plan to engage them in the Final testing of the new QPM for release Dr. Ben Likuyu (ILRI) Word vision (Int. NGO) Scaling up of Poultry ration formulation and improved poultry house 300 by 2020 Regreening Africa Initiative (Local NGO) Scaling up of Dairy feed ration formulation FIDE (Local NGO) Scaling up of Dairy & Poultry feed ration formulation and improved poultry housing ( ONGOING) 500 farmers by 2021 78 farmers (43 males and 35 females) Mutual agreement (meeting minutes) Farm Africa (Int. NGO) Scaling up of Dairy feed ration formulation (ONGOING) 1000 farmers by 2021 670 farmers (393 males and 277 females) Mutual agreement (meeting minutes)
  10. 10. Exposure farmers – overall TANZANIA Number of attendees District Villages Type of the event or treatment Date Organizer (s) Total Female Youth (<25 years) Karatu DC Bashy, Changarawe, Gyekrumlamb, Kainam Rhotia, Slahhamo, Kambi ya Simba & Burger Farmer Field Day: Tomato (Tengeru 97); African Nightshade (Nduruma-BG16) and Ethiopian Mustard (ML EM1). 9-13 July, 2019 WorldVeg & IITA 234 101 6 Kongwa Mlali Farmer field day: Residual Tied Ridging (RTR) tillage technique 31/05/2019 TARI-HOMBOLO 97 69 30 Kongwa Mlali Farmer field day: Agroforestry (G.sepium intercrop with maize & pigeon pea); Contour farming with G.sepium and In-situ rainwater harvesting and fertilizer microdosing 30/05/2019 SUA & ICRAF 107 59 23 TOTAL 438 229 59
  11. 11. Dataverse…/1 What’s that? Centralized data repository for AR-generated data and documentation Why upload data on Dataverse? • To ensure research integrity and validation of results • To increase research efficiency and impact • To facilitate data security and minimize the risk of data loss • To enable research continuity through secondary data use • To ensure compliance with donor requirement • To link/register AR datasets with USAID DDL (happening now!)
  12. 12. Dataverse…/2 Tracking Dataverse data uploads • Chief Scientists are responsible for ensuring: • Data collection plan is clearly identified in annual workplans • Data have been collected and uploaded annually or on an appropriately regular basis) • Support to the research teams to identify the appropriate timeline for open access • Data managers are responsible for compiling a list (“universe”) of datasets: • Collected thus far & those to be collected in FY 2019 and beyond • Along with info about experiment type and duration • …by reviewing work plans and progress reports…against which the completeness of (current and future) datasets on Dataverse can be assessed.
  13. 13. Dataverse…/3 Researchers • Having a Dataverse account gives you more control over your own and your team’s datasets • • Once you create an account, IFPRI Dataverse administrator will assign different user rights (administrator, contributor, etc.) as necessary: • Contributor account (for researchers): allows you to monitor access to your (restricted) datasets and downloads • Administrator account (for project manager/chief scientist account): allowed to add datasets, contribute to existing datasets, access and review restricted datasets uploaded by team members
  14. 14. Dataverse…/4 Review checklist • Metadata should be complete and consistent • PII (Personal Identifying Information -name, phone number, address, national identification number-) should be restricted • Supporting documentation (codebooks, survey questionnaires, sampling methodology, protocols) to assist with proper processing, extraction, and interpretation of the data should be submitted • Variables should be appropriately labelled; codebook and values (including value labels) in the datasets should be consistent.
  15. 15. Dataverse…/5 Dataverse dataset and file management 1st Step Researchers complete Dataverse metadata template….crucial for proper tagging and discoverability 2nd Step Researchers submit completed metadata, de- identified data files, documentation, and codebook to IFPRI M&E team 3rd Step M&E team and Dataverse administrator review submitted documents and data and uploads them (interoperability)
  16. 16. Dataverse…/6 Identified gaps in submission to Dataverse • Absence/Incomplete submissions • PII uploaded while confidential • Supporting documents not uploaded or incomplete • Datasets too raw to extract/interpret information; unfriendly for M&E purposes Recommended • Summaries of key preliminary findings be prepared and uploaded into dataverse
  17. 17. Other indicators Peer reviewed journal articles-Africa RISING Project- ESA 2016- 2019 Country 2016 2017 2018 2019 Tanzania 1 6 8 2 Malawi 3 2 1 1 Zambia 2 3 0 1 TOTAL 6 11 9 4
  18. 18. FtF indicators - challenges 1. Understanding FtF indicators (definition, targets, aggregation, etc.) 2. Difficulty in accurately counting number of hectares under improved management practices & technologies (indicator EG.3.2-25) 3. Absent/Incomplete targets 2019-2021
  19. 19. Challenges related to BTT 1. Incomplete information on direct beneficiaries (sex, age, contact info, primary role, education) 2. Poor recording and documentation of ancillary information (e.g. new sites, new farmers, dropouts & reasons, technologies tested, etc.)
  20. 20. FtF indicators - timelines for reporting • October 4: Annual FTFMS Webinar • October 15: FTFMS opens • October 30 (Internal):  Performance narrative submission to IITA for review  FtF indicators + discrepancy narratives submission to IFPRI for aggregation • November 9: Data submission to USAID for review • November 16: FTFMS data submission deadline • November 30: USAID data submission approval in FTFMS
  21. 21. M&E workplan 2020 M&E Data Manager 1. Interact with AR researchers to secure necessary data and information for populating the BTTT 2. Participate & develop a centralized database of farmer field days and scaling beneficiaries using AR monitoring tools. AR Researchers 1. Update & document beneficiary records (sex, age, education, contacts, HH information holder, dropout) 2. Ensure all datasets of research conducted since 2012 have been submitted as required (datasets, metadata & supporting documents)
  22. 22. M&E workplan 2020 M&E Data Manager 3. Review datasets currently uploaded on Dataverse by ESA researchers since 2012 4. Review project workplans and other documentation since 2012 and prepare a list of datasets researchers proposed to collect 5. Ensure timely (and complete) submission of FTF indicators data for Fiscal Year 2019. AR Researchers 3. FtF data:  Carefully review your FY2019 targets and share with the Data Manager  Complete and Submit FtF data on actual achievements for FT 2019  Ensure consistent and adequate level of disaggregation  Provide consistent narrative where actuals and targets differ more than 10% 4. Include in your workplans, M&E support meetings
  23. 23. Questions for discussion • Are we on the right track, both on the BTTT, scaling-up, and exposure monitoring? • Any challenges? • What would you suggest?
  24. 24. Africa Research in Sustainable Intensification for the Next Generation This presentation is licensed for use under the Creative Commons Attribution 4.0 International Licence. Thank You