1. At CHF, we are strongly committed to the design and
implementation of cutting-edge Monitoring, Evaluation
and Learning (MEL) systems in order to improve our
programming, communicate our effectiveness and
strengthen our accountability. We use a diverse range of
both quantitative and qualitative methodologies to track
activities and measure results, which include baseline
surveys, focus group and key informant interviews,
longitudinal household studies, and participatory rural
appraisal video case studies, amongst others. In the field
we collect, analyze and share many types of data, from
women’s opinions on small business successes, to intra-
household food security and food diversity information,
to wasting and stunting of children, to livestock grazing
patterns and environmental change. Our efforts ensure
Logic Models, Performance Monitoring Frameworks, and
indicators capture sex disaggregated data and qualitative
changes in access and control of resources, work load
and participation to ensure both women and men are
benefiting from CHF interventions and that gender gaps
are reducing.
CHF’s Monitoring, Evaluation and Learning Approach
OUR APPROACHTO MONITORING, EVALUATION AND LEARNING
• Focused on Accountability: we assess the impact of
our programmes to ensure we are effective, efficient and
making a difference
• Guided by Results-Based Management: this includes
the Logic Model and Performance Measurement
Framework
• Inclusive & Participatory: we embrace a range of
stakeholder perceptions, encourage joint analysis of
lessons, and catalyze learning within partner organizations,
and amongst the project beneficiaries themselves; and,
• Experiential: we learn from our own experience and
share what we know
2. • Creating beneficiary profiles and identification
certificates (with barcodes) which enable regular tracking
of beneficiary participation in project activities;
• Undertaking robust baseline studies to create
comparable data for project monitoring and to inform
programming; and follow-up mid-term and end of project
evaluations;
• Establishing regular data collection and monitoring
systems for collecting routine data on output, immediate
and intermediate outcome indicators in the PMF
and environmental indicators in the Environmental
Management Plan;
• Mainstreaming Gender into MEL Systems; this includes
tracking gender disaggregated data and analyzing
difference of opinions, access and control over resources
and decision-making for women and men;
• Establishing innovative, user-friendly Management
Information Systems (MIS) which combine access database
systems with Samsung Tablets for data collection and
analysis;
• Building staff and beneficiary capacity, buy-in and
ownership in MEL activities; CHF has developed core
modules on RBM, baselines, data analysis, lessons learned,
geographic information systems, management information
systems, IT for data collection, etc.; and,
• Establishing Geographic Information Systems (GIS) which
link into the MIS for better tracking and monitoring of
project activities.
Monitoring, evaluation and learning ACTIVITIES
QUALITY CONTROL
• Implementing a paper-less tablet system for data
collection;
• Establishing clear questionnaire and interview protocols
and guidelines;
• Providing hands-on support in survey/questionnaire
content and methodology, interview and gender-sensitive/
group discussion facilitation techniques;
• Engaging beneficiaries in data collection and review;
• Setting up survey monitoring systems in which senior
staff monitor and supervise the data collection process;
• Piloting and testing all survey questionnaires in the field;
• Holding feedback workshops with staff and beneficiaries
to debrief on the process, assess challenges, and share
successes;
• Cleaning and cross-checking data;
• Establishing automated data-entry systems and
interfaces (e.g. drop-down menus, automatic calculations,
negative acceptance of impossible values) on the tablets in
order to minimize data entry errors;
• Monitoring risk through Risk Registry;
• Establishing sample sizes for level of statistical
significance; and,
• Running logical, range and consistency checks on
entered data.
Specific quality control measures for data collection, input and analysis are in place to ensure high quality data is collected,
analyzed and shared. These measures include:
3. INNOVATIONS
• Paper-less system uses cost-effective, latest technology
for data collection and storage improving efficiencies,
decreasing costs and building buy-in;
• Built in feedback loops which ensure data is used to
improve programming and catalyze learning;
• Unique combination of excel and access database
systems which automates data analysis for field staff
(real-time) with built in tables/charts for efficient program
management;
• Innovative dashboard for managers built into the data
system for real-time analysis of workplan achievements and
burn rate for budgeting;
• Linked in system of Geographic Information System
(GIS) with the MIS allowing for mapping and geographic
referencing data. This provides added value by enabling
managers to effectively plan and target interventions
(locations of wells, latrines, roads, and infrastructure),
plan business and marketing initiatives, improve resource
allocation, monitor and evaluate interventions and
creates a learning environment by enhancing community
participation;
• Beneficiary ID cards with barcodes enables tracking each
beneficiaries’ involvement in the project and allow us to
analyze trends or link data to project interventions;
• Uses Coaching system – remote support provided
through Video/Teamviewer; and,
• Tailor-made capacity assessment tools (following the
SCALES methodology) to track and monitor key capacity
building interventions;
• Designing user-friendly, cost-efficient, learning-based
Management Information Systems (MIS) and Geographic
Information Systems (GIS):
• Core trainer expertise in M&E, having conducted
numerous M&E workshops, with guest lecturing at
Universities, M&E courses and US Evaluation Conferences.
• Expert Knowledge on the latest technology in the
industry, including GIS and data collection programming of
tablets and smartphones.
• Advancedknowledgeofdatastorageandweb-based
databasesystemsandextensiveexperienceindesigningand
programmingdatabasesfordifferentdevelopmentorganizations.
• M&E data collection tool development, including the
design of questionnaires, focus groups and quantitative
data collection methods.
• Establishing systems in various cultural contexts with
experience in setting-up M&E systems in remote, rural
regions in Ethiopia, Ghana, Zimbabwe, Kenya, South Sudan,
Bangladesh, Cambodia, Vietnam, etc.; and,
• Designing data analysis systems for monitoring
organizational change. For example, CHF was recognized
by IFAD for innovative M&E system for monitoring change
in organizational capacity of NGOs in Vietnam.
CHF EXPERTISE IN M&E
CHF is becoming a leader in developing innovative MEL systems. CHF’s specific expertise includes:
CHF has made significant efforts in increasing the effectiveness, rigor and impact of MEL systems within projects. CHF
brings an innovative, MEL system, which can incorporate the following features:
4. LOOKING AHEAD
Within the next five years, CHF aims to be a recognized
leader in developing and implementing innovative MEL
systems. We will scale up and build upon our current
experience in spearheading monitoring and evaluation
systems for complex food security and economic
development focused projects around the world and
continue to support local organizations (livestock research
institutes, rural development organizations, research
institutes) in developing data collection tools and data
storage and analysis systems that are tailored to their
capacity, resources and context. We will keep abreast of
the latest technology in the industry, seek out knowledge
sharing opportunities and collaborate with other like-
minded organizations on M&E systems.
Contact CHF’s M&E Team
HEADQUARTERS
Paula Richardson
Monitoring and Evaluation Manager
Tel: 1 (613) 237-0180 ext.225
Fax: (613) 237-5969
Email: prichardson@chf.ca
INTHE FIELD
Asad Rahman
MIS-GIS Specialist
Tel: +880 2 8416781
Mob: +880 17 45474303
Email: arahman@chf.ca
323 Chapel Street
Ottawa, Ontario
K1N 7Z2
Canada
www.chf.ca