SlideShare a Scribd company logo
1 of 89
Download to read offline
1
MID TERM REVIEW REPORT
“ALLEVIATING POVERTY THROUGH IMPROVED LIVELIHOOD
AND HEALTH PROJECT”
Funded by the European Commission
Contract Number: ONG-PVD/2005/095-808
MADAGASCAR NOVEMBER 2007
Written by:
Sirill T Benton, ADRA Norway
Pansi Katenga, ADRA UK
January 11, 2008
2
TABLE OF CONTENT
LIST OF ABBREVIATIONS...........................................................................................p.4
1. INTRODUCTION………………………………………………………………………… p.5
2. PURPOSE/OBJECTIVES OF THE MID TERM REVIEW…………………………... p.5
3. METHODOLOGY……………………………………………………………………….. p.6
3.1. Overview…………………………………………………………………………… p.6
3.2. Methodology used……………………………………………………………….. p.7
3.2.1. Review of existing information and secondary data……………………. p.7
3.2.2. Focus group discussions………………………………………………..… p.7
3.2.3. In-dept, individual interviews……………………………………………… p. 8
3.2.4. Most Significant Change Stories……………………………………….… p.8
3.2.5. Direct observation………………………………………………………….. p.8
3.2.6. Meetings…………………………………………………………………….. p.8
3.3. Sampling procedures……………………………………………………………. p.8
3.3.1. Selection of Craftswomen Associations for focus group discussions… p.8
3.3.2. Selection of Farmers Associations for focus group discussions….…… p.9
3.3.3. Selection of Health Volunteers for focus group discussions…………... p.9
3.3.4. Selection of individuals from Craftswomen Associations and Farmers. p.9
Associations
3.4. Limitations…………………………………………………………………………. p.9
4. THE AGRICULTURE COMPONENT…………………………………………………. p.9
4.1. Overview of the agriculture component………………………………………. p.9
4.2. Findings of the agriculture component…………………………………….... p.11
4.2.1. Summary of findings from the Farmers Associations…………………. p.11
4.2.2. Summary of individual interviews with farmers………………………... p.15
4.2.3. Summary of secondary data…………………………………...………… p.16
4.2.4. Summary of meetings with mayors……………………………………… p.17
4.3. Analysis……………………………………………………………………………. p.17
4.3.1. Sensitization and targeting process of the project……………………... p.17
4.3.2. Results and impact……………………………………………………..…. p.18
4.3.3. Project effectiveness………………………………………………..…….. p.22
4.3.4. Project relevance……………………………………………………….…. p.22
4.3.5. Project sustainability…………………………………………………….… p.23
4.3.6. Project constraints………………………………………………………… p.25
4.4. Recommendations……………………………………………………….……… p.25
5. THE CRAFTS COMPONENT……………………………………………………….... p.26
5.1. Findings……………………………………………………………………..…….. p.26
5.1.1. Summary of focus group discussions…………………………………… p.26
5.2. Analysis………………………………………………………………………..….. p.34
5.2.1. Results and impact……………………………………………...………… p.34
5.2.2. Project effectiveness…………………………………………………..….. p.35
5.2.3. Project relevance……………………………………………………….…. p.35
3
5.2.4. Project sustainability……………………………………………….……… p.36
5.2.5. Project constraints………………………………………………………… p.36
5.3. Recommendations………………………………………………………...…….. p.36
6. THE HEALTH COMPONENT………………………………………………...………. p.37
6.1. Findings……………………………………………………………………..…….. p.37
6.1.1. Assessment of expected results for the health activities……………… p.37
6.1.2. Summary of interviews with project staff………………………...……… p.38
6.1.3. Summary of findings of individual interviews with health volunteers… p.40
6.2. Analysis…………………………………………………………………………... p. 43
6.2.1. Results and impact……………………………………………………….. p.43
6.2.2. Effectiveness…………………………………………………………..….. p.43
6.2.3. Relevance…………………………………………………………...…….. p. 44
6.2.4. Sustainability………………………………………………………………. p.44
6.2.5. Constraints…………………………………………………………………. p.45
6.3. Recommendations……………………………………………………….……… p.45
7. MANAGEMENT EFFICIENCY………………………………………………………... p.45
7.1. Findings…………………………………………………………………………… p.45
7.1.1. Findings of “Partners organization’s capacity and project
management”….. ……………………………………………………………..p.45
7.1.2. Findings of “Financial Management Health Check”…………………. ...p.48
7.1.3. Findings from meeting with the District Chief…………………………... p.49
7.2. Recommendations………………………………………………………….…… p.49
8. GENDER…………………………………………………………………………….….. p.49
9. SUMMARY OF RECOMMENDATIONS…………………………………………….. p.50
9.1. Summary of recommendations agriculture component……………….………. p.50
9.2. Summary of recommendations crafts component……………………..………. p.50
9.3. Summary of recommendations health component……………….……………. p.50
9.4. Summary of recommendations management efficiency……………...………. p.51
APPENDICES
Appendix 1: Terms of Reference
Appendix 2: Focus group discussion guide crafts associations
Appendix 3: Focus group discussion guide farmer associations
Appendix 4: Focus group guide health volunteers
Appendix 5: Questionnaire for individual farmers
Appendix 6: Financial check list
Appendix 7: Management check list
Appendix 8: List of focus groups conducted
Appendix 9: List of health volunteers interviewed
Appendix 10: List of individual farmers interviewed
Appendix 11: Revised timetable for the evaluation team
Appendix 12: List of documents reviewed
Appendix 13: Actual yield realized
Appendix 14: Summary of results interview with individual farmers
Appendix 15: Pictures
4
LIST OF ABBREVIATIONS
ADCOM = Administrative Committee
ADRA = Adventist Development and Relief Agency
Ariary = The local currency in Madagascar
Kapoka = small cup of measurement
NGO = Non governmental organization
PROCOM = Project Committee
SSD = District Health Department
SRA = Improved rice farming system
SRI = Intensive rice farming system
Vata = 24Kgs
5
1. INTRODUCTION
In May 2006, Adventist Development and Relief Agency UK (ADRA-UK), in partnership
with ADRA Madagascar, began implementing the 3 year project “Alleviating Poverty
through Improved Livelihood and Health project (SMART Project)” in Fandriana, a region
within the Fianarantsoa province of Madagascar. The total project cost is 755,457 EUR,
and is funded by the European Commission (75%), ADRA UK (16 %), and ADRA
Norway (9%).
The overall objective of the project is to contribute to poverty alleviation for
disadvantaged communities in the region of Fandriana of Madagascar, with the specific
objective stated as improved income for vulnerable rural families.
The project aims at contributing to the alleviation of poverty among the poorest
households in the five communes of Tatamalaza, Milamaina, Miarinavaratra, Tsarazaza,
and Fandriana, in the Fandriana region through three main components; 1) Improved
food security through promotion of improved rice farming and kitchen gardening, 2)
improved opportunities for income-generating activities through promotion of income-
generating activities in agriculture and/or crafts, and 3) improved health practices
through establishing or reinforcing community-based health services. Capacity building
is a cross-cutting activity in all of the components.
The project works with 10 craftswomen and 65 farmers’ associations to improve their
productive, technical and marketing capacities and to ensure better availability of
community-based health services. The program activities aim to enhance the capacity of
the targeted farmers in adopting improved agricultural techniques, to increase crop
yields, increase income generation from handicraft products and overall improved health
among the population of the five targeted communes. The project has been formulated
in line with the concept that improved agricultural production is a pivotal component of
any tangible strategy to reduce the high poverty and food insecurity rates currently
prevalent in rural Madagascar.
Following 16 months of implementation, an internal midterm review of the project was
conducted by ADRA UK and ADRA Norway in cooperation with ADRA Madagascar.
2. PURPOSE/OBJECTIVES OF THE MID TERM REVIEW
The mid term review for the project assessed operational aspects, such as project
management and implementation of activities, and also the progress towards fulfilling
outcomes and objectives. Second and equally an integral part, the review endeavored to
re-assess the strategic objectives and implementation mechanisms proposed during the
design of the project with particular attention paid to the income generating and health
component of the project, to establish whether the aims and operational mechanisms
are directly aligned to the overall “big picture”, in an attempt to facilitate a more efficient
and effective implementation process.
The following specific objectives guided the implementation of the mid term review:
1. Examine the results and impacts (where possible)
To review the progress (status) of project activities towards the overall objective
and specific objectives and where possible the potential development impact on
the primary stakeholder groups. This encompasses an assessment of the
identified existing verifiable, result and impact indicators.
6
2. Assess the project effectiveness
To assess the achieved results against the set objectives and make an overall
assessment of project cost-effectiveness. This includes an evaluation of the
progress of project activities in terms of delivery of project inputs and outputs.
Also ascertain if any adjustment is required in the project design to increase its
scope in impacting the target groups.
3. Assess the relevance and adequacy
To assess the relevance and adequacy of the Income generating and Health
component to the needs of the beneficiaries. This assessment will function as a
platform on which to conduct an analysis of these components of the project in
regards to its lineage to the overall strategic perspective. Providing clarity of
program obligations and expectations, to facilitate effective coordination.
4. Explore sustainability of the project
To assess if the key stakeholders have the potential for retaining results and
benefits after the conclusion of the intervention. Determine the critical success
factors for the project and the conditions required to implement it.
5. Assess Constraints encountered during the project implementation
To analyze the various factors and constraints which have exerted an influence
on the project implementation. Such as the operational mechanisms, managerial,
institutional, socio-economic policy issues and other external factors unforeseen
during design.
6. Assess Management Efficiency
a) To assess the performance of ADRA-UK in terms of quality of
supervision, efficiency in financial administration, ability to anticipate
problems and extend implementation support, adequacy of reporting,
recommendations and effectiveness of follow-up on recommendations.
b) To assess the performance of ADRA Madagascar in terms of project
implementation (Including human resources, financial management,
internal and external risk factors etc).
7. Assess the quality of cooperation with institutions and effectiveness of
coordination mechanisms.
8. Produce a clear set of lessons learned that can benefit the project in its
remaining life-span.
See appendix 1 for further information.
3. METHODOLOGY
3.1. Overview
The midterm review process utilized a combination of methods, using both secondary
quantitative sources of data and qualitative data collected during the time frame of the
midterm review.
The review involved the major stakeholders of the project. The following stakeholders
were included:
 Craftswomen Associations
7
 Farmers Associations
 Health Volunteers
 Individual Farmers
 The Mayors in each target Commune
 ADRA staff at project level
 ADRA staff at country level
 European Commission delegation (Courtesy visit)
When the evaluation team arrived in country it became clear that not all activities
planned during the mid term review could be implemented due to time constraint (one
main reason being travel time in the field). It was determined that the evaluation team
did not have enough time to conduct individual interviews with crafts women, additional
government representatives, or other NGOs.
3.2. Methodology used
3.2.1. Review of existing information and secondary data
The quantitative source of data included review of baseline survey, market survey (only
part of it had been translated to English), progress reports, proposal (including revised
log frame) and other data provided by the project staff. (See appendix 12 for list of
documents reviewed)
3.2.2. Focus group discussions
The methodology of focus group discussions was used to collect information from the
Farmer’s Associations and Crafts Women Associations. Data collection tools were
developed jointly by ADRA UK, ADRA Norway and ADRA Madagascar before arrival of
the evaluation team. Since ADRA Madagascar had experience in conducting focus
group discussions, the agreement was that the tools would be pre-tested before the
evaluation team arrived. Upon arrival it was determined that this had not been done due
to difficulties in communication (lack of e-mail access) between the Country Office and
the Project Office.
To make sure all the evaluation team members had the same understanding of what a
focus group discussion is, a short training session was conducted by ADRA Norway.
After the training was conducted, the evaluation tools were finalized by the evaluation
team. It was decided that after the first day of implementation a review would be made to
determine if any adjustments had to be made to the tools. (See appendix 2 - 7 for final
version of tools).
ADRA Madagascar facilitated the focus group discussions so that there was no need to
use an interpreter. Mr. Mamiseheno, the Monitoring & Evaluation Officer from ADRA
Madagascar, was the facilitator and conducted the focus group discussions in Malagasy.
During the first two days, the project cashier/secretary assisted the evaluation team in
note taking in Malagasy, and during the last 2 days of data collection, Joshua Poole, the
Programs Director of ADRA Madagascar assisted in note taking (direct from Malagasy).
ADRA UK and ADRA Norway were also present during the discussions and taking notes
via the help of a translator. After each day of focus group discussions each note taker
typed their notes, and all the notes have been compiled into one document. The focus
group discussions were also recorded by a digital voice recorder.
Focus group discussions for health volunteers were planned, but when the evaluation
team arrived in country it was discovered that the health component of the project had
8
not progressed as thought. The health volunteers had not yet started to conduct health
education activities in the communities. It was therefore decided not to conduct the focus
group discussions, but conduct individual interviews with a couple of volunteers from
each commune.
3.2.3. In-depth, individual interviews
To obtain further information from the farmers, an individual interview was conducted
with farmers and health volunteers from each commune. Initially it was planned to
conduct individual interviews with women from the Craftswomen Associations. After
arrival in country the evaluation team realized due to time constrains, that most of the
questions that the team would have looked for in the individual interviews could be
solicited during the focus group discussions. It was therefore deemed unnecessary to
conduct individual interviews with crafts women.
3.2.4. Most Significant Change Stories:
The purpose of this methodology is to reveal unintended outcomes delivered by the
project. The plan was to utilize this methodology more in depth, but when the evaluation
team arrived in country it was realized that there was not enough time to train the
evaluation team, for them to be able to conduct this method in detail. During each focus
group discussion, the question “In your opinion, what is the most significant change that
has happen since the project started?” was asked.
3.2.5. Direct observation
During the evaluation team’s stay in-country they were able to observe the local context
of the implementation and also experience some of the logistical challenges
(communication and travel time) the project staff faces. The team visited some of the
beneficiary’s rice fields and kitchen gardens.
3.2.6. Meetings
Both formal and informal meetings took place with ADRA Madagascar staff while the
evaluation team was in country. After it was decided to reduce number the of focus
group discussions (see section 3.3.) part of the evaluation team visited the commune
that was deleted from the program (Miarinavaratra) and had discussions with both the
Farmers Association and Craft Association. Meetings were also held with mayors in all
the five communes where the project is being implemented.
3.3. Sampling procedures
3.3.1. Selection of Craftswomen’s associations for focus group discussions:
Focus group discussions were conducted with 4 craftswomen’s associations. Initially it
was planned to conduct focus group discussions with one craftswomen’s association in
each commune; a total of five associations (out of 10), but due to time constraints the
evaluation team decided to conduct only four. In communes with more than one
association, one association was picked randomly (drawing the name out of a hat). The
following crafts women’s associations were selected:
 Tatamalaza Commune – Miandrisoa craft’s association
 Milamaina Commune – Miaradia craft’s association
 Tsarazaza Commune – Tsiravaina craft’s association
 Fandriana Commune – Santatra craft’s association
9
3.3.2. Selection of Farmers associations for focus group discussions:
Focus group discussions were conducted with 4 farmers associations. Initially it was
planned to conduct focus group discussions with one farmers’ association in each
commune; a total of five associations (out of 65) but due to time constraints the
evaluation team decided to conduct only 4. In communes with more than one
association, one association was picked randomly (drawing the name out of a hat). The
following farmer’s associations were selected:
 Tatamalaza Commune – Miaradia Farmer’s association
 Milamaina Commune – Tanjona Farmer’s association
 Tsarazaza Commune – Miaramizotra Farmer’s association
 Fandriana Commune – Miavotene Farmer’s association
3.3.3. Selection of Health Volunteers for focus group discussions:
It was initially planned that one focus group discussion with Health Volunteers would be
conducted in each commune. A total of 9 Health volunteers would participate in each
focus group. The participants were randomly selected from each commune. However,
when the evaluation team arrived in country it was clear that the health activities were
delayed; therefore the tools developed for the focus group discussions were not
relevant. Instead it was decided to conduct individual interviews with a couple of health
volunteers from each commune to learn about their experiences with the project so far.
The health volunteers were not randomly selected, due to the challenges of distance and
transportation in each commune. The Health Agent selected two volunteers from each
commune. (See appendix 9 for list of health volunteers interviewed)
3.3.4. Selection of individuals from Craftswomen’s associations and Farmers
associations
Due to time constraints, individual interviews with craftswomen were not conducted.
Purposive sampling was used to identify two farmers for in-depth interviews in each
commune. The agriculture agents in each commune were asked to select two farmers
based on the variation in yields. (See appendix 10 for list of farmers interviewed).
3.4. Limitations:
There are several limitations to the implementation of the mid term review:
1. The mid term review is mostly using qualitative data which limits the possibility to
compare the results to the baseline data and national data.
2. Due to limited time and resources, the scope of the work was limited to the most
critical aspect of the implementation. It is quite likely that the evaluation team has
not been able to obtain data about every issue pertinent to the project. The
recommendations are based on limited knowledge obtained during the time of
the mid term review. This has to be taken into consideration when reading the
report.
3. Representatives from ADRA UK and ADRA Norway do not speak French or
Malagasy and a translator was used.
4. The mid term review was carried out in areas that are assumed to represent the
entire project area, but the sample size was limited.
4. THE AGRICULTURE COMPONENT
4.1. Overview of the agriculture component
Fandriana, is one of the poorest and most food insecure districts in Madagascar. Food
insecurity is exacerbated by different factors among them:
10
 Decreasing land availability: the decrease in land availability is more marked in
Fandriana because of its terrain and that has resulted in small arable land
holdings. The small land sizes coupled with big family sizes (on average 5.5)
results in most household only being able to produce rice enough to cover their
staple food for 4 to 8 months per year.
 Poor and depleted soil: soils in the area are mostly red or yellow ferralitic ones
which are not very productive. Inappropriate farming techniques have also
contributed to the depletion of soil structure and organic content. To restore the
soil there is need for use of fertilizer that is not affordable to many because of its
high prices. This results in declining yields year after year.
 Little or no use of improved farming techniques: though the population has some
knowledge of modern farming techniques, they do not apply them. Reasons
include (i) the lack of extension agents (one extension agent for a population
over 25,000) and (ii) the inability to invest in agricultural inputs due to extreme
poverty.
Activities of the project under the food security component were therefore designed to
address the food insecurity problem understanding the above constraint. The expected
results of the component are:
 Beneficiary households reporting 25% increase in their staple food production
 Beneficiary households reporting at least a 25% increase in financial income.
During the baseline and the mid term review leading1
indicators to show progress
towards achievement of the desired goals were developed and they included:
 Decrease in the hunger period
 Adoption of improved techniques
 Dietary diversification
 Coping strategies applied during the food gap
 Reduction in proportion of income going toward food purchases
For the food security component, the project was designed to target the following:
 Poor farming households who were practicing farmers and were producing rice to
cover no more than 6 months but at least 4 months of their annual needs
 Willingness to work in an association
 Households who to cope with food shortages practiced some form of income-
generating activities, which can be agricultural production or handicrafts to
supplement their incomes, but not as their main source of income.
 Beneficiaries of the household with no regular waged job member.
 Households that do not practice sharecropping.
 Households among the 80% of the population who are literate.
 90% of the beneficiaries from this category will be made up of couples, and 10%
of women who are heads of households.
65 farmers associations with membership of 992 beneficiary households were formed.
The total percentage of women in farmer’s associations is 37% (12% higher than the
expected 25%).
1
These types of indicators signal future events
11
Table 1: Number of selected farmer associations per commune and household membership
Communes Associations Membership 2006 Membership 2007
Miarinavaratra 14 219 221
Tsarazaza 14 180 207
Fandriana 13 205 216
Tatamalaza 12 144 180
Milamaina 12 150 168
TOTAL 65 898 992
4.2. Findings agriculture component
4.2.1. Summary of focus group discussions with Farmers Associations
The evaluation team conducted four focus group discussions with Farmers Associations
in four different communes (please see appendix 8). One general discussion was held
with farmers in Miarainavaratra (see section 3.2.6. and 3.3). During the focus group
discussions a semi-structured focus group guide was used, therefore in reporting the
findings, one topic might be listed several times under different sub headings. The
following section includes a summary of the findings.
4.2.1.1. What are the different ADRA activities that you have participated
in?
The participants of the focus group discussions revealed the following as the main
activities that they participated in:
4.2.1.1.1. Training in rice farming techniques:
The rice farming techniques were broken down into improved rice (SRA), intensive rice
farming (SRI) and non-irrigated rice. Regarding the improved rice farming the
participants described that they were trained to transplant after 15-20 days and when
sowing to observe the 20-25cm distance between plants and weed after every two
weeks. Regarding the intensive rice farming they reported that the difference between
improved rice farming and intensive rice farming is that intensive rice is transplanted
earlier, it’s being transplanted after 6-8 days. They also have to observe the 20 cm
spacing rule on either side to allow for weeding. The focus groups revealed that non-
irrigated rice is planted upland and is transplanted after 15 days. The reports revealed
that last years crop was affected by late delivery of seeds and the crop was destroyed by
a hailstorm.
4.2.1.1.2. Training in vegetable growing:
The participants responded that ADRA taught the beneficiaries how to grow the following
vegetables:
 Carrots – they started with smaller quantities because they were not sure of how
well carrots can grow in the area as they had never grown them before
 Leafy green – the results were good. A few people reported that their vegetable
garden is far from their houses and as a result some people stole their crop.
 Potatoes – most potatoes were small because they had diseases resulting in a
low yield.
 Cabbages – the beneficiaries were taught how to grow cabbages and learned
that cabbages cannot be planted in the same field as rice because they need soft
soil and the rice fields have lumps.
4.2.1.1.3. Compost making:
The participants revealed that the beneficiaries had been given seeds to grow plants so
that they can get leaves for composting in future. In addition, they were also taught how
12
to make compost manually. One beneficiary described the process: “To make compost
manure the process starts by collecting both dried and green leaves. Then I cut the
leaves in 10cm and pile them together. On the top layer I put cow manure and water.
Cover the leaves with dirt with a stick in the middle. Every week I mix the content and by
the end of the 3 weeks the compost is ready.” The participants also reported that they
have been trained on how to use fertilizer (bone powder),
4.2.1.1.4. Training on Long cycle income generation activities:
The members reported that they had just started implementing activities like planting
orange trees, chicken raising, bee keeping and fish farming.
4.2.1.1.5 Study Tours:
The members also reported that representatives of the associations went on field trips to
Moramanga, Antsirabe and Antananarivo where they observed other ADRA
Madagascar’s initiatives.
4.2.1.1.6
The focus group discussions also revealed that the beneficiaries were taught about
association management. The also reported that they received training in family
planning training.
4.2.1.2. What are the new skills that you have learned from ADRA?
When asked to describe the new skills that the participants had learnt from ADRA the
main responses were a) techniques for SRA and SRI rice farming and b) how to plant
vegetables. A follow up question was made on how they found the techniques that they
had learnt and the following are sentiments that were shared by the participants in
comparison with their previous practices. Participants felt that the new techniques are
better than the traditional method because the yield has increased compared to
previously. The participants felt that the new techniques require more work than when
they used the traditional method but since the results are better they are not
discouraged. They reported that the new technique requires them to keep and manage
time and that is one skill that they have learnt.
The participants also reported that they were taught how to control water in their field.
They further reported that it was not easy to control the water because sometimes the
farmers of the neighboring field may not be practicing the same technique. Therefore it
makes it difficult to just control the water on one field alone. The farmers have been
taught that water should not be flooded and the 3cm minimum height should always be
observed. Although some fields get flooded, association members help each other to
follow the practice.
A follow up question was asked to the participants to report what material support they
had received from ADRA. The following summarizes the answers:
Farm equipment including weeders, sprayers, forks, dolemite fertilizer, rakes, and water
cans. The equipment is kept by the treasurer who makes plans for lending it out. People
use the equipment and are divided into groups based on distances from each other;
those in the same neighborhood form one group. According to the participants the
system is good and it works well because everyone has equal access to the equipment.
Some members alluded to the fact that the equipment that they wanted was not provided
to them. They reported that they needed oxen to help them with the ploughing of the
field. It was also reported that the equipment; especially the weeders are not enough as
most people want to use them at the same time. A lot of associations reported that they
have created a fund for use to maintain the equipment.
13
In addition, the members reported that they also received seeds, manuals and fertilizer.
4.2.1.3. What does the improved rice farming concept involve?
The following is the summary of the answers from the participants:
The seeds are soaked in water and planted in the field. Rice is transplanted after 15-20
days. It is planted in rows and the distance between each plant should be 20-25cm to
enable them to weed properly in all directions. The space also gives the rice plant space
to breath. The participants reported that rice is transplanted when it is very young – with
just 2 leaves. There is also need to control water regularly so that the field is not
flooded. After transplanting the rice, the fields have to be weeded every two weeks even
if you do not see the weeds.
4.2.1.4. What does the non-irrigated rice farming involve?
The participants stated that this was the first time this technique was used by them as
they have always planted rice in the rice fields. Non-irrigated rice is planted upland and
transplanted after 15 days. However, during the last planting season, seeds were
delivered late and their crop was also attacked by pests. Furthermore, their crop was
destroyed by hail. Most of the participants reported that their yield was low.
4.2.1.5. What is the role of the Farmers Associations?
The participants reported that the associations are there for ”cooperation and to unite the
members.” In addition, the associations provide the members with an opportunity to
share knowledge and exchange ideas. The association also helps the members to plan
their work; they meet and schedule a work plan. The association also coordinates the
income generation components for funds to maintain equipment, to buy other agricultural
inputs and also for social activities. Members of the association pay a fee. Some pay
monthly and some paid a yearly fee soon after harvest. Associations have rules and
regulations that each member has to follow. One such rule is that all members should
attend meetings and if a member does not attend a meeting without a good reason they
are fined. However the association does not fine unnecessarily, they analyze the
reasons why a rule was not followed. Members were involved in setting up the rules and
regulations of associations so they feel the regulations are fair. Socially, the association
members help each other with work. Associations also help the farmers to work with
donors.
When asked if there are any disadvantages to belonging to an association, the members
said there were not any disadvantages. However one association reported that the
members are separated form the community. There were some comments that the
members are not able to follow all the techniques because of time constraints.
Attendance of meetings can sometimes be a problem due to multiple roles that they
have to carry out.
4.2.1.6. How do you think ADRA is contributing to food security in the
commune?
In response to the question, the participants felt that ADRA’s contribution to food security
has been through teaching them new farming techniques and providing them with the
required inputs (seeds and fertilizer) and also equipment to do their work better. They
added that ADRA has introduced crop diversity and that too has added to their food
security. The technicians who live in the commune also monitor their work so that they
have been able to master the techniques. Overall, all these efforts have resulted in
hunger period being reduced.
14
4.2.1.7. In your opinion, what aspects of the project have worked well,
what has not worked well and how can ADRA improve the aspects that
are currently not working well?
In describing what has worked well, the main responses were that their rice lasts longer.
They also felt that the introduction of new crops like cabbages was good. They also
reported that the training went well. The provision of the equipment and inputs was also
good as it allowed them to practice what they had learnt during the trainings. They also
reported that the manuals that were distributed during the training have been helpful as
they are able to refer to them when they forget how to do something. The participants
also reported that they have learnt to manage their time better and can undertake a lot of
activities in one day.
In describing what did not work well, the following were the main responses:
Their non-irrigated rice crop was destroyed by hail and their potatoes had diseases. The
participants also complained that the equipment that was distributed was not enough as
they all needed to use it at the same time. The participants also advised that the training
should be more practical than theory as practical training makes it easy for them to
understand.
In reporting the main areas that the participants wanted ADRA to improve, the
participants stressed that inputs should be delivered early to them as usually they need
time to transport them to the fields which are far from their houses. They also added
that ADRA should work towards assisting that the inputs that they have introduced to
make them are available on the local markets. The participants also added that their
non-irrigated rice field soil is very poor therefore requires more fertilizer than was
provided to them by the project. The participants also responded that they needed more
equipment especially oxen to help them with their labor needs.
4.2.1.8. What do you think will happen after the project has ended?
The participants responded that the associations will continue beyond ADRA’s project.
The participants will continue to use the skills and the knowledge that they have learnt.
They will continue to make compost. In addition, they will continue to encourage one
another. The associations have created funds so that they can enable them to buy
seeds, fertilizers and maintain equipment when ADRA leaves.
4.2.1.9. In your opinion, what has been the most significant change that
has occurred since the project started?
The following are the main responses that came up during the discussion:
 Access to inputs – didn’t buy seeds
 Improvement in rice production – food lasts longer
 Exchange ideas
 No need to buy seeds
 We are using less seeds for the same fields
 Soil has improved as a result of using bone powder
 Time management
 Ways of working – members felt they work hard and can achieve more
 Mentality change – to do away with traditional methods and apply techniques
 Price of rice is lower compared to last year
 Diverse diet
 Households have no problems to find rice accompaniments because they are
growing vegetables
15
 Women and men treated equally
 Life difficulties have reduced
4.2.2. Summary of individual interviews with farmers
Individual interviews were conducted with 10 farmers – 2 from each commune. The two
farmers were strategically chosen and were representatives of those farmers who had
produced above average and those who had produced below expected average in their
communes. The interviews were conducted to understand how the project activities
have made a difference in their individual households and learn about the coping
mechanisms that would be applied in times of food shortages and if they have changed
since the project started. For those who had produced above average, the objective was
to understand what they had done different compared to other farmers, their experience
with the technique has been and if they sold part of their produce, what they spent their
money on.
The interviews revealed that all the farmers had adopted the techniques. Eight of the
ten farmers adopted improved rice techniques and only two reported to have adopted
the intensive rice farming technique. They all had however, tried the non-irrigated rice
technique for the first time. Compared to the 2005/6 season, most of the farmers (7)
reported to have increased the surface area of land where they have used the
technique. The reason behind the increase is that they are convinced that the
techniques work. Two farmers had adopted the technique on 100% of their land during
the 2005/6 agricultural season and therefore reported no change to the surface area.
One farmer reported to have reduced his surface area from 10 ara last season to 8 ara
during this season due to a bad harvest that he had. (100 ara = 1 hectare, 1 ara = rice
field 10 x 10 meters squared).
Despite Fandriana District experiencing one of the worst cyclones in this decade during
the last planting season, eight farmers reported that their yield had increased compared
to 2005/2006 season. Two farmers reported a reduced yield. All the farmers reported a
decrease in the hunger period of on average two months. This was attributed to better
harvest and introduction of vegetables like potatoes in their diets that reduced the
quantity of rice cooked. All the households reported that they used the vegetables for
own consumption and they sold some as well. They all reported that their annual
expenditure towards food had reduced because of the reduced number of months that
they needed to procure rice.
Each of the farmers interviewed revealed that they will be affected by food shortages
during the lean season and some strategies will be applied to cope. Eight of the farmers
reported that eating less preferred foods like cassava and potatoes was the main
strategy for coping with a food shortage. When asked to describe the two main ways
how they were planning to cope with the food gap/shortages during the lean season, the
following are the results in order of most applied strategy:
 Eating less preferred foods (8)
 Sell of chicken and pigs (3)
 Selling of crafts (3)
 Reducing meal quantities (1)
 Casual labor (4)
 Borrow money (1)
 Charcoal production (1)
16
Two farmers out of the ten had produced a surplus of rice. They both had a total of 50
ara of land. One of the farmers had applied the intensive rice technique on all his land
and the other had applied the intensive rice technique on 35 ara and improved rice
technique on 15ara. After selling their rice, one used the money to pay school fees for
his two children attending university and employ laborers to work on his field and the
other one used his money, mainly to buy oxen to address labor constraint.
The two farmers described the techniques to be effective to address their food problems.
However, they both reported that they felt they reported a high yield because (i) they
have big land (ii) they had more people helping in the field and (iii) they applied the
intensive rice farming technique which is much more labor intensive than the improved
technique but produces much more rice. (Summary of individual farmers interview
appendix 14).
4.2.3. Summary of secondary data (reports, monitoring data etc)
From monitoring reports, the team was able to learn that rice is normally planted in
September and harvested around March. It was expected that during the 2006/7
agricultural season beneficiary households would apply their newly acquired knowledge
and skills therefore increase their yield. Monitoring reports show that all the beneficiary
households applied the techniques with the majority applying the techniques on part of
their land as a way of experimenting if the techniques would really work. Reports also
showed that there had been attempts in the past by other NGOs to introduced the similar
farming techniques in the same target area however adoption of the techniques were so
low due to lack of inputs.
4.2.3.1. Improved Rice techniques
The rice planted under the irrigated system was harvested and the following results have
been reported in self monitoring tools and agents activity reports (Appendix 13: Actual
yield realized):
 The maximum yield was 14 tons/ha reported in Miarinavaratra commune and the
minimum was 1,08 tons/ha.
 The general average yield of 5.23 tons/ha exceeded the average yield of 2.21
tons/ha that was reported in the baseline and more than the target set by the
project of 3-4tons/ha.The project goal of increasing the yield by 25% was
achieved and surpassed by nearly 100%.
 A total of 523 tons of irrigated rice was collected from 100 hectares of cultivated
area.
4.2.3.2. Non-irrigated Rice Production
Non-irrigated rice was promoted as a strategy to improve household food security and
was a completely new activity in the region. The average target yield was 1.5 to
2tons/ha however the actual yields reported were maximum of 3tons/ha and minimum of
0,05tons/ha.
Overall, the average yield was 0.53tons/ha way below the target.
4.2.3.3. Kitchen gardens
Kitchen gardening was introduced in the last quarter of year 1 and all beneficiary
households were targeted for the activity. (Appendix 13: Actual yield results).The potato
crops in the Fandriana district were attacked and virtually all potato fields were infected
17
by diseases: anthracnose and oidium. Otherwise farmers had a good yield in the other
crops that help with the food situation at household level.
4.2.4. Summary of meetings with mayors
Each field visit started with meetings with the mayors who are the local government
representatives in their communes. Discussions with the mayors revealed that they are
working very closely with the project teams, especially the extension agents, and that the
project is supporting some of the needs mentioned in the development plans of their
various communes. They also reported that the project, especially the agricultural
component, was very well publicized and the targeting criteria were clear and
transparent. They reported that initially people were hesitant to join associations due to a
bad experience with a microfinance group lending project that was implemented in the
same five communes before, but after the mayors explained to the communities how this
project was different from the other one, more people were interested in being
beneficiaries.
4.3. Analysis
A baseline was conducted in January 2007. The mid term review just like the baseline
was carried out during the hunger period. Conducting both the baseline and the mid
term review during the lean season has made it possible to give an indication of
beneficiaries’ vulnerability as well as the progress towards achieving some indicators
that the baseline collected. For example: adoption rate of technique and hunger period
duration.
A review of the plan document reveals a largely positive process was followed, with a
thorough contextual review and a problem statement. Food security as was during the
designing of the project phase continues to be the priority area of focus in the newly
developed Poverty Reduction Strategy Paper (2007) and has been outlined as challenge
7 to improve nutrition and food security. In addition the government has established a
national office of nutrition (ONN) to develop action plans.
The evaluation team found that core documents confirm that the project is addressing
key food security issues. Further it found that the strategies suggested seem to be
appropriate to the local context.
4.3.1. Sensitization and targeting process of the project
Direct observations revealed that due to the initial skepticism demonstrated at the
sensitization period of the project, some inclusion errors were noted e.g. inclusion of
regular waged people like the mayors. e.g. in Tatamalaza and Milamaina as
beneficiaries. Also noted was the fact that “willingness to work in an association” was
one of the criteria, would have led to self exclusion by some poor households who may
not have taken the courage to join the associations. However, despite a few inclusion
errors, the review team concluded that the process was transparent and worked with
community leaders who helped to identify and verify that the beneficiaries that were
selected were the poor households in their communities. One lesson learnt is that for
future projects rather than focusing on just social indicators the criteria should make an
attempt to include some economic criteria like possession of productive assets by a
household. A targeting meeting where all the villagers understand the criteria and can be
part of the selection process would be beneficial.
18
4.3.2. Results and Impact
4.3.2.1. Training of farmers
As mentioned in the findings section farmers were asked to report the training that they
had conducted and all the associations were able to demonstrate an understanding of
the methodology. They clearly articulate the training that they received and the technical
specifications for each of the rice farming methods for example:
 How to prepare the seeds for sowing
 How to prepare the land before sowing
 Spacing between seedlings for each of the methods
 Weeding requirements
 And how to generally take care of their crops
It is the view of the mid term review team that the farmers understanding of the
techniques is good and that the training methodology was effective.
4.3.2.2. Provision of farm inputs
Complimenting the training with provision of skills, inputs and equipment and on going
presence of an extension agent in the commune was the frequently cited answers to
respond to the ‘what worked well in the project’ question and is the element that has
made the project unique and successful according to beneficiaries according to the
mayors and the beneficiaries. Training has been conducted before by other NGOs in
improved techniques of rice farming and the baseline showed that only 29% of the
beneficiaries adopted the techniques. The main reasons for not adopting the techniques
were that the farmers could not afford the inputs that were suggested. After ADRA
provided seeds, fertilizers and small equipment, 100% of the beneficiaries adopted the
techniques. An important lesson for the future is that the training alone in poor
communities without initial provision of inputs and ongoing supervision is not effective.
The training approach that was taken by the project is worth replicating when designing
similar projects.
4.3.2.3. Food Security
The mid term review team relied on focus groups, farmers own experiences during the
individual farmer interviews and secondary data to get an indication as to progress
towards the food security and economic security theme.
Food security can be measured in a variety of ways. For the project, increased
production for the main staple food is the critical indicator. One common way such as
number of months of household food supply, ostensibly from own production, is the most
commonly cited factor. Monitoring reports (agents activity reports and farmers self
monitoring tools), complimented by discussions with project staff, mayors, farmer
associations as well as interviews with the individual farmers indicated that, for those
households who have adopted improved farming methods, their yield has improved.
Focus group discussions and interviews with farmers revealed that the food gap, which
used to range from 6-9 months (July to March) has been reduced to on average 4-5
months. Most of the households reported a reduction of the hunger period by 2 months.
The main reason provided for the reduction in the hunger period was the increased
production of rice that the households experienced after adopting the techniques.
Appendix 13 demonstrates the increase in production that mainly exceeded the targets
that were set for the communes. All the associations that were met during the mid-term
review reported positive results from their last harvest and felt that the improved
techniques produced more rice compared with the traditional method.
19
Personal Experiences
Ms. Aline Labao of Tsarazaza reported that she planted a total of 20 ara of rice.
She divided her land in half and planted 10 ara using the traditional method and
10 ara using the improved rice technique. She reported that her harvest was 96
containers from the 10 ara where she used the improved technique and
harvested 62 containers from the field where she planted using the traditional
method.
Mr. Jacque Alfred Razakamanana applied Intensive Rice technique on 6 out of
his 40 ara land. He reported that he harvested 600kgs from the 6 ara which was
the same as what he harvested on the remaining 34 ara where the traditional
method was used.
In Miarinavaratra, a lower rice price in markets was reported to demonstrate the
increased supply of rice. In 2006, during the month of November, the price of a kapoka
of rice was 440 Ariary. This year the price has reduced to 330 Ariary/kapoka and this is
the cheapest that they have seen in rice prices for the past 5 years.
Baseline results showed that only 29% of the beneficiaries were practicing the improved
techniques. Monitoring reports and focus group discussions showed that all the farmers
have adopted the technique during the last agricultural season with varying surface
sizes. In the second rice planting season, many farmers have also reportedly increased
the surface area where the techniques have been adopted. Monitoring reports revealed
that 87% of the farmers have increased surface area with 10% reporting no change
while 3% have reportedly reduced the surface area. As a way of verification, interviews
were conducted with ten individual farmers seven had increased surface area and only
one had reduced the surface area. Two out of the ten reported to have planted 100% of
their land with the technique both seasons.
Most households reported eating rice with vegetables from their own production. The
inclusion of such new foods in their diet signified a major change in their life style as
previously rice had been eaten dry without accompaniments. In Miarinavaratra (the
furthest commune visited), all members of the farmers’ association revealed that they
had never eaten cabbage and carrots before. Although a significant number reported to
have sold their vegetables, all the households that were individually interviewed revealed
that they also had used some of the vegetables for their own consumption in addition to
selling. None of the households reported to have stored any of the vegetables. From
lessons learnt in other projects, the review team observed that introduction of new crops
to the diet is good but to achieve better results it should be complimented with training
on its preparation for micronutrient retention. In addition dealing with food preservation
issues when there is high supply for use during the lean season is fundamental to
ensure that the nutrition status is maintained throughout the year. Teaching people on
how they can preserve their food for use during food shortages periods should be
considered as the project finalizes its health strategy. Promotion of nutrition awareness
was also observed to be an important area of focus after discussions with agents
revealed that because vegetables are a new inclusion in a Malagasy diet, some
households would sell most of their vegetable production and not include it in their
knowledge because of lack of information on the importance of eating a well balanced
diet.
20
Types of coping strategies2
that households apply in times of food shortages revealed
the vulnerability of targeted households. A coping strategy index was not developed for
this mid term review and secondary reports were used to identify strategies that have
generally been considered severe. For example, reducing the quantity of a meal but
maintaining the same number of meals is considered less severe than skipping a meal.
In the local context, eating less preferred foods (which was cited as the main coping
strategy) is considered less severe compared with borrowing money especially to buy
food which in the Malagasy culture is considered to be an extremely embarrassing
situation an option that is the last resort when all has failed. Charcoal production is
considered unsustainable because of the effects of deforestation that could further result
in more problems. Casual labor though, was considered normal but is not sustainable as
it results in people neglecting their own field. In the long term this would affect their own
yield and overall food security at the household level.
Although the responses according to the beneficiaries revealed an improvement in the
way they had coped previously, most of them revealed that they would have added to
their strategies – borrowing money to go and buy foods. It is still important that the
coping strategies are reviewed regularly during monitoring visits to ensure that
households are not resorting to destructive activities. It is anticipated that the long cycle
income generation activities will improve the household’s resilience to food shortages.
The reduction in the months in which they need to buy food has helped them. In
addition, the mid term review team observed that association members seem to be
socially responsible for one another. Reduction in percentage of household expenditure
going towards food is a good indicator as well that shows improved livelihood. The
reduction in the food gap has resulted in a decrease in expenditure going towards food
purchases
4.3.2.4. Adoption of technique by non beneficiaries
All the associations and mayors that were met during the mid term review reported that
there are a lot of non beneficiaries who have expressed an interest to join the
associations and asked if the project could increase its coverage. In addition, it was also
learnt that a lot of non beneficiaries are copying the techniques. Direct observations of
the rice fields during the visits also revealed that non beneficiaries have adopted the
techniques during the 2007/8 season. All the agents revealed that they had been
approached by non beneficiaries in the communes where they were working to find out
more about the techniques. The extension agent in Miarinavaratra –reported to have
conducted additional training to 124 non beneficiaries. In Miaradia and Miaramizotra the
chief of the fokontany has included on the agenda for his meetings some basic training
on the techniques.
Due to financial constraints, the project cannot increase its coverage, however it seems
that the non beneficiaries are interested in learning about the techniques and asking
beneficiaries to share their knowledge with them. Considering this demand for
information, it might be a good opportunity to identify lead farmers to conduct and
provide support to this group. This could lead to overall food security in the area. One
2
The term ‘coping strategies’ as used here is meant to denote a range of responses to ‘shock’.
These responses will comprise intensifying existing livelihood activities as well as expanding
activities in order to diversify food and income sources. The sustainability, legality and adverse
impact of these activities (on adopters and the community) will vary depending on the severity
and duration of the shock
21
way of doing this would be to provide in-depth training to especially those who seem to
have grasped the techniques as demonstrated by their yields. This would create a model
farmer system proven effective in other ADRA Madagascar interventions. In addition
chiefs of fokontany could be called upon to spread information to interested parties.
4.3.2.5. Economic Impact
This theme is closely linked with food security as food must largely be purchased in the
months prior to harvest. The project seeks to achieve sustainable increases in income
for its beneficiary population to be demonstrated through purchase of productive assets
etc. Since the project has been implemented only for one agricultural season, while a
reduction in the food gap was reported, most households are still not self sufficient in
food. Some indication on the increased income were sought during the individual
interviews especially among those who had exceeded the planned production targets
and some positive results were reported.
 Reportedly in one area, the Rabemiafara family who did not hesitate to apply the
improved techniques on their 50 ara land (15 ara improved rice and 35 ara
Intensive rice) produced 100 Vata3
and sold 40Vata of their rice. The family sold
each Vata for 4,000 Ariary. This household reported an improved cash income
and was able to pay for their two children university fees without borrowing from
anyone.
 The Randriamihasoa family after calculating their yearly food requirement was
able to sell 1 ton of their rice at 500 Ariary/kg. The proceeds from the sale were
used to buy an oxen to help with the field work on their 50 ara land that they have
cultivated using the improved technique.
4.3.2.6. Long cycle Income generation activities
Four main activities have been identified as long cycle income generating activities
(i) Chicken raising (ii) Agriculture (iii) Fish farming (iv) and fruit trees or essential oil
trees. Long cycle income generation activities are those which farmers will implement to
further improve their livelihood and alleviate themselves from poverty. As this activity has
just been introduced in year two most of the discussions were centered on the strategy
of implementation for the activity. Discussions with the project staff revealed that the
four activities that were identified during the design phase are still relevant. However,
observation of the mid term review team is that the implementation strategy for the
activity is not clear especially for fish farming and bee keeping. It was felt that minimal
attention has been paid to the demand side to make them viable business operations. A
general lesson that has been learnt during implementation of the project especially for
the craft component of the project has been the isolation of Fandriana to major centers
and how linkages to markets have proven to be problematic. The mid term review team
felt that this lesson should be considered in the implementation of the long cycle
activities as well as it is anticipated that there will be buyers for the proposed products.
The mid term review team also felt that although the project had proposed the 4
activities at design stage, a more study should be carried out to understand their
appropriateness for each of the 5 communes. Although culturally the people in the
communes may be the same, certain aspects of the commune need to be considered
and uniform activities should not be applied to all communes. Factors to consider before
implementation include access to markets, quality issues and storage and packaging
facilities. A cost and benefit analysis will also need to be carried out with set targets in
for income and production and monitoring tools developed to measure them. When the
3
Vata = 24Kgs
22
project team was asked basic information as to the price they expected to sell a
kg/honey or a comparison of what those currently practicing bee keeping are producing
and what the project expects them to produce after the project activities was also not
easy to obtain. The mid term review team recommends that more ground work be
carried out with attention paid to markets, processing, packaging and quantity and
financial targets.
4.3.3. Project effectiveness
At this level, the mid term review team examined the extent to which results had been
achieved against set objectives. Overall the mid-term review team concluded that the
agricultural production activities that have been implemented so far are on track to meet
the desired outcomes. However, lessons learnt from other projects and using the
definition of food security to be “ability to acquire sufficient quality and quantity of food to
meet all household’s member nutritional requirements for productive lives” 4
it was felt
that these agricultural interventions to be effective, nutrition aspects of food security
need to be addressed to ensure that the high production of food in resulting in correct
usage reported in detail above. The mid term review team felt that the newly introduced
long cycle activities need to be reviewed as above if they are to be effective in reaching
the desired goals.
4.3.4. Project relevance
This section is trying to assess whether the project interventions continue to be relevant.
This section goes slightly further by also considering whether the strategies chosen by
the project were and remain appropriate given contextual trends, community needs, the
priorities of the Malagasy government and are within the European Community thematic
and geographic priorities.
Meetings with the mayors indicated that the project activities are in line with what has
been identified as priority areas in their commune’s development plans.
Monitoring reports and discussions with the project team and beneficiaries revealed that
the project has carried out activities aimed at increasing food availability and access at
the household level. Realizing that the project cannot increase land size, the project
provided training in farming methods that can increase yields. Also introduced were new
activities aimed to further improve the food situation like non-irrigated rice techniques
and kitchen gardening on land that would otherwise have remained idle because of its
unsuitability for rice farming.
The problem of soil depletion was addressed by providing farmers with bone powder and
fertilizer to address the specific needs that were identified. The target beneficiaries are
poor people who cannot afford to buy chemical fertilizers. Therefore addressing this
problem in a sustainable way required an inexpensive method. Beneficiaries were
provided skills for making compost manure which is sustainable in that they don’t need
to buy inputs. In addition farmers were given seeds to plant trees that would in the long
term produce leaves which they can use for compost production.
The lack of knowledge of improved techniques was addressed by teaching the
beneficiaries about improved farming techniques. Additionally, the project was designed
with the support of local governments that the extension agents would stay in their
4
USAID’s definition from Food Nutrition Technical Assistance.
23
communes to provide adequate support to the farmers. To address the input problems,
farmers were provided with inputs and equipment that has contributed to food security.
When asked “how is ADRA contributing to food security” the responses were through
training, provision of seeds, equipment and knowledge.
The activities continue to be relevant as many beneficiaries, though they have reported
yield increases, are still NOT producing enough food for the whole year.
All the beneficiaries who were interviewed reported that in order for the techniques to be
effective, they also need a lot of labor and although they require less seeds, the seeds
are expensive. These two reasons were cited as the most prohibitive factors for many
beneficiaries to increase the surface area. The farmers were given seeds that they can
recycle for another two years so the problem is dealt with for now and hopefully the
funds that the associations have created will address the challenge. ADRA’s role though
could be working with seed producers to create outlet shops in Fandriana. At the
moment the seeds that ADRA provided are only available in Antananarivo. In fact some
of the participants do not know what the names of the seeds were and called them
‘ADRA’s seeds’.
The review team were however noted how certain associations are creating community
based initiatives to support each other to address the labor constraint like creating a
roaster when all the members would work on one field using part of their funds to hire
labor for those most in need of help. Promotion of such initiatives as best practices is
one of the ways of addressing the labor issue.
On responsiveness, the team was interested in establishing the extent to which the
program responded to emerging challenges on the ground and whether this response
was timely and appropriate. From reports and discussion with project team, an example
of a situation where the project responded to issues on the ground in an excellent way
was when an implementation strategy for training was changed. Initially, the project was
designed to have a total of 10 commune model plots that were to be provided by the
communal chiefs. However, due to problems identified during the theory sessions such
as division of labor to maintain the communal farm and distance to communal plots, the
project management decided to establish demo plots for each association (this plot
would belong to one of the members of the association but would be used by the group
and the agent to conduct the practical training). A total of 65 Demo plots for each
association were established. In addition, when it was learnt that farmers found it easier
to follow practical training than theory more time was spent on practical training sessions
that were conducted on the demo plots. Furthermore, a study tour to ADRA’s other
project in Moramanga was made to enable farmers to see for themselves how the
techniques can make a difference in their lives. Most farmers were motivated after the
trip to do much more.
4.3.5. Project Sustainability
With regard to the project, associations were very confident that development activities
would continue even when ADRA phased out their activities. The main elements for
sustainability were the knowledge and skills, creation of revolving funds, equipment
maintenance plans as well as ways of working together as an association that would
continue to be used into the future: “We have acquired different skills and we will
continue using these skills”, said one respondent. Another respondent said: “we have
found out that what ever we have learnt is for our benefit. We will continue drawing on
24
the knowledge and skills. Another one responded “I received technical training for free. I
can teach my children and next generation…” An association member reported “we
have been taught how to manage associations and we plan to remain as an association
and become an autonomous entity by 2010”.These sentiments are certainly believable
especially with regard to some of the activities introduced by the project. For example, it
is difficult to imagine why people would abandon the improved ways of cultivation
introduced by ADRA, which are clearly improving food security. The first year of
implementation concentrated on agricultural production and from year two the project
has added elements of possible income generation activities including poultry, fish
farming, bee keeping and livestock production which will enable the farmers to continue
with the techniques as they will have income to buy inputs.
In terms of exit strategies, the project will stop its implementation in April 2009. After
having operated in one district for three years it is important to see if communities can
continue to function without external input. The final year of the project will focus on
activities aimed at enhancing the capacity of associations to operate on their own.
Already mid way through the project, the review team had seen some creative ways in
which different associations are dealing with the issue of sustainability. It is therefore
recommended that identification of best practices be documented for sharing among
associations.
Some best practices:
In Tatamalaza commune, Miaradia 1 Association collected a portion of rice soon after
harvest and stored it. When the hunger period started they sold the rice to the members
at a cheaper price rate than the market price. The money has been used to create a
fund for association business but also for festivities like during Christmas time.
Miaramizotra Association in Tsarazaza commune collected part of the rice yield from
each member that they kept and sold during the lean season when the price had
increased. With this money, they created a fund and will use the money to buy more
rice this year for resale during the next lean season. In addition they have created a
separate equipment fund. Each member pays 100 Ariary whenever they use the
weeder. This money is kept by the treasurer for use to repair the equipment or to buy
more equipment when needed.
Miavotena association in Fandriana has created a communal kitchen garden. One
member volunteered usage of her land. Labor, harvesting and selling of products was
done by all the associations together. The proceeds from the sale have enabled them to
create a revolving fund. Next year another member will provide land for the communal
garden.
One association in Miarinavarata (a drought prone commune) collected rice from each
other during the last harvest and sold it during the lean season and used the money to
buy additional farm equipment: 11 hoes and 3 pedal pump pipes.
In Marinavarata 12 communal storage facilities have been built for storage of food for
use during the lean season.
To deal with labor constraints and to meet the timetable that is required for the improved
techniques, women in the Miavotena association work together in one field to transplant.
This has addressed the labor constraints.
25
4.3.6. Project Constraints:
Beneficiaries cited the following constraints:
 Last season Fandriana had one of the worst cyclone seasons.
 Lack of seeds on the specific seeds that ADRA provided on the local market
 Labor was cited as a major constraint for households to apply the techniques on
a bigger surface area.
 Theft of vegetables was experienced by some farmers
 Pests affected the yield of rain field rice
 Diseases that affected potatoes
Project staff cited the following constraints:
 Lack of communication facilities
 Travel problems due to bad roads
4.4. Recommendations:
4.4.1. Nutrition Education
The review team observed that in an area reported to have high incidences of
malnutrition, introduction of new crops to the diet is good but to achieve better results
should be complimented with nutrition education focusing on food preparation for
maximum nutrient retention. The health strategy should include this aspect of nutrition
education including food preparation seminars and storage of food for use during the
lean season.
4.4.2. Long cycle Income generation activities
A clear strategy on how the market side of the long cycle income generation activities
including a basic cost and benefit analysis should be developed considering the issues
raised by the mid term review team in the above section 4.3.2.6.
1.4.3 Seed availability on the markets
It was noted many households would like to increase surface area where the techniques
are applied; however, lack of availability of seeds on the local markets is a limiting factor
for both beneficiaries and non beneficiaries who may want to adopt the technique. The
fact that the exact seeds that ADRA provided to the farmers are not available locally
makes them very expensive to access as someone has to travel far to buy them. ADRA
should liaise with seeds organization and pursue the possibility of creating an outlet for
their products in Fandriana.
4.4.3. Best practices
As part of monitoring, the project agents should conduct a study and document all the
best practices especially those to do with creation of revolving funds and share them
with each other to promote learning. For example, Tanjona Association that has not yet
created a fund, would benefit from experiences of other associations who have already
established funds like in Miarinavatra.
There are no clear targets in the logical framework in terms of what the project expected
to be the adequate surface area to be cultivated using the technique. Despite that initial
omission, this information can easily be available from the extension agents reports and
the farmers self monitoring tools. It is important for extension agents to record the
changes in the surface area that are taking place and in the long run can help us
26
understand and learn the reasons behind some people not applying the techniques to
the whole land.
5. THE CRAFTS COMPONENT
5.1. Findings
5.1.1. Summary of the focus group discussions with Craftswomen Associations
The evaluation team conducted four focus group discussions with Craftswomen
Associations in four different communes (please see appendix 8). During the focus
group discussions a semi-structured focus group guide was used, therefore in reporting
the finding, one topic might be listed several times under different sub headings. The
following section includes a summary of the findings.
5.1.1.1. What is the role of the craftswomen association?
The focus group participants believe the associations are good because it gives them a
forum where they can work together and share experiences. The associations help them
to improve their lives. Through the association they learn new skills, both from trainings
provided by ADRA and from each other. Through the training sessions they have been
able to improve existing skills; the quality of their products has improved. One focus
group reported that only a few of them had worked with crafts before, while another
focus group mentioned that half of the members had worked with crafts in the past and
the rest of the members just wanted to learn the skills.
When the project started, ADRA staff visited the villages and talked to the women about
the project and the formation of crafts associations. According to the participants; the
women who were interested were welcome to join an association. There are currently
between 10-15 members of each association. ADRA’s criterion was to have maximum
15 women in each association. A couple of associations mentioned that more than15
women were interested in joining but it was the first 15 women who showed interest that
became members of the association. A couple of other associations mentioned that
more than 15 women were interested because women are now coming to the workshop
and want to learn from the association members and the association members teach
them. Some of the villages had crafts associations before the project started. One
association mentioned they had started the association in 2001.
Each association has internal regulations. The members decided the regulations
themselves and think they are appropriate. The regulations are needed to “keep order”
to have “good organization”, “coordinate work” and “control the members” in the
associations. For example, the internal regulations decide work hours. Several of the
associations mentioned the regulations help them work together, they start at a precise
time and if some of the members cannot attend (e.g. due to illness) they have to inform
the associations why they cannot work. “The regulations control the actions of the group
and make it equal for everyone. The same rules apply to all and if there are no
regulations “people do what they like.”
Only one association reported that none of its members had quit the association. In a
couple of associations the number of people who had left was seven and five. Several
reasons for why some women left were mentioned:
 The women who left thought they would get paid
 They left because they did not have immediate benefits.
 They did not like the regulations.
 They were concerned it would conflict with other priorities.
27
 Some were discouraged because they didn’t have time to take care of own
house.
5.1.1.2. What type of training have you received from ADRA?
When asked what type of training the associations had received from ADRA it varied
from association to association. The main skills mentioned were as follow; a) weaving, b)
crochet, c) wickerwork, and d) embroidery. They all received training in how to improve
the finish of their products.
There were many different answers when asked the duration of the training sessions.
The answers varied from 2 to 5 days pending on the type of craft they were being trained
in. All of the associations mentioned that the training they had received was good but
not sufficient, especially because some of the skills taught were new to the women.
ADRA had hired a consultant to conduct the crafts training. The training sessions
consisted of both theory and practical training. Some also mentioned that the training
consisted of too much theory and too little practice. There were also complaints that the
practical training sessions were not enough; they had to share items to practice.
Some of the associations had members that had not received training because they had
not been part of the association from the beginning. The association members, who had
received training, taught the new members how to do the different crafts.
5.1.1.3. What type of support has ADRA been giving after completion of
the training?
All the associations mentioned that they have received equipment and raw material from
ADRA. Some of the equipment that was mentioned was; sewing machines, knives,
scissors, wooden rulers, cupboards to store the products, tables, pots for paint, iron,
raffia, paint. One association mentioned that they have also received manuals about
crafts. The manuals help them to learn how to produce the different crafts. They thought
the manuals were good, but they were not able to apply all of it, because there are some
things they just don’t know. It was also mentioned that some of the members are not
able to read and therefore the manuals were not very useful to all.
The evaluation team obtained different information when it comes to the quality of the
equipment and raw material. One association mentioned that the equipment was of good
quality and they are using it well. Several associations mentioned that the scissors were
very fragile and would easily break because they are made of plastic. One of the
associations reported that some of the machines have already broken down and have
not been repaired. They are now using the machines that they have rented.
Most of the associations mentioned the poor quality of raffia. Some mentioned that the
raffia was too hard and that it could not be used to make hats, while others mentioned
that raffia was wet and therefore sometimes rotten. One association reported that of the
raffia that they received; only two thirds of it was usable and as a result they used the
bad raffia to practice.
The associations are managing the equipment that they have received from ADRA.
Some of the equipment was distributed individually and some of the equipment belongs
to the association. Several of the associations were divided into groups and took turns
using the different equipment. Those who need equipment may come to the association
28
and borrow it as needed. One association mentioned that all the equipment is stored at
the associations president’s house. When asked what happens when the equipment
need repair, one association mentioned that each member pays 500 Ariary each month
to the association. That money is separate from the revolving funds (funds from sale of
products). This money is used to repair equipment. Per the date of the evaluation, no
money had been spent on repairs yet.
Each association had a workshop, a place where they can meet and produce their
crafts. Some of the associations had contracts with the house owner until the activities
have been completed. Some of the associations had improved the rooms by applying
mud to the walls for example. According to one association, the workshop is a place
where everyone can meet.
The associations have a work schedule which varies from association to association.
Following are some of the responses from the participants:
 “We work Monday, Tuesday, and Wednesday in the afternoons.”
 “Before we worked everyday. It was not a good idea because now we are
transplanting rice. For the past month we have not worked in the workshop.”
 “During the transplanting season, we cannot work in the workshop, during
October through November we transplant rice and during March and April we
harvest rice.”
 “If we have orders we work every day… 8 am through 4 pm or 5 pm.”
 “We work everyday, if there are orders we work harder.”
 “We work every afternoon from 2 – 4 pm. If we work in the mornings we work
from 8 – 11 am.”
 “We only work in the afternoon because we have kitchen gardens and a house to
take care of.”
ADRA has provided study trips for some of the association members. One trip was to
Antananarivo to the International Fair and another trip was made to Ambositra. The
study trips gave the members an opportunity to observe the type of crafts and quality of
crafts that are being sold in other markets. These are some of the observations from the
members during their study trips:
 They saw good quality products and saw the adequate prices for their products
 They saw that the prices in Ambositra are higher compared to Fandriana
 They saw that the quality of their products are not as good as the products they
saw in Antananarivo
 They saw that the “finish” of their crafts were not as good as elsewhere.
 They realized they did not sell many products at the Fair because of the quality of
their products
 They have not been able to reproduce what they saw in Antananarivo due to lack
of training.
One of the major issues that was mentioned during all focus group discussions was the
lack of markets. All groups asked if ADRA could find markets for their products. They
were all aware that they needed markets to sell their products and they wanted to sell
their products at a higher price. Most of the current markets were in Fandriana. The
prices in Fandriana are much lower than the prices at the markets in Ambositra or
Antananarivo. For example: in Ambositra they can sell one basket for 8,000 Ariary, while
at the market in Fandriana they only receive 2,000 Ariary for it. Since they cannot find
other markets they sell their products in Fandriana at a lower price. It was also
29
mentioned that craft collectors came to the different villages and collected crafts that
they had made. The profit was not very high. Sometimes they sell to the collectors and
sometimes they go to the market. When they went to Antananarivo they searched for
markets but the quality of their products is only suitable for the local Fandriana market.
They wanted more training so they can improve the quality of their products and hence
increase their market options. Some of the associations mentioned the possibilities of
finding other markets. For example there were markets in the north and they could visit
other towns, but the problem was lack of money for transportation.
5.1.1.4. What are the major successes that you have experienced in
production and selling of your crafts?
When this question was asked many different issues were mentioned. Many examples
were given regarding how the associations had helped the members. These are some of
the responses:
 “It has helped us a bit. In the past we had to buy raw materials, but after ADRA
started the association, we received raw materials for free. That is a great benefit
for us. Although we have to return the price of the raw materials to the
association, we now have money to buy things like soap.”
 “Our knowledge (skills) of crafts has improved, our minds have also changed.
Working in a group allows us to learn new things and improve our minds. We are
happy and joyful. Our living conditions have changed.”
 “It has changed our living conditions; we have more income now after ADRA.”
 “It has changed my life a bit. At this period of the year, we usually don’t have rice
anymore. Rice is very expensive and I used to borrow money to buy rice. This
year I have less debts; that is a change in life.”
 “My knowledge has increased, I can do more crafts. Now I can be more creative,
change design, create design according to what people want at the market. Can
make more elaborate.”
 “I’ve improved my skills. Before I could just make basic things. Now I can
decorate the bags, which add to the value. Before I sold a basket for 200 Ariary,
now with decoration, now maybe 2,000 – 3,000 Ariary for the ones that are well
done
It also became clear that most of the associations have a revolving fund, when the
women sell their products; part of the money has to be returned to the association (the
production price is being returned to the association). The funds returned to the
association are with the purpose of continuing the work after ADRA leaves; because of
the revolving funds the associations will be able to purchase raw materials so the
members can produce more crafts. The revolving funds could also be used to help
members of the association when needed. For example if someone was sick or just had
delivered a baby. All members agree with how the fund is being used.
Another success mentioned was the associations themselves. By being members of an
association the women have been able to learn new skills (they learn from each other),
they are able to share experiences and encourage each other. One of the benefits is that
they now have equipment and raw materials provided by ADRA. They don’t have to
spend money on purchasing raw material. Another benefit is that two representatives of
the association can go to the market and sell the products while the rest of the members
continue to work. The associations can also be represented by a few members to attend
regional meetings. The members claimed to have better health and improved household
income.
30
The women also talked about their income. One association mentioned that the income
in October had been good because they had an order of hats. They made 100 hats in
four days (from Sunday to Wednesday) and they received 1,000 Ariary per hat. They
thought the price should have been 3,000 Ariary per hat if they included all the expenses
(price of raffia, time spent, and the food they consumed). It was mentioned that the cost
of raw materials for one hat was 2,000 Ariary. One group mentioned that the cost of 1
meter of raffia was 1,000 Ariary and they can make 2 hats with that material, which gives
them a profit of 400 Ariary per hat. When the women were asked how long it takes to
make a hat there were many different answers. The time frame varied from 1 hour to ½
day, from 2 hats in a day to 10 hats in a day.
The associations had been trained in how to calculate the price of the products. When
deciding on the price they take the cost of raw material and time spent into
consideration. Before the project they did not calculate the price as they do now. They
still mentioned that they do not make enough money and if crafts were their only means
of livelihood “we would quarrel with our husbands because the benefits are low.”
One of the associations reported that the income to date from sale of products was
222,280 Ariary (about $125).
5.1.1.5. What are the major challenges that you are facing in production
and selling of your crafts?
The number one major challenge mentioned by all associations was access to markets.
They were all mentioning lack of markets and their desire to sell their products at a
higher price. The Fandriana market offered low prices. They also thought it was hard to
identify new markets and wanted ADRA to identify markets for them. Some of the
associations realized that the quality of their products was not up to standard; therefore
at this point they could not sell their products on markets other than their local markets.
They therefore wished that ADRA would provide additional training so they can improve
their skills and the quality of their products. Hence, it will be easier to find markets and
they can also increase the price of the products. At the time of the mid term review one
of the challenges related to the local markets was access. Due to the rainy season and
bad road conditions, the women were not able to sell the products outside of their
commune. Another challenge was the cash flow of the population. This time of year is
the lean season and people are spending money on buying food, not products. If the
women take their products to the markets, many times they will not be sold.
Some of the members had visited other markets. There was one trip to Antananarivo to
the International Fair. Some of the associations sold some products there, but mostly
people just looked and asked for their address. In general, after the Fair the associations
brought back with them many unsold products, now the products are just sitting in
storage. The reason they gave for not being able to sell their products were that there
were too many products there and their prices were higher than the others. One reason
for the higher price is the time spent on producing the crafts. The skills are new to the
women so it takes longer to make a product, for example it takes 3 days to make a
basket. One person suggested that they should have sold a lower price instead of
bringing the products back with them, and having to sell them a lower price at the local
markets. The members who visited the Fair did not think there were many buyers there
but they saw many good ideas. One association had visited the market in Majunga (west
coast town). Regarding the quality of the products one association thought their products
were similar to those of others at the Fair and some thought their products were better.
31
When asked how the women would be able to find markets, after they have increased
the quality of the products, the following responses were recorded:
 “For example, I have relatives in Tulear, and I can tell them we have products to
sell if they are needed there.”
 “I have relatives out of the region; they can sell our products”
 “When there are guests here, we can send some items with them and they can
sell them for us.”
 “Talked to hat merchants in Antsirabe and they told us that hats sell better in
January when people have money after selling fruits.”
Another topic that was mentioned was the work hours. At the time of the mid term
review, the women did not spend much time on production of crafts because it was
transplanting season for rice. They work on the field during the day and some of the
associations tried to work on crafts during the evenings (7-9pm). The problem is that
there is no electricity, so making items in the evening takes longer time and the quality is
less. Some other associations mentioned that they only work 1 or 2 days at the
workshop, because the rest of the time they have to spend on activities in their homes.
The production time of products varied from association to association and there were of
course individual variations. For example the production time of bags varied from 2 bags
to 10 bags per week (for the association). Or individually, from one bag in 3-4 days to 2
bags in a week.
The participants also mentioned raw materials. They all agreed that raw materials are
expensive. One explanation given was that there are many weavers in the area so the
demand for raw material is high, thus the high prices. But the price of the finished
product is not so high, so the expenses do not correspond to the income. When it came
to the quality of the raw material, several different responses were recorded. Several
associations felt that the quality of the raw material was good, while another association
though the quality of the raw material varied greatly. One association reported that they
almost had a quarrel with ADRA because the raw materials they provided were so bad.
In some instances 1.5 kg out of every 5 kg was no good, rocks and sand were found in
the raffia. Some were very short and the ends were not good. The quality of the products
depends on the quality of the raw materials. The better materials are more expensive.
Two members told us than they have now started to plant the raw material. There was
also a difference in opinions when it came to equipment. Some associations thought
they had enough equipment and raw material while other associations reported that they
did not have enough tools and machines. Some of the equipment lacking was sewing
machines and irons. Since the associations did not receive an iron from ADRA, one of
them has been able to buy one, while another association mentioned that they are now
renting sewing machines for 5,000 Ariary per month and the rent is paid from the
associations’ fund.
The prices are also a challenge. During the training they were taught what the prices
should be for the different items. For example, “people buy one decorated basket for
1,500 Ariary, and it should be 3,000 Ariary, while the training taught us we can sell at
7000 Ariary.”
32
5.1.1.6. In your opinion, what aspects of the project have worked well,
what has not worked well and how can ADRA improve the aspects that
are currently not working well?
When asked what aspects of the project had worked well, most of the participants
mentioned that they now have increased skills; they are able to make more items and/or
make the items of better quality. Some of the skills mentioned were; make hats, bags,
and table mats. They thought the training went well, but would like more training. They
also thought the distribution of equipment went well. In the past they did have
equipment, but it was not sufficient. Now they have access to equipment through the
association.
When the participants were asked what can be done to improve the project, two main
issues were identified; improvements to workshops and trainings.
Several associations mentioned that improvement of the workshops was necessary
because they need a house for the equipment and a place to work. One association
mentioned their workshop is not adequate because not all of the members can fit inside
at the same time. Another association mentioned they would like to improve their
workshop by painting, making cement floor and inserting a door.
The associations also suggested additional training sessions. They want to improve their
existing skills and they would like to learn new skills. They suggested that the training
should include how to design items. The suggested time frame for the training was from
5 days for each activity to one month. These are some of the responses that were
recorded:
- “There wasn’t enough training, too much theory and not enough practice.”
- “Embroidery was too much talk, little practice”
- “We should have practical training straight away, that’s what we
expected. We shared table clothes 6 to 1; we should have our own
clothes to practice on.”
- “The training period should be longer, we need embroidery training and it
should be more practical.”
- “We need crochet training because we just had ½ day”
- “We need more training in how to crochet hats because they sell well.
When we go to market people ask if we know how to make those hats.”
- “We did not get embroidery training and we need it because we want to
improve our lifestyle and we can sell them.”
5.1.1.7. What do you think will happen after the project has ended?
After the project ends the participants think they will continue to work together as an
association. The associations will be able to function due to the revolving funds that the
members have created. When the project ends, the associations will be able to spend
that money on purchasing of raw materials for its members. Following are some of the
responses from the participants:
The continuity depends on the markets unless they have markets where they can sell
their products it will be difficult. They would like to search for markets and they would like
ADRA to assist. Some of the associations did not know what they could do to find
markets. Most of the associations mentioned the lack of transportation money to search
for markets as the main constraint.
The project has provided the associations with monitoring tool. Most of the associations
reported that they are using them but they did not understand fully how to fill them in
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar
Final report mid term review SMART project Madagascar

More Related Content

Similar to Final report mid term review SMART project Madagascar

Agricultural advisory services_uganda
Agricultural advisory services_ugandaAgricultural advisory services_uganda
Agricultural advisory services_uganda
Willy Mutenza
 
Sustainability Plan 03 02 09
Sustainability Plan 03 02 09Sustainability Plan 03 02 09
Sustainability Plan 03 02 09
Zackkri
 
impact_evaluation_of_hmi_through_rct
impact_evaluation_of_hmi_through_rctimpact_evaluation_of_hmi_through_rct
impact_evaluation_of_hmi_through_rct
CIRM
 
Advancing Healthy Housing. A Strategy for Action
Advancing Healthy Housing. A Strategy for ActionAdvancing Healthy Housing. A Strategy for Action
Advancing Healthy Housing. A Strategy for Action
Loyedi Waite
 
2 supplementary-webappendix-if-lancet-paper
2 supplementary-webappendix-if-lancet-paper2 supplementary-webappendix-if-lancet-paper
2 supplementary-webappendix-if-lancet-paper
Indonesia AIDS Coalition
 
2 supplementary-webappendix-if-lancet-paper
2 supplementary-webappendix-if-lancet-paper2 supplementary-webappendix-if-lancet-paper
2 supplementary-webappendix-if-lancet-paper
Indonesia AIDS Coalition
 
Strategy and framework for developing text
Strategy and framework for developing textStrategy and framework for developing text
Strategy and framework for developing text
cenafrica
 
HBS Management Challenge - Telemedicine for Prisons Final
HBS Management Challenge - Telemedicine for Prisons FinalHBS Management Challenge - Telemedicine for Prisons Final
HBS Management Challenge - Telemedicine for Prisons Final
Situl Shah
 

Similar to Final report mid term review SMART project Madagascar (20)

Agricultural advisory services_uganda
Agricultural advisory services_ugandaAgricultural advisory services_uganda
Agricultural advisory services_uganda
 
Sustainability Plan 03 02 09
Sustainability Plan 03 02 09Sustainability Plan 03 02 09
Sustainability Plan 03 02 09
 
Master thesis , impact of recently economic restructuring on healthcare dec...
Master thesis , impact of recently   economic restructuring on healthcare dec...Master thesis , impact of recently   economic restructuring on healthcare dec...
Master thesis , impact of recently economic restructuring on healthcare dec...
 
impact_evaluation_of_hmi_through_rct
impact_evaluation_of_hmi_through_rctimpact_evaluation_of_hmi_through_rct
impact_evaluation_of_hmi_through_rct
 
STRATEGIC PROGRAMMING FOR COMMUNITY NUTRITION INTERVENTIONS
STRATEGIC PROGRAMMING FOR COMMUNITY NUTRITION INTERVENTIONSSTRATEGIC PROGRAMMING FOR COMMUNITY NUTRITION INTERVENTIONS
STRATEGIC PROGRAMMING FOR COMMUNITY NUTRITION INTERVENTIONS
 
Horticulture Project for People with Mental Disorders or Epilepsy
Horticulture Project for People with Mental Disorders or EpilepsyHorticulture Project for People with Mental Disorders or Epilepsy
Horticulture Project for People with Mental Disorders or Epilepsy
 
Evaluation and Monitoring of Transboundary Aspects of Maritime Spatial Planni...
Evaluation and Monitoring of Transboundary Aspects of Maritime Spatial Planni...Evaluation and Monitoring of Transboundary Aspects of Maritime Spatial Planni...
Evaluation and Monitoring of Transboundary Aspects of Maritime Spatial Planni...
 
Monitoring Toolkit for School Gardens, Community Gardens, Institutional Garde...
Monitoring Toolkit for School Gardens, Community Gardens, Institutional Garde...Monitoring Toolkit for School Gardens, Community Gardens, Institutional Garde...
Monitoring Toolkit for School Gardens, Community Gardens, Institutional Garde...
 
Advancing Healthy Housing. A Strategy for Action
Advancing Healthy Housing. A Strategy for ActionAdvancing Healthy Housing. A Strategy for Action
Advancing Healthy Housing. A Strategy for Action
 
2 supplementary-webappendix-if-lancet-paper
2 supplementary-webappendix-if-lancet-paper2 supplementary-webappendix-if-lancet-paper
2 supplementary-webappendix-if-lancet-paper
 
2 supplementary-webappendix-if-lancet-paper
2 supplementary-webappendix-if-lancet-paper2 supplementary-webappendix-if-lancet-paper
2 supplementary-webappendix-if-lancet-paper
 
Aus aid%20final%20evaluation%20report
Aus aid%20final%20evaluation%20reportAus aid%20final%20evaluation%20report
Aus aid%20final%20evaluation%20report
 
Strategy and framework for developing text
Strategy and framework for developing textStrategy and framework for developing text
Strategy and framework for developing text
 
HBS Management Challenge - Telemedicine for Prisons Final
HBS Management Challenge - Telemedicine for Prisons FinalHBS Management Challenge - Telemedicine for Prisons Final
HBS Management Challenge - Telemedicine for Prisons Final
 
GES Serbia
GES SerbiaGES Serbia
GES Serbia
 
ANALYZING FISCAL SPACE FOR HEALTH IN BENUE STATE, NIGERIA
ANALYZING FISCAL SPACE FOR HEALTH IN BENUE STATE, NIGERIAANALYZING FISCAL SPACE FOR HEALTH IN BENUE STATE, NIGERIA
ANALYZING FISCAL SPACE FOR HEALTH IN BENUE STATE, NIGERIA
 
Supporting Collaboration and Harnessing of OER Within the Policy Framework of...
Supporting Collaboration and Harnessing of OER Within the Policy Framework of...Supporting Collaboration and Harnessing of OER Within the Policy Framework of...
Supporting Collaboration and Harnessing of OER Within the Policy Framework of...
 
Health OER Inter-Institutional Project Formative Evaluation of Health OER Des...
Health OER Inter-Institutional Project Formative Evaluation of Health OER Des...Health OER Inter-Institutional Project Formative Evaluation of Health OER Des...
Health OER Inter-Institutional Project Formative Evaluation of Health OER Des...
 
Vol. 8 of emap environmental management plan
Vol. 8 of emap   environmental management planVol. 8 of emap   environmental management plan
Vol. 8 of emap environmental management plan
 
Comprehensive Multi-year Plan - Universal Immunization Program Reaching Every...
Comprehensive Multi-year Plan - Universal Immunization Program Reaching Every...Comprehensive Multi-year Plan - Universal Immunization Program Reaching Every...
Comprehensive Multi-year Plan - Universal Immunization Program Reaching Every...
 

Final report mid term review SMART project Madagascar

  • 1. 1 MID TERM REVIEW REPORT “ALLEVIATING POVERTY THROUGH IMPROVED LIVELIHOOD AND HEALTH PROJECT” Funded by the European Commission Contract Number: ONG-PVD/2005/095-808 MADAGASCAR NOVEMBER 2007 Written by: Sirill T Benton, ADRA Norway Pansi Katenga, ADRA UK January 11, 2008
  • 2. 2 TABLE OF CONTENT LIST OF ABBREVIATIONS...........................................................................................p.4 1. INTRODUCTION………………………………………………………………………… p.5 2. PURPOSE/OBJECTIVES OF THE MID TERM REVIEW…………………………... p.5 3. METHODOLOGY……………………………………………………………………….. p.6 3.1. Overview…………………………………………………………………………… p.6 3.2. Methodology used……………………………………………………………….. p.7 3.2.1. Review of existing information and secondary data……………………. p.7 3.2.2. Focus group discussions………………………………………………..… p.7 3.2.3. In-dept, individual interviews……………………………………………… p. 8 3.2.4. Most Significant Change Stories……………………………………….… p.8 3.2.5. Direct observation………………………………………………………….. p.8 3.2.6. Meetings…………………………………………………………………….. p.8 3.3. Sampling procedures……………………………………………………………. p.8 3.3.1. Selection of Craftswomen Associations for focus group discussions… p.8 3.3.2. Selection of Farmers Associations for focus group discussions….…… p.9 3.3.3. Selection of Health Volunteers for focus group discussions…………... p.9 3.3.4. Selection of individuals from Craftswomen Associations and Farmers. p.9 Associations 3.4. Limitations…………………………………………………………………………. p.9 4. THE AGRICULTURE COMPONENT…………………………………………………. p.9 4.1. Overview of the agriculture component………………………………………. p.9 4.2. Findings of the agriculture component…………………………………….... p.11 4.2.1. Summary of findings from the Farmers Associations…………………. p.11 4.2.2. Summary of individual interviews with farmers………………………... p.15 4.2.3. Summary of secondary data…………………………………...………… p.16 4.2.4. Summary of meetings with mayors……………………………………… p.17 4.3. Analysis……………………………………………………………………………. p.17 4.3.1. Sensitization and targeting process of the project……………………... p.17 4.3.2. Results and impact……………………………………………………..…. p.18 4.3.3. Project effectiveness………………………………………………..…….. p.22 4.3.4. Project relevance……………………………………………………….…. p.22 4.3.5. Project sustainability…………………………………………………….… p.23 4.3.6. Project constraints………………………………………………………… p.25 4.4. Recommendations……………………………………………………….……… p.25 5. THE CRAFTS COMPONENT……………………………………………………….... p.26 5.1. Findings……………………………………………………………………..…….. p.26 5.1.1. Summary of focus group discussions…………………………………… p.26 5.2. Analysis………………………………………………………………………..….. p.34 5.2.1. Results and impact……………………………………………...………… p.34 5.2.2. Project effectiveness…………………………………………………..….. p.35 5.2.3. Project relevance……………………………………………………….…. p.35
  • 3. 3 5.2.4. Project sustainability……………………………………………….……… p.36 5.2.5. Project constraints………………………………………………………… p.36 5.3. Recommendations………………………………………………………...…….. p.36 6. THE HEALTH COMPONENT………………………………………………...………. p.37 6.1. Findings……………………………………………………………………..…….. p.37 6.1.1. Assessment of expected results for the health activities……………… p.37 6.1.2. Summary of interviews with project staff………………………...……… p.38 6.1.3. Summary of findings of individual interviews with health volunteers… p.40 6.2. Analysis…………………………………………………………………………... p. 43 6.2.1. Results and impact……………………………………………………….. p.43 6.2.2. Effectiveness…………………………………………………………..….. p.43 6.2.3. Relevance…………………………………………………………...…….. p. 44 6.2.4. Sustainability………………………………………………………………. p.44 6.2.5. Constraints…………………………………………………………………. p.45 6.3. Recommendations……………………………………………………….……… p.45 7. MANAGEMENT EFFICIENCY………………………………………………………... p.45 7.1. Findings…………………………………………………………………………… p.45 7.1.1. Findings of “Partners organization’s capacity and project management”….. ……………………………………………………………..p.45 7.1.2. Findings of “Financial Management Health Check”…………………. ...p.48 7.1.3. Findings from meeting with the District Chief…………………………... p.49 7.2. Recommendations………………………………………………………….…… p.49 8. GENDER…………………………………………………………………………….….. p.49 9. SUMMARY OF RECOMMENDATIONS…………………………………………….. p.50 9.1. Summary of recommendations agriculture component……………….………. p.50 9.2. Summary of recommendations crafts component……………………..………. p.50 9.3. Summary of recommendations health component……………….……………. p.50 9.4. Summary of recommendations management efficiency……………...………. p.51 APPENDICES Appendix 1: Terms of Reference Appendix 2: Focus group discussion guide crafts associations Appendix 3: Focus group discussion guide farmer associations Appendix 4: Focus group guide health volunteers Appendix 5: Questionnaire for individual farmers Appendix 6: Financial check list Appendix 7: Management check list Appendix 8: List of focus groups conducted Appendix 9: List of health volunteers interviewed Appendix 10: List of individual farmers interviewed Appendix 11: Revised timetable for the evaluation team Appendix 12: List of documents reviewed Appendix 13: Actual yield realized Appendix 14: Summary of results interview with individual farmers Appendix 15: Pictures
  • 4. 4 LIST OF ABBREVIATIONS ADCOM = Administrative Committee ADRA = Adventist Development and Relief Agency Ariary = The local currency in Madagascar Kapoka = small cup of measurement NGO = Non governmental organization PROCOM = Project Committee SSD = District Health Department SRA = Improved rice farming system SRI = Intensive rice farming system Vata = 24Kgs
  • 5. 5 1. INTRODUCTION In May 2006, Adventist Development and Relief Agency UK (ADRA-UK), in partnership with ADRA Madagascar, began implementing the 3 year project “Alleviating Poverty through Improved Livelihood and Health project (SMART Project)” in Fandriana, a region within the Fianarantsoa province of Madagascar. The total project cost is 755,457 EUR, and is funded by the European Commission (75%), ADRA UK (16 %), and ADRA Norway (9%). The overall objective of the project is to contribute to poverty alleviation for disadvantaged communities in the region of Fandriana of Madagascar, with the specific objective stated as improved income for vulnerable rural families. The project aims at contributing to the alleviation of poverty among the poorest households in the five communes of Tatamalaza, Milamaina, Miarinavaratra, Tsarazaza, and Fandriana, in the Fandriana region through three main components; 1) Improved food security through promotion of improved rice farming and kitchen gardening, 2) improved opportunities for income-generating activities through promotion of income- generating activities in agriculture and/or crafts, and 3) improved health practices through establishing or reinforcing community-based health services. Capacity building is a cross-cutting activity in all of the components. The project works with 10 craftswomen and 65 farmers’ associations to improve their productive, technical and marketing capacities and to ensure better availability of community-based health services. The program activities aim to enhance the capacity of the targeted farmers in adopting improved agricultural techniques, to increase crop yields, increase income generation from handicraft products and overall improved health among the population of the five targeted communes. The project has been formulated in line with the concept that improved agricultural production is a pivotal component of any tangible strategy to reduce the high poverty and food insecurity rates currently prevalent in rural Madagascar. Following 16 months of implementation, an internal midterm review of the project was conducted by ADRA UK and ADRA Norway in cooperation with ADRA Madagascar. 2. PURPOSE/OBJECTIVES OF THE MID TERM REVIEW The mid term review for the project assessed operational aspects, such as project management and implementation of activities, and also the progress towards fulfilling outcomes and objectives. Second and equally an integral part, the review endeavored to re-assess the strategic objectives and implementation mechanisms proposed during the design of the project with particular attention paid to the income generating and health component of the project, to establish whether the aims and operational mechanisms are directly aligned to the overall “big picture”, in an attempt to facilitate a more efficient and effective implementation process. The following specific objectives guided the implementation of the mid term review: 1. Examine the results and impacts (where possible) To review the progress (status) of project activities towards the overall objective and specific objectives and where possible the potential development impact on the primary stakeholder groups. This encompasses an assessment of the identified existing verifiable, result and impact indicators.
  • 6. 6 2. Assess the project effectiveness To assess the achieved results against the set objectives and make an overall assessment of project cost-effectiveness. This includes an evaluation of the progress of project activities in terms of delivery of project inputs and outputs. Also ascertain if any adjustment is required in the project design to increase its scope in impacting the target groups. 3. Assess the relevance and adequacy To assess the relevance and adequacy of the Income generating and Health component to the needs of the beneficiaries. This assessment will function as a platform on which to conduct an analysis of these components of the project in regards to its lineage to the overall strategic perspective. Providing clarity of program obligations and expectations, to facilitate effective coordination. 4. Explore sustainability of the project To assess if the key stakeholders have the potential for retaining results and benefits after the conclusion of the intervention. Determine the critical success factors for the project and the conditions required to implement it. 5. Assess Constraints encountered during the project implementation To analyze the various factors and constraints which have exerted an influence on the project implementation. Such as the operational mechanisms, managerial, institutional, socio-economic policy issues and other external factors unforeseen during design. 6. Assess Management Efficiency a) To assess the performance of ADRA-UK in terms of quality of supervision, efficiency in financial administration, ability to anticipate problems and extend implementation support, adequacy of reporting, recommendations and effectiveness of follow-up on recommendations. b) To assess the performance of ADRA Madagascar in terms of project implementation (Including human resources, financial management, internal and external risk factors etc). 7. Assess the quality of cooperation with institutions and effectiveness of coordination mechanisms. 8. Produce a clear set of lessons learned that can benefit the project in its remaining life-span. See appendix 1 for further information. 3. METHODOLOGY 3.1. Overview The midterm review process utilized a combination of methods, using both secondary quantitative sources of data and qualitative data collected during the time frame of the midterm review. The review involved the major stakeholders of the project. The following stakeholders were included:  Craftswomen Associations
  • 7. 7  Farmers Associations  Health Volunteers  Individual Farmers  The Mayors in each target Commune  ADRA staff at project level  ADRA staff at country level  European Commission delegation (Courtesy visit) When the evaluation team arrived in country it became clear that not all activities planned during the mid term review could be implemented due to time constraint (one main reason being travel time in the field). It was determined that the evaluation team did not have enough time to conduct individual interviews with crafts women, additional government representatives, or other NGOs. 3.2. Methodology used 3.2.1. Review of existing information and secondary data The quantitative source of data included review of baseline survey, market survey (only part of it had been translated to English), progress reports, proposal (including revised log frame) and other data provided by the project staff. (See appendix 12 for list of documents reviewed) 3.2.2. Focus group discussions The methodology of focus group discussions was used to collect information from the Farmer’s Associations and Crafts Women Associations. Data collection tools were developed jointly by ADRA UK, ADRA Norway and ADRA Madagascar before arrival of the evaluation team. Since ADRA Madagascar had experience in conducting focus group discussions, the agreement was that the tools would be pre-tested before the evaluation team arrived. Upon arrival it was determined that this had not been done due to difficulties in communication (lack of e-mail access) between the Country Office and the Project Office. To make sure all the evaluation team members had the same understanding of what a focus group discussion is, a short training session was conducted by ADRA Norway. After the training was conducted, the evaluation tools were finalized by the evaluation team. It was decided that after the first day of implementation a review would be made to determine if any adjustments had to be made to the tools. (See appendix 2 - 7 for final version of tools). ADRA Madagascar facilitated the focus group discussions so that there was no need to use an interpreter. Mr. Mamiseheno, the Monitoring & Evaluation Officer from ADRA Madagascar, was the facilitator and conducted the focus group discussions in Malagasy. During the first two days, the project cashier/secretary assisted the evaluation team in note taking in Malagasy, and during the last 2 days of data collection, Joshua Poole, the Programs Director of ADRA Madagascar assisted in note taking (direct from Malagasy). ADRA UK and ADRA Norway were also present during the discussions and taking notes via the help of a translator. After each day of focus group discussions each note taker typed their notes, and all the notes have been compiled into one document. The focus group discussions were also recorded by a digital voice recorder. Focus group discussions for health volunteers were planned, but when the evaluation team arrived in country it was discovered that the health component of the project had
  • 8. 8 not progressed as thought. The health volunteers had not yet started to conduct health education activities in the communities. It was therefore decided not to conduct the focus group discussions, but conduct individual interviews with a couple of volunteers from each commune. 3.2.3. In-depth, individual interviews To obtain further information from the farmers, an individual interview was conducted with farmers and health volunteers from each commune. Initially it was planned to conduct individual interviews with women from the Craftswomen Associations. After arrival in country the evaluation team realized due to time constrains, that most of the questions that the team would have looked for in the individual interviews could be solicited during the focus group discussions. It was therefore deemed unnecessary to conduct individual interviews with crafts women. 3.2.4. Most Significant Change Stories: The purpose of this methodology is to reveal unintended outcomes delivered by the project. The plan was to utilize this methodology more in depth, but when the evaluation team arrived in country it was realized that there was not enough time to train the evaluation team, for them to be able to conduct this method in detail. During each focus group discussion, the question “In your opinion, what is the most significant change that has happen since the project started?” was asked. 3.2.5. Direct observation During the evaluation team’s stay in-country they were able to observe the local context of the implementation and also experience some of the logistical challenges (communication and travel time) the project staff faces. The team visited some of the beneficiary’s rice fields and kitchen gardens. 3.2.6. Meetings Both formal and informal meetings took place with ADRA Madagascar staff while the evaluation team was in country. After it was decided to reduce number the of focus group discussions (see section 3.3.) part of the evaluation team visited the commune that was deleted from the program (Miarinavaratra) and had discussions with both the Farmers Association and Craft Association. Meetings were also held with mayors in all the five communes where the project is being implemented. 3.3. Sampling procedures 3.3.1. Selection of Craftswomen’s associations for focus group discussions: Focus group discussions were conducted with 4 craftswomen’s associations. Initially it was planned to conduct focus group discussions with one craftswomen’s association in each commune; a total of five associations (out of 10), but due to time constraints the evaluation team decided to conduct only four. In communes with more than one association, one association was picked randomly (drawing the name out of a hat). The following crafts women’s associations were selected:  Tatamalaza Commune – Miandrisoa craft’s association  Milamaina Commune – Miaradia craft’s association  Tsarazaza Commune – Tsiravaina craft’s association  Fandriana Commune – Santatra craft’s association
  • 9. 9 3.3.2. Selection of Farmers associations for focus group discussions: Focus group discussions were conducted with 4 farmers associations. Initially it was planned to conduct focus group discussions with one farmers’ association in each commune; a total of five associations (out of 65) but due to time constraints the evaluation team decided to conduct only 4. In communes with more than one association, one association was picked randomly (drawing the name out of a hat). The following farmer’s associations were selected:  Tatamalaza Commune – Miaradia Farmer’s association  Milamaina Commune – Tanjona Farmer’s association  Tsarazaza Commune – Miaramizotra Farmer’s association  Fandriana Commune – Miavotene Farmer’s association 3.3.3. Selection of Health Volunteers for focus group discussions: It was initially planned that one focus group discussion with Health Volunteers would be conducted in each commune. A total of 9 Health volunteers would participate in each focus group. The participants were randomly selected from each commune. However, when the evaluation team arrived in country it was clear that the health activities were delayed; therefore the tools developed for the focus group discussions were not relevant. Instead it was decided to conduct individual interviews with a couple of health volunteers from each commune to learn about their experiences with the project so far. The health volunteers were not randomly selected, due to the challenges of distance and transportation in each commune. The Health Agent selected two volunteers from each commune. (See appendix 9 for list of health volunteers interviewed) 3.3.4. Selection of individuals from Craftswomen’s associations and Farmers associations Due to time constraints, individual interviews with craftswomen were not conducted. Purposive sampling was used to identify two farmers for in-depth interviews in each commune. The agriculture agents in each commune were asked to select two farmers based on the variation in yields. (See appendix 10 for list of farmers interviewed). 3.4. Limitations: There are several limitations to the implementation of the mid term review: 1. The mid term review is mostly using qualitative data which limits the possibility to compare the results to the baseline data and national data. 2. Due to limited time and resources, the scope of the work was limited to the most critical aspect of the implementation. It is quite likely that the evaluation team has not been able to obtain data about every issue pertinent to the project. The recommendations are based on limited knowledge obtained during the time of the mid term review. This has to be taken into consideration when reading the report. 3. Representatives from ADRA UK and ADRA Norway do not speak French or Malagasy and a translator was used. 4. The mid term review was carried out in areas that are assumed to represent the entire project area, but the sample size was limited. 4. THE AGRICULTURE COMPONENT 4.1. Overview of the agriculture component Fandriana, is one of the poorest and most food insecure districts in Madagascar. Food insecurity is exacerbated by different factors among them:
  • 10. 10  Decreasing land availability: the decrease in land availability is more marked in Fandriana because of its terrain and that has resulted in small arable land holdings. The small land sizes coupled with big family sizes (on average 5.5) results in most household only being able to produce rice enough to cover their staple food for 4 to 8 months per year.  Poor and depleted soil: soils in the area are mostly red or yellow ferralitic ones which are not very productive. Inappropriate farming techniques have also contributed to the depletion of soil structure and organic content. To restore the soil there is need for use of fertilizer that is not affordable to many because of its high prices. This results in declining yields year after year.  Little or no use of improved farming techniques: though the population has some knowledge of modern farming techniques, they do not apply them. Reasons include (i) the lack of extension agents (one extension agent for a population over 25,000) and (ii) the inability to invest in agricultural inputs due to extreme poverty. Activities of the project under the food security component were therefore designed to address the food insecurity problem understanding the above constraint. The expected results of the component are:  Beneficiary households reporting 25% increase in their staple food production  Beneficiary households reporting at least a 25% increase in financial income. During the baseline and the mid term review leading1 indicators to show progress towards achievement of the desired goals were developed and they included:  Decrease in the hunger period  Adoption of improved techniques  Dietary diversification  Coping strategies applied during the food gap  Reduction in proportion of income going toward food purchases For the food security component, the project was designed to target the following:  Poor farming households who were practicing farmers and were producing rice to cover no more than 6 months but at least 4 months of their annual needs  Willingness to work in an association  Households who to cope with food shortages practiced some form of income- generating activities, which can be agricultural production or handicrafts to supplement their incomes, but not as their main source of income.  Beneficiaries of the household with no regular waged job member.  Households that do not practice sharecropping.  Households among the 80% of the population who are literate.  90% of the beneficiaries from this category will be made up of couples, and 10% of women who are heads of households. 65 farmers associations with membership of 992 beneficiary households were formed. The total percentage of women in farmer’s associations is 37% (12% higher than the expected 25%). 1 These types of indicators signal future events
  • 11. 11 Table 1: Number of selected farmer associations per commune and household membership Communes Associations Membership 2006 Membership 2007 Miarinavaratra 14 219 221 Tsarazaza 14 180 207 Fandriana 13 205 216 Tatamalaza 12 144 180 Milamaina 12 150 168 TOTAL 65 898 992 4.2. Findings agriculture component 4.2.1. Summary of focus group discussions with Farmers Associations The evaluation team conducted four focus group discussions with Farmers Associations in four different communes (please see appendix 8). One general discussion was held with farmers in Miarainavaratra (see section 3.2.6. and 3.3). During the focus group discussions a semi-structured focus group guide was used, therefore in reporting the findings, one topic might be listed several times under different sub headings. The following section includes a summary of the findings. 4.2.1.1. What are the different ADRA activities that you have participated in? The participants of the focus group discussions revealed the following as the main activities that they participated in: 4.2.1.1.1. Training in rice farming techniques: The rice farming techniques were broken down into improved rice (SRA), intensive rice farming (SRI) and non-irrigated rice. Regarding the improved rice farming the participants described that they were trained to transplant after 15-20 days and when sowing to observe the 20-25cm distance between plants and weed after every two weeks. Regarding the intensive rice farming they reported that the difference between improved rice farming and intensive rice farming is that intensive rice is transplanted earlier, it’s being transplanted after 6-8 days. They also have to observe the 20 cm spacing rule on either side to allow for weeding. The focus groups revealed that non- irrigated rice is planted upland and is transplanted after 15 days. The reports revealed that last years crop was affected by late delivery of seeds and the crop was destroyed by a hailstorm. 4.2.1.1.2. Training in vegetable growing: The participants responded that ADRA taught the beneficiaries how to grow the following vegetables:  Carrots – they started with smaller quantities because they were not sure of how well carrots can grow in the area as they had never grown them before  Leafy green – the results were good. A few people reported that their vegetable garden is far from their houses and as a result some people stole their crop.  Potatoes – most potatoes were small because they had diseases resulting in a low yield.  Cabbages – the beneficiaries were taught how to grow cabbages and learned that cabbages cannot be planted in the same field as rice because they need soft soil and the rice fields have lumps. 4.2.1.1.3. Compost making: The participants revealed that the beneficiaries had been given seeds to grow plants so that they can get leaves for composting in future. In addition, they were also taught how
  • 12. 12 to make compost manually. One beneficiary described the process: “To make compost manure the process starts by collecting both dried and green leaves. Then I cut the leaves in 10cm and pile them together. On the top layer I put cow manure and water. Cover the leaves with dirt with a stick in the middle. Every week I mix the content and by the end of the 3 weeks the compost is ready.” The participants also reported that they have been trained on how to use fertilizer (bone powder), 4.2.1.1.4. Training on Long cycle income generation activities: The members reported that they had just started implementing activities like planting orange trees, chicken raising, bee keeping and fish farming. 4.2.1.1.5 Study Tours: The members also reported that representatives of the associations went on field trips to Moramanga, Antsirabe and Antananarivo where they observed other ADRA Madagascar’s initiatives. 4.2.1.1.6 The focus group discussions also revealed that the beneficiaries were taught about association management. The also reported that they received training in family planning training. 4.2.1.2. What are the new skills that you have learned from ADRA? When asked to describe the new skills that the participants had learnt from ADRA the main responses were a) techniques for SRA and SRI rice farming and b) how to plant vegetables. A follow up question was made on how they found the techniques that they had learnt and the following are sentiments that were shared by the participants in comparison with their previous practices. Participants felt that the new techniques are better than the traditional method because the yield has increased compared to previously. The participants felt that the new techniques require more work than when they used the traditional method but since the results are better they are not discouraged. They reported that the new technique requires them to keep and manage time and that is one skill that they have learnt. The participants also reported that they were taught how to control water in their field. They further reported that it was not easy to control the water because sometimes the farmers of the neighboring field may not be practicing the same technique. Therefore it makes it difficult to just control the water on one field alone. The farmers have been taught that water should not be flooded and the 3cm minimum height should always be observed. Although some fields get flooded, association members help each other to follow the practice. A follow up question was asked to the participants to report what material support they had received from ADRA. The following summarizes the answers: Farm equipment including weeders, sprayers, forks, dolemite fertilizer, rakes, and water cans. The equipment is kept by the treasurer who makes plans for lending it out. People use the equipment and are divided into groups based on distances from each other; those in the same neighborhood form one group. According to the participants the system is good and it works well because everyone has equal access to the equipment. Some members alluded to the fact that the equipment that they wanted was not provided to them. They reported that they needed oxen to help them with the ploughing of the field. It was also reported that the equipment; especially the weeders are not enough as most people want to use them at the same time. A lot of associations reported that they have created a fund for use to maintain the equipment.
  • 13. 13 In addition, the members reported that they also received seeds, manuals and fertilizer. 4.2.1.3. What does the improved rice farming concept involve? The following is the summary of the answers from the participants: The seeds are soaked in water and planted in the field. Rice is transplanted after 15-20 days. It is planted in rows and the distance between each plant should be 20-25cm to enable them to weed properly in all directions. The space also gives the rice plant space to breath. The participants reported that rice is transplanted when it is very young – with just 2 leaves. There is also need to control water regularly so that the field is not flooded. After transplanting the rice, the fields have to be weeded every two weeks even if you do not see the weeds. 4.2.1.4. What does the non-irrigated rice farming involve? The participants stated that this was the first time this technique was used by them as they have always planted rice in the rice fields. Non-irrigated rice is planted upland and transplanted after 15 days. However, during the last planting season, seeds were delivered late and their crop was also attacked by pests. Furthermore, their crop was destroyed by hail. Most of the participants reported that their yield was low. 4.2.1.5. What is the role of the Farmers Associations? The participants reported that the associations are there for ”cooperation and to unite the members.” In addition, the associations provide the members with an opportunity to share knowledge and exchange ideas. The association also helps the members to plan their work; they meet and schedule a work plan. The association also coordinates the income generation components for funds to maintain equipment, to buy other agricultural inputs and also for social activities. Members of the association pay a fee. Some pay monthly and some paid a yearly fee soon after harvest. Associations have rules and regulations that each member has to follow. One such rule is that all members should attend meetings and if a member does not attend a meeting without a good reason they are fined. However the association does not fine unnecessarily, they analyze the reasons why a rule was not followed. Members were involved in setting up the rules and regulations of associations so they feel the regulations are fair. Socially, the association members help each other with work. Associations also help the farmers to work with donors. When asked if there are any disadvantages to belonging to an association, the members said there were not any disadvantages. However one association reported that the members are separated form the community. There were some comments that the members are not able to follow all the techniques because of time constraints. Attendance of meetings can sometimes be a problem due to multiple roles that they have to carry out. 4.2.1.6. How do you think ADRA is contributing to food security in the commune? In response to the question, the participants felt that ADRA’s contribution to food security has been through teaching them new farming techniques and providing them with the required inputs (seeds and fertilizer) and also equipment to do their work better. They added that ADRA has introduced crop diversity and that too has added to their food security. The technicians who live in the commune also monitor their work so that they have been able to master the techniques. Overall, all these efforts have resulted in hunger period being reduced.
  • 14. 14 4.2.1.7. In your opinion, what aspects of the project have worked well, what has not worked well and how can ADRA improve the aspects that are currently not working well? In describing what has worked well, the main responses were that their rice lasts longer. They also felt that the introduction of new crops like cabbages was good. They also reported that the training went well. The provision of the equipment and inputs was also good as it allowed them to practice what they had learnt during the trainings. They also reported that the manuals that were distributed during the training have been helpful as they are able to refer to them when they forget how to do something. The participants also reported that they have learnt to manage their time better and can undertake a lot of activities in one day. In describing what did not work well, the following were the main responses: Their non-irrigated rice crop was destroyed by hail and their potatoes had diseases. The participants also complained that the equipment that was distributed was not enough as they all needed to use it at the same time. The participants also advised that the training should be more practical than theory as practical training makes it easy for them to understand. In reporting the main areas that the participants wanted ADRA to improve, the participants stressed that inputs should be delivered early to them as usually they need time to transport them to the fields which are far from their houses. They also added that ADRA should work towards assisting that the inputs that they have introduced to make them are available on the local markets. The participants also added that their non-irrigated rice field soil is very poor therefore requires more fertilizer than was provided to them by the project. The participants also responded that they needed more equipment especially oxen to help them with their labor needs. 4.2.1.8. What do you think will happen after the project has ended? The participants responded that the associations will continue beyond ADRA’s project. The participants will continue to use the skills and the knowledge that they have learnt. They will continue to make compost. In addition, they will continue to encourage one another. The associations have created funds so that they can enable them to buy seeds, fertilizers and maintain equipment when ADRA leaves. 4.2.1.9. In your opinion, what has been the most significant change that has occurred since the project started? The following are the main responses that came up during the discussion:  Access to inputs – didn’t buy seeds  Improvement in rice production – food lasts longer  Exchange ideas  No need to buy seeds  We are using less seeds for the same fields  Soil has improved as a result of using bone powder  Time management  Ways of working – members felt they work hard and can achieve more  Mentality change – to do away with traditional methods and apply techniques  Price of rice is lower compared to last year  Diverse diet  Households have no problems to find rice accompaniments because they are growing vegetables
  • 15. 15  Women and men treated equally  Life difficulties have reduced 4.2.2. Summary of individual interviews with farmers Individual interviews were conducted with 10 farmers – 2 from each commune. The two farmers were strategically chosen and were representatives of those farmers who had produced above average and those who had produced below expected average in their communes. The interviews were conducted to understand how the project activities have made a difference in their individual households and learn about the coping mechanisms that would be applied in times of food shortages and if they have changed since the project started. For those who had produced above average, the objective was to understand what they had done different compared to other farmers, their experience with the technique has been and if they sold part of their produce, what they spent their money on. The interviews revealed that all the farmers had adopted the techniques. Eight of the ten farmers adopted improved rice techniques and only two reported to have adopted the intensive rice farming technique. They all had however, tried the non-irrigated rice technique for the first time. Compared to the 2005/6 season, most of the farmers (7) reported to have increased the surface area of land where they have used the technique. The reason behind the increase is that they are convinced that the techniques work. Two farmers had adopted the technique on 100% of their land during the 2005/6 agricultural season and therefore reported no change to the surface area. One farmer reported to have reduced his surface area from 10 ara last season to 8 ara during this season due to a bad harvest that he had. (100 ara = 1 hectare, 1 ara = rice field 10 x 10 meters squared). Despite Fandriana District experiencing one of the worst cyclones in this decade during the last planting season, eight farmers reported that their yield had increased compared to 2005/2006 season. Two farmers reported a reduced yield. All the farmers reported a decrease in the hunger period of on average two months. This was attributed to better harvest and introduction of vegetables like potatoes in their diets that reduced the quantity of rice cooked. All the households reported that they used the vegetables for own consumption and they sold some as well. They all reported that their annual expenditure towards food had reduced because of the reduced number of months that they needed to procure rice. Each of the farmers interviewed revealed that they will be affected by food shortages during the lean season and some strategies will be applied to cope. Eight of the farmers reported that eating less preferred foods like cassava and potatoes was the main strategy for coping with a food shortage. When asked to describe the two main ways how they were planning to cope with the food gap/shortages during the lean season, the following are the results in order of most applied strategy:  Eating less preferred foods (8)  Sell of chicken and pigs (3)  Selling of crafts (3)  Reducing meal quantities (1)  Casual labor (4)  Borrow money (1)  Charcoal production (1)
  • 16. 16 Two farmers out of the ten had produced a surplus of rice. They both had a total of 50 ara of land. One of the farmers had applied the intensive rice technique on all his land and the other had applied the intensive rice technique on 35 ara and improved rice technique on 15ara. After selling their rice, one used the money to pay school fees for his two children attending university and employ laborers to work on his field and the other one used his money, mainly to buy oxen to address labor constraint. The two farmers described the techniques to be effective to address their food problems. However, they both reported that they felt they reported a high yield because (i) they have big land (ii) they had more people helping in the field and (iii) they applied the intensive rice farming technique which is much more labor intensive than the improved technique but produces much more rice. (Summary of individual farmers interview appendix 14). 4.2.3. Summary of secondary data (reports, monitoring data etc) From monitoring reports, the team was able to learn that rice is normally planted in September and harvested around March. It was expected that during the 2006/7 agricultural season beneficiary households would apply their newly acquired knowledge and skills therefore increase their yield. Monitoring reports show that all the beneficiary households applied the techniques with the majority applying the techniques on part of their land as a way of experimenting if the techniques would really work. Reports also showed that there had been attempts in the past by other NGOs to introduced the similar farming techniques in the same target area however adoption of the techniques were so low due to lack of inputs. 4.2.3.1. Improved Rice techniques The rice planted under the irrigated system was harvested and the following results have been reported in self monitoring tools and agents activity reports (Appendix 13: Actual yield realized):  The maximum yield was 14 tons/ha reported in Miarinavaratra commune and the minimum was 1,08 tons/ha.  The general average yield of 5.23 tons/ha exceeded the average yield of 2.21 tons/ha that was reported in the baseline and more than the target set by the project of 3-4tons/ha.The project goal of increasing the yield by 25% was achieved and surpassed by nearly 100%.  A total of 523 tons of irrigated rice was collected from 100 hectares of cultivated area. 4.2.3.2. Non-irrigated Rice Production Non-irrigated rice was promoted as a strategy to improve household food security and was a completely new activity in the region. The average target yield was 1.5 to 2tons/ha however the actual yields reported were maximum of 3tons/ha and minimum of 0,05tons/ha. Overall, the average yield was 0.53tons/ha way below the target. 4.2.3.3. Kitchen gardens Kitchen gardening was introduced in the last quarter of year 1 and all beneficiary households were targeted for the activity. (Appendix 13: Actual yield results).The potato crops in the Fandriana district were attacked and virtually all potato fields were infected
  • 17. 17 by diseases: anthracnose and oidium. Otherwise farmers had a good yield in the other crops that help with the food situation at household level. 4.2.4. Summary of meetings with mayors Each field visit started with meetings with the mayors who are the local government representatives in their communes. Discussions with the mayors revealed that they are working very closely with the project teams, especially the extension agents, and that the project is supporting some of the needs mentioned in the development plans of their various communes. They also reported that the project, especially the agricultural component, was very well publicized and the targeting criteria were clear and transparent. They reported that initially people were hesitant to join associations due to a bad experience with a microfinance group lending project that was implemented in the same five communes before, but after the mayors explained to the communities how this project was different from the other one, more people were interested in being beneficiaries. 4.3. Analysis A baseline was conducted in January 2007. The mid term review just like the baseline was carried out during the hunger period. Conducting both the baseline and the mid term review during the lean season has made it possible to give an indication of beneficiaries’ vulnerability as well as the progress towards achieving some indicators that the baseline collected. For example: adoption rate of technique and hunger period duration. A review of the plan document reveals a largely positive process was followed, with a thorough contextual review and a problem statement. Food security as was during the designing of the project phase continues to be the priority area of focus in the newly developed Poverty Reduction Strategy Paper (2007) and has been outlined as challenge 7 to improve nutrition and food security. In addition the government has established a national office of nutrition (ONN) to develop action plans. The evaluation team found that core documents confirm that the project is addressing key food security issues. Further it found that the strategies suggested seem to be appropriate to the local context. 4.3.1. Sensitization and targeting process of the project Direct observations revealed that due to the initial skepticism demonstrated at the sensitization period of the project, some inclusion errors were noted e.g. inclusion of regular waged people like the mayors. e.g. in Tatamalaza and Milamaina as beneficiaries. Also noted was the fact that “willingness to work in an association” was one of the criteria, would have led to self exclusion by some poor households who may not have taken the courage to join the associations. However, despite a few inclusion errors, the review team concluded that the process was transparent and worked with community leaders who helped to identify and verify that the beneficiaries that were selected were the poor households in their communities. One lesson learnt is that for future projects rather than focusing on just social indicators the criteria should make an attempt to include some economic criteria like possession of productive assets by a household. A targeting meeting where all the villagers understand the criteria and can be part of the selection process would be beneficial.
  • 18. 18 4.3.2. Results and Impact 4.3.2.1. Training of farmers As mentioned in the findings section farmers were asked to report the training that they had conducted and all the associations were able to demonstrate an understanding of the methodology. They clearly articulate the training that they received and the technical specifications for each of the rice farming methods for example:  How to prepare the seeds for sowing  How to prepare the land before sowing  Spacing between seedlings for each of the methods  Weeding requirements  And how to generally take care of their crops It is the view of the mid term review team that the farmers understanding of the techniques is good and that the training methodology was effective. 4.3.2.2. Provision of farm inputs Complimenting the training with provision of skills, inputs and equipment and on going presence of an extension agent in the commune was the frequently cited answers to respond to the ‘what worked well in the project’ question and is the element that has made the project unique and successful according to beneficiaries according to the mayors and the beneficiaries. Training has been conducted before by other NGOs in improved techniques of rice farming and the baseline showed that only 29% of the beneficiaries adopted the techniques. The main reasons for not adopting the techniques were that the farmers could not afford the inputs that were suggested. After ADRA provided seeds, fertilizers and small equipment, 100% of the beneficiaries adopted the techniques. An important lesson for the future is that the training alone in poor communities without initial provision of inputs and ongoing supervision is not effective. The training approach that was taken by the project is worth replicating when designing similar projects. 4.3.2.3. Food Security The mid term review team relied on focus groups, farmers own experiences during the individual farmer interviews and secondary data to get an indication as to progress towards the food security and economic security theme. Food security can be measured in a variety of ways. For the project, increased production for the main staple food is the critical indicator. One common way such as number of months of household food supply, ostensibly from own production, is the most commonly cited factor. Monitoring reports (agents activity reports and farmers self monitoring tools), complimented by discussions with project staff, mayors, farmer associations as well as interviews with the individual farmers indicated that, for those households who have adopted improved farming methods, their yield has improved. Focus group discussions and interviews with farmers revealed that the food gap, which used to range from 6-9 months (July to March) has been reduced to on average 4-5 months. Most of the households reported a reduction of the hunger period by 2 months. The main reason provided for the reduction in the hunger period was the increased production of rice that the households experienced after adopting the techniques. Appendix 13 demonstrates the increase in production that mainly exceeded the targets that were set for the communes. All the associations that were met during the mid-term review reported positive results from their last harvest and felt that the improved techniques produced more rice compared with the traditional method.
  • 19. 19 Personal Experiences Ms. Aline Labao of Tsarazaza reported that she planted a total of 20 ara of rice. She divided her land in half and planted 10 ara using the traditional method and 10 ara using the improved rice technique. She reported that her harvest was 96 containers from the 10 ara where she used the improved technique and harvested 62 containers from the field where she planted using the traditional method. Mr. Jacque Alfred Razakamanana applied Intensive Rice technique on 6 out of his 40 ara land. He reported that he harvested 600kgs from the 6 ara which was the same as what he harvested on the remaining 34 ara where the traditional method was used. In Miarinavaratra, a lower rice price in markets was reported to demonstrate the increased supply of rice. In 2006, during the month of November, the price of a kapoka of rice was 440 Ariary. This year the price has reduced to 330 Ariary/kapoka and this is the cheapest that they have seen in rice prices for the past 5 years. Baseline results showed that only 29% of the beneficiaries were practicing the improved techniques. Monitoring reports and focus group discussions showed that all the farmers have adopted the technique during the last agricultural season with varying surface sizes. In the second rice planting season, many farmers have also reportedly increased the surface area where the techniques have been adopted. Monitoring reports revealed that 87% of the farmers have increased surface area with 10% reporting no change while 3% have reportedly reduced the surface area. As a way of verification, interviews were conducted with ten individual farmers seven had increased surface area and only one had reduced the surface area. Two out of the ten reported to have planted 100% of their land with the technique both seasons. Most households reported eating rice with vegetables from their own production. The inclusion of such new foods in their diet signified a major change in their life style as previously rice had been eaten dry without accompaniments. In Miarinavaratra (the furthest commune visited), all members of the farmers’ association revealed that they had never eaten cabbage and carrots before. Although a significant number reported to have sold their vegetables, all the households that were individually interviewed revealed that they also had used some of the vegetables for their own consumption in addition to selling. None of the households reported to have stored any of the vegetables. From lessons learnt in other projects, the review team observed that introduction of new crops to the diet is good but to achieve better results it should be complimented with training on its preparation for micronutrient retention. In addition dealing with food preservation issues when there is high supply for use during the lean season is fundamental to ensure that the nutrition status is maintained throughout the year. Teaching people on how they can preserve their food for use during food shortages periods should be considered as the project finalizes its health strategy. Promotion of nutrition awareness was also observed to be an important area of focus after discussions with agents revealed that because vegetables are a new inclusion in a Malagasy diet, some households would sell most of their vegetable production and not include it in their knowledge because of lack of information on the importance of eating a well balanced diet.
  • 20. 20 Types of coping strategies2 that households apply in times of food shortages revealed the vulnerability of targeted households. A coping strategy index was not developed for this mid term review and secondary reports were used to identify strategies that have generally been considered severe. For example, reducing the quantity of a meal but maintaining the same number of meals is considered less severe than skipping a meal. In the local context, eating less preferred foods (which was cited as the main coping strategy) is considered less severe compared with borrowing money especially to buy food which in the Malagasy culture is considered to be an extremely embarrassing situation an option that is the last resort when all has failed. Charcoal production is considered unsustainable because of the effects of deforestation that could further result in more problems. Casual labor though, was considered normal but is not sustainable as it results in people neglecting their own field. In the long term this would affect their own yield and overall food security at the household level. Although the responses according to the beneficiaries revealed an improvement in the way they had coped previously, most of them revealed that they would have added to their strategies – borrowing money to go and buy foods. It is still important that the coping strategies are reviewed regularly during monitoring visits to ensure that households are not resorting to destructive activities. It is anticipated that the long cycle income generation activities will improve the household’s resilience to food shortages. The reduction in the months in which they need to buy food has helped them. In addition, the mid term review team observed that association members seem to be socially responsible for one another. Reduction in percentage of household expenditure going towards food is a good indicator as well that shows improved livelihood. The reduction in the food gap has resulted in a decrease in expenditure going towards food purchases 4.3.2.4. Adoption of technique by non beneficiaries All the associations and mayors that were met during the mid term review reported that there are a lot of non beneficiaries who have expressed an interest to join the associations and asked if the project could increase its coverage. In addition, it was also learnt that a lot of non beneficiaries are copying the techniques. Direct observations of the rice fields during the visits also revealed that non beneficiaries have adopted the techniques during the 2007/8 season. All the agents revealed that they had been approached by non beneficiaries in the communes where they were working to find out more about the techniques. The extension agent in Miarinavaratra –reported to have conducted additional training to 124 non beneficiaries. In Miaradia and Miaramizotra the chief of the fokontany has included on the agenda for his meetings some basic training on the techniques. Due to financial constraints, the project cannot increase its coverage, however it seems that the non beneficiaries are interested in learning about the techniques and asking beneficiaries to share their knowledge with them. Considering this demand for information, it might be a good opportunity to identify lead farmers to conduct and provide support to this group. This could lead to overall food security in the area. One 2 The term ‘coping strategies’ as used here is meant to denote a range of responses to ‘shock’. These responses will comprise intensifying existing livelihood activities as well as expanding activities in order to diversify food and income sources. The sustainability, legality and adverse impact of these activities (on adopters and the community) will vary depending on the severity and duration of the shock
  • 21. 21 way of doing this would be to provide in-depth training to especially those who seem to have grasped the techniques as demonstrated by their yields. This would create a model farmer system proven effective in other ADRA Madagascar interventions. In addition chiefs of fokontany could be called upon to spread information to interested parties. 4.3.2.5. Economic Impact This theme is closely linked with food security as food must largely be purchased in the months prior to harvest. The project seeks to achieve sustainable increases in income for its beneficiary population to be demonstrated through purchase of productive assets etc. Since the project has been implemented only for one agricultural season, while a reduction in the food gap was reported, most households are still not self sufficient in food. Some indication on the increased income were sought during the individual interviews especially among those who had exceeded the planned production targets and some positive results were reported.  Reportedly in one area, the Rabemiafara family who did not hesitate to apply the improved techniques on their 50 ara land (15 ara improved rice and 35 ara Intensive rice) produced 100 Vata3 and sold 40Vata of their rice. The family sold each Vata for 4,000 Ariary. This household reported an improved cash income and was able to pay for their two children university fees without borrowing from anyone.  The Randriamihasoa family after calculating their yearly food requirement was able to sell 1 ton of their rice at 500 Ariary/kg. The proceeds from the sale were used to buy an oxen to help with the field work on their 50 ara land that they have cultivated using the improved technique. 4.3.2.6. Long cycle Income generation activities Four main activities have been identified as long cycle income generating activities (i) Chicken raising (ii) Agriculture (iii) Fish farming (iv) and fruit trees or essential oil trees. Long cycle income generation activities are those which farmers will implement to further improve their livelihood and alleviate themselves from poverty. As this activity has just been introduced in year two most of the discussions were centered on the strategy of implementation for the activity. Discussions with the project staff revealed that the four activities that were identified during the design phase are still relevant. However, observation of the mid term review team is that the implementation strategy for the activity is not clear especially for fish farming and bee keeping. It was felt that minimal attention has been paid to the demand side to make them viable business operations. A general lesson that has been learnt during implementation of the project especially for the craft component of the project has been the isolation of Fandriana to major centers and how linkages to markets have proven to be problematic. The mid term review team felt that this lesson should be considered in the implementation of the long cycle activities as well as it is anticipated that there will be buyers for the proposed products. The mid term review team also felt that although the project had proposed the 4 activities at design stage, a more study should be carried out to understand their appropriateness for each of the 5 communes. Although culturally the people in the communes may be the same, certain aspects of the commune need to be considered and uniform activities should not be applied to all communes. Factors to consider before implementation include access to markets, quality issues and storage and packaging facilities. A cost and benefit analysis will also need to be carried out with set targets in for income and production and monitoring tools developed to measure them. When the 3 Vata = 24Kgs
  • 22. 22 project team was asked basic information as to the price they expected to sell a kg/honey or a comparison of what those currently practicing bee keeping are producing and what the project expects them to produce after the project activities was also not easy to obtain. The mid term review team recommends that more ground work be carried out with attention paid to markets, processing, packaging and quantity and financial targets. 4.3.3. Project effectiveness At this level, the mid term review team examined the extent to which results had been achieved against set objectives. Overall the mid-term review team concluded that the agricultural production activities that have been implemented so far are on track to meet the desired outcomes. However, lessons learnt from other projects and using the definition of food security to be “ability to acquire sufficient quality and quantity of food to meet all household’s member nutritional requirements for productive lives” 4 it was felt that these agricultural interventions to be effective, nutrition aspects of food security need to be addressed to ensure that the high production of food in resulting in correct usage reported in detail above. The mid term review team felt that the newly introduced long cycle activities need to be reviewed as above if they are to be effective in reaching the desired goals. 4.3.4. Project relevance This section is trying to assess whether the project interventions continue to be relevant. This section goes slightly further by also considering whether the strategies chosen by the project were and remain appropriate given contextual trends, community needs, the priorities of the Malagasy government and are within the European Community thematic and geographic priorities. Meetings with the mayors indicated that the project activities are in line with what has been identified as priority areas in their commune’s development plans. Monitoring reports and discussions with the project team and beneficiaries revealed that the project has carried out activities aimed at increasing food availability and access at the household level. Realizing that the project cannot increase land size, the project provided training in farming methods that can increase yields. Also introduced were new activities aimed to further improve the food situation like non-irrigated rice techniques and kitchen gardening on land that would otherwise have remained idle because of its unsuitability for rice farming. The problem of soil depletion was addressed by providing farmers with bone powder and fertilizer to address the specific needs that were identified. The target beneficiaries are poor people who cannot afford to buy chemical fertilizers. Therefore addressing this problem in a sustainable way required an inexpensive method. Beneficiaries were provided skills for making compost manure which is sustainable in that they don’t need to buy inputs. In addition farmers were given seeds to plant trees that would in the long term produce leaves which they can use for compost production. The lack of knowledge of improved techniques was addressed by teaching the beneficiaries about improved farming techniques. Additionally, the project was designed with the support of local governments that the extension agents would stay in their 4 USAID’s definition from Food Nutrition Technical Assistance.
  • 23. 23 communes to provide adequate support to the farmers. To address the input problems, farmers were provided with inputs and equipment that has contributed to food security. When asked “how is ADRA contributing to food security” the responses were through training, provision of seeds, equipment and knowledge. The activities continue to be relevant as many beneficiaries, though they have reported yield increases, are still NOT producing enough food for the whole year. All the beneficiaries who were interviewed reported that in order for the techniques to be effective, they also need a lot of labor and although they require less seeds, the seeds are expensive. These two reasons were cited as the most prohibitive factors for many beneficiaries to increase the surface area. The farmers were given seeds that they can recycle for another two years so the problem is dealt with for now and hopefully the funds that the associations have created will address the challenge. ADRA’s role though could be working with seed producers to create outlet shops in Fandriana. At the moment the seeds that ADRA provided are only available in Antananarivo. In fact some of the participants do not know what the names of the seeds were and called them ‘ADRA’s seeds’. The review team were however noted how certain associations are creating community based initiatives to support each other to address the labor constraint like creating a roaster when all the members would work on one field using part of their funds to hire labor for those most in need of help. Promotion of such initiatives as best practices is one of the ways of addressing the labor issue. On responsiveness, the team was interested in establishing the extent to which the program responded to emerging challenges on the ground and whether this response was timely and appropriate. From reports and discussion with project team, an example of a situation where the project responded to issues on the ground in an excellent way was when an implementation strategy for training was changed. Initially, the project was designed to have a total of 10 commune model plots that were to be provided by the communal chiefs. However, due to problems identified during the theory sessions such as division of labor to maintain the communal farm and distance to communal plots, the project management decided to establish demo plots for each association (this plot would belong to one of the members of the association but would be used by the group and the agent to conduct the practical training). A total of 65 Demo plots for each association were established. In addition, when it was learnt that farmers found it easier to follow practical training than theory more time was spent on practical training sessions that were conducted on the demo plots. Furthermore, a study tour to ADRA’s other project in Moramanga was made to enable farmers to see for themselves how the techniques can make a difference in their lives. Most farmers were motivated after the trip to do much more. 4.3.5. Project Sustainability With regard to the project, associations were very confident that development activities would continue even when ADRA phased out their activities. The main elements for sustainability were the knowledge and skills, creation of revolving funds, equipment maintenance plans as well as ways of working together as an association that would continue to be used into the future: “We have acquired different skills and we will continue using these skills”, said one respondent. Another respondent said: “we have found out that what ever we have learnt is for our benefit. We will continue drawing on
  • 24. 24 the knowledge and skills. Another one responded “I received technical training for free. I can teach my children and next generation…” An association member reported “we have been taught how to manage associations and we plan to remain as an association and become an autonomous entity by 2010”.These sentiments are certainly believable especially with regard to some of the activities introduced by the project. For example, it is difficult to imagine why people would abandon the improved ways of cultivation introduced by ADRA, which are clearly improving food security. The first year of implementation concentrated on agricultural production and from year two the project has added elements of possible income generation activities including poultry, fish farming, bee keeping and livestock production which will enable the farmers to continue with the techniques as they will have income to buy inputs. In terms of exit strategies, the project will stop its implementation in April 2009. After having operated in one district for three years it is important to see if communities can continue to function without external input. The final year of the project will focus on activities aimed at enhancing the capacity of associations to operate on their own. Already mid way through the project, the review team had seen some creative ways in which different associations are dealing with the issue of sustainability. It is therefore recommended that identification of best practices be documented for sharing among associations. Some best practices: In Tatamalaza commune, Miaradia 1 Association collected a portion of rice soon after harvest and stored it. When the hunger period started they sold the rice to the members at a cheaper price rate than the market price. The money has been used to create a fund for association business but also for festivities like during Christmas time. Miaramizotra Association in Tsarazaza commune collected part of the rice yield from each member that they kept and sold during the lean season when the price had increased. With this money, they created a fund and will use the money to buy more rice this year for resale during the next lean season. In addition they have created a separate equipment fund. Each member pays 100 Ariary whenever they use the weeder. This money is kept by the treasurer for use to repair the equipment or to buy more equipment when needed. Miavotena association in Fandriana has created a communal kitchen garden. One member volunteered usage of her land. Labor, harvesting and selling of products was done by all the associations together. The proceeds from the sale have enabled them to create a revolving fund. Next year another member will provide land for the communal garden. One association in Miarinavarata (a drought prone commune) collected rice from each other during the last harvest and sold it during the lean season and used the money to buy additional farm equipment: 11 hoes and 3 pedal pump pipes. In Marinavarata 12 communal storage facilities have been built for storage of food for use during the lean season. To deal with labor constraints and to meet the timetable that is required for the improved techniques, women in the Miavotena association work together in one field to transplant. This has addressed the labor constraints.
  • 25. 25 4.3.6. Project Constraints: Beneficiaries cited the following constraints:  Last season Fandriana had one of the worst cyclone seasons.  Lack of seeds on the specific seeds that ADRA provided on the local market  Labor was cited as a major constraint for households to apply the techniques on a bigger surface area.  Theft of vegetables was experienced by some farmers  Pests affected the yield of rain field rice  Diseases that affected potatoes Project staff cited the following constraints:  Lack of communication facilities  Travel problems due to bad roads 4.4. Recommendations: 4.4.1. Nutrition Education The review team observed that in an area reported to have high incidences of malnutrition, introduction of new crops to the diet is good but to achieve better results should be complimented with nutrition education focusing on food preparation for maximum nutrient retention. The health strategy should include this aspect of nutrition education including food preparation seminars and storage of food for use during the lean season. 4.4.2. Long cycle Income generation activities A clear strategy on how the market side of the long cycle income generation activities including a basic cost and benefit analysis should be developed considering the issues raised by the mid term review team in the above section 4.3.2.6. 1.4.3 Seed availability on the markets It was noted many households would like to increase surface area where the techniques are applied; however, lack of availability of seeds on the local markets is a limiting factor for both beneficiaries and non beneficiaries who may want to adopt the technique. The fact that the exact seeds that ADRA provided to the farmers are not available locally makes them very expensive to access as someone has to travel far to buy them. ADRA should liaise with seeds organization and pursue the possibility of creating an outlet for their products in Fandriana. 4.4.3. Best practices As part of monitoring, the project agents should conduct a study and document all the best practices especially those to do with creation of revolving funds and share them with each other to promote learning. For example, Tanjona Association that has not yet created a fund, would benefit from experiences of other associations who have already established funds like in Miarinavatra. There are no clear targets in the logical framework in terms of what the project expected to be the adequate surface area to be cultivated using the technique. Despite that initial omission, this information can easily be available from the extension agents reports and the farmers self monitoring tools. It is important for extension agents to record the changes in the surface area that are taking place and in the long run can help us
  • 26. 26 understand and learn the reasons behind some people not applying the techniques to the whole land. 5. THE CRAFTS COMPONENT 5.1. Findings 5.1.1. Summary of the focus group discussions with Craftswomen Associations The evaluation team conducted four focus group discussions with Craftswomen Associations in four different communes (please see appendix 8). During the focus group discussions a semi-structured focus group guide was used, therefore in reporting the finding, one topic might be listed several times under different sub headings. The following section includes a summary of the findings. 5.1.1.1. What is the role of the craftswomen association? The focus group participants believe the associations are good because it gives them a forum where they can work together and share experiences. The associations help them to improve their lives. Through the association they learn new skills, both from trainings provided by ADRA and from each other. Through the training sessions they have been able to improve existing skills; the quality of their products has improved. One focus group reported that only a few of them had worked with crafts before, while another focus group mentioned that half of the members had worked with crafts in the past and the rest of the members just wanted to learn the skills. When the project started, ADRA staff visited the villages and talked to the women about the project and the formation of crafts associations. According to the participants; the women who were interested were welcome to join an association. There are currently between 10-15 members of each association. ADRA’s criterion was to have maximum 15 women in each association. A couple of associations mentioned that more than15 women were interested in joining but it was the first 15 women who showed interest that became members of the association. A couple of other associations mentioned that more than 15 women were interested because women are now coming to the workshop and want to learn from the association members and the association members teach them. Some of the villages had crafts associations before the project started. One association mentioned they had started the association in 2001. Each association has internal regulations. The members decided the regulations themselves and think they are appropriate. The regulations are needed to “keep order” to have “good organization”, “coordinate work” and “control the members” in the associations. For example, the internal regulations decide work hours. Several of the associations mentioned the regulations help them work together, they start at a precise time and if some of the members cannot attend (e.g. due to illness) they have to inform the associations why they cannot work. “The regulations control the actions of the group and make it equal for everyone. The same rules apply to all and if there are no regulations “people do what they like.” Only one association reported that none of its members had quit the association. In a couple of associations the number of people who had left was seven and five. Several reasons for why some women left were mentioned:  The women who left thought they would get paid  They left because they did not have immediate benefits.  They did not like the regulations.  They were concerned it would conflict with other priorities.
  • 27. 27  Some were discouraged because they didn’t have time to take care of own house. 5.1.1.2. What type of training have you received from ADRA? When asked what type of training the associations had received from ADRA it varied from association to association. The main skills mentioned were as follow; a) weaving, b) crochet, c) wickerwork, and d) embroidery. They all received training in how to improve the finish of their products. There were many different answers when asked the duration of the training sessions. The answers varied from 2 to 5 days pending on the type of craft they were being trained in. All of the associations mentioned that the training they had received was good but not sufficient, especially because some of the skills taught were new to the women. ADRA had hired a consultant to conduct the crafts training. The training sessions consisted of both theory and practical training. Some also mentioned that the training consisted of too much theory and too little practice. There were also complaints that the practical training sessions were not enough; they had to share items to practice. Some of the associations had members that had not received training because they had not been part of the association from the beginning. The association members, who had received training, taught the new members how to do the different crafts. 5.1.1.3. What type of support has ADRA been giving after completion of the training? All the associations mentioned that they have received equipment and raw material from ADRA. Some of the equipment that was mentioned was; sewing machines, knives, scissors, wooden rulers, cupboards to store the products, tables, pots for paint, iron, raffia, paint. One association mentioned that they have also received manuals about crafts. The manuals help them to learn how to produce the different crafts. They thought the manuals were good, but they were not able to apply all of it, because there are some things they just don’t know. It was also mentioned that some of the members are not able to read and therefore the manuals were not very useful to all. The evaluation team obtained different information when it comes to the quality of the equipment and raw material. One association mentioned that the equipment was of good quality and they are using it well. Several associations mentioned that the scissors were very fragile and would easily break because they are made of plastic. One of the associations reported that some of the machines have already broken down and have not been repaired. They are now using the machines that they have rented. Most of the associations mentioned the poor quality of raffia. Some mentioned that the raffia was too hard and that it could not be used to make hats, while others mentioned that raffia was wet and therefore sometimes rotten. One association reported that of the raffia that they received; only two thirds of it was usable and as a result they used the bad raffia to practice. The associations are managing the equipment that they have received from ADRA. Some of the equipment was distributed individually and some of the equipment belongs to the association. Several of the associations were divided into groups and took turns using the different equipment. Those who need equipment may come to the association
  • 28. 28 and borrow it as needed. One association mentioned that all the equipment is stored at the associations president’s house. When asked what happens when the equipment need repair, one association mentioned that each member pays 500 Ariary each month to the association. That money is separate from the revolving funds (funds from sale of products). This money is used to repair equipment. Per the date of the evaluation, no money had been spent on repairs yet. Each association had a workshop, a place where they can meet and produce their crafts. Some of the associations had contracts with the house owner until the activities have been completed. Some of the associations had improved the rooms by applying mud to the walls for example. According to one association, the workshop is a place where everyone can meet. The associations have a work schedule which varies from association to association. Following are some of the responses from the participants:  “We work Monday, Tuesday, and Wednesday in the afternoons.”  “Before we worked everyday. It was not a good idea because now we are transplanting rice. For the past month we have not worked in the workshop.”  “During the transplanting season, we cannot work in the workshop, during October through November we transplant rice and during March and April we harvest rice.”  “If we have orders we work every day… 8 am through 4 pm or 5 pm.”  “We work everyday, if there are orders we work harder.”  “We work every afternoon from 2 – 4 pm. If we work in the mornings we work from 8 – 11 am.”  “We only work in the afternoon because we have kitchen gardens and a house to take care of.” ADRA has provided study trips for some of the association members. One trip was to Antananarivo to the International Fair and another trip was made to Ambositra. The study trips gave the members an opportunity to observe the type of crafts and quality of crafts that are being sold in other markets. These are some of the observations from the members during their study trips:  They saw good quality products and saw the adequate prices for their products  They saw that the prices in Ambositra are higher compared to Fandriana  They saw that the quality of their products are not as good as the products they saw in Antananarivo  They saw that the “finish” of their crafts were not as good as elsewhere.  They realized they did not sell many products at the Fair because of the quality of their products  They have not been able to reproduce what they saw in Antananarivo due to lack of training. One of the major issues that was mentioned during all focus group discussions was the lack of markets. All groups asked if ADRA could find markets for their products. They were all aware that they needed markets to sell their products and they wanted to sell their products at a higher price. Most of the current markets were in Fandriana. The prices in Fandriana are much lower than the prices at the markets in Ambositra or Antananarivo. For example: in Ambositra they can sell one basket for 8,000 Ariary, while at the market in Fandriana they only receive 2,000 Ariary for it. Since they cannot find other markets they sell their products in Fandriana at a lower price. It was also
  • 29. 29 mentioned that craft collectors came to the different villages and collected crafts that they had made. The profit was not very high. Sometimes they sell to the collectors and sometimes they go to the market. When they went to Antananarivo they searched for markets but the quality of their products is only suitable for the local Fandriana market. They wanted more training so they can improve the quality of their products and hence increase their market options. Some of the associations mentioned the possibilities of finding other markets. For example there were markets in the north and they could visit other towns, but the problem was lack of money for transportation. 5.1.1.4. What are the major successes that you have experienced in production and selling of your crafts? When this question was asked many different issues were mentioned. Many examples were given regarding how the associations had helped the members. These are some of the responses:  “It has helped us a bit. In the past we had to buy raw materials, but after ADRA started the association, we received raw materials for free. That is a great benefit for us. Although we have to return the price of the raw materials to the association, we now have money to buy things like soap.”  “Our knowledge (skills) of crafts has improved, our minds have also changed. Working in a group allows us to learn new things and improve our minds. We are happy and joyful. Our living conditions have changed.”  “It has changed our living conditions; we have more income now after ADRA.”  “It has changed my life a bit. At this period of the year, we usually don’t have rice anymore. Rice is very expensive and I used to borrow money to buy rice. This year I have less debts; that is a change in life.”  “My knowledge has increased, I can do more crafts. Now I can be more creative, change design, create design according to what people want at the market. Can make more elaborate.”  “I’ve improved my skills. Before I could just make basic things. Now I can decorate the bags, which add to the value. Before I sold a basket for 200 Ariary, now with decoration, now maybe 2,000 – 3,000 Ariary for the ones that are well done It also became clear that most of the associations have a revolving fund, when the women sell their products; part of the money has to be returned to the association (the production price is being returned to the association). The funds returned to the association are with the purpose of continuing the work after ADRA leaves; because of the revolving funds the associations will be able to purchase raw materials so the members can produce more crafts. The revolving funds could also be used to help members of the association when needed. For example if someone was sick or just had delivered a baby. All members agree with how the fund is being used. Another success mentioned was the associations themselves. By being members of an association the women have been able to learn new skills (they learn from each other), they are able to share experiences and encourage each other. One of the benefits is that they now have equipment and raw materials provided by ADRA. They don’t have to spend money on purchasing raw material. Another benefit is that two representatives of the association can go to the market and sell the products while the rest of the members continue to work. The associations can also be represented by a few members to attend regional meetings. The members claimed to have better health and improved household income.
  • 30. 30 The women also talked about their income. One association mentioned that the income in October had been good because they had an order of hats. They made 100 hats in four days (from Sunday to Wednesday) and they received 1,000 Ariary per hat. They thought the price should have been 3,000 Ariary per hat if they included all the expenses (price of raffia, time spent, and the food they consumed). It was mentioned that the cost of raw materials for one hat was 2,000 Ariary. One group mentioned that the cost of 1 meter of raffia was 1,000 Ariary and they can make 2 hats with that material, which gives them a profit of 400 Ariary per hat. When the women were asked how long it takes to make a hat there were many different answers. The time frame varied from 1 hour to ½ day, from 2 hats in a day to 10 hats in a day. The associations had been trained in how to calculate the price of the products. When deciding on the price they take the cost of raw material and time spent into consideration. Before the project they did not calculate the price as they do now. They still mentioned that they do not make enough money and if crafts were their only means of livelihood “we would quarrel with our husbands because the benefits are low.” One of the associations reported that the income to date from sale of products was 222,280 Ariary (about $125). 5.1.1.5. What are the major challenges that you are facing in production and selling of your crafts? The number one major challenge mentioned by all associations was access to markets. They were all mentioning lack of markets and their desire to sell their products at a higher price. The Fandriana market offered low prices. They also thought it was hard to identify new markets and wanted ADRA to identify markets for them. Some of the associations realized that the quality of their products was not up to standard; therefore at this point they could not sell their products on markets other than their local markets. They therefore wished that ADRA would provide additional training so they can improve their skills and the quality of their products. Hence, it will be easier to find markets and they can also increase the price of the products. At the time of the mid term review one of the challenges related to the local markets was access. Due to the rainy season and bad road conditions, the women were not able to sell the products outside of their commune. Another challenge was the cash flow of the population. This time of year is the lean season and people are spending money on buying food, not products. If the women take their products to the markets, many times they will not be sold. Some of the members had visited other markets. There was one trip to Antananarivo to the International Fair. Some of the associations sold some products there, but mostly people just looked and asked for their address. In general, after the Fair the associations brought back with them many unsold products, now the products are just sitting in storage. The reason they gave for not being able to sell their products were that there were too many products there and their prices were higher than the others. One reason for the higher price is the time spent on producing the crafts. The skills are new to the women so it takes longer to make a product, for example it takes 3 days to make a basket. One person suggested that they should have sold a lower price instead of bringing the products back with them, and having to sell them a lower price at the local markets. The members who visited the Fair did not think there were many buyers there but they saw many good ideas. One association had visited the market in Majunga (west coast town). Regarding the quality of the products one association thought their products were similar to those of others at the Fair and some thought their products were better.
  • 31. 31 When asked how the women would be able to find markets, after they have increased the quality of the products, the following responses were recorded:  “For example, I have relatives in Tulear, and I can tell them we have products to sell if they are needed there.”  “I have relatives out of the region; they can sell our products”  “When there are guests here, we can send some items with them and they can sell them for us.”  “Talked to hat merchants in Antsirabe and they told us that hats sell better in January when people have money after selling fruits.” Another topic that was mentioned was the work hours. At the time of the mid term review, the women did not spend much time on production of crafts because it was transplanting season for rice. They work on the field during the day and some of the associations tried to work on crafts during the evenings (7-9pm). The problem is that there is no electricity, so making items in the evening takes longer time and the quality is less. Some other associations mentioned that they only work 1 or 2 days at the workshop, because the rest of the time they have to spend on activities in their homes. The production time of products varied from association to association and there were of course individual variations. For example the production time of bags varied from 2 bags to 10 bags per week (for the association). Or individually, from one bag in 3-4 days to 2 bags in a week. The participants also mentioned raw materials. They all agreed that raw materials are expensive. One explanation given was that there are many weavers in the area so the demand for raw material is high, thus the high prices. But the price of the finished product is not so high, so the expenses do not correspond to the income. When it came to the quality of the raw material, several different responses were recorded. Several associations felt that the quality of the raw material was good, while another association though the quality of the raw material varied greatly. One association reported that they almost had a quarrel with ADRA because the raw materials they provided were so bad. In some instances 1.5 kg out of every 5 kg was no good, rocks and sand were found in the raffia. Some were very short and the ends were not good. The quality of the products depends on the quality of the raw materials. The better materials are more expensive. Two members told us than they have now started to plant the raw material. There was also a difference in opinions when it came to equipment. Some associations thought they had enough equipment and raw material while other associations reported that they did not have enough tools and machines. Some of the equipment lacking was sewing machines and irons. Since the associations did not receive an iron from ADRA, one of them has been able to buy one, while another association mentioned that they are now renting sewing machines for 5,000 Ariary per month and the rent is paid from the associations’ fund. The prices are also a challenge. During the training they were taught what the prices should be for the different items. For example, “people buy one decorated basket for 1,500 Ariary, and it should be 3,000 Ariary, while the training taught us we can sell at 7000 Ariary.”
  • 32. 32 5.1.1.6. In your opinion, what aspects of the project have worked well, what has not worked well and how can ADRA improve the aspects that are currently not working well? When asked what aspects of the project had worked well, most of the participants mentioned that they now have increased skills; they are able to make more items and/or make the items of better quality. Some of the skills mentioned were; make hats, bags, and table mats. They thought the training went well, but would like more training. They also thought the distribution of equipment went well. In the past they did have equipment, but it was not sufficient. Now they have access to equipment through the association. When the participants were asked what can be done to improve the project, two main issues were identified; improvements to workshops and trainings. Several associations mentioned that improvement of the workshops was necessary because they need a house for the equipment and a place to work. One association mentioned their workshop is not adequate because not all of the members can fit inside at the same time. Another association mentioned they would like to improve their workshop by painting, making cement floor and inserting a door. The associations also suggested additional training sessions. They want to improve their existing skills and they would like to learn new skills. They suggested that the training should include how to design items. The suggested time frame for the training was from 5 days for each activity to one month. These are some of the responses that were recorded: - “There wasn’t enough training, too much theory and not enough practice.” - “Embroidery was too much talk, little practice” - “We should have practical training straight away, that’s what we expected. We shared table clothes 6 to 1; we should have our own clothes to practice on.” - “The training period should be longer, we need embroidery training and it should be more practical.” - “We need crochet training because we just had ½ day” - “We need more training in how to crochet hats because they sell well. When we go to market people ask if we know how to make those hats.” - “We did not get embroidery training and we need it because we want to improve our lifestyle and we can sell them.” 5.1.1.7. What do you think will happen after the project has ended? After the project ends the participants think they will continue to work together as an association. The associations will be able to function due to the revolving funds that the members have created. When the project ends, the associations will be able to spend that money on purchasing of raw materials for its members. Following are some of the responses from the participants: The continuity depends on the markets unless they have markets where they can sell their products it will be difficult. They would like to search for markets and they would like ADRA to assist. Some of the associations did not know what they could do to find markets. Most of the associations mentioned the lack of transportation money to search for markets as the main constraint. The project has provided the associations with monitoring tool. Most of the associations reported that they are using them but they did not understand fully how to fill them in