SlideShare a Scribd company logo
1 of 47
Retrospective evaluation report
of the Project "Community
Mobilization, Infrastructures,
Hygiene and Health in the
Shantytowns of Toliary -
Madagascar"
Period: 21 March - 18 April 2014
Date of presentation :14 April 2014
Date of deposition : 18 April 2014
Places:Toliary and Antananarivo
Name of the Appraiser:Rakoto Yvon Namelankafatra
Recipient of Evaluation: Habitat For Humanity Madagascar
2014
Cabinet TEFIGASY
18/04/2014
[2]
List of the abbreviations and acronyms
DAO : Offer Appeal File (Dossier d’Appel d’Offre)
FKT : Fokontany
HFH : Habitat For Humanity
KOICA : Korean International Cooperation Agency
OMD : Objectives Millennium of Development
NGO : Non governemental Organization
TOR : Terms Of reference
List tables
Tableau 1 Situation of the house construction.........................................................................15
Tableau 2 Realization on the cover of the lanes in Paving stones..........................................17
Tableau 3 Realization in Water Points construction and renovation.......................................18
Tableau 4 Internal factors affecting the results of the project..................................................21
Tableau 5 External factors affecting the results of the project.................................................21
Tableau 6 The result of project................................................................................................24
List graphs
Figure 1 Flipchart showing the progression of work of the house...........................................14
Figure 2Situation of the houses construction...........................................................................15
Figure 3 "Trano vondro", manufacturated out vegetable matter, it is property of Mr.
Rafaralahy there .......................................................................................................................16
Figure 4 A Mason who charged to rebuilt an house destroyed by Cyclone "Haruna" ............16
Figure 5 It's here that Mr. Rafaralahy will settle in the next months........................................16
Figure 6 This house is rebuilt with precaution and attention after its collapse at the passage
of the Cyclone Haruna..............................................................................................................16
Figure 7 An house HFH/KOICA in the course completion in Ankilahila ..................................17
Figure 8 An house HFH/KOIKA which has been just finished in Ankilahila ............................17
Figure 9 Realization of the cover of the lanes in Paving stones..............................................17
Figure 10 Water Point renovated in Tsimenatse IWest..........................................................18
Figure 11 New construction of Water point in Tanambao Motombe .......................................18
Figure 12 Water point renavated in Mahavatse I East.............................................................18
Figure 13 New construction of Water point in High Ankiambe................................................18
Figure 14 An inhabitant of Tsianengea Shantytown raises the question which the
Maintenance of infrastructures for them means. Photograph: HFH Antananarivo .................20
Figure 15 Trainers explain to the participants the importance of the Maintenance of the
infrastructures and Hygiene. Photograph:: HFH Antananarivo ...............................................20
[3]
Contents
List of the abbreviations and acronyms .....................................................................................2
List tables....................................................................................................................................2
List graphs ..................................................................................................................................2
Contents .....................................................................................................................................3
Executive Summary....................................................................................................................6
I. Summary .........................................................................................................................6
II. Purpose of the Evaluation...............................................................................................6
III. The public of the evaluation.........................................................................................6
IV. Uses in the future.........................................................................................................7
I. Results of the evaluation.................................................................................................7
Methodology and Sampling........................................................................................................8
I. Sampling on ground........................................................................................................8
II. Methodology....................................................................................................................8
1. Analysis of the various project documents..................................................................8
2. Formal surveys and guidelines....................................................................................8
3. Free and informal interviews .......................................................................................9
4. Focus group.................................................................................................................9
5. Observation..................................................................................................................9
6. Refining and the stepping of the meditative information.............................................9
7. Limits of the external evaluation..................................................................................9
Methodology and sampling ......................................................................................................10
III. Sampling on ground...................................................................................................10
IV. Methodology..............................................................................................................10
8. Analysis of the various documents project................................................................10
9. Formal surveys and guidelines..................................................................................10
10. The free and not formal interviews.........................................................................11
11. The focus group .....................................................................................................11
12. The Observation.....................................................................................................11
13. The refining and the stepping of the meditative information .................................11
14. Limits of the external evaluation ............................................................................11
Assessment of execution.........................................................................................................12
I. How was the project it prepared?..................................................................................12
II. Organization and Human resources .............................................................................12
[4]
III. The realization of the project.....................................................................................15
i. Construction and or rehabilitation of 89 Houses.......................................................15
ii. Construction of the lanes in Paving stones...............................................................17
iii. Construction and rehabilitation of the Water Points..................................................18
iv. Training in Maintenance of infrastructures and Hygiene.......................................20
v. Distribution of the Mosquito nets...............................................................................20
IV. Factors affecting the project results ..........................................................................21
i. Internal factors affecting the project..........................................................................21
ii. External factors affecting the project.........................................................................21
iii. The relevance of the project......................................................................................22
iv. The efficiency of the project...................................................................................22
v. Impacts of the project................................................................................................23
vi. The efficiency of the project.......................................................................................23
vii. The durability of the project....................................................................................23
viii. Marketing images of HFH and the Donors ............................................................23
Conclusion................................................................................................................................24
Main recommendations............................................................................................................25
The lessons to be learned........................................................................................................26
Best practice to be duplicated in the future..............................................................................26
Appendix 1 Matrix of evaluation ...........................................................................................27
Appendix 2 Sampling............................................................................................................28
Appendix 3 Methodology......................................................................................................29
Definition of the evaluation criteria....................................................................................29
Design of a matrix of evaluation........................................................................................29
Methods of data acquisition..............................................................................................29
Monitoring and Evaluation (M&E).....................................................................................29
Existing Reports/ documents............................................................................................29
Interviews ..........................................................................................................................30
Observations on the ground..............................................................................................30
Case studies......................................................................................................................30
Questions about the quality of the data ............................................................................30
Improvement of the quality of sampling............................................................................30
To guarantee the consistency of the gathering of the data ..............................................30
Checking of the precise details: use of several data sources ..........................................31
Analysis, interpretation and synthesis of the data............................................................31
Appendix – 4 Questionnaire – 1 Technical Staff HFH Antananarivo.....................................32
[5]
Appendix 5 – Card-indexes Balance-sheet of execution ..................................................35
Appendix 6 - Balance-sheet of execution – A - FKT Tsianengea.......................................36
Appendix 7 - Balance-sheet of execution – B- FKT Tsimenatse........................................37
Appendix 8 - Balance-sheet of execution – A - FKT Mahavatse........................................38
Appendix 9 Questionnaire – Impact – Beneficiaries- Focus Group (Group of 8 A 12 People)
..............................................................................................................................................39
Appendix 10 - Questionnaire HFH Toliary ...........................................................................41
Appendix 11 Questionnaire municipal Authority of Toliary I (Mayor or PDS and DSAS)....44
Appendix 12 Lists interviewed people..................................................................................45
Appendix 13 – visited Sites ...................................................................................................46
Appendix 14 - Quoted work..................................................................................................46
Appendix 16 - DECLARATION OF THE RESPECT OF THE ETHICS ...............................46
[6]
Executive Summary
I. Summary
The present document handles the final external evaluation of the project "Community
Mobilization, Infrastructure, Hygiene and Health in the slums of Toliara." Part 3.
The plan was to carry out this project for the year between January 2013 and December
2013, but for several reasons which we will further develop, its launch was delayed by 8
months and it is on track to be complete by the end of April 2014.
The main content of the project is as follows:
- Construction and / or rehabilitation of 89 houses ;
- Distribution of 267 mosquito nets;
- Construction and / or rehabilitation of 12 Water Points ;
- Rehabilitation of streets in Pavers with a total length of 2000 meters.
Besides, other actions were planned such as the training of beneficiaries in Maintenance and
hygiene.
The NGO Habitat For Humanity is the Agency of Execution – This project is financed by
KOICA as high as 248 095 293 Korean
The evaluation mission is headed by Yvon Rakoto Namelankafatra with the assistance of two
Consultants - Investigators: Ramaharoarivo Tahinjanahary Hariliva and Tsangandahy Aina.
II. Purpose of the Evaluation
According to the TOR, the objective of the evaluation is of:
- to appreciate in a way independent the results of the project, while sticking more to
the impact of the actions carried out compared to the had aims;
- To learn the principal lessons from the intervention and to make practical
recommendations.
III. The public of the evaluation
The public of the evaluation is constituted by HFHM, KOICA, the Urban district of Toliary, the
Presidents of Fokontany where the actions were rationally chosen there, the resident families
in the sites of the project, the direct beneficiaries, the inhabitants of the urban city of Toliary,
NGO and Associations which have work which have work in development of the human
value.
[7]
IV. Uses in the future
The results, assets identified, weaknesses, lessons learned, and the various impacts should
be used for ideas and as benchmarks in similar projects.
I. Results of the evaluation
At the time of completion of the evaluation, the result is:
The project "Community Mobilization, Infrastructures, Hygiene and Health in the slums of
Toliary " reached the majority of its objectives with some difficulties.
Of the 89 houses to be built or rehabilitated:
- 86 are actually finished and occupied in 22 Fokontany;
- 2 are in the course of being finished;
- 1 to completely reconstruct in Anketa Bas.
The completion rate for the houses is therefore 95.50 %.
- Concerning the 2000m of alleys to be paved:
- 89.74%, or almost 1794,9 m, are finished and practicable
Concerning the12 Water Points:
- 6 old public Water Points were renovated and continued to supply of drinking water (in
Fokontany: Ambalanombikamoa, Mahavatse I West, Tsimenatse I West, Tsimenatse I
East and Mahavatse II West)
- 6 new public fountains were built but are unoperational because they are not
connected to JIRAMA sources (Fokontany: Tanambao Motombe, Ankiambe Haute,
Mahavatse I East, Mahavatse I West, Ambalanombikamoa, Mahavatse Tanambao).
Regarding health, namely prevention of and the fight against Malaria, 267 mosquito nets
were distributed to all the beneficiaries of houses (3 mosquito nets per beneficiary).
Finally, the project beneficiaries from Tsianengea and Tsimenatse Fokontany have benefited
from training on the Maintenance and hygiene
[8]
Methodology and Sampling
I. Sampling on ground
Population (Ideal Universe): human resource employed by Habitat For Humanity NGO
(Antananarivo and Toliary), leaders and technicians for the companies involved in the project
(Head of company, Heads of building site and Masons), the beneficiaries of the project,
Authorities of the Urban District of Toliara I, and the decentralized Communities (Mayor of
the CUT, Presidents of the FKT).
Subpopulation (operational Universe)
N° Subpopulations Criteria of selection Variable Size
1
Technical persons in
charge for the ONG
HabitatFor Humanity
Having a directresponsibilitywith the
execution for the projectwith Toliara
and a knowledge ofthe history of the
project
Place of employment
Antananarivo
Toliary
2
07
2 Enterprise manager Contribution on execution of the
project
geographical locality
01
3 Final recipients ofthe
project
recipients associations members geographical locality 14
4 Indirect recipients
To reside in neighbouring FKTwhile
profiting the advantages rising from
the built infrastructures
Function and
responsibility:In the
Commune In the FKT
08
5 Communal and FKT
Authorities
To be decision makers in the
Commune or in the FKT
Function and
responsibility: In the
Commune orIn the FKT
01
Commune
03 FKT
6 Workmen Effective participation in work of the
project
-Function and
responsibility
-professional
Classification
06
II. Methodology
As announced in our technical offer, the methodology adopted contains several techniques of
investigation.
1. Analysisofthe various projectdocuments
These documents are provided by HFH: They include the initial project document, the
previous evaluation reports, the organizational structure of the Executive, the Schedule, and
the databases for tracking.
2. Formal surveysandguidelines
Questionnaires were prepared for the purpose of obtaining precise technical information
required by the evaluation. (See questionnaire in Appendix).
[9]
3. Free andinformal interviews
They allowed us to obtain useful information, while their importance was unforeseen during
the elaboration of the methodology – Interviews of this type were recorded to get faithful
transcriptions of the narratives given and declarations made by the interviewees, often in
local dialects.
4. Focusgroup
They are organized to obtain several joint and divergent answers for some questions - The
focus group were used to collect the information with the direct or indirect beneficiaries and
HFH Staff of Toliary.
5. Observation
The technical observation enabled us to see, in person, the state of the sites. Photographs
were taken in order to analyze them. The observation is necessary because it will enable us
to confirm, cancel, or to correct certain assertions or accounts of the interviewed people. It’s
the most effective instrument to describe the results accurately.
6. Refiningandthe steppingofthe meditativeinformation
Information proven to be unfounded will not be taken into account and more rhetorical
accounts will be compared with other sources.
Thus, analyses and interpretation will be based on reliable data.
7. Limits ofthe external evaluation
The limits of the external evaluation are imposed by available time and the geographical
distance of the sites involved. Also, interviewees who withhold information will limit the scope
of the evaluation.
[10]
Methodology and sampling
III. Sampling on ground
Population (ideal Universe):human resource employed by Habitat For Humanity NGO
(Antananarivo and Toliary), leaders and Responsible technical for the companies having
carried out the implementation for the project (Head of company, Heads of building site and
Masons), the recipients of the project, Authorities of the Urban District of Toliara I and the
decentralized Communities (Mayor of the CUT, Presidents of the FKT).
Subpopulation (operational Universe)
N° Subpopulations Criteria of selection Variable Size
1
Technical persons in
charge for the ONG
HabitatFor Humanity
Having a directresponsibilitywith the
execution for the projectwith Toliara
and a knowledge ofthe history of the
project
Place of employment
Antananarivo
Toliary
2
07
2 Enterprises manager Contribution on execution of the
project
geographical locality
01
3 Final recipients ofthe
project
recipients associations members geographical locality 14
4 Indirect recipients
To be residentneighbouring FKT
while profiting the advantages rising
from the built infrastructures
Function and
responsibility:In the
Commune In the FKT
08
5 Communal and FKT
Authorities
To be maker decision in the
Commune or in the FKT
Function and
responsibility: In the
Commune orIn the FKT
01
Commune
03 FKT
6 Workmen Effective participation in work of the
project
-Function and
responsibility
-professional
Classification
06
IV. Methodology
As announced in our technical offer, the methodology adopted contains several methods and
techniques of investigation.
8. Analysisofthe various documentsproject
These documents are provided by HFH: It’s the initial project document, the previous
evaluation reports, the organizational structure of the Executive, the Schedule, the databases
for tracking.
9. Formal surveysandguidelines
Questionnaires pre-established were used to obtain the technical information requiring
precision in the evaluation. (Cf. Questionnaire in Appendix).
[11]
10. Thefree andnot formal interviews
They allowed us to obtain useful information, while their importance was unforeseen during
the elaboration of the methodology - This type of interview (Maintenance) was always
followed by sound recordings, to transcribe faithfully narratives and declarations of people
interviewed, often expressed in dialects local.
11. Thefocusgroup
They are organized to obtain several joint and divergent answers for some questions - The
focus group were used to collect the information with the direct or indirect beneficiaries and
HFH Staff of Toliary.
12. TheObservation
The observation technical enabled us to see in visu the inventory of fixtures. Photographs
were taken in order to analyze them. The observation is necessary, it will enable us to
confirm, cancel or to correct certain assertions or accounts of the interviewed people. It’s the
most effective instrument to describe the inventories of fixtures accurately.
13. Therefiningandthe steppingofthe meditative information
Proven information as non founded will not be taken into account and those which are the
subject of a rhetoric, will be compared with other sources.
Thus, it’s at the base of the reliable data that the analyses and interpretations of the facts
are based.
14. Limits ofthe external evaluation
The limits of the external evaluation are in the time required to make it count held by the
geographical distance where are the Sites of the Project - The possibility of withholding of
information on behalf of certain interviewed people.
[12]
Assessment ofexecution
The project "Community Mobilization, Infrastructures, Hygiene and Health in the Slums of
Toliary " - HFH-KOICA, was launched in a particularly difficult context: political and
economic crisis, passage of the Haruna Cyclone in Toliara of an intensity not seen for 35
years, and internal management problems of HFHM. The project required HFHM to
restructure itself by improving the connection between HFH Toliary and HFH Antananarivo,
while scrupulously sticking to procedures.
I. How was the project it prepared?
Being already in the third phase of the project, experiments and improvements of the
preceding phases were taken into account.
The City of Toliary is rationally chosen, just like Fokontany selected (Tsianengea,
Mahavatse, and Tsimenatse). It’s the biggest Province of Madagascar, but also the worst if
we consider all the indicators of development (health, education, housing).
The project continues to focus its efforts on the pressing needs of the City and the
Fokontany. These needs are for infrastructure essential to the inhabitants: houses, roads
and alleys, drinking water, and measures against malaria.
The actual start of the project was preceded by organizational restructuring, in particular by
the removal of certain functions and the creation of media outlet.
Adequate preparations were made for the project.
II. Organization and Human resources
1. Organizational structure
The project adopts an functional organization (structure) of pyramidal form. There are
between 10 and 13 levels. Each of these member is subordinate to one directly above with a
slightly broader function, but a related goal. The project serves several Cities and Regions at
the same time: Toliary, Fianarantsoa, Antsirabe, Tamatave, Fianarantsoa, Moramanga.
The advantages of the organization come from its simplicity, executive efficiency, and
stability. It is particularly suited to small companies or companies of average size.
The weakness of the functional structure is that it is heavy and slow, especially when applied
to big projects to be realized in various localities, such as is the case of HFHM at present.
The matrix structure or the organization by geographical territory seem more adapted to the
actions of HFHM.
[13]
2. Humanresources
HFHM employs highly qualified technicians, recruited on the basis of scientific criteria. It is a
compact, plain, and interdependent team that carries out a professional life in harmony;
generally, it is composed of Christians.
Devoted to work in Toliary each week begins with a prayer meeting and a briefing.
Devotion and enthusiasm decrease in the consultants when the end of their contract
approaches.
However, the number of employees of HFHM are insufficient – It is the weak point of the
project. In Toliary, and certainly in other Cities, the demand for Houses averages requests
per week. But the staff of HFHM is decreasing – construction specialists are unable to make
their periodic follow-ups on site. Also, other employees are required to help peers complete
their tasks, even if they really have no competence in the domain. The effect is not always
positive.
The insufficiency of the staff is partially responsible for the slowness and for the low quality of
certain parts of the project.
3. Theplanning
The HFHM plans the actions to be made during the period when the project is executed, by
means of a Chronogram (Graph of Henry GANTT or linear graphic representation). This
technical kind of sequencing of the works would not raise of the problem then that it is about
works of which we know in advance its dimension as alleys in Pavements or others
infrastructures same Water Point. But when it is about the Construction of the House the
applicants of which come according to the effects of the very effective Mass communications
to Toliary (By Radio, Seminars), we don’t know, in advance how many Houses go we to
build, which type and Where? How much mason are we going to mobilize? And who will be
in charge (be loaded) of the control of the construction of each of these Houses? In this
genre of very complicated problem, especially when the staff(size) of the technical Staff is
not enough, the use of a Software of planning and the Monitoring and Evaluation of project is
imperative.
[14]
4. TheMonitoringandEvaluationSystem(ME)
The ME System shows itself under two (2) forms: the periodic sending of a report(of
Monitoring, following the progressof the works on Construction sites and the descents on
ground. In Toliary, the Specialist under construction manages a data base of all the Work in
progress by types; he updates this data base following the progress on ground.
To avoid the risks of forgetting the responsible in ME shows on Flipchart posted in the wall
the progress the realizations of Houses by Beneficiaries. (See photo below)
Photographs are taken and preserved in the base of the data. These photographs show the
state of Work progress.
In Antananarivo the post of Monitoring and Evaluation is not occupied yet and remains
vacant.
Strengthenings of capacity regarding Monitoring and Evaluation assisted on Computer,
would be advantageous for the project.
Figure 1 Flipchart showing the progression of work of the house
[15]
III. The realization of the project
The Assessment of the execution after the organisational reorganization and management
can be recapitulated as follows :
i. Constructionandorrehabilitationof89 Houses
The houses are built in several scattered FKT: Amborogony, Tsimenatse, Ankatsaka,
Tseanengea, Anketraka, Tanambao Motombe, Ampasiko, Befanamy (Ankilahila), Betania,
Mitsinjo, Antaravoy, Mangambe, Andakoro, Anketa, Andaboly, Tsianaloka, Mahavatse,
Besakoa, Camp Caser, Ampasikibo (Ambaiboho), Ambohitsabo and Toliara Center.
Situation Numbers envisaged Numbers real Difference % percentage
Built and/or rehabilitated houses 89 85 4 95,50
Houses in phase of completion 0 3 3,27
Unfinished house 1 1,12
Tableau 1 Situation of the house construction
Figure 2Situation of the houses construction
1 House with Ambalanombikamoa Tsimenatsa II is almost completed, it remains with its
recipient to make the tilings. 2 other Houses being in the FKT Ankilahila and in Andaboly are
also in phase of completion – It remains with their owners to make the pavements and
paintings.
1 another house in Anketa - Bas, is to be rebuilt after its collapse at the time of the passage
of the Haruna Cyclone in February 2013;
Generally, all those which saw their house finished are content and satisfied. It is family
project or a dream which has been just carried out. Satisfactions depend on several
0
20
40
60
80
100
Situation of house construction/rehabilitation
Numbers envisaged
Real number
[16]
parameters: when the house is well and by a good mason, within the time envisaged – the
recipients are also satisfied when they directed them even the operations of constructions
with materials which are appropriate them. The recipients who have financial means are
included in this category.
Among these people, let us quote the case of Raharivelo Clin, For a long time, He had a
dream to build a House behind its place of work in Ampasikibo. He exerts an independent
trade. For a long time, He bought Building materials gradually. One day, He attended a
campaign of HFH and introduced its file; HFH decides to finance Construction partly.
Construction lasted only 20 days, it’s time record.
There is part of the recipients who are not satisfied of the quality of the work of the Masons, a
few months only after the completion of the house, of the cracks appear on the walls.
Figure 3 "Trano vondro", manufacturated out vegetable
matter, it is property of Mr. Rafaralahy there
Figure 4 A Mason who charged to rebuilt an house
destroyed by Cyclone "Haruna"
Figure 5 It's here that Mr. Rafaralahy will settle in the
next months
Figure 6 This house is rebuilt with precaution and
attention after its collapse at the passage of the
Cyclone Haruna
[17]
Figure 7 An house HFH/KOICAin the course completion
in Ankilahila
Figure 8 An house HFH/KOIKAwhich has been just
finished in Ankilahila
ii. Constructionofthelanesin Pavingstones
Fokontany Envisaged Realized Rate of
realization in%
Tsimenatse II Ambalanombikamoa 259 237,7 91,78
Ambalanombikamoa 156 156 100,00
Tsimenatsa I East 446 346 84.30
Ankatsaka 714,4 714,4 100,00
Tsimenatsa I West 82 67,6 82,44
Mahavatse 342 273,23 78,89
Total 1999,4 1794,93 89,77
Tableau 2 Realization on the cover of the lanes in Paving stones
Figure 9 Realization of the cover of the lanes in Paving stones
0 500 1000 1500 2000
Tsimenatse II Ambalanombikamoa
Ambalanombikamoa
Tsimenatsa I East
Ankatsaka
Tsimenatsa I West
Mahavatse
Total
Construction of the lanes in paving stones in
meter
Realized
Envisaged
[18]
iii. Constructionandrehabilitationofthe Water Points
FKT New Water Points Water Points renovated
Mahavatse Tanambao 1 0
Ambalanombikamoa 1 1
Mahavatse I West 1 1
Mahavatse I East 1 0
Tsimenatse I West 0 2
Tsimenatse I East 0 1
High Ankiambe 1 0
Tanambao Motombe 1 0
Mahavatse II West 0 1
Total 6 6
Tableau 3 Realization in Water Points construction and renovation
Figure 10 WaterPoint renovated in Tsimenatse I West
Figure 11 New construction of Water point in
Tanambao Motombe
Figure 12 Waterpoint renavated in Mahavatse IEast
Figure 13 New construction of Water point in High
Ankiambe
[19]
Figure 7 Realization in Water Points construction
The drinking water supply is a crucial problem of the slum dwellers of Toliary.The project
plans to build 6 Borders of new public fountains and to rehabilitate (discharge) 6 others
already operational, that is a total of twelve (1). For lack of connecting with the sources) of
JIRAMA, three (3) news Water Points are not able of serving the users. The heart of the
problem of the inhabitants are not solved yet.
0 1 2 3 4 5 6
Mahavatse Tanambao
Ambalanombikamoa
Mahavatse I West
Mahavatse I East
Tsimenatse I West
Tsimenatse I East
High Ankiambe
Tanambao Motombe
Mahavatse II West
Total
Construction and rehabilitation of the Water
Points
Water Points renovated
New Water Points
[20]
iv. TraininginMaintenanceofinfrastructuresandHygiene
It is the corollary of the previous actions, in particular the construction of Houses, Water
Points and alleys in pavements. The theme of training concerns the Maintenance of
infrastructures and Hygiene - The training took place 04 Mars in Toliary - the beneficiaries
association members of Tsianengea and Tsimenatse participated in this training
Figure 14 An inhabitant of Tsianengea Shantytown
raises the question which the Maintenance of
infrastructures for them means. Photograph: HFH
Antananarivo
Figure 15 Trainers explain to the participants the
importance of the Maintenance of the infrastructures
and Hygiene.Photograph:: HFH Antananarivo
v. DistributionoftheMosquito nets
It is the shutter health of the project, its characteristic resides on the free distribution of the
Mosquito nets at the recipients of the Houses. It is a contribution to the fight and prevention
against Malaria. Each recipient has right of 3 Mosquito nets. 267 Mosquito nets were
distributed.
[21]
IV. Factors affecting the project results
Several factors can affect the results of a project.
They can be inherent to this one, in this case: we call it internal factors, if they are outer of the
project, we call them external factors. These factors can act differently on the results,
sometimes positive, sometimes negative.
i. Internal factorsaffectingthe project
Internal factors affecting the project positively Internal factors affecting the project negatively
The reorganization brought to the organization in
October 2013
Insufficient manpower
The devotion of the employees to work Insufficient materials and equipment
The competence of the Technical Staff
Insufficient of work permanent control
The technical skill of some Masons
The cohesion of the group Insufficient implication of the partners: the Urban
District and the JIRAMA Company
Free distribution of various tools, equipment and
materials to the Masons, Bible…
Insufficiency of the degree of appropriation of the
works carried out at the recipients
The relationship between the Recipient and Mason
HFH. This last often refuses the order and council of
the future owner.
A Mason assumes at the same time 2 to 3 Houses:
the consequence is reflected on output quality
Tableau 4 Internal factors affecting the results of the project
ii. External factorsaffectingtheproject
External factors affecting the project
positively
External factors affecting the project negatively
The support brought by certain Presidents FKT to
persuade the inhabitants to collaborate with the
project
The political and economic crisis
The Haruna Cyclone and its effects
The behavior and dealing of the inhabitants who live
in the sites which are not integrated in the project
Tableau 5 External factors affecting the results of the project
[22]
iii. Therelevanceofthe project
The project is relevant: it is an initiative which answers OMD. So, it is an answer to the social
needs for the Toliary City: needs regarding housing, Hygiene and regarding Health.
93.7 %1
of Houses to Toliary are made either wooden, or in sheet steels, vegetable materials
which they call "Trano Vondro" - to welcome approximately 6 people (the domestic size to
Toliary is 5,3).
Besides, regarding main source of water to drink 59.1 % of Toliary people use the river and
37.5 % make recourses to wells without pump not covered.
iv. Theefficiencyofthe project
The efficiency of the project varies according to shutters:
The constructions of alleys in Pavements and the distribution of Mosquito nets to the
beneficiaries of Houses, showed the efficiency of the project.
Before project, according to the testimony of an inhabitant, the residents of the district have to
bring with them a bottle filled with water to wash their shoes or sandals at the exit. of the
alleys which were dirty and muddy. The situation is other at present. The Malaria is the
second disease which causes most death in Madagascar. Until the contrary proof, mosquito
nets stay the most effective way of prevention is the least expensive.
On the other hand, until 6 Water Points recently constructed are connected with the sources
of the JIRAMA, the shutter: Water Points construction and rehabilitation is not effective. The
situation Before and After project, regarding water supply in Fokontany Beneficiaries stays
the same.
The Water points old rehabilitated remain insufficient in number and the problem in supply of
drinking water persists: the inhabitants deposits their cans to reserve a place at 4:30 am of
the Morning, the distance separating their places to residence of Water Point vary between
300 in 600 meters; It’s open at 5:30 am or at 6 am in the morning; the flow is very low in
Toliara, from Noon till 2 pm, there is a systematic cut of water supply at the present time
there.
The construction of Houses is partially effective: a House it hard is reassuring, not vulnerable
on fires or on any risks of the disasters as Cyclones or floods. The beneficiaries are reported
the change of their social status. Several people put down their files and ask every day the
HFH Toliary, following in the daytime by the raising sensitizations.
However, the absence of uniformity in the forms and the quality of built Houses following the
coat of category socio - professional where belonged their owners; the problems bound to the
technical skill of Masons used, the quality of Building materials delivered by the Suppliers,
1 Source : INSTAT/DSM/EPM 2004
[23]
hinder the construction of Houses such as they were initially designed, return the often
ineffective project.
v. Impacts ofthe project
From the social, cultural and public health views, We can admit that the project has positive
impacts.
The economic impact is not still measurable, because the project has just been finished; so,
the beneficiaries are still for the period of repayment in an economic in state of recession. It's
the same for the environmental impact of the project, it is necessary that one time ago or
events to appreciate the positive or negative impacts of the works built on the environment.
vi. Theefficiencyofthe project
Référerant on the size of the Staff allocated directly to the project, Staff of HFH Toliary and
Antananarivo confused (18 individuals) using equipments and often insufficient materials-
allowing them however to execute difficult tasks and complex works, with a satisfactory result
of execution, we can admit that the project is efficient.
vii. Thedurabilityofthe project
The durability of the project in the future is certain, taking into account the nature of outputs:
houses hard, alleys in Pavements the life expectancy of which can pass beyond two (2)
centuries, Shelters of Water Point built in bricks covered cement.
Nevertheless, the effectiveness of this durability will depend widely in the application of a
culture of Infrastructures Maintenance of the beneficiaries and the users of the public works.
The durability of the experiences of the project will also depend on contribution of the Urban
district and Communities decentralized in Maintenance of the public Works.
viii. MarketingimagesofHFHand the Donors
The HFHM is known in Toliary as Christians NGO - The population of Toliary knows it has
through campaign diffused by the local radio and of the seminaries. It is in the environment of
construction of House that it’s more known.
The Donor of fund, KOICA, is better known at the beneficiary's than in the Population.
The informations on this organization are diffused by HFH Toliary during the meeting of
sensitivity.
So, on the main facade of the constructed Houses are written on a plate their company
names and initials.
[24]
Conclusion
In conclusion, the project "Community Mobilization, Infrastructures, Hygiene and Health "
reached the majority of the objectives with some difficulties.
The other actions planned all was produced as distribution of the Mosquito nets, for the
recipients of the Houses; distribution of materials, small tools, equipment, clothing, helmets of
protection and Bibles for the masons,
- 95.50% of Houses to be built are realized, that is 85/89 ;
- 89,77 % of alleys to be covered with Pavements are made, that is 1824,93 meters on
1999,4 meters;
- 100 % of shelters of Water Points are rehabilitated and/or built among which 50 % of them
are capable serving the users.
- 267 Mosquito nets are distributed to all the beneficiaries of Houses, completely built or in
the course of finish.
The beneficiaries of the infrastructures of Tsianengea and Tsimenatse FKT received training
on the Maintenance of infrastructures and Hygiene.
The reasons by which the objectives didn’t reach are often ascribable to the partners of HFH,
like JIRAMA Company and the Urban District of Toliary.
The other causes come from the slowness of the procedure, the insufficiency of Human
resources and the maladjustment of the organization to dimension and the compexity of the
project.
Also, the refusal of certain inhabitants to move their clotures delay the beginnings of work
N° The result of project
01 The project achieved all its goals
02 The project reached the majority of its objectives without difficulties
03 The project reached the majority of its objectives with some difficulties 
04 The project did not reach the majority of its objectives, but has some positive effects
05 The project did not reach the majority of its objectives and does not have any positive effect
06 The project did not reach any of its objectives, but has some positive effects
07 The project did not reach any of its objectives and does not have any positive effect
Tableau 6 The result of project
[25]
Main recommendations
- Strengthen collaborations with the local authorities and companies), NGO by the
formal agreements (written documents signed by the partners) planning their
respective roles and responsibilities, following their fields of expertise, if the project
requires it.
- Work more in the relative actions in Drinking water supply
- To intensify and reinforce covering.
- Try to introduce into the strategies HFH the Marketing of service (The speed and the
quality of the services
- Adopt an organization answering better the geographical dimension and the extent of
the project, by adopting either the matrix structure, or the organization by
geographical territory.
- Increase the number of the technical staff, to be better adapted to the exponential
increase of their tasks and responsibilities.
- Endow the project team of the sufficient material equipments and necessary for their
daily tasks: rolling stocks, materials (equipments) of reproduction of documents,
computing software…
- Systematize the strengthening of capacity or the development of skill of the
employees of HFH (Training) following the technological evolution and the needs for
HFHM.
- Include in appendix to DAO the characteristics and technical specificities of the Work
to be built with which will be signed their technical obligations and responsibilities.
- As soon as possible, establish and apply rational and scientific criteria to the choice of
the quality of building materials to be used (quality of raw materials, composition,
hardness, degree of drying of wood.).
- Establish and outsource a system of PERMANENT CONTROL to any companies or
Masons who execute works within the framework of the project HFH.
- Try to recruit Landscape painters and Architects among the technical Staff of the
project.
- Verify and check systematically the quality and the reliability of building materials
coming from Suppliers;
- Involve the beneficiaries in any purchase of building materials susceptible to engage
their financial responsibility.
- Relieve any procedures or mechanism susceptible to engender slowness or delays in
the execution of a project, without compromising the good management.
[26]
The lessonsto be learned
- Before any launch, estimate the political and social viability of the project.
- Give more responsibilities to the other actors or the partners of the project (Urban
district of Toliary, JIRAMA…);
- An unsolved problem in time, as the delay of an activity for example, can entail a
chain of delays susceptible to succeed up to the not achievement of one or several
objectives
- The Organization and the resources (human, material and technological) remain key
factors of success).
Best practiceto be duplicated in the future
- The free distribution of tools, small materials and equipments, Bible and clothing-work
for the Masons;
- Development of the cohesion of spirit of the team by the session of the prayer, the
working briefing every beginning of the week, the sense of mutual aid and the
Sharing…
[27]
Appendix 1 Matrix of evaluation
Criteria of
evaluation
Question-keys specific Under-
questions
Méthodes/Outils
of data-gathering
Indicateurs/Normes
of success
Methods to
analyze the data
The attack of
the objectives
Which are forced
havingmarked
out its
implementation,
the learned
lessons and the
good practices?
Which are the
effects and
impacts awaited
and not awaited
in relationto the
use of the
resources which
were allocatedto
him?
Are the products
of the results
stated in the
document of
project –they
reached?
Collections of
informationon
the realizationof
the project
(Reports/ratios
periodic); semi-
directing
interviews ofall
the persons in
charge for the
project;
Technique of
observation
Nbr carried out /
Nbr Envisaged X100
A number of
mosquito nets
distributed
Numbers exempted
Participants of
training in
Maintenance and
hygiene
Regrouping of
informationin
data base,
refining of
informationand
interpretationof
the significance
of these data
bases
Effectiveness
How the
objectives and/or
the results they
are reached
Relevance
Le projet répond-
il aubesoin
régional ?
The project
meets it the
local context, or
needs regional?
Reference:
Milleniumof
Development,
PCD of ToliaryI,
Statistical
reports/ratios of the
Regional
Management ofthe
Statistics of Toliary
(dwellings, Water,
Health...
Efficiency
Le projet est il
efficient
Is the use of the
resources
(human,
material and
financial) it
efficient?
Analyze volume of
the activities
carriedout and
the level of the
use of funds
Comparison
betweenthe rate of
realizationandthe
rate of withdrawal
Impacts
Quels sont les
impacts du
projet ?
Which is its
impact on the
recipients from
the point ofview
social,
economic, public
health, cultural
Investigations into
ground near the
persons incharge
respectifs/Collecte
for the official
data
Nbr réalisé/Nbr
Envisaged X100 - a
Number of
mosquitonets
distributed - a
Number of the
exempted
Participants of
training in
Maintenance and
hygiene
[28]
Appendix 2 Sampling
Population (ideal Universe) Staff technical employed by Habitat For Humanity
Madagascar, technical leaders and Responsible for the companies having carried out the
implementation of the project, the recipients of the project, the Urban District Authorities of
Toliara I.
Subpopulation (operational Universe)
N° Subpopulations Criteria of selection Variable Size
1
Staff technical employed by
HFHM
Having a direct
responsibility with the
execution for the
project with Toliara
Knowledge of the
project history
Place of
employment 4 people
2 Managers of undertaking Execution of the project Role and function
within the company
To determine
3 Final recipients ofthe project
Member of associations
of the recipients - resident
in the 3 Fokontany
-to be chosen since the
launching ofthe project
- Sexes -
Ages - Profession 36 (12 By
Fokontany)
4 Indirect recipients
To be residentof
Fokontany neighbouring
while profiting the
advantages rising from
the built infrastructures
To determine
5 Communal authorities
To be maker decision -
Having a responsibilityin
the social affairs and the
implementation for the
Communal Plan for
Development -
Function and
responsibilitywithin
the Commune
2 to 3
[29]
Appendix 3 Methodology
In some lines, the methodological steps that we intend to carry on are developed hereafter:
Definitionoftheevaluationcriteria
The evaluations criteria are as follows:
a) The reaching of the objectives and the results at the end of April 2014;
b) The relevance
c) The effectiveness
d) The efficiency
e) The impact
Designofa matrixof evaluation
The Matrix of evaluation will make it possible to tally, first of all the mission of evaluation in
general, according to the terms' of references, then, to synthesize in the form of table, all the
question-keys in connections with the above mentioned criteria of evaluation, as well as the
short specific questions, the methods / tools for data-gathering, the indicators and standards
of successes, finally the methods to analyze the data.
Methodsofdata acquisition
The various answers to the question-keys of the criteria of evaluation, in particular of the
reaching of the objectives/results, relevance, effectiveness, impact and durability, will be
obtained starting from the various methods of data acquisition, which will rationally be
chosen, according to their natures and their sources.
MonitoringandEvaluation (M&E)
It is fundamental insofar as it provides us the indicators of performance to measure the
progress, particularly the current results facing the expected results
ExistingReports/ documents
Practically, the majority of information which the criteria of evaluation require, are drawn
from the secondary data sources (external or internal): the monograph of area
(demographic information , socio-economic, etc), a preliminary photograph draft of the sites;
the document of project, agreements of partnership (if, necessary), schedules of conditions
on which the Project superintendent must conform to it, periodic reports of Monitoring and
Evaluation, evaluation reports to internal semi-course, etc
[30]
Interviews
Also called, primary sources data, it is only by the means of the talks, individual or of groups
of 6 to 8 people, directing or semi-directing, as we will obtain information answering the
specific questions stated in the Terms of references.
The talks are preceded by the sampling of the people to be interviewed (Personal technique
of the Project, the recipients of the project, the targets, the local authorities...), the
elaboration of the questionnaires (short of all the tools for evaluation).
The people to be interviewed could be also, the Advisor-keys and the Panels of Expert, if
the mission of Evaluation requires it.
Observations on the ground
The descent on ground, by the exploitation of the technique of Observation, is the singularity
of any informed and conscientious Appraiser of its trade. It will help him to describe as
accurately as possible the inventory of fixtures, or to give a photograph of the project to a
given moment.
Case studies
The studies of the cases of the similar projects carried out in other areas or other countries,
could be useful during the evaluation of the relevance of the project. The Appraiser must
also resort to this method with the purpose of consolidating the good experiments and the
lessons drawn from the other projects.
Questions about the quality of the data
Our strategy consists in improving reliability and the validity of the data bases.
To this end, the Appraiser will carry out the:
Improvement of the quality of sampling
The sample must, be thus selected on the basis of of a reasoning or an aim directly related
to the purposes of the evaluation and is supposed to guarantee a precision in the
interpretation of the conclusions and the utility of the results of the evaluation.
To guarantee the consistency of the gathering of the data
By assisting the Appraiser, the data-processing Operator already received a training about
the protocols of observation; in order to make sure that they record all their observations in
the same way.
The meaning of key words used in the questionnaires and the time-tables of the talks, will be
checked particularly if they were translated, in order to make sure that the people who are
polled understand well what is required of them.
[31]
Checkingoftheprecisedetails: useof several datasources
It is a matter of proceeding:
- the use of a mixture of methods to collect information rather than to stick with only
one source or only one element.
- the cross checking for example the element of a source (such as the Maintenance of
group) with another element on the experiments of the people living in rural
environment (being able to be a documentary element coming from relationship or of
talks with credible advisor-keys and quite informed on the situation).
- the calling of experts to examine and validate the facts.
Analysis,interpretationandsynthesisofthedata
According to the duration and the complexity of the mission of Evaluation, the Appraiser can
work out a Plan of analysis.
It is the phase which precedes the drafting of the evaluation report.
It should be reminded that the analysis of the data is a systematic process for which it is a
question of organizing and of classifying the information collected in the form of tables, to
summarize them and compare the results with those of the other adequate information in
order to extract some deductions being able to answer the questions of the evaluation and
its purposes.
It makes it possible to the analyst to decipher the facts resulting from a whole of testimonies
thanks to a coding and a systematic gathering of the collected data, while taking care to
ensure itself of their precision, by carrying out any statistical analysis necessary and while
transposing these data on formats or units of analysis related to each question about the
evaluation.
The analysis of the data seeks to identify models in the facts, either by isolating some
significant deductions (analyzes), or by combining sources of information to reach a greater
comprehension (synthesis). So the mixture of the methods of evaluation requires a separate
analysis of each element and a synthesis of all the sources in order to examine the
diagrams, the convergence or complexity
[32]
Appendix – 4 Questionnaire – 1 Technical Staff HFH Antananarivo
Names of the responsible to be interviewed:
Functions and roles in the project:
Place...................................................... Date and
hour:..........................................
1. When and how the project was identified?
2. To your knowledge was the project in question the purpose of a Preparation
(enquiry about the social, economic, public health, demographic....)
YES NO
In the affirmative, ask the references of the documents
3. To your knowledge,did the project have the purpose of a precondition of a prior
evaluation (technical Analysis of feasibility, analyzes of financial feasibility)?
YES NOT
In the affirmative, to ask the references of the documents
4. were the recommendations put forth in the evaluation report of 2012 followed
up by positive and concrete acts?
Yes, all were followed up partially without
(in case that the response given is partially or without, ask the reasons - Why?)
5. To make the information on the time-table of execution filled out by bringing
explanations the gaps Goes back to beginning envisaged (jj/mm/aaaa) real
Date of beginning:
Différence ;
Reasons of the difference:
Envisaged date of completion envisaged real Date of
completion
Différence
Reason of the difference:
6. Make the information on the financing of the project filled out
Organization 1....................Amount t of the contribution financial
Organization 2....................Amount t of the contribution financial
Organization 3....................Amount t of the contribution financial
Organization 4....................Amount t of the contribution financial
Total costs of the project
Envisaged real
Difference
Reasons of the difference:
7. Do the Commune and the recipientscontribute to the financing of the project?
YES NOT
[33]
If Yes, give the percentages of their respective participation:
commune
Recipients......................................................................
8. Briefly describe the organization of the project and ONG HFH as a whole?
10.How many workers are mobilized by HFH in Toliary in the execution of project?
11. Is the size of the team of Project, according to you:
Normal Insufficient in excess
12. Please appreciate the motivation of the Technical staffof the project as a whole?
Extremely motivate Fairly motivate Not motivate
13. Please appreciate the competence of the Technical staff of the Project as a
whole?
Highly qualified Fairly qualified Inefficient
14.Does the document of preliminary draft comprise a planning of the activities?
Yes Not
Ask an unspecified related document (operational Planning, Chronogram, Plan
of annual work) / _ /
15.Is the organisational structure of the project equipped with a service (function or
department) dealing only of the Monitoring and Evaluation?
Yes No
16.If Yes, are the Monitoring and Evaluation are systematized (Procedure, standard
form of report, periodic descent, etc.)
Yes No
17 Were the difficulties encountered, the problems of execution or the delays of
executions on ground reported accurately to the Head of project or to the Person in
charge for Monitoring and Evaluation?
Yes No..................More or less
Explain
18 Is – were the reported difficulties encountered, the problems of execution or the
delays of executions examined, taken into account and solved after an adequate
decision?
Always No Seldom
If the answer is " no " or " seldom ", describe briefly the reasons of the non
application of a corrective decision? /
19. Quote, according to you the Assets of the project, in terms of its management
or its execution:
-
-
-
-
[34]
20. Quote, according to you the Weaknesses of the project (according to your own
experiment), in terms of its management or its execution:
-
-
-
-
21. Quote, according to your experiments,the influential internal factors positively
or negatively the results of the project. A) A Factors internal (but
unforeseeable) influencing the results positively
-
B) Internal factors influencing the results negatively
-
-
-
22. Quote, according to your experiments, the influential external factors positively
or negatively the results of the project.
A) ,External factors (but unforeseeable) influencing the results positively
-
-
-
-B) External factors influencing the results negatively
-
-
-
23. Which data-processing software do you use in the Monitoring, Project
management and Evaluation?
24. Did the Project envisage a strategy of perennisation or durability?
Yes No
If in the affirmative, would you specify which?
[35]
Appendix 5 – Card-indexes Balance-sheetof execution
Recapitulation
LOCALITES Construction and/or
rehabilitation of the
houses
Distribution of the
mosquito nets in 89
Houses
Construction of the
lanes in Paving stones
Construction of Water
Ponits
Training of the
recipients
Fokontany
Tsianengea
Envisage
d
Realized Envisag
ed
Realized Envisaged Realized Envisaged Realized Envisage
d
Realized
Fokontany
Tsimenatse
Fokontany
Tsimenatse
Total
Rate of
realization
REMARKSAND OBSERVATIONS
[36]
Appendix 6 - Balance-sheetof execution – A - FKT Tsianengea
N° Contents Observation
01
Construction and/or
rehabilitation of houses
Number
02 Distribution of mosquito net Number
03 Construction of the lanes in
Paving stones
Length (m)
04
Construction of Water Points Number
05
Formation des bénéficiaires
Number
[37]
Appendix 7 - Balance-sheetof execution – B- FKT Tsimenatse
N° Contents Observation
01
Construction and/or
rehabilitation of houses
Number
02 Distribution of mosquito net Number
03 Construction of the lanes in
Paving stones
Length (m)
04
Construction of Water Points Number
05
Formation des bénéficiaires
Number
[38]
Appendix 8 - Balance-sheetof execution – A - FKT Mahavatse
N° Contents Observation
01
Construction and/or
rehabilitation of houses
Number
02 Distribution of mosquito net Number
03 Construction of the lanes in
Paving stones
Length (m)
04
Construction of Water Points Number
05
Formation des bénéficiaires
Number
[39]
Appendix 9 Questionnaire – Impact – Beneficiaries- Focus Group (Group of 8 A
12 People)
Locality and date:............................................................... Hour: …………………
A - Questions to be asked to the final beneficiaries
1. Did you take part or contribute to the identification or the implementation
of the project? If so, which was your role?
2. Which trade do you practise?
3. How many people are there in your family (size of household)?
4. Preparatory project, describe the living conditions where your family has
lived:
- The number of rooms? Did you live with a problem of promiscuity?
(Establish the ratio: the amount of household/number of rooms)
- are you tenant of a house? If so, how much did you pay monthly?
- Or were you lodged by your close or friends? Or a homeless? Do you
built yourself your house? Water accessibility? Availability of health
facilities?
- Were the children provided education ?
- Does malaria prevail in the district before? Are there other tropical
diseases which prevailed there? If yes, which?
- Do you have Savings preparatory project? Roughly, how much per
month?
- How much per month do you ge, roughly as income?
5. After Project, was the problem of promiscuity solved? explain, how many do
you live in the same roof now? (Establish the current ratio: Cut of household
per rooms)
6. Is drinking water accessibility now solved?
7. Quid with the schooling of the children?
8. Did you receive Mosquito nets? Do you use it?
9. was the problem of malaria in the district clearly improved (Statistical
epidemiologic to be checked, if possible, at the closest CSB where the
recipients frequented in case of epidemic of malaria)
10. Do you currently have Savings or are they improved?
11. How much per month do you receive roughly as income? (analyze the
difference Before and After project)
[40]
12. Give your opinions on the and impact and the effect of the project? (Compared
to your former way of life)
13. Did you profit from a training on Maintenance of the work, the dwelling and
hygiene?
14. How do you find the training? Did you already put it into practice?
15. Do you know how the organization which finances this project is?
16. How is the ONG which carries out this project called?
17. How to recognize them? Describe their respective logos
B - Specific questions, indirect recipients of the project (non members of
associations of the recipients)
18.Which feeling do you express the works built (Lanes in Paving stones, water
Points, discharge culverts of worn water) within the project HFH, in which you
enjoy and get advantages and interests, as well as the direct recipients in the
Fokontany?
19.Is there no frustration,rivalry or litigation betweenyou the direct recipients and
the indirect recipients who enjoy the advantages through the project in the
everyday life?
20.If in the affirmative, how to solve them? Would not you attempt to organize
yourself one day, to take similar initiatives in order to solve the problems of
home, of water supply, traffic, hygiene and public health?
a) 4 Highlight in a few words the difference of the advantages and interests
between you and the associations of the final recipients.
21.Do you know what the organization which finances this project in Fokontany
Tsianengea, Tsimenatse and Mahavatse is?
22.How is the ONG which carries out this project called?
23.How to recognize them? Describe their respective logos?
Put the questions 22, 23 and 24 to a sample of the inhabitants of the Fokontany
neighbouring, randomly taken and with multivariable: (sex, age, social and
economic category). Record the good and the bad answers.
[41]
Appendix 10 - Questionnaire HFH Toliary
1. How does your Communication with the local Partners of HFH appear?
a) With the local Authorities and politicians of the region
Good Average Bad Sometimes good sometimes bad
Explain?
b) With the firms
Good average bad sometimes good sometimes bad
Explain?
c) With the Final recipients (members of the associations of the recipients)
Good average bad sometimes good sometimes bad
Explain?
2. Briefly describe your role, function, attributions and extent of your
responsibilities in the execution for the project?
-
-
3. Do the titular firms designed to execute some tasks respect their engagements to
HFH?
Yes No......................... Rarely
Explain?
4. Are there casesin which the execution of one or more activities are late or in
update?
[42]
Yes Rarement Frequently
Explain, which are the reasons?
5. Were the recorded lost time of executions made up?
Yes No
How?
6-. Who controls the completion of the work?
-
-
7. How many works are finished officially?
a) Temporarily
Fkt Tsianengea:
- House:
- Water Points
- Lanes in Paving stones:
-- Mosquito nets distributed
Fkt Tsimenatse
- House:
- Water Points
- Lanes in Paving stones:
-- Mosquito nets distributed
Fkt Mahavatse
- House:
- Water Points
- Lanes in Paving stones:
-- Mosquito nets distributed
b) Definitively
Fkt Tsianengea:
House:
- Water Points
- Lanes in Paving stones:
-- Mosquito nets distributed
Fkt Tsimenatse
House:
- Water Points
- Lanes in Paving stones:
-- Mosquito nets distributed
Fkt Mahavatse
- House:
- Water Points
- Lanes in Paving stones:
-- Mosquito nets distributed
[43]
8.What are the assets of the project, which should be maintained or to develop
more? According to your experiments on ground
-
-
9. Which are the weaknesses and difficultiesencountered during the execution of
the project? (Relational, administrative, financial, material, competence of RH
employed...)
-
-
[44]
Appendix 11 Questionnaire municipal Authority of Toliary I (Mayor or PDS and
DSAS)
1.Does the CUT lay a Communal Plan of Development?
Yes No
If Yes, is it operational?
2.How do you see the initiative of HFH in the Shantytowns of the 3 Fokontany of
Toliary?
-
-
-
-
-
-
Does the CUT have a budget allocated for the Maintenance of public works?
Yes No
If Yes, till how much does it rise?
Till how much does the annual budget of the CUT approved by the Town council
rise?
3.Does the CUT lay out a strategy having for purpose to develop and maintain the
works, services and goods left by the Projects initiated by various ONG after their
completion?
[45]
Appendix 12 Lists interviewed people
-Haja Mamiharijaona Ramerison, Program Manager, Hfh Antananarivo
- AZOELISOLOMIHANTA Volatiana Livanirina, Resources Development and
communication Manager, HFH Antananarivo
- Ravotovelson Mamisoa Hubert, Consulting in Covering, HFF Toliary
- Ramamonjisoa Cerice Gaustin, Consulting in Covering, HFH Toliary
- Razafindrambola Adrien, Consulting Specialist Construction
- Rasoanantenaina Simonette, Socio-Organizing, Hfh Toliary
-Tinanomendranahary Luciana Danella, Socio-Organizing, Hfh Toliary
- Rambeloson Thierry, Consulting Cs, Hfh Toliary
- Mampionotsihoaly Patric, Consultant Hao, Hfh Toliary
- Dr. Fiacre Hatimo, Mayor of the Urban District Toliara
- Perfect, Assistant Emampo - Fokontany Head, Tsianengea
- Robin, Member of the Committee of Fokontany Tsianengea
- Zo Chef of building site, Fenitra Firm,
- Faly, Head of Building site, Fenitra Firm,
- Niry, Manager of the Fenitra firm,
- Manjato, Mason, Undertaken Fanilo
- Rado, Head of Building site, Fanilo Firm
- Solonjatovo José Ralaro, Mason Hfh, Ampasikibo - Ambahiboho
- Léandre Fidison, Operation, Ampasikibo - Ambahiboho
- Mrs. Lazaikely Patrice, Profit House, Ampasikibo – Ambahiboho
- Christian, President of Fokontany – Ankatsaka
- Dino, Mason – Ankilahila Befanamy
- Justin, Mason - Ankilahila Befanamy;
- Celine Sitony, Recipient;
- Lala Jean Baptiste, Recipient
- Basile, Recipient;
- Rakoromamonjisoa Barijaona, Recipient
- Christel Role, Recipient
- Novasoa Berthine, Recipient
- Leky, Recipient
- Mouslah Hazam, Recipient
- Arthur, Member of the Committee of Fokontany
- Ramilasoa, Head of Village, recipient
- Etitatse, Assistant Fokontany, Recipient
- Raharivelo Clim, Ampasikibo, Recipient
- Farez, Andrimasom-pokonolona, nonprofit
- Christelle, Ankatsaka, nonprofit
[46]
Appendix 13 – visited Sites
- Hfh Antananarivo
- Hfh Toliary – Roadway system
- Toliary Town hall
- Mahavatse Tanambao
- Ambalanombikamoa
- Mahavatse I West
- Mahavatse I Is
- Tsimenatse I West
- Tsimenatse I Is
- High Ankiambe
- Tanambao Motombe
- Mahavatse II West
- Ankilahila
- Ambahiboho
- Andaboly
Appendix 14 - Quoted work
Ministry of Economy, Finances and Budget - Secretary general. PERIODIC
ENQUIRY INTO THE HOUSEHOLD 2004. Report of the anquiry Socio-
demographic, healthand economic, Antananarivo: Instat,January 2006.
Appendix 16 - DECLARATION OF THE RESPECT OF THE ETHICS
I, undersigned, Rakoto Yvon Namelankafatra - Consultant in Evaluation, declares
that the Retrospective appraisal and external Project " Community Mobilization,
Infrastructures, Hygiene and Healthin the Shantytowns of Toliary ", is carried out
in the respect of the Ethics of the Evaluation.
In this respect, the Evaluation is made with independence, impartiality,honesty,
integrity,responsibility,confidentiality and transparency; any conflict of interest
enters the interviewed people was avoided.
The team had not saved her efforts so that the reports and the presentations of
evaluation are precise, complete and reliable.
Antananarivo, April 14 2014
Rakoto Yvon Namelankafatra
[47]

More Related Content

What's hot

Burger world individual franchise agreement 20130214 khaled and ahmed alhebsi
Burger world   individual franchise agreement 20130214 khaled and ahmed alhebsiBurger world   individual franchise agreement 20130214 khaled and ahmed alhebsi
Burger world individual franchise agreement 20130214 khaled and ahmed alhebsiLaith Rashed
 
Layout for the project
Layout for the projectLayout for the project
Layout for the projectKrupol Phato
 
Federal Open Government Guide (FOIA and Other Federal Access Laws)
Federal Open Government Guide (FOIA and Other Federal Access Laws)Federal Open Government Guide (FOIA and Other Federal Access Laws)
Federal Open Government Guide (FOIA and Other Federal Access Laws)Umesh Heendeniya
 
101 writing booklet_hw_unit_8
101 writing booklet_hw_unit_8101 writing booklet_hw_unit_8
101 writing booklet_hw_unit_8Rafael Ferraz
 
דו"ח פשיטת הרגל של סולינדרה
דו"ח פשיטת הרגל של סולינדרהדו"ח פשיטת הרגל של סולינדרה
דו"ח פשיטת הרגל של סולינדרהTashtiot media
 
Rapport de la Banque Mondiale sur la Production et la Consommation du Charbon...
Rapport de la Banque Mondiale sur la Production et la Consommation du Charbon...Rapport de la Banque Mondiale sur la Production et la Consommation du Charbon...
Rapport de la Banque Mondiale sur la Production et la Consommation du Charbon...Stanleylucas
 
Archaeological Report - 11 Patricks St, Kilkenny, Co. Kilkenny (Ireland)
Archaeological Report - 11 Patricks St, Kilkenny, Co. Kilkenny (Ireland)Archaeological Report - 11 Patricks St, Kilkenny, Co. Kilkenny (Ireland)
Archaeological Report - 11 Patricks St, Kilkenny, Co. Kilkenny (Ireland)John Tierney
 
The English language
The English languageThe English language
The English languagetranslatorale
 
Info de Curso. Inglés Americano Nivel 2
Info de Curso. Inglés Americano Nivel 2Info de Curso. Inglés Americano Nivel 2
Info de Curso. Inglés Americano Nivel 2dahedi05
 
Standing rules and bylaws
Standing rules and bylawsStanding rules and bylaws
Standing rules and bylawsDiegoTGarcia
 
A Study on Market Share of Indian Detergent giant Surf Excel and Suggesting m...
A Study on Market Share of Indian Detergent giant Surf Excel and Suggesting m...A Study on Market Share of Indian Detergent giant Surf Excel and Suggesting m...
A Study on Market Share of Indian Detergent giant Surf Excel and Suggesting m...silvygoldy
 
Recent Developments in Rhode Island Law 2014 - State Courts and Civil Procedure
Recent Developments in Rhode Island Law 2014 - State Courts and Civil ProcedureRecent Developments in Rhode Island Law 2014 - State Courts and Civil Procedure
Recent Developments in Rhode Island Law 2014 - State Courts and Civil ProcedureNicole Benjamin
 
Wanekeya R et al;B.A Journalism and Media Studies Research Project_MOBILE PHO...
Wanekeya R et al;B.A Journalism and Media Studies Research Project_MOBILE PHO...Wanekeya R et al;B.A Journalism and Media Studies Research Project_MOBILE PHO...
Wanekeya R et al;B.A Journalism and Media Studies Research Project_MOBILE PHO...Richard Wanekeya
 
46 Proven Ways to Make Money Online
46 Proven Ways to Make Money Online46 Proven Ways to Make Money Online
46 Proven Ways to Make Money OnlineNixerr
 

What's hot (17)

Student Handbook
Student HandbookStudent Handbook
Student Handbook
 
Burger world individual franchise agreement 20130214 khaled and ahmed alhebsi
Burger world   individual franchise agreement 20130214 khaled and ahmed alhebsiBurger world   individual franchise agreement 20130214 khaled and ahmed alhebsi
Burger world individual franchise agreement 20130214 khaled and ahmed alhebsi
 
Layout for the project
Layout for the projectLayout for the project
Layout for the project
 
Federal Open Government Guide (FOIA and Other Federal Access Laws)
Federal Open Government Guide (FOIA and Other Federal Access Laws)Federal Open Government Guide (FOIA and Other Federal Access Laws)
Federal Open Government Guide (FOIA and Other Federal Access Laws)
 
101 writing booklet_hw_unit_8
101 writing booklet_hw_unit_8101 writing booklet_hw_unit_8
101 writing booklet_hw_unit_8
 
דו"ח פשיטת הרגל של סולינדרה
דו"ח פשיטת הרגל של סולינדרהדו"ח פשיטת הרגל של סולינדרה
דו"ח פשיטת הרגל של סולינדרה
 
Sahiwal
SahiwalSahiwal
Sahiwal
 
Staff Handbook 09 10
Staff Handbook 09 10Staff Handbook 09 10
Staff Handbook 09 10
 
Rapport de la Banque Mondiale sur la Production et la Consommation du Charbon...
Rapport de la Banque Mondiale sur la Production et la Consommation du Charbon...Rapport de la Banque Mondiale sur la Production et la Consommation du Charbon...
Rapport de la Banque Mondiale sur la Production et la Consommation du Charbon...
 
Archaeological Report - 11 Patricks St, Kilkenny, Co. Kilkenny (Ireland)
Archaeological Report - 11 Patricks St, Kilkenny, Co. Kilkenny (Ireland)Archaeological Report - 11 Patricks St, Kilkenny, Co. Kilkenny (Ireland)
Archaeological Report - 11 Patricks St, Kilkenny, Co. Kilkenny (Ireland)
 
The English language
The English languageThe English language
The English language
 
Info de Curso. Inglés Americano Nivel 2
Info de Curso. Inglés Americano Nivel 2Info de Curso. Inglés Americano Nivel 2
Info de Curso. Inglés Americano Nivel 2
 
Standing rules and bylaws
Standing rules and bylawsStanding rules and bylaws
Standing rules and bylaws
 
A Study on Market Share of Indian Detergent giant Surf Excel and Suggesting m...
A Study on Market Share of Indian Detergent giant Surf Excel and Suggesting m...A Study on Market Share of Indian Detergent giant Surf Excel and Suggesting m...
A Study on Market Share of Indian Detergent giant Surf Excel and Suggesting m...
 
Recent Developments in Rhode Island Law 2014 - State Courts and Civil Procedure
Recent Developments in Rhode Island Law 2014 - State Courts and Civil ProcedureRecent Developments in Rhode Island Law 2014 - State Courts and Civil Procedure
Recent Developments in Rhode Island Law 2014 - State Courts and Civil Procedure
 
Wanekeya R et al;B.A Journalism and Media Studies Research Project_MOBILE PHO...
Wanekeya R et al;B.A Journalism and Media Studies Research Project_MOBILE PHO...Wanekeya R et al;B.A Journalism and Media Studies Research Project_MOBILE PHO...
Wanekeya R et al;B.A Journalism and Media Studies Research Project_MOBILE PHO...
 
46 Proven Ways to Make Money Online
46 Proven Ways to Make Money Online46 Proven Ways to Make Money Online
46 Proven Ways to Make Money Online
 

Similar to Community Mobilization and Hygiene Project Evaluation

Healthy Families Healthy Forests_CI's PHE end of project report article
Healthy Families Healthy Forests_CI's PHE end of project report articleHealthy Families Healthy Forests_CI's PHE end of project report article
Healthy Families Healthy Forests_CI's PHE end of project report articleMarcelino Jr. Viernes
 
Singapore National NGO Report to CEDAW
Singapore National NGO Report to CEDAWSingapore National NGO Report to CEDAW
Singapore National NGO Report to CEDAWbhavnarr
 
Watershed Development in India An Approach Evolving through Experience_0.pdf
Watershed Development in India An Approach Evolving through Experience_0.pdfWatershed Development in India An Approach Evolving through Experience_0.pdf
Watershed Development in India An Approach Evolving through Experience_0.pdfravi936752
 
Factors affect taking charge at Vingroup Corporation
Factors affect taking charge at Vingroup CorporationFactors affect taking charge at Vingroup Corporation
Factors affect taking charge at Vingroup CorporationNguyễn Hà
 
2015 local chapter handbook
2015 local chapter handbook2015 local chapter handbook
2015 local chapter handbookdrrskhan
 
Teaching english language
Teaching english languageTeaching english language
Teaching english languagepaolasparapani
 
AaryaShah_Cambridge_Dissertation
AaryaShah_Cambridge_DissertationAaryaShah_Cambridge_Dissertation
AaryaShah_Cambridge_DissertationAarya Shah
 
Vita Industry Survey 2010
Vita Industry Survey 2010Vita Industry Survey 2010
Vita Industry Survey 2010Neil Peterson
 
Analysis of International Funding to Tackle IWT
Analysis of International Funding to Tackle IWTAnalysis of International Funding to Tackle IWT
Analysis of International Funding to Tackle IWThasita
 
Middleshire university proposal
Middleshire university proposalMiddleshire university proposal
Middleshire university proposalNwabueze Dexter
 
SFCG_CMM-Evaluation-Report
SFCG_CMM-Evaluation-ReportSFCG_CMM-Evaluation-Report
SFCG_CMM-Evaluation-ReportClaudios Hakuna
 
Jobeet 1.4-doctrine-en
Jobeet 1.4-doctrine-enJobeet 1.4-doctrine-en
Jobeet 1.4-doctrine-enModu Labs LLC
 
ROC (Taiwan) Yearbook 2011 Indices
ROC (Taiwan) Yearbook 2011 IndicesROC (Taiwan) Yearbook 2011 Indices
ROC (Taiwan) Yearbook 2011 IndicesKlaus Bardenhagen
 

Similar to Community Mobilization and Hygiene Project Evaluation (20)

Healthy Families Healthy Forests_CI's PHE end of project report article
Healthy Families Healthy Forests_CI's PHE end of project report articleHealthy Families Healthy Forests_CI's PHE end of project report article
Healthy Families Healthy Forests_CI's PHE end of project report article
 
Singapore National NGO Report to CEDAW
Singapore National NGO Report to CEDAWSingapore National NGO Report to CEDAW
Singapore National NGO Report to CEDAW
 
Community Archaeology Report
Community Archaeology ReportCommunity Archaeology Report
Community Archaeology Report
 
Watershed Development in India An Approach Evolving through Experience_0.pdf
Watershed Development in India An Approach Evolving through Experience_0.pdfWatershed Development in India An Approach Evolving through Experience_0.pdf
Watershed Development in India An Approach Evolving through Experience_0.pdf
 
Volunteer Manual
Volunteer ManualVolunteer Manual
Volunteer Manual
 
Happy schools
Happy schoolsHappy schools
Happy schools
 
Factors affect taking charge at Vingroup Corporation
Factors affect taking charge at Vingroup CorporationFactors affect taking charge at Vingroup Corporation
Factors affect taking charge at Vingroup Corporation
 
2015 local chapter handbook
2015 local chapter handbook2015 local chapter handbook
2015 local chapter handbook
 
Teaching english language
Teaching english languageTeaching english language
Teaching english language
 
AaryaShah_Cambridge_Dissertation
AaryaShah_Cambridge_DissertationAaryaShah_Cambridge_Dissertation
AaryaShah_Cambridge_Dissertation
 
Vita Industry Survey 2010
Vita Industry Survey 2010Vita Industry Survey 2010
Vita Industry Survey 2010
 
Vietnam Quarterly Knowledge Report | Q4 2016
Vietnam Quarterly Knowledge Report | Q4 2016 Vietnam Quarterly Knowledge Report | Q4 2016
Vietnam Quarterly Knowledge Report | Q4 2016
 
SMES-Publication UK
SMES-Publication UKSMES-Publication UK
SMES-Publication UK
 
Analysis of International Funding to Tackle IWT
Analysis of International Funding to Tackle IWTAnalysis of International Funding to Tackle IWT
Analysis of International Funding to Tackle IWT
 
Middleshire university proposal
Middleshire university proposalMiddleshire university proposal
Middleshire university proposal
 
WisconsinPlan
WisconsinPlanWisconsinPlan
WisconsinPlan
 
SFCG_CMM-Evaluation-Report
SFCG_CMM-Evaluation-ReportSFCG_CMM-Evaluation-Report
SFCG_CMM-Evaluation-Report
 
Jobeet 1.4-doctrine-en
Jobeet 1.4-doctrine-enJobeet 1.4-doctrine-en
Jobeet 1.4-doctrine-en
 
ROC (Taiwan) Yearbook 2011 Indices
ROC (Taiwan) Yearbook 2011 IndicesROC (Taiwan) Yearbook 2011 Indices
ROC (Taiwan) Yearbook 2011 Indices
 
Forgotten Europeans Forgotten Rights
Forgotten Europeans Forgotten RightsForgotten Europeans Forgotten Rights
Forgotten Europeans Forgotten Rights
 

Community Mobilization and Hygiene Project Evaluation

  • 1. Retrospective evaluation report of the Project "Community Mobilization, Infrastructures, Hygiene and Health in the Shantytowns of Toliary - Madagascar" Period: 21 March - 18 April 2014 Date of presentation :14 April 2014 Date of deposition : 18 April 2014 Places:Toliary and Antananarivo Name of the Appraiser:Rakoto Yvon Namelankafatra Recipient of Evaluation: Habitat For Humanity Madagascar 2014 Cabinet TEFIGASY 18/04/2014
  • 2. [2] List of the abbreviations and acronyms DAO : Offer Appeal File (Dossier d’Appel d’Offre) FKT : Fokontany HFH : Habitat For Humanity KOICA : Korean International Cooperation Agency OMD : Objectives Millennium of Development NGO : Non governemental Organization TOR : Terms Of reference List tables Tableau 1 Situation of the house construction.........................................................................15 Tableau 2 Realization on the cover of the lanes in Paving stones..........................................17 Tableau 3 Realization in Water Points construction and renovation.......................................18 Tableau 4 Internal factors affecting the results of the project..................................................21 Tableau 5 External factors affecting the results of the project.................................................21 Tableau 6 The result of project................................................................................................24 List graphs Figure 1 Flipchart showing the progression of work of the house...........................................14 Figure 2Situation of the houses construction...........................................................................15 Figure 3 "Trano vondro", manufacturated out vegetable matter, it is property of Mr. Rafaralahy there .......................................................................................................................16 Figure 4 A Mason who charged to rebuilt an house destroyed by Cyclone "Haruna" ............16 Figure 5 It's here that Mr. Rafaralahy will settle in the next months........................................16 Figure 6 This house is rebuilt with precaution and attention after its collapse at the passage of the Cyclone Haruna..............................................................................................................16 Figure 7 An house HFH/KOICA in the course completion in Ankilahila ..................................17 Figure 8 An house HFH/KOIKA which has been just finished in Ankilahila ............................17 Figure 9 Realization of the cover of the lanes in Paving stones..............................................17 Figure 10 Water Point renovated in Tsimenatse IWest..........................................................18 Figure 11 New construction of Water point in Tanambao Motombe .......................................18 Figure 12 Water point renavated in Mahavatse I East.............................................................18 Figure 13 New construction of Water point in High Ankiambe................................................18 Figure 14 An inhabitant of Tsianengea Shantytown raises the question which the Maintenance of infrastructures for them means. Photograph: HFH Antananarivo .................20 Figure 15 Trainers explain to the participants the importance of the Maintenance of the infrastructures and Hygiene. Photograph:: HFH Antananarivo ...............................................20
  • 3. [3] Contents List of the abbreviations and acronyms .....................................................................................2 List tables....................................................................................................................................2 List graphs ..................................................................................................................................2 Contents .....................................................................................................................................3 Executive Summary....................................................................................................................6 I. Summary .........................................................................................................................6 II. Purpose of the Evaluation...............................................................................................6 III. The public of the evaluation.........................................................................................6 IV. Uses in the future.........................................................................................................7 I. Results of the evaluation.................................................................................................7 Methodology and Sampling........................................................................................................8 I. Sampling on ground........................................................................................................8 II. Methodology....................................................................................................................8 1. Analysis of the various project documents..................................................................8 2. Formal surveys and guidelines....................................................................................8 3. Free and informal interviews .......................................................................................9 4. Focus group.................................................................................................................9 5. Observation..................................................................................................................9 6. Refining and the stepping of the meditative information.............................................9 7. Limits of the external evaluation..................................................................................9 Methodology and sampling ......................................................................................................10 III. Sampling on ground...................................................................................................10 IV. Methodology..............................................................................................................10 8. Analysis of the various documents project................................................................10 9. Formal surveys and guidelines..................................................................................10 10. The free and not formal interviews.........................................................................11 11. The focus group .....................................................................................................11 12. The Observation.....................................................................................................11 13. The refining and the stepping of the meditative information .................................11 14. Limits of the external evaluation ............................................................................11 Assessment of execution.........................................................................................................12 I. How was the project it prepared?..................................................................................12 II. Organization and Human resources .............................................................................12
  • 4. [4] III. The realization of the project.....................................................................................15 i. Construction and or rehabilitation of 89 Houses.......................................................15 ii. Construction of the lanes in Paving stones...............................................................17 iii. Construction and rehabilitation of the Water Points..................................................18 iv. Training in Maintenance of infrastructures and Hygiene.......................................20 v. Distribution of the Mosquito nets...............................................................................20 IV. Factors affecting the project results ..........................................................................21 i. Internal factors affecting the project..........................................................................21 ii. External factors affecting the project.........................................................................21 iii. The relevance of the project......................................................................................22 iv. The efficiency of the project...................................................................................22 v. Impacts of the project................................................................................................23 vi. The efficiency of the project.......................................................................................23 vii. The durability of the project....................................................................................23 viii. Marketing images of HFH and the Donors ............................................................23 Conclusion................................................................................................................................24 Main recommendations............................................................................................................25 The lessons to be learned........................................................................................................26 Best practice to be duplicated in the future..............................................................................26 Appendix 1 Matrix of evaluation ...........................................................................................27 Appendix 2 Sampling............................................................................................................28 Appendix 3 Methodology......................................................................................................29 Definition of the evaluation criteria....................................................................................29 Design of a matrix of evaluation........................................................................................29 Methods of data acquisition..............................................................................................29 Monitoring and Evaluation (M&E).....................................................................................29 Existing Reports/ documents............................................................................................29 Interviews ..........................................................................................................................30 Observations on the ground..............................................................................................30 Case studies......................................................................................................................30 Questions about the quality of the data ............................................................................30 Improvement of the quality of sampling............................................................................30 To guarantee the consistency of the gathering of the data ..............................................30 Checking of the precise details: use of several data sources ..........................................31 Analysis, interpretation and synthesis of the data............................................................31 Appendix – 4 Questionnaire – 1 Technical Staff HFH Antananarivo.....................................32
  • 5. [5] Appendix 5 – Card-indexes Balance-sheet of execution ..................................................35 Appendix 6 - Balance-sheet of execution – A - FKT Tsianengea.......................................36 Appendix 7 - Balance-sheet of execution – B- FKT Tsimenatse........................................37 Appendix 8 - Balance-sheet of execution – A - FKT Mahavatse........................................38 Appendix 9 Questionnaire – Impact – Beneficiaries- Focus Group (Group of 8 A 12 People) ..............................................................................................................................................39 Appendix 10 - Questionnaire HFH Toliary ...........................................................................41 Appendix 11 Questionnaire municipal Authority of Toliary I (Mayor or PDS and DSAS)....44 Appendix 12 Lists interviewed people..................................................................................45 Appendix 13 – visited Sites ...................................................................................................46 Appendix 14 - Quoted work..................................................................................................46 Appendix 16 - DECLARATION OF THE RESPECT OF THE ETHICS ...............................46
  • 6. [6] Executive Summary I. Summary The present document handles the final external evaluation of the project "Community Mobilization, Infrastructure, Hygiene and Health in the slums of Toliara." Part 3. The plan was to carry out this project for the year between January 2013 and December 2013, but for several reasons which we will further develop, its launch was delayed by 8 months and it is on track to be complete by the end of April 2014. The main content of the project is as follows: - Construction and / or rehabilitation of 89 houses ; - Distribution of 267 mosquito nets; - Construction and / or rehabilitation of 12 Water Points ; - Rehabilitation of streets in Pavers with a total length of 2000 meters. Besides, other actions were planned such as the training of beneficiaries in Maintenance and hygiene. The NGO Habitat For Humanity is the Agency of Execution – This project is financed by KOICA as high as 248 095 293 Korean The evaluation mission is headed by Yvon Rakoto Namelankafatra with the assistance of two Consultants - Investigators: Ramaharoarivo Tahinjanahary Hariliva and Tsangandahy Aina. II. Purpose of the Evaluation According to the TOR, the objective of the evaluation is of: - to appreciate in a way independent the results of the project, while sticking more to the impact of the actions carried out compared to the had aims; - To learn the principal lessons from the intervention and to make practical recommendations. III. The public of the evaluation The public of the evaluation is constituted by HFHM, KOICA, the Urban district of Toliary, the Presidents of Fokontany where the actions were rationally chosen there, the resident families in the sites of the project, the direct beneficiaries, the inhabitants of the urban city of Toliary, NGO and Associations which have work which have work in development of the human value.
  • 7. [7] IV. Uses in the future The results, assets identified, weaknesses, lessons learned, and the various impacts should be used for ideas and as benchmarks in similar projects. I. Results of the evaluation At the time of completion of the evaluation, the result is: The project "Community Mobilization, Infrastructures, Hygiene and Health in the slums of Toliary " reached the majority of its objectives with some difficulties. Of the 89 houses to be built or rehabilitated: - 86 are actually finished and occupied in 22 Fokontany; - 2 are in the course of being finished; - 1 to completely reconstruct in Anketa Bas. The completion rate for the houses is therefore 95.50 %. - Concerning the 2000m of alleys to be paved: - 89.74%, or almost 1794,9 m, are finished and practicable Concerning the12 Water Points: - 6 old public Water Points were renovated and continued to supply of drinking water (in Fokontany: Ambalanombikamoa, Mahavatse I West, Tsimenatse I West, Tsimenatse I East and Mahavatse II West) - 6 new public fountains were built but are unoperational because they are not connected to JIRAMA sources (Fokontany: Tanambao Motombe, Ankiambe Haute, Mahavatse I East, Mahavatse I West, Ambalanombikamoa, Mahavatse Tanambao). Regarding health, namely prevention of and the fight against Malaria, 267 mosquito nets were distributed to all the beneficiaries of houses (3 mosquito nets per beneficiary). Finally, the project beneficiaries from Tsianengea and Tsimenatse Fokontany have benefited from training on the Maintenance and hygiene
  • 8. [8] Methodology and Sampling I. Sampling on ground Population (Ideal Universe): human resource employed by Habitat For Humanity NGO (Antananarivo and Toliary), leaders and technicians for the companies involved in the project (Head of company, Heads of building site and Masons), the beneficiaries of the project, Authorities of the Urban District of Toliara I, and the decentralized Communities (Mayor of the CUT, Presidents of the FKT). Subpopulation (operational Universe) N° Subpopulations Criteria of selection Variable Size 1 Technical persons in charge for the ONG HabitatFor Humanity Having a directresponsibilitywith the execution for the projectwith Toliara and a knowledge ofthe history of the project Place of employment Antananarivo Toliary 2 07 2 Enterprise manager Contribution on execution of the project geographical locality 01 3 Final recipients ofthe project recipients associations members geographical locality 14 4 Indirect recipients To reside in neighbouring FKTwhile profiting the advantages rising from the built infrastructures Function and responsibility:In the Commune In the FKT 08 5 Communal and FKT Authorities To be decision makers in the Commune or in the FKT Function and responsibility: In the Commune orIn the FKT 01 Commune 03 FKT 6 Workmen Effective participation in work of the project -Function and responsibility -professional Classification 06 II. Methodology As announced in our technical offer, the methodology adopted contains several techniques of investigation. 1. Analysisofthe various projectdocuments These documents are provided by HFH: They include the initial project document, the previous evaluation reports, the organizational structure of the Executive, the Schedule, and the databases for tracking. 2. Formal surveysandguidelines Questionnaires were prepared for the purpose of obtaining precise technical information required by the evaluation. (See questionnaire in Appendix).
  • 9. [9] 3. Free andinformal interviews They allowed us to obtain useful information, while their importance was unforeseen during the elaboration of the methodology – Interviews of this type were recorded to get faithful transcriptions of the narratives given and declarations made by the interviewees, often in local dialects. 4. Focusgroup They are organized to obtain several joint and divergent answers for some questions - The focus group were used to collect the information with the direct or indirect beneficiaries and HFH Staff of Toliary. 5. Observation The technical observation enabled us to see, in person, the state of the sites. Photographs were taken in order to analyze them. The observation is necessary because it will enable us to confirm, cancel, or to correct certain assertions or accounts of the interviewed people. It’s the most effective instrument to describe the results accurately. 6. Refiningandthe steppingofthe meditativeinformation Information proven to be unfounded will not be taken into account and more rhetorical accounts will be compared with other sources. Thus, analyses and interpretation will be based on reliable data. 7. Limits ofthe external evaluation The limits of the external evaluation are imposed by available time and the geographical distance of the sites involved. Also, interviewees who withhold information will limit the scope of the evaluation.
  • 10. [10] Methodology and sampling III. Sampling on ground Population (ideal Universe):human resource employed by Habitat For Humanity NGO (Antananarivo and Toliary), leaders and Responsible technical for the companies having carried out the implementation for the project (Head of company, Heads of building site and Masons), the recipients of the project, Authorities of the Urban District of Toliara I and the decentralized Communities (Mayor of the CUT, Presidents of the FKT). Subpopulation (operational Universe) N° Subpopulations Criteria of selection Variable Size 1 Technical persons in charge for the ONG HabitatFor Humanity Having a directresponsibilitywith the execution for the projectwith Toliara and a knowledge ofthe history of the project Place of employment Antananarivo Toliary 2 07 2 Enterprises manager Contribution on execution of the project geographical locality 01 3 Final recipients ofthe project recipients associations members geographical locality 14 4 Indirect recipients To be residentneighbouring FKT while profiting the advantages rising from the built infrastructures Function and responsibility:In the Commune In the FKT 08 5 Communal and FKT Authorities To be maker decision in the Commune or in the FKT Function and responsibility: In the Commune orIn the FKT 01 Commune 03 FKT 6 Workmen Effective participation in work of the project -Function and responsibility -professional Classification 06 IV. Methodology As announced in our technical offer, the methodology adopted contains several methods and techniques of investigation. 8. Analysisofthe various documentsproject These documents are provided by HFH: It’s the initial project document, the previous evaluation reports, the organizational structure of the Executive, the Schedule, the databases for tracking. 9. Formal surveysandguidelines Questionnaires pre-established were used to obtain the technical information requiring precision in the evaluation. (Cf. Questionnaire in Appendix).
  • 11. [11] 10. Thefree andnot formal interviews They allowed us to obtain useful information, while their importance was unforeseen during the elaboration of the methodology - This type of interview (Maintenance) was always followed by sound recordings, to transcribe faithfully narratives and declarations of people interviewed, often expressed in dialects local. 11. Thefocusgroup They are organized to obtain several joint and divergent answers for some questions - The focus group were used to collect the information with the direct or indirect beneficiaries and HFH Staff of Toliary. 12. TheObservation The observation technical enabled us to see in visu the inventory of fixtures. Photographs were taken in order to analyze them. The observation is necessary, it will enable us to confirm, cancel or to correct certain assertions or accounts of the interviewed people. It’s the most effective instrument to describe the inventories of fixtures accurately. 13. Therefiningandthe steppingofthe meditative information Proven information as non founded will not be taken into account and those which are the subject of a rhetoric, will be compared with other sources. Thus, it’s at the base of the reliable data that the analyses and interpretations of the facts are based. 14. Limits ofthe external evaluation The limits of the external evaluation are in the time required to make it count held by the geographical distance where are the Sites of the Project - The possibility of withholding of information on behalf of certain interviewed people.
  • 12. [12] Assessment ofexecution The project "Community Mobilization, Infrastructures, Hygiene and Health in the Slums of Toliary " - HFH-KOICA, was launched in a particularly difficult context: political and economic crisis, passage of the Haruna Cyclone in Toliara of an intensity not seen for 35 years, and internal management problems of HFHM. The project required HFHM to restructure itself by improving the connection between HFH Toliary and HFH Antananarivo, while scrupulously sticking to procedures. I. How was the project it prepared? Being already in the third phase of the project, experiments and improvements of the preceding phases were taken into account. The City of Toliary is rationally chosen, just like Fokontany selected (Tsianengea, Mahavatse, and Tsimenatse). It’s the biggest Province of Madagascar, but also the worst if we consider all the indicators of development (health, education, housing). The project continues to focus its efforts on the pressing needs of the City and the Fokontany. These needs are for infrastructure essential to the inhabitants: houses, roads and alleys, drinking water, and measures against malaria. The actual start of the project was preceded by organizational restructuring, in particular by the removal of certain functions and the creation of media outlet. Adequate preparations were made for the project. II. Organization and Human resources 1. Organizational structure The project adopts an functional organization (structure) of pyramidal form. There are between 10 and 13 levels. Each of these member is subordinate to one directly above with a slightly broader function, but a related goal. The project serves several Cities and Regions at the same time: Toliary, Fianarantsoa, Antsirabe, Tamatave, Fianarantsoa, Moramanga. The advantages of the organization come from its simplicity, executive efficiency, and stability. It is particularly suited to small companies or companies of average size. The weakness of the functional structure is that it is heavy and slow, especially when applied to big projects to be realized in various localities, such as is the case of HFHM at present. The matrix structure or the organization by geographical territory seem more adapted to the actions of HFHM.
  • 13. [13] 2. Humanresources HFHM employs highly qualified technicians, recruited on the basis of scientific criteria. It is a compact, plain, and interdependent team that carries out a professional life in harmony; generally, it is composed of Christians. Devoted to work in Toliary each week begins with a prayer meeting and a briefing. Devotion and enthusiasm decrease in the consultants when the end of their contract approaches. However, the number of employees of HFHM are insufficient – It is the weak point of the project. In Toliary, and certainly in other Cities, the demand for Houses averages requests per week. But the staff of HFHM is decreasing – construction specialists are unable to make their periodic follow-ups on site. Also, other employees are required to help peers complete their tasks, even if they really have no competence in the domain. The effect is not always positive. The insufficiency of the staff is partially responsible for the slowness and for the low quality of certain parts of the project. 3. Theplanning The HFHM plans the actions to be made during the period when the project is executed, by means of a Chronogram (Graph of Henry GANTT or linear graphic representation). This technical kind of sequencing of the works would not raise of the problem then that it is about works of which we know in advance its dimension as alleys in Pavements or others infrastructures same Water Point. But when it is about the Construction of the House the applicants of which come according to the effects of the very effective Mass communications to Toliary (By Radio, Seminars), we don’t know, in advance how many Houses go we to build, which type and Where? How much mason are we going to mobilize? And who will be in charge (be loaded) of the control of the construction of each of these Houses? In this genre of very complicated problem, especially when the staff(size) of the technical Staff is not enough, the use of a Software of planning and the Monitoring and Evaluation of project is imperative.
  • 14. [14] 4. TheMonitoringandEvaluationSystem(ME) The ME System shows itself under two (2) forms: the periodic sending of a report(of Monitoring, following the progressof the works on Construction sites and the descents on ground. In Toliary, the Specialist under construction manages a data base of all the Work in progress by types; he updates this data base following the progress on ground. To avoid the risks of forgetting the responsible in ME shows on Flipchart posted in the wall the progress the realizations of Houses by Beneficiaries. (See photo below) Photographs are taken and preserved in the base of the data. These photographs show the state of Work progress. In Antananarivo the post of Monitoring and Evaluation is not occupied yet and remains vacant. Strengthenings of capacity regarding Monitoring and Evaluation assisted on Computer, would be advantageous for the project. Figure 1 Flipchart showing the progression of work of the house
  • 15. [15] III. The realization of the project The Assessment of the execution after the organisational reorganization and management can be recapitulated as follows : i. Constructionandorrehabilitationof89 Houses The houses are built in several scattered FKT: Amborogony, Tsimenatse, Ankatsaka, Tseanengea, Anketraka, Tanambao Motombe, Ampasiko, Befanamy (Ankilahila), Betania, Mitsinjo, Antaravoy, Mangambe, Andakoro, Anketa, Andaboly, Tsianaloka, Mahavatse, Besakoa, Camp Caser, Ampasikibo (Ambaiboho), Ambohitsabo and Toliara Center. Situation Numbers envisaged Numbers real Difference % percentage Built and/or rehabilitated houses 89 85 4 95,50 Houses in phase of completion 0 3 3,27 Unfinished house 1 1,12 Tableau 1 Situation of the house construction Figure 2Situation of the houses construction 1 House with Ambalanombikamoa Tsimenatsa II is almost completed, it remains with its recipient to make the tilings. 2 other Houses being in the FKT Ankilahila and in Andaboly are also in phase of completion – It remains with their owners to make the pavements and paintings. 1 another house in Anketa - Bas, is to be rebuilt after its collapse at the time of the passage of the Haruna Cyclone in February 2013; Generally, all those which saw their house finished are content and satisfied. It is family project or a dream which has been just carried out. Satisfactions depend on several 0 20 40 60 80 100 Situation of house construction/rehabilitation Numbers envisaged Real number
  • 16. [16] parameters: when the house is well and by a good mason, within the time envisaged – the recipients are also satisfied when they directed them even the operations of constructions with materials which are appropriate them. The recipients who have financial means are included in this category. Among these people, let us quote the case of Raharivelo Clin, For a long time, He had a dream to build a House behind its place of work in Ampasikibo. He exerts an independent trade. For a long time, He bought Building materials gradually. One day, He attended a campaign of HFH and introduced its file; HFH decides to finance Construction partly. Construction lasted only 20 days, it’s time record. There is part of the recipients who are not satisfied of the quality of the work of the Masons, a few months only after the completion of the house, of the cracks appear on the walls. Figure 3 "Trano vondro", manufacturated out vegetable matter, it is property of Mr. Rafaralahy there Figure 4 A Mason who charged to rebuilt an house destroyed by Cyclone "Haruna" Figure 5 It's here that Mr. Rafaralahy will settle in the next months Figure 6 This house is rebuilt with precaution and attention after its collapse at the passage of the Cyclone Haruna
  • 17. [17] Figure 7 An house HFH/KOICAin the course completion in Ankilahila Figure 8 An house HFH/KOIKAwhich has been just finished in Ankilahila ii. Constructionofthelanesin Pavingstones Fokontany Envisaged Realized Rate of realization in% Tsimenatse II Ambalanombikamoa 259 237,7 91,78 Ambalanombikamoa 156 156 100,00 Tsimenatsa I East 446 346 84.30 Ankatsaka 714,4 714,4 100,00 Tsimenatsa I West 82 67,6 82,44 Mahavatse 342 273,23 78,89 Total 1999,4 1794,93 89,77 Tableau 2 Realization on the cover of the lanes in Paving stones Figure 9 Realization of the cover of the lanes in Paving stones 0 500 1000 1500 2000 Tsimenatse II Ambalanombikamoa Ambalanombikamoa Tsimenatsa I East Ankatsaka Tsimenatsa I West Mahavatse Total Construction of the lanes in paving stones in meter Realized Envisaged
  • 18. [18] iii. Constructionandrehabilitationofthe Water Points FKT New Water Points Water Points renovated Mahavatse Tanambao 1 0 Ambalanombikamoa 1 1 Mahavatse I West 1 1 Mahavatse I East 1 0 Tsimenatse I West 0 2 Tsimenatse I East 0 1 High Ankiambe 1 0 Tanambao Motombe 1 0 Mahavatse II West 0 1 Total 6 6 Tableau 3 Realization in Water Points construction and renovation Figure 10 WaterPoint renovated in Tsimenatse I West Figure 11 New construction of Water point in Tanambao Motombe Figure 12 Waterpoint renavated in Mahavatse IEast Figure 13 New construction of Water point in High Ankiambe
  • 19. [19] Figure 7 Realization in Water Points construction The drinking water supply is a crucial problem of the slum dwellers of Toliary.The project plans to build 6 Borders of new public fountains and to rehabilitate (discharge) 6 others already operational, that is a total of twelve (1). For lack of connecting with the sources) of JIRAMA, three (3) news Water Points are not able of serving the users. The heart of the problem of the inhabitants are not solved yet. 0 1 2 3 4 5 6 Mahavatse Tanambao Ambalanombikamoa Mahavatse I West Mahavatse I East Tsimenatse I West Tsimenatse I East High Ankiambe Tanambao Motombe Mahavatse II West Total Construction and rehabilitation of the Water Points Water Points renovated New Water Points
  • 20. [20] iv. TraininginMaintenanceofinfrastructuresandHygiene It is the corollary of the previous actions, in particular the construction of Houses, Water Points and alleys in pavements. The theme of training concerns the Maintenance of infrastructures and Hygiene - The training took place 04 Mars in Toliary - the beneficiaries association members of Tsianengea and Tsimenatse participated in this training Figure 14 An inhabitant of Tsianengea Shantytown raises the question which the Maintenance of infrastructures for them means. Photograph: HFH Antananarivo Figure 15 Trainers explain to the participants the importance of the Maintenance of the infrastructures and Hygiene.Photograph:: HFH Antananarivo v. DistributionoftheMosquito nets It is the shutter health of the project, its characteristic resides on the free distribution of the Mosquito nets at the recipients of the Houses. It is a contribution to the fight and prevention against Malaria. Each recipient has right of 3 Mosquito nets. 267 Mosquito nets were distributed.
  • 21. [21] IV. Factors affecting the project results Several factors can affect the results of a project. They can be inherent to this one, in this case: we call it internal factors, if they are outer of the project, we call them external factors. These factors can act differently on the results, sometimes positive, sometimes negative. i. Internal factorsaffectingthe project Internal factors affecting the project positively Internal factors affecting the project negatively The reorganization brought to the organization in October 2013 Insufficient manpower The devotion of the employees to work Insufficient materials and equipment The competence of the Technical Staff Insufficient of work permanent control The technical skill of some Masons The cohesion of the group Insufficient implication of the partners: the Urban District and the JIRAMA Company Free distribution of various tools, equipment and materials to the Masons, Bible… Insufficiency of the degree of appropriation of the works carried out at the recipients The relationship between the Recipient and Mason HFH. This last often refuses the order and council of the future owner. A Mason assumes at the same time 2 to 3 Houses: the consequence is reflected on output quality Tableau 4 Internal factors affecting the results of the project ii. External factorsaffectingtheproject External factors affecting the project positively External factors affecting the project negatively The support brought by certain Presidents FKT to persuade the inhabitants to collaborate with the project The political and economic crisis The Haruna Cyclone and its effects The behavior and dealing of the inhabitants who live in the sites which are not integrated in the project Tableau 5 External factors affecting the results of the project
  • 22. [22] iii. Therelevanceofthe project The project is relevant: it is an initiative which answers OMD. So, it is an answer to the social needs for the Toliary City: needs regarding housing, Hygiene and regarding Health. 93.7 %1 of Houses to Toliary are made either wooden, or in sheet steels, vegetable materials which they call "Trano Vondro" - to welcome approximately 6 people (the domestic size to Toliary is 5,3). Besides, regarding main source of water to drink 59.1 % of Toliary people use the river and 37.5 % make recourses to wells without pump not covered. iv. Theefficiencyofthe project The efficiency of the project varies according to shutters: The constructions of alleys in Pavements and the distribution of Mosquito nets to the beneficiaries of Houses, showed the efficiency of the project. Before project, according to the testimony of an inhabitant, the residents of the district have to bring with them a bottle filled with water to wash their shoes or sandals at the exit. of the alleys which were dirty and muddy. The situation is other at present. The Malaria is the second disease which causes most death in Madagascar. Until the contrary proof, mosquito nets stay the most effective way of prevention is the least expensive. On the other hand, until 6 Water Points recently constructed are connected with the sources of the JIRAMA, the shutter: Water Points construction and rehabilitation is not effective. The situation Before and After project, regarding water supply in Fokontany Beneficiaries stays the same. The Water points old rehabilitated remain insufficient in number and the problem in supply of drinking water persists: the inhabitants deposits their cans to reserve a place at 4:30 am of the Morning, the distance separating their places to residence of Water Point vary between 300 in 600 meters; It’s open at 5:30 am or at 6 am in the morning; the flow is very low in Toliara, from Noon till 2 pm, there is a systematic cut of water supply at the present time there. The construction of Houses is partially effective: a House it hard is reassuring, not vulnerable on fires or on any risks of the disasters as Cyclones or floods. The beneficiaries are reported the change of their social status. Several people put down their files and ask every day the HFH Toliary, following in the daytime by the raising sensitizations. However, the absence of uniformity in the forms and the quality of built Houses following the coat of category socio - professional where belonged their owners; the problems bound to the technical skill of Masons used, the quality of Building materials delivered by the Suppliers, 1 Source : INSTAT/DSM/EPM 2004
  • 23. [23] hinder the construction of Houses such as they were initially designed, return the often ineffective project. v. Impacts ofthe project From the social, cultural and public health views, We can admit that the project has positive impacts. The economic impact is not still measurable, because the project has just been finished; so, the beneficiaries are still for the period of repayment in an economic in state of recession. It's the same for the environmental impact of the project, it is necessary that one time ago or events to appreciate the positive or negative impacts of the works built on the environment. vi. Theefficiencyofthe project Référerant on the size of the Staff allocated directly to the project, Staff of HFH Toliary and Antananarivo confused (18 individuals) using equipments and often insufficient materials- allowing them however to execute difficult tasks and complex works, with a satisfactory result of execution, we can admit that the project is efficient. vii. Thedurabilityofthe project The durability of the project in the future is certain, taking into account the nature of outputs: houses hard, alleys in Pavements the life expectancy of which can pass beyond two (2) centuries, Shelters of Water Point built in bricks covered cement. Nevertheless, the effectiveness of this durability will depend widely in the application of a culture of Infrastructures Maintenance of the beneficiaries and the users of the public works. The durability of the experiences of the project will also depend on contribution of the Urban district and Communities decentralized in Maintenance of the public Works. viii. MarketingimagesofHFHand the Donors The HFHM is known in Toliary as Christians NGO - The population of Toliary knows it has through campaign diffused by the local radio and of the seminaries. It is in the environment of construction of House that it’s more known. The Donor of fund, KOICA, is better known at the beneficiary's than in the Population. The informations on this organization are diffused by HFH Toliary during the meeting of sensitivity. So, on the main facade of the constructed Houses are written on a plate their company names and initials.
  • 24. [24] Conclusion In conclusion, the project "Community Mobilization, Infrastructures, Hygiene and Health " reached the majority of the objectives with some difficulties. The other actions planned all was produced as distribution of the Mosquito nets, for the recipients of the Houses; distribution of materials, small tools, equipment, clothing, helmets of protection and Bibles for the masons, - 95.50% of Houses to be built are realized, that is 85/89 ; - 89,77 % of alleys to be covered with Pavements are made, that is 1824,93 meters on 1999,4 meters; - 100 % of shelters of Water Points are rehabilitated and/or built among which 50 % of them are capable serving the users. - 267 Mosquito nets are distributed to all the beneficiaries of Houses, completely built or in the course of finish. The beneficiaries of the infrastructures of Tsianengea and Tsimenatse FKT received training on the Maintenance of infrastructures and Hygiene. The reasons by which the objectives didn’t reach are often ascribable to the partners of HFH, like JIRAMA Company and the Urban District of Toliary. The other causes come from the slowness of the procedure, the insufficiency of Human resources and the maladjustment of the organization to dimension and the compexity of the project. Also, the refusal of certain inhabitants to move their clotures delay the beginnings of work N° The result of project 01 The project achieved all its goals 02 The project reached the majority of its objectives without difficulties 03 The project reached the majority of its objectives with some difficulties  04 The project did not reach the majority of its objectives, but has some positive effects 05 The project did not reach the majority of its objectives and does not have any positive effect 06 The project did not reach any of its objectives, but has some positive effects 07 The project did not reach any of its objectives and does not have any positive effect Tableau 6 The result of project
  • 25. [25] Main recommendations - Strengthen collaborations with the local authorities and companies), NGO by the formal agreements (written documents signed by the partners) planning their respective roles and responsibilities, following their fields of expertise, if the project requires it. - Work more in the relative actions in Drinking water supply - To intensify and reinforce covering. - Try to introduce into the strategies HFH the Marketing of service (The speed and the quality of the services - Adopt an organization answering better the geographical dimension and the extent of the project, by adopting either the matrix structure, or the organization by geographical territory. - Increase the number of the technical staff, to be better adapted to the exponential increase of their tasks and responsibilities. - Endow the project team of the sufficient material equipments and necessary for their daily tasks: rolling stocks, materials (equipments) of reproduction of documents, computing software… - Systematize the strengthening of capacity or the development of skill of the employees of HFH (Training) following the technological evolution and the needs for HFHM. - Include in appendix to DAO the characteristics and technical specificities of the Work to be built with which will be signed their technical obligations and responsibilities. - As soon as possible, establish and apply rational and scientific criteria to the choice of the quality of building materials to be used (quality of raw materials, composition, hardness, degree of drying of wood.). - Establish and outsource a system of PERMANENT CONTROL to any companies or Masons who execute works within the framework of the project HFH. - Try to recruit Landscape painters and Architects among the technical Staff of the project. - Verify and check systematically the quality and the reliability of building materials coming from Suppliers; - Involve the beneficiaries in any purchase of building materials susceptible to engage their financial responsibility. - Relieve any procedures or mechanism susceptible to engender slowness or delays in the execution of a project, without compromising the good management.
  • 26. [26] The lessonsto be learned - Before any launch, estimate the political and social viability of the project. - Give more responsibilities to the other actors or the partners of the project (Urban district of Toliary, JIRAMA…); - An unsolved problem in time, as the delay of an activity for example, can entail a chain of delays susceptible to succeed up to the not achievement of one or several objectives - The Organization and the resources (human, material and technological) remain key factors of success). Best practiceto be duplicated in the future - The free distribution of tools, small materials and equipments, Bible and clothing-work for the Masons; - Development of the cohesion of spirit of the team by the session of the prayer, the working briefing every beginning of the week, the sense of mutual aid and the Sharing…
  • 27. [27] Appendix 1 Matrix of evaluation Criteria of evaluation Question-keys specific Under- questions Méthodes/Outils of data-gathering Indicateurs/Normes of success Methods to analyze the data The attack of the objectives Which are forced havingmarked out its implementation, the learned lessons and the good practices? Which are the effects and impacts awaited and not awaited in relationto the use of the resources which were allocatedto him? Are the products of the results stated in the document of project –they reached? Collections of informationon the realizationof the project (Reports/ratios periodic); semi- directing interviews ofall the persons in charge for the project; Technique of observation Nbr carried out / Nbr Envisaged X100 A number of mosquito nets distributed Numbers exempted Participants of training in Maintenance and hygiene Regrouping of informationin data base, refining of informationand interpretationof the significance of these data bases Effectiveness How the objectives and/or the results they are reached Relevance Le projet répond- il aubesoin régional ? The project meets it the local context, or needs regional? Reference: Milleniumof Development, PCD of ToliaryI, Statistical reports/ratios of the Regional Management ofthe Statistics of Toliary (dwellings, Water, Health... Efficiency Le projet est il efficient Is the use of the resources (human, material and financial) it efficient? Analyze volume of the activities carriedout and the level of the use of funds Comparison betweenthe rate of realizationandthe rate of withdrawal Impacts Quels sont les impacts du projet ? Which is its impact on the recipients from the point ofview social, economic, public health, cultural Investigations into ground near the persons incharge respectifs/Collecte for the official data Nbr réalisé/Nbr Envisaged X100 - a Number of mosquitonets distributed - a Number of the exempted Participants of training in Maintenance and hygiene
  • 28. [28] Appendix 2 Sampling Population (ideal Universe) Staff technical employed by Habitat For Humanity Madagascar, technical leaders and Responsible for the companies having carried out the implementation of the project, the recipients of the project, the Urban District Authorities of Toliara I. Subpopulation (operational Universe) N° Subpopulations Criteria of selection Variable Size 1 Staff technical employed by HFHM Having a direct responsibility with the execution for the project with Toliara Knowledge of the project history Place of employment 4 people 2 Managers of undertaking Execution of the project Role and function within the company To determine 3 Final recipients ofthe project Member of associations of the recipients - resident in the 3 Fokontany -to be chosen since the launching ofthe project - Sexes - Ages - Profession 36 (12 By Fokontany) 4 Indirect recipients To be residentof Fokontany neighbouring while profiting the advantages rising from the built infrastructures To determine 5 Communal authorities To be maker decision - Having a responsibilityin the social affairs and the implementation for the Communal Plan for Development - Function and responsibilitywithin the Commune 2 to 3
  • 29. [29] Appendix 3 Methodology In some lines, the methodological steps that we intend to carry on are developed hereafter: Definitionoftheevaluationcriteria The evaluations criteria are as follows: a) The reaching of the objectives and the results at the end of April 2014; b) The relevance c) The effectiveness d) The efficiency e) The impact Designofa matrixof evaluation The Matrix of evaluation will make it possible to tally, first of all the mission of evaluation in general, according to the terms' of references, then, to synthesize in the form of table, all the question-keys in connections with the above mentioned criteria of evaluation, as well as the short specific questions, the methods / tools for data-gathering, the indicators and standards of successes, finally the methods to analyze the data. Methodsofdata acquisition The various answers to the question-keys of the criteria of evaluation, in particular of the reaching of the objectives/results, relevance, effectiveness, impact and durability, will be obtained starting from the various methods of data acquisition, which will rationally be chosen, according to their natures and their sources. MonitoringandEvaluation (M&E) It is fundamental insofar as it provides us the indicators of performance to measure the progress, particularly the current results facing the expected results ExistingReports/ documents Practically, the majority of information which the criteria of evaluation require, are drawn from the secondary data sources (external or internal): the monograph of area (demographic information , socio-economic, etc), a preliminary photograph draft of the sites; the document of project, agreements of partnership (if, necessary), schedules of conditions on which the Project superintendent must conform to it, periodic reports of Monitoring and Evaluation, evaluation reports to internal semi-course, etc
  • 30. [30] Interviews Also called, primary sources data, it is only by the means of the talks, individual or of groups of 6 to 8 people, directing or semi-directing, as we will obtain information answering the specific questions stated in the Terms of references. The talks are preceded by the sampling of the people to be interviewed (Personal technique of the Project, the recipients of the project, the targets, the local authorities...), the elaboration of the questionnaires (short of all the tools for evaluation). The people to be interviewed could be also, the Advisor-keys and the Panels of Expert, if the mission of Evaluation requires it. Observations on the ground The descent on ground, by the exploitation of the technique of Observation, is the singularity of any informed and conscientious Appraiser of its trade. It will help him to describe as accurately as possible the inventory of fixtures, or to give a photograph of the project to a given moment. Case studies The studies of the cases of the similar projects carried out in other areas or other countries, could be useful during the evaluation of the relevance of the project. The Appraiser must also resort to this method with the purpose of consolidating the good experiments and the lessons drawn from the other projects. Questions about the quality of the data Our strategy consists in improving reliability and the validity of the data bases. To this end, the Appraiser will carry out the: Improvement of the quality of sampling The sample must, be thus selected on the basis of of a reasoning or an aim directly related to the purposes of the evaluation and is supposed to guarantee a precision in the interpretation of the conclusions and the utility of the results of the evaluation. To guarantee the consistency of the gathering of the data By assisting the Appraiser, the data-processing Operator already received a training about the protocols of observation; in order to make sure that they record all their observations in the same way. The meaning of key words used in the questionnaires and the time-tables of the talks, will be checked particularly if they were translated, in order to make sure that the people who are polled understand well what is required of them.
  • 31. [31] Checkingoftheprecisedetails: useof several datasources It is a matter of proceeding: - the use of a mixture of methods to collect information rather than to stick with only one source or only one element. - the cross checking for example the element of a source (such as the Maintenance of group) with another element on the experiments of the people living in rural environment (being able to be a documentary element coming from relationship or of talks with credible advisor-keys and quite informed on the situation). - the calling of experts to examine and validate the facts. Analysis,interpretationandsynthesisofthedata According to the duration and the complexity of the mission of Evaluation, the Appraiser can work out a Plan of analysis. It is the phase which precedes the drafting of the evaluation report. It should be reminded that the analysis of the data is a systematic process for which it is a question of organizing and of classifying the information collected in the form of tables, to summarize them and compare the results with those of the other adequate information in order to extract some deductions being able to answer the questions of the evaluation and its purposes. It makes it possible to the analyst to decipher the facts resulting from a whole of testimonies thanks to a coding and a systematic gathering of the collected data, while taking care to ensure itself of their precision, by carrying out any statistical analysis necessary and while transposing these data on formats or units of analysis related to each question about the evaluation. The analysis of the data seeks to identify models in the facts, either by isolating some significant deductions (analyzes), or by combining sources of information to reach a greater comprehension (synthesis). So the mixture of the methods of evaluation requires a separate analysis of each element and a synthesis of all the sources in order to examine the diagrams, the convergence or complexity
  • 32. [32] Appendix – 4 Questionnaire – 1 Technical Staff HFH Antananarivo Names of the responsible to be interviewed: Functions and roles in the project: Place...................................................... Date and hour:.......................................... 1. When and how the project was identified? 2. To your knowledge was the project in question the purpose of a Preparation (enquiry about the social, economic, public health, demographic....) YES NO In the affirmative, ask the references of the documents 3. To your knowledge,did the project have the purpose of a precondition of a prior evaluation (technical Analysis of feasibility, analyzes of financial feasibility)? YES NOT In the affirmative, to ask the references of the documents 4. were the recommendations put forth in the evaluation report of 2012 followed up by positive and concrete acts? Yes, all were followed up partially without (in case that the response given is partially or without, ask the reasons - Why?) 5. To make the information on the time-table of execution filled out by bringing explanations the gaps Goes back to beginning envisaged (jj/mm/aaaa) real Date of beginning: Différence ; Reasons of the difference: Envisaged date of completion envisaged real Date of completion Différence Reason of the difference: 6. Make the information on the financing of the project filled out Organization 1....................Amount t of the contribution financial Organization 2....................Amount t of the contribution financial Organization 3....................Amount t of the contribution financial Organization 4....................Amount t of the contribution financial Total costs of the project Envisaged real Difference Reasons of the difference: 7. Do the Commune and the recipientscontribute to the financing of the project? YES NOT
  • 33. [33] If Yes, give the percentages of their respective participation: commune Recipients...................................................................... 8. Briefly describe the organization of the project and ONG HFH as a whole? 10.How many workers are mobilized by HFH in Toliary in the execution of project? 11. Is the size of the team of Project, according to you: Normal Insufficient in excess 12. Please appreciate the motivation of the Technical staffof the project as a whole? Extremely motivate Fairly motivate Not motivate 13. Please appreciate the competence of the Technical staff of the Project as a whole? Highly qualified Fairly qualified Inefficient 14.Does the document of preliminary draft comprise a planning of the activities? Yes Not Ask an unspecified related document (operational Planning, Chronogram, Plan of annual work) / _ / 15.Is the organisational structure of the project equipped with a service (function or department) dealing only of the Monitoring and Evaluation? Yes No 16.If Yes, are the Monitoring and Evaluation are systematized (Procedure, standard form of report, periodic descent, etc.) Yes No 17 Were the difficulties encountered, the problems of execution or the delays of executions on ground reported accurately to the Head of project or to the Person in charge for Monitoring and Evaluation? Yes No..................More or less Explain 18 Is – were the reported difficulties encountered, the problems of execution or the delays of executions examined, taken into account and solved after an adequate decision? Always No Seldom If the answer is " no " or " seldom ", describe briefly the reasons of the non application of a corrective decision? / 19. Quote, according to you the Assets of the project, in terms of its management or its execution: - - - -
  • 34. [34] 20. Quote, according to you the Weaknesses of the project (according to your own experiment), in terms of its management or its execution: - - - - 21. Quote, according to your experiments,the influential internal factors positively or negatively the results of the project. A) A Factors internal (but unforeseeable) influencing the results positively - B) Internal factors influencing the results negatively - - - 22. Quote, according to your experiments, the influential external factors positively or negatively the results of the project. A) ,External factors (but unforeseeable) influencing the results positively - - - -B) External factors influencing the results negatively - - - 23. Which data-processing software do you use in the Monitoring, Project management and Evaluation? 24. Did the Project envisage a strategy of perennisation or durability? Yes No If in the affirmative, would you specify which?
  • 35. [35] Appendix 5 – Card-indexes Balance-sheetof execution Recapitulation LOCALITES Construction and/or rehabilitation of the houses Distribution of the mosquito nets in 89 Houses Construction of the lanes in Paving stones Construction of Water Ponits Training of the recipients Fokontany Tsianengea Envisage d Realized Envisag ed Realized Envisaged Realized Envisaged Realized Envisage d Realized Fokontany Tsimenatse Fokontany Tsimenatse Total Rate of realization REMARKSAND OBSERVATIONS
  • 36. [36] Appendix 6 - Balance-sheetof execution – A - FKT Tsianengea N° Contents Observation 01 Construction and/or rehabilitation of houses Number 02 Distribution of mosquito net Number 03 Construction of the lanes in Paving stones Length (m) 04 Construction of Water Points Number 05 Formation des bénéficiaires Number
  • 37. [37] Appendix 7 - Balance-sheetof execution – B- FKT Tsimenatse N° Contents Observation 01 Construction and/or rehabilitation of houses Number 02 Distribution of mosquito net Number 03 Construction of the lanes in Paving stones Length (m) 04 Construction of Water Points Number 05 Formation des bénéficiaires Number
  • 38. [38] Appendix 8 - Balance-sheetof execution – A - FKT Mahavatse N° Contents Observation 01 Construction and/or rehabilitation of houses Number 02 Distribution of mosquito net Number 03 Construction of the lanes in Paving stones Length (m) 04 Construction of Water Points Number 05 Formation des bénéficiaires Number
  • 39. [39] Appendix 9 Questionnaire – Impact – Beneficiaries- Focus Group (Group of 8 A 12 People) Locality and date:............................................................... Hour: ………………… A - Questions to be asked to the final beneficiaries 1. Did you take part or contribute to the identification or the implementation of the project? If so, which was your role? 2. Which trade do you practise? 3. How many people are there in your family (size of household)? 4. Preparatory project, describe the living conditions where your family has lived: - The number of rooms? Did you live with a problem of promiscuity? (Establish the ratio: the amount of household/number of rooms) - are you tenant of a house? If so, how much did you pay monthly? - Or were you lodged by your close or friends? Or a homeless? Do you built yourself your house? Water accessibility? Availability of health facilities? - Were the children provided education ? - Does malaria prevail in the district before? Are there other tropical diseases which prevailed there? If yes, which? - Do you have Savings preparatory project? Roughly, how much per month? - How much per month do you ge, roughly as income? 5. After Project, was the problem of promiscuity solved? explain, how many do you live in the same roof now? (Establish the current ratio: Cut of household per rooms) 6. Is drinking water accessibility now solved? 7. Quid with the schooling of the children? 8. Did you receive Mosquito nets? Do you use it? 9. was the problem of malaria in the district clearly improved (Statistical epidemiologic to be checked, if possible, at the closest CSB where the recipients frequented in case of epidemic of malaria) 10. Do you currently have Savings or are they improved? 11. How much per month do you receive roughly as income? (analyze the difference Before and After project)
  • 40. [40] 12. Give your opinions on the and impact and the effect of the project? (Compared to your former way of life) 13. Did you profit from a training on Maintenance of the work, the dwelling and hygiene? 14. How do you find the training? Did you already put it into practice? 15. Do you know how the organization which finances this project is? 16. How is the ONG which carries out this project called? 17. How to recognize them? Describe their respective logos B - Specific questions, indirect recipients of the project (non members of associations of the recipients) 18.Which feeling do you express the works built (Lanes in Paving stones, water Points, discharge culverts of worn water) within the project HFH, in which you enjoy and get advantages and interests, as well as the direct recipients in the Fokontany? 19.Is there no frustration,rivalry or litigation betweenyou the direct recipients and the indirect recipients who enjoy the advantages through the project in the everyday life? 20.If in the affirmative, how to solve them? Would not you attempt to organize yourself one day, to take similar initiatives in order to solve the problems of home, of water supply, traffic, hygiene and public health? a) 4 Highlight in a few words the difference of the advantages and interests between you and the associations of the final recipients. 21.Do you know what the organization which finances this project in Fokontany Tsianengea, Tsimenatse and Mahavatse is? 22.How is the ONG which carries out this project called? 23.How to recognize them? Describe their respective logos? Put the questions 22, 23 and 24 to a sample of the inhabitants of the Fokontany neighbouring, randomly taken and with multivariable: (sex, age, social and economic category). Record the good and the bad answers.
  • 41. [41] Appendix 10 - Questionnaire HFH Toliary 1. How does your Communication with the local Partners of HFH appear? a) With the local Authorities and politicians of the region Good Average Bad Sometimes good sometimes bad Explain? b) With the firms Good average bad sometimes good sometimes bad Explain? c) With the Final recipients (members of the associations of the recipients) Good average bad sometimes good sometimes bad Explain? 2. Briefly describe your role, function, attributions and extent of your responsibilities in the execution for the project? - - 3. Do the titular firms designed to execute some tasks respect their engagements to HFH? Yes No......................... Rarely Explain? 4. Are there casesin which the execution of one or more activities are late or in update?
  • 42. [42] Yes Rarement Frequently Explain, which are the reasons? 5. Were the recorded lost time of executions made up? Yes No How? 6-. Who controls the completion of the work? - - 7. How many works are finished officially? a) Temporarily Fkt Tsianengea: - House: - Water Points - Lanes in Paving stones: -- Mosquito nets distributed Fkt Tsimenatse - House: - Water Points - Lanes in Paving stones: -- Mosquito nets distributed Fkt Mahavatse - House: - Water Points - Lanes in Paving stones: -- Mosquito nets distributed b) Definitively Fkt Tsianengea: House: - Water Points - Lanes in Paving stones: -- Mosquito nets distributed Fkt Tsimenatse House: - Water Points - Lanes in Paving stones: -- Mosquito nets distributed Fkt Mahavatse - House: - Water Points - Lanes in Paving stones: -- Mosquito nets distributed
  • 43. [43] 8.What are the assets of the project, which should be maintained or to develop more? According to your experiments on ground - - 9. Which are the weaknesses and difficultiesencountered during the execution of the project? (Relational, administrative, financial, material, competence of RH employed...) - -
  • 44. [44] Appendix 11 Questionnaire municipal Authority of Toliary I (Mayor or PDS and DSAS) 1.Does the CUT lay a Communal Plan of Development? Yes No If Yes, is it operational? 2.How do you see the initiative of HFH in the Shantytowns of the 3 Fokontany of Toliary? - - - - - - Does the CUT have a budget allocated for the Maintenance of public works? Yes No If Yes, till how much does it rise? Till how much does the annual budget of the CUT approved by the Town council rise? 3.Does the CUT lay out a strategy having for purpose to develop and maintain the works, services and goods left by the Projects initiated by various ONG after their completion?
  • 45. [45] Appendix 12 Lists interviewed people -Haja Mamiharijaona Ramerison, Program Manager, Hfh Antananarivo - AZOELISOLOMIHANTA Volatiana Livanirina, Resources Development and communication Manager, HFH Antananarivo - Ravotovelson Mamisoa Hubert, Consulting in Covering, HFF Toliary - Ramamonjisoa Cerice Gaustin, Consulting in Covering, HFH Toliary - Razafindrambola Adrien, Consulting Specialist Construction - Rasoanantenaina Simonette, Socio-Organizing, Hfh Toliary -Tinanomendranahary Luciana Danella, Socio-Organizing, Hfh Toliary - Rambeloson Thierry, Consulting Cs, Hfh Toliary - Mampionotsihoaly Patric, Consultant Hao, Hfh Toliary - Dr. Fiacre Hatimo, Mayor of the Urban District Toliara - Perfect, Assistant Emampo - Fokontany Head, Tsianengea - Robin, Member of the Committee of Fokontany Tsianengea - Zo Chef of building site, Fenitra Firm, - Faly, Head of Building site, Fenitra Firm, - Niry, Manager of the Fenitra firm, - Manjato, Mason, Undertaken Fanilo - Rado, Head of Building site, Fanilo Firm - Solonjatovo José Ralaro, Mason Hfh, Ampasikibo - Ambahiboho - Léandre Fidison, Operation, Ampasikibo - Ambahiboho - Mrs. Lazaikely Patrice, Profit House, Ampasikibo – Ambahiboho - Christian, President of Fokontany – Ankatsaka - Dino, Mason – Ankilahila Befanamy - Justin, Mason - Ankilahila Befanamy; - Celine Sitony, Recipient; - Lala Jean Baptiste, Recipient - Basile, Recipient; - Rakoromamonjisoa Barijaona, Recipient - Christel Role, Recipient - Novasoa Berthine, Recipient - Leky, Recipient - Mouslah Hazam, Recipient - Arthur, Member of the Committee of Fokontany - Ramilasoa, Head of Village, recipient - Etitatse, Assistant Fokontany, Recipient - Raharivelo Clim, Ampasikibo, Recipient - Farez, Andrimasom-pokonolona, nonprofit - Christelle, Ankatsaka, nonprofit
  • 46. [46] Appendix 13 – visited Sites - Hfh Antananarivo - Hfh Toliary – Roadway system - Toliary Town hall - Mahavatse Tanambao - Ambalanombikamoa - Mahavatse I West - Mahavatse I Is - Tsimenatse I West - Tsimenatse I Is - High Ankiambe - Tanambao Motombe - Mahavatse II West - Ankilahila - Ambahiboho - Andaboly Appendix 14 - Quoted work Ministry of Economy, Finances and Budget - Secretary general. PERIODIC ENQUIRY INTO THE HOUSEHOLD 2004. Report of the anquiry Socio- demographic, healthand economic, Antananarivo: Instat,January 2006. Appendix 16 - DECLARATION OF THE RESPECT OF THE ETHICS I, undersigned, Rakoto Yvon Namelankafatra - Consultant in Evaluation, declares that the Retrospective appraisal and external Project " Community Mobilization, Infrastructures, Hygiene and Healthin the Shantytowns of Toliary ", is carried out in the respect of the Ethics of the Evaluation. In this respect, the Evaluation is made with independence, impartiality,honesty, integrity,responsibility,confidentiality and transparency; any conflict of interest enters the interviewed people was avoided. The team had not saved her efforts so that the reports and the presentations of evaluation are precise, complete and reliable. Antananarivo, April 14 2014 Rakoto Yvon Namelankafatra
  • 47. [47]