Transparency, Recognition and the role of eSealing - Ildiko Mazar and Koen No...
Doing School-Based Research in Sub-Saharan Africa: Practical Issues, Ethical Challenges, and Mitigation Strategies
1. Doing school-based research in Sub-Saharan
Africa: practical issues, ethical challenges,
and mitigation strategies
CIES Conference
April 17, 2019
2. Why a session on fieldwork?
Nature of TTT study
- Multi-country and multi-site
design
- Qualitative methodology (IDIs,
FGDs, non-participant observation)
- School-based data collection
- Under-aged participants
Contextual challenges
- Developing settings
- Conflict-affected regions
- Climatic, geographic and cultural
specificities
7. Gaining Access to Schools
Challenge
Gatekeepers denying access
Study seen as inquisitive
Survey fatigue
Suspicion towards outsiders
Response
Introductory letter by MoE (REOs/DEOs and HTs)
Village chiefs informed verbally (by DEOs)
School visits prior to data collection
8. Gaining trust & eliciting participation
Challenge
Teachers unwilling to participate
or answer truthfully
Response
Explain study objectives & costs
and benefits of participation (no
material rewards)
Stress principles of privacy,
confidentiality, consent
Avoid use of negatively charged
terminology (e.g. absenteeism,
sanctioning, etc.)
9. Clearing up misconceptions & managing expectations
• Rwanda (public, rural school):
• Former headteacher accused of corruption and temporarily removed;
• Enumerators perceived as audit officers;
• Teachers hesitant to share information thinking an investigation was
going on
• South Sudan (public, urban school):
• Enumerators perceived as school inspectors;
• Teachers asked enumerators for feedback
• Uganda (public, rural school):
• Expectation that the study would result in fast interventions
10. Instrument administration
Challenge
Lack of spaces that ensured privacy and confidentiality
Constant interruptions
Non-participant curiosity
Noise (e.g. from ongoing road traffic, during lunch
breaks, etc.)
Response
Puntland: Some field teams resorted to nearby mosques
to conduct FGDs/IDIs
Uganda, Tanzania: Some interviews conducted in
residential homes or at night
Comoros, Rwanda: Surveyors placed outside of
classrooms/management offices to monitor entry
11. Avoiding selection bias
Challenge
Teachers attempting to interfere with selection of students for the FGDs
HTs attempting to influence the selection of teachers for the IDIs
EDU officials nominating themselves for participation in the study
Response
Enumerators explaining the selection process and rationale;
Interviewing multiple individuals (targeted and volunteer) or organizing
small FGDs
12. Managing unforeseen events
Challenge: Changing conflict dynamics
South Sudan: conflict suddenly erupted in Maban county (July 2018)
Response
Security assessment & sample adjustment
Data collection sites relocated to Renk County
Challenge: Unreliable school data
South Sudan: Targeted schools closed or non-existent
Response
Back up schools (with similar characteristics) selected in all targeted states
and paymas
13. Terrain and Climate
Challenge
Delays in fieldwork due to remoteness, poor
infrastructure & weather conditions
Rwanda, Kenya: Moderators walked to reach schools
& relied on locals to locate schools
Puntland, Rwanda: Recording of interviews difficult
when it rained (too noisy)
Puntland, N. Kenya: Data collection impossible in
the afternoon (too hot)
Response
Fieldwork avoided during rainy season (when possible)
When delays inevitable, schools and DEOs informed
School location geotagged and stored prior to travel
Interviews/FGDs conducted in the evening/early
morning or when rain subsided.
14. Cultural specificities
Challenge: Verbal and non-verbal communication (Comoros)
Respondents took exceptionally long pauses when speaking (very common in Comoros)
Moderators interrupted participants several times (perceived as disrespectful)
Response
Field team sensitized on pauses
Eye contact used to verify that a participant has finished talking
Challenge: Religious practices (N. Kenya, Comoros)
Delays in starting interviews and FGDs on Fridays
Response
Adjust fieldwork plan
Moderators kept busy with observations around the school until participants were done
with Friday prayers
15. Surveyors’ safety & well-being
Strains during fieldwork
Remoteness and poor infrastructure (roads, signs, internet)
Unsuitable accommodation / insufficient commercial activity
Fatigue (long working hours, excessive heat, etc.)
Emotional distress (narratives/images of poverty and abuse)
Management strategy
Improve field supplies (maps, food and drink, mosquito nets, power
banks, etc.)
Introduce free days & lunch and tea breaks
Daily debriefings with team leader
Follow ups with heads of schools and community leaders
17. Giving back
Challenge
School administrations expressed fatigue
over continuous assessments (INGOs,
NGOs and UN) that rarely feedback and
bear little fruit
Teachers wanted to know how they could
find out whether their contribution made a
difference
Response
Contact details of research team shared
with all participants
National dissemination plan includes
delivering simplified summaries of
findings to participating schools
Rationale for including a presentation on the practical and ethical challenges of TTT fieldwork:
Complexity: TTT is a complex project that entails data collection in multiple countries and sites (within each country) organization of data collection activities and field logistics are often challenging.
Type of methods used: TTT relies heavily on ethnographic methods which typically involve close interaction between researchers and participants interviewer-interviewee dynamics can be tricky and give rise to ethical concerns.
Research ethics are especially important considering that most TTT data collection activities take place within schools and sometimes involves under-aged participants (students) as well as alternative vulnerable groups like refugees and minorities.
SSA in general and the ESA region in particular can pause several challenges (mostly practical) to qualitative researchers, primarily due to poor infrastructure, harsh terrain and climatic conditions (extreme heat as well as heavy seasonal rainfall). Communal and intra-state conflict can also occur in some countries in the region (S. Sudan, Puntland) which may put enumerators and respondents directly at risk.
Structure of presentation (3 parts)
Before fieldwork: Steps the research team took to pre-empt as many potential challenges as possible.
During fieldwork: Actual challenges field teams faced and mitigation/management strategies followed.
After fieldwork: What to do once fieldwork is over
Fieldwork did not start before:
A detailed fieldwork plan was drafted, specifying visitation sites and dates, number of enumerators per site, travel days and order of data collection activities in each sampled country, locality and school.
All field teams (enumerators/moderators, supervisor and the team leader) were trained on instrument administration and research ethics, especially on the ethical principles and practical requirements of collecting unbiased empirical data in a manner that protects study participants (see next slide for key ethical principles the team tried to uphold during data collection – enumerators were sensitized on them and taught techniques on how to collect data according to UNICEF’s ethical standards and international best practices for ethical research)
A pilot was conducted in each country (in one or two schools per country) to ensure the feasibility of the fieldwork plan and the suitability of the research instruments. The pilot was also an opportunity for the field teams to recognize linguistic, cultural and other contextual specificities and prepare accordingly.
The research team requested and received ethical approval for its fieldwork plan and research tools both nationally (National ethics review boards) and internationally (international research ethics board in DC) .
Do no harm: Apart from its obvious content (ensure physical and psychological safety of participants) within the TTT framework this principle also entails causing as little disruption to normal school life as possible and ensuring that research activities (at the school level) do not undermine the learning process.
Voluntary participation: No individual was forced to participate to the study – participants could also leave at any point they wanted (e.g. before an interview or a FGD had ended)
Informed consent: A consent form was presented to and signed by all participants. For pupil participants consent was sought and provided by the school teacher.
All participants had the right to withdraw their consent (even when previously offered) and ask that their testimonies were discarded.
DEOs, HTs, and village chiefs sometimes denied access to schools as study was perceived as inquisitive and threatening. Also, in some contexts, like Puntland, local stakeholders expressed survey fatigue from continuous assessments, especially from outsiders.
- In most countries, the MoE formally communicated in writing with regional education officials and HTs prior to the commencement of the fieldwork, informing them about the study and urging a close collaboration with the study team. This increased the sense of national ownership over the study and its findings, and significantly contributed to the smooth and timely implementation of the study across districts and schools.
- Given that the literacy levels of village chiefs is most cases were too low to be able to read any letter, when necessary, village chiefs were informed by DEOs.
- Enumerators also visited schools a day prior to data collection to speak with school staff, explain the objectives of the study, and dispel any concerns.
No material rewards offered to participants, only snacks and refreshments to teachers taking the survey and pupils participating in the FGDs.
Rationale: Participation voluntary on the basis of understanding potential future benefits (e.g. improving teacher working conditions).
Examples of common misconceptions RE the nature/objective of the study and the identity/role of enumerators.
Misconceptions were cleared up through a truthful and realistic presentation of the team, the study, and its objectives.
First point: Teachers usually nominated class prefects on the basis that they were more eloquent. Occasionally they also tried to coach pupils.
Last point: This was done to avoid unnecessary conflict. See for examples this excerpt from the Sudan fieldwork report.
“The initial target was the director for Quality Promotion. The Director for Alternative Education, however, selected himself to be interviewed. The enumerators decided to interview both individuals to avoid conflict”.
Excerpts from fieldwork reports, explaining the above:
RWANDA: Some of the schools were located in very remote mountainous villages especially in the western and the northern provinces to the extent that some schools did not have access to roads that reach them which necessitated the data collectors to walk on foot. Even though this did not affect the data collection exercise, there were some delays to reach schools. Communication would be made with the respective schools to alert them ahead of time.
KENYA: El-Adow Primary School located in a very remote area where even access to telecommunication network was a problem. The team used a local they met along the way to guide them to the school since even Google maps could not locate the school because the area did not have network connection.
Rwanda: The field exercise took place during the rainy season and sometimes it rained during interviews and this sometimes affected the quality of the recording. However, when the rain was too much, the team asked the respondents to be patient and wait until the rain subsided (Rwanda)
Kenya: Heavy downpour made it difficult to proceed and record the interviews forcing the team to postpone data collection occasionally
Puntland: Some teams (team 2 and 3) were obstructed by heavy rains – team 3 was stranded in a rural remote area for almost 12 hours due to flooding. The effect of drought was also prevalent in most districts visited, specifically rural, which had adverse implications on peoples’ livelihoods and behaviors.
South Sudan: Long distance and flood (see in the pic enumerator wondering the accessibility to school in Aweil State). Fear is that enumerators would just sit down and prepared their result.. Requesting pictures as proof that fieldwork did take place.
Most field teams recruited locally, but cultural divides still emerged!
Only exception (to local recruitment): Comoros (some members of the field team, including the team leader, were from Mauritius)
Examples:
Comoros: “On visits planned on Fridays, the field team had to cater for prayer times for boys. In Comoros, it is usual for boys to have time off to attend the special Friday prayer at 1pm. This has led to disruptions in the field planning, delaying data collection for those schools.”
E.g. in COMOROS: “Ngazidja, the main island of Comoros, is relatively well equipped in terms of infrastructure. However, when the field team moved to Anjouan and Moheli, there were many logistics issues faced which caused major delays in the progress of transcripts, notably the frequency electricity cuts which paralysed the islands”
In RWANDA: “Some selected schools are located in remote areas. In some cases, the field teams were unaware of the social environment and were caught in a school without any food or drinking water. In the surrounding community, there were no commercial activity and this meant that the team had to spend the day in a school without adequate food and drink”
Follow ups with heads of school on issues of abuse reported by children, who narrated instances of abuse but did not provide consent for official investigation.
Contact details of TTT PI and coordinator (Dom and Despina) as well as of the local team lead were written on the consent form (a copy was given to all participants).
Participants can call or email the team to inquire about the progress of the study and its key findings or to withdraw their consent and ask that their testimony is discarded.