This document provides an overview of research design methodology, including different types of research methods, data collection approaches, and frequently asked questions. It discusses quantitative, qualitative, and mixed methods approaches. Specifically, it describes structured surveys, semi-structured discussions, observations, and sequential or concurrent mixed methods. Considerations for selecting a methodology include the research objectives, available time and resources, and required scope and quality of findings. The document aims to help researchers design a methodology that effectively addresses their research questions.
Qualitative & Quantitative Research Methods.docxSobiaAlvi
Content List
Topic: Concept of Qualitative & Quantitative Research Design
1. Quantitative Research
2. Qualitative Research
Topic: Comparison of Qualitative & Quantitative Research
1. Qualitative Vs. Quantitative Research – A Comparison
References
a) Research in subject/discipline
b) Methods of data collection in the subject
c) Drawing conclusion, generalization and theory development
d) Preparing reference, notes and bibliography
Difference Between Qualitative and Quantitative Research.docxzekfeker
Literature search tools Zekarias Tilaye
Hints:
These tools help researchers to find and collect relevant scholarly literature, such as
academic journals, books, and conference proceedings. Some examples of literature
search tools include Google Scholar, PubMed, and Scopus.
Therefore, please provide us with clear information on this topic.
Concept of Qualitative and Quantitative Research Design.pptxSobiaAlvi
Topic: Concept of Qualitative and Quantitative Research Design
Content List
1. Quantitative Research Design
Definition
What is Quantitative Research
Characteristics of Quantitative Research
Quantitative Research: Key Advantages
Quantitative Research Methodology
7 Best Practices to Conduct Quantitative Research
Basic Research Design for Quantitative Studies
Strengths of Using Quantitative Methods
Limitations of Using Quantitative Methods
2. Qualitative research design
Definition
What is Qualitative Research?
Characteristics of Qualitative Research
Three Key Elements of Qualitative Research
Quantitative Research: Key Advantages
Basic Research Design for Qualitative Studies
Strengths of Using Qualitative Methods
Limitations of Using Qualitative Methods
5 Key Types of Qualitative Research
Qualitative Research Methods: The Top 4 Techniques
Qualitative Research Best Practices
References
https://libguides.usc.edu/writingguide/quantitative#:~:text=Quantitative%20research%20deals%20in%20numbers,%2C%20free%2Dflowing%20manner%5D
https://www.scribbr.com/methodology/qualitative-quantitative-research/
https://www.enago.com/academy/qualitative-vs-quantitative-research/
https://www.investopedia.com/terms/q/quantitativeanalysis.asp
https://ideascale.com/blog/what-is-quantitative-research/
https://ideascale.com/blog/what-is-qualitative-research/
Qualitative & Quantitative Research Methods.docxSobiaAlvi
Content List
Topic: Concept of Qualitative & Quantitative Research Design
1. Quantitative Research
2. Qualitative Research
Topic: Comparison of Qualitative & Quantitative Research
1. Qualitative Vs. Quantitative Research – A Comparison
References
a) Research in subject/discipline
b) Methods of data collection in the subject
c) Drawing conclusion, generalization and theory development
d) Preparing reference, notes and bibliography
Difference Between Qualitative and Quantitative Research.docxzekfeker
Literature search tools Zekarias Tilaye
Hints:
These tools help researchers to find and collect relevant scholarly literature, such as
academic journals, books, and conference proceedings. Some examples of literature
search tools include Google Scholar, PubMed, and Scopus.
Therefore, please provide us with clear information on this topic.
Concept of Qualitative and Quantitative Research Design.pptxSobiaAlvi
Topic: Concept of Qualitative and Quantitative Research Design
Content List
1. Quantitative Research Design
Definition
What is Quantitative Research
Characteristics of Quantitative Research
Quantitative Research: Key Advantages
Quantitative Research Methodology
7 Best Practices to Conduct Quantitative Research
Basic Research Design for Quantitative Studies
Strengths of Using Quantitative Methods
Limitations of Using Quantitative Methods
2. Qualitative research design
Definition
What is Qualitative Research?
Characteristics of Qualitative Research
Three Key Elements of Qualitative Research
Quantitative Research: Key Advantages
Basic Research Design for Qualitative Studies
Strengths of Using Qualitative Methods
Limitations of Using Qualitative Methods
5 Key Types of Qualitative Research
Qualitative Research Methods: The Top 4 Techniques
Qualitative Research Best Practices
References
https://libguides.usc.edu/writingguide/quantitative#:~:text=Quantitative%20research%20deals%20in%20numbers,%2C%20free%2Dflowing%20manner%5D
https://www.scribbr.com/methodology/qualitative-quantitative-research/
https://www.enago.com/academy/qualitative-vs-quantitative-research/
https://www.investopedia.com/terms/q/quantitativeanalysis.asp
https://ideascale.com/blog/what-is-quantitative-research/
https://ideascale.com/blog/what-is-qualitative-research/
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdfTechSoup
In this webinar you will learn how your organization can access TechSoup's wide variety of product discount and donation programs. From hardware to software, we'll give you a tour of the tools available to help your nonprofit with productivity, collaboration, financial management, donor tracking, security, and more.
Embracing GenAI - A Strategic ImperativePeter Windle
Artificial Intelligence (AI) technologies such as Generative AI, Image Generators and Large Language Models have had a dramatic impact on teaching, learning and assessment over the past 18 months. The most immediate threat AI posed was to Academic Integrity with Higher Education Institutes (HEIs) focusing their efforts on combating the use of GenAI in assessment. Guidelines were developed for staff and students, policies put in place too. Innovative educators have forged paths in the use of Generative AI for teaching, learning and assessments leading to pockets of transformation springing up across HEIs, often with little or no top-down guidance, support or direction.
This Gasta posits a strategic approach to integrating AI into HEIs to prepare staff, students and the curriculum for an evolving world and workplace. We will highlight the advantages of working with these technologies beyond the realm of teaching, learning and assessment by considering prompt engineering skills, industry impact, curriculum changes, and the need for staff upskilling. In contrast, not engaging strategically with Generative AI poses risks, including falling behind peers, missed opportunities and failing to ensure our graduates remain employable. The rapid evolution of AI technologies necessitates a proactive and strategic approach if we are to remain relevant.
Synthetic Fiber Construction in lab .pptxPavel ( NSTU)
Synthetic fiber production is a fascinating and complex field that blends chemistry, engineering, and environmental science. By understanding these aspects, students can gain a comprehensive view of synthetic fiber production, its impact on society and the environment, and the potential for future innovations. Synthetic fibers play a crucial role in modern society, impacting various aspects of daily life, industry, and the environment. ynthetic fibers are integral to modern life, offering a range of benefits from cost-effectiveness and versatility to innovative applications and performance characteristics. While they pose environmental challenges, ongoing research and development aim to create more sustainable and eco-friendly alternatives. Understanding the importance of synthetic fibers helps in appreciating their role in the economy, industry, and daily life, while also emphasizing the need for sustainable practices and innovation.
Francesca Gottschalk - How can education support child empowerment.pptxEduSkills OECD
Francesca Gottschalk from the OECD’s Centre for Educational Research and Innovation presents at the Ask an Expert Webinar: How can education support child empowerment?
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...Levi Shapiro
Letter from the Congress of the United States regarding Anti-Semitism sent June 3rd to MIT President Sally Kornbluth, MIT Corp Chair, Mark Gorenberg
Dear Dr. Kornbluth and Mr. Gorenberg,
The US House of Representatives is deeply concerned by ongoing and pervasive acts of antisemitic
harassment and intimidation at the Massachusetts Institute of Technology (MIT). Failing to act decisively to ensure a safe learning environment for all students would be a grave dereliction of your responsibilities as President of MIT and Chair of the MIT Corporation.
This Congress will not stand idly by and allow an environment hostile to Jewish students to persist. The House believes that your institution is in violation of Title VI of the Civil Rights Act, and the inability or
unwillingness to rectify this violation through action requires accountability.
Postsecondary education is a unique opportunity for students to learn and have their ideas and beliefs challenged. However, universities receiving hundreds of millions of federal funds annually have denied
students that opportunity and have been hijacked to become venues for the promotion of terrorism, antisemitic harassment and intimidation, unlawful encampments, and in some cases, assaults and riots.
The House of Representatives will not countenance the use of federal funds to indoctrinate students into hateful, antisemitic, anti-American supporters of terrorism. Investigations into campus antisemitism by the Committee on Education and the Workforce and the Committee on Ways and Means have been expanded into a Congress-wide probe across all relevant jurisdictions to address this national crisis. The undersigned Committees will conduct oversight into the use of federal funds at MIT and its learning environment under authorities granted to each Committee.
• The Committee on Education and the Workforce has been investigating your institution since December 7, 2023. The Committee has broad jurisdiction over postsecondary education, including its compliance with Title VI of the Civil Rights Act, campus safety concerns over disruptions to the learning environment, and the awarding of federal student aid under the Higher Education Act.
• The Committee on Oversight and Accountability is investigating the sources of funding and other support flowing to groups espousing pro-Hamas propaganda and engaged in antisemitic harassment and intimidation of students. The Committee on Oversight and Accountability is the principal oversight committee of the US House of Representatives and has broad authority to investigate “any matter” at “any time” under House Rule X.
• The Committee on Ways and Means has been investigating several universities since November 15, 2023, when the Committee held a hearing entitled From Ivory Towers to Dark Corners: Investigating the Nexus Between Antisemitism, Tax-Exempt Universities, and Terror Financing. The Committee followed the hearing with letters to those institutions on January 10, 202
A Strategic Approach: GenAI in EducationPeter Windle
Artificial Intelligence (AI) technologies such as Generative AI, Image Generators and Large Language Models have had a dramatic impact on teaching, learning and assessment over the past 18 months. The most immediate threat AI posed was to Academic Integrity with Higher Education Institutes (HEIs) focusing their efforts on combating the use of GenAI in assessment. Guidelines were developed for staff and students, policies put in place too. Innovative educators have forged paths in the use of Generative AI for teaching, learning and assessments leading to pockets of transformation springing up across HEIs, often with little or no top-down guidance, support or direction.
This Gasta posits a strategic approach to integrating AI into HEIs to prepare staff, students and the curriculum for an evolving world and workplace. We will highlight the advantages of working with these technologies beyond the realm of teaching, learning and assessment by considering prompt engineering skills, industry impact, curriculum changes, and the need for staff upskilling. In contrast, not engaging strategically with Generative AI poses risks, including falling behind peers, missed opportunities and failing to ensure our graduates remain employable. The rapid evolution of AI technologies necessitates a proactive and strategic approach if we are to remain relevant.
Read| The latest issue of The Challenger is here! We are thrilled to announce that our school paper has qualified for the NATIONAL SCHOOLS PRESS CONFERENCE (NSPC) 2024. Thank you for your unwavering support and trust. Dive into the stories that made us stand out!
Operation “Blue Star” is the only event in the history of Independent India where the state went into war with its own people. Even after about 40 years it is not clear if it was culmination of states anger over people of the region, a political game of power or start of dictatorial chapter in the democratic setup.
The people of Punjab felt alienated from main stream due to denial of their just demands during a long democratic struggle since independence. As it happen all over the word, it led to militant struggle with great loss of lives of military, police and civilian personnel. Killing of Indira Gandhi and massacre of innocent Sikhs in Delhi and other India cities was also associated with this movement.
Introduction to AI for Nonprofits with Tapp NetworkTechSoup
Dive into the world of AI! Experts Jon Hill and Tareq Monaur will guide you through AI's role in enhancing nonprofit websites and basic marketing strategies, making it easy to understand and apply.
3. Session
Contents
1. Overview of research methods
2. Distinction between quantitative
& qualitative research
3. Types & applicability of different
research methods
4. Q&A
5. Research methodology
The methodology is an outline of the overall data collection and analysis strategy that
will be used to implement the research cycle
The methodology should:
Be compatible with the preliminary data analysis plan
Be designed in a way that ensures the intended scope of the research (i.e. objectives and
research questions) can be feasibly achieved to the required quality, given the time,
resources and access available
Designing a methodology involves three key components:
Selecting the overall research method
Selecting the appropriate data collection approach(es)
Designing the sampling strategy
Our focus for today!
6. Categories of research methods
Research methods are broadly distinguished between the following categories:
Quantitative
Measure prevalence of
issues, verify hypotheses
and establish causal
relations between
variables
Large samples,
structured data collection,
and predominantly
deductive analysis
Qualitative
Explore and discover
themes, develop
theories, rather than verify
hypotheses and measure
occurrences
Smaller samples, semi-
structured data collection,
inductive analysis
Mixed Methods
Combines both
qualitative and
quantitative to (1) collect
and analyse both types of
data and (2) use both
approaches in tandem
8. Selecting your research method
What factors to consider when choosing one research method over another?
Overall applicability to meet research objectives
Time i.e. key planning and decision-making milestones to inform
Resources available
Material resources
Financial resources
Human resources
Access to population of interest
10. Differences between quantitative & qualitative research
The distinction between quantitative and qualitative research is not always as clear-cut:
Individual and household surveys
o Commonly associated with quantitative, large sample research
o Could also be used for a qualitative case study
Key Informant interviews and community discussions
o Commonly associated with qualitative, semi-structured data collection & analysis
o Could also be used for quantitative data collection & analysis where time and resources do not
allow a large, representative sample
Focus Group Discussions
o Perhaps the most distinctly qualitative research method, always administered using a semi-
structured data collection tool
o Often analysed using content analysis i.e. a somewhat quantitative approach counting the
number of times a theme or set of words appear with the discussion transcripts
o This content analysis can then inform the more in-depth qualitative analysis.
11. Differences between quantitative & qualitative research
Distinction between the two can be made based on the following three criteria:
Quantitative Qualitative
1. Type of data collection Structured, close-ended data
collection tools
Semi-structured (but not
unstructured) data collection tools
2. Type of analysis Measuring prevalence,
quantifying issues, and
primarily involves deductive
analysis
Exploratory, and primarily involves
inductive analysis
3. Type of sampling strategy Can use both probability or
non-probability sampling
generalisation to the wider
population possible
Non-probability sampling
generalisation to the wider population
not possible
13. Types of research methods (1)
Category Type of research
methods
Description When to use this method
Quantitative Structured, probability
sampling/ census
Structured, close-ended data
collection;
Quantitative analysis;
Data collected from a census or
through large samples, with
sample size calculated based on
probability theory
To measure prevalence and make
generalizable claims,
To conduct deductive analysis
(relationship tests, verify hypothesis)
To identify key factors that influence a
particular outcome or understand the best
predictors of a specific outcome
Quantitative Structured, non-
probability sampling
Structured, close-ended data
collection;
Quantitative analysis;
Can be small or large sizes; non-
probability sampling
To measure prevalence (indicative only)
but contextual and/ or logistical
constraints do not allow for large,
repressentative samples
To draw indicative inferences from a
sample to a population
14. Types of research methods (2)
Category Type of research
methods
Description When to use this method
Qualitative Semi-structured, non-
probability sampling
Semi-structured data collection;
Qualitative analysis;
Relatively small sample sizes;
non-probability sampling
No measurement of prevalence or
verification of hypothesis needed;
No or limited prior understanding of the
situation to be studied and the specific
variables to be assessed;
To conduct inductive analysis i.e.
explore and develop a theory or pattern
of meaning, based on experiences,
observations and perspectives of the
situation being studied
Mixed
Methods
N/A Combines both qualitative and
quantitative methods, both in
terms of collecting and analyzing
both types of data but also using
both in tandem to enhance the
overall strength of the study
Quantitative or qualitative methods by
themselves inadequate to understand
the research problem;
To use all methods possible to obtain an
in-depth, comprehensive understanding
of the research problem.
15. The most powerful research method?
Mixed methods research – if time, access, resources allow!
Common misnomer that quantitative research is the strongest – not always!
Not all issues need to explained in a quantifiable way
Some issues are over-simplified if only explored in numeric terms
In-depth explanation and contextualisation is useful
Ultimately depends on the research objectives
17. Research Design
Training of Trainers:
Module 2.2 Methodology design
(Data collection approaches)
Webex, May 2020
18. Session
Contents
1. Unit of measurement
2. Types of data collection approaches
(structured)
3. Types of data collection approaches (semi-
structured)
4. Types of data collection approaches (mixed
methods)
5. Frequently Asked Questions (FAQs)
6. Overview of remote data collection
7. Q&A
8. Task for the week
20. What is it?
The unit that will be used to record,
measure and analyse observations/
information collected
Examples?
Individual
Family
Household
Community/ group
Town/ village
Facility
Cow
21. Remember…
Unit will impact the time, resources needed to collect and analyse information
Unit will define the depth of information possible and scope of analysis
Depth
of
information
Location level
Household level
Individual level
Community/Group level
Time / Cost / Access
23. 1. The structured survey approach
Information collected through an interview, a discussion, a conversation
Using structured, close-ended data collection tools
Collection of quantifiable information
Cross-sectional or longitudinal
Types of data collection methods?
Household (HH) survey – collecting data at HH level, to understand experiences and characteristics of HHs within population of interest
Individual survey – collecting data at individual level, to help understand situation and characteristics of individuals within the population of
interest can include some HH level indicators if needed
Key informant interview – collecting data at community. location or group level from a key informant (KIs) i.e. an individual whose informal/
formal position gives him specific knowledge about other people, processes, or events that is more extensive, detailed, or privileged than
other individuals in their group/ community/ location
Group discussion – collecting data at community, location or group level from a group of representatives e.g. KIs
24. 1. The structured survey approach- Applicability
When should you use this approach?
To measure prevalence provide a quantifiable, numeric description of
the trends, behaviours, experiences, attitudes or opinions of a population
To generalize findings to a wider population probability sample
statistically representative information
Need prevalence data, understanding of scale of crisis but probability
sampling not possible non-probability sample indicative information
Types of research cycles this approach is commonly used for?
Multi-sector needs assessments
In-depth thematic needs assessments e.g. WASH Cluster needs assessment
Longitudinal studies
Third party monitoring (impact evaluation, outcome monitoring, post-
distribution monitoring, etc.)
25. 2. The structured experimental approach
What is it?
Similar to survey approach
But relies on experimental survey design
control vs. treatment group
Types of data collection methods?
Household (HH) survey – collecting data at HH level, to understand experiences and
characteristics of HHs within population of interest
Individual survey – collecting data at individual level, to help understand situation and
characteristics of individuals within the population of interest can include some HH level
indicators if needed
26. 2. The structured experimental approach - Applicability
When should you use this approach?
To measure prevalence and evaluate the outcomes or impact of a medium to large-scale
intervention on the population of interest
Generalize findings to a wider population probability sample statistically
representative information
Types of research cycles this approach is commonly used for?
Outcome monitoring
Impact evaluations
Etc.
27. 3. The structured observation approach (Description)
What is it?
Information collected through observation rather than
conversation
Using structured, close-ended checklists to collect
quantifiable information
Looking for specific object, behaviour or event against a
checklist e.g. Household using soap? Damage to health
center? Students participating in classroom?
Can be used as part of experimental approach
Types of data collection methods?
Participant observation – researcher participates in
context (e.g. anthropologists)
Direct observation – researchers observes context (e.g.
psychologists or clinical research)
28. 3. The structured observation approach - Applicability
When should you use this approach?
Serves similar purpose as survey approach
Depends on research objectives observation vs.
conversation?
Types of research cycles this approach is commonly used for?
Could be same as survey approach
Could be same as experimental approach
30. 4. The semi-structured discussion approach
What is it?
Information collected through detailed, narrative interviews, group discussions
Using semi-structured (NOT UNSTRUCTURED) data collection tools
open-ended questions, probes
Purposefully selected participants
Types of data collection methods?
Individual interview – collecting data at individual level, to help understand situation and characteristics of individuals within the population
of interest can include some HH level indicators if needed
Key informant interview – collecting data at community. location or group level from a key informant (KIs) i.e. an individual whose informal/
formal position gives him specific knowledge about other people, processes, or events that is more extensive, detailed, or privileged than
other individuals in their group/ community/ location
Group discussion – collecting data at community, location or group level from a group of representatives e.g. Kis
Focus group discussion – bringing together people from similar backgrounds or experiences to discuss a specific topic of interest; data
collected at community, location or group level
31. 4. The semi-structured discussion approach - Applicability
When should you use this approach?
To gather detailed insights about the
experiences, perspectives of specific population
group or location
To provide a qualitative description of the
experiences, trends, attitudes or opinions of a
population
Types of research cycles this approach is
commonly used for?
In-depth assessments where there is limited
prior understanding of a situation e.g. access to
cash among refugees & migrants in Libya
Participatory mapping exercises (mapping FGDs
or KI interviews)
32. ‘Most Significant Change’ data collection technique
A very specific type of participatory,
discussion-based data collection
method used for monitoring &
evaluation
Invites participants (through KI
interviews, individual interviews or
FGDs) to explain the most significant
changes brought about in their lives
by a project over a given period of time,
in key domains of change
Useful for third party monitoring or
impact evaluation research cycles
33. ‘Most Significant Change’ data collection technique
The stories, anecdotes you collect from beneficiaries/ project partners,
broken down by «domain» of interest
The stories, anecdotes you select to qualitatively analyse change per
«domain», in consultation with project team
34. 5. The semi-structured observation approach
Similar to structured observation approach
But two key differences:
Structured observation Semi-structured observation
1. Differences in data
collection methods
Information collected using a
structured set of questions,
usually to identify specific object,
behaviour or event against a
checklist
Information collected based on a
short set of open-ended
questions for observations e.g.
movement patterns of refugees
in and out of camps during a
sustained period of time
2. Differences in purpose Provide a quantifiable, numeric
description of the trends,
behaviours, experiences, etc. of
a population
Gather detailed insights about
the behaviours, experiences of
a specific population group or
location, and to understand, by
observation, how things are
done and what issues exist
36. 6. Sequential mixed methods data collection
Method used to sequentially elaborate or expand on the findings of one type of
research method with another
• Identify coping
strategies
Qualitative
• Measure
prevalence of
identified coping
strategies
Quantitative
1. Exploratory sequential approach
• Measure
prevalence of
known coping
strategies
Quantitative
• Understand and
contextualize
observed trends
in prevalence
Qualitative
2. Explanatory sequential approach
• Identify coping
strategies
Qualitative
• Measure
prevalence of
identified coping
strategies
Quantitative
• Understand and
contextualize
observed trends
in prevalence
Qualitative
3. The “ideal” sequential approach
37. 7. Concurrent mixed methods approach
Method used to merge or converge the findings from different research methods collected at the
same time
Alternative to sequential approach if time constraints sequential better practice if time and
resources allow
Concurrent mixed methods serves two key purposes:
Triangulation strategy
Convergence
of information
collected?
Divergence of
information
collected?
Embedded strategy
Primary
method:
quant
(What?
Where?)
Secondary
method:
qual (How?
Why?)
Key findings &
conclusions
38. Case study data collection technique
Using a combination of different data
collection methods to zoom in to a
specific issue, area or group
A component within a research
cycle, not a research cycle by itself
Useful to collect detailed information
on an event, activity, process, group
e.g. zoom in to one specific type of
intervention in an area within a larger
DFID-funded humanitarian programme
40. FAQs (1)
What is the difference between a key informant interview and an individual
interview? Isn’t the key informant also technically an individual?
The differences lies in the unit of measurement individual experiences
(individual interview) vs. community/ village/ institution experiences (KI interview)
For semi-structured data collection, when is it recommended to use FGDs
over KI or individual interviews?
This depends on two things
Research objectives and type of information needed e.g. Variety of
opinions and experiences useful? Specific information needed from an
expert? Topics sensitive to discuss in group setting?
Logistical constraints e.g. Large number of individuals to be reached within
a short timeframe?
41. FAQs (2)
Is it possible to have two different units of measurement in the same questionnaire?
Ideally, should be avoided, but there are some exceptions:
Individual information within a household survey (e.g. child attendance roster)
Household information within an individual survey (e.g. household size or income indicators)
Individual information within a village/ community/ location level interview (e.g. KI’s displacement status
and experiences, if KI also part of the affected population)
Household information within a village/ community/ location level interview (e.g. KI estimates # or % of
households affected by a specific situation in a village)
What if my population of interest includes minors (i.e. individuals <18 years of age)?
Can I collect data from minors?
Only if absolutely necessary to meet objectives of the research
Only if required information cannot be collected from adult respondents e.g. parents or caregivers
Ideally, only from respondents >15 years
Only if the required protocols are being followed
Will de discussed later in this training
44. What is remote data collection?
Remote data collection is a means of gathering data without a
physical presence in the data collection location and without
direct, in-person contact with the population of interest
When is it useful?
When it is not possible to conduct in-person visits to the
locations / populations of interest because of reasons such as:
Disease outbreak (e.g. COVID-19)
Time or resource constraints (e.g. not enough budget to hire
enumerators to cover all areas for face to face interviews)
Access constraints due to:
Security concerns
COVID-19 travel restrictions
Physical access barriers such as lack of infrastructure
Severe weather conditions which limits travel
possibilities, etc.
Etc.
45. Pros and cons of remote data collection
Pros Cons
Planning efficiency
More time and resource efficient; if
necessary logistics already in place,
could be fairly straightforward to
deploy
Challenging and time consuming to
set up correctly (e.g. identifying
respondents, organizing necessary
logistics, etc.), difficult to apply
stratification in sampling; challenging
to monitor progress
Implementation efficiency
Easier to implement even with
limited time, access and resources
(assuming planning and design is
done robustly)
Higher likelihood of low response
rates; limited means of verifying
responses/ data quality assurance;
more challenging to build trust with the
respondents; difficult to deploy long
or complicated questionnaires
Coverage
Ensures maximum possible
coverage of areas and population of
interest despite access constraints
Difficult to have the “full picture” as it
could introduce potential sampling
biases (e.g. based on phone network
coverage) and results in exclusions/
oversight of certain population
groups or areas
46. Some types of remote data collection methods (1)
1. Phone-based (individual, household, community level)
Most relevant for: needs assessments, post distribution monitoring (PDMs),
humanitarian situation monitoring (HSM)
Representative sampling could be possible
2. REACH “Area of Knowledge” methodology (face-to-
face data collection in alternate location)
Most relevant for: community-level needs assessments or HSM
Representative sampling not relevant (requires identifying the
respondent most likely to have the required knowledge)
3. Internet-based data collection
Tools include: social media, web-based surveys, online discussion
platforms, chatbots (WFP mVAM), etc.
Most relevant for: community-level needs assessments or HSM (KI
interviews or group discussions), PDMs (individual perception surveys)
Representative sampling could be possible (but extremely difficult to
implement e.g. would need email address database and usually low
response rates)
47. Some types of remote data collection methods (2)
4. Remote sensing
Only relevant if aim is to gain an understanding based on specific physical
characteristics of an area (e.g. agriculture and vegetation health analysis, shelter
damage assessment, flood impact assessment, etc.)
Representative sampling or even census could be possible
5. Secondary data review and “expert” consultations
Most relevant for: needs analysis or HSM
Only feasible if relevant and «reliable» data sources already exist
6. Paper form submissions
Only applicable if respondents have no movement restrictions and are able to
send paper forms back through required means
Logistically difficult, not the most time and resource efficient
Most relevant for: community-level needs assessments or HSM (KI
interviews), PDMs (individual perception surveys)
Representative sampling could be possible (but extremely difficult to
implement e.g. would need postal address database and expect very low
response rates)
48. Post-distribution
monitoring (PDM) of cash
assistance and core relief
items to refugees and
IDPs across Iraq
Project began in 2016
and remains ongoing
Data collected through
two call centres: Erbil and
Baghdad
Household level data
collection, providing at
least a 90% confidence
level and 10% margin of
error at Governorate level
Phone-based data collection example: Iraq UNHCR
Cash Assistance PDM (2017-now)
Project background
To improve time and cost
efficiency, since most of
the data collected would
not be verifiable by
enumerators in the field
Access to beneficiary
contact lists ensures time-
efficient data collection
The project has a wide
geographical spread, so
the call centre allows for
rapid, far reaching data
collection
Why was it remote? What worked well? Challenges?
A team of enumerators
have been well trained and
dedicated to this
assessment continuously
Availability of anonymised,
comprehensive beneficiary
lists for sampling purposes
Remote data collection
helps ensure data privacy
Typically the call centre
remains functional,
regardless of changing
access constraints
Building trust among
respondents
Ensuring respondents
understand the role of this
assessment
Potential for duplication as
beneficiary lists were at the
individual level while
sampling was at the
household level
Space constraints within
the call centre during
multiple ongoing
assessments
49. Humanitarian Situation
Monitoring in ‘hard to
reach areas’ of ‘3 border’
area between Mali, Niger
and Burkina Faso
Since November 2019
Remote data collection
through face to face
interviews with KIs who
travel between accessible
and inaccessible areas
Collect information about
humanitarian situation in
each country / areas with
same tool to allow for
comparability
AoK data collection example: 3-border HSM in Sahel
(December 2019- now)
Project background
To gather information
about areas where
humanitarian access is low
or unreliable
To ensure supply of
information about these
areas is regular and not
contingent on access,
allowing for trends
monitoring
Less resource intensive –
good compromise to
gather indicative data in
complement to existing,
more robust data collection
systems
Why was it remote?
Once knowledge of
population movements
within a region is clear,
easy to set up data
collection to ‘capture’
information about
different areas
Ability to cover data
across a vast territory
from a handful of static
bases.
Ability to monitor trends
on situation in hard to
reach areas and to
compare and contrast
between severity levels.
What worked well?
Reliability is not high and
ability to verify validity of
data collected is low – it’s
indicative only
KIs reporting on overall
situation at settlement
level can hide inequalities
While it is less
challenging finding KIs
from relevant geographic
areas, it can be difficult to
find a balance of KI
profiles (men, women,
age groups, vulnerable
groups etc), impacting
comparative analysis.
Challenges?
54. Instructions
Take the research objectives & preliminary analysis plan you formulated last week and briefly
determine:
• Which overall research method would be most appropriate and why?
• Which data collection approach(es) would be most appropriate and why?
• It is up to you to decide whether you want to assume face-to-face data collection is
possible/ remote data collection is necessary in your scenario
• Don’t go into sampling just yet, we will come back to that next week
• Is there likely to be any sensitive information collected? Is this suitable to the data collection
approach being discussed?
• What additional information do you need to make final decisions on the approaches?
We can discuss how this goes next week!
Editor's Notes
HH survey has two components: (1) a short background and demographics module (which includes a detailed roster of each household member’s age, sex, marital status and relationship status to the head of household) and (2) a detailed module exploring the key indicators and variables relevant to the topic of research. In some cases, a third module is also included which records individual-level data within the household, for e.g. information on education background and current status of each child member of school-going age within the household.
FGDs are useful to:
gain insight into how a specific group thinks about an issue
collect anecdotal evidence
gather a wide range of opinions and ideas through a few discussions only, and
identify and understand inconsistencies and variations that exist in a particular community in terms of perceptions, experiences and practices.
What is the project?
Post-distribution monitoring of cash assistance and core relief items to refugees and IDPs across Iraq
PDM activities have been conducted for in-kind, cash, and seasonal assistance in the KR-I and neighbouring areas from 2016, and for cash-based assistance nationwide since 2017.
Two call centres- in Erbil and Baghdad
Once we have the beneficiary lists, we stratify them by governorate and conduct HH interviews. We do a census for any governorate under 100 people and randomly sample the rest to get 90/10 governorate level and 95/5 overall
Why was a call centre used?
Most of the data collected is not verifiable by in-person enumerators anyway (i.e. use of cash assistance, use of household coping strategies)
Geographic spread – some assessments under this project cover the whole of Iraq. In some governorates we have 500+ beneficiaries, but sometimes we only have 4 or 5 beneficiaries in a governorate. This would make it challenging to do in-person data collection.
What works well?
We’ve built a strong team of core enumerators who are primarily dedicated to this project. Some have worked on the team for years and really understand the methodology and questions.
Good for data privacy- all phones and beneficiary lists stay within the office at all times.
When access is limited, call-centre data collection is usually unaffected.
What challenges were faced?
Building trust of beneficiaries – we’ve written robust introduction statements at the start of our surveys to ensure that enumerators are fully explaining who they are, why they’re calling, etc. For in person data collection enumerators are identifiable as REACH employees, but on the phone it has to be explained much more thoroughly.
Duplication - we were potentially duplicating households in our survey since the contact lists we had could often have more than one household member in them (i.e. multiple beneficiaries within the same household). Since our unit of measurement was the household (i.e. most of the questions we were asking were at household level), we had to find some ways to overcome this. One very simple measure for example we took was to ask right at the start of the survey if someone else within their household (defining clearly what the household was) had already been contacted in the past x period for a similar survey. There was another measure we took which was matching unique case registration IDs, but this isn’t always possible
Space constraints- when we have simultaneous data collection for multiple assessments it’s often very crowded in the call centre. Makes it hard for enumerators to hear and for people to hear them on the call.