2. SESSION OBJECTIVES
3
DEPARTMENT OF EDUCATION
1. differentiate the instruments used in data
collection;
2. identify the characteristics of a good data
collection instrument;
3. determine the appropriate data collection
instrument to be used for a given problem;
4. enumerate the procedures in data collection;
and
5. develop appropriate data collection instruments.
9. ACTIVITY: Write Me!
3
DEPARTMENT OF EDUCATION
1. The class will be divided into 4 groups.
2. Each group will be given a task to work on.
*Groups 1 & 2
• Construct five (5) interrelated questions (in a form
of a Checklist) related to your strand
*Groups 3 & 4
• Construct five (5) interrelated interview questions
in relation to their experiences in this training.
3. After the given time allotment, present your output
10. ANALYSIS
3
DEPARTMENT OF EDUCATION
1. How did you find the activity?
2. What were your considerations in
constructing your questions?
3. What can you say about the
questions constructed by the other
group/s?
11. 3
DEPARTMENT OF EDUCATION
Quantitative Approach
• Data in numerical form
• Data that can be precisely measured
–age, cost, length, height, area, volume,
weight, speed, time, and temperature
• Harder to develop
• Easier to analyze
13. 3
DEPARTMENT OF EDUCATION
4. Train the
raters,
observers,
assistants and
other research
personnel.
3. Select and
screen the
population using
appropriate
sampling
technique
2. Seek
permission from
the authorities.
1. Develop
your data
collection
instrument
and
materials.
Planning the Data Collection Procedure
BEFORE
14. 3
DEPARTMENT OF EDUCATION
6. Pilot test
the
instruments.
5. Obtained
informed
consent from
the
participants.
BEFORE
Planning the Data Collection Procedure
15. 3
DEPARTMENT OF EDUCATION
3. As much as
possible, utilize
triangulation.
2. Administer
the instrument,
and implement
the intervention
or treatment, if
applicable..
1. Provide
instructions to
the participants.
Planning the Data Collection Procedure
During
16. 3
DEPARTMENT OF EDUCATION
3. Later,
examine and
analyse your
data using the
appropriate
statistical tools.
2. Safeguard the
confidentiality
of your data.
1. Immediately
encode or
transcribe and
archive your
data.
Planning the Data Collection Procedure
After
17. 3
DEPARTMENT OF EDUCATION
Questionnaire
Allows us to collect the most complete and accurate
data in a logical flow.
It is well-designed and should meet the research
goal and objectives and minimize unanswered
questions—a common problem bound to many
surveys.
18. 3
DEPARTMENT OF EDUCATION
Writing the Questionnaire
• researcher should decide on the questionnaire content.
• question should contribute to testing one or more
hypothesis/research question established in the research
design.
Questions could be:
• Open format questions that are without a predetermined
set of responses.
• Closed format questions that take the form of a multiple-
choice question.
19. 3
DEPARTMENT OF EDUCATION
Some considerations in
writing the Questionnaire
• Clarity
• Phrasing
• Sensitive question
• Hypothetical Questions should be avoided if possible.
20. 3
DEPARTMENT OF EDUCATION
Why pilot test the questionnaires?
• In-order to identify and solve the confusing points, we need
to pre-test the questionnaire.
• During the pilot trial: the participants should be randomly
selected from the study population
• Results of the pilot test shall be used to determine
instrument’s reliability.
• To ensure validity, a panel of experts may be requested to
check the instrument.
21. 3
DEPARTMENT OF EDUCATION
In Summary,
• Questionnaire allows collection of both
subjective and objective data in a large sample
of the study population in order to obtain
results that are statistically significant,
specially when resources are limited.
• Questionnaire is a good tool for the protection
of the privacy of the participants.
22. 3
DEPARTMENT OF EDUCATION
In Summary,
• The validity of data and information
depends on the honesty of the
respondent.
• Questionnaires can measure both
qualitative and quantitative data, but is it
more appropriate for quantitative data
collection.
24. 3
DEPARTMENT OF EDUCATION
Table 1. Five Likert-Type Questions
Strongly Disagree Disagree Neutral Agree Strongly Agree
1. 4-H has been a
good experience for
me.
SD D N A SA
2. My parents have
provided support for
my 4-H projects.
SD D N A SA
3. My 4-H
involvement will
allow me to make a
difference.
SD D N A SA
4. My 4-H advisor
was always there for
me.
SD D N A SA
5. Collegiate 4-H is
important in the
selection of a
college.
SD D N A SA
25. 3
DEPARTMENT OF EDUCATION
Likert Scale Best Practices & Tips:
1.Keep it labelled.
2.Keep it unipolar. For example, it’s better to use a scale that
ranges from “extremely brave” to “not at all brave,” rather than a scale
that ranges from “extremely brave” to “extremely shy.”
3.Keep it odd.
26. 3
DEPARTMENT OF EDUCATION
With regard to Likert scales,
1. Likert scales are totals or averages of answers
to multiple Likert items.
2. Likert scales contain multiple items and are
therefore likely to be more reliable than single
items.
3. Likert scales contain multiple items and can be
taken to be interval scales so descriptive
statistics can be applied.
27. 3
DEPARTMENT OF EDUCATION
With regard to Likert scales,
4. If a researcher presents the means and
standard deviations (interval scale and
nominal scale statistics) and let the reader
decide how to interpret the results at the
Likert-item level.
29. 3
DEPARTMENT OF EDUCATION
Advantages
of interview
Collect complete information with greater
understanding.
It is more personal, as compared to questionnaires,
allowing us to have higher response rates.
It allows more control over the order and flow of
questions.
We can introduce necessary changes in the interview
schedule based on initial results (which is not possible in
the case of a questionnaire study/survey)
30. 3
DEPARTMENT OF EDUCATION
Disadvantages
of Interview
Data analysis—especially when there
is a lot of qualitative data..
Interviewing can be tiresome for large
numbers of participants.
Risk of bias is high due to fatigue and to
becoming too involved with
interviewees. .
31. 3
DEPARTMENT OF EDUCATION
When is Interview useful?
Individual perspectives and experiences
Sensitive topics
Situations where there is perceived danger of
reprisal
Topics that cannot be investigated through surveys
Gathering in-depth information about a topic
32. 3
DEPARTMENT OF EDUCATION
Challenges of Interview:
• Can be expensive, labor intensive, and time
consuming
• Selective hearing on the part of the interviewer
may miss information that does not conform to
pre-existing beliefs
• Cultural sensitivity: e.g., gender issues
34. 3
DEPARTMENT OF EDUCATION
Structured Interview
questions as well as their order is already
scheduled.
your additional intervention consists of giving
more explanation to clarify your question (if
needed),
ask your respondent/s to provide more
explanation if the answer they provide is vague
(probing).
35. 3
DEPARTMENT OF EDUCATION
Semi-Structured Interview
Semi-structured interviews include a number of
planned questions, but the interviewer has more
freedom to modify the wording and order of
questions.
36. 3
DEPARTMENT OF EDUCATION
In-depth Interview
In-depth interview is less formal and the least
structured, in which the wording and questions are
not predetermined.
This type of interview is more appropriate to collect
complex information with a higher proportion of
opinion-based information.
37. 3
DEPARTMENT OF EDUCATION
Activity: Answer Me!
1.The prepared questions will be
answered by the members of the group.
2.One of the members will tally and
consolidate your group’s responses.
3.Assign a rapporteur who will present
the results.
40. 3
DEPARTMENT OF EDUCATION
RELEVANCE
•Does the measure capture what matters?
•Do not measure what is easy instead of what is
needed
CREDIBILITY
•Is the measure believable? Will it be viewed as a
reasonable and appropriate way to capture the
information sought?
41. 3
DEPARTMENT OF EDUCATION
INTERNAL VALIDITY
•How well does the measure capture what it is supposed to?
•Are waiting lists a valid measure of demand?
RELIABILITY
• A measure’s precision and stability- extent to which the
same result would be obtained with repeated trials
•How reliable are:
– birth weights of newborn infants?
– speeds measured by a stopwatch?
42. 3
DEPARTMENT OF EDUCATION
Activity: Act Me Out!
1.Each group is given 5 minutes to plan and
prepare for simulation based on the given
task.
2.Each group is given 3 minutes to simulate.
3.After each presentation, one member from
the other group will give insights to what was
presented.
45. 3
DEPARTMENT OF EDUCATION
• learns about behaviours
• in natural setting; learns
about cultural aspect of
setting context.
• various data collection
such as surveys, stories,
diaries, documents..
• generates insights into
hared experiences and
• social norms through
• group discussion.
• explores individual
experiences perspective
or practices in rich
detail.
Interview
Focus
Group
Discussion
.
Observation
Textual data
COMMON APPROACHES TO DATA COLLECTION
46. 3
DEPARTMENT OF EDUCATION
Focus Group Discussion (FGD)
structured discussion with the purpose of
stimulating conversation around a specific topic.
led by a facilitator who poses questions and the
participants give their thoughts and opinios.
gives us the possibility to cross check one
individual’s opinion with other opinions gathered.
47. 3
DEPARTMENT OF EDUCATION
Focus Group Discussion (FGD)
A well organized and facilitated FGD is more than a
question and answer session.
In a group situation, members tend to be more
open and the dynamics within the group and
interaction can enrich the quality and quantity of
information needed.
48. 3
DEPARTMENT OF EDUCATION
Focus Group Discussion (FGD)
Generating narrative data in a focused discussion
Group dynamics: Widens the range of responses
(different perspectives and views on common
experience) Activates forgotten details Releases
inhibitions
49. 3
DEPARTMENT OF EDUCATION
Focus Group Discussion (FGD)
Useful for: Characterizing social and cultural norms
Sharing and comparing Revealing how people talk
about an issue Exploring sensitive topics
50. Focus Group Discussion (FGD) Process
3
DEPARTMENT OF EDUCATION
Phase Action
1 Opening Ice-breaker; explain purpose; ground rules;
introductions
2 Warm-
up
Relate experience; stimulate group interaction;
start with least threatening and simplest questions
3 Main
body
Move to more threatening or sensitive and
complex questions; elicit deep responses; connect
emergent data to complex, broad participation
4 Closure End with closure-type questions; summarize and
refine; present theories, etc; invite final comments
or insights; thank participants
51. 3
DEPARTMENT OF EDUCATION
Focus Group Discussion (FGD)
Advantages Can be conducted relatively quickly and easily;
may take less staff time than in-depth, in-person
interviews; allow flexibility to make changes in
process and questions; can explore different
perspectives; can be fun
Challenges Analysis is time consuming; participants not be
representative of population, possibly biasing the
data; group may be influenced by moderator or
dominant group members
52. 3
DEPARTMENT OF EDUCATION
FGD are Inappropriate when:
• language barriers are insurmountable
• evaluator has little control over the situation
• trust cannot be established
• free expression cannot be ensured
• confidentiality cannot be assured
53. 3
DEPARTMENT OF EDUCATION
Observation
• Enable researcher to learn what is taken for
granted in a situation and to discover what is
going on by watching and listening.
• Techniques differ primarily in the visibility and
involvement of researcher in the setting:
Participant observation & Nonparticipant
observation
• Field notes (also photographs, video)
54. APPLICATION 1
3
DEPARTMENT OF EDUCATION
1. A metacard will be distributed to each
group.
2. Develop data gathering tools given the
research questions in the metacard.
3. Assign a representative to present the
group’s output.
55. APPLICATION 2
3
DEPARTMENT OF EDUCATION
Develop appropriate
instrument/s in data collection
related to your identified
research problems in the
previous sessions.
56. 3
DEPARTMENT OF EDUCATION
Remember, in data collection technique:
•Choose more than one data collection technique
•No “best” tool
•Do not let the tool drive your work but rather
choose the right tool to address the evaluation
question
The validity of data and information depends on the honesty of the respondent.
The questionnaires can measure both qualitative and quantitative data, but is it more appropriate for quantitative data collection.
structured discussion with the purpose of stimulating conversation around a specific topic.
led by a facilitator who poses questions and the participants give their thoughts and opinions.
gives us the possibility to cross check one individual’s opinion with other opinions gathered.
A well organized and facilitated FGD is more than a question and answer session.
In a group situation, members tend to be more open and the dynamics within the group and interaction can enrich the quality and quantity of information needed.