2. Steps to consider before selecting data collection methods
Review existing data. Take a look at the data you
routinely collect and decide whether to use it in this
evaluation.
Define the data you need to collect. Figure out which
data you still need to collect.Make a list of topics you need to
know more about and develop a list of the data you will
collect. Finalize the list based on the importance of the
information and its ease of collection.
3. QUALITATIVE AND QUANTITATIVE APPROACHES
Qualitative Methods - capture data that are difficult to
measure, count, or express in numerical terms.
Three qualitative methods to collect data
1. Observation - involves gathering information about how
program operates. Data can be collected on the setting,
activities, and participants.
Direct Observation
Indirect Observation
4. TIPS TO REMEMBER
Choose opening questions that are designed to break
the ice.
Use transition questions to get the data you need.
Be sure to get the key questions answered before you
finish
Be sure to include ending questions that summarize
the discussion and gather any missing information.
5. 2. Interviews - involve asking people to describe or explain
particular program issues or practices. You can conduct
interviews by telephone or in person. Interviews allow you to
gather information on unobserved program attributes.
3. Focus groups - involve group discussions guided by an
evaluator acting as a facilitator using a set of structured
questions. The goals of the discussions may vary, but this
method is designed to explore a particular topic in depth.
6. Quantitative Methods - capture data that can be
counted, measured, compared, or expressed in numerical
terms.
Two quantitative methods to collect data
Document review - involves collecting and reviewing
existing written material about the program. Documents
may include program records, or materials such as
proposals, annual or monthly reports, budgets,
organizational charts, memorandums, policies and
procedures, operations handbooks, and training materials.
7. Questionnaires and surveys - involves collecting data
directly from individuals. This approach allows to gather
data directly from the source.
When developing questionnires or survey it should be:
well constructed, easily understood, unambigous, and
obejective
short, simple, and specific
grouped logically
devoid of vague qualifiers, abstract terms, and jargon.
8. OVERVIEW OF DATA COLLECTION METHODS
OVERVIEW OF DATA COLLECTION METHODS
METHOD TYPE OVERALL PURPOSE ADVANTAGES CHALLENGES
Observation Qualitative To gather information first-hand
about how a program actuall
works
Can see program in
operation; requires small
amount of time to complete
Requires much training; expertise
needed to devise coding scheme;
can influence participants
Interview Qualitative To explore participant
perceptions, impressions, or
experiences and to learn more
about their answers
Can gather in-depth,
detailed information
Takes much time; analysis can be
lengthy; requires good interview
or conversation skills; formal
analysis methods can be difficult
to learn
Focus Group Qualitative To explore particular topic in
depth, get participant reactions,
understand program issues and
challenges
Can quickly get information
about participant likes and
dislikes
Can be difficult to manage;
requires good interview or
conversation skilss; data can be
difficult to analyze
Document
Review
Quantitative To unobtrusively get an
impression of how a program
operates
Objective least obtrusive;
little expertise needed
Access to data may be tricky; can
be difficult to interpret; may
require a lot of time; data may be
incomplete
Questionnaire
and Self-
Administered
Quantitative To gather data quickly and easily
in a non threatening way
Anonymous;easy to
compare and analyze; can
administer to several people
Impersonal; subjective; results
are easily biased
9. METHOD TYPE OVERALL PURPOSE ADVANTAGES CHALLENGES
but some expertise
needed to administer;
can get lots of data in a
moderate timeframe
In - person Survey Quantitative To gather data quickly andf easily in a
nonthreathening way
Can clarify responses Requires more yime to
conduct than self-
administered survey;
need some experise to
gather an use
10. TIPS TO REMEMBER
Ask only necessary demographic questions
Make sure you ask all of the important questions
Consider the setting in which the survey is administered or
disseminated
Assure your respondents of their anonymity and privacy.
11. If required to collect personal or demographic data from potential
respondents it is important to:
gain their consent
explain how the information will be used and reported
explain how the information will be stored and maintained