2. •Survey research is perhaps the most frequently
used mode of observation in sociology and
political science, and surveys are often used in
criminal justice research as well
•You have no doubt been a respondent in some
sort of survey, and you may have conducted a
survey yourself
2
3. •Counting Crime: asking people about
victimization counters problems of data collected
by police
•Self-Reports: dominant method for studying the
etiology of crime
•Frequency/type of crimes committed
•Prevalence (how many people commit crimes)
committed by a broader population
3
4. •Perceptions and Attitudes: To learn how people
feel about crime and CJ policy
•Targeted Victim Surveys: Used to evaluate
policy innovations & program success
•Other Evaluation Uses: e.g., Measuring
community attitudes, citizen responses, etc.
•Chicago Community Policing Evaluation Consortium
•General Purpose Crime Surveys
4
5. •How questions are asked is the single most
important feature of survey research
•Open-Ended: Respondent is asked to provide
his or her own answer
•Closed-Ended: Respondent selects an answer
from a list
•Choices should be exhaustive and mutually
exclusive
•Questions and Statements – (Likert scale)
5
6. •Make Items Clear: Avoid ambiguous questions;
do not ask “double-barreled” questions
•Short Items are Best: Respondents like to read
and answer a question quickly
•Avoid Negative Items: Leads to
misinterpretation
•Avoid Biased Items and Terms: Do not ask
questions that encourage a certain answer
•Designing Self-Report Items: Use of computer
assisted interviewing techniques
6
7. •General questionnaire format – critical, must be
laid out properly - uncluttered
•Contingency Questions: Relevant only to some
respondents – answered only based on their
previous response
•Matrix Questions: Same set of answer
categories used by multiple questions
7
8. •Ordering may affect the answers given
•Estimate the effect of question order
•Perhaps devise more than one version
•Begin with most interesting questions
•End with duller, demographic data
•This is opposite for in-person interview surveys
8
9. •Can be home-delivered
•Researcher delivers questionnaire to home of
sample respondent, explains the study, and then
comes back later
•Mailed (sent and returned) survey is most
common
•Researchers must reduce the trouble it takes to
return a questionnaire
9
10. •Used to increase response rates
•Warning Mailings: “Address correction
requested” card sent out to determine incorrect
addresses and to “warn” residents to expect
questionnaire in mail
•Cover Letters: Detail why survey is being
conducted, why respondent was selected, why is
it important to complete questionnaire
•Include institutional affiliation or sponsorship
10
11. •Monitoring returns: Pay close attention to the
response rate, assign #’s serially
•Follow-up mailings: Nonrespondents can be
sent a letter, or a letter and another
questionnaire; timing
•Acceptable response rates: 50% is adequate,
60% is good, and 70% is very good
•We would rather have a lack of response bias than
a high response rate?
11
12. •Via Fax, Email, Web Site/Page
•Issues
•Representativeness
•Mixed in with, or mistaken for, spam
•Requires access to Web
•Sampling frame?
12
13. •Typically achieve higher response rates than
mail surveys (80-85% is considered good)
•Demeanor and appearance of interviewer
should be appropriate; interviewer should be
familiar with questionnaire and ask questions
precisely
•Can probe for additional responses
•When more than one interviewer administers,
efforts must be coordinated and controlled
•Practice interviewing
13
14. •Reported success in enhancing confidentiality
•Reported higher rates of self-reporting
•Computer-assisted personal interview (CAPI) –
Interviewers read questions from screens and then
type in answers from respondents’
•Computer-assisted self-interviewing (CASI) –
Respondent keys in answers, which are scrambled
so that interviewer cannot access them
14
15. •95.5% of all households have telephones
(2005, US Census Bureau)
•Random-Digit Dialing
•Obviates unlisted number problem
•Often results in business, pay phones, fax lines
•Saves money and time, provides safety to
interviewers, more convenient
•May be interpreted as bogus sales calls; ease of
hang-ups
15
16. •A set of computerized tools that aid telephone
interviewers and supervisors by automating
various data collection tasks
•Easier, faster, more accurate but more
expensive
•Formats responses into a data file as they are
keyed in
•Can automate contingency questions and skip
sequences
16
17. •Self-administered questionnaires are generally
cheaper, better for sensitive issues than interview
surveys
•Using mail: Local and national surveys are same
cost
•Interviews: More appropriate when respondent
literacy may be a problem, produce fewer
incompletes, achieve higher completion rates
•Validity low, reliability high in survey research
•Surveys are also inflexible, superficial in
coverage
17
18. •Particularly useful in describing large populations.
•Standardized questionnaires can ensure uniform
responses and measurement.
•Protects against respondents interpreting
concepts differently.
18
19. •Standardized questionnaire items often represent
the least common denominator in assessing
people’s attitudes, orientations, circumstances,
and experiences.
•Superficial coverage of complex topics
•Survey research cannot readily deal with the
specific contexts of social life.
•Some populations might be hard to contact
through customary sampling methods.
19
20. •Consider start-up costs
•Finding, training, paying interviewers is time
consuming and not cheap, and requires some
expertise
•Mail surveys are less expensive, and can be
conducted by 1-2 persons well
•The method you use depends on your research
question
20