Comparisons are made with the assumption that events in the test condition have not affected events in settings where the test condition is absent.
A “fact” is something that does exist or did happen. Therefore a counter-fact is something that does not exist or did not actually happen.
1 29-13 research methods overview
RESEARCH METHODS OVERVIEW Dr. John Bradford
Research Methods• All research begins with a ‘Literature Review’! – A ‘lit review’ is a review of the existing literature on the topic• Types of Research (not exhaustive!)1. Surveys and Interviews2. Experiments3. Observation/ethnography4. Unobtrusive (nonreactive) research
Survey• Survey: a series of questions asked of a number of people 1. Interview 2. Self-administered questionnaire – Surveys are especially good for discovering basic ‘demographic information’- age, gender, income, education, etc. – Allows researchers to obtain information about things that cannot observed directly, such as attitudes.
Survey1. Close-ended Survey Questions: respondents are provided with list of possible answers – Examples. 1. Are you: _______ male _______ female? 2. What is your present marital status? – ______ _never married – _______married – _______ separated – _______ divorced – _______ widowed 3. Are you presently employed? ______ no ______ yes
Survey1. Close-ended Survey Questions: – Matrix Questions: answers look like a matrix, or an array of numbers. Agree Agree Disagree Disagree Strongly Somewhat Somewhat Strongly1. No student should beallowed to consume alcoholon campus.2. Faculty should be subjectto a dress code
Survey2. Open-ended Survey Questions: Respondents answer questions in their own words.Examples: – What is the most important thing you have learned so far in this class? – What is the thing that you like most about your sociology class? The thing you like least?
Survey 6 Guidelines for Crafting Survey Questions1. Adapt phrasing of questions to the educational level of your respondents.2. Avoid double negatives in a question3. Avoid ‘marathon’ questions.4. Don’t ask ‘double-barreled’ questions: ask only one question at a time!5. Don’t ask ‘leading’ or ‘loaded’ questions6. Don’t ask questions that your respondent cannot answer – Inaccessible information, or illogical questions.
Experiment• An experiment involves manipulating the independent variable (X) and observing the effect on the dependent variable (Y)• Experiments are the only means by which we can explore causal relationships; only way we can know for sure if changes to X cause changes in Y.• Experimenter needs two dependent variable (Y) groups of Y: 1. Experimental group- receives ‘treatment’ of independent variable (X) 2. Control group- does not receive treatment; is left alone.
Experiment• Imagine a scientist testing the effect that some drug, X, has on growth of rats, Y.• To see how the drug effects rat growth, the experimenter will compare growth in two groups of rats: Y₁ , the group of rats that gets the drug (X) and a group of rates Y₂ that will not.• Y₁ is the experimental group, and Y₂ is the control group.
Experiment• One assumes separation or isolation between the setting where X is applied and the control, where X isn’t applied.• It is important that rats which receive the drug and rats which do not be alike in all relevant characteristics and conditions, so that any observed differences between rats which receive the drug (the experimental group) and those that do not (the control group) can be attributed only to the drug (X), and not to something else.
Experiment• A counter-factual refers to something that did not happen, but could have or would have occurred. – Whenever we infer causal relationships (‘X’ caused ‘Y’ to happen), we compare what did happen with what we believe would have happened in the absence of the cause, i.e. we compare a factual with a counter-factual (imagined) condition.• We use the ‘control group’ to make a counterfactual argument, which says that: “in the absence of X, this is how Y₁ would have behaved.” We assume that Y₁ would have behaved like Y₂, the control.• Why? Because they are alike in all relevant characteristics, so any difference we observe must be a result of the independent variable, X.
Experiment 5 Rules for Doing True Experiments1. Have at least two groups (control and experiment)2. Randomly assign people to groups3. Treat the experimental group by manipulating the independent variable4. Observe the effect of the treatment on the dependent variable in the experimental group5. Compare the dependent variable differences (the outcome of treatment) in the experimental and control groups
Observation• Strategies of Field Research: – Complete participant – Complete observer – Participant ObserverHawthorne Effect: observation by a researcher can influence the subjects who are being observed.NO TOTALPARTICIPATION PARTICIPATION Complete Participant Complete Observer Observer participant
Unobtrusive (Nonreactive) Research• Artifacts (archeologists)• Statistics• Content Analysis• Triangulation = using several research methods.
Sampling• A Sample is a portion of the larger population that you will study to make inferences about the larger population.• General rule: the more diverse a population is, the larger the sample needs to be!• Samples should be random: every element in the population has the same probability of being in the sample.