The document discusses experimental research designs. It defines key terms like causal hypotheses, experimental designs, control groups, stimuli, placebos, internal validity, and pretest-posttest designs. It describes classic experimental designs that involve randomly assigning subjects to experimental and control groups, introducing/manipulating the independent variable between pre- and posttests, and comparing results. Threats to internal validity like maturation and history are also outlined.

1. Experimental Research Chapter 8

2. Introduction Explanatory research Research that seeks to explain the cause of a phenomenon, and typically asks “what causes what?” or “why is it this way?”

3. Introduction Causal hypothesis A testable expectation about an independent variable’s affect on a dependent variable

4. Introduction Causal hypotheses and experimental designs Empirical association Temporal precedence or time order Non-causal relationship

5. Introduction Causal hypotheses and experimental designs Experimental designs A study design in which the independent variable is controlled, manipulated, or introduced in some way by the researcher

6. Introduction The classic experiment: Data collection technique or study design? In experimental design the independent variable is introduced, manipulated, or controlled What does this mean? The independent variable does not occur naturally, but it is the result of an action taken by the researcher Unique feature of the classic experimental design The researcher controls the placement of sample members into two or more categories of the independent variable

7. Introduction The classic experiment: Data collection technique or study design? If practical and ethical , a study can be designed so that the dependent variable is measured first and then, the independent variable is introduced or manipulated and, finally, the dependent variable is measured again. Can see whether the introduction of the independent variable comes before change in the dependent variable.

8. Experimental Designs Control group Exposed to all the influences that the experimental group is exposed to except for the stimulus

9. Experimental Designs Stimulus The experimental condition of the independent variable that is controlled or “introduced” by the researcher in an experiment The researcher tries to treat the two groups exactly alike, except instead of the stimulus, the control group receives no treatments, an alternative treatment, or a placebo

10. Experimental Designs Placebo A simulated treatment of the control group that is designed to appear authentic

11. Experimental Designs Internal validity Agreement between a study’s conclusions about causal connections and what is actually true

12. Experimental Designs Experimental design pretest-posttest control group experiment Classic controlled experiment An experimental design with two or more randomly selected groups (an experimental and control group) in which the researcher controls or “introduces” the independent variable and measures the dependent variable at least two times (pretest and posttest measurement)

13. Experimental Designs Experimental design pretest-posttest control group experiment Pretest The measurement of the dependent variable that occurs before the introduction of the stimulus of independent variable

14. Experimental Designs Experimental design pretest-posttest control group experiment Posttest The measurement of the dependent variable that occurs after the introduction of the stimulus or the independent variable

15. Experimental Designs Experimental design pretest-posttest control group experiment Probability sampling A sample that gives every member of the population a known (nonzero) chance of inclusion

16. Experimental Designs Experimental design pretest-posttest control group experiment Random Assignment A technique for assigning members of the sample to experimental and control groups by chance to maximize the likelihood that the groups are similar at the beginning of the experiment This can be done by flipping a coin to determine which subject is assigned to which group Assign each subject a number and using either a random number table or electronic random number generator to select members of each group

17. Experimental Designs Experimental design pretest-posttest control group experiment Matching Assigning members of the sample to groups by matching members of the sample on one or more characteristics and separating the pairs into two groups with one group randomly selected to become the experimental group

18. Experimental Designs Experimental design pretest-posttest control group experiment The study uses at least one experimental and one control group, selected using a strategy to make the groups as similar as possible The dependent variable is measured at least two time for the experimental and control groups. The first measurement is before and the second is after the independent variable is introduced

19. Experimental Designs Experimental design pretest-posttest control group experiment 3. The independent variable is introduced, manipulated, or controlled by the researcher between the two measurements of the dependent variable. 4. The differences in the dependent variable between the pretest and posttest are calculated for the experimental group(s) and for the control group. The differences in the dependent variable for the experimental and control groups are compared.

20. Experimental Designs

21. Experimental Designs Internal validity and experiments Maturation The biological and psychological processes that cause people to change over time

22. Experimental Designs Internal validity and experiments Testing effect The sensitizing effect on subjects of the pretest

23. Experimental Designs Internal validity and experiments History The effects of general historical events on study participants

24. Experimental Designs Internal validity and experiments Selection bias A bias in the way the experimental and control or comparison groups are selected that is responsible for preexisting differences between the groups.

25. Experimental Designs Posttest-only control group experiment An experimental design with no pretest Either because it is not possible to do a pretest or because of a concern that using a pretest would sensitize the experimental group to the stimulus Same design elements as other experiments: control of manipulation of the stimulus and two or more groups using random selection or assignment

26. Experimental Designs Extended experimental design Solomon four-group design A controlled experiment with an additional experimental and control group with each receiving a posttest only

27. Experimental Designs

28. Experimental Designs Quasi-experimental design An experimental design that is missing one or more aspects of a true experiment Most frequently random assignment into experimental and control groups Used when it is not ethical or practical to do a controlled experiment

29. Experimental Designs Experiments in the field Field experiment An experiment done in the “real world” of classrooms, offices, factories, homes, playgrounds, and the like

30. Experimental Designs Experiments in the field Generalizability The ability to apply the results of a study to groups or situations beyond those actually studied

31. Focal Research A Field Experiment in the Classroom by Chris Caldeira Hypothesized that using film clips to teach sociological concepts in conjunction with the textbook and lecture is more effective in helping students learn core concepts than the lecture and textbook without the clips.

32. Experimental Designs Experiments in the laboratory Laboratory research Research done in settings that allows the researcher control over the conditions, such as in a university or medical setting Research examples Hobza and Aaron Rochlen (2009) Bushman and Anderson (2009)

33. Experimental Designs Experiments in the laboratory Important to evaluate a study’s external validity – or the ability to generalize the results from the laboratory to the “real world”

34. Experimental Designs Experiments in the laboratory External Validity – Issues to Consider Was the situation very artificial, or did it approximate “real life?” How different were study participants from other populations? To what extent did the participants believe that they were up for inspection, serving as guinea pigs or play acting, or have other feelings that would affect responses to the stimulus? To what extent did the researcher communicate his or her expectations for results to the subjects with verbal or nonverbal cues?

35. Experimental Designs Experiments in the laboratory Experimenter expectations When expected behaviors or outcomes are communicated to subjects by the researcher One way to handle the issue of experimenter expectations is to use a double-blind experiment.

36. Experimental Designs Experiments in the laboratory Double-blind experiment An experiment in which neither the subjects nor research staff who interact with them knows the memberships of the experimental or control groups.

37. Experimental Designs Natural experiments A study using a real-work phenomena that approximates an experimental design even though the independent variable is not controlled, manipulated, or introduced by the researcher

38. Experimental Designs Natural experiments Wars, hurricanes, & political events might effect some groups and not others. Example Studying the of deployment on military families The researcher cannot control deployment, but two groups could be created by those families who were deployed and those families who were not deployed

39. Comparing Experiments to Other Designs Many research questions cannot be studied using experimental design Large samples are required Not practical, ethical, and possible to manipulate the independent variable In these scenarios researchers may consider panel, trend, cross-sectional, or case study designs

40. Summary Study design options Refer to Table 8.2 - Summary of Design Studies Issues to consider in designing a study Ethical considerations Practicality Time Cost Feasibility of controlling the independent variable

41. Quiz – Question 1 An experimental design has the advantage over non-experimental approaches of determining the order in which events occur and controlling the effects of other variables. minimizing the costs of the research. accommodating ethical concerns. proving conclusively that a relationship is causal.

42. Quiz – Question 2 In a classic experimental design, it is important to take measures of control and experimental groups before and after treatment. at least once during the research. after the treatment. before the treatment. it is not important to take measures.

43. Quiz – Question 3 In experimental designs, it is important that the control group and the experimental group are as similar as possible. represent very different groups so that the research is generalizable. do not come from the same background. receive the same treatment.