SlideShare a Scribd company logo
1 of 107
Educational Research:  Causal-Comparative &  Experimental Studies ELT-718 Research Methods Asst. Prof. Dr. Hasan  BEDİR
Research... ,[object Object],… an ongoing process based on many accumulated understandings and explanations that, when taken together lead to generalizations about problems and the development of theories
The basic steps of research... Scientific and disciplined inquiry is an orderly process, involving:    description and execution of procedures to collection information (“ method ”)    objective data  analysis    statement of findings (“ results ”)    recognition and identification of a topic to be studied (“ problem ”)
Research methods... Quantitative … … collects and analyzes numerical  data  obtained from formal  instruments
Quantitative methods... ,[object Object],[object Object],[object Object],[object Object]
Research Methodologies A continuum rather than “either/or” ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Data Collection ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Causal-Comparative Research The Purpose Purpose of explaining educational phenomena through the study of cause-and-effect relationships.  The presumed cause is called the  independent variable  and the presumed effect is called the  dependent variable .  Designs where the researcher does not manipulate the independent variable are called  ex post facto research .
Causal-Comparative Research  ( Continued ) Causal-Comparative research is also a type of non-experimental investigation in which researchers seek to identify cause-effect relationships by forming groups of individuals in whom the independent variable is present or absent and than determining whether the groups differ on the dependent variable.
[object Object],… at least two different groups are compared on a  dependent variable  or measure of performance (called the “effect”) because the  independent variable  (called the “cause”) has already occurred or cannot be manipulated
Research variables... Independent … … an activity of characteristic believed to make a difference with respect to some behavior … (syn.) experimental variable, cause, treatment
dependent variable … … the change or difference occurring as a result of the independent variable … (syn.) criterion variable, effect, outcome, posttest
Data analysis and interpretation… … researcher uses a variety of  descriptive  and  inferential statistics : mean standard   deviation t-test analysis of variance chi squared
[object Object],… the descriptive statistic indicating the average performance of an individual or group on a measure of some variable
[object Object],… the descriptive statistic indicating the spread of a set of scores around the mean
[object Object],… the inferential statistic indicating whether the means of  two  groups are significantly different from one another
[object Object],… the inferential statistic indicating the presence of a significant difference among the means of  three or more groups
[object Object],… the inferential statistic indicating that there is a greater than expected difference among group frequencies
Research Design s ,[object Object],[object Object],[object Object]
Experimental Designs ,[object Object],[object Object]
Experimental Designs ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],… the researcher selects participants and divides them into two or more groups having similar characteristics and, then, applies the treatment(s) to the groups and measures the effects upon the groups
Types of experimental comparison… 1.  comparison of two different approaches ( A  versus  B ) 2.  comparison of an existing approach to a new approach ( A  and  ~  A ) 3.  comparison of differing   amounts of a single approach ( A  and  a  or  a  and  A )
where: A  – experimental (“treatment”) group B  – control (“no treatment,” “nonmanipulated”) group
Group experimental designs… 1.  single-variable 2.  factorial
[object Object],one-shot case study X  O … a single group exposed to a treatment ( X ) and then posttested ( O )
one-group pretest-posttest design O  X  O  … a single group is pretested ( O ), exposed to a treatment ( X ) and, then, is posttested ( O )
static group comparison X 1   O X 2   O … involves at least two groups ( X ), one receiving a new, or experimental treatment ( X 1  ) and another receiving a traditional, or control treatment ( X 2  ) and, then, are posttested ( O )
“ True” experiments defined ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],pretest-posttest control group design R  O  X 1   O R  O  X 2   O
… at least two groups are formed by random assignment ( R ), administered a pretest ( O ), receive different treatments ( X 1 , X 2  ), are administered a posttest, and posttest scores are compared to determine effectiveness of treatments
posttest-only control group design R  X 1   O R  X 2   O
… at least two groups are formed by random assignment ( R ), receive different treatments ( X 1 , X 2  ), are administered a posttest, and posttest scores are compared to determine effectiveness of treatments
Solomon four-group design R  O  X 1   O R  O  X 2   O R  X 1   O R  X 2   O
… four groups are formed by random assignment ( R ) of participants, two groups are pretested ( O ) and two are not, one pretested and one unpretested group receive the experimental treatments ( X 1 , X 2  ), each group is are administered a posttest on the dependent variable, and posttest scores are compared to determine effectiveness of treatments
[object Object],… involve two or more independent variables with at least one independent variable being manipulated by the researcher
Experimental Design Factorial Design Diagram Independent Variable #1:  Teaching Method Independent   Variable #2: Aptitude Randomly assigned 3 rd graders scoring below 60 on  an aptitude test. Randomly assigned 3 rd graders scoring below 60 on  an aptitude test. Randomly assigned 3 rd graders scoring about 85 on  an aptitude test. Randomly assigned 3 rd graders scoring above 85 on  an aptitude test. Reading/Lecture/Etc. Lecture Only High Low
Independent Variable #1  Teaching Method How many possible Teaching Methods are there? Which will be the methods used in the study? If more than one will be used, each method may be considered a  factor  of the variable known as Teaching Method. Teaching Method Lecture only Lecture & Small Group Discussion
Independent Variable #2  Aptitude How many possible levels of aptitude are there? How many may be represented in the group of subjects participating in the study? Once identified, levels of aptitude may be considered  factors  of the variable known as Aptitude. Low High Aptitude
Lecture only Lecture & Small Group Discussion Low High
[object Object],two-by-two factorial design  (four cells) 2  X  2 … two types of factors (e.g., method of instruction) each of which has two levels (e.g., traditional vs. innovative)
A 2 X 2 factorial design… Independent Variable A B Dependent Variable O O Group #1 Group #2 Group #3 Group #4 Cells not manipulated manipulated
A 2 X 2 factorial design… A No interaction between factors B
A 2 X 2 factorial design… A No interaction between factors B
A 2 X 2 factorial design… A Interacting factors B
A 2 X 2 factorial design… A Interacting factors B
two-by-three factorial design  (six cells) 2  X  3 … two types of factors (e.g., motivation; interest) each of which has three levels (e.g., high, medium, low)
Single-subject experimental designs… 1.  A – B – A withdrawal 2.  multiple baseline designs 3.  alternating treatments designs
[object Object],… baseline measurements ( O ) are repeatedly made until stability is established, then the treatment ( X ) is introduced and an appropriate number of measurements ( O ) are made during treatment implementation
[object Object],O  O  O  X  O  X  O  X  O baseline  treatment   phase  phase A  |  B
[object Object],… baseline measurements ( O ) are repeatedly made until stability is established, then the treatment ( X ) is introduced and an appropriate number of measurements ( O ) are made during treatment implementation, followed by an appropriate number of baseline measurements ( O ) to determine stability of treatment ( X )
[object Object],O  O  O  X  O  X  O  X  O  O  O baseline  treatment  baseline   phase  phase  phase A  |  B  |   A
[object Object],… used when a return to baseline conditions is difficult or impossible since treatment effects oftentimes do not disappear when a treatment is removed
…“ multiple” refers to the study of more than one behavior, participant, or setting
… instead of collecting baseline data on one specific behavior, data are collected on: (1) several behaviors for one participant, (2) one behavior for several participants, or (3) one behavior and one participant in several settings
… then, over a period of time, the treatment is systematically applied to each behavior (or participant, or setting) one at a time until all behaviors (or participants or settings)  have been exposed to the treatment
[object Object],Example: one treatment for three behaviors in three settings behavior 1  O  O  OXOXOXOXOXOXOXOXOXOXOXO  setting #1 behavior 2  O  O  O  O  O  OXOXOXOXOXOXOXO  setting #2 behavior 3  O  O  O  O  O  O  O  O  OXOXOXO  setting #3 A B the baseline remains the same… … while the treatment is applied at other settings
Threats to validity… … internal : factors other than the independent variable that affect the dependent variable … external : factors that affect the generalizability of the study to groups and settings beyond those of the experiment
Threats to internal validity… 1.  history 2.  maturation 3.  testing 4.  instrumentation 5.  statistical regression 6.  differential selection of participants 7.  mortality 8.  selection-maturation interaction
[object Object],… the occurrence of events that are not part of the experimental treatment but that occur during the study and affect the dependent variable
[object Object],… the physical, intellectual, and emotional changes that occur naturally in a study’s participants over a period of time
[object Object],… refers to improved scores on a posttest as a result of having taken a pretest
[object Object],… the unreliability or lack of consistency in measuring instruments that can result in an invalid assessment of performance
[object Object],… the tendency of participants who score highest on a test to score lower on a second, similar test and vice versa
[object Object],… the outcome when already formed groups are compared raising the possibility that the groups were different before a study even begins
[object Object],… the case in which participants drop out of a study which changes the characteristics of the groups and may significantly affect the study’s results
[object Object],… if already-formed groups are used in a study, one group may profit more (or less) from a treatment or have an initial advantage because of maturation, history, or testing factors
Threats to external validity… 1.  pretest-treatment interaction 2.  selection-treatment interaction 3.  multiple treatment interference 4.  specificity of variables 5.  treatment diffusion 6.  experimenter effects 7.  reactive effects
[object Object],… the situation when participants respond or react differently to a treatment because they have been pretested
[object Object],… the situation when the same participants receive more than one treatment in succession
[object Object],… the situation when participants are not randomly selected for treatments
[object Object],… the situation when a study is conducted with (1) a specific kind of participant; (2) is based on a particular operational definition of the independent variable; (3) uses specific dependent variables; (4) transpires at a specific time; and, (5) under a specific set of circumstances
[object Object],… the situation when different treatment groups communicate with and learn from each other
[object Object],… the situation when the researchers present potential threats to the external validity of their own studies
[object Object],… the situation when a number of factors associated with the way in which a study is conducted interacts with or shapes the feelings and attitudes of the participants involved
Types of reactive arrangements… … Hawthorne effect : any situation in which participants’ behavior is affected not by the treatment per se but by their knowledge of participating in a study … compensatory rivalry : the control group is informed that they will be the control group for a new, experimental study (“ John Henry effect ”)
… placebo effect : the situation in which half of the participants receive no treatment but believe they are … novelty effect : the situation in which  participant interest, motivation, or engagement increases simply because they are doing something different
Controlling for extraneous (confounding) variables… 1.  randomization 2.  matching 3.  comparing homogeneous groups or subgroups 4.  using participants as their own controls 5.  analysis of covariance (ANCOVA)
[object Object],… the process of selecting and assigning participants in such a way that all individuals in the defined population have an equal and independent chance of being selected for the sample
[object Object],… a technique for equating groups on one or more variables, usually the ones highly related to performance on the dependent variable (e.g., pairwise matching)
[object Object],… a technique to control an extraneous variable by comparing groups that are similar with respect to that variable (e.g., stratified sampling)
[object Object],… exposing a single group to different treatments one treatment at a time
Data analysis and interpretation… ,[object Object],… a visual inspection and analysis of graphical presentations of results … focuses upon: adequacy of the design; an assessment of treatment effectiveness ( clinical  vs.  statistical significance )
Mini-Quiz… ,[object Object],… causal-comparative studies  attempt  to identify the cause-effect relationships; correlational studies do not True
… causal-comparative studies typically involve two (or more) groups and one independent variable, whereas correlational studies typically involve two (or more) variables and one group True
… causal-comparative studies involve relation, whereas correlational  studies involve cause False
… oftentimes, causal-comparative research is undertaken because the independent variable could be manipulated but should not True
… one of the most important reasons for conducting causal-comparative research is to identify variables worthy of experimental investigation True
…“ lack of control” means that the researcher can and should  manipulate the independent variable False
… each group in a causal-comparative study represents a different population True
… the more similar two groups are on all relevant variables except the independent variable, the stronger the study is True
… there is random assignment to treatment groups from a single population in causal-comparative studies False
… lack of randomization, manipulation of the independent variable, and control are all sources of weakness in a causal-comparative design True
… matching, comparing homogenous groups or subgroups, and covariate analysis are strategies that enable researchers to overcome problems of initial group differences on an extraneous variable True
… interpretation of the findings in a causal-comparative study requires considerable caution because the cause may be the effect and the effect may be the cause True
… extraneous variables or confounding factors may be the real “cause” of both the independent and dependent variables True
[object Object],… groups selected for a causal-comparative study which differ on some independent variable and comparing them on some dependent variable comparison groups
[object Object],… unexplained variables that influence a dependent variable  confounding factors extraneous variables
[object Object],… a method for controlling extraneous variables by comparing groups that are homogeneous with respect to the extraneous variable comparing homogeneous groups
[object Object],… a method for controlling extraneous variables by forming subgroups within each group that represent all levels of the control variable comparing homogeneous subgroups
[object Object],… a statistical tool to determine the effects of the independent variable and the control variable on the dependent variable, both separately and in combination factorial analysis of variance
[object Object],… the descriptive statistic indicating the average performance of a group on a measure of some variable mean
[object Object],… the descriptive statistic indicating how clustered or spread out around the mean a set of scores is standard deviation
[object Object],… the inferential statistic determining whether there is a significant difference between the means of  two  groups t-test
[object Object],… the inferential statistic determining whether there is a significant difference between the means of  three or more  groups analysis of variance
[object Object],… the inferential statistic determining whether there is a greater than expected difference among group frequencies chi squared
[object Object],… activities by which a researcher endeavors to ensure that the results of a causal-comparative study are not tainted by extraneous variables control

More Related Content

What's hot

Experimental research
Experimental researchExperimental research
Experimental research
dhinnar
 
Comparative and non-comparative study
Comparative and non-comparative studyComparative and non-comparative study
Comparative and non-comparative study
u070536
 
Causal comparative research
Causal comparative researchCausal comparative research
Causal comparative research
Jahanzeb Jahan
 
Causalcomparativeresearch 150312133324-conversion-gate01-converted
Causalcomparativeresearch 150312133324-conversion-gate01-convertedCausalcomparativeresearch 150312133324-conversion-gate01-converted
Causalcomparativeresearch 150312133324-conversion-gate01-converted
Dr. Hina Kaynat
 
Survey, correlational & ccr research (SHEHA GROUP)
Survey, correlational & ccr research (SHEHA GROUP)Survey, correlational & ccr research (SHEHA GROUP)
Survey, correlational & ccr research (SHEHA GROUP)
Sheha Shaida Tuan Hadzri
 
Causal comparative study
Causal comparative studyCausal comparative study
Causal comparative study
wawaaa789
 
Experimental research
Experimental researchExperimental research
Experimental research
izzajalil
 

What's hot (20)

Causal Comparative Research / Ex- Post Facto
Causal Comparative Research / Ex- Post FactoCausal Comparative Research / Ex- Post Facto
Causal Comparative Research / Ex- Post Facto
 
Experimental research
Experimental researchExperimental research
Experimental research
 
Comparative and non-comparative study
Comparative and non-comparative studyComparative and non-comparative study
Comparative and non-comparative study
 
Causal comparative research
Causal comparative researchCausal comparative research
Causal comparative research
 
Causal comparative research
Causal comparative researchCausal comparative research
Causal comparative research
 
Chapter15
Chapter15Chapter15
Chapter15
 
Experimental method of Educational Research.
Experimental method of Educational Research.Experimental method of Educational Research.
Experimental method of Educational Research.
 
Experimental research sd
Experimental research sdExperimental research sd
Experimental research sd
 
How to Know if a Quantitative Research Design Is Appropriate for Your Study
How to Know if a Quantitative Research Design Is Appropriate for Your StudyHow to Know if a Quantitative Research Design Is Appropriate for Your Study
How to Know if a Quantitative Research Design Is Appropriate for Your Study
 
EX POST FACTO RESEARCH
EX POST FACTO RESEARCHEX POST FACTO RESEARCH
EX POST FACTO RESEARCH
 
Research Method - Ex Post Facto Research
Research Method - Ex Post Facto ResearchResearch Method - Ex Post Facto Research
Research Method - Ex Post Facto Research
 
experimental research ppt
experimental research pptexperimental research ppt
experimental research ppt
 
Causalcomparativeresearch 150312133324-conversion-gate01-converted
Causalcomparativeresearch 150312133324-conversion-gate01-convertedCausalcomparativeresearch 150312133324-conversion-gate01-converted
Causalcomparativeresearch 150312133324-conversion-gate01-converted
 
Survey, correlational & ccr research (SHEHA GROUP)
Survey, correlational & ccr research (SHEHA GROUP)Survey, correlational & ccr research (SHEHA GROUP)
Survey, correlational & ccr research (SHEHA GROUP)
 
Quantitative research present
Quantitative research   presentQuantitative research   present
Quantitative research present
 
Causal comparative study
Causal comparative studyCausal comparative study
Causal comparative study
 
What is an experimental research (1)
What is an experimental research (1)What is an experimental research (1)
What is an experimental research (1)
 
Experimental Research Design - Meaning, Characteristics and Classification
Experimental Research Design - Meaning, Characteristics and ClassificationExperimental Research Design - Meaning, Characteristics and Classification
Experimental Research Design - Meaning, Characteristics and Classification
 
Experimental research
Experimental researchExperimental research
Experimental research
 
Experimental method
Experimental methodExperimental method
Experimental method
 

Viewers also liked

Definition and types of research
Definition and types of researchDefinition and types of research
Definition and types of research
fadifm
 
Emotional and Behavioral Disorders (EBD) and Grade I Pupils' Achievements
Emotional and Behavioral Disorders (EBD) and Grade I Pupils' AchievementsEmotional and Behavioral Disorders (EBD) and Grade I Pupils' Achievements
Emotional and Behavioral Disorders (EBD) and Grade I Pupils' Achievements
Ernie Cerado
 
Statistic Chart
Statistic ChartStatistic Chart
Statistic Chart
hw0830
 
1.1 An Overview of Statistics
1.1 An Overview of Statistics1.1 An Overview of Statistics
1.1 An Overview of Statistics
leblance
 
Sopheap's Using Spss presentation
Sopheap's Using Spss presentationSopheap's Using Spss presentation
Sopheap's Using Spss presentation
pheapping
 
Applied Statistical Techniques
Applied Statistical TechniquesApplied Statistical Techniques
Applied Statistical Techniques
dafutdok
 
Probability Distributions
Probability DistributionsProbability Distributions
Probability Distributions
Harish Lunani
 
Handling data scattergraph
Handling data scattergraphHandling data scattergraph
Handling data scattergraph
Steve Bishop
 

Viewers also liked (20)

Educational Research
Educational ResearchEducational Research
Educational Research
 
Research Methods: Basic Concepts and Methods
Research Methods: Basic Concepts and MethodsResearch Methods: Basic Concepts and Methods
Research Methods: Basic Concepts and Methods
 
Definition and types of research
Definition and types of researchDefinition and types of research
Definition and types of research
 
HCI research methods by Sanjay Tripathi, ABB
HCI research methods by Sanjay Tripathi, ABBHCI research methods by Sanjay Tripathi, ABB
HCI research methods by Sanjay Tripathi, ABB
 
Causal
CausalCausal
Causal
 
Quanti tony coloma
Quanti tony colomaQuanti tony coloma
Quanti tony coloma
 
Type research
Type researchType research
Type research
 
Grounded Theory
Grounded TheoryGrounded Theory
Grounded Theory
 
Emotional and Behavioral Disorders (EBD) and Grade I Pupils' Achievements
Emotional and Behavioral Disorders (EBD) and Grade I Pupils' AchievementsEmotional and Behavioral Disorders (EBD) and Grade I Pupils' Achievements
Emotional and Behavioral Disorders (EBD) and Grade I Pupils' Achievements
 
Statistic Chart
Statistic ChartStatistic Chart
Statistic Chart
 
Questionnaires
QuestionnairesQuestionnaires
Questionnaires
 
1.1 An Overview of Statistics
1.1 An Overview of Statistics1.1 An Overview of Statistics
1.1 An Overview of Statistics
 
Sopheap's Using Spss presentation
Sopheap's Using Spss presentationSopheap's Using Spss presentation
Sopheap's Using Spss presentation
 
Applied Statistical Techniques
Applied Statistical TechniquesApplied Statistical Techniques
Applied Statistical Techniques
 
Les5e ppt 01
Les5e ppt 01Les5e ppt 01
Les5e ppt 01
 
Chi square
Chi squareChi square
Chi square
 
Thiyagu statistics
Thiyagu   statisticsThiyagu   statistics
Thiyagu statistics
 
Probability Distributions
Probability DistributionsProbability Distributions
Probability Distributions
 
Handling data scattergraph
Handling data scattergraphHandling data scattergraph
Handling data scattergraph
 
Research Design
Research DesignResearch Design
Research Design
 

Similar to Cs comp&experiemental2011 12

Experimental, Quasi experimental, Single-Case, and Internet-based Researches ...
Experimental, Quasi experimental, Single-Case, and Internet-based Researches ...Experimental, Quasi experimental, Single-Case, and Internet-based Researches ...
Experimental, Quasi experimental, Single-Case, and Internet-based Researches ...
Hatice Çilsalar
 

Similar to Cs comp&experiemental2011 12 (20)

action research Experimental Research Design.pptx
action research Experimental Research Design.pptxaction research Experimental Research Design.pptx
action research Experimental Research Design.pptx
 
Adlt673 session 5_2017
Adlt673 session 5_2017Adlt673 session 5_2017
Adlt673 session 5_2017
 
Experimental research
Experimental researchExperimental research
Experimental research
 
Between groups design
Between groups designBetween groups design
Between groups design
 
Pre- Experimental Research
Pre- Experimental Research Pre- Experimental Research
Pre- Experimental Research
 
Experimental Research Design
Experimental Research DesignExperimental Research Design
Experimental Research Design
 
Quantitative research design
Quantitative research designQuantitative research design
Quantitative research design
 
Experimental Design
Experimental DesignExperimental Design
Experimental Design
 
Shovan anova main
Shovan anova mainShovan anova main
Shovan anova main
 
Refl
ReflRefl
Refl
 
1 ANOVA.ppt
1 ANOVA.ppt1 ANOVA.ppt
1 ANOVA.ppt
 
Experimental, Quasi experimental, Single-Case, and Internet-based Researches ...
Experimental, Quasi experimental, Single-Case, and Internet-based Researches ...Experimental, Quasi experimental, Single-Case, and Internet-based Researches ...
Experimental, Quasi experimental, Single-Case, and Internet-based Researches ...
 
RESEARCH DESIGN 5.pptx
RESEARCH DESIGN 5.pptxRESEARCH DESIGN 5.pptx
RESEARCH DESIGN 5.pptx
 
Experimental design
Experimental designExperimental design
Experimental design
 
Experimental design
Experimental designExperimental design
Experimental design
 
Experimental Studies
Experimental StudiesExperimental Studies
Experimental Studies
 
Research design mahesh
Research design maheshResearch design mahesh
Research design mahesh
 
Research design and approachs
Research design and approachsResearch design and approachs
Research design and approachs
 
Research in Psychology
Research in PsychologyResearch in Psychology
Research in Psychology
 
Applied statistics part 3
Applied statistics part 3Applied statistics part 3
Applied statistics part 3
 

Recently uploaded

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Recently uploaded (20)

Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 

Cs comp&experiemental2011 12

  • 1. Educational Research: Causal-Comparative & Experimental Studies ELT-718 Research Methods Asst. Prof. Dr. Hasan BEDİR
  • 2.
  • 3. The basic steps of research... Scientific and disciplined inquiry is an orderly process, involving:  description and execution of procedures to collection information (“ method ”)  objective data analysis  statement of findings (“ results ”)  recognition and identification of a topic to be studied (“ problem ”)
  • 4. Research methods... Quantitative … … collects and analyzes numerical data obtained from formal instruments
  • 5.
  • 6.
  • 7.
  • 8. Causal-Comparative Research The Purpose Purpose of explaining educational phenomena through the study of cause-and-effect relationships. The presumed cause is called the independent variable and the presumed effect is called the dependent variable . Designs where the researcher does not manipulate the independent variable are called ex post facto research .
  • 9. Causal-Comparative Research ( Continued ) Causal-Comparative research is also a type of non-experimental investigation in which researchers seek to identify cause-effect relationships by forming groups of individuals in whom the independent variable is present or absent and than determining whether the groups differ on the dependent variable.
  • 10.
  • 11. Research variables... Independent … … an activity of characteristic believed to make a difference with respect to some behavior … (syn.) experimental variable, cause, treatment
  • 12. dependent variable … … the change or difference occurring as a result of the independent variable … (syn.) criterion variable, effect, outcome, posttest
  • 13. Data analysis and interpretation… … researcher uses a variety of descriptive and inferential statistics : mean standard deviation t-test analysis of variance chi squared
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23. Types of experimental comparison… 1. comparison of two different approaches ( A versus B ) 2. comparison of an existing approach to a new approach ( A and ~ A ) 3. comparison of differing amounts of a single approach ( A and a or a and A )
  • 24. where: A – experimental (“treatment”) group B – control (“no treatment,” “nonmanipulated”) group
  • 25. Group experimental designs… 1. single-variable 2. factorial
  • 26.
  • 27. one-group pretest-posttest design O X O … a single group is pretested ( O ), exposed to a treatment ( X ) and, then, is posttested ( O )
  • 28. static group comparison X 1 O X 2 O … involves at least two groups ( X ), one receiving a new, or experimental treatment ( X 1 ) and another receiving a traditional, or control treatment ( X 2 ) and, then, are posttested ( O )
  • 29.
  • 30.
  • 31. … at least two groups are formed by random assignment ( R ), administered a pretest ( O ), receive different treatments ( X 1 , X 2 ), are administered a posttest, and posttest scores are compared to determine effectiveness of treatments
  • 32. posttest-only control group design R X 1 O R X 2 O
  • 33. … at least two groups are formed by random assignment ( R ), receive different treatments ( X 1 , X 2 ), are administered a posttest, and posttest scores are compared to determine effectiveness of treatments
  • 34. Solomon four-group design R O X 1 O R O X 2 O R X 1 O R X 2 O
  • 35. … four groups are formed by random assignment ( R ) of participants, two groups are pretested ( O ) and two are not, one pretested and one unpretested group receive the experimental treatments ( X 1 , X 2 ), each group is are administered a posttest on the dependent variable, and posttest scores are compared to determine effectiveness of treatments
  • 36.
  • 37. Experimental Design Factorial Design Diagram Independent Variable #1: Teaching Method Independent Variable #2: Aptitude Randomly assigned 3 rd graders scoring below 60 on an aptitude test. Randomly assigned 3 rd graders scoring below 60 on an aptitude test. Randomly assigned 3 rd graders scoring about 85 on an aptitude test. Randomly assigned 3 rd graders scoring above 85 on an aptitude test. Reading/Lecture/Etc. Lecture Only High Low
  • 38. Independent Variable #1 Teaching Method How many possible Teaching Methods are there? Which will be the methods used in the study? If more than one will be used, each method may be considered a factor of the variable known as Teaching Method. Teaching Method Lecture only Lecture & Small Group Discussion
  • 39. Independent Variable #2 Aptitude How many possible levels of aptitude are there? How many may be represented in the group of subjects participating in the study? Once identified, levels of aptitude may be considered factors of the variable known as Aptitude. Low High Aptitude
  • 40. Lecture only Lecture & Small Group Discussion Low High
  • 41.
  • 42. A 2 X 2 factorial design… Independent Variable A B Dependent Variable O O Group #1 Group #2 Group #3 Group #4 Cells not manipulated manipulated
  • 43. A 2 X 2 factorial design… A No interaction between factors B
  • 44. A 2 X 2 factorial design… A No interaction between factors B
  • 45. A 2 X 2 factorial design… A Interacting factors B
  • 46. A 2 X 2 factorial design… A Interacting factors B
  • 47. two-by-three factorial design (six cells) 2 X 3 … two types of factors (e.g., motivation; interest) each of which has three levels (e.g., high, medium, low)
  • 48. Single-subject experimental designs… 1. A – B – A withdrawal 2. multiple baseline designs 3. alternating treatments designs
  • 49.
  • 50.
  • 51.
  • 52.
  • 53.
  • 54. …“ multiple” refers to the study of more than one behavior, participant, or setting
  • 55. … instead of collecting baseline data on one specific behavior, data are collected on: (1) several behaviors for one participant, (2) one behavior for several participants, or (3) one behavior and one participant in several settings
  • 56. … then, over a period of time, the treatment is systematically applied to each behavior (or participant, or setting) one at a time until all behaviors (or participants or settings) have been exposed to the treatment
  • 57.
  • 58. Threats to validity… … internal : factors other than the independent variable that affect the dependent variable … external : factors that affect the generalizability of the study to groups and settings beyond those of the experiment
  • 59. Threats to internal validity… 1. history 2. maturation 3. testing 4. instrumentation 5. statistical regression 6. differential selection of participants 7. mortality 8. selection-maturation interaction
  • 60.
  • 61.
  • 62.
  • 63.
  • 64.
  • 65.
  • 66.
  • 67.
  • 68. Threats to external validity… 1. pretest-treatment interaction 2. selection-treatment interaction 3. multiple treatment interference 4. specificity of variables 5. treatment diffusion 6. experimenter effects 7. reactive effects
  • 69.
  • 70.
  • 71.
  • 72.
  • 73.
  • 74.
  • 75.
  • 76. Types of reactive arrangements… … Hawthorne effect : any situation in which participants’ behavior is affected not by the treatment per se but by their knowledge of participating in a study … compensatory rivalry : the control group is informed that they will be the control group for a new, experimental study (“ John Henry effect ”)
  • 77. … placebo effect : the situation in which half of the participants receive no treatment but believe they are … novelty effect : the situation in which participant interest, motivation, or engagement increases simply because they are doing something different
  • 78. Controlling for extraneous (confounding) variables… 1. randomization 2. matching 3. comparing homogeneous groups or subgroups 4. using participants as their own controls 5. analysis of covariance (ANCOVA)
  • 79.
  • 80.
  • 81.
  • 82.
  • 83.
  • 84.
  • 85. … causal-comparative studies typically involve two (or more) groups and one independent variable, whereas correlational studies typically involve two (or more) variables and one group True
  • 86. … causal-comparative studies involve relation, whereas correlational studies involve cause False
  • 87. … oftentimes, causal-comparative research is undertaken because the independent variable could be manipulated but should not True
  • 88. … one of the most important reasons for conducting causal-comparative research is to identify variables worthy of experimental investigation True
  • 89. …“ lack of control” means that the researcher can and should manipulate the independent variable False
  • 90. … each group in a causal-comparative study represents a different population True
  • 91. … the more similar two groups are on all relevant variables except the independent variable, the stronger the study is True
  • 92. … there is random assignment to treatment groups from a single population in causal-comparative studies False
  • 93. … lack of randomization, manipulation of the independent variable, and control are all sources of weakness in a causal-comparative design True
  • 94. … matching, comparing homogenous groups or subgroups, and covariate analysis are strategies that enable researchers to overcome problems of initial group differences on an extraneous variable True
  • 95. … interpretation of the findings in a causal-comparative study requires considerable caution because the cause may be the effect and the effect may be the cause True
  • 96. … extraneous variables or confounding factors may be the real “cause” of both the independent and dependent variables True
  • 97.
  • 98.
  • 99.
  • 100.
  • 101.
  • 102.
  • 103.
  • 104.
  • 105.
  • 106.
  • 107.