SlideShare a Scribd company logo
1 of 10
Chapter 3
Review
Fylliccia D’Angelo
EVidence based Practice
1.When designing a course your decisions
should be based on….
a.Fads (what is already done)
b.Opinions
c.Politics
d.Ideology
*Evidence-based practice is an effective
method due to the research dedicated to each
idea/theory.
Three Approaches to Research on Instructional
effectiveness
*Identify methods that have been shown to
improve learning*
1.What works?--does this instructional method
cause learning? Compare the test performance
of people who used the instructional feature
versus those who did not.
2.When does it work?--does this method work
better for certain types of learners?
Instructional effectiveness continued...
3. How does it work?--what learning process
determines the effectiveness of your chosen
method?
Research methods to the 3 approaches
1.Experimental comparison: find something that
that you and learners are interested in.
Find appropriate research. Find experiments
that meet the criteria of good research.
2.Factorial experimental materials or
environments comparison: identify
appropriate materials
3.Observation, interview, questionnaire: a
variety of methods to assess data
Good research methodology
1.Control→ a test that stays the same/the
control group to determine the results
2.Random Assignment→ assigned to groups
known as treatment groups
3.Appropriate Measure→ This will tell you
the Mean, Standard Deviation and Sample
Size for each group.
How to interpret no effect in experimental comparisons
Why is there no difference between the control
group and the treatment group?
1.Ineffective Treatment: no effect on learning
on learning
2.Inadequate Sample Size: not enough learners
in the group
3.Insensitive Measure: dependent measure not
sensitive enough to detect differences in
learning outcome
4. Inadequate Treatment Implementation: the
treatment and control group were not different
enough from one another
5. Insensitivity to Learners: learners not
sensitive enough to treatment
6. Confounding Variable: treatment and control
group differ one another important variable
Interpreting research statistics
1.Probability less than .05:
a.There is a difference due to the
treatment given
2.Probability greater than .5:
a.If ES= .5 the impact is moderate
b.If ES= .8 the impact/effect is large
Relevant research--how to identify it.
1.The similarities in your learners and the
learners in the study
2.The conclusions are based on an experimental
research design
3.How many times has the study been conducted?
Were the results the same?
4.Do the tests used measure actual learning?
5.Does the data reflect practical and
statistical significance?

More Related Content

What's hot

Methodology Checklist : Systematic Reviews and Meta-analyses Notes for comple...
Methodology Checklist : Systematic Reviews and Meta-analyses Notes for comple...Methodology Checklist : Systematic Reviews and Meta-analyses Notes for comple...
Methodology Checklist : Systematic Reviews and Meta-analyses Notes for comple...QURATULAIN MUGHAL
 
Revising instructional materials
Revising instructional materialsRevising instructional materials
Revising instructional materialsLaSheena Nation
 
Handouts English III Top 20 Part 2
Handouts English III Top 20 Part 2Handouts English III Top 20 Part 2
Handouts English III Top 20 Part 2Greco Gervin Cruz
 
Research Methodology - Selecting an evaluation
Research Methodology - Selecting an evaluation Research Methodology - Selecting an evaluation
Research Methodology - Selecting an evaluation Md. Shafiuzzaman Hira
 
Psychology module 4
Psychology module 4Psychology module 4
Psychology module 4asuncion
 
Chapter 3
Chapter 3Chapter 3
Chapter 3raapjom
 
How does a scientists work
How does a scientists workHow does a scientists work
How does a scientists workLevi Nebres
 
Adler clark 4e ppt 07
Adler clark 4e ppt 07Adler clark 4e ppt 07
Adler clark 4e ppt 07arpsychology
 
Nr523 week-7-assignment-application-exercise-3-latest-2020-january
Nr523 week-7-assignment-application-exercise-3-latest-2020-januaryNr523 week-7-assignment-application-exercise-3-latest-2020-january
Nr523 week-7-assignment-application-exercise-3-latest-2020-january071241345
 
Analyzingandusingtestitemdata 101012035435-phpapp02
Analyzingandusingtestitemdata 101012035435-phpapp02Analyzingandusingtestitemdata 101012035435-phpapp02
Analyzingandusingtestitemdata 101012035435-phpapp02cezz gonzaga
 
Fdu item analysis (1).ppt revised by dd
Fdu item analysis (1).ppt revised by ddFdu item analysis (1).ppt revised by dd
Fdu item analysis (1).ppt revised by dddettmore
 
Qualities of Good Test (Usability, Reliability, & Validity)
Qualities of Good Test (Usability, Reliability, & Validity)Qualities of Good Test (Usability, Reliability, & Validity)
Qualities of Good Test (Usability, Reliability, & Validity)HennaAnsari
 
Basics of Systematic Review and Meta-analysis: Part 3
Basics of Systematic Review and Meta-analysis: Part 3Basics of Systematic Review and Meta-analysis: Part 3
Basics of Systematic Review and Meta-analysis: Part 3Rizwan S A
 
Class 5 designing so tl studies
Class 5   designing so tl studiesClass 5   designing so tl studies
Class 5 designing so tl studiestjcarter
 

What's hot (18)

Methodology Checklist : Systematic Reviews and Meta-analyses Notes for comple...
Methodology Checklist : Systematic Reviews and Meta-analyses Notes for comple...Methodology Checklist : Systematic Reviews and Meta-analyses Notes for comple...
Methodology Checklist : Systematic Reviews and Meta-analyses Notes for comple...
 
Revising instructional materials
Revising instructional materialsRevising instructional materials
Revising instructional materials
 
Handouts English III Top 20 Part 2
Handouts English III Top 20 Part 2Handouts English III Top 20 Part 2
Handouts English III Top 20 Part 2
 
Research Methodology - Selecting an evaluation
Research Methodology - Selecting an evaluation Research Methodology - Selecting an evaluation
Research Methodology - Selecting an evaluation
 
Psychology module 4
Psychology module 4Psychology module 4
Psychology module 4
 
Chapter 3
Chapter 3Chapter 3
Chapter 3
 
How does a scientists work
How does a scientists workHow does a scientists work
How does a scientists work
 
Chapter 4 b
Chapter 4 bChapter 4 b
Chapter 4 b
 
Adler clark 4e ppt 07
Adler clark 4e ppt 07Adler clark 4e ppt 07
Adler clark 4e ppt 07
 
Nr523 week-7-assignment-application-exercise-3-latest-2020-january
Nr523 week-7-assignment-application-exercise-3-latest-2020-januaryNr523 week-7-assignment-application-exercise-3-latest-2020-january
Nr523 week-7-assignment-application-exercise-3-latest-2020-january
 
Paper 12 ELT
Paper 12 ELTPaper 12 ELT
Paper 12 ELT
 
Analyzingandusingtestitemdata 101012035435-phpapp02
Analyzingandusingtestitemdata 101012035435-phpapp02Analyzingandusingtestitemdata 101012035435-phpapp02
Analyzingandusingtestitemdata 101012035435-phpapp02
 
Experimental method
Experimental method Experimental method
Experimental method
 
Fdu item analysis (1).ppt revised by dd
Fdu item analysis (1).ppt revised by ddFdu item analysis (1).ppt revised by dd
Fdu item analysis (1).ppt revised by dd
 
Qualities of Good Test (Usability, Reliability, & Validity)
Qualities of Good Test (Usability, Reliability, & Validity)Qualities of Good Test (Usability, Reliability, & Validity)
Qualities of Good Test (Usability, Reliability, & Validity)
 
Basics of Systematic Review and Meta-analysis: Part 3
Basics of Systematic Review and Meta-analysis: Part 3Basics of Systematic Review and Meta-analysis: Part 3
Basics of Systematic Review and Meta-analysis: Part 3
 
Test Utility
Test UtilityTest Utility
Test Utility
 
Class 5 designing so tl studies
Class 5   designing so tl studiesClass 5   designing so tl studies
Class 5 designing so tl studies
 

Similar to Chapter 3

Introduction to nursing research
Introduction to nursing researchIntroduction to nursing research
Introduction to nursing researchNursing Hi Nursing
 
Psychology module 4
Psychology module 4Psychology module 4
Psychology module 4asuncion
 
Unit 2 types of research
Unit 2 types of researchUnit 2 types of research
Unit 2 types of researchAsima shahzadi
 
POWERPOINTTECHNICALTERMS.pptx
POWERPOINTTECHNICALTERMS.pptxPOWERPOINTTECHNICALTERMS.pptx
POWERPOINTTECHNICALTERMS.pptxJinx36
 
educational research by Gay, Mils and Alrasian
educational research by Gay, Mils and Alrasianeducational research by Gay, Mils and Alrasian
educational research by Gay, Mils and Alrasianmanzoor83
 
Ch1 introduction to educational research
Ch1 introduction to educational researchCh1 introduction to educational research
Ch1 introduction to educational researchsaima sardar
 
CONCEPTUALIZATION AND PLANNING RESEARCH.pptx
CONCEPTUALIZATION AND PLANNING RESEARCH.pptxCONCEPTUALIZATION AND PLANNING RESEARCH.pptx
CONCEPTUALIZATION AND PLANNING RESEARCH.pptxRuthJoshila
 
1.3 Experimental Design and Observational Studies
1.3 Experimental Design and Observational Studies 1.3 Experimental Design and Observational Studies
1.3 Experimental Design and Observational Studies MaryWall14
 
Research Activity 1.docx
Research Activity 1.docxResearch Activity 1.docx
Research Activity 1.docxAsheFritz
 
Internal and External threat to Validity
Internal and External threat to ValidityInternal and External threat to Validity
Internal and External threat to ValidityZehra Khushal
 
Action research in guidance made easy
Action research in guidance made easyAction research in guidance made easy
Action research in guidance made easyJayson Hernandez
 
statistics 02.ppt
statistics 02.pptstatistics 02.ppt
statistics 02.pptCade143
 
Research Proposal The articles for this proposal is attach.docx
Research Proposal The articles for this proposal is attach.docxResearch Proposal The articles for this proposal is attach.docx
Research Proposal The articles for this proposal is attach.docxgholly1
 

Similar to Chapter 3 (20)

Chapter 3
Chapter 3Chapter 3
Chapter 3
 
Introduction to nursing research
Introduction to nursing researchIntroduction to nursing research
Introduction to nursing research
 
Psychology module 4
Psychology module 4Psychology module 4
Psychology module 4
 
Unit 2 types of research
Unit 2 types of researchUnit 2 types of research
Unit 2 types of research
 
POWERPOINTTECHNICALTERMS.pptx
POWERPOINTTECHNICALTERMS.pptxPOWERPOINTTECHNICALTERMS.pptx
POWERPOINTTECHNICALTERMS.pptx
 
CH01.PPT
CH01.PPTCH01.PPT
CH01.PPT
 
educational research by Gay, Mils and Alrasian
educational research by Gay, Mils and Alrasianeducational research by Gay, Mils and Alrasian
educational research by Gay, Mils and Alrasian
 
Educational Research.PPT
Educational Research.PPTEducational Research.PPT
Educational Research.PPT
 
Ch1 introduction to educational research
Ch1 introduction to educational researchCh1 introduction to educational research
Ch1 introduction to educational research
 
Ch01 intro
Ch01 introCh01 intro
Ch01 intro
 
CONCEPTUALIZATION AND PLANNING RESEARCH.pptx
CONCEPTUALIZATION AND PLANNING RESEARCH.pptxCONCEPTUALIZATION AND PLANNING RESEARCH.pptx
CONCEPTUALIZATION AND PLANNING RESEARCH.pptx
 
1.3 Experimental Design and Observational Studies
1.3 Experimental Design and Observational Studies 1.3 Experimental Design and Observational Studies
1.3 Experimental Design and Observational Studies
 
Research Activity 1.docx
Research Activity 1.docxResearch Activity 1.docx
Research Activity 1.docx
 
Internal and External threat to Validity
Internal and External threat to ValidityInternal and External threat to Validity
Internal and External threat to Validity
 
Action research in guidance made easy
Action research in guidance made easyAction research in guidance made easy
Action research in guidance made easy
 
Quantitative research methodologies
Quantitative research methodologiesQuantitative research methodologies
Quantitative research methodologies
 
Quantitative research methodologies
Quantitative research methodologiesQuantitative research methodologies
Quantitative research methodologies
 
statistics 02.ppt
statistics 02.pptstatistics 02.ppt
statistics 02.ppt
 
Research Proposal The articles for this proposal is attach.docx
Research Proposal The articles for this proposal is attach.docxResearch Proposal The articles for this proposal is attach.docx
Research Proposal The articles for this proposal is attach.docx
 
Chapter 9-METHODS OF DATA COLLECTION
Chapter 9-METHODS OF DATA COLLECTIONChapter 9-METHODS OF DATA COLLECTION
Chapter 9-METHODS OF DATA COLLECTION
 

Recently uploaded

Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Celine George
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionSafetyChain Software
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsanshu789521
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991RKavithamani
 
Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application ) Sakshi Ghasle
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfchloefrazer622
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docxPoojaSen20
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxVS Mahajan Coaching Centre
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesFatimaKhan178732
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
Micromeritics - Fundamental and Derived Properties of Powders
Micromeritics - Fundamental and Derived Properties of PowdersMicromeritics - Fundamental and Derived Properties of Powders
Micromeritics - Fundamental and Derived Properties of PowdersChitralekhaTherkar
 

Recently uploaded (20)

Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Staff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSDStaff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSD
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory Inspection
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha elections
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
 
Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application )
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdf
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
 
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docx
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and Actinides
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Micromeritics - Fundamental and Derived Properties of Powders
Micromeritics - Fundamental and Derived Properties of PowdersMicromeritics - Fundamental and Derived Properties of Powders
Micromeritics - Fundamental and Derived Properties of Powders
 

Chapter 3

  • 2. EVidence based Practice 1.When designing a course your decisions should be based on…. a.Fads (what is already done) b.Opinions c.Politics d.Ideology *Evidence-based practice is an effective method due to the research dedicated to each idea/theory.
  • 3. Three Approaches to Research on Instructional effectiveness *Identify methods that have been shown to improve learning* 1.What works?--does this instructional method cause learning? Compare the test performance of people who used the instructional feature versus those who did not. 2.When does it work?--does this method work better for certain types of learners?
  • 4. Instructional effectiveness continued... 3. How does it work?--what learning process determines the effectiveness of your chosen method?
  • 5. Research methods to the 3 approaches 1.Experimental comparison: find something that that you and learners are interested in. Find appropriate research. Find experiments that meet the criteria of good research. 2.Factorial experimental materials or environments comparison: identify appropriate materials 3.Observation, interview, questionnaire: a variety of methods to assess data
  • 6. Good research methodology 1.Control→ a test that stays the same/the control group to determine the results 2.Random Assignment→ assigned to groups known as treatment groups 3.Appropriate Measure→ This will tell you the Mean, Standard Deviation and Sample Size for each group.
  • 7. How to interpret no effect in experimental comparisons Why is there no difference between the control group and the treatment group? 1.Ineffective Treatment: no effect on learning on learning 2.Inadequate Sample Size: not enough learners in the group 3.Insensitive Measure: dependent measure not sensitive enough to detect differences in learning outcome
  • 8. 4. Inadequate Treatment Implementation: the treatment and control group were not different enough from one another 5. Insensitivity to Learners: learners not sensitive enough to treatment 6. Confounding Variable: treatment and control group differ one another important variable
  • 9. Interpreting research statistics 1.Probability less than .05: a.There is a difference due to the treatment given 2.Probability greater than .5: a.If ES= .5 the impact is moderate b.If ES= .8 the impact/effect is large
  • 10. Relevant research--how to identify it. 1.The similarities in your learners and the learners in the study 2.The conclusions are based on an experimental research design 3.How many times has the study been conducted? Were the results the same? 4.Do the tests used measure actual learning? 5.Does the data reflect practical and statistical significance?