SlideShare a Scribd company logo
1 of 21
Download to read offline
TEST
RELIABILITY
Lecture Forum 05 – Psychometric subject
By Adiyo R – F.Psikologi
Universitas Mercu Buana, Jakarta
The consistency of
measurement
Reliability
Reliability ≠ Validity
Validity Implies Reliability,
But Reliability Does Not
Imply Validity
Carryover Effects
The influences of previous measurements on current measurements
Practice Effects
A true score is
the expected
value for the
distribution of
possible scores
for an
individual.
Population Mean
Mean for a
Specific Person
Source: W.J Schneider (2019)
Observed Score True Score Measurement Error
Hypothetical average of
many measurements
free of carryover effects
Deviations from
the True Score
True
Score
Observed
Score
Measurement
Error
80 1080 + 10 = 90
True
Score
Observed
Score
Measurement
Error
115 −15115 − 15 = 100
True
Score
Observed
Score
Measurement
Error
115 10115 + 10 = 125
Individuals with
Different
Average Scores
Individuals with
Different
Average Scores
Reliability
Coefficient
Variance of
True Scores
Variance of
Observed Scores
The Proportion of
Observed Score Variance
Due to True Score Variance
Reliability
Index
Correlation
of Observed Scores
and True Scores
Errors have an expected value of 0.
Observed scores and true scores have the same expected value.
Errors are uncorrelated with true scores.
Observed Score True Score Measurement Error
Errors are uncorrelated with each other.
Observed variance is the sum of true score and error variance.
Typical Distance of an Observed Score
from its True Score
Standard Error of Measurement
Test – Retest Reliability
• The same test is given two times
at different time.
• The correlation of the two
results of the same test is known
as test – retest reliability
Covariance
Geometric Mean
of the Variances
Split Half
Reliability
Problems
The split-half differs
depending one which way
it is split.
Halves of tests are less
reliable than whole tests.
Correlation between two
halves of tests
Cronbach’s α
The Mean of All Possible
Split-Half Correlations,
Corrected for Test Length
Accurate for parallel and true-score equivalent tests
Underestimates the reliability of congeneric tests
Overestimates the reliability of multifactorial data
Cronbach Alpha Coefficient
Factors Affecting Reliability
VARIABILITY OF SCORES PRACTICE EFFECT TEST LENGTH

More Related Content

Similar to Test reliability

2011 Orange County's Most Trusted Brands
2011 Orange County's Most Trusted Brands 2011 Orange County's Most Trusted Brands
2011 Orange County's Most Trusted Brands
DGWB
 
Chap007 measurement in_selection_editing
Chap007 measurement in_selection_editingChap007 measurement in_selection_editing
Chap007 measurement in_selection_editing
Zilafeeq Shafilla
 
Aliado risk management presentation v3a
Aliado risk management presentation v3aAliado risk management presentation v3a
Aliado risk management presentation v3a
Jody Keyser
 

Similar to Test reliability (17)

Bayesian Assurance: Formalizing Sensitivity Analysis For Sample Size
Bayesian Assurance: Formalizing Sensitivity Analysis For Sample SizeBayesian Assurance: Formalizing Sensitivity Analysis For Sample Size
Bayesian Assurance: Formalizing Sensitivity Analysis For Sample Size
 
21 may2014 f healey ps congres
21 may2014 f healey ps congres21 may2014 f healey ps congres
21 may2014 f healey ps congres
 
Balance assessment scales
Balance assessment scales Balance assessment scales
Balance assessment scales
 
Bivariate Statistics and Statistical Inference
Bivariate Statistics and Statistical InferenceBivariate Statistics and Statistical Inference
Bivariate Statistics and Statistical Inference
 
Topic validity
Topic validityTopic validity
Topic validity
 
Lund 2009
Lund 2009Lund 2009
Lund 2009
 
5 essential steps for sample size determination in clinical trials slideshare
5 essential steps for sample size determination in clinical trials   slideshare5 essential steps for sample size determination in clinical trials   slideshare
5 essential steps for sample size determination in clinical trials slideshare
 
Rep
RepRep
Rep
 
Hypothesis Testing: Spread (Compare 1:Standard)
Hypothesis Testing: Spread (Compare 1:Standard)Hypothesis Testing: Spread (Compare 1:Standard)
Hypothesis Testing: Spread (Compare 1:Standard)
 
2011 Orange County's Most Trusted Brands
2011 Orange County's Most Trusted Brands 2011 Orange County's Most Trusted Brands
2011 Orange County's Most Trusted Brands
 
Chap007 measurement in_selection_editing
Chap007 measurement in_selection_editingChap007 measurement in_selection_editing
Chap007 measurement in_selection_editing
 
Odds ratio and confidence interval
Odds ratio and confidence intervalOdds ratio and confidence interval
Odds ratio and confidence interval
 
Aliado risk management presentation v3a
Aliado risk management presentation v3aAliado risk management presentation v3a
Aliado risk management presentation v3a
 
Hypothesis Testing: Spread (Compare 1:1)
Hypothesis Testing: Spread (Compare 1:1)Hypothesis Testing: Spread (Compare 1:1)
Hypothesis Testing: Spread (Compare 1:1)
 
Final report mkt
Final report mktFinal report mkt
Final report mkt
 
Service Provider Expectations and the Word of Mouth That Follows
Service Provider Expectations and the Word of Mouth That FollowsService Provider Expectations and the Word of Mouth That Follows
Service Provider Expectations and the Word of Mouth That Follows
 
Lecture 5.Riddles of the p value, CI and alpha values
Lecture 5.Riddles of the p value, CI and alpha valuesLecture 5.Riddles of the p value, CI and alpha values
Lecture 5.Riddles of the p value, CI and alpha values
 

More from FahrulRosyid1

More from FahrulRosyid1 (20)

TES PAULI
TES PAULITES PAULI
TES PAULI
 
Kewirausahaan 2
Kewirausahaan 2Kewirausahaan 2
Kewirausahaan 2
 
teknik presentasi
teknik presentasiteknik presentasi
teknik presentasi
 
analisis item
analisis itemanalisis item
analisis item
 
Metode penelitian kualitatif observasi wawancara
Metode penelitian kualitatif observasi wawancaraMetode penelitian kualitatif observasi wawancara
Metode penelitian kualitatif observasi wawancara
 
Ragam bahasa indonesia
Ragam bahasa indonesiaRagam bahasa indonesia
Ragam bahasa indonesia
 
reliabilitas dan validitas with spss
reliabilitas dan  validitas with spss reliabilitas dan  validitas with spss
reliabilitas dan validitas with spss
 
Item analysis
Item analysis Item analysis
Item analysis
 
Test construction
Test construction Test construction
Test construction
 
Basic statistics for psychometrics
Basic statistics for psychometrics Basic statistics for psychometrics
Basic statistics for psychometrics
 
1 konsep pengukuran
1 konsep pengukuran 1 konsep pengukuran
1 konsep pengukuran
 
Desain eksperimen 1 2 kelompok
Desain eksperimen 1  2 kelompok Desain eksperimen 1  2 kelompok
Desain eksperimen 1 2 kelompok
 
Desain eksperimen 1
Desain eksperimen 1  Desain eksperimen 1
Desain eksperimen 1
 
Prinsip dasar eksperimen
Prinsip dasar eksperimen Prinsip dasar eksperimen
Prinsip dasar eksperimen
 
Checking assumption of normality
Checking assumption of normality Checking assumption of normality
Checking assumption of normality
 
Developing an instrument
Developing an instrument Developing an instrument
Developing an instrument
 
Level of measurement
Level of measurement Level of measurement
Level of measurement
 
Populasi dan sampel
Populasi dan sampel Populasi dan sampel
Populasi dan sampel
 
Finding a research idea
Finding a research idea Finding a research idea
Finding a research idea
 
Non Experimental and Experimental Designs
Non Experimental and Experimental DesignsNon Experimental and Experimental Designs
Non Experimental and Experimental Designs
 

Recently uploaded

Reboulia: features, anatomy, morphology etc.
Reboulia: features, anatomy, morphology etc.Reboulia: features, anatomy, morphology etc.
Reboulia: features, anatomy, morphology etc.
Cherry
 
Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.
Cherry
 
ONLINE VOTING SYSTEM SE Project for vote
ONLINE VOTING SYSTEM SE Project for voteONLINE VOTING SYSTEM SE Project for vote
ONLINE VOTING SYSTEM SE Project for vote
RaunakRastogi4
 
development of diagnostic enzyme assay to detect leuser virus
development of diagnostic enzyme assay to detect leuser virusdevelopment of diagnostic enzyme assay to detect leuser virus
development of diagnostic enzyme assay to detect leuser virus
NazaninKarimi6
 
COMPOSTING : types of compost, merits and demerits
COMPOSTING : types of compost, merits and demeritsCOMPOSTING : types of compost, merits and demerits
COMPOSTING : types of compost, merits and demerits
Cherry
 
Pteris : features, anatomy, morphology and lifecycle
Pteris : features, anatomy, morphology and lifecyclePteris : features, anatomy, morphology and lifecycle
Pteris : features, anatomy, morphology and lifecycle
Cherry
 
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
Scintica Instrumentation
 
Digital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptxDigital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptx
MohamedFarag457087
 

Recently uploaded (20)

Reboulia: features, anatomy, morphology etc.
Reboulia: features, anatomy, morphology etc.Reboulia: features, anatomy, morphology etc.
Reboulia: features, anatomy, morphology etc.
 
Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.
 
Understanding Partial Differential Equations: Types and Solution Methods
Understanding Partial Differential Equations: Types and Solution MethodsUnderstanding Partial Differential Equations: Types and Solution Methods
Understanding Partial Differential Equations: Types and Solution Methods
 
ONLINE VOTING SYSTEM SE Project for vote
ONLINE VOTING SYSTEM SE Project for voteONLINE VOTING SYSTEM SE Project for vote
ONLINE VOTING SYSTEM SE Project for vote
 
development of diagnostic enzyme assay to detect leuser virus
development of diagnostic enzyme assay to detect leuser virusdevelopment of diagnostic enzyme assay to detect leuser virus
development of diagnostic enzyme assay to detect leuser virus
 
COMPOSTING : types of compost, merits and demerits
COMPOSTING : types of compost, merits and demeritsCOMPOSTING : types of compost, merits and demerits
COMPOSTING : types of compost, merits and demerits
 
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
 
TransientOffsetin14CAftertheCarringtonEventRecordedbyPolarTreeRings
TransientOffsetin14CAftertheCarringtonEventRecordedbyPolarTreeRingsTransientOffsetin14CAftertheCarringtonEventRecordedbyPolarTreeRings
TransientOffsetin14CAftertheCarringtonEventRecordedbyPolarTreeRings
 
Pteris : features, anatomy, morphology and lifecycle
Pteris : features, anatomy, morphology and lifecyclePteris : features, anatomy, morphology and lifecycle
Pteris : features, anatomy, morphology and lifecycle
 
GBSN - Microbiology (Unit 5) Concept of isolation
GBSN - Microbiology (Unit 5) Concept of isolationGBSN - Microbiology (Unit 5) Concept of isolation
GBSN - Microbiology (Unit 5) Concept of isolation
 
Cot curve, melting temperature, unique and repetitive DNA
Cot curve, melting temperature, unique and repetitive DNACot curve, melting temperature, unique and repetitive DNA
Cot curve, melting temperature, unique and repetitive DNA
 
GBSN - Biochemistry (Unit 3) Metabolism
GBSN - Biochemistry (Unit 3) MetabolismGBSN - Biochemistry (Unit 3) Metabolism
GBSN - Biochemistry (Unit 3) Metabolism
 
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
 
Genome sequencing,shotgun sequencing.pptx
Genome sequencing,shotgun sequencing.pptxGenome sequencing,shotgun sequencing.pptx
Genome sequencing,shotgun sequencing.pptx
 
Terpineol and it's characterization pptx
Terpineol and it's characterization pptxTerpineol and it's characterization pptx
Terpineol and it's characterization pptx
 
CURRENT SCENARIO OF POULTRY PRODUCTION IN INDIA
CURRENT SCENARIO OF POULTRY PRODUCTION IN INDIACURRENT SCENARIO OF POULTRY PRODUCTION IN INDIA
CURRENT SCENARIO OF POULTRY PRODUCTION IN INDIA
 
Energy is the beat of life irrespective of the domains. ATP- the energy curre...
Energy is the beat of life irrespective of the domains. ATP- the energy curre...Energy is the beat of life irrespective of the domains. ATP- the energy curre...
Energy is the beat of life irrespective of the domains. ATP- the energy curre...
 
Digital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptxDigital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptx
 
FAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical ScienceFAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical Science
 
Concept of gene and Complementation test.pdf
Concept of gene and Complementation test.pdfConcept of gene and Complementation test.pdf
Concept of gene and Complementation test.pdf
 

Test reliability