SlideShare a Scribd company logo
RELIABILITY IN
SELECTION
MEASURES
Workshop Presented by:
Chimere Elele #5****45
Mustafa El-Sayed #3****40
Oluwaseun Omotayo #5****85
INTRODUCTION
▪ Reliability simply means the degree
of dependability, consistency or
stability of scores on a measure
used in selection research.
▪ This can be further simplified as meaning ‘if the
test were to be repeated, the individual being
tested will score something similar.
▪ Reliability means that the selection methods,
tests and ensuing results are consistent and do
not vary with time, place or different subjects.
OBJECTIVES OF THE WORKSHOP
To know the essence of testing for
reliability in selection measures.
The various methods of estimating
reliability in selection measures.
Interpreting Reliability coefficients
How reliable should measures be
and how can Human Resource
managers reduce errors
ESSENCE OF RELIABILITY IN SELECTION
MEASURES
▪ Xobtained = Xtrue + Xerror
SELECTION MEASURE RELIABILITY BEST CANDIDATE
The essence of reliability is to estimate what percentage of an obtained
score is an error, so as to reduce to the barest minimum. A true score is
the score obtained if all conditions were perfect, while an error score
represents the score that is not related to the characteristic, trait or
attribute being measured.
Every score obtained from a selection measure is made up
of a true score and an error score.
Reliability cannot be measured per se it can only be estimated,
therefore we should not think about the reliability of a measure
rather the estimate of its reliability
METHODS OF MEASURING
RELIABILITY IN SELECTION
TEST-RETEST
RELIABILITY
PARALLEL OR
EQUIVALENT
FORMS
INTERNAL
CONSISTENCY:
a. Split-Half Reliability
b. Kuder-Richardson
Reliability
c. Cronbach’s
Coefficient Alpha
INTERRATER
RELIABILITY
ESTIMATES:
a. Interrater Agreement
b.Interclass correlation
c. Intraclass Correlation
INTERRATER RELIABILITY ESTIMATES
▪ This is done by comparing scores of
different raters of an applicant or
candidate on a particular measure.
▪ There are three categories that most of
the procedures tend to fall into they
are:
a. Interrater agreement
b. Interclass Correlation
c. Intraclass Correlation
TEST-RETEST
It is simply repeating a test on the same
subjects at different times and then
comparing the scores obtained by each
candidate in both tests.
It is advised to leave a time gap of at least 8
weeks between tests to offset the effects of
memory and practice.
A test-retest is the most common reliability
estimate.
PARALLEL OR EQUIVALENT FORMS
▪ This method of estimating reliability
is similar to the test-retest method
but instead of repeating the same
test a different form of the test is
used when retesting.
▪ One of the major reasons for this
method is to control the effect of
memory on the scores
▪ The reliability coefficient in this case
is referred to as a coefficient of
equivalence
▪ Also it is important to note that the
two versions of the measure must
be equal if not we wont have a
parallel form
INTERNAL CONSISTENCY
RELIABILITY ESTIMATE
▪ To test Internal Consistency the
relationship between similar parts of a
measure is determined.
▪ It’s a method used to measure reliability
by dividing a test into two and then
correlation is measured between both
parts.
▪ It does not require the test being taken
twice.
▪ The following procedures are mostly
applied: a. Split-Half Relibility
b. Kuder-Richardson Reliability
c. Cronbach’s coefficient alpha
INTERPRETING RELIABILITY
COEFFICIENTS
▪ It is an index that summarizes the
relationship between two or more
sets of measures.
▪ Reliability Coefficients are mainly
correlation coefficients, and the
higher the score the more reliable
the measure.
▪ There are some major relibility
coefficients such as: Pearsons
Product-moment Correlation,
Cronbach’s Coefficient Alpha,
Spearman-Brown formula, Cohen’s
Kappa, etc.
Reliability Coefficient Interpretation
0.90 & higher Excellent
0.80 - 0.89 Good
0.70 – 0.79 Adequate
Below 0.70
May have limited
applicability
HOW CAN HUMAN RESOURCE
MANAGERS ENSURE RELIABILITY
▪ To ensure reliability the measure
must be standardized
A standardized measure has the
following factors consistent.
a. Content
b. Administration
c. Scoring
The rules for
scoring are
specified
before
administering
the measure
and are
applied in the
same way
Scoring
The
information
should be
collected in
the same
condition for
all applicants
Administration
The content
of the
measure or
predictor
must be the
same
Content
FACTORS INFLUENCING THE RELIABILITY
OF A MEASURE
▪ Method of estimating reliability
▪ Individual Differences among respondents
▪ Sample
▪ Length of a Measure
▪ Test Question difficulty
▪ Homogeneity of a Measure
▪ Response Format
▪ Administration and Scoring of a Measure
HOW RELIABLE SHOULD
MEASURES BE?
Measures of selection should be as
reliable as possible, if not qualified
candidates might not be selected.
Measures should measure what it
claims to measure consistently.
CONCLUSION
Errors in selection measurements cannot be
completely eliminated, i.e. most likely the
score obtained will have an error score due
to any of the reasons discussed earlier.
It is the duty of the Hiring managers to
consistently adopt reliable measures to
reduce the percentage of errors in an
obtained score.

More Related Content

Viewers also liked

Reliability for testing and assessment
Reliability for testing and assessmentReliability for testing and assessment
Reliability for testing and assessment
Erlwinmer Mangmang
 
Characteristics of a Good Test
Characteristics of a Good TestCharacteristics of a Good Test
Characteristics of a Good Test
Ann Meredith Garcia
 
Reliability And Validity
Reliability And ValidityReliability And Validity
Reliability And Validity
James Penny
 
Reliability Testing
Reliability TestingReliability Testing
Reliability Testing
Chellamuthu K
 
Standard error of measurement
Standard error of measurementStandard error of measurement
Standard error of measurementtlcoffman
 
Standard error
Standard error Standard error
Standard error
Satyaki Mishra
 
Errors and Error Measurements
Errors and Error MeasurementsErrors and Error Measurements
Errors and Error Measurements
Milind Pelagade
 
Characteristics of a good test
Characteristics of a good test Characteristics of a good test
Characteristics of a good test
Arash Yazdani
 
Characteristics of a good test
Characteristics of a good testCharacteristics of a good test
Characteristics of a good testBoyet Aluan
 

Viewers also liked (10)

Reliability for testing and assessment
Reliability for testing and assessmentReliability for testing and assessment
Reliability for testing and assessment
 
Characteristics of a Good Test
Characteristics of a Good TestCharacteristics of a Good Test
Characteristics of a Good Test
 
Reliability And Validity
Reliability And ValidityReliability And Validity
Reliability And Validity
 
Reliability Testing
Reliability TestingReliability Testing
Reliability Testing
 
Standard error of measurement
Standard error of measurementStandard error of measurement
Standard error of measurement
 
Standard error
Standard error Standard error
Standard error
 
Errors and Error Measurements
Errors and Error MeasurementsErrors and Error Measurements
Errors and Error Measurements
 
Characteristics of a good test
Characteristics of a good test Characteristics of a good test
Characteristics of a good test
 
Errors in measurement
Errors in measurementErrors in measurement
Errors in measurement
 
Characteristics of a good test
Characteristics of a good testCharacteristics of a good test
Characteristics of a good test
 

Similar to Reliability in selection measures

Monika seminar
Monika seminarMonika seminar
Monika seminar
monika22singh
 
Monika seminar
Monika seminarMonika seminar
Monika seminar
monika22singh
 
Edm 202
Edm 202Edm 202
Edm 202
namrata227
 
Evaluation of Measurement Instruments.ppt
Evaluation of Measurement Instruments.pptEvaluation of Measurement Instruments.ppt
Evaluation of Measurement Instruments.ppt
CityComputers3
 
Reliability and validity w3
Reliability and validity w3Reliability and validity w3
Reliability and validity w3
Muhammad Ali
 
Reliability and validity
Reliability and validityReliability and validity
Reliability and validity
Muhammad Ali
 
EM&E.pptx
EM&E.pptxEM&E.pptx
EM&E.pptx
Hafiz20006
 
Establishing the English Language Test Reliability
 Establishing the  English Language Test Reliability  Establishing the  English Language Test Reliability
Establishing the English Language Test Reliability
Djihad .B
 
Selection tests and Reliability and Validity in HRM
Selection tests and Reliability and Validity in HRMSelection tests and Reliability and Validity in HRM
Selection tests and Reliability and Validity in HRM
Satya P. Joshi
 
Reliability and dependability by neil jones
Reliability and dependability by neil jonesReliability and dependability by neil jones
Reliability and dependability by neil jones
ahfameri
 
Reliability and dependability by neil jones
Reliability and dependability by neil jonesReliability and dependability by neil jones
Reliability and dependability by neil jones
Amir Hamid Forough Ameri
 
Chapter 6 - Standardized Measurement & Assessment
Chapter 6 - Standardized Measurement & AssessmentChapter 6 - Standardized Measurement & Assessment
Chapter 6 - Standardized Measurement & Assessmentkjhatzi
 
Lecture 3 measurement, reliability and validity (
Lecture   3 measurement, reliability and validity (Lecture   3 measurement, reliability and validity (
Lecture 3 measurement, reliability and validity (La Islaa
 
Reliability Validity
Reliability ValidityReliability Validity
Reliability Validity
pascastpt
 
HR 202 Chapter 11
HR 202 Chapter 11HR 202 Chapter 11
HR 202 Chapter 11
BealCollegeOnline
 
Test appraisal
Test appraisalTest appraisal
Test appraisal
AbdullahMir3
 
RELIABILITY AND VALIDITY
RELIABILITY AND VALIDITYRELIABILITY AND VALIDITY
RELIABILITY AND VALIDITY
Joydeep Singh
 
Outcomes in Occupational Therapy (& Assistive Technology)
Outcomes in Occupational Therapy (& Assistive Technology)Outcomes in Occupational Therapy (& Assistive Technology)
Outcomes in Occupational Therapy (& Assistive Technology)
will wade
 
Scales and Measures in Research
Scales and Measures in ResearchScales and Measures in Research
Scales and Measures in Research
Dr. Anamika Ray Memorial Trust
 
Characteristics of Good Evaluation Instrument
Characteristics of Good Evaluation InstrumentCharacteristics of Good Evaluation Instrument
Characteristics of Good Evaluation Instrument
Suresh Babu
 

Similar to Reliability in selection measures (20)

Monika seminar
Monika seminarMonika seminar
Monika seminar
 
Monika seminar
Monika seminarMonika seminar
Monika seminar
 
Edm 202
Edm 202Edm 202
Edm 202
 
Evaluation of Measurement Instruments.ppt
Evaluation of Measurement Instruments.pptEvaluation of Measurement Instruments.ppt
Evaluation of Measurement Instruments.ppt
 
Reliability and validity w3
Reliability and validity w3Reliability and validity w3
Reliability and validity w3
 
Reliability and validity
Reliability and validityReliability and validity
Reliability and validity
 
EM&E.pptx
EM&E.pptxEM&E.pptx
EM&E.pptx
 
Establishing the English Language Test Reliability
 Establishing the  English Language Test Reliability  Establishing the  English Language Test Reliability
Establishing the English Language Test Reliability
 
Selection tests and Reliability and Validity in HRM
Selection tests and Reliability and Validity in HRMSelection tests and Reliability and Validity in HRM
Selection tests and Reliability and Validity in HRM
 
Reliability and dependability by neil jones
Reliability and dependability by neil jonesReliability and dependability by neil jones
Reliability and dependability by neil jones
 
Reliability and dependability by neil jones
Reliability and dependability by neil jonesReliability and dependability by neil jones
Reliability and dependability by neil jones
 
Chapter 6 - Standardized Measurement & Assessment
Chapter 6 - Standardized Measurement & AssessmentChapter 6 - Standardized Measurement & Assessment
Chapter 6 - Standardized Measurement & Assessment
 
Lecture 3 measurement, reliability and validity (
Lecture   3 measurement, reliability and validity (Lecture   3 measurement, reliability and validity (
Lecture 3 measurement, reliability and validity (
 
Reliability Validity
Reliability ValidityReliability Validity
Reliability Validity
 
HR 202 Chapter 11
HR 202 Chapter 11HR 202 Chapter 11
HR 202 Chapter 11
 
Test appraisal
Test appraisalTest appraisal
Test appraisal
 
RELIABILITY AND VALIDITY
RELIABILITY AND VALIDITYRELIABILITY AND VALIDITY
RELIABILITY AND VALIDITY
 
Outcomes in Occupational Therapy (& Assistive Technology)
Outcomes in Occupational Therapy (& Assistive Technology)Outcomes in Occupational Therapy (& Assistive Technology)
Outcomes in Occupational Therapy (& Assistive Technology)
 
Scales and Measures in Research
Scales and Measures in ResearchScales and Measures in Research
Scales and Measures in Research
 
Characteristics of Good Evaluation Instrument
Characteristics of Good Evaluation InstrumentCharacteristics of Good Evaluation Instrument
Characteristics of Good Evaluation Instrument
 

Reliability in selection measures

  • 1. RELIABILITY IN SELECTION MEASURES Workshop Presented by: Chimere Elele #5****45 Mustafa El-Sayed #3****40 Oluwaseun Omotayo #5****85
  • 2. INTRODUCTION ▪ Reliability simply means the degree of dependability, consistency or stability of scores on a measure used in selection research. ▪ This can be further simplified as meaning ‘if the test were to be repeated, the individual being tested will score something similar. ▪ Reliability means that the selection methods, tests and ensuing results are consistent and do not vary with time, place or different subjects.
  • 3. OBJECTIVES OF THE WORKSHOP To know the essence of testing for reliability in selection measures. The various methods of estimating reliability in selection measures. Interpreting Reliability coefficients How reliable should measures be and how can Human Resource managers reduce errors
  • 4. ESSENCE OF RELIABILITY IN SELECTION MEASURES ▪ Xobtained = Xtrue + Xerror SELECTION MEASURE RELIABILITY BEST CANDIDATE The essence of reliability is to estimate what percentage of an obtained score is an error, so as to reduce to the barest minimum. A true score is the score obtained if all conditions were perfect, while an error score represents the score that is not related to the characteristic, trait or attribute being measured. Every score obtained from a selection measure is made up of a true score and an error score. Reliability cannot be measured per se it can only be estimated, therefore we should not think about the reliability of a measure rather the estimate of its reliability
  • 5. METHODS OF MEASURING RELIABILITY IN SELECTION TEST-RETEST RELIABILITY PARALLEL OR EQUIVALENT FORMS INTERNAL CONSISTENCY: a. Split-Half Reliability b. Kuder-Richardson Reliability c. Cronbach’s Coefficient Alpha INTERRATER RELIABILITY ESTIMATES: a. Interrater Agreement b.Interclass correlation c. Intraclass Correlation
  • 6. INTERRATER RELIABILITY ESTIMATES ▪ This is done by comparing scores of different raters of an applicant or candidate on a particular measure. ▪ There are three categories that most of the procedures tend to fall into they are: a. Interrater agreement b. Interclass Correlation c. Intraclass Correlation
  • 7. TEST-RETEST It is simply repeating a test on the same subjects at different times and then comparing the scores obtained by each candidate in both tests. It is advised to leave a time gap of at least 8 weeks between tests to offset the effects of memory and practice. A test-retest is the most common reliability estimate.
  • 8. PARALLEL OR EQUIVALENT FORMS ▪ This method of estimating reliability is similar to the test-retest method but instead of repeating the same test a different form of the test is used when retesting. ▪ One of the major reasons for this method is to control the effect of memory on the scores ▪ The reliability coefficient in this case is referred to as a coefficient of equivalence ▪ Also it is important to note that the two versions of the measure must be equal if not we wont have a parallel form
  • 9. INTERNAL CONSISTENCY RELIABILITY ESTIMATE ▪ To test Internal Consistency the relationship between similar parts of a measure is determined. ▪ It’s a method used to measure reliability by dividing a test into two and then correlation is measured between both parts. ▪ It does not require the test being taken twice. ▪ The following procedures are mostly applied: a. Split-Half Relibility b. Kuder-Richardson Reliability c. Cronbach’s coefficient alpha
  • 10. INTERPRETING RELIABILITY COEFFICIENTS ▪ It is an index that summarizes the relationship between two or more sets of measures. ▪ Reliability Coefficients are mainly correlation coefficients, and the higher the score the more reliable the measure. ▪ There are some major relibility coefficients such as: Pearsons Product-moment Correlation, Cronbach’s Coefficient Alpha, Spearman-Brown formula, Cohen’s Kappa, etc. Reliability Coefficient Interpretation 0.90 & higher Excellent 0.80 - 0.89 Good 0.70 – 0.79 Adequate Below 0.70 May have limited applicability
  • 11. HOW CAN HUMAN RESOURCE MANAGERS ENSURE RELIABILITY ▪ To ensure reliability the measure must be standardized A standardized measure has the following factors consistent. a. Content b. Administration c. Scoring The rules for scoring are specified before administering the measure and are applied in the same way Scoring The information should be collected in the same condition for all applicants Administration The content of the measure or predictor must be the same Content
  • 12. FACTORS INFLUENCING THE RELIABILITY OF A MEASURE ▪ Method of estimating reliability ▪ Individual Differences among respondents ▪ Sample ▪ Length of a Measure ▪ Test Question difficulty ▪ Homogeneity of a Measure ▪ Response Format ▪ Administration and Scoring of a Measure
  • 13. HOW RELIABLE SHOULD MEASURES BE? Measures of selection should be as reliable as possible, if not qualified candidates might not be selected. Measures should measure what it claims to measure consistently.
  • 14. CONCLUSION Errors in selection measurements cannot be completely eliminated, i.e. most likely the score obtained will have an error score due to any of the reasons discussed earlier. It is the duty of the Hiring managers to consistently adopt reliable measures to reduce the percentage of errors in an obtained score.