PRACTICAL RESEARCH 2 Maam Chedz Arnigo
ESTABLISHING THE
VALIDITY AND RELIABILITY
OF THE INSTRUMENT
Cheding M. Arnigo
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
VALIDITY
What is VALIDITY?
Validity refers to the degree to which the
instrument measures what it intends to
measure. It involves collecting and analyzing
the data to assess the accuracy of an
instrument.
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
Ways to Assess the Validity
Face Validity
Content Validity
Criterion Validity
Construct Validity
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
Face Validity
 It is a subjective type of measurement.
 It is the simplest and the easiest type of validity wherein
the validator skims the surface of the instrument in
order to form an opinion.
 It is often criticized as the weakest form of validity
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
Ways to Assess the Validity
 It refers to the appropriateness of the
content of an instrument.
 It includes experts or people familiar with the
construct being measured.
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
Ways to Assess the Validity
Content Validity
Criterion Validity
This type of validity measures how well
the relationship between the measure
and an outcome.
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
Ways to Assess the Validity
3 Ways to Measure Criterion Validity
Convergent Validity
Divergent Validity
Construct Validity
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
shows instrument is highly correlated
with instruments measuring similar
variables
Example: geriatric suicide correlated to
depression
Convergent Validity
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
 shows that the instrument is poorly
correlated to instruments that measure
different variables
Example: correlation is low in instrument measuring
motivation and instrument measuring self-efficacy
Divergent Validity
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
 The instrument that has correlation with
the future criterion
Example: score of a high efficacy test related to a
performance task should predict the likelihood of
completing the task
Construct Validity
Construct Validity
 defines how well a test measures what it
claims to measure
 It is used to know whether the operational
definition of a construct aligned to the true
theoretical meaning of a concept
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
Ways to Assess the Validity
3 Types of Construct Validity
Homogeneity
Convergence
Theory of Evidence
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
This means the instrument measures one construct only.
The instrument measures construct similarly to another
instrument.
This is when behavior is similar to the theoretical
propositions of the construct measured in the instrument.
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
RELIABILITY
What is Reliability?
Reliability refers to how accurate and
precise the measuring instrument. It yields
consistent responses for repeated
measurements.
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
Ways to Assess the Reliability
Stability or Test-retest reliability
Split-half Method
Internal Consistency
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
Ways to Assess the Reliability
Stability or Test-retest reliability
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
 This is the simplest type of reliability
wherein the same questionnaire is
administered twice and a correlation
between two sets of scores is computed.
Ways to Assess the Reliability
Split-half Method
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
 Also called equivalent or parallel forms. This
is done by administering two different sets
of questionnaires but with the same topic
and a correlation between two sets of
scores is computed.
Ways to Assess the Reliability
Internal Consistency
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
 This is when the instrument measures a
specific concept. It is estimated based on a
single form of the test administered on a
single occasion.
Ways to improve the instrument
Pilot Testing
Revising the instrument
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
Activity 1
Identify the word being described in each statement. Choose the
letter of your answer in the box.
a. Validity b. Content validity c. criterion validity
d. test-retest reliability e. Face validity f. split-half method
g. Construct validity h. questionnaire i. Pilot testing
j. questionnaire k. Face validity l. Reliability
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
1. It is a degree to which a test measure what it
intends to measure
a. Validity b. Content validity c. criterion validity
d. test-retest reliability e. Face validity f. split-half method
g. Construct validity h. questionnaire i. Pilot testing
j. questionnaire k. Face validity l. Reliability
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
2. It measures the relationship between measure
and outcome.
a. Validity b. Content validity c. criterion validity
d. test-retest reliability e. Face validity f. split-half method
g. Construct validity h. questionnaire i. Pilot testing
j. questionnaire k. Face validity l. Reliability
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
3. The process of pre-testing the instrument before
distributing to the target respondents
a. Validity b. Content validity c. criterion validity
d. test-retest reliability e. Face validity f. split-half method
g. Construct validity h. questionnaire i. Pilot testing
j. questionnaire k. Face validity l. Reliability
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
4. Testing reliability by giving the test twice and
correlating two sets of scores.
a. Validity b. Content validity c. criterion validity
d. test-retest reliability e. Face validity f. split-half method
g. Construct validity h. questionnaire i. Pilot testing
j. questionnaire k. Face validity l. Reliability
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
5. A series of questions where the respondents
provide their answers.
a. Validity b. Content validity c. criterion validity
d. test-retest reliability e. Face validity f. split-half method
g. Construct validity h. questionnaire i. Pilot testing
j. questionnaire k. Face validity l. Reliability
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
6. The subjective form of validating the
instrument.
a. Validity b. Content validity c. criterion validity
d. test-retest reliability e. Face validity f. split-half method
g. Construct validity h. questionnaire i. Pilot testing
j. questionnaire k. Face validity l. Reliability
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
7. It refers to whether the operational definition of a
variable actually reflects the true theoretical
meaning of a concept.
a. Validity b. Content validity c. criterion validity
d. test-retest reliability e. Face validity f. split-half method
g. Construct validity h. questionnaire i. Pilot testing
j. questionnaire k. Face validity l. Reliability
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
8. It refers to how accurate and precise the
measuring instrument.
a. Validity b. Content validity c. criterion validity
d. test-retest reliability e. Face validity f. split-half method
g. Construct validity h. questionnaire i. Pilot testing
j. questionnaire k. Face validity l. Reliability
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
9. A process of validating with the help pf experts.
a. Validity b. Content validity c. criterion validity
d. test-retest reliability e. Face validity f. split-half method
g. Construct validity h. questionnaire i. Pilot testing
j. questionnaire k. Face validity l. Reliability
PRACTICAL RESEARCH 2 Maam Chedz Arnigo
10. Also called equivalent or parallel forms.
a. Validity b. Content validity c. criterion validity
d. test-retest reliability e. Face validity f. split-half method
g. Construct validity h. questionnaire i. Pilot testing
j. questionnaire k. Face validity l. Reliability
ESTABLISHING THE VALIDITY AND RELIABILITY [Autosaved].pptx

ESTABLISHING THE VALIDITY AND RELIABILITY [Autosaved].pptx

  • 1.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo ESTABLISHING THE VALIDITY AND RELIABILITY OF THE INSTRUMENT Cheding M. Arnigo
  • 2.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo VALIDITY
  • 3.
    What is VALIDITY? Validityrefers to the degree to which the instrument measures what it intends to measure. It involves collecting and analyzing the data to assess the accuracy of an instrument. PRACTICAL RESEARCH 2 Maam Chedz Arnigo
  • 4.
    Ways to Assessthe Validity Face Validity Content Validity Criterion Validity Construct Validity PRACTICAL RESEARCH 2 Maam Chedz Arnigo
  • 5.
    Face Validity  Itis a subjective type of measurement.  It is the simplest and the easiest type of validity wherein the validator skims the surface of the instrument in order to form an opinion.  It is often criticized as the weakest form of validity PRACTICAL RESEARCH 2 Maam Chedz Arnigo Ways to Assess the Validity
  • 6.
     It refersto the appropriateness of the content of an instrument.  It includes experts or people familiar with the construct being measured. PRACTICAL RESEARCH 2 Maam Chedz Arnigo Ways to Assess the Validity Content Validity
  • 7.
    Criterion Validity This typeof validity measures how well the relationship between the measure and an outcome. PRACTICAL RESEARCH 2 Maam Chedz Arnigo Ways to Assess the Validity
  • 8.
    3 Ways toMeasure Criterion Validity Convergent Validity Divergent Validity Construct Validity PRACTICAL RESEARCH 2 Maam Chedz Arnigo
  • 9.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo shows instrument is highly correlated with instruments measuring similar variables Example: geriatric suicide correlated to depression Convergent Validity
  • 10.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo  shows that the instrument is poorly correlated to instruments that measure different variables Example: correlation is low in instrument measuring motivation and instrument measuring self-efficacy Divergent Validity
  • 11.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo  The instrument that has correlation with the future criterion Example: score of a high efficacy test related to a performance task should predict the likelihood of completing the task Construct Validity
  • 12.
    Construct Validity  defineshow well a test measures what it claims to measure  It is used to know whether the operational definition of a construct aligned to the true theoretical meaning of a concept PRACTICAL RESEARCH 2 Maam Chedz Arnigo Ways to Assess the Validity
  • 13.
    3 Types ofConstruct Validity Homogeneity Convergence Theory of Evidence PRACTICAL RESEARCH 2 Maam Chedz Arnigo This means the instrument measures one construct only. The instrument measures construct similarly to another instrument. This is when behavior is similar to the theoretical propositions of the construct measured in the instrument.
  • 14.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo RELIABILITY
  • 15.
    What is Reliability? Reliabilityrefers to how accurate and precise the measuring instrument. It yields consistent responses for repeated measurements. PRACTICAL RESEARCH 2 Maam Chedz Arnigo
  • 16.
    Ways to Assessthe Reliability Stability or Test-retest reliability Split-half Method Internal Consistency PRACTICAL RESEARCH 2 Maam Chedz Arnigo
  • 17.
    Ways to Assessthe Reliability Stability or Test-retest reliability PRACTICAL RESEARCH 2 Maam Chedz Arnigo  This is the simplest type of reliability wherein the same questionnaire is administered twice and a correlation between two sets of scores is computed.
  • 18.
    Ways to Assessthe Reliability Split-half Method PRACTICAL RESEARCH 2 Maam Chedz Arnigo  Also called equivalent or parallel forms. This is done by administering two different sets of questionnaires but with the same topic and a correlation between two sets of scores is computed.
  • 19.
    Ways to Assessthe Reliability Internal Consistency PRACTICAL RESEARCH 2 Maam Chedz Arnigo  This is when the instrument measures a specific concept. It is estimated based on a single form of the test administered on a single occasion.
  • 20.
    Ways to improvethe instrument Pilot Testing Revising the instrument PRACTICAL RESEARCH 2 Maam Chedz Arnigo
  • 21.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo Activity 1 Identify the word being described in each statement. Choose the letter of your answer in the box. a. Validity b. Content validity c. criterion validity d. test-retest reliability e. Face validity f. split-half method g. Construct validity h. questionnaire i. Pilot testing j. questionnaire k. Face validity l. Reliability
  • 22.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo 1. It is a degree to which a test measure what it intends to measure a. Validity b. Content validity c. criterion validity d. test-retest reliability e. Face validity f. split-half method g. Construct validity h. questionnaire i. Pilot testing j. questionnaire k. Face validity l. Reliability
  • 23.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo 2. It measures the relationship between measure and outcome. a. Validity b. Content validity c. criterion validity d. test-retest reliability e. Face validity f. split-half method g. Construct validity h. questionnaire i. Pilot testing j. questionnaire k. Face validity l. Reliability
  • 24.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo 3. The process of pre-testing the instrument before distributing to the target respondents a. Validity b. Content validity c. criterion validity d. test-retest reliability e. Face validity f. split-half method g. Construct validity h. questionnaire i. Pilot testing j. questionnaire k. Face validity l. Reliability
  • 25.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo 4. Testing reliability by giving the test twice and correlating two sets of scores. a. Validity b. Content validity c. criterion validity d. test-retest reliability e. Face validity f. split-half method g. Construct validity h. questionnaire i. Pilot testing j. questionnaire k. Face validity l. Reliability
  • 26.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo 5. A series of questions where the respondents provide their answers. a. Validity b. Content validity c. criterion validity d. test-retest reliability e. Face validity f. split-half method g. Construct validity h. questionnaire i. Pilot testing j. questionnaire k. Face validity l. Reliability
  • 27.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo 6. The subjective form of validating the instrument. a. Validity b. Content validity c. criterion validity d. test-retest reliability e. Face validity f. split-half method g. Construct validity h. questionnaire i. Pilot testing j. questionnaire k. Face validity l. Reliability
  • 28.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo 7. It refers to whether the operational definition of a variable actually reflects the true theoretical meaning of a concept. a. Validity b. Content validity c. criterion validity d. test-retest reliability e. Face validity f. split-half method g. Construct validity h. questionnaire i. Pilot testing j. questionnaire k. Face validity l. Reliability
  • 29.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo 8. It refers to how accurate and precise the measuring instrument. a. Validity b. Content validity c. criterion validity d. test-retest reliability e. Face validity f. split-half method g. Construct validity h. questionnaire i. Pilot testing j. questionnaire k. Face validity l. Reliability
  • 30.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo 9. A process of validating with the help pf experts. a. Validity b. Content validity c. criterion validity d. test-retest reliability e. Face validity f. split-half method g. Construct validity h. questionnaire i. Pilot testing j. questionnaire k. Face validity l. Reliability
  • 31.
    PRACTICAL RESEARCH 2Maam Chedz Arnigo 10. Also called equivalent or parallel forms. a. Validity b. Content validity c. criterion validity d. test-retest reliability e. Face validity f. split-half method g. Construct validity h. questionnaire i. Pilot testing j. questionnaire k. Face validity l. Reliability