Reliability of Assessment Tools PPT

1. Reliability
of
Assessment Tools
EDEM 511

2. Reliability
It refers to whether an assessment instrument gives
the same results each time it is used in the same
setting with the same type of subjects. Reliability
essentially means consistent or dependable results.
Reliability is a part of the assessment of validity.
Reliability of Assessment Tools 2

3. 1. Test-retest reliability
The test-retest reliability method in research
involves giving a group of people the same test
more than once. If the results of the test are
similar each time you give it to the sample
group, that shows your research method is likely
reliable and not influenced by external factors.
Reliability of Assessment Tools 3
4 Ways To Assess Reliability in
Research

4. 2. Parallel forms reliability
This strategy involves giving the same group of
people multiple types of tests to determine if the
results stay the same when using different
research methods. If they do, this means the
methods are likely reliable because, otherwise,
the participants in the sample group may behave
differently and change the results.
Reliability of Assessment Tools 4
4 Ways To Assess Reliability in
Research

5. 3. Inter-rater reliability
The inter-rater reliability testing involves multiple researchers assessing
a sample group and comparing their results. This can help them avoid
influencing factors related to the assessor, including:
- Personal bias
- Mood
- Human error
If most of the results from different assessors are similar, it's likely the
research method is reliable and can produce usable research because
the assessors gathered the same data from the group.
Reliability of Assessment Tools 5
4 Ways To Assess Reliability in
Research

6. 4. Internal consistency reliability
Checking for internal consistency in research involves making sure your
internal research methods or parts of research methods deliver the same
results. There are two typical ways to make this determination:
Split-half reliability test: You can perform this test by splitting a research
method, like a survey or test, in half, delivering both halves separately to a
sample group, then comparing the results to ensure the method can
produce consistent results. If the results are consistent, then the results of
the research method are likely reliable.
Inter-item reliability test: With this assessment, you administer sample
groups multiple testing items, like with parallel forms reliability testing, and
calculate the correlation between the results of each of the method
results. With this information, you calculate the average and use the
number to determine if the results are reliable.
Reliability of Assessment Tools 6
4 Ways To Assess Reliability in
Research

7. 1. Plan ahead
2. Make note of the environment
3. Consider the participants
4. Review results thoroughly
5. Think about the type of research
Reliability of Assessment Tools 7
Tips for testing the reliability of Research
Methods

8. Thank you