Presentation
Course: Classroom Assessment
Bechlours in Education (B Ed)
Reliability
Reliability is the degree to which an assessment tool
produces stable and consistent results.
Reliability Consistency
measure is considered reliable if it gives us the same
results over and over again.
different environments can affect the result.
Accurate interpretation and decision-making.
Accuracy
3 qualities for good reliability
Consistency
Dependability
)
)
)
)
)
)
)
)
)
It measures reliability.
TEST-RETEST RELIABILITY
)
)
)
)
)
)
)
)
)
The same test is taken twice from the same group
of individuals over a period of time.
After both tests results will be compared to check
whether both results are correlated or not.
It checks the consistency of scores
Process:
)
)
)
)
)
)
)
)
)
An IQ test is taken from a group of students. The
same IQ test will be taken again from the same
group of students after a week.
CONDITION: there should be NO INTERVENTION
EXAMPLE:
)
)
)
)
)
)
)
)
)
It is used to assess the consistency of the
results of two tests constructed in the same
way from the same content domain.
we measure the correlation between two
equivalent versions of a test.
Parallel forms Reliability:
Different versions of a test are designed to
be equivalent.
The same number of items/questions.
Same difficulty level.
EXAMPLE:
Surveys
Writing
Inter-Rater Relaibility:
It is a statistical measure that assesses the reliability and
consistency of the assessment process by comparing the
ratings or scores assigned by different assessors.
It is crucial in assessment as it helps ensure that the
assessment process is objective, fair, and consistent
across different assessors or raters.
Portfolio Assessment of Student Artwork
In an art class, students are required to compile a
portfolio showcasing their artwork created
throughout the year.
Multiple art teachers are assigned to evaluate the
portfolios using a set of predetermined criteria.
The scores assigned by the assessors are then
compared to determine the level of reliability.
Example:
It is the type of Reliability which used to Evaluate the
degree of Assessment through different questions asking
about the same Skill and producing Similar results.
It is used to determine the validity of Similar items on a
test.
Internal Consistency reliability
My Favorite Personality
My School.
The student should give the same answer to both.
Two questions on Essay writing:
1.
2.
If s/he knows what is the suitable structure for writing an
essay (Introduction, Body, Conclusion), s/he will get both
questions right.
Example:
References:
https://youtu.be/L9wgWUMo8DQ
https://conjointly.com/kb/types-of-reliability/
https://youtu.be/OlUVKvjMUFc
Thank
you

Relaibility in Assessment

  • 1.
  • 2.
    Reliability is thedegree to which an assessment tool produces stable and consistent results. Reliability Consistency
  • 3.
    measure is consideredreliable if it gives us the same results over and over again. different environments can affect the result. Accurate interpretation and decision-making.
  • 4.
    Accuracy 3 qualities forgood reliability Consistency Dependability
  • 5.
    ) ) ) ) ) ) ) ) ) It measures reliability. TEST-RETESTRELIABILITY ) ) ) ) ) ) ) ) ) The same test is taken twice from the same group of individuals over a period of time. After both tests results will be compared to check whether both results are correlated or not. It checks the consistency of scores Process:
  • 6.
    ) ) ) ) ) ) ) ) ) An IQ testis taken from a group of students. The same IQ test will be taken again from the same group of students after a week. CONDITION: there should be NO INTERVENTION EXAMPLE: ) ) ) ) ) ) ) ) )
  • 7.
    It is usedto assess the consistency of the results of two tests constructed in the same way from the same content domain. we measure the correlation between two equivalent versions of a test. Parallel forms Reliability:
  • 8.
    Different versions ofa test are designed to be equivalent. The same number of items/questions. Same difficulty level. EXAMPLE: Surveys Writing
  • 9.
    Inter-Rater Relaibility: It isa statistical measure that assesses the reliability and consistency of the assessment process by comparing the ratings or scores assigned by different assessors. It is crucial in assessment as it helps ensure that the assessment process is objective, fair, and consistent across different assessors or raters.
  • 10.
    Portfolio Assessment ofStudent Artwork In an art class, students are required to compile a portfolio showcasing their artwork created throughout the year. Multiple art teachers are assigned to evaluate the portfolios using a set of predetermined criteria. The scores assigned by the assessors are then compared to determine the level of reliability. Example:
  • 11.
    It is thetype of Reliability which used to Evaluate the degree of Assessment through different questions asking about the same Skill and producing Similar results. It is used to determine the validity of Similar items on a test. Internal Consistency reliability
  • 12.
    My Favorite Personality MySchool. The student should give the same answer to both. Two questions on Essay writing: 1. 2. If s/he knows what is the suitable structure for writing an essay (Introduction, Body, Conclusion), s/he will get both questions right. Example:
  • 13.
  • 14.