SlideShare a Scribd company logo
Assessment of
learning 1
Distracter Analysis
1.Distracter
Distracter is term used for the incorrect
option in the multiple choice type of test while the
correct answers represents the key.
Item analysis we can identify non-performing
test items, but this item seldom indicates the error
or the problem in the given item.
Factors why students failed to get the
correct answer in given question:
a. it is not taught in the class properly.
b. it is ambiguous.
c. the correct answer is not the given option.
d. it has more than one correct answer.
e. It contains grammatical clues to mislead the students.
f. The student is not aware of the correct.
g. The students were confused by the logic of the
question because it has double negatives.
h. The students failed to study the lesson.
Distracter Analysis
2.Miskeyed item
The test item is a potential miskey if there are more
students from the upper group who choose the incorrect
options than the key.
3.Guessing item
Student from the upper group have equal spread of
choices among the given alternatives.
Distracter Analysis
Students from the upper group guess their
answers because of the following reasons:
a. The content of the test is not
discussed in the class or in the text.
b. The test item is very difficult.
c. The question is trivial.
Distracter Analysis
4. Ambiguous item
This happen when more students from
the upper group choose equally an
incorrect option and the keyed answer.
Qualitative Item Analysis
Qualitative item analysis(Zurawski, R. M) is a process in which the
teacher or expert carefully proofreads the best test before is
administered, to check if there are typographical errors, to avoid
grammatical clues that may lead to giving away the correct answer,
and to ensure that the level of reading materials is appropriate.
These procedures can also include small group discussion on the
quality of the examination are its item, with examinees that have
already took the test.
Students who took the examination are asked to express verbally
their experience in answering each item in the examination. This
procedure can help the teacher in determining why they
misunderstood a certain item.
Types of Quantitative Item
Analysis
Difficulty index
Discrimination index
Response Option Analysis
Difficulty Index
Level of Difficulty of an Item
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Moderately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Difficulty Index Formula
n
F
=
N
_____ ,where
F
= Difficulty index
n =
Number of students selecting the item
correctly in upper and lower group.
N= Total number of students who answered the test.
D
Discrimination Index
Level of Discrimination
Index Range Discrimination Level
0.19 and below Poor item, should be eliminated
or need to be revised
0.20-0.29 Marginal item, needs some
revision
0.30- 0.39 Reasonably good item but
possibly for improvement
0.40 and above Very good item
Discrimination Index
D C
1
=
D
________________ ,where
1
= Discrimination index value
UG =
Number of students selecting the
correct answer in the upper group.
C = Number of students selecting then correct
answer in the lower group.
UG
__
LG
C
C
LG
= Number of students in either the
lower group or upper group.
IMPROVING TEST
ITEMSConsider the following examples in analyzing the test and some notes on
how to improve the item based from the result of item analysis.
Example 1. A class is composed of 40 students. Divide the group into two.
Option B is the correct answer. Based from the given data on the table, as a
teacher, what would you do with the test item?
How to improve the test item
Options A B * C D E
Upper group 3 10 4 0 3
Lower group 4 4 8 0 4
1. Compute the difficulty index.
0.35 OR 35%
n = 10+4=14
N = 40
DF
n
F =
N
_____ ,whereD
14
F =
40
_____ ,whereD
=
Options A B * C D E
Upper
group
3 10 4 0 3
Lower
group
4 4 8 0 4
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
2. Compute the discrimination index.
0.30 OR 30%
=10
1 =
D
______________ ,whereD
20=D
C
UG
= 4
UG
C
LG
C __ CLG
Options A B * C D E
Upper
group
3 10 4 0 3
Lower
group
4 4 8 0 4
10 __
4
20
___________
6
20
______
=
=
=
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
1
1
D
3. Make an analysis about the level of difficulty,
discrimination and distracters.
a. Only 35% of the examines got the answer correctly, hence, the item is
difficult.
b. More students from the upper group got the answer correctly, hence,
has a positive discrimination.
c. Retain option A, C, and E because most of the students who did not
perform well in the overall examination selected it. Those option
most students from the lower group.
4. Conclusion: Retain the test item but change option D, make it more
realistic to make it effective for the upper and lower groups. At least 5%
of the examinees choose the incorrect answer.
IMPROVING TEST ITEMS
IMPROVING TEST
ITEMS
Options A B * C D E
Upper
group
3 10 4 0 3
Lower
group
4 4 8 0 4
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
a.Only 35% of the examines got the
answer correctly, hence, the item is
difficult.
b.More students from the upper group got the
answer correctly, hence, it has a positive
discrimination.
c.Retain option A, C, and E because most of the
students who did not perform well in the overall
examination selected it. Those option attract
most students from the lower group.
4. Conclusion: Retain the test item but change option
D, make it more realistic to make it effective for the
upper and lower groups. At least 5% of the examinees
choose the incorrect answer.
Response option analysis
3. Make an analysis about the level of
difficulty, discrimination and distracters.
IMPROVING TEST
ITEMSExample 2. A class is composed of 50 students. Use 27% to get the upper
and the lower groups. Analyze the item given the following results. Option D
is the correct answer. What will you do with the test item?
How to improve the test item
Options A B C D * E
Upper group (27%) 3 1 2 6 2
Lower group (27%) 5 0 4 4 1
1. Compute the difficulty index.
0.36 OR 36%
n = 6+4=10
N = 28
DF
n
F =
N
_____ ,whereD
10
F =
28
_____ ,whereD
=
Options A B C D * E
Upper
group
(27%)
3 1 2 6 2
Lower
group
(27%)
5 0 4 4 1
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
2. Compute the discrimination index.
0.14 OR 14%
= 6
1 =
D
______________ ,whereD
14=D
C
UG
= 4
UG
C
LG
C __ CLG
6 __
4
14
___________
2
14
______
=
=
=
Options A B C D * E
Upper
group
(27%)
3 1 2 6 2
Lower
group
(27%)
5 0 4 4 1
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
D
1
1
3. Make an analysis about the level of difficulty, discrimination and distracters.
a. Only 36% of the examines got the answer correctly, hence, the item is
difficult.
b. More students from the upper group got the answer correctly, hence, it has
positive discrimination.
c. Modify option B and E because more students from the upper group chose
them compare with the lower group, hence, They are not effective
because most of the students who performed well in the overall
selected them as their answer.
4. Conclusion: Retain A and C because most of the students who did not
perform well in the overall examination selected them as the correct answers.
Hence, option A and C are effective distracters.
IMPROVING TEST ITEMS
IMPROVING TEST
ITEMSIndex Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Response option analysis
a.Only 36% of the examines got the
answer correctly, hence, the item is
difficult.
b.More students from the upper group got the
answer correctly, hence, it has a positive
discrimination.
c.Modify option B and E because more students
from the upper group chose them compare with
the lower group, hence, They are not effective
distracters because most of the students who
performed well in the overall examination selected
them as their answer.
Options A B C D * E
Upper
group
(27%)
3 1 2 6 2
Lower
group
(27%)
5 0 4 4 1
Conclusion: Retain A and C because most of the students
who did not perform well in the overall examination selected
them as the correct answers. Hence, option A and C are
effective distracters.
3. Make an analysis about the level of
difficulty, discrimination and distracters.
IMPROVING TEST
ITEMSExample 3. A class is composed of 50 students. Use 27% to get the upper
and the lower groups. Analyze the item given the following results. Option E
is the correct answer. What will you do with the test item?
How to improve the test item
Options A B C D E *
Upper group (27%) 2 3 2 2 5
Lower group (27%) 2 2 1 1 8
1. Compute the difficulty index.
OR %
n = + =
N =
DF
n
F =
N
_____ ,whereD
F = _____ ,?D
=
Options A B C D E *
Upper
group
(27%)
2 3 2 2 5
Lower
group
(27%)
2 2 1 1 8
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
2. Compute the discrimination index.
OR %
=
1 =
D
______________ ,whereD
=D
C
UG
=
UG
C
LG
C __ CLG
__
___________,?
______
=
=
=
Options A B C D E *
Upper
group
(27%)
2 3 2 2 5
Lower
group
(27%)
2 2 1 1 8
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
1
1
D
3. Make an analysis about the level of difficulty, discrimination and
distracters.
a. Only ____________ got the answer correctly, hence, the item is moderately
difficult.
b. More students from the lower group got the answer correctly, therefor, it has
__________________________ . The discrimination index is -21%.
c. No need to analyze the distracters because the item discriminates
________________ .
d. Modify all the distracters because they are not effective. Most of the students
the upper group chose the incorrect option. The options are effective if most
the students in the lower group chose the incorrect options.
4. Conclusion: Reject the item because it has a ___________________ index.
IMPROVING TEST ITEMS
IMPROVING TEST
ITEMSIndex Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Response option analysis
a.Only 46% got the answer
correctly, hence, the item is
moderately difficult.
b.More students from the lower group got the
answer correctly, therefor, it has a negative
discrimination The discrimination index is -21%.
Options A B C D E *
Upper
group
(27%)
2 3 2 2 5
Lower
group
(27%)
2 2 1 1 8
c.No need to analyze the distracters because
the item discriminates negatively.
d.Modify all the distracters
because they are not effective.
Most of the students in the upper
group chose the incorrect option.
The options are effective if most
of the students in the lower
group chose the incorrect
options.
4. Conclusion: Reject the item because it has a negative
discrimination index.
3. Make an analysis about the level
of difficulty, discrimination and
distracters
IMPROVING TEST
ITEMSExample 4.POTENTIAL MISKEYED ITEM. Make an item
analysis about the table below. What will you do with the
that is potential miskeyed item?
How to improve the test item
Options A * B C D E
Upper group 1 2 3 10 4
Lower group 3 4 4 4 5
1. Compute the difficulty index.
0.10 OR 10%
n = 1+3=4
N = 40
DF
n
F =
N
_____ ,whereD
4
F =
40
_____ ,whereD
=
Options A * B C D E
Upper
group
1 2 3 10 4
Lower
group
3 4 4 4 5
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
2. Compute the discrimination index.
-0.10 OR -10%
=1
1 =
D
______________ ,whereD
20=D
C
UG
= 3
UG
C
LG
C __ CLG
1 __
3
20
___________
-2
20
______
=
=
=
Options A * B C D E
Upper
group
1 2 3 10 4
Lower
group
3 4 4 4 5
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
D
1
1
3. Make an analysis:
a. More students from the upper group choose option D that option A,
even though option A is the supposedly the correct answer.
b. Mostly likely the teacher has written the wrong answer key.
c. The teacher checks and finds out that he/she did not miskey the answer
that he/she thought is the correct answer.
d. If the teacher miskeyed it he/she must check and retally the score of the
students’ test papers before giving them back.
e. If option A is really the correct answer, revise to weaken option D,
distracters are not supposed to draw more attention than the keyed
answer.
IMPROVING TEST ITEMS
3. Make an analysis:
f. Only 10% of the students got the answer to the test item correctly,
hence, the test item is very difficult.
g. More students from the lower group got the item correctly,
therefore a negative discrimination resulted. The discrimination
index is -10%
h. No need to analyze the distracters because the test item is very
difficult and discrimination negatively.
4. Conclusion: reject the item because it is very difficult and a has
negative discrimination index.
IMPROVING TEST ITEMS
IMPROVING TEST
ITEMSIndex Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Response option analysis a.More students from the upper group
choose option D that option A, even
though option A is the supposedly the
correct answer.
Options A * B C D E
Upper
group
1 2 3 10 4
Lower
group
3 4 4 4 5
b.Mostly likely the teacher has
written the wrong answer key.
c.The teacher checks and finds out that
he/she did not miskey the answer that
he/she thought is the correct answer.
d.If the teacher miskeyed it he/she
must check and retally the score of
the students’ test papers before
giving them back.
e.If option A is really the correct answer,
revise to weaken option D, distracters are
not supposed to draw more attention than
the keyed answer.
f.Only 10% of the students got the
answer to the test item correctly,
hence, the test item is very difficult.
g.More students from the lower group
got the item correctly, therefore a
negative discrimination resulted. The
discrimination index is -10%
h.No need to analyze the distracters because the test
item is very difficult and discrimination negatively.
4. Conclusion: reject the item because it is
very difficult and a has negative
discrimination index.
3. Make an analysis: potential miskeyed item
IMPROVING TEST
ITEMSExample 5. AMBIGUOUS ITEM. Below is the result of item analysis of
a test with an ambiguous test item. What can you say about the
item? Are you going to retain, revise or reject?
How to improve the test item
Options A B C D E *
Upper group 7 1 1 2 8
Lower group 6 2 3 3 6
1. Compute the difficulty index.
0.36 OR 36%
n = 8+6=14
N = 39
DF
n
F =
N
_____ ,whereD
14
F =
39
_____ ,whereD
=
Options A B C D E *
Upper
group
7 1 1 2 8
Lower
group
6 2 3 3 6
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
2. Compute the discrimination index.
0.10 OR 10%
=8
1 =
D
______________ ,whereD
20=D
C
UG
= 6
UG
C
LG
C __ CLG
8 __
6
20
___________
2
20
______
=
=
=
Options A B C D E *
Upper
group
7 1 1 2 8
Lower
group
6 2 3 3 6
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
1
1
D
3. Make an analysis:
a. Only 36% of the students got the answer to test item correctly,
hence, the test item is difficult.
b.More students from the upper group got the item correctly, hence,
it discriminates positively. The discrimination index is 10%
c. About equal numbers of top students went for option A and
option E, this implies that they could not tell which is the correct
answer. The students do not know the content of the test, thus, a
reteach is needed.
4. Conclusion: Revise the test item because it is ambiguous.
IMPROVING TEST ITEMS
IMPROVING TEST
ITEMSIndex Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Response option analysis
Options A B C D E *
Upper
group
7 1 1 2 8
Lower
group
6 2 3 3 6
3. Make an analysis: ambiguous item
a.Only 36% of the students
got the answer to test item
correctly, hence, the test item
is difficult.
b.More students from the upper group got the
item correctly, hence, it discriminates positively. The
discrimination index is 10%
c.About equal numbers of top students went for option
A and option E, this implies that they could not tell
which is the correct answer. The students do not know
the content of the test, thus, a reteach is needed.
4.Conclusion: Revise the test
item because it is
ambiguous.
IMPROVING TEST
ITEMSExample 6.GUESSING ITEM. Below is the result of item
analysis of a test with students’ answers mostly based on a
guess. Are you going to retain, revise or reject?
How to improve the test item
Options A B C * D E
Upper group 4 3 4 3 6
Lower group 3 4 3 4 5
1. Compute the difficulty index.
0.18 OR 18%
n = 4+3=7
N = 39
DF
n
F =
N
_____ ,whereD
7
F =
39
_____ ,whereD
=
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Options A B C * D E
Upper
group
4 3 4 3 6
Lower
group
3 4 3 4 5
2. Compute the discrimination index.
0.05 OR 5%
=4
1 =
D
______________ ,whereD
20=D
C
UG
= 3
UG
C
LG
C __ CLG
4 __
3
20
___________
1
20
______
=
=
=
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Options A B C * D E
Upper
group
4 3 4 3 6
Lower
group
3 4 3 4 5
D1
1
3. Make an analysis:
a. Only18% of the students got the answer to the test item correctly.
b. More students from the upper group got the correct answer to the test item;
therefore, the test item is positive discrimination. The discrimination index is 5%.
c. Students responds about equally to all alternatives, an indication that they are
guessing.
Three possibilities why student guesses the answer on a test item:
The content of the test item has not yet been discussed in the class
because the test is designed in advance;
Test item were badly written that students have no idea what the question
is really all about: and
Test item were very difficult as shown from the difficulty index and low
discrimination index.
IMPROVING TEST ITEMS
3. Make an analysis:
d.If the test is well-written but too difficult, reteach
material to the class.
4. Conclusion: Reject the item because it is very
difficult and the discrimination index is very poor, and
option A and B are not effective distracters.
IMPROVING TEST ITEMS
IMPROVING TEST
ITEMSIndex Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Response option analysis
3. Make an analysis: guessing item
Options A B C * D E
Upper
group
4 3 4 3 6
Lower
group
3 4 3 4 5
a.Only18% of the students got the
answer to the test item correctly.
b.More students from the upper group got the correct
answer to the test item; therefore, the test item is
positive discrimination. The discrimination index is 5%.
c.Students responds about equally to all
alternatives, an indication that they are
guessing.
d.If the test is well-written but too
difficult, reteach the material to
the class.
4. Conclusion: Reject the item
because it is very difficult and the
discrimination index is very poor, and
option A and B are not effective
distracters.
IMPROVING TEST
ITEMSExample 7.Reject the item because it is very difficult and the
discrimination index is very poor, and options A and B are
not effective distracters.
How to improve the test item
Options A B C * D E
Upper group 5 3 9 0 3
Lower group 6 4 6 0 4
1. Compute the difficulty index.
OR %
n = + =
N =
DF
n
F =
N
_____ ,whereD
F = _____ ,?D
=
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Options A B C * D E
Upper
group
5 3 9 0 3
Lower
group
6 4 6 0 4
2. Compute the discrimination index.
OR %
=
1 =
D
______________ ,whereD
=D
C
UG
=
UG
C
LG
C __ CLG
__
___________,?
______
=
=
=
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Options A B C * D E
Upper
group
5 3 9 0 3
Lower
group
6 4 6 0 4
1
1
D
3. Make an analysis about the level of difficulty, discrimination and
distracters.
a. Only ____________ got the answer correctly, hence, the item is
difficult.
b.More students from the upper group answer the test item correctly,
a result, the test got a __________________________ . The discrimination
index is 15%
c. Option A,B, and E are attractive and effective distracters.
d.Option D is in effective; therefore, changing it with more realistic
one.
4. Conclusion: Revise the item by changing option D.
IMPROVING TEST ITEMS
IMPROVING TEST
ITEMSIndex Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Response option analysis
3. Make an analysis:
a.Only 38% got the answer
correctly, hence, the item is
difficult.
Options A B C * D E
Upper
group
5 3 9 0 3
Lower
group
6 4 6 0 4
b.More students from the upper group answer
the test item correctly, as a result, the test got
a positive discrimination. The discrimination
index is 15%
c.Option A,B, and E are attractive and
effective distracters.
d.Option D is in effective; therefore, changing
it with more realistic one.
4. Conclusion: Revise the item by
changing option D.
The End

More Related Content

What's hot

Writing Instructional Objectives in the Affective Domain
Writing Instructional Objectives in the Affective DomainWriting Instructional Objectives in the Affective Domain
Writing Instructional Objectives in the Affective Domain
Mr. Ronald Quileste, PhD
 
Process oriented performance-based assessment
Process oriented performance-based assessmentProcess oriented performance-based assessment
Process oriented performance-based assessmentrenarch
 
Alternative-Response Test
Alternative-Response TestAlternative-Response Test
Alternative-Response Test
MD Pits
 
authentic vs. traditional assessment
authentic vs. traditional assessmentauthentic vs. traditional assessment
authentic vs. traditional assessmentfreshious
 
Analyzing and using test item data
Analyzing and using test item dataAnalyzing and using test item data
Analyzing and using test item data
Lance Gerard G. Abalos LPT, MA
 
Authentic Assessment Tools
Authentic Assessment ToolsAuthentic Assessment Tools
Authentic Assessment Tools
Sarah Abigail Diaz
 
Field Study 1, Episode 1 "The School as a Learning Environment"
Field Study 1, Episode 1 "The School as a Learning Environment"Field Study 1, Episode 1 "The School as a Learning Environment"
Field Study 1, Episode 1 "The School as a Learning Environment"
Ruschelle Cossid
 
Item Analysis
Item AnalysisItem Analysis
Item Analysis
Ann Meredith Garcia
 
Field Study 2 Episode 1 Principles of Learning
Field Study 2 Episode 1 Principles of LearningField Study 2 Episode 1 Principles of Learning
Field Study 2 Episode 1 Principles of Learning
Ruschelle Cossid
 
Rubrics (Analytic and Holistic)
Rubrics (Analytic and Holistic)Rubrics (Analytic and Holistic)
Rubrics (Analytic and Holistic)
Jeziel Dela Cruz
 
Improving the test items
Improving the test itemsImproving the test items
Improving the test items
Fernando Rayos Jr.
 
Qualitative item analysis
Qualitative item analysisQualitative item analysis
Qualitative item analysis
Bienvenido Trabajada
 
Philosophy of education
Philosophy of educationPhilosophy of education
Philosophy of education
Arneyo
 
Portfolio Assessment
Portfolio AssessmentPortfolio Assessment
Portfolio Assessment
janehbasto
 
Portfolio assessment
Portfolio assessmentPortfolio assessment
Portfolio assessment
Carlo Magno
 
Process oriented learning competencies
Process  oriented learning competenciesProcess  oriented learning competencies
Process oriented learning competencies
Ronnie Z. Valenciano
 
FS 1 Episodes 1-6 plus attachments
FS 1 Episodes 1-6 plus attachmentsFS 1 Episodes 1-6 plus attachments
FS 1 Episodes 1-6 plus attachments
Marian Tiempo
 

What's hot (20)

Writing Instructional Objectives in the Affective Domain
Writing Instructional Objectives in the Affective DomainWriting Instructional Objectives in the Affective Domain
Writing Instructional Objectives in the Affective Domain
 
Process oriented performance-based assessment
Process oriented performance-based assessmentProcess oriented performance-based assessment
Process oriented performance-based assessment
 
Alternative-Response Test
Alternative-Response TestAlternative-Response Test
Alternative-Response Test
 
authentic vs. traditional assessment
authentic vs. traditional assessmentauthentic vs. traditional assessment
authentic vs. traditional assessment
 
Analyzing and using test item data
Analyzing and using test item dataAnalyzing and using test item data
Analyzing and using test item data
 
Authentic Assessment Tools
Authentic Assessment ToolsAuthentic Assessment Tools
Authentic Assessment Tools
 
Field Study 1, Episode 1 "The School as a Learning Environment"
Field Study 1, Episode 1 "The School as a Learning Environment"Field Study 1, Episode 1 "The School as a Learning Environment"
Field Study 1, Episode 1 "The School as a Learning Environment"
 
Item analysis
Item analysisItem analysis
Item analysis
 
Item Analysis
Item AnalysisItem Analysis
Item Analysis
 
Field Study 2 Episode 1 Principles of Learning
Field Study 2 Episode 1 Principles of LearningField Study 2 Episode 1 Principles of Learning
Field Study 2 Episode 1 Principles of Learning
 
Rubrics (Analytic and Holistic)
Rubrics (Analytic and Holistic)Rubrics (Analytic and Holistic)
Rubrics (Analytic and Holistic)
 
Improving the test items
Improving the test itemsImproving the test items
Improving the test items
 
Qualitative item analysis
Qualitative item analysisQualitative item analysis
Qualitative item analysis
 
Philosophy of education
Philosophy of educationPhilosophy of education
Philosophy of education
 
Item analysis2
Item analysis2Item analysis2
Item analysis2
 
Portfolio Assessment
Portfolio AssessmentPortfolio Assessment
Portfolio Assessment
 
Types of test
Types of testTypes of test
Types of test
 
Portfolio assessment
Portfolio assessmentPortfolio assessment
Portfolio assessment
 
Process oriented learning competencies
Process  oriented learning competenciesProcess  oriented learning competencies
Process oriented learning competencies
 
FS 1 Episodes 1-6 plus attachments
FS 1 Episodes 1-6 plus attachmentsFS 1 Episodes 1-6 plus attachments
FS 1 Episodes 1-6 plus attachments
 

Similar to Assessment of learning1

Assesment of Learning 1.pptx
Assesment of Learning 1.pptxAssesment of Learning 1.pptx
Assesment of Learning 1.pptx
RayLorenzOrtega
 
Administering, analyzing, and improving the test or assessment
Administering, analyzing, and improving the test or assessmentAdministering, analyzing, and improving the test or assessment
Administering, analyzing, and improving the test or assessment
Nema Grace Medillo
 
Analyzingandusingtestitemdata 101012035435-phpapp02
Analyzingandusingtestitemdata 101012035435-phpapp02Analyzingandusingtestitemdata 101012035435-phpapp02
Analyzingandusingtestitemdata 101012035435-phpapp02cezz gonzaga
 
Fdu item analysis (1).ppt revised by dd
Fdu item analysis (1).ppt revised by ddFdu item analysis (1).ppt revised by dd
Fdu item analysis (1).ppt revised by dddettmore
 
Item and Distracter Analysis
Item and Distracter AnalysisItem and Distracter Analysis
Item and Distracter AnalysisSue Quirante
 
Item analysis
Item analysisItem analysis
Item analysis
pankaj Singh shekhawat
 
Topic 8b Item Analysis
Topic 8b Item AnalysisTopic 8b Item Analysis
Topic 8b Item AnalysisYee Bee Choo
 
Test Items Based on their Discrimination Power.pptx
Test Items Based on their Discrimination Power.pptxTest Items Based on their Discrimination Power.pptx
Test Items Based on their Discrimination Power.pptx
Shad847167
 
Item analysis report
Item analysis report Item analysis report
Item analysis report
Noah Ark Angel
 
Item Analysis.pptx
Item Analysis.pptxItem Analysis.pptx
Item Analysis.pptx
JessieBarrera8
 
Item analysis in education
Item analysis  in educationItem analysis  in education
Item analysis in education
munsif123
 
TEST ITEM ANALYSIS PRESENTATION 2022.ppt
TEST ITEM ANALYSIS PRESENTATION 2022.pptTEST ITEM ANALYSIS PRESENTATION 2022.ppt
TEST ITEM ANALYSIS PRESENTATION 2022.ppt
JennilynDescargar
 
Test Administration, Test administration, Test-taking Strategies
Test Administration, Test administration, Test-taking StrategiesTest Administration, Test administration, Test-taking Strategies
Test Administration, Test administration, Test-taking Strategies
Sarah Cruz
 
tryout test, item analysis (difficulty, discrimination)
tryout test, item analysis (difficulty, discrimination)tryout test, item analysis (difficulty, discrimination)
tryout test, item analysis (difficulty, discrimination)
April Gealene Alera
 
ITEM DIFFICULTY.pptx
ITEM DIFFICULTY.pptxITEM DIFFICULTY.pptx
ITEM DIFFICULTY.pptx
ZhylaineCastroDacoro
 
430660906-Item-Analysis.pptx
430660906-Item-Analysis.pptx430660906-Item-Analysis.pptx
430660906-Item-Analysis.pptx
SultanRitoAnthony
 
Item
ItemItem

Similar to Assessment of learning1 (20)

Assesment of Learning 1.pptx
Assesment of Learning 1.pptxAssesment of Learning 1.pptx
Assesment of Learning 1.pptx
 
Analyzing and using test item data
Analyzing and using test item dataAnalyzing and using test item data
Analyzing and using test item data
 
Analyzing and using test item data
Analyzing and using test item dataAnalyzing and using test item data
Analyzing and using test item data
 
Analyzing and using test item data
Analyzing and using test item dataAnalyzing and using test item data
Analyzing and using test item data
 
Administering, analyzing, and improving the test or assessment
Administering, analyzing, and improving the test or assessmentAdministering, analyzing, and improving the test or assessment
Administering, analyzing, and improving the test or assessment
 
Analyzingandusingtestitemdata 101012035435-phpapp02
Analyzingandusingtestitemdata 101012035435-phpapp02Analyzingandusingtestitemdata 101012035435-phpapp02
Analyzingandusingtestitemdata 101012035435-phpapp02
 
Fdu item analysis (1).ppt revised by dd
Fdu item analysis (1).ppt revised by ddFdu item analysis (1).ppt revised by dd
Fdu item analysis (1).ppt revised by dd
 
Item and Distracter Analysis
Item and Distracter AnalysisItem and Distracter Analysis
Item and Distracter Analysis
 
Item analysis
Item analysisItem analysis
Item analysis
 
Topic 8b Item Analysis
Topic 8b Item AnalysisTopic 8b Item Analysis
Topic 8b Item Analysis
 
Test Items Based on their Discrimination Power.pptx
Test Items Based on their Discrimination Power.pptxTest Items Based on their Discrimination Power.pptx
Test Items Based on their Discrimination Power.pptx
 
Item analysis report
Item analysis report Item analysis report
Item analysis report
 
Item Analysis.pptx
Item Analysis.pptxItem Analysis.pptx
Item Analysis.pptx
 
Item analysis in education
Item analysis  in educationItem analysis  in education
Item analysis in education
 
TEST ITEM ANALYSIS PRESENTATION 2022.ppt
TEST ITEM ANALYSIS PRESENTATION 2022.pptTEST ITEM ANALYSIS PRESENTATION 2022.ppt
TEST ITEM ANALYSIS PRESENTATION 2022.ppt
 
Test Administration, Test administration, Test-taking Strategies
Test Administration, Test administration, Test-taking StrategiesTest Administration, Test administration, Test-taking Strategies
Test Administration, Test administration, Test-taking Strategies
 
tryout test, item analysis (difficulty, discrimination)
tryout test, item analysis (difficulty, discrimination)tryout test, item analysis (difficulty, discrimination)
tryout test, item analysis (difficulty, discrimination)
 
ITEM DIFFICULTY.pptx
ITEM DIFFICULTY.pptxITEM DIFFICULTY.pptx
ITEM DIFFICULTY.pptx
 
430660906-Item-Analysis.pptx
430660906-Item-Analysis.pptx430660906-Item-Analysis.pptx
430660906-Item-Analysis.pptx
 
Item
ItemItem
Item
 

Recently uploaded

CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
camakaiclarkmusic
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
Balvir Singh
 
A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
Peter Windle
 
"Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe..."Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe...
SACHIN R KONDAGURI
 
Guidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th SemesterGuidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th Semester
Atul Kumar Singh
 
Honest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptxHonest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptx
timhan337
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
Nguyen Thanh Tu Collection
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
Vivekanand Anglo Vedic Academy
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
Celine George
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
Jean Carlos Nunes Paixão
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
Atul Kumar Singh
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
siemaillard
 
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdfAdversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Po-Chuan Chen
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
Levi Shapiro
 
Digital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and ResearchDigital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and Research
Vikramjit Singh
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
Pavel ( NSTU)
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Thiyagu K
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
Peter Windle
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
Jisc
 

Recently uploaded (20)

CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
 
A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
 
"Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe..."Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe...
 
Guidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th SemesterGuidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th Semester
 
Honest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptxHonest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptx
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdfAdversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
 
Digital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and ResearchDigital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and Research
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
 

Assessment of learning1

  • 2. Distracter Analysis 1.Distracter Distracter is term used for the incorrect option in the multiple choice type of test while the correct answers represents the key. Item analysis we can identify non-performing test items, but this item seldom indicates the error or the problem in the given item.
  • 3. Factors why students failed to get the correct answer in given question: a. it is not taught in the class properly. b. it is ambiguous. c. the correct answer is not the given option. d. it has more than one correct answer. e. It contains grammatical clues to mislead the students. f. The student is not aware of the correct. g. The students were confused by the logic of the question because it has double negatives. h. The students failed to study the lesson.
  • 4. Distracter Analysis 2.Miskeyed item The test item is a potential miskey if there are more students from the upper group who choose the incorrect options than the key. 3.Guessing item Student from the upper group have equal spread of choices among the given alternatives.
  • 5. Distracter Analysis Students from the upper group guess their answers because of the following reasons: a. The content of the test is not discussed in the class or in the text. b. The test item is very difficult. c. The question is trivial.
  • 6. Distracter Analysis 4. Ambiguous item This happen when more students from the upper group choose equally an incorrect option and the keyed answer.
  • 7. Qualitative Item Analysis Qualitative item analysis(Zurawski, R. M) is a process in which the teacher or expert carefully proofreads the best test before is administered, to check if there are typographical errors, to avoid grammatical clues that may lead to giving away the correct answer, and to ensure that the level of reading materials is appropriate. These procedures can also include small group discussion on the quality of the examination are its item, with examinees that have already took the test. Students who took the examination are asked to express verbally their experience in answering each item in the examination. This procedure can help the teacher in determining why they misunderstood a certain item.
  • 8. Types of Quantitative Item Analysis Difficulty index Discrimination index Response Option Analysis
  • 9. Difficulty Index Level of Difficulty of an Item Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Moderately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy
  • 10. Difficulty Index Formula n F = N _____ ,where F = Difficulty index n = Number of students selecting the item correctly in upper and lower group. N= Total number of students who answered the test. D
  • 11. Discrimination Index Level of Discrimination Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item
  • 12. Discrimination Index D C 1 = D ________________ ,where 1 = Discrimination index value UG = Number of students selecting the correct answer in the upper group. C = Number of students selecting then correct answer in the lower group. UG __ LG C C LG = Number of students in either the lower group or upper group.
  • 13. IMPROVING TEST ITEMSConsider the following examples in analyzing the test and some notes on how to improve the item based from the result of item analysis. Example 1. A class is composed of 40 students. Divide the group into two. Option B is the correct answer. Based from the given data on the table, as a teacher, what would you do with the test item? How to improve the test item Options A B * C D E Upper group 3 10 4 0 3 Lower group 4 4 8 0 4
  • 14. 1. Compute the difficulty index. 0.35 OR 35% n = 10+4=14 N = 40 DF n F = N _____ ,whereD 14 F = 40 _____ ,whereD = Options A B * C D E Upper group 3 10 4 0 3 Lower group 4 4 8 0 4 Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item
  • 15. 2. Compute the discrimination index. 0.30 OR 30% =10 1 = D ______________ ,whereD 20=D C UG = 4 UG C LG C __ CLG Options A B * C D E Upper group 3 10 4 0 3 Lower group 4 4 8 0 4 10 __ 4 20 ___________ 6 20 ______ = = = Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item 1 1 D
  • 16. 3. Make an analysis about the level of difficulty, discrimination and distracters. a. Only 35% of the examines got the answer correctly, hence, the item is difficult. b. More students from the upper group got the answer correctly, hence, has a positive discrimination. c. Retain option A, C, and E because most of the students who did not perform well in the overall examination selected it. Those option most students from the lower group. 4. Conclusion: Retain the test item but change option D, make it more realistic to make it effective for the upper and lower groups. At least 5% of the examinees choose the incorrect answer. IMPROVING TEST ITEMS
  • 17. IMPROVING TEST ITEMS Options A B * C D E Upper group 3 10 4 0 3 Lower group 4 4 8 0 4 Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item a.Only 35% of the examines got the answer correctly, hence, the item is difficult. b.More students from the upper group got the answer correctly, hence, it has a positive discrimination. c.Retain option A, C, and E because most of the students who did not perform well in the overall examination selected it. Those option attract most students from the lower group. 4. Conclusion: Retain the test item but change option D, make it more realistic to make it effective for the upper and lower groups. At least 5% of the examinees choose the incorrect answer. Response option analysis 3. Make an analysis about the level of difficulty, discrimination and distracters.
  • 18. IMPROVING TEST ITEMSExample 2. A class is composed of 50 students. Use 27% to get the upper and the lower groups. Analyze the item given the following results. Option D is the correct answer. What will you do with the test item? How to improve the test item Options A B C D * E Upper group (27%) 3 1 2 6 2 Lower group (27%) 5 0 4 4 1
  • 19. 1. Compute the difficulty index. 0.36 OR 36% n = 6+4=10 N = 28 DF n F = N _____ ,whereD 10 F = 28 _____ ,whereD = Options A B C D * E Upper group (27%) 3 1 2 6 2 Lower group (27%) 5 0 4 4 1 Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item
  • 20. 2. Compute the discrimination index. 0.14 OR 14% = 6 1 = D ______________ ,whereD 14=D C UG = 4 UG C LG C __ CLG 6 __ 4 14 ___________ 2 14 ______ = = = Options A B C D * E Upper group (27%) 3 1 2 6 2 Lower group (27%) 5 0 4 4 1 Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item D 1 1
  • 21. 3. Make an analysis about the level of difficulty, discrimination and distracters. a. Only 36% of the examines got the answer correctly, hence, the item is difficult. b. More students from the upper group got the answer correctly, hence, it has positive discrimination. c. Modify option B and E because more students from the upper group chose them compare with the lower group, hence, They are not effective because most of the students who performed well in the overall selected them as their answer. 4. Conclusion: Retain A and C because most of the students who did not perform well in the overall examination selected them as the correct answers. Hence, option A and C are effective distracters. IMPROVING TEST ITEMS
  • 22. IMPROVING TEST ITEMSIndex Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item Response option analysis a.Only 36% of the examines got the answer correctly, hence, the item is difficult. b.More students from the upper group got the answer correctly, hence, it has a positive discrimination. c.Modify option B and E because more students from the upper group chose them compare with the lower group, hence, They are not effective distracters because most of the students who performed well in the overall examination selected them as their answer. Options A B C D * E Upper group (27%) 3 1 2 6 2 Lower group (27%) 5 0 4 4 1 Conclusion: Retain A and C because most of the students who did not perform well in the overall examination selected them as the correct answers. Hence, option A and C are effective distracters. 3. Make an analysis about the level of difficulty, discrimination and distracters.
  • 23. IMPROVING TEST ITEMSExample 3. A class is composed of 50 students. Use 27% to get the upper and the lower groups. Analyze the item given the following results. Option E is the correct answer. What will you do with the test item? How to improve the test item Options A B C D E * Upper group (27%) 2 3 2 2 5 Lower group (27%) 2 2 1 1 8
  • 24. 1. Compute the difficulty index. OR % n = + = N = DF n F = N _____ ,whereD F = _____ ,?D = Options A B C D E * Upper group (27%) 2 3 2 2 5 Lower group (27%) 2 2 1 1 8 Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item
  • 25. 2. Compute the discrimination index. OR % = 1 = D ______________ ,whereD =D C UG = UG C LG C __ CLG __ ___________,? ______ = = = Options A B C D E * Upper group (27%) 2 3 2 2 5 Lower group (27%) 2 2 1 1 8 Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item 1 1 D
  • 26. 3. Make an analysis about the level of difficulty, discrimination and distracters. a. Only ____________ got the answer correctly, hence, the item is moderately difficult. b. More students from the lower group got the answer correctly, therefor, it has __________________________ . The discrimination index is -21%. c. No need to analyze the distracters because the item discriminates ________________ . d. Modify all the distracters because they are not effective. Most of the students the upper group chose the incorrect option. The options are effective if most the students in the lower group chose the incorrect options. 4. Conclusion: Reject the item because it has a ___________________ index. IMPROVING TEST ITEMS
  • 27. IMPROVING TEST ITEMSIndex Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item Response option analysis a.Only 46% got the answer correctly, hence, the item is moderately difficult. b.More students from the lower group got the answer correctly, therefor, it has a negative discrimination The discrimination index is -21%. Options A B C D E * Upper group (27%) 2 3 2 2 5 Lower group (27%) 2 2 1 1 8 c.No need to analyze the distracters because the item discriminates negatively. d.Modify all the distracters because they are not effective. Most of the students in the upper group chose the incorrect option. The options are effective if most of the students in the lower group chose the incorrect options. 4. Conclusion: Reject the item because it has a negative discrimination index. 3. Make an analysis about the level of difficulty, discrimination and distracters
  • 28. IMPROVING TEST ITEMSExample 4.POTENTIAL MISKEYED ITEM. Make an item analysis about the table below. What will you do with the that is potential miskeyed item? How to improve the test item Options A * B C D E Upper group 1 2 3 10 4 Lower group 3 4 4 4 5
  • 29. 1. Compute the difficulty index. 0.10 OR 10% n = 1+3=4 N = 40 DF n F = N _____ ,whereD 4 F = 40 _____ ,whereD = Options A * B C D E Upper group 1 2 3 10 4 Lower group 3 4 4 4 5 Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item
  • 30. 2. Compute the discrimination index. -0.10 OR -10% =1 1 = D ______________ ,whereD 20=D C UG = 3 UG C LG C __ CLG 1 __ 3 20 ___________ -2 20 ______ = = = Options A * B C D E Upper group 1 2 3 10 4 Lower group 3 4 4 4 5 Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item D 1 1
  • 31. 3. Make an analysis: a. More students from the upper group choose option D that option A, even though option A is the supposedly the correct answer. b. Mostly likely the teacher has written the wrong answer key. c. The teacher checks and finds out that he/she did not miskey the answer that he/she thought is the correct answer. d. If the teacher miskeyed it he/she must check and retally the score of the students’ test papers before giving them back. e. If option A is really the correct answer, revise to weaken option D, distracters are not supposed to draw more attention than the keyed answer. IMPROVING TEST ITEMS
  • 32. 3. Make an analysis: f. Only 10% of the students got the answer to the test item correctly, hence, the test item is very difficult. g. More students from the lower group got the item correctly, therefore a negative discrimination resulted. The discrimination index is -10% h. No need to analyze the distracters because the test item is very difficult and discrimination negatively. 4. Conclusion: reject the item because it is very difficult and a has negative discrimination index. IMPROVING TEST ITEMS
  • 33. IMPROVING TEST ITEMSIndex Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item Response option analysis a.More students from the upper group choose option D that option A, even though option A is the supposedly the correct answer. Options A * B C D E Upper group 1 2 3 10 4 Lower group 3 4 4 4 5 b.Mostly likely the teacher has written the wrong answer key. c.The teacher checks and finds out that he/she did not miskey the answer that he/she thought is the correct answer. d.If the teacher miskeyed it he/she must check and retally the score of the students’ test papers before giving them back. e.If option A is really the correct answer, revise to weaken option D, distracters are not supposed to draw more attention than the keyed answer. f.Only 10% of the students got the answer to the test item correctly, hence, the test item is very difficult. g.More students from the lower group got the item correctly, therefore a negative discrimination resulted. The discrimination index is -10% h.No need to analyze the distracters because the test item is very difficult and discrimination negatively. 4. Conclusion: reject the item because it is very difficult and a has negative discrimination index. 3. Make an analysis: potential miskeyed item
  • 34. IMPROVING TEST ITEMSExample 5. AMBIGUOUS ITEM. Below is the result of item analysis of a test with an ambiguous test item. What can you say about the item? Are you going to retain, revise or reject? How to improve the test item Options A B C D E * Upper group 7 1 1 2 8 Lower group 6 2 3 3 6
  • 35. 1. Compute the difficulty index. 0.36 OR 36% n = 8+6=14 N = 39 DF n F = N _____ ,whereD 14 F = 39 _____ ,whereD = Options A B C D E * Upper group 7 1 1 2 8 Lower group 6 2 3 3 6 Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item
  • 36. 2. Compute the discrimination index. 0.10 OR 10% =8 1 = D ______________ ,whereD 20=D C UG = 6 UG C LG C __ CLG 8 __ 6 20 ___________ 2 20 ______ = = = Options A B C D E * Upper group 7 1 1 2 8 Lower group 6 2 3 3 6 Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item 1 1 D
  • 37. 3. Make an analysis: a. Only 36% of the students got the answer to test item correctly, hence, the test item is difficult. b.More students from the upper group got the item correctly, hence, it discriminates positively. The discrimination index is 10% c. About equal numbers of top students went for option A and option E, this implies that they could not tell which is the correct answer. The students do not know the content of the test, thus, a reteach is needed. 4. Conclusion: Revise the test item because it is ambiguous. IMPROVING TEST ITEMS
  • 38. IMPROVING TEST ITEMSIndex Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item Response option analysis Options A B C D E * Upper group 7 1 1 2 8 Lower group 6 2 3 3 6 3. Make an analysis: ambiguous item a.Only 36% of the students got the answer to test item correctly, hence, the test item is difficult. b.More students from the upper group got the item correctly, hence, it discriminates positively. The discrimination index is 10% c.About equal numbers of top students went for option A and option E, this implies that they could not tell which is the correct answer. The students do not know the content of the test, thus, a reteach is needed. 4.Conclusion: Revise the test item because it is ambiguous.
  • 39. IMPROVING TEST ITEMSExample 6.GUESSING ITEM. Below is the result of item analysis of a test with students’ answers mostly based on a guess. Are you going to retain, revise or reject? How to improve the test item Options A B C * D E Upper group 4 3 4 3 6 Lower group 3 4 3 4 5
  • 40. 1. Compute the difficulty index. 0.18 OR 18% n = 4+3=7 N = 39 DF n F = N _____ ,whereD 7 F = 39 _____ ,whereD = Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item Options A B C * D E Upper group 4 3 4 3 6 Lower group 3 4 3 4 5
  • 41. 2. Compute the discrimination index. 0.05 OR 5% =4 1 = D ______________ ,whereD 20=D C UG = 3 UG C LG C __ CLG 4 __ 3 20 ___________ 1 20 ______ = = = Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item Options A B C * D E Upper group 4 3 4 3 6 Lower group 3 4 3 4 5 D1 1
  • 42. 3. Make an analysis: a. Only18% of the students got the answer to the test item correctly. b. More students from the upper group got the correct answer to the test item; therefore, the test item is positive discrimination. The discrimination index is 5%. c. Students responds about equally to all alternatives, an indication that they are guessing. Three possibilities why student guesses the answer on a test item: The content of the test item has not yet been discussed in the class because the test is designed in advance; Test item were badly written that students have no idea what the question is really all about: and Test item were very difficult as shown from the difficulty index and low discrimination index. IMPROVING TEST ITEMS
  • 43. 3. Make an analysis: d.If the test is well-written but too difficult, reteach material to the class. 4. Conclusion: Reject the item because it is very difficult and the discrimination index is very poor, and option A and B are not effective distracters. IMPROVING TEST ITEMS
  • 44. IMPROVING TEST ITEMSIndex Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item Response option analysis 3. Make an analysis: guessing item Options A B C * D E Upper group 4 3 4 3 6 Lower group 3 4 3 4 5 a.Only18% of the students got the answer to the test item correctly. b.More students from the upper group got the correct answer to the test item; therefore, the test item is positive discrimination. The discrimination index is 5%. c.Students responds about equally to all alternatives, an indication that they are guessing. d.If the test is well-written but too difficult, reteach the material to the class. 4. Conclusion: Reject the item because it is very difficult and the discrimination index is very poor, and option A and B are not effective distracters.
  • 45. IMPROVING TEST ITEMSExample 7.Reject the item because it is very difficult and the discrimination index is very poor, and options A and B are not effective distracters. How to improve the test item Options A B C * D E Upper group 5 3 9 0 3 Lower group 6 4 6 0 4
  • 46. 1. Compute the difficulty index. OR % n = + = N = DF n F = N _____ ,whereD F = _____ ,?D = Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item Options A B C * D E Upper group 5 3 9 0 3 Lower group 6 4 6 0 4
  • 47. 2. Compute the discrimination index. OR % = 1 = D ______________ ,whereD =D C UG = UG C LG C __ CLG __ ___________,? ______ = = = Index Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item Options A B C * D E Upper group 5 3 9 0 3 Lower group 6 4 6 0 4 1 1 D
  • 48. 3. Make an analysis about the level of difficulty, discrimination and distracters. a. Only ____________ got the answer correctly, hence, the item is difficult. b.More students from the upper group answer the test item correctly, a result, the test got a __________________________ . The discrimination index is 15% c. Option A,B, and E are attractive and effective distracters. d.Option D is in effective; therefore, changing it with more realistic one. 4. Conclusion: Revise the item by changing option D. IMPROVING TEST ITEMS
  • 49. IMPROVING TEST ITEMSIndex Range Difficulty Level 0.00-0.20 Very Difficult 0.21-0.40 Difficult 0.41- 0.60 Average/Mode rately Difficult 0.61- 0.80 Easy 0.81 – 1.00 Very Easy Index Range Discrimination Level 0.19 and below Poor item, should be eliminated or need to be revised 0.20-0.29 Marginal item, needs some revision 0.30- 0.39 Reasonably good item but possibly for improvement 0.40 and above Very good item Response option analysis 3. Make an analysis: a.Only 38% got the answer correctly, hence, the item is difficult. Options A B C * D E Upper group 5 3 9 0 3 Lower group 6 4 6 0 4 b.More students from the upper group answer the test item correctly, as a result, the test got a positive discrimination. The discrimination index is 15% c.Option A,B, and E are attractive and effective distracters. d.Option D is in effective; therefore, changing it with more realistic one. 4. Conclusion: Revise the item by changing option D.

Editor's Notes

  1. Ambiguous : unclear or inexact because a choice between alternatives has not been made. open to more than one interpretation; having a double meaning.