Analysis of item test pola of respondents' choice analysis

1. Pola of Respondents' Choice
POLA OF RESPONDENTS' CHOICE ANALYSIS
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40
Respondent Group
item number
G a a c a c a b c b c c a c d a c c a a b d b b a c b d a b d c a a b b b b d b b
F C UPPER
a a a a c a d a b d c a c d - a a d a b b b c a d b d a b a c b a c b b b b b b
a a c a c c b a d c a d c d d a a a a b a b b a c a d a b b a b b b b d b c b b
E a a a a c a b a b d c a a a - a a d a b b b c a d b d a b a c b a c b b b - b b
J a a a a c a b a b d c a c d d a a d a c b b c d a b d a b a c - a c b b b d b b
LOWER
A a a b a b a b a b d c a c d c a a a a b a a b a d c a a d a a c a c b b c c a b
H a a b a b a b a b d c a c d c a a a a b a b b a d c a a d a a c a c b b c c a b
I a a b a b a b a b d c a c d c a a a a b d b b a d c a - d a a c a c b b b c a b
B a a d b a c b a a d c a c d c a a a c b d b c a d a a a d d a d a a b b b a b b
D b d d a a c b a b d c a c d d a a a a b d b c a b a a b b a a a a b a b b a b a
A distractor is good if it is choosen by at least 5% of the respondents.
a b c d o 5% * 10 = 1
upper 5*) 0 0 0 0 So, if the distractors choosen at least 1 person, it means that the distractors is good.
lower 4*) 1 0 0 0
upper 5*) 0 0 0 0 An item test is good if the omit is no more than 10% of the respondent
lower 4*) 0 0 1 0 10% * 10 = 1
upper 3 0 2*) 0 0 So, if the omit is no more than 1 person, it means that the item test is good
lower 0 3 *) 2 0
upper 5*) 0 0 0 0 a = option a
lower 4*) 1 0 0 0 b = option b
upper 0 *) 5 0 0 c = option c
lower 2 3*) 0 0 0 d = option d
upper 4 0 1*) 0 0 o = ommit (students who don't answer
lower 3 0 2*) 0 0 *) is the key answer
upper 0 4*) 0 1 0
lower 0 5*) 0 0 0
upper 4*) 0 1 0 0
lower 5*) 0 0 0 0
item
number
1 bad good
2
8
group choice criteria
distractor item
3
4
5
6
7
bad good
good good
bad
good
good
good
good
good
bad
bad
bad good

2. .....continued POLA OF RESPONDENTS' CHOICE ANALYSIS
group
a b c d o a b c d o
upper 0 4*) 0 1 0 1 0 2*) 2 0
lower 1 4*) 0 0 0 0 1 *) 4 0
upper 0 0 2*) 3 0 1 4*) 0 0 0
lower 0 0 2*) 5 0 2 *) 3 0 0
upper 1 0 4*) 0 0 0 0 0 5*) 0
lower 0 0 5*) 0 0 5 0 0 *) 0
upper 4*) 0 0 1 0 5*) 0 0 0 0
lower 5*) 0 0 0 0 3*) 1 0 0 0
upper 1 0 4*) 0 0 0 5*) 0 0 0
lower 0 0 5*) 0 0 0 1*) 0 4 0
upper 1 0 4 *) 0 3 1 0 1*) 0
lower 0 0 5 *) 0 4 0 0 1*) 0
upper 1 0 *) 2 2 1 0 4*) 0 0
lower 0 0 4*) 1 0 5 0 *) 0 0
upper 4*) 0 1 0 0 1 3*) 0 0 0
lower 5*) 0 0 0 0 1 *) 3 1 0
upper 4*) 0 1 0 0 4*) 1 0 0 0
lower 5*) 0 0 0 0 5*) 0 0 0 0
upper 2 0 0 3*) 0 0 2*) 3 0 0
lower 5 0 0 *) 0 1 1*) 3 0 0
upper 5*) 0 0 0 0 0 5*) 0 0 0
lower 4*) 0 1 0 0 1 4*) 0 0 0
upper 0 4*) 1 0 0 0 4*) 0 1 0
lower 0 5*) 0 0 0 0 5*) 0 0 0
upper 1 3*) 0 1 0 0 5*) 0 0 0
lower 2 *) 0 3 0 0 3*) 2 0 0
upper 0 5*) 0 0 0 0 1 1*) 2 1
lower 1 4*) 0 0 0 2 0 3*) 0 0
upper 0 2*) 3 0 0 0 5*) 0 0 0
lower 0 3*) 2 0 0 3 2*) 0 0 0
upper 4*) 0 0 1 0 0 5*) 0 0 0
lower 5*) 0 0 0 0 1 4*) 0 0 0
item
number
9
10
11
12
13
14
15
16
21
23
24
distractor
bad
22
item
number
32
33
34
35
group
choice criteria
item
good good
36
37
17
18
19
20
40
criteria
upper
lower
upper
lower
upper
lower
upper
lower
choice
distractor item
38
39
upper
lower
upper
lower
upper
lower
upper
lower
upper
lower
upper
lower
upper
lower
upper
lower
upper
lower
good good
lower
upper
lower
upper
lower
upper
good
good
good
good
good
bad
good
good
good
good
good
good
25
26
27
28
29
30
31
good
bad
bad
bad
bad
good
bad
bad
good
bad
bad
bad
good
good
good
good
good
good
good
bad
bad
bad
good
good
bad
bad
bad
good
bad
good good
bad
good
good
bad
bad
bad
good good
bad
bad
good
good
good
good
good
good