1. The document discusses analyzing test items through quantitative and qualitative methods. It defines key terms like difficulty index, discrimination index, and describes how to calculate them.
2. The document provides examples of analyzing test items based on student response data. It shows how to determine the difficulty level, identify effective or ineffective distractors, and ways to improve test items based on the analysis.
3. The goal of the analysis is to evaluate how well items discriminate between higher and lower performing students, identify issues, and determine if items should be retained or modified to make them more effective.
Is it possible to explain why the student outputs is as they are through an assessment of the processes which they did in order to arrive at the final product?
YES, through Process oriented, performance-based assessment
Assessment of Learning - Multiple Choice TestXiTian Miran
A powerpoint presentation about the Multiple Choice Test as one of the assessment strategies that can be used by teachers in assessing learners. Also, this includes the introduction, definition, advantages, and limitations of Multiple Choice Test.
Here is a simplified version of Item Analysis for Educational Assessments. Covered here are terminologies, formulas, and processes in conducting Item Discrimination and Difficulty. Thank you. Namaste!
Is it possible to explain why the student outputs is as they are through an assessment of the processes which they did in order to arrive at the final product?
YES, through Process oriented, performance-based assessment
Assessment of Learning - Multiple Choice TestXiTian Miran
A powerpoint presentation about the Multiple Choice Test as one of the assessment strategies that can be used by teachers in assessing learners. Also, this includes the introduction, definition, advantages, and limitations of Multiple Choice Test.
Here is a simplified version of Item Analysis for Educational Assessments. Covered here are terminologies, formulas, and processes in conducting Item Discrimination and Difficulty. Thank you. Namaste!
Often times, teachers master the art of writing very good cognitive and psychomotor instructional objectives. So good that what happens is that most of the students become not only intelligent but "airheads". Some also will aim for the grade, but after that enduring grading period, or semester, they forget everything. Affective objectives help the students appreciate the lessons, retain them longer, and find connections in the real world (yes, algebra is present in the market place). Affective objectives help the teacher integrate values formation in all subjects/courses.
Download it here: https://drive.google.com/open?id=0B-NSFQQ2b9P2Q3ZrTVVhWEZfaWc
Often times, teachers master the art of writing very good cognitive and psychomotor instructional objectives. So good that what happens is that most of the students become not only intelligent but "airheads". Some also will aim for the grade, but after that enduring grading period, or semester, they forget everything. Affective objectives help the students appreciate the lessons, retain them longer, and find connections in the real world (yes, algebra is present in the market place). Affective objectives help the teacher integrate values formation in all subjects/courses.
Download it here: https://drive.google.com/open?id=0B-NSFQQ2b9P2Q3ZrTVVhWEZfaWc
Macroeconomics- Movie Location
This will be used as part of your Personal Professional Portfolio once graded.
Objective:
Prepare a presentation or a paper using research, basic comparative analysis, data organization and application of economic information. You will make an informed assessment of an economic climate outside of the United States to accomplish an entertainment industry objective.
Operation “Blue Star” is the only event in the history of Independent India where the state went into war with its own people. Even after about 40 years it is not clear if it was culmination of states anger over people of the region, a political game of power or start of dictatorial chapter in the democratic setup.
The people of Punjab felt alienated from main stream due to denial of their just demands during a long democratic struggle since independence. As it happen all over the word, it led to militant struggle with great loss of lives of military, police and civilian personnel. Killing of Indira Gandhi and massacre of innocent Sikhs in Delhi and other India cities was also associated with this movement.
A Strategic Approach: GenAI in EducationPeter Windle
Artificial Intelligence (AI) technologies such as Generative AI, Image Generators and Large Language Models have had a dramatic impact on teaching, learning and assessment over the past 18 months. The most immediate threat AI posed was to Academic Integrity with Higher Education Institutes (HEIs) focusing their efforts on combating the use of GenAI in assessment. Guidelines were developed for staff and students, policies put in place too. Innovative educators have forged paths in the use of Generative AI for teaching, learning and assessments leading to pockets of transformation springing up across HEIs, often with little or no top-down guidance, support or direction.
This Gasta posits a strategic approach to integrating AI into HEIs to prepare staff, students and the curriculum for an evolving world and workplace. We will highlight the advantages of working with these technologies beyond the realm of teaching, learning and assessment by considering prompt engineering skills, industry impact, curriculum changes, and the need for staff upskilling. In contrast, not engaging strategically with Generative AI poses risks, including falling behind peers, missed opportunities and failing to ensure our graduates remain employable. The rapid evolution of AI technologies necessitates a proactive and strategic approach if we are to remain relevant.
Honest Reviews of Tim Han LMA Course Program.pptxtimhan337
Personal development courses are widely available today, with each one promising life-changing outcomes. Tim Han’s Life Mastery Achievers (LMA) Course has drawn a lot of interest. In addition to offering my frank assessment of Success Insider’s LMA Course, this piece examines the course’s effects via a variety of Tim Han LMA course reviews and Success Insider comments.
The French Revolution, which began in 1789, was a period of radical social and political upheaval in France. It marked the decline of absolute monarchies, the rise of secular and democratic republics, and the eventual rise of Napoleon Bonaparte. This revolutionary period is crucial in understanding the transition from feudalism to modernity in Europe.
For more information, visit-www.vavaclasses.com
How to Make a Field invisible in Odoo 17Celine George
It is possible to hide or invisible some fields in odoo. Commonly using “invisible” attribute in the field definition to invisible the fields. This slide will show how to make a field invisible in odoo 17.
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...Levi Shapiro
Letter from the Congress of the United States regarding Anti-Semitism sent June 3rd to MIT President Sally Kornbluth, MIT Corp Chair, Mark Gorenberg
Dear Dr. Kornbluth and Mr. Gorenberg,
The US House of Representatives is deeply concerned by ongoing and pervasive acts of antisemitic
harassment and intimidation at the Massachusetts Institute of Technology (MIT). Failing to act decisively to ensure a safe learning environment for all students would be a grave dereliction of your responsibilities as President of MIT and Chair of the MIT Corporation.
This Congress will not stand idly by and allow an environment hostile to Jewish students to persist. The House believes that your institution is in violation of Title VI of the Civil Rights Act, and the inability or
unwillingness to rectify this violation through action requires accountability.
Postsecondary education is a unique opportunity for students to learn and have their ideas and beliefs challenged. However, universities receiving hundreds of millions of federal funds annually have denied
students that opportunity and have been hijacked to become venues for the promotion of terrorism, antisemitic harassment and intimidation, unlawful encampments, and in some cases, assaults and riots.
The House of Representatives will not countenance the use of federal funds to indoctrinate students into hateful, antisemitic, anti-American supporters of terrorism. Investigations into campus antisemitism by the Committee on Education and the Workforce and the Committee on Ways and Means have been expanded into a Congress-wide probe across all relevant jurisdictions to address this national crisis. The undersigned Committees will conduct oversight into the use of federal funds at MIT and its learning environment under authorities granted to each Committee.
• The Committee on Education and the Workforce has been investigating your institution since December 7, 2023. The Committee has broad jurisdiction over postsecondary education, including its compliance with Title VI of the Civil Rights Act, campus safety concerns over disruptions to the learning environment, and the awarding of federal student aid under the Higher Education Act.
• The Committee on Oversight and Accountability is investigating the sources of funding and other support flowing to groups espousing pro-Hamas propaganda and engaged in antisemitic harassment and intimidation of students. The Committee on Oversight and Accountability is the principal oversight committee of the US House of Representatives and has broad authority to investigate “any matter” at “any time” under House Rule X.
• The Committee on Ways and Means has been investigating several universities since November 15, 2023, when the Committee held a hearing entitled From Ivory Towers to Dark Corners: Investigating the Nexus Between Antisemitism, Tax-Exempt Universities, and Terror Financing. The Committee followed the hearing with letters to those institutions on January 10, 202
Synthetic Fiber Construction in lab .pptxPavel ( NSTU)
Synthetic fiber production is a fascinating and complex field that blends chemistry, engineering, and environmental science. By understanding these aspects, students can gain a comprehensive view of synthetic fiber production, its impact on society and the environment, and the potential for future innovations. Synthetic fibers play a crucial role in modern society, impacting various aspects of daily life, industry, and the environment. ynthetic fibers are integral to modern life, offering a range of benefits from cost-effectiveness and versatility to innovative applications and performance characteristics. While they pose environmental challenges, ongoing research and development aim to create more sustainable and eco-friendly alternatives. Understanding the importance of synthetic fibers helps in appreciating their role in the economy, industry, and daily life, while also emphasizing the need for sustainable practices and innovation.
Embracing GenAI - A Strategic ImperativePeter Windle
Artificial Intelligence (AI) technologies such as Generative AI, Image Generators and Large Language Models have had a dramatic impact on teaching, learning and assessment over the past 18 months. The most immediate threat AI posed was to Academic Integrity with Higher Education Institutes (HEIs) focusing their efforts on combating the use of GenAI in assessment. Guidelines were developed for staff and students, policies put in place too. Innovative educators have forged paths in the use of Generative AI for teaching, learning and assessments leading to pockets of transformation springing up across HEIs, often with little or no top-down guidance, support or direction.
This Gasta posits a strategic approach to integrating AI into HEIs to prepare staff, students and the curriculum for an evolving world and workplace. We will highlight the advantages of working with these technologies beyond the realm of teaching, learning and assessment by considering prompt engineering skills, industry impact, curriculum changes, and the need for staff upskilling. In contrast, not engaging strategically with Generative AI poses risks, including falling behind peers, missed opportunities and failing to ensure our graduates remain employable. The rapid evolution of AI technologies necessitates a proactive and strategic approach if we are to remain relevant.
2. Distracter Analysis
1.Distracter
Distracter is term used for the incorrect
option in the multiple choice type of test while the
correct answers represents the key.
Item analysis we can identify non-performing
test items, but this item seldom indicates the error
or the problem in the given item.
3. Factors why students failed to get the
correct answer in given question:
a. it is not taught in the class properly.
b. it is ambiguous.
c. the correct answer is not the given option.
d. it has more than one correct answer.
e. It contains grammatical clues to mislead the students.
f. The student is not aware of the correct.
g. The students were confused by the logic of the
question because it has double negatives.
h. The students failed to study the lesson.
4. Distracter Analysis
2.Miskeyed item
The test item is a potential miskey if there are more
students from the upper group who choose the incorrect
options than the key.
3.Guessing item
Student from the upper group have equal spread of
choices among the given alternatives.
5. Distracter Analysis
Students from the upper group guess their
answers because of the following reasons:
a. The content of the test is not
discussed in the class or in the text.
b. The test item is very difficult.
c. The question is trivial.
6. Distracter Analysis
4. Ambiguous item
This happen when more students from
the upper group choose equally an
incorrect option and the keyed answer.
7. Qualitative Item Analysis
Qualitative item analysis(Zurawski, R. M) is a process in which the
teacher or expert carefully proofreads the best test before is
administered, to check if there are typographical errors, to avoid
grammatical clues that may lead to giving away the correct answer,
and to ensure that the level of reading materials is appropriate.
These procedures can also include small group discussion on the
quality of the examination are its item, with examinees that have
already took the test.
Students who took the examination are asked to express verbally
their experience in answering each item in the examination. This
procedure can help the teacher in determining why they
misunderstood a certain item.
8. Types of Quantitative Item
Analysis
Difficulty index
Discrimination index
Response Option Analysis
9. Difficulty Index
Level of Difficulty of an Item
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Moderately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
10. Difficulty Index Formula
n
F
=
N
_____ ,where
F
= Difficulty index
n =
Number of students selecting the item
correctly in upper and lower group.
N= Total number of students who answered the test.
D
11. Discrimination Index
Level of Discrimination
Index Range Discrimination Level
0.19 and below Poor item, should be eliminated
or need to be revised
0.20-0.29 Marginal item, needs some
revision
0.30- 0.39 Reasonably good item but
possibly for improvement
0.40 and above Very good item
12. Discrimination Index
D C
1
=
D
________________ ,where
1
= Discrimination index value
UG =
Number of students selecting the
correct answer in the upper group.
C = Number of students selecting then correct
answer in the lower group.
UG
__
LG
C
C
LG
= Number of students in either the
lower group or upper group.
13. IMPROVING TEST
ITEMSConsider the following examples in analyzing the test and some notes on
how to improve the item based from the result of item analysis.
Example 1. A class is composed of 40 students. Divide the group into two.
Option B is the correct answer. Based from the given data on the table, as a
teacher, what would you do with the test item?
How to improve the test item
Options A B * C D E
Upper group 3 10 4 0 3
Lower group 4 4 8 0 4
14. 1. Compute the difficulty index.
0.35 OR 35%
n = 10+4=14
N = 40
DF
n
F =
N
_____ ,whereD
14
F =
40
_____ ,whereD
=
Options A B * C D E
Upper
group
3 10 4 0 3
Lower
group
4 4 8 0 4
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
15. 2. Compute the discrimination index.
0.30 OR 30%
=10
1 =
D
______________ ,whereD
20=D
C
UG
= 4
UG
C
LG
C __ CLG
Options A B * C D E
Upper
group
3 10 4 0 3
Lower
group
4 4 8 0 4
10 __
4
20
___________
6
20
______
=
=
=
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
1
1
D
16. 3. Make an analysis about the level of difficulty,
discrimination and distracters.
a. Only 35% of the examines got the answer correctly, hence, the item is
difficult.
b. More students from the upper group got the answer correctly, hence,
has a positive discrimination.
c. Retain option A, C, and E because most of the students who did not
perform well in the overall examination selected it. Those option
most students from the lower group.
4. Conclusion: Retain the test item but change option D, make it more
realistic to make it effective for the upper and lower groups. At least 5%
of the examinees choose the incorrect answer.
IMPROVING TEST ITEMS
17. IMPROVING TEST
ITEMS
Options A B * C D E
Upper
group
3 10 4 0 3
Lower
group
4 4 8 0 4
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
a.Only 35% of the examines got the
answer correctly, hence, the item is
difficult.
b.More students from the upper group got the
answer correctly, hence, it has a positive
discrimination.
c.Retain option A, C, and E because most of the
students who did not perform well in the overall
examination selected it. Those option attract
most students from the lower group.
4. Conclusion: Retain the test item but change option
D, make it more realistic to make it effective for the
upper and lower groups. At least 5% of the examinees
choose the incorrect answer.
Response option analysis
3. Make an analysis about the level of
difficulty, discrimination and distracters.
18. IMPROVING TEST
ITEMSExample 2. A class is composed of 50 students. Use 27% to get the upper
and the lower groups. Analyze the item given the following results. Option D
is the correct answer. What will you do with the test item?
How to improve the test item
Options A B C D * E
Upper group (27%) 3 1 2 6 2
Lower group (27%) 5 0 4 4 1
19. 1. Compute the difficulty index.
0.36 OR 36%
n = 6+4=10
N = 28
DF
n
F =
N
_____ ,whereD
10
F =
28
_____ ,whereD
=
Options A B C D * E
Upper
group
(27%)
3 1 2 6 2
Lower
group
(27%)
5 0 4 4 1
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
20. 2. Compute the discrimination index.
0.14 OR 14%
= 6
1 =
D
______________ ,whereD
14=D
C
UG
= 4
UG
C
LG
C __ CLG
6 __
4
14
___________
2
14
______
=
=
=
Options A B C D * E
Upper
group
(27%)
3 1 2 6 2
Lower
group
(27%)
5 0 4 4 1
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
D
1
1
21. 3. Make an analysis about the level of difficulty, discrimination and distracters.
a. Only 36% of the examines got the answer correctly, hence, the item is
difficult.
b. More students from the upper group got the answer correctly, hence, it has
positive discrimination.
c. Modify option B and E because more students from the upper group chose
them compare with the lower group, hence, They are not effective
because most of the students who performed well in the overall
selected them as their answer.
4. Conclusion: Retain A and C because most of the students who did not
perform well in the overall examination selected them as the correct answers.
Hence, option A and C are effective distracters.
IMPROVING TEST ITEMS
22. IMPROVING TEST
ITEMSIndex Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Response option analysis
a.Only 36% of the examines got the
answer correctly, hence, the item is
difficult.
b.More students from the upper group got the
answer correctly, hence, it has a positive
discrimination.
c.Modify option B and E because more students
from the upper group chose them compare with
the lower group, hence, They are not effective
distracters because most of the students who
performed well in the overall examination selected
them as their answer.
Options A B C D * E
Upper
group
(27%)
3 1 2 6 2
Lower
group
(27%)
5 0 4 4 1
Conclusion: Retain A and C because most of the students
who did not perform well in the overall examination selected
them as the correct answers. Hence, option A and C are
effective distracters.
3. Make an analysis about the level of
difficulty, discrimination and distracters.
23. IMPROVING TEST
ITEMSExample 3. A class is composed of 50 students. Use 27% to get the upper
and the lower groups. Analyze the item given the following results. Option E
is the correct answer. What will you do with the test item?
How to improve the test item
Options A B C D E *
Upper group (27%) 2 3 2 2 5
Lower group (27%) 2 2 1 1 8
24. 1. Compute the difficulty index.
OR %
n = + =
N =
DF
n
F =
N
_____ ,whereD
F = _____ ,?D
=
Options A B C D E *
Upper
group
(27%)
2 3 2 2 5
Lower
group
(27%)
2 2 1 1 8
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
25. 2. Compute the discrimination index.
OR %
=
1 =
D
______________ ,whereD
=D
C
UG
=
UG
C
LG
C __ CLG
__
___________,?
______
=
=
=
Options A B C D E *
Upper
group
(27%)
2 3 2 2 5
Lower
group
(27%)
2 2 1 1 8
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
1
1
D
26. 3. Make an analysis about the level of difficulty, discrimination and
distracters.
a. Only ____________ got the answer correctly, hence, the item is moderately
difficult.
b. More students from the lower group got the answer correctly, therefor, it has
__________________________ . The discrimination index is -21%.
c. No need to analyze the distracters because the item discriminates
________________ .
d. Modify all the distracters because they are not effective. Most of the students
the upper group chose the incorrect option. The options are effective if most
the students in the lower group chose the incorrect options.
4. Conclusion: Reject the item because it has a ___________________ index.
IMPROVING TEST ITEMS
27. IMPROVING TEST
ITEMSIndex Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Response option analysis
a.Only 46% got the answer
correctly, hence, the item is
moderately difficult.
b.More students from the lower group got the
answer correctly, therefor, it has a negative
discrimination The discrimination index is -21%.
Options A B C D E *
Upper
group
(27%)
2 3 2 2 5
Lower
group
(27%)
2 2 1 1 8
c.No need to analyze the distracters because
the item discriminates negatively.
d.Modify all the distracters
because they are not effective.
Most of the students in the upper
group chose the incorrect option.
The options are effective if most
of the students in the lower
group chose the incorrect
options.
4. Conclusion: Reject the item because it has a negative
discrimination index.
3. Make an analysis about the level
of difficulty, discrimination and
distracters
28. IMPROVING TEST
ITEMSExample 4.POTENTIAL MISKEYED ITEM. Make an item
analysis about the table below. What will you do with the
that is potential miskeyed item?
How to improve the test item
Options A * B C D E
Upper group 1 2 3 10 4
Lower group 3 4 4 4 5
29. 1. Compute the difficulty index.
0.10 OR 10%
n = 1+3=4
N = 40
DF
n
F =
N
_____ ,whereD
4
F =
40
_____ ,whereD
=
Options A * B C D E
Upper
group
1 2 3 10 4
Lower
group
3 4 4 4 5
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
30. 2. Compute the discrimination index.
-0.10 OR -10%
=1
1 =
D
______________ ,whereD
20=D
C
UG
= 3
UG
C
LG
C __ CLG
1 __
3
20
___________
-2
20
______
=
=
=
Options A * B C D E
Upper
group
1 2 3 10 4
Lower
group
3 4 4 4 5
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
D
1
1
31. 3. Make an analysis:
a. More students from the upper group choose option D that option A,
even though option A is the supposedly the correct answer.
b. Mostly likely the teacher has written the wrong answer key.
c. The teacher checks and finds out that he/she did not miskey the answer
that he/she thought is the correct answer.
d. If the teacher miskeyed it he/she must check and retally the score of the
students’ test papers before giving them back.
e. If option A is really the correct answer, revise to weaken option D,
distracters are not supposed to draw more attention than the keyed
answer.
IMPROVING TEST ITEMS
32. 3. Make an analysis:
f. Only 10% of the students got the answer to the test item correctly,
hence, the test item is very difficult.
g. More students from the lower group got the item correctly,
therefore a negative discrimination resulted. The discrimination
index is -10%
h. No need to analyze the distracters because the test item is very
difficult and discrimination negatively.
4. Conclusion: reject the item because it is very difficult and a has
negative discrimination index.
IMPROVING TEST ITEMS
33. IMPROVING TEST
ITEMSIndex Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Response option analysis a.More students from the upper group
choose option D that option A, even
though option A is the supposedly the
correct answer.
Options A * B C D E
Upper
group
1 2 3 10 4
Lower
group
3 4 4 4 5
b.Mostly likely the teacher has
written the wrong answer key.
c.The teacher checks and finds out that
he/she did not miskey the answer that
he/she thought is the correct answer.
d.If the teacher miskeyed it he/she
must check and retally the score of
the students’ test papers before
giving them back.
e.If option A is really the correct answer,
revise to weaken option D, distracters are
not supposed to draw more attention than
the keyed answer.
f.Only 10% of the students got the
answer to the test item correctly,
hence, the test item is very difficult.
g.More students from the lower group
got the item correctly, therefore a
negative discrimination resulted. The
discrimination index is -10%
h.No need to analyze the distracters because the test
item is very difficult and discrimination negatively.
4. Conclusion: reject the item because it is
very difficult and a has negative
discrimination index.
3. Make an analysis: potential miskeyed item
34. IMPROVING TEST
ITEMSExample 5. AMBIGUOUS ITEM. Below is the result of item analysis of
a test with an ambiguous test item. What can you say about the
item? Are you going to retain, revise or reject?
How to improve the test item
Options A B C D E *
Upper group 7 1 1 2 8
Lower group 6 2 3 3 6
35. 1. Compute the difficulty index.
0.36 OR 36%
n = 8+6=14
N = 39
DF
n
F =
N
_____ ,whereD
14
F =
39
_____ ,whereD
=
Options A B C D E *
Upper
group
7 1 1 2 8
Lower
group
6 2 3 3 6
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
36. 2. Compute the discrimination index.
0.10 OR 10%
=8
1 =
D
______________ ,whereD
20=D
C
UG
= 6
UG
C
LG
C __ CLG
8 __
6
20
___________
2
20
______
=
=
=
Options A B C D E *
Upper
group
7 1 1 2 8
Lower
group
6 2 3 3 6
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
1
1
D
37. 3. Make an analysis:
a. Only 36% of the students got the answer to test item correctly,
hence, the test item is difficult.
b.More students from the upper group got the item correctly, hence,
it discriminates positively. The discrimination index is 10%
c. About equal numbers of top students went for option A and
option E, this implies that they could not tell which is the correct
answer. The students do not know the content of the test, thus, a
reteach is needed.
4. Conclusion: Revise the test item because it is ambiguous.
IMPROVING TEST ITEMS
38. IMPROVING TEST
ITEMSIndex Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Response option analysis
Options A B C D E *
Upper
group
7 1 1 2 8
Lower
group
6 2 3 3 6
3. Make an analysis: ambiguous item
a.Only 36% of the students
got the answer to test item
correctly, hence, the test item
is difficult.
b.More students from the upper group got the
item correctly, hence, it discriminates positively. The
discrimination index is 10%
c.About equal numbers of top students went for option
A and option E, this implies that they could not tell
which is the correct answer. The students do not know
the content of the test, thus, a reteach is needed.
4.Conclusion: Revise the test
item because it is
ambiguous.
39. IMPROVING TEST
ITEMSExample 6.GUESSING ITEM. Below is the result of item
analysis of a test with students’ answers mostly based on a
guess. Are you going to retain, revise or reject?
How to improve the test item
Options A B C * D E
Upper group 4 3 4 3 6
Lower group 3 4 3 4 5
40. 1. Compute the difficulty index.
0.18 OR 18%
n = 4+3=7
N = 39
DF
n
F =
N
_____ ,whereD
7
F =
39
_____ ,whereD
=
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Options A B C * D E
Upper
group
4 3 4 3 6
Lower
group
3 4 3 4 5
41. 2. Compute the discrimination index.
0.05 OR 5%
=4
1 =
D
______________ ,whereD
20=D
C
UG
= 3
UG
C
LG
C __ CLG
4 __
3
20
___________
1
20
______
=
=
=
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Options A B C * D E
Upper
group
4 3 4 3 6
Lower
group
3 4 3 4 5
D1
1
42. 3. Make an analysis:
a. Only18% of the students got the answer to the test item correctly.
b. More students from the upper group got the correct answer to the test item;
therefore, the test item is positive discrimination. The discrimination index is 5%.
c. Students responds about equally to all alternatives, an indication that they are
guessing.
Three possibilities why student guesses the answer on a test item:
The content of the test item has not yet been discussed in the class
because the test is designed in advance;
Test item were badly written that students have no idea what the question
is really all about: and
Test item were very difficult as shown from the difficulty index and low
discrimination index.
IMPROVING TEST ITEMS
43. 3. Make an analysis:
d.If the test is well-written but too difficult, reteach
material to the class.
4. Conclusion: Reject the item because it is very
difficult and the discrimination index is very poor, and
option A and B are not effective distracters.
IMPROVING TEST ITEMS
44. IMPROVING TEST
ITEMSIndex Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Response option analysis
3. Make an analysis: guessing item
Options A B C * D E
Upper
group
4 3 4 3 6
Lower
group
3 4 3 4 5
a.Only18% of the students got the
answer to the test item correctly.
b.More students from the upper group got the correct
answer to the test item; therefore, the test item is
positive discrimination. The discrimination index is 5%.
c.Students responds about equally to all
alternatives, an indication that they are
guessing.
d.If the test is well-written but too
difficult, reteach the material to
the class.
4. Conclusion: Reject the item
because it is very difficult and the
discrimination index is very poor, and
option A and B are not effective
distracters.
45. IMPROVING TEST
ITEMSExample 7.Reject the item because it is very difficult and the
discrimination index is very poor, and options A and B are
not effective distracters.
How to improve the test item
Options A B C * D E
Upper group 5 3 9 0 3
Lower group 6 4 6 0 4
46. 1. Compute the difficulty index.
OR %
n = + =
N =
DF
n
F =
N
_____ ,whereD
F = _____ ,?D
=
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Options A B C * D E
Upper
group
5 3 9 0 3
Lower
group
6 4 6 0 4
47. 2. Compute the discrimination index.
OR %
=
1 =
D
______________ ,whereD
=D
C
UG
=
UG
C
LG
C __ CLG
__
___________,?
______
=
=
=
Index Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Options A B C * D E
Upper
group
5 3 9 0 3
Lower
group
6 4 6 0 4
1
1
D
48. 3. Make an analysis about the level of difficulty, discrimination and
distracters.
a. Only ____________ got the answer correctly, hence, the item is
difficult.
b.More students from the upper group answer the test item correctly,
a result, the test got a __________________________ . The discrimination
index is 15%
c. Option A,B, and E are attractive and effective distracters.
d.Option D is in effective; therefore, changing it with more realistic
one.
4. Conclusion: Revise the item by changing option D.
IMPROVING TEST ITEMS
49. IMPROVING TEST
ITEMSIndex Range Difficulty Level
0.00-0.20 Very Difficult
0.21-0.40 Difficult
0.41- 0.60 Average/Mode
rately Difficult
0.61- 0.80 Easy
0.81 – 1.00 Very Easy
Index Range Discrimination
Level
0.19 and below Poor item,
should be
eliminated or
need to be
revised
0.20-0.29 Marginal item,
needs some
revision
0.30- 0.39 Reasonably
good item but
possibly for
improvement
0.40 and
above
Very good
item
Response option analysis
3. Make an analysis:
a.Only 38% got the answer
correctly, hence, the item is
difficult.
Options A B C * D E
Upper
group
5 3 9 0 3
Lower
group
6 4 6 0 4
b.More students from the upper group answer
the test item correctly, as a result, the test got
a positive discrimination. The discrimination
index is 15%
c.Option A,B, and E are attractive and
effective distracters.
d.Option D is in effective; therefore, changing
it with more realistic one.
4. Conclusion: Revise the item by
changing option D.