ANALYZING AND USING TEST ITEM DATA
Purposes and Elements of Item Analysis <ul><li>To select the best available items for the final form of the test. </li></u...
Three Elements in an Item Analysis <ul><li>Examination of the difficulty level of the items, </li></ul><ul><li>Determinati...
<ul><li>The difficulty level of an item is known as  index of difficulty . </li></ul><ul><li>Index of difficulty  is the p...
Preparing Data for Item Analysis <ul><li>Arrange test scores from highest to lowest. </li></ul><ul><li>Get one-third of th...
<ul><li>Add the number of correct answers to each item made by the combined upper and lower groups. </li></ul><ul><li>Comp...
<ul><li>Compute the index of discrimination, based on the formula: </li></ul><ul><li>IDN =  (CU –CL) </li></ul><ul><li>  N...
Using Information about Index of Difficulty <ul><li>The difficulty index of a test item tells a teacher about the comprehe...
Item Group Answers A  B  C  D Total No. of Correct Answers Difficulty Index H – L  Discrimination Index 1 H  20 L  20 3  1...
<ul><li>For an item to be considered a good item, its difficulty index should be 50%.  An item with 50% difficulty index i...
Interpretation of the Difficulty Index Range Difficulty Level 20 & below 21 – 40 41 – 60 61 – 80 81 & above Very Difficult...
Using Information  about Index of Discrimination <ul><li>The index of discrimination tells a teacher the degree to which a...
<ul><li>There are instances when an item has zero discriminating power – when equal number of students from upper and lowe...
Interpretation of the Index of Discrimination Range Verbal Description .40 & above .30 – .39 .20 – .29 .09 – .19 Very Good...
<ul><li>When should a test item be rejected?  Retained? Modified or revised? </li></ul><ul><li>A test item can be retained...
Examining Distractor Effectiveness <ul><li>An ideal item is one that all students in the upper group answer correctly and ...
Developing an Item Data File   <ul><li>Encourage teachers to undertake an item analysis as often as practical </li></ul><u...
Limitations of Item Analysis <ul><li>It cannot be used for essay items. </li></ul><ul><li>Teachers must be cautious about ...
Upcoming SlideShare
Loading in …5
×

Analyzing and using test item data

9,872 views

Published on

5 Comments
10 Likes
Statistics
Notes
No Downloads
Views
Total views
9,872
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
436
Comments
5
Likes
10
Embeds 0
No embeds

No notes for slide

Analyzing and using test item data

  1. 1. ANALYZING AND USING TEST ITEM DATA
  2. 2. Purposes and Elements of Item Analysis <ul><li>To select the best available items for the final form of the test. </li></ul><ul><li>To identify structural or content defects in the items. </li></ul><ul><li>To detect learning difficulties of the class as a whole </li></ul><ul><li>To identify the areas of weaknesses of students in need of remediation . </li></ul>
  3. 3. Three Elements in an Item Analysis <ul><li>Examination of the difficulty level of the items, </li></ul><ul><li>Determination of the discriminating power of each item, and </li></ul><ul><li>Examination of the effectiveness of distractors in a multiple choice or matching items. </li></ul>
  4. 4. <ul><li>The difficulty level of an item is known as index of difficulty . </li></ul><ul><li>Index of difficulty is the percentage of students answering correctly each item in the test </li></ul><ul><li>Index of discrimination refers to the percentage of high-scoring individuals responding correctly versus the number of low-scoring individuals responding correctly to an item. </li></ul><ul><li>This numeric index indicates how effectively an item differentiates between the students who did well and those who did poorly on the test. </li></ul>
  5. 5. Preparing Data for Item Analysis <ul><li>Arrange test scores from highest to lowest. </li></ul><ul><li>Get one-third of the papers from the highest scores and the other third from the lowest scores. </li></ul><ul><li>Record separately the number of times each alternative was chosen by the students in both groups. </li></ul>
  6. 6. <ul><li>Add the number of correct answers to each item made by the combined upper and lower groups. </li></ul><ul><li>Compute the index of difficulty for each item, following the formula: </li></ul><ul><li>IDF = ( NRC / TS )100 </li></ul><ul><li>where IDF = index of difficulty </li></ul><ul><li> NRC = number of students responding correctly to an item </li></ul><ul><li> TS = total number of students in the upper and lower groups </li></ul><ul><li> </li></ul>
  7. 7. <ul><li>Compute the index of discrimination, based on the formula: </li></ul><ul><li>IDN = (CU –CL) </li></ul><ul><li> NSG </li></ul><ul><li>where IDN = index of discrimination </li></ul><ul><li>CU = number of correct responses of the upper group </li></ul><ul><li>CL = number of correct responses of the lower group </li></ul><ul><li>NSG = number of students per group </li></ul>
  8. 8. Using Information about Index of Difficulty <ul><li>The difficulty index of a test item tells a teacher about the comprehension of or performance on material or task contained in an item. </li></ul>
  9. 9. Item Group Answers A B C D Total No. of Correct Answers Difficulty Index H – L Discrimination Index 1 H 20 L 20 3 14 2 1 10 7 3 0 21 52.5 7 0.35 2 H 20 L 20 0 0 18 2 0 3 9 8 27 67.5 9 0.45 3 H 20 L 20 3 8 4 4 10 2 4 4 10 25.0 6 0.30 4 H 20 L 20 3 3 4 10 2 4 10 4 14 35.0 6 0.30 5 H 20 L 20 <ul><li>2 2 1 </li></ul><ul><li>1 10 4 5 </li></ul>16 40.0 14 0.70
  10. 10. <ul><li>For an item to be considered a good item, its difficulty index should be 50%. An item with 50% difficulty index is neither easy nor difficult. </li></ul><ul><li>If an item has a difficulty index of 67.5%, this means that it is 67.5% easy and 32.5% difficult. </li></ul><ul><li>Information on the index of difficulty of an item can help a teacher decide whether a test should be revised, retained or modified . </li></ul>
  11. 11. Interpretation of the Difficulty Index Range Difficulty Level 20 & below 21 – 40 41 – 60 61 – 80 81 & above Very Difficult Difficult Average Easy Very Easy
  12. 12. Using Information about Index of Discrimination <ul><li>The index of discrimination tells a teacher the degree to which a test item differentiates the high achievers from the low achievers in his class. A test item may have positive or negative discriminating power. </li></ul><ul><li>An item has a positive discriminating power when more students from the upper group got the right answer than those from the lower group </li></ul><ul><li>When more students from the lower group got the correct answer on an item than those from the upper group, the item has a negative discriminating power. </li></ul>
  13. 13. <ul><li>There are instances when an item has zero discriminating power – when equal number of students from upper and lower group got the right answer to a test item. </li></ul><ul><li>In the given example, item 5 has the highest discriminating power. This means that it can differentiate high and low achievers. </li></ul>
  14. 14. Interpretation of the Index of Discrimination Range Verbal Description .40 & above .30 – .39 .20 – .29 .09 – .19 Very Good Item Good Item Fair Item Poor Item
  15. 15. <ul><li>When should a test item be rejected? Retained? Modified or revised? </li></ul><ul><li>A test item can be retained when its level of difficulty is average and discriminating power is positive. </li></ul><ul><li>It has to rejected when it is either easy/very easy or difficult/very difficult and its discriminating power is negative or zero. </li></ul><ul><li>An item can be modified when its difficulty level is average and its discrimination index is negative. </li></ul>
  16. 16. Examining Distractor Effectiveness <ul><li>An ideal item is one that all students in the upper group answer correctly and all students in the lower group answer wrongly. And the responses of the lower group have to be evenly distributed among the incorrect alternatives. </li></ul>
  17. 17. Developing an Item Data File <ul><li>Encourage teachers to undertake an item analysis as often as practical </li></ul><ul><li>Allowing for accumulated data to be used to make item analysis more reliable </li></ul><ul><li>Providing for a wider choice of item format and objectives </li></ul><ul><li>Facilitating the revision of items </li></ul><ul><li>Facilitating the physical construction and reproduction of the test </li></ul><ul><li>Accumulating a large pool of items as to allow for some items to be shared with the students for study purposes. </li></ul>
  18. 18. Limitations of Item Analysis <ul><li>It cannot be used for essay items. </li></ul><ul><li>Teachers must be cautious about what damage may be due to the table of specifications when items not meeting the criteria are deleted from the test. These items are to be rewritten or replaced. </li></ul>

×