Your SlideShare is downloading. ×
0
ADMINISTERING,SCORINGAND REPORTING A TEST        MANALI H SOLANKI        F.Y. M.SC. NURSING        J G COLLEGE OF        N...
TERMINOLOGY   Analysis: The examination and    evaluation of the relevant information    to select the best course of act...
 Scoring:It means to evaluate and assign a grade. Report: A document   containing information organized in a narrative, ...
INTRODUCTION: Administering the written test is perhaps the most important aspect of the examining process. The atmospher...
 The test administrators manner, bearing, and attitude may well inspire confidence in competitors and put them at ease wh...
ADMINISTERING A TEST: A teachers test administration procedures can have great impact on student test performance.Before ...
TYPES OF SCORERaw Scores : A Raw Score is simply the number of questions a student answers correctly for a test.
Uses: A raw score provides an indication of the variability in performance among students in a classroom.
Limitations: A rawscore by itself has no meaning. It can be interpreted only by comparing it with some standard such as t...
Percentile Rank A percentile is a measure that tells us what percent of the total frequency scored at or below that measu...
Advantages: Laypeople easily understand them Easy   to interpret
Limitations: Percentile   differences are not equal
Stanine (Standard nine) Standard  nine) : Stanine scores express test results in equal steps that range from 1 (lowest) t...
Standard Scores The  standard scores indicate a  student’s relative position in a  group. It expresses test  performance ...
Types of standard ScoresZ – Score If a mean and standard deviation  can be calculated for a given set  of raw scores, eac...
    Z – Score =          Raw Score –Mean/Standard     deviation    Note: Z – score is always minus when    the raw score ...
T Scores: anyset of normally distributed standard scores that has a mean of 50 and SD of 10. Multiplying the z – score by...
Advantages only   positive integers are provided    Interpretation is relatively simple    once the concept of T – Score...
GRADING Grading refers to the process of using symbols, such as letter to indicate various types of students progress (Ni...
Common Methods ofGrading : Lettergrades : There is a great flexibility in the number of grades that can be adopted i.e. 3...
Limitations: Meaning   of grades may vary widely Do not describe strengths/weakness of students
Strengths: Easy   to use Easyto interpret theoretically Provide   a concise summary
 Number/Percentage        grades (5, 3, 2, 1, 0) or (98%, 80%, 60% etc.) It is same as letter grades. Only difference is ...
Strengths: Easy to use Easy to interpret theoretically Provide a concise summary May be combined with letter  grades ...
Limitations: Meaning   of grades may vary  widely Do not describe  strengths/weaknesses of students Meaning may need to...
Two category grades Itis good for courses that  require mastery of learning.
Strengths: Less emotional for students.Limitations : Less reliable Does not contain enough  information about student’s...
CHECK LIST AND RATING SCALE They are more detailed and since they are too detailed it is cumbersome for teachers to prepare
Strengths Present        detailed lists of students’ achievements Canbe combined with letter grades Good   for clinical...
Limitations: May become too detailed to easily comprehend Difficult   for record keeping.
Advantages of Grades Grades    are divided in to 5 – 7  divisions to which student’s  performance is assigned as  compare...
Disadvantages of Grades: The  assigned grades varies  from teacher to teacher 2. Do not indicate students  strengths or ...
Scoring Essay type Questions: Evaluating essay response the evaluator should: Evaluator should use appropriate  method to...
Method of grading essay typequestion : Analytical   grading : (Point method) In this method of the ideal answer to a ques...
ADVANTAGES: Itcan yield very reliable scores The preparation of detailed  answer may bring to the teachers. The sub div...
LIMITATIONS: Itis very laborious and time  consuming In attempting to identify the  elements, undue attention may be  gi...
Global grading: In   this method the ideal answer is not sub divided into the specific points and component points. The e...
Sequential Grading In   order to bring more objectivity more answers can be scored beautifully. This is the same teacher ...
Computer Software    The “Software” learns a specific    subject area by scanning    appropriate documents.    Then, the ...
Scoring Objective Tests   Hand graded :    Due to human effort, mistakes    may occur. Having two graders    grade exams ...
Machine Scoring : As  accurate as the answer  code given to the computer. Some testing publishers will  only release or ...
Avante InternationalTechnology (Biometric) The first test scoring system to achieve less than 1 error in 1.5 million mark...
ITEM ANALYSIS:
Definition   Item analysis is a process that    examines students’ response to    individual test items/questions in orde...
Benefits of item analysis: Provides    a basis for efficient  classroom discussion of the test  results Provides data fo...
Procedures involved in anitem analysis Qualitative: Qualitative item analysis procedures  include proofreading of the exa...
Quantitative: Item difficulty index (p) Item difficulty index portrays the  “easiness” of an item because the  higher th...
 Item difficulty = R/T R = number of students who correctly answered the item T = number of students included for the ana...
Item Discrimination Index (D) The item discrimination index of a test refers to the degree, which the item discriminates ...
 Theformula to determine itemdiscrimination index is :   D = R u - R 1/ ½ TRu = number of students in theupper group who ...
EXAMPLE:   After you have notified the doctor    about leg pain in a postpartum mother,    your most APPROPRIATE action  ...
Distractor Power The kind of statistic is Distractor Power. It provides information about effectiveness of the distractors
Simplified item analysisprocedures Conducttest/exams and score them. (Suppose we have conducted test on 21 students). Ar...
 Calculate  27% of the answer sheet. For a group of 21 students it will be approx. 6. Select 6 papers within the highest...
 Compute the difficulty index of each item. Compute  the discriminating index of each item. Evaluate    the effectivene...
REPORTING
GOALS Accurate  and useful reporting of assessment results enables teachers, students, parents and the public to understa...
JOURNAL: Developing   and scoring essay tests.
Administering,scoring and reporting a test ppt
Administering,scoring and reporting a test ppt
Administering,scoring and reporting a test ppt
Upcoming SlideShare
Loading in...5
×

Administering,scoring and reporting a test ppt

4,159

Published on

0 Comments
5 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
4,159
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
267
Comments
0
Likes
5
Embeds 0
No embeds

No notes for slide

Transcript of "Administering,scoring and reporting a test ppt"

  1. 1. ADMINISTERING,SCORINGAND REPORTING A TEST MANALI H SOLANKI F.Y. M.SC. NURSING J G COLLEGE OF NURSING
  2. 2. TERMINOLOGY Analysis: The examination and evaluation of the relevant information to select the best course of action from among various alternatives. Test: A procedure for critical evaluation; a means of determining the presence, quality, or truth of something.
  3. 3.  Scoring:It means to evaluate and assign a grade. Report: A document containing information organized in a narrative, graphic, or tabular form, prepared on ad hoc, periodic, recurring, regular, or as required basis.
  4. 4. INTRODUCTION: Administering the written test is perhaps the most important aspect of the examining process. The atmosphere the test administrator creates in the test room and the attitude the test administrator displays in performing his/her duties is extremely important
  5. 5.  The test administrators manner, bearing, and attitude may well inspire confidence in competitors and put them at ease while participating in the testing process.
  6. 6. ADMINISTERING A TEST: A teachers test administration procedures can have great impact on student test performance.Before the testAfter Distributing Test PapersDuring the TestAfter the Test
  7. 7. TYPES OF SCORERaw Scores : A Raw Score is simply the number of questions a student answers correctly for a test.
  8. 8. Uses: A raw score provides an indication of the variability in performance among students in a classroom.
  9. 9. Limitations: A rawscore by itself has no meaning. It can be interpreted only by comparing it with some standard such as total number of items for a test or with raw scores earned by a comparison group.
  10. 10. Percentile Rank A percentile is a measure that tells us what percent of the total frequency scored at or below that measure. A percentile rank is the percentage of scores that fall at or below a given score.
  11. 11. Advantages: Laypeople easily understand them Easy to interpret
  12. 12. Limitations: Percentile differences are not equal
  13. 13. Stanine (Standard nine) Standard nine) : Stanine scores express test results in equal steps that range from 1 (lowest) to 9 (highest). The average is a score of 5. In general, stanine scores 1,2 & 3 are below average, 4,5 & 6 are average and 7, 8 & 9 are above average
  14. 14. Standard Scores The standard scores indicate a student’s relative position in a group. It expresses test performance in terms of standard deviation units from the mean The mean is the arithmetical average. The standard deviation is a measure of the spread of scores in a group.
  15. 15. Types of standard ScoresZ – Score If a mean and standard deviation can be calculated for a given set of raw scores, each raw scores can be expressed in terms of its distance from the mean in standard deviation units or z – scores.
  16. 16.  Z – Score = Raw Score –Mean/Standard deviation Note: Z – score is always minus when the raw score is smaller than the mean.
  17. 17. T Scores: anyset of normally distributed standard scores that has a mean of 50 and SD of 10. Multiplying the z – score by 10 and adding the product to 50 can obtain T Scores.
  18. 18. Advantages only positive integers are provided Interpretation is relatively simple once the concept of T – Score is grasped.
  19. 19. GRADING Grading refers to the process of using symbols, such as letter to indicate various types of students progress (Nitko 2001).
  20. 20. Common Methods ofGrading : Lettergrades : There is a great flexibility in the number of grades that can be adopted i.e. 3 – 11.
  21. 21. Limitations: Meaning of grades may vary widely Do not describe strengths/weakness of students
  22. 22. Strengths: Easy to use Easyto interpret theoretically Provide a concise summary
  23. 23.  Number/Percentage grades (5, 3, 2, 1, 0) or (98%, 80%, 60% etc.) It is same as letter grades. Only difference is that instead of letters numbers of percentage is used.
  24. 24. Strengths: Easy to use Easy to interpret theoretically Provide a concise summary May be combined with letter grades More continuous than letter grades
  25. 25. Limitations: Meaning of grades may vary widely Do not describe strengths/weaknesses of students Meaning may need to be explained or interpreted.
  26. 26. Two category grades Itis good for courses that require mastery of learning.
  27. 27. Strengths: Less emotional for students.Limitations : Less reliable Does not contain enough information about student’s achievement Provides no indication of the level of learning.
  28. 28. CHECK LIST AND RATING SCALE They are more detailed and since they are too detailed it is cumbersome for teachers to prepare
  29. 29. Strengths Present detailed lists of students’ achievements Canbe combined with letter grades Good for clinical evaluation
  30. 30. Limitations: May become too detailed to easily comprehend Difficult for record keeping.
  31. 31. Advantages of Grades Grades are divided in to 5 – 7 divisions to which student’s performance is assigned as compared to 101 (0 – 100) divisions of conventional marking. It is a convenient method. Chances of errors are minimized
  32. 32. Disadvantages of Grades: The assigned grades varies from teacher to teacher 2. Do not indicate students strengths or weaknesses 3. Foster unfair competition among students.
  33. 33. Scoring Essay type Questions: Evaluating essay response the evaluator should: Evaluator should use appropriate method to minimize bias Pay attention to the significant and relevant aspects of the answer Be careful not to let personal idiosyncrasy affect assessment Apply uniform standard to all the
  34. 34. Method of grading essay typequestion : Analytical grading : (Point method) In this method of the ideal answer to a question is specified in advance, although need not be in the amplitude the ideal or model answer is broken down into
  35. 35. ADVANTAGES: Itcan yield very reliable scores The preparation of detailed answer may bring to the teachers. The sub division of the model answer can make it easier to discuss with the students the marks awarded to them.
  36. 36. LIMITATIONS: Itis very laborious and time consuming In attempting to identify the elements, undue attention may be given to the specific aspect.
  37. 37. Global grading: In this method the ideal answer is not sub divided into the specific points and component points. The examiner is interacted to read the responses rapidly from a general impression and using some standard and standard assign
  38. 38. Sequential Grading In order to bring more objectivity more answers can be scored beautifully. This is the same teacher valuing answer of a particular question.
  39. 39. Computer Software The “Software” learns a specific subject area by scanning appropriate documents. Then, the software is fed graded essays to set up the grading standards.
  40. 40. Scoring Objective Tests Hand graded : Due to human effort, mistakes may occur. Having two graders grade exams help to catch 90% of those simple mistakes in grading.
  41. 41. Machine Scoring : As accurate as the answer code given to the computer. Some testing publishers will only release or sell their products to individuals who have undergone special training or have a particular degree in a related field.
  42. 42. Avante InternationalTechnology (Biometric) The first test scoring system to achieve less than 1 error in 1.5 million marks during testing by an independent testing laboratory responsible for testing election equipment and ballots. The same error-free tabulation method is adapted for test scoring and grading, and survey tabulation.
  43. 43. ITEM ANALYSIS:
  44. 44. Definition Item analysis is a process that examines students’ response to individual test items/questions in order to assess the quality of those items and of the test as a whole.
  45. 45. Benefits of item analysis: Provides a basis for efficient classroom discussion of the test results Provides data for remedial work Provides a basis for the general improvement of classroom instruction Provides a basis for increased skill in item construction
  46. 46. Procedures involved in anitem analysis Qualitative: Qualitative item analysis procedures include proofreading of the exam prior to administering it for typographical errors, for grammatical cues and for appropriateness of the reading level of the material, conducting small group discussions of students after the exam and some time with the experts.
  47. 47. Quantitative: Item difficulty index (p) Item difficulty index portrays the “easiness” of an item because the higher the percentage, the easier the item. Item difficulty index is symbolized by p.
  48. 48.  Item difficulty = R/T R = number of students who correctly answered the item T = number of students included for the analysis.
  49. 49. Item Discrimination Index (D) The item discrimination index of a test refers to the degree, which the item discriminates between high achieving students and low achieving students in terms of the scores of the total test
  50. 50.  Theformula to determine itemdiscrimination index is : D = R u - R 1/ ½ TRu = number of students in theupper group who got the itemright.R1 = number of students in thelower group who got the item right. ½ T = One half of the total number of students included in the
  51. 51. EXAMPLE: After you have notified the doctor about leg pain in a postpartum mother, your most APPROPRIATE action would be to Massage her leg to increase circulation Have her walk around to decrease the stiffness Ask her to remain in bed
  52. 52. Distractor Power The kind of statistic is Distractor Power. It provides information about effectiveness of the distractors
  53. 53. Simplified item analysisprocedures Conducttest/exams and score them. (Suppose we have conducted test on 21 students). Arrange all answer sheets in order of merit (From higher to the lower score).
  54. 54.  Calculate 27% of the answer sheet. For a group of 21 students it will be approx. 6. Select 6 papers within the highest total score and the 6 papers with the lowest total score. Putaside 9 papers. They will not be used.
  55. 55.  Compute the difficulty index of each item. Compute the discriminating index of each item. Evaluate the effectiveness of distracter
  56. 56. REPORTING
  57. 57. GOALS Accurate and useful reporting of assessment results enables teachers, students, parents and the public to understand why various assessment instruments are being applied and how the results will be used as part of the institute improvement process
  58. 58. JOURNAL: Developing and scoring essay tests.
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×