The document discusses different types of objective and subjective tests and their pros and cons. It notes that objective tests like multiple choice are easy to mark reliably but subjective tests like essays are more difficult to mark reliably due to inconsistencies in human judgement. It suggests using fewer assessors with different roles and agreed scores to increase reliability when using subjective tests. The document also discusses different marking techniques like holistic, atomistic, and prepared feature lists to balance reliability and practicality in scoring tests.

1. Carolina Salazar
28.04.2014

3. OBJECTIVE TEST TYPES
 Easy to mark
 Only one marker is needed
 High reliability
 E.g. multiple choice
SUBJECTIVE TEST TYPES
 More difficult to mark
 More than one marker is advisable
 Low reliability
 E.g. oral tests, essays
RIGHTWRONGRight Wrong

4. AVOID SUBJECTIVE
TESTS ALTOGETHER
FACE
INCONSISTENCIES OF
HUMAN JUDGEMENT

6. ASSESSOR ASSESSOR ASSESSOR
HIGHER
RELIABILITYBUT…

7. BUT…
TOO MANY COOKS
SPOIL THE BROTH

8. TOO MANY COOKS
SPOIL THE BROTHSOLUTION
FEWER
ASSESSORS
DIFFERENT
ROLES
AGREED SCORE
SOLVED
DISCREPANCIES

9. BETTER ASSESSORS
MORE CONSISTENT
PROGRAMS EXERCISES
MORE
RELIABLE
STANDARDS

10. SPECIFY
APPROACH IN
ADVANCE
SAVE
UNCERTAINTY
SAVE TIME SAVE MONEY

11.  ANTICIPATE PROBLEMS AND SUGGEST HOW TO COPE WITH THEM
 MAINTAIN THE AIMS OF THE TEST
 GIVE GENERAL GUIDELINES FOR DEALING WITH UNCOMMON RESPONSES
 DESCRIBE THE PURPOSE OF EACH QUESTION

12. HOLLISTIC
 TEST OVERALL PROFICIENCY
ATOMISTIC
 ASSESS SPECIFIC SKILLS
Least
reliable
Most
reliable

13. NOT ALL CATEGORIES IN A TEST ARE EQUALLY IMPORTANT…
LESS
IMPORTANT
MORE
IMPORTANT

14. DESCRIPTION
OF LEVELS
LANGUAGE
ABILITY
TYPICAL
LEARNERBUT…

15. BUT…
FEW LEARNERS ARE TYPICAL  CREATE
PROFILES AND CATEGORIES

16. CONTINUITY!

18. OVERALL
PERFORMANCE
NO SYSTEM FOR
COUNTING
ERRORS
SINGLE SCALE
FOR ENTIRE TEST
QUICK
PROCEDURE
SUBJECTIVE
JUDGEMENT
ADVISABLE TO
COMBINE IT WITH
OTHER MARKING
SYSTEM

19. PREPARED
LIST OF
FEATURES
1 MARK FOR
EACH
FEATURE
STARTS WITH
ZERO
INCREMENTAL
MARKING
SYSTEM

20. PREPARED LIST
OF FEATURES
SUBSTRACTION
OF 1 MARK FOR
EACH MISTAKE
ENDS WITH A
MINIMUM OF ZERO
UNSUITABLE FOR
CERTAIN
CATEGORIES
(STYLE, CONTENT)
ADVISABLE TO
COMBINE IT WITH
OTHER
TECHNIQUES