2. Content
What is a checklist
Five key aspects involved
Element Rating
Using the Checklist.
3. Introduction
The purpose of this presentation is to highlight the
Monitoring and Evaluation Checklist used when
evaluating educational programs (assessments).
It also explains the elements and aspects to be
considered.
Giving guide on how to use a checklist for test
development.
4. Five Key Aspects ivolved
1) test development;
2) test administration;
3) reliability evidence;
4) validity evidence; and
5) scoring and reporting.
5. Element Rating
The Assessment Evaluation Checklists also provide a
format for indicating the extent to which available evidence
provides support for each element subsumed by the aspect.
Elements within each checklist are accompanied by the
following scale:
O = Observed
N = Not Observed
NA = Not Applicable
6. Using the Checklist
To use one of the Assessment Evaluation Checklists, an
evaluator considers the individual element in light of
the evidence related to that element, then indicates
whether the element was observed (O), not observed
(N), or not applicable (NA). An area for elaboration or
comments is provided at the bottom of each checklist.
7. Checklist for Test Development
The Standards for Educational and Psychological
Testing list four phases of test development.
o 1) delineation of the purpose(s) of the test and scope of
the construct or extent of the domain to be measured;
o 2) development and evaluation of test specifications;
o 3) development, field testing, evaluation and selection
of the items, scoring guides and procedures; and
o 4) assembly and evaluation of the test for operational
8. Evaluation Checklist Test Development
O N N/A Evaluating Elements
TD1 - The need/purpose of the test is clearly stated.
TD2 - The appropriate population of intended examinees is
specified.
TD3 - The appropriate and inappropriate uses of the test is
specified.
TD4 - Domain definition is based on systematic, scientific
procedures (e.g. curriculum review).
TD5 - Content standards have been developed and are
documented.
TD6 - Content standards development involved relevant
stakeholders.
TD10 - The type of assessment (e.g., standards-referenced, norm-
referenced)