How to write test

1. How do you write tests?
Course Title : Language Test Development
Professor: Dr. Lemuel Fontillas
Prepared by: Roselle M. Reonal

2. Phases of Language Test Development
Identifying
objectives
PLANNING DESIGNING
Writing
specifications
Deciding on test
features and
topics produced
DEVELOPMENT
Trial of
materials
developed
OPERATIONAL
Construction
and
administration
of a complete
test
MONITORING
Live test
performance
analyzed
Revision of
materials

3. Principles of Language
Assessment
• Practicality
• Reliability
• Validity

4. 1. Practicality
• Not excessively expensive
• Stay within appropriate time
constraints
• is relatively easy to administer
• Has a scoring/ evaluation
procedure that is specific and
time-efficient
Image source: https://alchetron.com/cdn/h-douglas-brown-
b5ccd29f-4ff1-4c05-96c5-360d1ac5983-resize-750.jpeg
A test that is
prohibitively expensive
is impractical!

5. 2. Reliability
A reliable test is consistent and dependable..
Image source: https://alchetron.com/cdn/h-douglas-brown-
b5ccd29f-4ff1-4c05-96c5-360d1ac5983-resize-750.jpeg
If you give the same test to
the same student or matched
students in two different
occasions, the test should
yield similar results.

6. A. Student-Related
Reliability
Most common learner-
related issue, caused by
temporary illness, fatigue,
a “bad day”, and other
physical and
psychological factors.
Image source: https://alchetron.com/cdn/h-douglas-brown-
b5ccd29f-4ff1-4c05-96c5-360d1ac5983-resize-750.jpeg

7. Image source: https://herviewfromhome.com/wp-
content/uploads/2017/01/shutterstock_148498271.jpg
Students being sick is a
student-related
reliability

8. B. Rater Reliability
Human error, subjectivity, and bias may
enter into the scoring process
Image source: https://i.imgflip.com/2higha.jpg
1. Inter-rater Reliability
Lack of attention to scoring
criteria, inexperience,
inattention, pr even
preconceived biases
2. Intra-Rater Reliability
Unclear scoring criteria,
fatigue, bias toward particular
“good” and “bad” students or
simple carelessness

9. Image source:
https://hg1.funnyjunk.com/pictures/Three+tremendous+camel_ca357a_7105519.jpg
Favoritism in classroom
is one example that
affects rater reliability

10. C. Test Administration
Reliability
Conditions in which the
test is administered
ex. Photocopying
variations, amount of light
and temperature, and
condition of desks and
chairs
Image source: https://memegenerator.net/img/instances/73360884.jpg

11. Image source: https://www.officialgazette.gov.ph/images/uploads/Beneficiaries-in-
Naneng-Tabuk-Kalinga1-copy.jpg
The conditions of the
classroom and its
equipment also affect
reliability.

12. D. Test Reliability
The nature of the test
itself can cause
measurement errors
Ex: timed tests,
ambiguous test
questions
Image source: https://pics.me.me/when-youre-taking-a-test-dont-
understand-not-even-one-14924818.png

13. Image sources: https://www.mrmemel.com,
https://www.reddit.com/r/memes/comments/dev42k/ah_yes_simple_test/
Ambiguous test questions can also
affect reliability.

14. 3. Validity
the extent to inferences made from assessment results are
appropriate, meaningful, and itself in terms of the purpose of
the assessment (Grolund, 1998).
Image source: https://alchetron.com/cdn/h-douglas-brown-
b5ccd29f-4ff1-4c05-96c5-360d1ac5983-resize-750.jpeg
Most complex criterion of an
effective test—arguably the
most important principle

15. A. Content Validity
Test samples the subject matter, and requires the test-
maker to perform the behavior that is being measured
Image source: https://i.imgflip.com/2higha.jpg
1. Direct Testing
Test-taker actually performs
target tasks
2. Indirect Testing
Learners are not performing
the task itself but rather a task
that is related in some way

16. B. Criterion-Related Validity
The extent to which
“criterion” of the test has
actually been reached
Image source:
https://media.tenor.com/images/584268c8e41bc68ba976700343e46791/tenor.gif

17. C. Construct Validity
A construct is any theory,
hypothesis, or model that
attempts to explain a
phenomena
Image source: https://pics.me.me/when-youre-taking-a-test-dont-
understand-not-even-one-14924818.png

18. D. Consequential Validity
Encompasses all the consequences of a
test, including considerations as its
accuracy in: measuring intended
criteria, impact on the preparations of
the test-takers, its effect on the learners
social consequences of a test’s
interpretation and use
Image source: https://pics.me.me/when-youre-taking-a-test-dont-
understand-not-even-one-14924818.png

19. E. Face Validity
Students view the assessment
as fair, relevant, and useful for
improving learning.
Image source: https://pics.me.me/when-youre-taking-a-test-dont-
understand-not-even-one-14924818.png

20. Reference:
Brown, H. (2004). Principles and
Classroom Practices. New York:
Longman.