This document outlines the 10 stages of developing a language proficiency test: 1) Stating the problem and purpose of the test. 2) Writing specifications that outline the test content, structure, timing, techniques and performance criteria. 3) Writing and moderating test items by sampling from the content specifications and having items reviewed by colleagues. 4) Informally trialling test items on native speakers. 5) Trialling the full test on non-native speakers similar to the intended test takers. 6) Analyzing trial results and making any necessary changes to faulty items. 7) Calibrating performance scales. 8) Potentially validating the test further for larger-scale

1. Stages of development
Dayanara Loján

2. Test development
It is better when it’s done by a team.
The desirable qualities for the developers:
native or near native command of the language, intelligence
and imagination.

3. Stages

4. 1.Stating the problem
What kind of test would it be?
What is its precise purpose?
What abilities are to be tested?
How detailed/accurate must the results be?
How important is backwash?
You can take information from tests that have been designed for simmilar
situations. This isn't wrong.

5. 2. Writing specifications for the test
These must be written at the outset.
Includes:
a)content: The entire potential content of any number of versions of a test.
The fuller the information of the content the less arbitrary should be the
subsequent decisions.

6. i.Aspects specified in the content:
1. Operations: scan, skim
2. Types of text: write letters, articles...
3. Addresses of the text
4. Length of texts
5. Topics
6. Structural range: that occur/ should be excluded/ a general
indication
7. Vocabulary range

7. ii. Structure, timing, medium/channel and techniques
Test structure→ sections
Number of items→ in the sections
Medium/ channel→ paper, pencil, online...etc.
Timing→ section and the entire test
Techniques

8. iii. Criteria levels of performance.
Accuracy→
Appropriacy→ Language appropriate to the function?
Range→ vocabulary
Flexibility→ adapt
Size→ more than short- form answers

9. 3. Writing and moderating items.
i. Sampling: Choose wisely from the whole area of content.
ii. Writing items: with specifications in mind/ think like the
test taker/ give a key item.
iii. Moderating items: at least two colleagues.

10. 4. Informal trialling of items on native speakers.

11. 5. Trialling of the test on a group of non-native
speakers similar to those for whom the test is
intended

12. 6. Analysis of results of the trial: making of
any necessary changes.
Were any misinterpretations? Any faulty items?

13. 7.Calibration of scales
8. Validation: if bigger…
9. Writing handbooks for test takers, test users
and staff.
10. Training staff.

14. Conclusion
Making a test is a very complex process. It is in
fact a “construction” more than just a simple
step.