The document summarizes the process for developing test items for graded English language exams. It involves 4 main stages: 1) Item writers are recruited and trained to write test prompts. 2) Test items are commissioned, pre-edited, may be resubmitted or rejected, and edited by a panel. 3) Approved items are trial tested, reviewed for bias, and added to the test bank or rejected. 4) Final exam materials are produced and analyzed after testing. Examples show an item being resubmitted and edited during development.

1. Represented by Gemma Bellhouse, Test Production Manager
Language Testing Forum, University of Oxford, 20–22 November 2015
Example: Graded Examinations in
Spoken English interactive prompt
GESE Grade 12 (C2)
Example 3 (resubmitted)
Some people claim that the tabloid press and sensationalist
journalism and media around the world merely reflects society and
does not shape it. I sometimes wonder if that really is the case.
Resubmission:
Some people claim that the tabloid press and sensationalist
journalism and media all around the world simply reflects a
society and does not shape it. I sometimes wonder if that really is
the case.
Prompt after panel edit:
Some people claim that sensationalist journalism all around the
world simply reflects a society and doesn’t shape it. I wonder if
that really is the case.
Final live prompt:
Some people claim that sensationalist journalism simply
reflects a society and doesn’t shape it. I wonder if that really
is the case.
The Test Production Process
Stage 1
 Item writers are recruited
� Initial and ongoing training
www.trinitycollege.com/GESE
Stage 2
(see examples)
� Items are commissioned
� Items are pre-edited in-house
� Items are accepted or rejected
� Items are resubmitted in line with feedback
� Items are edited by a panel
� Items are typeset and proofread
Stage 3
� Items are trialled/pretested
� Items are reviewed for bias
� Items are banked or rejected
Stage 4
� Exam materials/test papers go live
� Post-test analysis
Examples: Graded Examinations in
Spoken English interactive prompts
GESE Grade 10 (C1)
Example 1 (resubmitted)
Nowadays entertainment seems to be too focused on technology
with downloads readily available to phones, computers and
tablets. If we continue this way I fear that real social interaction
will become a thing of the past.
Resubmission:
Nowadays technology seems to have taken over in all areas
of life, especially entertainment. If this trend continues I think
that the consequences can only be detrimental to traditional
family pastimes.
Prompt after panel edit:
Nowadays technology seems to have taken over many areas
of life, especially entertainment. If this trend continues, I think that
the consequences will be detrimental to traditional family pastimes.
Final live prompt:
Nowadays technology seems to have taken over many areas of
life, especially entertainment. If this trend continues, I think that
the consequences will be detrimental to traditional pastimes.
Example 2 (rejected)
These days people spend a lot of time campaigning on
environmental issues. However, in my opinion there can be
no rational debate on these issues until people understand
the science involved.
The Journey of a test item
Pre-editing feedback:
Similar to old task: DVD vs cinema; and too dependent
on technology. Tighten up the phrasing.
Pre-editing feedback:
Reject: Requires specific scientific knowledge
Pre-editing feedback:
Edit to avoid UK bias: ‘tabloid’.