Principles of Item Building

1. Azizi Ahmad

2. 9 point system from Malaysian Examination Syndicate:
Conform
Curriculum
Conform
Chance
Conform
Specification
Accuracy
Construct Accuracy
Topic
Clear
Suitable
Difficulty Level
Suitable
Important
Suitable
Fair
Azizi Ahmad

3. Azizi AhmadAzizi Ahmad

4. Multiple Choice Questions (MCQ)
Multiple Complementary Combination
Easy Type
(I) Fill in the Blank
(Ii) Matching
(Iii) True-False (Q Binary)
Azizi Ahmad

5. Azizi Ahmad

6. Multiple Choice
Options
- several choices response
(normally four choices – A, B, C, D)
- most popular
Multiple
Complementary
Complete
(Multiple
combinations)
- Combination of responses
( I, II, III , IV)
Azizi Ahmad

7. Stem/Task Question / Task
Statement of what is needed to be
given / presented by candidates in
response to the item.
Option Choices of given response
(A, B, C, D)
Key The correct option
Azizi Ahmad

8. Distractor Not the selected response
Serves to attract candidates who
have not mastered the subject
Statement that is indeed wrong, or
partly correct but does not conform
to stem.
Azizi Ahmad

9. Stimulus Describe a situation or conditions.
In the form of quotes, statements,
diagrams, flow charts,
conversation and others
Azizi Ahmad

10. STEM/TASK
The figure below shows the Paleolithic shelter. Why people
choose these early cave as a place to stay?
A. It's easy to get forest resources
B. Safe from enemies
C. Save the cost of construction of houses
D. Protect themselves from the animals
OPTION
KEY
DISTRACTOR
STIMULUS
Azizi Ahmad

11. Use simple clear language and vocabulary
Ensure language suitable and accord to
the reading and the language abilities of
students. (Vocabulary, sentence structure,
grammar and others)
Azizi Ahmad

12. Avoid continuously using material from the text
book.
Avoid using or copying items directly from
reference or text books.
Azizi Ahmad

13. Make certain each item is independent of the
other items in the test. (Gronlund,1982)
If some questions are based on the stimulus /
stimuli, make sure each independent question is
not closely related with another question..
Azizi Ahmad

14. Build items on what is learned by students
Balance the key for each letter.
Balanced the response distributions A/B/C/D.
Distractor chosen by weak student
Azizi Ahmad

15. A consistent system must be implement
i) Capital letters to be used in the first word for
the whole test
ii) The main questions / stem is not a complete
verse, alternative should start with the
lowercase (except) special name and
ends with appropriate suffix sentences.
Azizi Ahmad

16. The number of options or alternative answers
need not necessarily be consistent with
each item.
There is no advantage to set the number
to an alternative, for example, only four.
.
Ebel, 1979
Azizi Ahmad

17. Azizi AhmadAzizi Ahmad

18. *Avoid using two negative words in a
question (option and stem).
Example :
Which of the statement is NOT TRUE about friction?
A. Produce heat.
B. Non existence on wet floor.
C.Allow us to hold an object.
D.Drain surface contact with each other.
Suggestion : Exists on rough floor.Azizi Ahmad

19. *Avoid using or writing negative stem.
If unavoided, explain the negative aspects
by underline or bold print or using capital
letters (pg 47)
Example :
Which of statement is NOT TRUE about friction?
link
Azizi Ahmad

20. *Stem must be CLEAR.
-State the problem to be solved.
-No Depending on options.
Example :
Savings is
A unexpended consumption.
B disposable income less taxable income.
C disposable income minus consumption spending.
D minus consumption spending disposable income.
Suggestion : Define what is savings?Azizi Ahmad

21. *As far as possible, create it the form of
questioning.
It is proposed that the item is written in the
format of questioning because it is more
effective, convenient and 'direct' to get a
response from the students.
(Haladyna and Downing (1989) and Statman (1988)
Azizi Ahmad

22. Example :
The fitness components is related to health.
A. Flexibility
B. Agility
C. Muscle strength
D. Body Composition
Suggestion:
What are the components of health-related fitness?
Azizi Ahmad

23. If it is written in the form of statements
that are not complete (fill in the blank),
avoid ‘fill in’ at the beginning of the item.
Fill in the blank may be placed in the middle
or at the end of item.
Azizi Ahmad

24. Example UPSR 2009 :
My family has ________ in this village for the past five years.
A been residing
B perform pilgrimage
C been sheltering
D perform exchanges
Relations between the two twin brothers are very close and difficult to
separate ___________
A ring with gems
B tacky like bile in the liver
C like turmeric with lime
D such as the fenced stars
General Realisation
Stem : form a complete sentence,
incomplete sentences,
questions and others
Azizi Ahmad

25. *Stem does not contained unrelevant or
cosmetic information.
Example :
Figure 2 shows a rectangle. The rectangle is a form consisting of four
straight lines or sides and same opposite sides measurement.
What is the length X if the rectangle is 72 square centimeters in size.
X
Y (6 cm)
Diagram 2
Suggestions: Figure 2 shows a rectangle measuring 72 cm square.
What is the length of X? Azizi Ahmad

26. *Stem does not have clues as response.
The following figure shows the factors that cause Mat Salleh fighting against
British North Borneo Company in Sabah.
Example
Resistance factor
* Factor X
* Regulatory burden
* Attempts to negotiate failed.
* Settlements burnt
Factor X is closely associated with religious matter. What is X?
A. Holy war
B. Persecution
C. Prohibit the opening of new land
D. Encroaching on forests
Suggestion :
What is X ?
Azizi Ahmad

27. Azizi AhmadAzizi Ahmad

28. Stimulus shall contain all information
necessary to allow candidates to
choose the right option.
Provide a stimulus as brief as possible.
Azizi Ahmad

29. Azizi AhmadAzizi Ahmad

30. *Ensure only ONE correct answer.
Example 1:
Ali bought 2 durians at RM2.00 each, 1 bunch of rambutan worth
RM4.00 and 50 mangosteen at 10 per RM.
What is the price of all the fruits that Ali bought?
A. Less than RM10.00
B. Less than RM12.00
C. More than RM10.00
D. More than RM12.00
Answer RM4 + RM4 + RM5 = RM13
Suggestion :
A. Less than RM8.00
B. Between RM8.00 and RM10.00
C. Between RM10.00 and RM14.00
D. More than RM14.00
Azizi Ahmad

31. *Avoid using overlapping alternative
Example 2 :
What is the population of Malaysia?
A. More than 10 million
B. More than 12 million
C.More than 14 million
D.More than 27 million
Suggestion :
A. 10 million
B. 12 million
C. 14 million
D. 27 million
*Ensure only ONE correct answer.
Azizi Ahmad

32. *Option arranged in ascending not descending
Example:
What is the main task of the Temenggung?
A in-charge of palace customs
B in-charge of running the harbor
C maintain security in the country.
D maintaining security in the waters of Malacca.
Azizi Ahmad

33. * Option arranged in ascending not descending.
Example:
What Is the main task of the Temenggung?
A. maintaining security in the waters of Malacca.
B. maintain security in the country.
C.in-charge of running the harbor.
D.in-charge of palace customs.
Azizi Ahmad

34. *The options shall be consistent with
the main question in terms of grammar.
Example 1 :
What is the meaning of the word obscured in the passage above?
A stop.
B disturbed
C withstand
D blocked.
Suggestions: A. standstill
B. disturbed
C. retained
D. jammed
Azizi Ahmad

35. *Do not provide clue to response. This may happen in terms of
phrases, grammar and word use.
Example 2:
Evaluation is different from measurement as the purpose of
evaluation is to
A compare individual performance with national standards
B determine the achievement of the objectives of a school
C determined the extent of achievement of moral values and ethics
D interpreting performance measured against specific criteria.
Intelligent candidate can select the correct answer just by looking at alternatives
The most well connected with the main question in terms of language fluency
Azizi Ahmad

36. *Option having the same length.
Example:
The Johor Port was visited by many foreign traders.Which of the
following is not a factor of attraction?
A Warehouse facilities.
B Ship repairing services.
C Preferential tax system applicable to traders based on the place
of origin of trader.
D. The use of currency.
Suggestion : Preferential tax system Azizi Ahmad

37. *Avoid repeating the same information in each option
Example :
Based on Diagram 1, what does P represent?
A. Acid material.
B. Alkali material
C. Liquid material
D. Neutral material
Shampoo P
Orange
juice
Suggestion :
Based on Diagram 1, what
does P represent?
A. Acid.
B. Alkali
C. Liquid
D. Neutral
Diagram 1
Azizi Ahmad

38. *Option having the same relationship with stem
and is homogenous.
Example :
Table below describes the court ruling in Sabah.
Who is the judge for the local state court?
A. Resident.
B. District Officer
C. Head of Local
D. J.W.W. Birch
Court Empowerment
Magistrate Handle serious case
Local Handle ethnic case
Suggestion :
D. Village Headman
Name of position
Name of person
Azizi Ahmad

39. *Avoid related language between stem and key
.
Example
Which of the government agency is responsible for agricultural
policy?
A Ministry of Agriculture
B Ministry of Education
C Ministry of Labour
D Ministry of Home Affairs
Azizi Ahmad

40. Avoid using “ All of the above” or
“None of the above” in option.
Example :
A. I and II
B. II and III
C. I, III, and IV
D. All of the above
link
Azizi Ahmad

41. Item is weak if all choices appear in all
suggestion
A. I and II only
B. I and IV only
C. I, II and III only
D. I, II, III and IV
Number I appear
in all response
Azizi Ahmad

42. Arrange option/choice of response in logic
according to the arrangement like …
•Number arrangement
A 670
B 795
C 1 105
D 1 245
Make it easy for candidate to make the right choice
Azizi Ahmad

43. Arrange option/choice of response
in arrangement like …
*Chronological happening
A. Burney Treaty 1826
B. British-Siam Border Treaty 1899
C. British-Siam Treaty 1902
D. Bangkok Treaty 1909
Azizi Ahmad

44. Arrange option/choice of response
in arrangement like …
*Lettering arrangement
A Ipoh
B Johor Bahru
C Kuantan
D Seremban
If unavoided, arrange in random order
Azizi Ahmad

45. Arrange option/choice of response
in arrangement like from top to bottom …
A Ipoh
B Johor Bahru
C Kuantan
D Seremban
NOT in continous form from left to right
A Ipoh B Johor Bahru C Kuantan D Seremban
Azizi Ahmad

46. Azizi Ahmad

47. (i) Fill-in-the-blank
a) Question variety
b) Completion variety
c) Association variety
Azizi Ahmad

48. (i) Question Variety
Example
When does the English-Dutch Treaty
signed? ( ____ )
(ii) Completion Variety (Melengkapkan jawapan)
Scientist who are experts in astronomy are
known as ________
(iii) Association Variety (Bentuk Perkaitan)
Write down the capital for the states mentioned.
Melaka ( ______)
Perak ( ______)
Azizi Ahmad

49. *If the item calls for the calculation and the need
to set the unit of measurement which are
needed for the answer.
13÷ 4 = ________
(response in one decimal place)
Azizi Ahmad

50. * Omit the important word only.
During the reign of the Sultanate of
Malacca, maintaining security in the
country is..................... Temenggong.
During the reign of the Sultanate of
Malacca, the person responsible for internal
security and affairs is the ……………..
??
Which is
better?
Azizi Ahmad

51. *Avoid providing too many blanks
in an item
Important factors that drive powerhouse like
__________ and Portugal to traveled to _______ in
______ century is trading of ___________
Azizi Ahmad

52. *Blanks to fill is placed in the
middle or end
The important factor that drives powerhouse like
the Spaniairds and Portuguese to the east in the
15th
century is for the trades of ___________
Place the blanks at the end of the statement.
This permits the student to read the complete
problem before he comes to the blank.
(Gronlund, 1982)
Azizi Ahmad

53. *Better to use questioning items rather
than completing answer.
i) Easier to build items of questioning and less
ambiguity.
ii) Use questions that students are familiar in class.
The use of a direct question increases the
likelihood that the problem will be stated clearly.
(Gronlund,1982)
Azizi Ahmad

54. *Space provided should be the same or
equal . The aim is to reduce the 'clue' to
students.
The King ________had elected 80 British advisers.
While King _______________ introduced Low
Advisory Council.
Azizi Ahmad

55. Azizi Ahmad

56. (ii) Matching
Having two sets of information (set of
questions and a set of answers) which
should be matched by students.
The information in the first set needs to
relate to the information of the second set
Azizi Ahmad

57. Example (i)
Match these idioms with their meanings:
Meaning Idioms
Strolling Archidendron pauciflorum
Helpful Chicken Mooring
Dependable Eat wind
Stingy Light bones
Azizi Ahmad

58. Example (ii)
Column A Column B
(__) 1. Discovered penicillin A. Curie
(__) 2. Discovered x-rays B. DeBakey
(__) 3. Discovered radium C. Fleming
(__) 4. Discovered polio vaccine D. Harvery
(__) 5. Invented an artificial heart E. Roentgen
(__) 6. Discovered blood circulation F. Salk
G. Pastuer
In the blank to the left of each discovery or invention described in columm
A, write the letter of the discoverer or inventor listed in column B. You may
use a letter in column B once, more than once, or not at all.
Azizi Ahmad

59. *If possible, set of questions or item is placed
on the left and consists of long phrases
The answer set should consist of short phrases,
one word or number.
Meaning Simpulan bahasa
Strolling Archidendron pauciflorum
Helpful Chicken Mooring
Dependable Heavy bones
Stingy Light bones
Eat wind
Azizi Ahmad

60. *Matching list should not be too long.
Nomally between 5 to 12 item.
*Avoid giving same equal item in a set of item
and answers.
A good rule of thumb to follow is to have two or
three more responses than premises.
(Mehrens & Lehmann, 1985)
* The number of items in the set can provide
less or more answers than the number of
items on the set of questions. Items on the
answer set can be used more than once.
(Gronlund, 1982)Azizi Ahmad

61. *Each matching item should be homogenous.
Column A Column B
___________ (1) 1957 A. Official Religion of Malaysia
___________ (2) Tunku Abdul Rahman B. National Anthem of Malaysia
___________ (3) Malaysia Day C. 16 September each year
___________ (4) Negaraku D. Malaysia National Day
___________ (5) Islam E. Father of Independence Malaysia
F. Father of Development Malaysia
Column A Column B
(__) 1. Discovered penicillin A. Curie
(__) 2. Discovered x-rays B. DeBakey
(__) 3. Discovered radium C. Fleming
(__) 4. Discovered polio vaccine D. Harvery
(__) 5. Invented an artificial heart E. Pastuer
(__) 6. Discovered blood circulation F. Roentge
G. Salk
Example 1
Example 2
Which
is
better??
Azizi Ahmad

62. * Arrange response (in the answer set)
systematically based on alphabetically, dates
and numbers.
Column A Column B
(__) 1. Dutch invaded Melaka A. 1402
(__) 2. Portugis conquered Melaka B. 1511
(__) 3. British occupied Melaka C. 1641
D. 1824
Azizi Ahmad

63. Example 2 : Write your answer in the form of alphabet
in the space provided on the set of answer in
Column B.
Items in set of answers can be used once,
more than once or not used at all
* Instructions should be clear how to
match whether only once, more than
once or will not be used at all
Example 1 : Underline the match based on a set of
questions in Column A and set of answer in
Column B.
Items on the set of answers can only be
used once only
Azizi Ahmad

64. Azizi Ahmad

65. (iii) Right-Wrong
Only two choices
Azizi Ahmad

66. (iv)Correction variety
Types of Right-Wrong Item
(i) Yes-No
(ii) Right-Wrong
(iii) Cluster variety
Azizi Ahmad

67. Write your answers in the space provided. If
the answer is Right, write “R” if it is wrong,
write “W”
The idioms ‘foot stool’ means
People walking without shoes.(__)
Example (i) Item Right-Wrong
Azizi Ahmad

68. Write your answers in the space provided. If the
answer is Right, write “Y” if it is wrong, write “N”
Preferential tax system is the tax imposed on
foreign traders during the Melaka Sultanate
and is based on the place of origin of trader.
(__)
Example (ii) Item Yes-No
Azizi Ahmad

69. Incomplete item stem and having several suggestion
of answers.
1. The role of State Council according to Sarawak constitution in 1941 are
(a)Manage finance R W
(b)Passing the law . R W
(c)Choosing members of High Council R W
(d)Advising Raja Brooke on administration R W
Circle your answers. If your answer is Right circle “R” and if it is wrong circle “W”
Example (iii) Cluster Form Item
Azizi Ahmad

70. Correct the statement which is wrong on the item
Suggestion : The section to be corrected is underlined.
1.After Sultan Mahmud III died in 1812, Tengku
Hussein (______________) was appointed as
the successor sultan of Johor-Riau.
All the underlined word or phrase is a statement that is wrong.
Write the correct answer to replace a word or underlined phrase
Example (iv) Simple Item Correction
Azizi Ahmad

71. Avoid ambiguous words and statements.
Example :
All men has the same rights R W
Azizi Ahmad

72. *Item statement should be short and
simple and using the correct
language
*Each item should have one important
fact/idea only.
*Item statement must be appropriate
and not be disputed whether "Right"
or "Wrong".
Azizi Ahmad

73. *Avoid using negative statement or
“double negatives”.
If used, underline or bold them
Friction does not appear on floor
which is not dry
.
Friction does not exist on wet floor
Azizi Ahmad

74. *For correction type, underline the
word(s) to be corrected.
*Sufficient or balanced of right and
wrong item.
*Do not use statements direct from
text books
Azizi Ahmad

75. Azizi AhmadAzizi Ahmad

76. (1) Ensure Types of Item
•Open response
•Restricted response
•Structured Item
(2) Fixed Scoring
•There should be provisions of marks on
each question
•There should be a marking schemeAzizi Ahmad

77. (3) Ensure instructions are clear
(5) Ensure verbs to be appropriate
(Normally questions start with verb to be).
Assisting candidate to present expected
response
(4) Ensure stem/task are clear.
*Avoid long elaboration.
Azizi Ahmad

78. (8 Ensure sufficient period of time given
(9) Ensure item quality is assured
(6) Avoid responses that need answers
"Yes" or "no"
(7) Make sure the item are enabled to
discriminate between weak,
medium and brilliant students.
Azizi Ahmad

79. Restrictive response
*Measure a specific skills
* Prepare appropriate line / space.
* Specify the number of decimal places and units.
Azizi Ahmad

80. Write down 2 health component-based fitness (2m)
i) ……………………………
ii) ……………………………
Calculate Mr Ali bin Abu Body Mass Index if he is
1.70m tall and weighing 70kg? (4m)
(Your answer should be in one decimal point)
………….
Restrictive Response
Azizi Ahmad

81. List the colours of rainbow. ( 4 marks )
_____________________________________
_____________________________________
_____________________________________
State the process of rain forming. (5 marks)
_____________________________________
_____________________________________
_____________________________________
Restrictive Response
Azizi Ahmad

82. 1. Describe the problem of moral decadence
among youth. (25 marks)
Open Response (Essay)
"Reading is Key to Success"
Motto: This shows the importance of reading.
Discuss ways to instilled love of reading
among students today
( 25 marks )
Azizi Ahmad