Assessment Discourse
Lecture 3
Item
Warga LPM
130104
Using instruments that are unable to
produce quality score could result an
unfair judgement
The clever score low,
the less clever get a high score
Adopting an unfair
judicial process is a
real injustice
Construct Content
Level of
Difficulty
Type of
Item
Classification
Item
ImportantCurriuclum
SuitabilityConformity Accurate and Clear
Difficulty KeadilanChance Specification Construct Content Clear
5 subjects
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
The two types of traditional items are Objectives and Subjectives
Items can be categorized as conventional or alternative
PentingKurikulum
KesesuaianKeakuran Ketepaten & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Item
Tools used to obtained evidence of a construct and ways
to obtained scores from an assessment administration
The objective in this phrase refers to the responses / answers intended. When there is only ONE only acceptable
answer for an item, the item was categorized as an objective item.
Item objectives are divided into two types: Supply Type or Select Type
Supply Type
Fill in the blank
Sentences completion
Diagram completion
Select Type
True-False
Matching
Multiple choice
Subjective item is an item that allows subjectivity in the responses given
Constructed response
Essay
Structured
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
Item can be classified as Recall or Thinking
PentingKurikulum
KesesuaianKeakuran Ketepaten & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Recall Item
Thinking Item
Items that require remembering to answer
Items that require students / candidates
apply thinking skills to answer
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepatan & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi
•Construct is WHAT (things) is assessed
•The construct is the human dimension in the form of
concrete or abstract
•The construct is a matter of building or expanding the
teaching of a subject
•Constructs are identified from the syllabus
Konstruk Tajuk Jelas
Construct
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepatan & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi
•Knowledge
• Skills
•Value
Construct assessed can be categorized
Konstruk Tajuk Jelas
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepatan & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Knowledge on
•concept
•facts
•principles
•criteria
•terminology
•procedures
•methods
Skills of
•Intellectual
•Practical
•Investigating
•Organizing
•Assessing
Values
•responsibility
•confident
•value
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
•Content are parts of certain subjects
•Content covered in the assessment are identified
from the syllabus
•Content is usually indicated by a specific area
within a field
•To ensure comprehensive coverage, the content is
usually divided into several sub-headings
PentingKurikulum
KesesuaianKeakuran Ketepatan & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Content/Context
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
Level of Difficulty
Easy/Fair/ Difficult
Assumption
•The weak can answer easy questions
•The fair can answer easy items and fair items
•The good can answer the fair and the difficult
•Easy item are item that can be answered by most students
•Difficult item are item that can be answered by a small number of students
•Fair item are item in between the easy and the difficult
For an instrument to be considered as good,
test should contain all three level of difficulties
PentingKurikulum
KesesuaianKeakuran Ketepaten & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Building Subjective Item
•Ensure types of item
•Ensure task and instructions are clear
•Ensure the ‘verb’ are right
•Ensure item are able to discriminate
•Ensure duration of time are sufficient
•Avoid items that requires ‘Yes” or “No” as answers
•Vocabulary, concept, suitable issues suitable with candidates
•Prepare marking schemes
•Ability to answer (item are able to be answered)
Example
Construct Content
Difficulty
Level
Type
Item
Classification
Testing and MeasurementRecallObjektif/beri Low/EasyKnowledge on terminology
In measurement of education,
reliability can be defined as
___________________________________
___________________________________
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
Pengujian dan pengukuranPengingatanObjektif/beri MudahPengetahuan tentang terminologi
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
Pengujian dan pengukuranPengingatanObjektif/pilih MudahPengetahuan tentang kriteria
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
Pengujian dan pengukuranPengingatanObjektif/pilih MudahPengetahuan tentang kriteria
A test is considered perfect if the test score
A. clear and sound
B. valid and reliable
C. understood by all
D. simple and covers all topic
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PecahanPemikiranSubjektif PertengahanKemahiran aplikasi
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PecahanPemikiranSubjektif PertengahanKemahiran aplikasi
Ali and Asmah is eating ‘lempeng
pisang’. Ali had eaten 1/2 of the
‘lempeng’. Asmah had also eaten 1/2 of
the ‘lempeng’.
Ali said he had eaten more ‘lempeng’
than Asmah.
Explain how Ali’s statement is said to be
correct.
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepaten & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Evaluating Item
Nine Point System
9 characteristics of a good item
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepaten & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Ciri-ciri Item Yang Baik
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepaten & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Characteristics of A Good Item
An good item is one having characteristics of:
•Conformity
•Accurate and Clear
•Suitable
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepaten & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Characteristics of A Good Item
Conformity of an item is based on three aspects:
•Conform with the curriculum
•Conform with chance
•Conform with specification
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepatan & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Conformity Curriculum
What is assessed (construct) and where the
assessment is done (content/context) must be part
of the curriculum.
This aspect is important and vital, should what
is assessed is outside the curriculum then the
curricular validity for the item can be disputed
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepatan & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Conformity Chance
Student/candidates must be given enough
chance to learn what was assessed.
Chance refers to facilities, teachers
presence, skills of teachers in providing
assessed knowledge to students/candidates
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepaten & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Conform Specification
Specification are established to control
test based on ideas and content.
It is important for individuals or
group to control test content so as to
ensure the level of achievement are the
same.
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepaten & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Characteristics of A Good Item
Accuracy and clear refers to
•Accuracy to construct
•Accuracy to topic/content
•Clear (proper language)
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
Accuracy Construct
Is the item able to provide usable evident to
assess the expected construct?
Construct is WHAT is assessed.
Should the task in the item failed to provide the
necessary evidence and candidate failed to
deliver relevant response , thus, item is
considered ‘not valid’
PentingKurikulum
KesesuaianKeakuran Ketepaten & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepaten & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Accuracy Topic
Topic or context is where the assessment of a
construct is applied to.
It is important to ensure candidate or students
are familiar with the facts, ideas given.
If not, they might not provide satisfying
responses not because of the ‘construct’ but of
the content not known to them.
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepaten & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Can the word arrangement and statements or
image/graphs provide enough ‘clues’ on what should be
done by candidates and how to make it presentable.
Does the item written has high degree of
communicability based on :
•Readable
•Clear expression
•Consistent style
Clear (Correct Language)
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepaten & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Characteristics of Good Item
Suitability of an item is based on :
•Suitable with level of difficulty
•Suitable of importance
•Suitability with fairness(non bias)
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepatan & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Suitability of Difficulty Level
Written item brings along the intended
level of difficulties.
Are the items suitable with the intended
difficulty level?
If not, something must be done to ensure
the whole test design to be sustained.
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepatan & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Suitability Importance
Since assessment is important and vital , we
must ensure that ideas, content, context or
issues forwarded by items are important
matters needed in the learning process.
Unsuitable matters or irrelevant matters should
not be put up so as to ensure unfair judgement
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepatan & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Suitable Fair
Steps are made to ensure item written
should not give advantage systematically or
automatically to certain groups, race,
ethnics or community based on race , sex,
place or socio-economic-status (SES)
Konstruk Tajuk
Aras
Kesukaran
Janis
Item
Klasifikasi
Item
PentingKurikulum
KesesuaianKeakuran Ketepaten & Kejelasan
Kesukaran KeadilanPeluang Spesifikasi Konstruk Tajuk Jelas
Evaluating Item
Evaluation of items is a process to judge the quality of item based on the
characteristics of good item. The process should end with, item
• ACCEPTABLE,
•REJECTED or
•Keep in View (KIV)
Conform
Curriculum
Conform
Chance
Conform
Specification
Accurate
Construct Accurate
Content Clear
Suitable
Difficulty
Sutiable
Important
Suitable
Fair
**
**
**
**
**
*
*
*
*
**
*
One or more negative = Item rejected
One or more negatif = Item KIV
All positive = Item Accepted

Item building 9 point Item