Computer-based test designs (cbt)

1. Computer-Based Test
Designs (CBT)
Presented By:
Muhammad Munsif
munsifsail@gmail.com

2. DEFINITION
What is CBT?
Computer Based Test (CBT), is defined as a test or assessment given
by the computer whether they are stand-alone or dedicated network,
or with other technology devices that are connected to the Internet or
World Wide Web (WWW) and mostly use the Multiple Choice
Question (MCQs).
Computer Based Test itself has been applied since 1960 to test the
knowledge and problem-solving test.

3. TYPES OF CBT
There are two types of CBT which include:
• Linear Test - This involves a full-length examination in which the
computer selects different questions for individuals without considering
their performance level
• Adaptive Test - Here the computer selects the range of questions based
on individuals‟ performance level. These questions are taken from a
very large pool of possible questions categorized by content and
difficulty

4. ADVANTAGES OF CBT
• Improved candidate reach: Delivered via the Internet or a specific computer, a
CBT test online helps remove the geographical barriers and reach more candidates.
Thus, the online test saves time, money and effort of the candidates as well as the
examining authority
• Enriched results analysis: Unlike pen-and-paper testing that captures only the
candidate’s responses, a computer-based test can gather plenty of valuable
information. Data such as start and end time, time spent on each item & on the
overall test. This information helps in arriving at a better judgement about the
candidate

5. • Streamlined process: Paper-based testing involves a lot of preparation starting months prior
to the exam date to ensure smooth conduct. Tasks such as securing facilities, hiring
invigilators, designing and printing of the test papers and ensuring their security and storage
to maintain the exam integrity keep the exam administrators on their toes before the exam.
Once the exam is over, retrieval, scanning and marking of the test papers, analyzing, preparing
and delivering the result occupy the entirety of the exam bodies. Many of these tasks can be
automated and the processes improved to free up the administrators to concentrate on
important tasks
• Quick delivery of results: The possibility of instant scoring, especially in the case of
multiple-choice question-based exams, help the exam body prepare and deliver results quickly
• Test integrity: Remote proctoring and other security features make computer-based testing
extremely secure allowing for the test integrity to be maintained.
• Helpful for candidates with disability: Screen readers, magnification tools, text-to-voice
and voice-to-text applications, Braille keyboards and other such tools help the differently-
abled candidates to take up the tests more conveniently as compared to a pen-and-paper test.

6. DISADVANTAGES OF CBT
• You can't write stuff down on your screen
• Difficult to navigate back
• Computer glitches
• Errors in the content/problems
• Staring at a computer screen
• There is an uneven distribution of internet network as the internet
network in some areas can be poor

7. CBT Models
MST
CAT

8. MST
Multi-Stage Test

9. Multi-Stage Test (MST)
The first, and simplest model is the multi-stage test (MST). It begins by presenting each
student with a first-stage or routing test, which will typically contain 10 or more items.
Once the student completes the routing test, a score is produced and a decision is
made. This decision is to choose among two or more second-stage tests by determining
which is most appropriate given performance on the routing test. Following the
standard principles of adaptive testing, students who performed well on the routing
test are assigned a second-stage test compose mainly of more difficult items, while
students who struggled are administered an easier second-stage test. Upon completion
of the second-stage test, a two-stage MST ends and a final score is produced that
aggregates performance across both the routing and second stages of the test.

11. CAT
Computerized Adaptive
Test

12. Computerized Adaptive Test (CAT)
Computerized adaptive testing has been widely used in educational testing
programs. CAT is a method of administering items sequentially according
to the ability level of each examinee. In CAT, each item is selected by a pre-
determined item selection rule according to the examinee’s current ability
estimate based on the available responses in the test. Then, the difficulty of
each item is well matched to the examinee’s ability level and other practical
requirements. The process of selecting items continues until the stopping
rule is met. Steps for administrating a CAT (He,2010) are: