The Angoff method is a standard setting technique used to determine cut scores on examinations. It requires subject matter experts to review exam items and predict the percentage of borderline or minimally competent candidates that would correctly answer each item. The average of the experts' predictions for each item is calculated to determine the predicted difficulty. These predicted difficulties are then averaged across items to calculate the cut score. Key aspects of the Angoff method include using experts' judgments of borderline candidates to determine cut scores in a test-centered and defensible manner.

1. Presented By:
Muhammad Munsif
(M.phil Education)
(2019-21)
munsifsail@gmail.com
Slideshare Link
Presented to:
Dr. Muhammad Iqbal
University of Education
Lahore
Angoff Method

2.  What is Standard Setting
 What is cut Score
 What is borderline students
 What is purpose of Standard setting
 Importance of Standard Setting in Education
 Angoff Method
 Overview of Angoff Method
 Procedure of Angoff Method

3.  Standard Setting is the methodology used to define
levels of achievement or proficiency and the cut score
corresponding to those levels. For that reasons standard
setting is a critical components of the test development
process.
 In brief, standard setting refers to the process of
establishing one or more cut scores on examination.

4.  Standard setting is the mechanism by reach to real
calculate a pass mark for examination a paper to
ensure the competent paper are going to and
incompetence once are staying behind and not able to
go ahead.
 These Standards set are like rules and laws which can
be achievable. It is like bar not too much high to
achieve, not too much low down to achieve very easy.

5.  A cut score is the point that set that predetermine level,
it differentiates between those who pass and fail.
 The cut scores divided the distribution of examinees
test performance into two or more categories. Such as
(Pass/fail, Award /deny in license, or grant / Without a
credential).

6.  Multiple cut scores may also be set to more finest
students into categories.
 (E.g) Students may be classified as advanced,
proficient, Needs improvement or unsatisfactory.
 As a researcher has pointed out, establishing cut scores
can literally be a matter of life and death.

7.  Absolute : Passing score is depend on the minimal
mastery of the study content( Criterion referenced).
 Relative : Passing score is dependent on performance
of a reference group ( Norm reference ).

8.  It sets a clear and measure goals.
 It informs instruction.
 Standard setting measures a achievement.
 It is important to take strong decisions in education
system.

9.  Angoff Method Introduced by William Angoff.
 One of the most preferred widely and frequently used methods.
 The Angoff Method allows expert judges to determine an
appropriate pass marks is based on the content of the examination
and not on group performance.
 Angoff method relies on subject-matter experts(SMEs)who examine
the content of each the questions(items) and then predict how many
minimally-qualified candidates would answer the item correctly.
The average of the judges predictions for test question becomes its
predicated difficulty.

10.  In the original Angoff method, experts determine the probabilities.
 They select any probability ranging from 0 to 1(0.9,0.44,0.56).
 The Angoff method is a widely used standard setting approach in the test in
test development.
 It is the kind of study that test developers used to determine the passing
percentage ( cut score)for the test.
 The passing grade of a test can't be decided arbitrarily; it must be justified
with empirical.
 The average of these probabilities across judges or raters is the cutoff score

11.  Absolute method
 Test centered Method
 Written and practical Exam
 Angoff Method that uses a group of experts to judge
how difficult each items is in exam determine the cut
score.
 The cut score is like a line of stands that divides the
students in two groups. First, who are above the cut
score called pass and second, who are below the cut
score called fail.

12.  This methods calculate cut- marks of based on
performances of the candidate in relation to standard of
Content based( Absolute).
 It involves judgment being made on exam items.( Test-
Centered ).

13.  In Angoff, a group of subject expert are asked “what
percentage of borderline candidates would answer this
items correctly?” before making a judgment , the
experts must agree on the definition of a “borderline
candidate”.
 All judges must have same definition of borderline
candidate for the Angoff cut-off score to be reliable.
This requires a good understanding of what makes a
candidate competent enough to be passing, hence why
judges must be subject experts.

14. A sort of students who is
just minimal competent so
administrative allow them
to progress actually they are
not brilliant not average
only they are just fine in
ordered to make them
promote on the behalf of
guide line of examination.
E.g: If the passing marks are
50 and some students got 49
or 48 out of hundred.
These are borderline
students.

15.  Each experts judgment for an item should be same or
within a close, define range ( around 10%). The mean
of everyone's judgment is calculated for each item; this
is often referred to as the predicated difficulty.
 Each predicated difficulty( mean) is added and together
and divided by the total number of items in the
examination to get cut- off percentage. This percentage
of the total marks for the exam indicates the cut- off
mark.

16. These are major reasons to used Angoff method
 This method is defensible, reliable , test centered and it
is absolute method.
 Easy for use
 For this judges have minimal training is required who
make the judgments about cut-of score.
 Wide accepted.

17. For this method Experts took following steps:
 Selection participant
 Take the assessment
 Rate the items( According to level of achievement and level
of difficulty)
 Review
 Determine the cut score of a test

18.  Hold up in the court
 Reflect the difficulty of content
 Simple when you know how

19.  Need back up
 Long process
 Confidence is the key
 Recyclable
 Time and Place

20.  To summarize, Angoff is a standard setting method that
requires subject expert making judgment about how
difficult each item in an exam by predicting the
percentage of borderline candidates that would get
question correct. It is widely used in high stake exams
and holds up in court challenged

23. 1) In Angoff Method , Probability range of cut score from ………………….
A) 2 to 5 B) 0 to 1 C) -1 to + 1 D) 1 to 2
2) Which Method more relies on Subject-matter experts(SMEs)……..
A) Hofstee Method B) Eble Method C) Nedelsky Method D) Angoff Method
3) Passing score is depend on the minimal mastery of the study content based is ……
A ) Relative B) Absolute C) Norm reference D) Non of them
4) ………………who is just minimal competent so administrative allow them to
progress
A) Brilliant Student B) Grounded Student C) Borderline student D) Average Student
5) A …………..is the point that set that predetermine level, it differentiates
between those who pass and fail
A ) Cut score B) Borderline score C ) Pass score D ) All of them
6) Passing score is dependent on performance of a reference group
A) Norm reference B) Absolute C) Criterion reference D) Non of them

24.  1) B
 2) D
 3) B
 4) C
 5) A
 6) A