Monitoring and
Assessment
H.Zarei
Content &
sequencing

principles
Principles

.zzzxxl;d
Goal
Monitorin
g and
assessing

Environment
Monitoring and assessment must take account of the
environment in which
the course will be used,
the needs of the learners,
And…
principles of teaching and learning.
Monitoring and Assessment
can provide a teacher and learners with
information about…

the learners’ present knowledge
and progress,
and it can also be a means of
encouraging involvement and participation.
Purpose of monitoring
To make sure that the learner will get the most benefit from the
course.

This involves;
 Carefully observing the learners & the course
 Suggesting changes to the course and the way it is run
Types of monitoring and assessment

•
•
•
•
•
•

Placement assessment
Observation of learning
Short term achievement assessment
Diagnostic assessment
Achievement assessment
Proficiency assessment
Types of monitoring and assessment

•
•
•
•
•
•

Placement assessment
Observation of learning
Short term achievement assessment
Diagnostic assessment
Achievement assessment
Proficiency assessment
Placement assessment
• is used to decide what level of the course a learner
should enter
• usually occurs under environment constraints
• It often has to be done just before a course begins
• The learners may not perform their best
• The Learners are unfamiliar with some of the test
formats
• assessment may be the learners’ first meeting with the
teachers and course and could affect their attitudes to
the course.
Placement assessment should be…
• Familiar, friendly and relaxed
• Reasonably brief and easy to mark
• Focused on gathering the most relevant
information
Placement tests focus on…
• Knowledge of language items
rather than

skill in language use.
Tests which focus on language items include…
• Pronunciation
• Vocabulary
• Grammar test
Test which focus on language use include…
•
•
•
•
•

Interviews
Role play
Listening tests(message-focused)
Reading passage (message-focused)
Composition writing
Why we don’t use tests with language use focus
for placement?
• Difficult to interpret
• Difficult to score
• Time consuming to set
• May not meet many of the requirements for an
effective placement test
Types of monitoring and assessment

•
•
•
•
•
•

Placement assessment
Observation of learning
Short term achievement assessment
Diagnostic assessment
Achievement assessment
Proficiency assessment
Observation of learning
• Occur at the level of learning activity
• does not assess the learners but is directed towards the
tasks that they do

The purpose;
• to see if it is necessary to make changes to the learning
activities in order to encourage learning
Questions that should be asked when
observing learning activities…
• What’s the learning goal of the activity?
• What are the learning conditions that would lead to
the achievement of this goal?
• What are the observable signs that these learning
conditions are occurring?
• What are the design features of the activity that set
up the learning conditions or that need to be
changed to set up the learning conditions?
Monitoring can occur in different
ways…
• Learner diaries
• Logbooks written for the teachers
• Learners talking in small groups
Types of monitoring and assessment

•
•
•
•
•
•

Placement assessment
Observation of learning
Short term achievement assessment
Diagnostic assessment
Achievement assessment
Proficiency assessment
Short-Term Achievement Assessment
• looks at the product of activities or a small set of
activities
The purpose
• to see if the learners are making progress on a
daily or weekly basis
Short-term assessment
can also have motivational purposes…

Why?
to make learners do required work and to give
them feelings of achievement through success on
the tests
Short-term achievement is more easily assessed if
there are clear performance objectives for some of
the learning goals. A performance objective is a
statement consisting of ve parts;
1.
2.
3.
4.
5.

the subject
The performance
The conditions
The measure
The criterion
According to Brown…
• curriculum designers should write performance
objectives for some of the goals of the course,
particularly
where
there
might
be
misunderstanding of what is to be learned and
where focused repeated practice is needed to
reach the goals.
Good short-term achievement assessment
should …
• Provide a clear record of progress that is easily
to interpreted
• In a form to motivate learners to keep working
toward the course goals
• Not occupy too much class time
• Be a regular expected of class activity
Types of monitoring and assessment

•
•
•
•
•
•

Placement assessment
Observation of learning
Short term achievement assessment
Diagnostic assessment
Achievement assessment
Proficiency assessment
Diagnostic assessment
• used to find the gaps and weaknesses in learners’
knowledge so that something can be done about
them
• used to find what learners know well so that time
is not wasted on teaching that
Diagnostic assessment
• The findings of diagnostic assessment are used
to determine what goes into a course
• good diagnostic assessment is accurate and easy
to interpret in terms of what should be done as a
result
The Vocabulary levels test
• This test helps a teacher decide whether learners should
be focusing on high-frequency vocabulary, academic
vocabulary or low-frequency vocabulary.
Why it is important?
• because high-frequency vocabulary and low-frequency
vocabulary require quite different teaching strategies.
Learner self-assessment
• Self-assessment usually involves learners working with
checklists or scales to indicate their perceived areas of
strength and weakness.

What’s the problem?
• It is often difficult to separate the learners’ subjective
concerns from objective judgment.
Types of monitoring and assessment

•
•
•
•
•
•

Placement assessment
Observation of learning
Short term achievement assessment
Diagnostic assessment
Achievement assessment
Proficiency assessment
Achievement test
• measures both the achievement of learners during a
course and the effectiveness of the course.
• The tests part of the way through a course may have the
purpose of picking up learners who are not achieving, so
that something can be done to help them learn.
Characteristics of achievement test

1. They are based on material taught in the
course.
2. Learners usually know what kinds of questions
will be asked and what material will be covered.
3. They are criterion referenced.
Mastery test
 a high criterion is set
 Achievement tests may be mastery tests
• Mastery achievement tests usually focus on a
small area of knowledge so that learners are
clear about what has to be learned and so that
they can set themselves a series of short-term
goals to eventually cover the area of knowledge.
The thinking behind masteryittest be
1. if something is to be learned, should
learned well
2. every learner is capable of achieving mastery,
some may require more time to do so than
others
3. The teacher’s responsibility is to the students
and to learning and thus every learner should
have the chance to learn well
4. mastery of an area is rewarding and motivating
for both teacher and learners.
Opposing views
1. the teacher’s responsibility is to the subject matter and
not to the students.
1. one role of courses is to indicate to employers and
those responsible for admission to further education
that some learners are more capable than others.
2. learners are responsible for their learning and the
management of their learning.
Types of monitoring and assessment

•
•
•
•
•
•

Placement assessment
Observation of learning
Short term achievement assessment
Diagnostic assessment
Achievement assessment
Proficiency assessment
Proficiency assessment
• draws items for the test not from the course that the learners are
studying, but from the language itself, independent of any course

Purpose
• To show how much the learners know of the language or a particular
part of the language
The difference between proficiency test and achievement
test …

• The proficiency test is likely to cover a larger
range of items and skills.
TOEFL & IELTS
• This test may be working as a criterion-referenced test to
determine whether a learner goes into an Englishmedium university or not.

• Sometimes the test may simply act as a norm-referenced
test which shows learners at which percentile of
prociency they are in relation to others.
TOEFL washback
• A proficiency test like TOEFL which is used as a
criterion-referenced test can have a profound washback
effect on a language course that precedes the sitting of
the test.
• It can be a major environmental factor affecting the
course.
• It can have the effect of encouraging learners to drop out
of the course if the course does not clearly and directly
address the requirements of the test.
It can have the effect of
• encouraging learners to drop out of the course if
the course does not clearly and address the
requirements of the test. Courses which copy the
format of the test in their learning activities are
in effect trying to make the proficiency test be
like an achievement test(that instead of the test
drawing items from the course, the course is
drawing items from old tests. )
All assessment needs to be checked to
see that it’s doing its job properly …
Reliability
Validity
Practicality
Reliability
A test is more reliable if
1. it is always given under the same conditions

2. it is consistently marked
3. it has a large number of points of assessment
4. its questions and instructions are clear and
unambiguous
validity
• A valid test measures what it is supposed to
measure.
Face validity
• if the test is called a reading test, does it look like a
reading test?

• is important because it reflects how the learners and
perhaps their parents, and other teachers will react
to the test.
Content Validity
• the decision-making about validity is not made
by looking at the test’s “face”, but by analysing
the test and comparing it to what it is supposed
to test.
How we can see that we have content
validity in the test?
• look at the part of the course that was being tested and
list the items and skills taught. Then we would have to
look at the test and list the items and skills tested. If
these two lists matched each other quite closely, or if the
test involved a representative sample of the course list.
practicality
Examined by looking at…
1. the cost involved in administering and scoring the
test
2. the time taken to administer and sit the test
3. the time taken to mark the test
4. the number of people needed to administer and
mark the test
5. the ease in interpreting and applying the results of
the test
SOME POINTS
• The requirements of practicality and reliability and
validity do not always agree with each other, for example
short tests are practical but not very reliable or valid.

• Where possible, reliability and validity should be
preferred over practicality, but usually compromise is
necessary.
Thank you

Monitoring and assessment

  • 1.
  • 2.
  • 3.
    Monitoring and assessmentmust take account of the environment in which the course will be used, the needs of the learners, And… principles of teaching and learning.
  • 4.
    Monitoring and Assessment canprovide a teacher and learners with information about… the learners’ present knowledge and progress, and it can also be a means of encouraging involvement and participation.
  • 5.
    Purpose of monitoring Tomake sure that the learner will get the most benefit from the course. This involves;  Carefully observing the learners & the course  Suggesting changes to the course and the way it is run
  • 6.
    Types of monitoringand assessment • • • • • • Placement assessment Observation of learning Short term achievement assessment Diagnostic assessment Achievement assessment Proficiency assessment
  • 7.
    Types of monitoringand assessment • • • • • • Placement assessment Observation of learning Short term achievement assessment Diagnostic assessment Achievement assessment Proficiency assessment
  • 8.
    Placement assessment • isused to decide what level of the course a learner should enter • usually occurs under environment constraints • It often has to be done just before a course begins • The learners may not perform their best • The Learners are unfamiliar with some of the test formats • assessment may be the learners’ first meeting with the teachers and course and could affect their attitudes to the course.
  • 9.
    Placement assessment shouldbe… • Familiar, friendly and relaxed • Reasonably brief and easy to mark • Focused on gathering the most relevant information
  • 10.
    Placement tests focuson… • Knowledge of language items rather than skill in language use.
  • 11.
    Tests which focuson language items include… • Pronunciation • Vocabulary • Grammar test
  • 12.
    Test which focuson language use include… • • • • • Interviews Role play Listening tests(message-focused) Reading passage (message-focused) Composition writing
  • 13.
    Why we don’tuse tests with language use focus for placement? • Difficult to interpret • Difficult to score • Time consuming to set • May not meet many of the requirements for an effective placement test
  • 14.
    Types of monitoringand assessment • • • • • • Placement assessment Observation of learning Short term achievement assessment Diagnostic assessment Achievement assessment Proficiency assessment
  • 15.
    Observation of learning •Occur at the level of learning activity • does not assess the learners but is directed towards the tasks that they do The purpose; • to see if it is necessary to make changes to the learning activities in order to encourage learning
  • 16.
    Questions that shouldbe asked when observing learning activities… • What’s the learning goal of the activity? • What are the learning conditions that would lead to the achievement of this goal? • What are the observable signs that these learning conditions are occurring? • What are the design features of the activity that set up the learning conditions or that need to be changed to set up the learning conditions?
  • 17.
    Monitoring can occurin different ways… • Learner diaries • Logbooks written for the teachers • Learners talking in small groups
  • 18.
    Types of monitoringand assessment • • • • • • Placement assessment Observation of learning Short term achievement assessment Diagnostic assessment Achievement assessment Proficiency assessment
  • 19.
    Short-Term Achievement Assessment •looks at the product of activities or a small set of activities The purpose • to see if the learners are making progress on a daily or weekly basis
  • 20.
    Short-term assessment can alsohave motivational purposes… Why? to make learners do required work and to give them feelings of achievement through success on the tests
  • 21.
    Short-term achievement ismore easily assessed if there are clear performance objectives for some of the learning goals. A performance objective is a statement consisting of ve parts; 1. 2. 3. 4. 5. the subject The performance The conditions The measure The criterion
  • 22.
    According to Brown… •curriculum designers should write performance objectives for some of the goals of the course, particularly where there might be misunderstanding of what is to be learned and where focused repeated practice is needed to reach the goals.
  • 23.
    Good short-term achievementassessment should … • Provide a clear record of progress that is easily to interpreted • In a form to motivate learners to keep working toward the course goals • Not occupy too much class time • Be a regular expected of class activity
  • 24.
    Types of monitoringand assessment • • • • • • Placement assessment Observation of learning Short term achievement assessment Diagnostic assessment Achievement assessment Proficiency assessment
  • 25.
    Diagnostic assessment • usedto find the gaps and weaknesses in learners’ knowledge so that something can be done about them • used to find what learners know well so that time is not wasted on teaching that
  • 26.
    Diagnostic assessment • Thefindings of diagnostic assessment are used to determine what goes into a course • good diagnostic assessment is accurate and easy to interpret in terms of what should be done as a result
  • 27.
    The Vocabulary levelstest • This test helps a teacher decide whether learners should be focusing on high-frequency vocabulary, academic vocabulary or low-frequency vocabulary. Why it is important? • because high-frequency vocabulary and low-frequency vocabulary require quite different teaching strategies.
  • 28.
    Learner self-assessment • Self-assessmentusually involves learners working with checklists or scales to indicate their perceived areas of strength and weakness. What’s the problem? • It is often difficult to separate the learners’ subjective concerns from objective judgment.
  • 29.
    Types of monitoringand assessment • • • • • • Placement assessment Observation of learning Short term achievement assessment Diagnostic assessment Achievement assessment Proficiency assessment
  • 30.
    Achievement test • measuresboth the achievement of learners during a course and the effectiveness of the course. • The tests part of the way through a course may have the purpose of picking up learners who are not achieving, so that something can be done to help them learn.
  • 31.
    Characteristics of achievementtest 1. They are based on material taught in the course. 2. Learners usually know what kinds of questions will be asked and what material will be covered. 3. They are criterion referenced.
  • 32.
    Mastery test  ahigh criterion is set  Achievement tests may be mastery tests • Mastery achievement tests usually focus on a small area of knowledge so that learners are clear about what has to be learned and so that they can set themselves a series of short-term goals to eventually cover the area of knowledge.
  • 33.
    The thinking behindmasteryittest be 1. if something is to be learned, should learned well 2. every learner is capable of achieving mastery, some may require more time to do so than others 3. The teacher’s responsibility is to the students and to learning and thus every learner should have the chance to learn well 4. mastery of an area is rewarding and motivating for both teacher and learners.
  • 34.
    Opposing views 1. theteacher’s responsibility is to the subject matter and not to the students. 1. one role of courses is to indicate to employers and those responsible for admission to further education that some learners are more capable than others. 2. learners are responsible for their learning and the management of their learning.
  • 35.
    Types of monitoringand assessment • • • • • • Placement assessment Observation of learning Short term achievement assessment Diagnostic assessment Achievement assessment Proficiency assessment
  • 36.
    Proficiency assessment • drawsitems for the test not from the course that the learners are studying, but from the language itself, independent of any course Purpose • To show how much the learners know of the language or a particular part of the language
  • 37.
    The difference betweenproficiency test and achievement test … • The proficiency test is likely to cover a larger range of items and skills.
  • 38.
    TOEFL & IELTS •This test may be working as a criterion-referenced test to determine whether a learner goes into an Englishmedium university or not. • Sometimes the test may simply act as a norm-referenced test which shows learners at which percentile of proficiency they are in relation to others.
  • 39.
    TOEFL washback • Aproficiency test like TOEFL which is used as a criterion-referenced test can have a profound washback effect on a language course that precedes the sitting of the test. • It can be a major environmental factor affecting the course. • It can have the effect of encouraging learners to drop out of the course if the course does not clearly and directly address the requirements of the test.
  • 40.
    It can havethe effect of • encouraging learners to drop out of the course if the course does not clearly and address the requirements of the test. Courses which copy the format of the test in their learning activities are in effect trying to make the proficiency test be like an achievement test(that instead of the test drawing items from the course, the course is drawing items from old tests. )
  • 41.
    All assessment needsto be checked to see that it’s doing its job properly … Reliability Validity Practicality
  • 42.
    Reliability A test ismore reliable if 1. it is always given under the same conditions 2. it is consistently marked 3. it has a large number of points of assessment 4. its questions and instructions are clear and unambiguous
  • 43.
    validity • A validtest measures what it is supposed to measure. Face validity • if the test is called a reading test, does it look like a reading test? • is important because it reflects how the learners and perhaps their parents, and other teachers will react to the test.
  • 44.
    Content Validity • thedecision-making about validity is not made by looking at the test’s “face”, but by analysing the test and comparing it to what it is supposed to test.
  • 45.
    How we cansee that we have content validity in the test? • look at the part of the course that was being tested and list the items and skills taught. Then we would have to look at the test and list the items and skills tested. If these two lists matched each other quite closely, or if the test involved a representative sample of the course list.
  • 46.
    practicality Examined by lookingat… 1. the cost involved in administering and scoring the test 2. the time taken to administer and sit the test 3. the time taken to mark the test 4. the number of people needed to administer and mark the test 5. the ease in interpreting and applying the results of the test
  • 47.
    SOME POINTS • Therequirements of practicality and reliability and validity do not always agree with each other, for example short tests are practical but not very reliable or valid. • Where possible, reliability and validity should be preferred over practicality, but usually compromise is necessary.
  • 48.