SlideShare a Scribd company logo
 Classroom Assessment
 Fulcher 2010
by:
 Amir Hamid Forough Ameri
 ahfameri@gmail.com
1. Life at the chalk-face (Introduction)
Just how different is assessment in the classroom from the world
of large-scale standardized assessment?
Some believe that they are not only different paradigms, but exist
in a state of conflict.
The uneasy relationship between externally mandated testing and
teacher assessment has been widely studied (Brindley, 1998,
2001), showing, in Rea-Dickins’ (2008: 258) words, how ‘the
wider political context in which children are assessed may
constrain desirable assessment practices’.
1. Life at the chalk-face (Introduction)
Latham (1877: 40) saw why the teachers of his time liked tests:
‘The value of examinations … is far greater as an engine in the
hands of the teacher to keep the pupil to definite work than as a
criterion.’The analogy of the test as an engine to drive other
goals is a powerful one. The technology of standardised testing
has been developed in order to produce an engine that is capable
of driving a meritocratic social system. Tests encourage learning
because they are gateways to goals. In the classroom, however,
we wish to devise engines that encourage learning, not only by
motivating learners, but also by providing feedback on learning
and achievement to both learners and teachers. If learning can
also take place through assessment, we may have achieved the
effect to which classroom testing aspires.
Chapter Review
The chapter considers two major approaches to classroom
assessment:
 Assessment for Learning and Dynamic Assessment.
Also briefly looks at:
 self- and peer-assessment,
 portfolio assessment
 the link between assessment and second language acquisition
 criterion-referenced
 dependability in criterion-referenced testing
 assessing the state of the theory underlying classroom
assessment.
2. Assessment for Learning
Since the 1980s, there has been a strong interest in the role that
assessment can have during the learning process (formative )
(Black and Wiliam , 1998), rather than just at the end of it
(summative, traditional approach to classroom assessment).
Black and Wiliam argued that the most important endeavor is to
modify or change teaching and learning activities to better meet
the needs of learners. It was also claimed that the process of
assessment, including self-assessment, could improve
motivation and self-esteem, leading to additional learning gains.
In assessment for learning, feedback should be ‘descriptive’
rather than ‘evaluative’, so that it is not perceived negatively
(Rea-Dickins, 2006)
2. Assessment for Learning (Cont.)
There are also a number of practical teaching practices that support
improved learning through assessment.
For Example: Questioning
Traditionally, teachers spend a long time on
asking questions with Initiation–Response–Feedback
(IRF) patterns. What Black and Wiliam discovered was
that teachers in the classrooms they observed did not leave
sufficient time after a question for learners to think about what was
being asked. Rather, if there was no immediate response, teachers
would provide the answer themselves or move on to the next topic. The
practical recommendation for this form of classroom assessment is to
frame questions that do not require the simple repetition of facts, but
are more open-ended. Once a question has been asked, teachers should
allow longer ‘wait times’ for the learners to think, and respond.
2. Assessment for Learning (Cont.)
The other critical component of formative assessment is the
choice and design of classroom tasks;
Classroom tasks frequently look very different
from the kinds of items and tasks that appear in
standardised tests. The main reason for this
is the requirement that standardised tests have
many items in order to achieve reliability. This is
not a requirement for classroom assessment, where there is time
for much more open-ended tasks that take considerable time to
complete.
3. Self- and peer-assessment
Another important component of helping learners to develop a
clear picture of the goals of their own learning compared to their
current performance is self- and peer-assessment. The practice
using transparent criteria is designed primarily to assist the
development of the awareness of the ‘gap’ between what is being
produced now, and the target performance, thus improving
learning.
In order for self- and peer-assessment to work well, it is essential
that classroom time be spent on training learners to rate their own
work, and the work of their colleagues (using rating scales).
3. Self- and peer-assessment (Cont.)
Oscarson (1989: 2) famously argued that ‘the question of subjectivity
does not necessarily invalidate the practice of self-assessment
techniques in language testing and evaluation and, furthermore … self-
assessment may be motivated by reasons that go beyond mere
evaluation’. He saw the primary value in a shared responsibility
between learners and teachers for deciding what constituted ‘good’
work. This led to improved learning through raising awareness of the
quality of writing or speech, and establishing a goal-orientation in
study. Oscarson recommended the practical devices of getting learners
to keep records of their work, and their own perceptions and ratings of
how their work improves. This may involve a diary, or a continuous
assessment card like the one illustrated in Figure 3.1.
Today this could take other forms, such as a digital audio or video
diary, or an online blog in which samples of work and a commentary
are saved, which is called portfolio. The primary benefits of portfolio
assessment in conjunction with self- and peer-assessment to be
collaboration, inclusiveness, involvement and responsibility, in both
learning and assessment. This leads to increased motivation.
4. Dynamic Assessment
Assessment for Learning in the classroom is premised upon the belief
that activities should focus upon making the learner aware of the gap
between current abilities and performance levels. DA makes the same
assumption, but is built upon the work of Vygotsky.
Based in sociocultural theory, it is a new understanding
that cognitive abilities are developed through socially
supported interactions.
DA differs from learning for assessment, as the learner is not
necessarily shown what the final target performance is, but shown the
gap to the next level of development in a sequence of acquisition or
learning. The second difference is in the conceptualisation of the role of
the teacher. Rather than ‘just’ a provider of feedback, teachers are
‘mediators’.
4. DA (Interventionist, Interactionist)
Mediation is about intervening in the learning process in a way that
aids learners to modify their use of language or communication, so that
they constantly improve. In terms of the kinds of tasks that learners are
given, DA holds that teachers should use activities that learners cannot
complete independently, so that mediation is required.
The nature of the mediation is also important. It can be of 2 types. If it is
‘interventionist’, the mediator standardises the mediation, so that it is
common across learners. DA practitioners, however, recommend
‘interactionist’ mediation, in which the mediator interacts with each
learner depending upon the ongoing assessment of the current stage of
the individual’s development. It is this ‘interaction’ that provides DA
with the rationale for the use of the word ‘dynamic’ in its title.
4. Three DA methods
 graduated prompt interventionist techniques
 testing the limits
 mediated learning experience interactionist technique
‘graduated prompt’
 In this technique, the mediator creates a task with a graded series of
questions to ask a learner who has problems completing a task. The
questions start from the most implicit to see if a learner can
overcome a difficulty through guided thinking, to very explicitly
focusing on the nature of the problem. These prompts are prepared
in advanced, and not varied.
‘testing the limits’
 In this technique, learners are given feedback on their performance
on a task, and then asked to verbalise the problems they feel they
have faced, and what they will try to do to overcome them. This
technique requires a teacher to work with a single student on a task,
and to provide whatever scaffolding is necessary to enable the
learner to complete it successfully.
‘mediated learning experience’
 The preferred ‘mediated learning experience’ is a one-to-one
interaction in which the mediator interactively helps the learner
move toward the next stage of learning through scaffolding attempts
to communicate.
Cake or Sandwich?
 Each technique can also be used in a ‘cake’ or ‘sandwich’
approach. In the ‘cake’ approach, mediation takes place after
each item or task, and so can only really be used with
individuals. On the other hand, the ‘sandwich’ approach
involves mediation at the end of a test or series of activities,
and so can also be used with groups.
5. Understanding change
DA Standardised Testing
More concerned with change than
with stability. Indeed, the whole
purpose of ‘feedback’ or ‘mediation’
is to cause change. If the
intervention or interaction is
successful, learning takes place and
the learner is no longer the same
person.
Assumption is that the learner’s state
will remain stable at least for a
period of time.
6. Assessment and second language acquisition
Perhaps one of the most intractable problems associated with DA is the
notion that the mediator, who is always a person with more knowledge (the
teacher) who can act as a guide, is able to identify and describe both the
present state of the learner and the next level of development. It assumes
that learning is a progression along a known pathway. This implies a strong
link between assessment and second language acquisition (SLA) theory.
The kind of theory that is required is a model of SLA that ‘includes two
dimensions: 1) development, which [is] regular and predictable, and 2)
variation, which is largely the result of individual differences’ (Bachman,
1998: 190). However, SLA does not provide us with a theoretical model that
can be used to construct the kind of progression required to describe the
current stage of an individual learner, or the most likely next step on the
path. The closest that SLA research can offer is Krashen’s (1981) natural
order hypothesis and Pienemann’s acquisition-based procedures for
assessment.
7. Criterion-referenced testing
The insights that have led to Assessment for Learning and DA come from
CRT. In CRT, whatever the method, one of the key features of classroom
testing is that test takers are not compared with each other. In criterion-
referenced testing the teaching comes first, and the results of the tests are
used to make decisions about learners and instruction. If the meaning of any
score ‘flows directly from the connection between the items and the
criterion’, the critical feature of CRT is the test specification, which
describes the nature of the items and the rationale for their use in the test.
Glaser 1963:
Achievement measurement can be defined as the assessment of terminal or
criterion behavior; this involves the determination of the characteristics of
student performance with respect to specified standards.
8. Dependability
In classroom testing we wish to know whether the results of the assessment
are dependable. This concerns whether an estimate of a learner’s current
stage would change if a different teacher conducted the assessment, or if a
different (but comparable) task was used. Dependability is the criterion-
referenced correlate of reliability in standardised testing. The traditional
methods of investigating cannot be used, as the lack of variance ‘would lead
to a zero internal consistency estimate. Cronbach’s alpha would always be
very low. Rather, we need to turn to estimates of the consistency or
dependability of decisions. These are the kinds of decisions that teachers
make when they decide that a learner has or has not achieved a certain level.
This decision is sometimes called a ‘mastery/non-mastery’ decision.
The most common ways of calculating dependability are known as the
‘threshold loss agreement approaches’.
‘threshold loss agreement approaches’
These approaches (below) require the same test to be given twice, just as in
calculating test–retest reliability. The purpose is to calculate whether
learners are consistently classified as ‘masters’ or ‘non-masters’.
 Agreement coefficient, or Po.
 Squared-error loss agreement
9. Some thoughts on theory
Perhaps the most serious problem for DA is that it does have any
apparatus for rejecting alternative hypotheses for what is observed in
case studies. Each case study is presented as a unique, non-
generalizable event. What happens in each instance of DA involves
the contextual interpretation of the participants who co-construct
temporally bound meaning. Poehner (2008: 12) follows Luria (1979)
in calling this ‘Romantic Science’. Indeed, this is not science. It is
poetry, and art. It is an attempt to appreciate the whole as a piece,
rather than create variables that can be investigated. There is a place
for poetry and art. However, this is a fundamental flaw in DA. The
purpose of any theory is to explain generalities in observable
phenomena. But DA says that there are no generalities.

More Related Content

What's hot

RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUPRELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUPTitin Rohayati
 
Contrastive analysis
Contrastive analysis Contrastive analysis
Contrastive analysis
khaliliavatalk
 
Describing Learners J Harmer (2001)
Describing Learners J  Harmer (2001)Describing Learners J  Harmer (2001)
Describing Learners J Harmer (2001)lilianamonserrat
 
Toward a Theory of Second Language Acquisition
Toward a Theory of Second Language AcquisitionToward a Theory of Second Language Acquisition
Toward a Theory of Second Language Acquisition
Noni Ib
 
Communicative language testing
Communicative language testingCommunicative language testing
Communicative language testingIda Mantra
 
Principles of Language Assessment
Principles of Language AssessmentPrinciples of Language Assessment
Principles of Language Assessment
SubramanianMuthusamy3
 
types of syllabus
types of syllabustypes of syllabus
types of syllabus
AubergeAmsouzartAits
 
Reliability in Language Testing
Reliability in Language Testing Reliability in Language Testing
Reliability in Language Testing
Seray Tanyer
 
The relationship between Language testing & SLA
The relationship between Language testing & SLAThe relationship between Language testing & SLA
The relationship between Language testing & SLA
Kobra( Minoo) Tajahmadi
 
The Post-Method era
The Post-Method eraThe Post-Method era
The Post-Method era
Hernán Sarasty
 
Factors affecting second language learning strategies
Factors affecting second language learning strategiesFactors affecting second language learning strategies
Factors affecting second language learning strategieszilatesl
 
The role of materials
The role of materialsThe role of materials
The role of materials
Zohreh Dehghan
 
Silent way
Silent waySilent way
Silent way
Loc Le
 
Designing the Needs Analysis
Designing the Needs AnalysisDesigning the Needs Analysis
Designing the Needs Analysis
Ola Sayed Ahmed
 
Language Testing : Principles of language assessment
Language Testing : Principles of language assessment Language Testing : Principles of language assessment
Language Testing : Principles of language assessment
Yulia Eolia
 
Stephan Krashen's five hypotheses
Stephan Krashen's five hypothesesStephan Krashen's five hypotheses
Stephan Krashen's five hypotheses
Ajit Kaliya
 
The logical problem of language learning
The logical problem of language learningThe logical problem of language learning
The logical problem of language learning
Indah Palguna
 
Background issues in language learning
Background issues in language learningBackground issues in language learning
Background issues in language learningclauvides
 
Alternative Assessment
Alternative AssessmentAlternative Assessment
Alternative AssessmentWHS
 

What's hot (20)

Assessing Listening
Assessing ListeningAssessing Listening
Assessing Listening
 
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUPRELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
 
Contrastive analysis
Contrastive analysis Contrastive analysis
Contrastive analysis
 
Describing Learners J Harmer (2001)
Describing Learners J  Harmer (2001)Describing Learners J  Harmer (2001)
Describing Learners J Harmer (2001)
 
Toward a Theory of Second Language Acquisition
Toward a Theory of Second Language AcquisitionToward a Theory of Second Language Acquisition
Toward a Theory of Second Language Acquisition
 
Communicative language testing
Communicative language testingCommunicative language testing
Communicative language testing
 
Principles of Language Assessment
Principles of Language AssessmentPrinciples of Language Assessment
Principles of Language Assessment
 
types of syllabus
types of syllabustypes of syllabus
types of syllabus
 
Reliability in Language Testing
Reliability in Language Testing Reliability in Language Testing
Reliability in Language Testing
 
The relationship between Language testing & SLA
The relationship between Language testing & SLAThe relationship between Language testing & SLA
The relationship between Language testing & SLA
 
The Post-Method era
The Post-Method eraThe Post-Method era
The Post-Method era
 
Factors affecting second language learning strategies
Factors affecting second language learning strategiesFactors affecting second language learning strategies
Factors affecting second language learning strategies
 
The role of materials
The role of materialsThe role of materials
The role of materials
 
Silent way
Silent waySilent way
Silent way
 
Designing the Needs Analysis
Designing the Needs AnalysisDesigning the Needs Analysis
Designing the Needs Analysis
 
Language Testing : Principles of language assessment
Language Testing : Principles of language assessment Language Testing : Principles of language assessment
Language Testing : Principles of language assessment
 
Stephan Krashen's five hypotheses
Stephan Krashen's five hypothesesStephan Krashen's five hypotheses
Stephan Krashen's five hypotheses
 
The logical problem of language learning
The logical problem of language learningThe logical problem of language learning
The logical problem of language learning
 
Background issues in language learning
Background issues in language learningBackground issues in language learning
Background issues in language learning
 
Alternative Assessment
Alternative AssessmentAlternative Assessment
Alternative Assessment
 

Viewers also liked

Practical Language Testing by Fulcher (2010)
Practical Language Testing by Fulcher (2010)Practical Language Testing by Fulcher (2010)
Practical Language Testing by Fulcher (2010)
Mahsa Farahanynia
 
Practical Language Testing Glenn Fulcher
Practical Language Testing Glenn FulcherPractical Language Testing Glenn Fulcher
Practical Language Testing Glenn Fulcher
translatoran
 
Classroom assessment, glenn fulcher
Classroom assessment, glenn fulcherClassroom assessment, glenn fulcher
Classroom assessment, glenn fulcher
Amir Hamid Forough Ameri
 
Individual Assessment Methods for Group Projects ('13 Create! Conference)
Individual Assessment Methods for Group Projects ('13 Create! Conference)Individual Assessment Methods for Group Projects ('13 Create! Conference)
Individual Assessment Methods for Group Projects ('13 Create! Conference)Laurence Baker
 
The acquisition of cultural competence an ethnographic framework for cultural...
The acquisition of cultural competence an ethnographic framework for cultural...The acquisition of cultural competence an ethnographic framework for cultural...
The acquisition of cultural competence an ethnographic framework for cultural...
Mahsa Farahanynia
 
Study quality in quantitative l2 research (1990–2010) a methodological synthe...
Study quality in quantitative l2 research (1990–2010) a methodological synthe...Study quality in quantitative l2 research (1990–2010) a methodological synthe...
Study quality in quantitative l2 research (1990–2010) a methodological synthe...
Mahsa Farahanynia
 
Fulcher standardized testing
Fulcher standardized testingFulcher standardized testing
Fulcher standardized testing
Melikarj
 
Constructs and models
Constructs and modelsConstructs and models
Constructs and models
Amir Kardoust
 
Classroom assessment techniques
Classroom assessment techniquesClassroom assessment techniques
Classroom assessment techniques
Atul Thakur
 
Mixed between-within groups ANOVA
Mixed between-within groups ANOVAMixed between-within groups ANOVA
Mixed between-within groups ANOVA
Mahsa Farahanynia
 
Situational syllabi
Situational syllabiSituational syllabi
Situational syllabi
Mahsa Farahanynia
 
Culture and nonverbal communication
Culture and nonverbal communicationCulture and nonverbal communication
Culture and nonverbal communication
Mahsa Farahanynia
 
Lyle F. Bachman Measurement ( Chapter 2 )
Lyle F. Bachman  Measurement ( Chapter 2 )Lyle F. Bachman  Measurement ( Chapter 2 )
Lyle F. Bachman Measurement ( Chapter 2 )
Abdolhossein Omidi
 
Classroom Assessment
Classroom AssessmentClassroom Assessment
Classroom Assessment
Sturgeon Heights
 
Assessment of reading
Assessment of readingAssessment of reading
Assessment of reading
ArgeeA
 
Reading test specifications assignment-01-ppt
Reading test specifications assignment-01-pptReading test specifications assignment-01-ppt
Reading test specifications assignment-01-ppt
Bilal Yaseen
 
Language testing
Language testingLanguage testing
Language testing
iendah lestari
 
Test specifications and designs
Test specifications and designs  Test specifications and designs
Test specifications and designs
ahfameri
 
Classroom assessment powerpoint ch.2 and 3
Classroom assessment powerpoint ch.2 and 3Classroom assessment powerpoint ch.2 and 3
Classroom assessment powerpoint ch.2 and 3Etowah High School
 

Viewers also liked (20)

Practical Language Testing by Fulcher (2010)
Practical Language Testing by Fulcher (2010)Practical Language Testing by Fulcher (2010)
Practical Language Testing by Fulcher (2010)
 
Practical Language Testing Glenn Fulcher
Practical Language Testing Glenn FulcherPractical Language Testing Glenn Fulcher
Practical Language Testing Glenn Fulcher
 
Classroom assessment, glenn fulcher
Classroom assessment, glenn fulcherClassroom assessment, glenn fulcher
Classroom assessment, glenn fulcher
 
Individual Assessment Methods for Group Projects ('13 Create! Conference)
Individual Assessment Methods for Group Projects ('13 Create! Conference)Individual Assessment Methods for Group Projects ('13 Create! Conference)
Individual Assessment Methods for Group Projects ('13 Create! Conference)
 
The acquisition of cultural competence an ethnographic framework for cultural...
The acquisition of cultural competence an ethnographic framework for cultural...The acquisition of cultural competence an ethnographic framework for cultural...
The acquisition of cultural competence an ethnographic framework for cultural...
 
Study quality in quantitative l2 research (1990–2010) a methodological synthe...
Study quality in quantitative l2 research (1990–2010) a methodological synthe...Study quality in quantitative l2 research (1990–2010) a methodological synthe...
Study quality in quantitative l2 research (1990–2010) a methodological synthe...
 
Fulcher standardized testing
Fulcher standardized testingFulcher standardized testing
Fulcher standardized testing
 
Constructs and models
Constructs and modelsConstructs and models
Constructs and models
 
Classroom assessment techniques
Classroom assessment techniquesClassroom assessment techniques
Classroom assessment techniques
 
Mixed between-within groups ANOVA
Mixed between-within groups ANOVAMixed between-within groups ANOVA
Mixed between-within groups ANOVA
 
Situational syllabi
Situational syllabiSituational syllabi
Situational syllabi
 
Culture and nonverbal communication
Culture and nonverbal communicationCulture and nonverbal communication
Culture and nonverbal communication
 
Lyle F. Bachman Measurement ( Chapter 2 )
Lyle F. Bachman  Measurement ( Chapter 2 )Lyle F. Bachman  Measurement ( Chapter 2 )
Lyle F. Bachman Measurement ( Chapter 2 )
 
Language testing
Language testingLanguage testing
Language testing
 
Classroom Assessment
Classroom AssessmentClassroom Assessment
Classroom Assessment
 
Assessment of reading
Assessment of readingAssessment of reading
Assessment of reading
 
Reading test specifications assignment-01-ppt
Reading test specifications assignment-01-pptReading test specifications assignment-01-ppt
Reading test specifications assignment-01-ppt
 
Language testing
Language testingLanguage testing
Language testing
 
Test specifications and designs
Test specifications and designs  Test specifications and designs
Test specifications and designs
 
Classroom assessment powerpoint ch.2 and 3
Classroom assessment powerpoint ch.2 and 3Classroom assessment powerpoint ch.2 and 3
Classroom assessment powerpoint ch.2 and 3
 

Similar to Classroom assessment glenn fulcher

Summative Assessment
Summative AssessmentSummative Assessment
Summative Assessment
Custom Paper Writing UK
 
ChartTSTSE
ChartTSTSEChartTSTSE
ChartTSTSEianmcnee
 
Essay On Assessment For Learning
Essay On Assessment For LearningEssay On Assessment For Learning
Essay On Assessment For Learning
Best Paper Writing Services
 
What makes-great-teaching-final-4.11.14
What makes-great-teaching-final-4.11.14What makes-great-teaching-final-4.11.14
What makes-great-teaching-final-4.11.14mitch0101
 
Day 3 presesntation morning
Day 3 presesntation morningDay 3 presesntation morning
Day 3 presesntation morning
M Taylor
 
What makes-great-teaching?
What makes-great-teaching?What makes-great-teaching?
What makes-great-teaching?
Scott Miller
 
The Assessment Of Formative Assessment
The Assessment Of Formative AssessmentThe Assessment Of Formative Assessment
The Assessment Of Formative Assessment
Carla Bennington
 
Designing and conducting formative evaluations
Designing and conducting formative evaluationsDesigning and conducting formative evaluations
Designing and conducting formative evaluations
JCrawford62
 
Unit 301 Essay
Unit 301 EssayUnit 301 Essay
Formative Reflective Assessment
Formative Reflective AssessmentFormative Reflective Assessment
Formative Reflective Assessment
Christina Valadez
 
5 discussion issues on assessment.
5 discussion issues on assessment.5 discussion issues on assessment.
5 discussion issues on assessment.
Sarjan Paul Vosko
 
K to 12 Grading Sheet Deped Order No. 8 S. 2015 PPT presentation
K to 12 Grading Sheet Deped Order No. 8 S. 2015 PPT presentationK to 12 Grading Sheet Deped Order No. 8 S. 2015 PPT presentation
K to 12 Grading Sheet Deped Order No. 8 S. 2015 PPT presentation
Chuckry Maunes
 
A Fourstepapproach
A FourstepapproachA Fourstepapproach
A Fourstepapproachianmcnee
 
A Fourstepapproach
A FourstepapproachA Fourstepapproach
A Fourstepapproachmcneeteach
 
Reflection On Summative Assessment
Reflection On Summative AssessmentReflection On Summative Assessment
article
articlearticle
article
sunitha85
 
Features of Classroom Formative Assessment
Features of Classroom Formative AssessmentFeatures of Classroom Formative Assessment
Features of Classroom Formative Assessment
Carlo Magno
 

Similar to Classroom assessment glenn fulcher (20)

Summative Assessment
Summative AssessmentSummative Assessment
Summative Assessment
 
ChartTSTSE
ChartTSTSEChartTSTSE
ChartTSTSE
 
ChartTSTSE
ChartTSTSEChartTSTSE
ChartTSTSE
 
Essay On Assessment For Learning
Essay On Assessment For LearningEssay On Assessment For Learning
Essay On Assessment For Learning
 
What makes-great-teaching-final-4.11.14
What makes-great-teaching-final-4.11.14What makes-great-teaching-final-4.11.14
What makes-great-teaching-final-4.11.14
 
Day 3 presesntation morning
Day 3 presesntation morningDay 3 presesntation morning
Day 3 presesntation morning
 
What makes-great-teaching?
What makes-great-teaching?What makes-great-teaching?
What makes-great-teaching?
 
The Assessment Of Formative Assessment
The Assessment Of Formative AssessmentThe Assessment Of Formative Assessment
The Assessment Of Formative Assessment
 
report in chem
report in chemreport in chem
report in chem
 
Designing and conducting formative evaluations
Designing and conducting formative evaluationsDesigning and conducting formative evaluations
Designing and conducting formative evaluations
 
Unit 301 Essay
Unit 301 EssayUnit 301 Essay
Unit 301 Essay
 
Formative Reflective Assessment
Formative Reflective AssessmentFormative Reflective Assessment
Formative Reflective Assessment
 
5 discussion issues on assessment.
5 discussion issues on assessment.5 discussion issues on assessment.
5 discussion issues on assessment.
 
K to 12 Grading Sheet Deped Order No. 8 S. 2015 PPT presentation
K to 12 Grading Sheet Deped Order No. 8 S. 2015 PPT presentationK to 12 Grading Sheet Deped Order No. 8 S. 2015 PPT presentation
K to 12 Grading Sheet Deped Order No. 8 S. 2015 PPT presentation
 
A Fourstepapproach
A FourstepapproachA Fourstepapproach
A Fourstepapproach
 
A Fourstepapproach
A FourstepapproachA Fourstepapproach
A Fourstepapproach
 
Assessment Overview Formatted
Assessment  Overview FormattedAssessment  Overview Formatted
Assessment Overview Formatted
 
Reflection On Summative Assessment
Reflection On Summative AssessmentReflection On Summative Assessment
Reflection On Summative Assessment
 
article
articlearticle
article
 
Features of Classroom Formative Assessment
Features of Classroom Formative AssessmentFeatures of Classroom Formative Assessment
Features of Classroom Formative Assessment
 

More from ahfameri

Exploring culture
Exploring cultureExploring culture
Exploring culture
ahfameri
 
Thesis summary by amir hamid forough ameri
Thesis summary by amir hamid forough ameriThesis summary by amir hamid forough ameri
Thesis summary by amir hamid forough ameri
ahfameri
 
The role of corrective feedback in second language learning
The role of corrective feedback in second language learningThe role of corrective feedback in second language learning
The role of corrective feedback in second language learning
ahfameri
 
Standards based classroom assessments of english proficiency
Standards based classroom  assessments of english proficiencyStandards based classroom  assessments of english proficiency
Standards based classroom assessments of english proficiency
ahfameri
 
Reliability and dependability by neil jones
Reliability and dependability by neil jonesReliability and dependability by neil jones
Reliability and dependability by neil jones
ahfameri
 
Language testing the social dimension
Language testing  the social dimensionLanguage testing  the social dimension
Language testing the social dimension
ahfameri
 
Extroversion introversion
Extroversion introversionExtroversion introversion
Extroversion introversion
ahfameri
 
Developing a comprehensive empirically based research framework for classroom...
Developing a comprehensive empirically based research framework for classroom...Developing a comprehensive empirically based research framework for classroom...
Developing a comprehensive empirically based research framework for classroom...
ahfameri
 
Cognitive approaches to learning piaget
Cognitive approaches to learning   piagetCognitive approaches to learning   piaget
Cognitive approaches to learning piaget
ahfameri
 
Behavioral view of motivation
Behavioral view of motivationBehavioral view of motivation
Behavioral view of motivation
ahfameri
 

More from ahfameri (10)

Exploring culture
Exploring cultureExploring culture
Exploring culture
 
Thesis summary by amir hamid forough ameri
Thesis summary by amir hamid forough ameriThesis summary by amir hamid forough ameri
Thesis summary by amir hamid forough ameri
 
The role of corrective feedback in second language learning
The role of corrective feedback in second language learningThe role of corrective feedback in second language learning
The role of corrective feedback in second language learning
 
Standards based classroom assessments of english proficiency
Standards based classroom  assessments of english proficiencyStandards based classroom  assessments of english proficiency
Standards based classroom assessments of english proficiency
 
Reliability and dependability by neil jones
Reliability and dependability by neil jonesReliability and dependability by neil jones
Reliability and dependability by neil jones
 
Language testing the social dimension
Language testing  the social dimensionLanguage testing  the social dimension
Language testing the social dimension
 
Extroversion introversion
Extroversion introversionExtroversion introversion
Extroversion introversion
 
Developing a comprehensive empirically based research framework for classroom...
Developing a comprehensive empirically based research framework for classroom...Developing a comprehensive empirically based research framework for classroom...
Developing a comprehensive empirically based research framework for classroom...
 
Cognitive approaches to learning piaget
Cognitive approaches to learning   piagetCognitive approaches to learning   piaget
Cognitive approaches to learning piaget
 
Behavioral view of motivation
Behavioral view of motivationBehavioral view of motivation
Behavioral view of motivation
 

Recently uploaded

The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
Delapenabediema
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
Balvir Singh
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Thiyagu K
 
Sectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdfSectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdf
Vivekanand Anglo Vedic Academy
 
How to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERPHow to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERP
Celine George
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
Pavel ( NSTU)
 
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptxStudents, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
EduSkills OECD
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
MysoreMuleSoftMeetup
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
RaedMohamed3
 
How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
Jisc
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS Module
Celine George
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
JosvitaDsouza2
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
BhavyaRajput3
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
Celine George
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
EugeneSaldivar
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
Celine George
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
MIRIAMSALINAS13
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
Thiyagu K
 
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
Nguyen Thanh Tu Collection
 

Recently uploaded (20)

The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
 
Sectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdfSectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdf
 
How to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERPHow to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERP
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
 
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptxStudents, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
 
How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS Module
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
 
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
 

Classroom assessment glenn fulcher

  • 1.  Classroom Assessment  Fulcher 2010 by:  Amir Hamid Forough Ameri  ahfameri@gmail.com
  • 2. 1. Life at the chalk-face (Introduction) Just how different is assessment in the classroom from the world of large-scale standardized assessment? Some believe that they are not only different paradigms, but exist in a state of conflict. The uneasy relationship between externally mandated testing and teacher assessment has been widely studied (Brindley, 1998, 2001), showing, in Rea-Dickins’ (2008: 258) words, how ‘the wider political context in which children are assessed may constrain desirable assessment practices’.
  • 3. 1. Life at the chalk-face (Introduction) Latham (1877: 40) saw why the teachers of his time liked tests: ‘The value of examinations … is far greater as an engine in the hands of the teacher to keep the pupil to definite work than as a criterion.’The analogy of the test as an engine to drive other goals is a powerful one. The technology of standardised testing has been developed in order to produce an engine that is capable of driving a meritocratic social system. Tests encourage learning because they are gateways to goals. In the classroom, however, we wish to devise engines that encourage learning, not only by motivating learners, but also by providing feedback on learning and achievement to both learners and teachers. If learning can also take place through assessment, we may have achieved the effect to which classroom testing aspires.
  • 4. Chapter Review The chapter considers two major approaches to classroom assessment:  Assessment for Learning and Dynamic Assessment. Also briefly looks at:  self- and peer-assessment,  portfolio assessment  the link between assessment and second language acquisition  criterion-referenced  dependability in criterion-referenced testing  assessing the state of the theory underlying classroom assessment.
  • 5. 2. Assessment for Learning Since the 1980s, there has been a strong interest in the role that assessment can have during the learning process (formative ) (Black and Wiliam , 1998), rather than just at the end of it (summative, traditional approach to classroom assessment). Black and Wiliam argued that the most important endeavor is to modify or change teaching and learning activities to better meet the needs of learners. It was also claimed that the process of assessment, including self-assessment, could improve motivation and self-esteem, leading to additional learning gains. In assessment for learning, feedback should be ‘descriptive’ rather than ‘evaluative’, so that it is not perceived negatively (Rea-Dickins, 2006)
  • 6. 2. Assessment for Learning (Cont.) There are also a number of practical teaching practices that support improved learning through assessment. For Example: Questioning Traditionally, teachers spend a long time on asking questions with Initiation–Response–Feedback (IRF) patterns. What Black and Wiliam discovered was that teachers in the classrooms they observed did not leave sufficient time after a question for learners to think about what was being asked. Rather, if there was no immediate response, teachers would provide the answer themselves or move on to the next topic. The practical recommendation for this form of classroom assessment is to frame questions that do not require the simple repetition of facts, but are more open-ended. Once a question has been asked, teachers should allow longer ‘wait times’ for the learners to think, and respond.
  • 7. 2. Assessment for Learning (Cont.) The other critical component of formative assessment is the choice and design of classroom tasks; Classroom tasks frequently look very different from the kinds of items and tasks that appear in standardised tests. The main reason for this is the requirement that standardised tests have many items in order to achieve reliability. This is not a requirement for classroom assessment, where there is time for much more open-ended tasks that take considerable time to complete.
  • 8. 3. Self- and peer-assessment Another important component of helping learners to develop a clear picture of the goals of their own learning compared to their current performance is self- and peer-assessment. The practice using transparent criteria is designed primarily to assist the development of the awareness of the ‘gap’ between what is being produced now, and the target performance, thus improving learning. In order for self- and peer-assessment to work well, it is essential that classroom time be spent on training learners to rate their own work, and the work of their colleagues (using rating scales).
  • 9. 3. Self- and peer-assessment (Cont.) Oscarson (1989: 2) famously argued that ‘the question of subjectivity does not necessarily invalidate the practice of self-assessment techniques in language testing and evaluation and, furthermore … self- assessment may be motivated by reasons that go beyond mere evaluation’. He saw the primary value in a shared responsibility between learners and teachers for deciding what constituted ‘good’ work. This led to improved learning through raising awareness of the quality of writing or speech, and establishing a goal-orientation in study. Oscarson recommended the practical devices of getting learners to keep records of their work, and their own perceptions and ratings of how their work improves. This may involve a diary, or a continuous assessment card like the one illustrated in Figure 3.1. Today this could take other forms, such as a digital audio or video diary, or an online blog in which samples of work and a commentary are saved, which is called portfolio. The primary benefits of portfolio assessment in conjunction with self- and peer-assessment to be collaboration, inclusiveness, involvement and responsibility, in both learning and assessment. This leads to increased motivation.
  • 10.
  • 11. 4. Dynamic Assessment Assessment for Learning in the classroom is premised upon the belief that activities should focus upon making the learner aware of the gap between current abilities and performance levels. DA makes the same assumption, but is built upon the work of Vygotsky. Based in sociocultural theory, it is a new understanding that cognitive abilities are developed through socially supported interactions. DA differs from learning for assessment, as the learner is not necessarily shown what the final target performance is, but shown the gap to the next level of development in a sequence of acquisition or learning. The second difference is in the conceptualisation of the role of the teacher. Rather than ‘just’ a provider of feedback, teachers are ‘mediators’.
  • 12. 4. DA (Interventionist, Interactionist) Mediation is about intervening in the learning process in a way that aids learners to modify their use of language or communication, so that they constantly improve. In terms of the kinds of tasks that learners are given, DA holds that teachers should use activities that learners cannot complete independently, so that mediation is required. The nature of the mediation is also important. It can be of 2 types. If it is ‘interventionist’, the mediator standardises the mediation, so that it is common across learners. DA practitioners, however, recommend ‘interactionist’ mediation, in which the mediator interacts with each learner depending upon the ongoing assessment of the current stage of the individual’s development. It is this ‘interaction’ that provides DA with the rationale for the use of the word ‘dynamic’ in its title.
  • 13. 4. Three DA methods  graduated prompt interventionist techniques  testing the limits  mediated learning experience interactionist technique
  • 14. ‘graduated prompt’  In this technique, the mediator creates a task with a graded series of questions to ask a learner who has problems completing a task. The questions start from the most implicit to see if a learner can overcome a difficulty through guided thinking, to very explicitly focusing on the nature of the problem. These prompts are prepared in advanced, and not varied.
  • 15. ‘testing the limits’  In this technique, learners are given feedback on their performance on a task, and then asked to verbalise the problems they feel they have faced, and what they will try to do to overcome them. This technique requires a teacher to work with a single student on a task, and to provide whatever scaffolding is necessary to enable the learner to complete it successfully.
  • 16. ‘mediated learning experience’  The preferred ‘mediated learning experience’ is a one-to-one interaction in which the mediator interactively helps the learner move toward the next stage of learning through scaffolding attempts to communicate.
  • 17. Cake or Sandwich?  Each technique can also be used in a ‘cake’ or ‘sandwich’ approach. In the ‘cake’ approach, mediation takes place after each item or task, and so can only really be used with individuals. On the other hand, the ‘sandwich’ approach involves mediation at the end of a test or series of activities, and so can also be used with groups.
  • 18. 5. Understanding change DA Standardised Testing More concerned with change than with stability. Indeed, the whole purpose of ‘feedback’ or ‘mediation’ is to cause change. If the intervention or interaction is successful, learning takes place and the learner is no longer the same person. Assumption is that the learner’s state will remain stable at least for a period of time.
  • 19. 6. Assessment and second language acquisition Perhaps one of the most intractable problems associated with DA is the notion that the mediator, who is always a person with more knowledge (the teacher) who can act as a guide, is able to identify and describe both the present state of the learner and the next level of development. It assumes that learning is a progression along a known pathway. This implies a strong link between assessment and second language acquisition (SLA) theory. The kind of theory that is required is a model of SLA that ‘includes two dimensions: 1) development, which [is] regular and predictable, and 2) variation, which is largely the result of individual differences’ (Bachman, 1998: 190). However, SLA does not provide us with a theoretical model that can be used to construct the kind of progression required to describe the current stage of an individual learner, or the most likely next step on the path. The closest that SLA research can offer is Krashen’s (1981) natural order hypothesis and Pienemann’s acquisition-based procedures for assessment.
  • 20. 7. Criterion-referenced testing The insights that have led to Assessment for Learning and DA come from CRT. In CRT, whatever the method, one of the key features of classroom testing is that test takers are not compared with each other. In criterion- referenced testing the teaching comes first, and the results of the tests are used to make decisions about learners and instruction. If the meaning of any score ‘flows directly from the connection between the items and the criterion’, the critical feature of CRT is the test specification, which describes the nature of the items and the rationale for their use in the test. Glaser 1963: Achievement measurement can be defined as the assessment of terminal or criterion behavior; this involves the determination of the characteristics of student performance with respect to specified standards.
  • 21. 8. Dependability In classroom testing we wish to know whether the results of the assessment are dependable. This concerns whether an estimate of a learner’s current stage would change if a different teacher conducted the assessment, or if a different (but comparable) task was used. Dependability is the criterion- referenced correlate of reliability in standardised testing. The traditional methods of investigating cannot be used, as the lack of variance ‘would lead to a zero internal consistency estimate. Cronbach’s alpha would always be very low. Rather, we need to turn to estimates of the consistency or dependability of decisions. These are the kinds of decisions that teachers make when they decide that a learner has or has not achieved a certain level. This decision is sometimes called a ‘mastery/non-mastery’ decision. The most common ways of calculating dependability are known as the ‘threshold loss agreement approaches’.
  • 22. ‘threshold loss agreement approaches’ These approaches (below) require the same test to be given twice, just as in calculating test–retest reliability. The purpose is to calculate whether learners are consistently classified as ‘masters’ or ‘non-masters’.  Agreement coefficient, or Po.  Squared-error loss agreement
  • 23. 9. Some thoughts on theory Perhaps the most serious problem for DA is that it does have any apparatus for rejecting alternative hypotheses for what is observed in case studies. Each case study is presented as a unique, non- generalizable event. What happens in each instance of DA involves the contextual interpretation of the participants who co-construct temporally bound meaning. Poehner (2008: 12) follows Luria (1979) in calling this ‘Romantic Science’. Indeed, this is not science. It is poetry, and art. It is an attempt to appreciate the whole as a piece, rather than create variables that can be investigated. There is a place for poetry and art. However, this is a fundamental flaw in DA. The purpose of any theory is to explain generalities in observable phenomena. But DA says that there are no generalities.