Practical Language Testing Glenn Fulchertranslatoran
Practical LanguageTesting
Glenn Fulcher
Specifications for testing and teaching.
A sample detailed specification for a
reading test.
In this section we present an example of an architecture for a reading test. This includes
the test framework that presents the test purpose, the target test takers, the criterion
domain and the rationale for the test content. The architecture is annotated with explanations
in text boxes. This is a detailed test specification. The complexities of coding
in test specifications of this kind are usually necessary in the design and assembly of
high-stakes tests where it is essential to achieve parallel forms. There are problems with
this type of specification for use in classroom assessment, which we deal with in Section
4 below.
Practical Language Testing Glenn Fulchertranslatoran
Practical LanguageTesting
Glenn Fulcher
Specifications for testing and teaching.
A sample detailed specification for a
reading test.
In this section we present an example of an architecture for a reading test. This includes
the test framework that presents the test purpose, the target test takers, the criterion
domain and the rationale for the test content. The architecture is annotated with explanations
in text boxes. This is a detailed test specification. The complexities of coding
in test specifications of this kind are usually necessary in the design and assembly of
high-stakes tests where it is essential to achieve parallel forms. There are problems with
this type of specification for use in classroom assessment, which we deal with in Section
4 below.
Tets types
Language Aptitude Test
Proficiency Tests
Placement Tests
Diagnostic Tests
Achievement Tests
Language Aptitude Test
Is designed to measure capacity or general ability to learn a foreign language and ultimate success in that undertaking. Language aptitude tests are ostensibly designed to apply to the classroom learning of any language. Two standardized aptitude tests have been used in the USA: the Modern Language Aptitude Test (MLAT) (Carroll and Sapon, 1958) and the Pimsleur Language Aptitude Battery (PLAB) (Pimsleur, 1966). Both are English language tests and require students to perform a number of Language-related tasks.
A short presentation that accompanied a seminar I gave in December 2012 in Eurasia National University in Astana. This was from my final seminar as Methodologist, before my resignation took effect.
Do you feel like what you are doing is watered down? Are you “telling” more than you are leading? So were we. Increasing rigor in your classroom with complex text will get the results you want. Find out how to do just that.
Presenter(s): James Burney and Heather Cameron
Tets types
Language Aptitude Test
Proficiency Tests
Placement Tests
Diagnostic Tests
Achievement Tests
Language Aptitude Test
Is designed to measure capacity or general ability to learn a foreign language and ultimate success in that undertaking. Language aptitude tests are ostensibly designed to apply to the classroom learning of any language. Two standardized aptitude tests have been used in the USA: the Modern Language Aptitude Test (MLAT) (Carroll and Sapon, 1958) and the Pimsleur Language Aptitude Battery (PLAB) (Pimsleur, 1966). Both are English language tests and require students to perform a number of Language-related tasks.
A short presentation that accompanied a seminar I gave in December 2012 in Eurasia National University in Astana. This was from my final seminar as Methodologist, before my resignation took effect.
Do you feel like what you are doing is watered down? Are you “telling” more than you are leading? So were we. Increasing rigor in your classroom with complex text will get the results you want. Find out how to do just that.
Presenter(s): James Burney and Heather Cameron
Presentation from this year's Teaching and Learning Takeover at the University of Southampton. Sharing ideas adapted from Penny Langford's building writers plan and also some feedback techniques for ks3 and ks4.
Part 3 great opportunities great expectationsSeltAcademy
The last part of the presentation. Some more ideas for getting connected and engaging students. Today's Meet, Pinterest, Facebook, Edmodo, and a discussion of how education is changing.
Part 2 great opportunities great expectationsSeltAcademy
On day 2 we looked at some issues related to reading lessons, engaging students with communicative tasks and started to look at ways teachers can collect and share information.
Synthetic Fiber Construction in lab .pptxPavel ( NSTU)
Synthetic fiber production is a fascinating and complex field that blends chemistry, engineering, and environmental science. By understanding these aspects, students can gain a comprehensive view of synthetic fiber production, its impact on society and the environment, and the potential for future innovations. Synthetic fibers play a crucial role in modern society, impacting various aspects of daily life, industry, and the environment. ynthetic fibers are integral to modern life, offering a range of benefits from cost-effectiveness and versatility to innovative applications and performance characteristics. While they pose environmental challenges, ongoing research and development aim to create more sustainable and eco-friendly alternatives. Understanding the importance of synthetic fibers helps in appreciating their role in the economy, industry, and daily life, while also emphasizing the need for sustainable practices and innovation.
Francesca Gottschalk - How can education support child empowerment.pptxEduSkills OECD
Francesca Gottschalk from the OECD’s Centre for Educational Research and Innovation presents at the Ask an Expert Webinar: How can education support child empowerment?
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdfTechSoup
In this webinar you will learn how your organization can access TechSoup's wide variety of product discount and donation programs. From hardware to software, we'll give you a tour of the tools available to help your nonprofit with productivity, collaboration, financial management, donor tracking, security, and more.
The French Revolution, which began in 1789, was a period of radical social and political upheaval in France. It marked the decline of absolute monarchies, the rise of secular and democratic republics, and the eventual rise of Napoleon Bonaparte. This revolutionary period is crucial in understanding the transition from feudalism to modernity in Europe.
For more information, visit-www.vavaclasses.com
How to Make a Field invisible in Odoo 17Celine George
It is possible to hide or invisible some fields in odoo. Commonly using “invisible” attribute in the field definition to invisible the fields. This slide will show how to make a field invisible in odoo 17.
Biological screening of herbal drugs: Introduction and Need for
Phyto-Pharmacological Screening, New Strategies for evaluating
Natural Products, In vitro evaluation techniques for Antioxidants, Antimicrobial and Anticancer drugs. In vivo evaluation techniques
for Anti-inflammatory, Antiulcer, Anticancer, Wound healing, Antidiabetic, Hepatoprotective, Cardio protective, Diuretics and
Antifertility, Toxicity studies as per OECD guidelines
Acetabularia Information For Class 9 .docxvaibhavrinwa19
Acetabularia acetabulum is a single-celled green alga that in its vegetative state is morphologically differentiated into a basal rhizoid and an axially elongated stalk, which bears whorls of branching hairs. The single diploid nucleus resides in the rhizoid.
2.3 tests of receptive skills: workshop CTS-Academic
1. KAYSERI, 29-31 JANUARY 2014
Tests of receptive skills
developing tests for Reading and Listening
2.
3. Aims of the session
! challenges in testing for comprehension
! what sub-skills are to be tested
! selecting texts
! writing items
! task types: pros and cons
5. What makes testing
comprehension challenging?
Pros
Cons
! relatively easy to create if
texts are available
! no observable learner
behaviour
! input can control learner
output
! familiarity and interest
may affect success
! objective marking is
normally possible
! if a learner fails, difficult to
know why they failed
! are we only testing what
we intend to test?
6. receptive skills can only
be tested indirectly
language performance ! inferences to comprehension
abilities
7. The process of writing a test
set
aims
select
texts
write
tasks
10. Selecting texts
! a representative sample of text types learners are
likely to encounter
! appropriate extent
! texts with high information content
! clear structure
! neutral but interesting themes
! avoid relying on general knowledge
! avoid culturally loaded texts
! avoid texts learners have already read
11. Item writing checklist
" text and item grammatically correct
" English natural and appropriate
" item achieves test objective
" the intended sub-skills needed to answer item
" one correct key (or a limited number of responses)
" open answers within student abilities
" open answers with valid and reliable marking
" distractors all work
" item economical and practical
" key complete and correct
13. Common task types for testing
receptive skills
! multiple choice
! short answers
! gap fill
! information transfer
! multiple matching
! for both reading and listening
! note-taking, dictation or transcription
! for listening only
14. Common task types for testing
receptive skills
! short answers
! multiple choice
! gap fill
! multiple matching
! information transfer
! for both reading and listening
! note-taking, dictation or transcription
! for listening only
What are the pros and cons of each task
type?
15. Short answers
Pros
! each student can
complete an item
according to their
abilities
! no distractors
! links reception to
controlled production
Cons
! need to decide if answer
length is specified
! unpredictable alternative
answers
! difficult to phrase stem
to determine answer
! encourages verbatim
quoting –
comprehension?
16. Multiple choice
Pros
! very familiar format
! quick to complete
! easy to mark
! very objective
! high discrimination
index
Cons
! difficult to write good
distractors
! need to produce one
correct answer only
! temptation to use for
every purpose
! may encourage
guessing
17. Tips for writing good distractors
" Make sure there is only ONE correct answer.
" They should be the same form as the key.
" They should be related logically to the key.
" Key should not stand out – similar length and level.
" Avoid synonyms so they can’t be eliminated at once.
" Keep distractor extent and repetition to a minimum.
" Don’t pair up two distractors (these focus attention).
" Check for unintended clues (e.g. an … ! vowel).
" Avoid illogical or obviously impossible distractors.
" If nobody chooses a distractor, it isn’t a distractor!
18. Gap fill
Pros
! familiar format
! easy to create
! relatively easy to mark
Cons
! difficult to predict all
alternative answers
! some items can be
answered without
reading the whole item
19. Multiple matching
Pros
! clear task, easy to do
! easy to mark
Cons
! errors duplicate as
items aren’t
independent of one
another
! can be solved by
elimination (where
there are no distractor
items)
! encourages guessing
20. Information transfer
Pros
Cons
! integrated ! real-life
skill
! two or more skills
tested at once
! involving and
challenging task
! difficult to write tasks
that limit the number of
variables
! difficult to mark