SlideShare a Scribd company logo
L U C Í A R U B I O R U B I O
How should we test reading
skills?
1. Is it easy to test reading skills? - Problems
2. Which skills the reader perform? - Operations
3. Which texts candidates are expected to be able to deal with? –
Parameters
4. Criterial level of performance
5. Setting tasks:
a. Selecting texts
b. Writing items
c. Possible techniques
d. Which language for items and responses?
e. Procedures for writing items – Practical advice
6. What should we test on a reading test?
1. Is it easy to test reading skills?
• A good one?
• What do you want to measure?
Quickly
construction of a
reading test
• Which skills are involved?
• Measuring a particular skill – Successful item?
Manifest of
receptive skills
• Reading purpose
• The kind of text
Different ways of
reading depending
on…
• Diagnostic test
• Achievement test
• Placement test
• Profiency test
The purpose of the
test
2. Which skills the reader perform? - Operations
Operations based on different
purposes
Expeditious
reading
Skimming
Search
reading
Scanning
Careful
reading
Identify
Interpret
Distinguish
Recognise
Outline
Make
inferences
3. Which texts candidates are expected to be able
to deal with?
• Text types
• Text forms
• Graphic features
• Topics
• Style
• Intended readership
• Lenght
• Readability
• Range of vocabulary
• Range of grammar
• Authenticity
Parameters
We want the texts included in a
test to be representative of the
texts candidates should be able
to read successfully. Content
validity and backwash.
4. Criterial level of performance
Traditional passmarks expressed in percentages: no direct
interpretation
To use the test tasks themselves to define
the level
When can we compare performance on the test using
scales: ACTFL or ILR?
5. Setting tasks
• Advices:
• Representative sample: many texts and operations
• Appropriate length
• Content validity & reliability: Many passages (Fresh starts) VS.
Practicality
• Search reading: discrete information
• Scanning: Texts with the specified elements
• Structure ability: Clear structure
• Interest but not overexcite or disturb
• Avoid texts about general knowledge
• Avoid too culturally laden texts
• New texts for students
a. Selecting texts: Experience, judgement and common sense
• Measure the ability in which we are interested
• Elicit reliable behaviour from candidates
• Permit highly reliable scoring
b. Writing items that…
• Multiple choices
• Short answer
• Gap filling
• Information transfer
c. Possible techniques
Multiple choice
The man with a
dog was attacked
in the street by a
woman
True/False: by
chance?
-> Add another
distractor
Short answer
It is better with an unique correct response
 For testing the ability to identify referents
 For testing the ability to predict the meaning of a word in
context
 For testing the ability to make various distinctions
 For testing scanning
 For testing the ability to structure a text (Problems on
scoring of sequencing items)
Gap filling
When the required response is so complex and it may cause
writing and scoring problems
• To test if the candidate had grasped the main idea
• To test the ability to recognise detail presented support a
main idea
• Summary cloze
Information transfer
 Minimising demands on writing
ability
 Example: a table, following a
route, labelling a picture etc.
• Items: Less demanding than the text itself
• Responses: Minimal demands on writing ability
• Target language or native language?
d. Which language for items and responses?
• 1. Careful reading: operations in mind
• 2. What a competent reader should derive from the
text?
• 3. To take notes
• 4. To decide the tasks
• 5. Paragraph and line numbers (to reference)
• 6. Moderation by colleagues and modification
e. Procedures for writing items – Practical advice
Moderation
checklist
TIPS
Items in
order
Answers
found
without
reading
No
general
knowledg
e answers
Independient
items
Minor
changes –
Ask a
native
6. What should we test on a reading test?
Grammar,
vocabulary,
spelling or
punctuation
To test receptive and productive skills at the same time
makes the measurement less valid
7. References
 Hughes, A. (2003). Testing for language teachers. Testing
Reading, 136-160.

More Related Content

What's hot

Testing oral ability
Testing oral abilityTesting oral ability
Testing oral ability
Arfan rai
 
Task Based Language Teaching - TBLT
Task Based Language Teaching - TBLTTask Based Language Teaching - TBLT
Task Based Language Teaching - TBLTMüberra GÜLEK
 
Testing oral ability
Testing oral ability Testing oral ability
Testing oral ability
Cristina Molino Fdez
 
Testing speaking
Testing speakingTesting speaking
Testing speaking
M B
 
testing writing
testing writingtesting writing
testing writing
Afif Kurniawan
 
THE ROLES OF ESP TEACHERS
THE ROLES OF ESP TEACHERSTHE ROLES OF ESP TEACHERS
THE ROLES OF ESP TEACHERS
steadyfalcon
 
Functional Syllabuses
Functional SyllabusesFunctional Syllabuses
Functional Syllabuses
A Faiz
 
Chapter 6( assessing listening)
Chapter 6( assessing listening)Chapter 6( assessing listening)
Chapter 6( assessing listening)Kheang Sokheng
 
discrete-point and integrative testing
discrete-point and integrative testingdiscrete-point and integrative testing
discrete-point and integrative testing
indriyatul munawaroh
 
Common test techniques
Common test techniquesCommon test techniques
Common test techniques
Maury Martinez
 
Language testing
Language testingLanguage testing
Language testing
Jihan Zayed
 
Testing for Language Teachers
Testing for Language TeachersTesting for Language Teachers
Testing for Language Teachers
mpazhou
 
Testing oral ability
Testing oral abilityTesting oral ability
Testing oral abilitypaoladed
 
Designing language test
Designing language testDesigning language test
Designing language test
Jesullyna Manuel
 
Testing for language teachers 101 (1)
Testing for language teachers 101 (1)Testing for language teachers 101 (1)
Testing for language teachers 101 (1)Paul Doyon
 
Designing classroom language test
Designing classroom language testDesigning classroom language test
Designing classroom language test
Ratih Puspitasari
 
Testing writing
Testing writingTesting writing
Testing writing
Marta Ribas
 
Testing listening slide
Testing listening slideTesting listening slide
Testing listening slide
Santi Setiorini Nur
 

What's hot (20)

Language testing
Language testingLanguage testing
Language testing
 
Testing oral ability
Testing oral abilityTesting oral ability
Testing oral ability
 
Task Based Language Teaching - TBLT
Task Based Language Teaching - TBLTTask Based Language Teaching - TBLT
Task Based Language Teaching - TBLT
 
Testing oral ability
Testing oral ability Testing oral ability
Testing oral ability
 
Testing speaking
Testing speakingTesting speaking
Testing speaking
 
testing writing
testing writingtesting writing
testing writing
 
THE ROLES OF ESP TEACHERS
THE ROLES OF ESP TEACHERSTHE ROLES OF ESP TEACHERS
THE ROLES OF ESP TEACHERS
 
Functional Syllabuses
Functional SyllabusesFunctional Syllabuses
Functional Syllabuses
 
Testing of listening
Testing of listeningTesting of listening
Testing of listening
 
Chapter 6( assessing listening)
Chapter 6( assessing listening)Chapter 6( assessing listening)
Chapter 6( assessing listening)
 
discrete-point and integrative testing
discrete-point and integrative testingdiscrete-point and integrative testing
discrete-point and integrative testing
 
Common test techniques
Common test techniquesCommon test techniques
Common test techniques
 
Language testing
Language testingLanguage testing
Language testing
 
Testing for Language Teachers
Testing for Language TeachersTesting for Language Teachers
Testing for Language Teachers
 
Testing oral ability
Testing oral abilityTesting oral ability
Testing oral ability
 
Designing language test
Designing language testDesigning language test
Designing language test
 
Testing for language teachers 101 (1)
Testing for language teachers 101 (1)Testing for language teachers 101 (1)
Testing for language teachers 101 (1)
 
Designing classroom language test
Designing classroom language testDesigning classroom language test
Designing classroom language test
 
Testing writing
Testing writingTesting writing
Testing writing
 
Testing listening slide
Testing listening slideTesting listening slide
Testing listening slide
 

Similar to Testing reading

The reader: defining the construct of reading ability.
The reader:  defining the construct of reading ability.The reader:  defining the construct of reading ability.
The reader: defining the construct of reading ability.
Zaina Dali
 
Testing four skills
Testing four skillsTesting four skills
Testing four skills
steadyfalcon
 
Developing writing skills - The process approach
Developing writing skills - The process approachDeveloping writing skills - The process approach
Developing writing skills - The process approach
Xavier Pradheep Singh
 
Guided reading in the Elementary
Guided reading in the ElementaryGuided reading in the Elementary
Guided reading in the Elementary
Lisa Shaw
 
Lec 1
Lec 1Lec 1
Objective type of test
Objective type of testObjective type of test
Objective type of test
HennaAnsari
 
Be ch 7 assessing students progress
Be ch 7   assessing students  progressBe ch 7   assessing students  progress
Be ch 7 assessing students progressAbdelaziz Aittaleb
 
languagetesting-200627343434344035034.pdf
languagetesting-200627343434344035034.pdflanguagetesting-200627343434344035034.pdf
languagetesting-200627343434344035034.pdf
Attallah Alanazi
 
Academic writing - An overview of types of writing
Academic writing - An overview of types of writing Academic writing - An overview of types of writing
Academic writing - An overview of types of writing
Nutan Erathi
 
Assessment of reading
Assessment of readingAssessment of reading
Assessment of reading
ArgeeA
 
Assessing writing
Assessing writingAssessing writing
Assessing writing
roni79
 
ESAP Symposium Reading workshop August 15 2015
ESAP Symposium Reading workshop August 15 2015ESAP Symposium Reading workshop August 15 2015
ESAP Symposium Reading workshop August 15 2015
Stephen j Hall
 
Language tests
Language testsLanguage tests
Language tests
Universidad Santo Tomás
 
Langguage assessment( final version)
Langguage assessment( final version)Langguage assessment( final version)
Langguage assessment( final version)
Như Huỳnh Thị
 
essat type question
essat type question essat type question
essat type question
MR. JAGDISH SAMBAD
 
Assessing receptive skills.pptx
Assessing receptive skills.pptxAssessing receptive skills.pptx
Assessing receptive skills.pptx
Lahcen Biz
 
studyskills-150226211659-conversion-gate01.pptx
studyskills-150226211659-conversion-gate01.pptxstudyskills-150226211659-conversion-gate01.pptx
studyskills-150226211659-conversion-gate01.pptx
safdarhussainbhutta4
 
FINAL
FINALFINAL
FINAL
IES JFK
 

Similar to Testing reading (20)

The reader: defining the construct of reading ability.
The reader:  defining the construct of reading ability.The reader:  defining the construct of reading ability.
The reader: defining the construct of reading ability.
 
Testing four skills
Testing four skillsTesting four skills
Testing four skills
 
Developing writing skills - The process approach
Developing writing skills - The process approachDeveloping writing skills - The process approach
Developing writing skills - The process approach
 
Reading assessment
Reading assessmentReading assessment
Reading assessment
 
Guided reading in the Elementary
Guided reading in the ElementaryGuided reading in the Elementary
Guided reading in the Elementary
 
Lec 1
Lec 1Lec 1
Lec 1
 
Objective type of test
Objective type of testObjective type of test
Objective type of test
 
Assessment
AssessmentAssessment
Assessment
 
Be ch 7 assessing students progress
Be ch 7   assessing students  progressBe ch 7   assessing students  progress
Be ch 7 assessing students progress
 
languagetesting-200627343434344035034.pdf
languagetesting-200627343434344035034.pdflanguagetesting-200627343434344035034.pdf
languagetesting-200627343434344035034.pdf
 
Academic writing - An overview of types of writing
Academic writing - An overview of types of writing Academic writing - An overview of types of writing
Academic writing - An overview of types of writing
 
Assessment of reading
Assessment of readingAssessment of reading
Assessment of reading
 
Assessing writing
Assessing writingAssessing writing
Assessing writing
 
ESAP Symposium Reading workshop August 15 2015
ESAP Symposium Reading workshop August 15 2015ESAP Symposium Reading workshop August 15 2015
ESAP Symposium Reading workshop August 15 2015
 
Language tests
Language testsLanguage tests
Language tests
 
Langguage assessment( final version)
Langguage assessment( final version)Langguage assessment( final version)
Langguage assessment( final version)
 
essat type question
essat type question essat type question
essat type question
 
Assessing receptive skills.pptx
Assessing receptive skills.pptxAssessing receptive skills.pptx
Assessing receptive skills.pptx
 
studyskills-150226211659-conversion-gate01.pptx
studyskills-150226211659-conversion-gate01.pptxstudyskills-150226211659-conversion-gate01.pptx
studyskills-150226211659-conversion-gate01.pptx
 
FINAL
FINALFINAL
FINAL
 

Recently uploaded

TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
EugeneSaldivar
 
Polish students' mobility in the Czech Republic
Polish students' mobility in the Czech RepublicPolish students' mobility in the Czech Republic
Polish students' mobility in the Czech Republic
Anna Sz.
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
Delapenabediema
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
Levi Shapiro
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
Peter Windle
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
Sandy Millin
 
678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf
CarlosHernanMontoyab2
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
joachimlavalley1
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
EverAndrsGuerraGuerr
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
Tamralipta Mahavidyalaya
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
camakaiclarkmusic
 
The basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptxThe basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptx
heathfieldcps1
 
A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
Peter Windle
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
Celine George
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
JosvitaDsouza2
 
Guidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th SemesterGuidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th Semester
Atul Kumar Singh
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
TechSoup
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
BhavyaRajput3
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
Jheel Barad
 

Recently uploaded (20)

TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
 
Polish students' mobility in the Czech Republic
Polish students' mobility in the Czech RepublicPolish students' mobility in the Czech Republic
Polish students' mobility in the Czech Republic
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
 
678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
 
The basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptxThe basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptx
 
A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
 
Guidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th SemesterGuidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th Semester
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
 

Testing reading

  • 1. L U C Í A R U B I O R U B I O How should we test reading skills?
  • 2. 1. Is it easy to test reading skills? - Problems 2. Which skills the reader perform? - Operations 3. Which texts candidates are expected to be able to deal with? – Parameters 4. Criterial level of performance 5. Setting tasks: a. Selecting texts b. Writing items c. Possible techniques d. Which language for items and responses? e. Procedures for writing items – Practical advice 6. What should we test on a reading test?
  • 3. 1. Is it easy to test reading skills? • A good one? • What do you want to measure? Quickly construction of a reading test • Which skills are involved? • Measuring a particular skill – Successful item? Manifest of receptive skills • Reading purpose • The kind of text Different ways of reading depending on… • Diagnostic test • Achievement test • Placement test • Profiency test The purpose of the test
  • 4. 2. Which skills the reader perform? - Operations Operations based on different purposes Expeditious reading Skimming Search reading Scanning Careful reading Identify Interpret Distinguish Recognise Outline Make inferences
  • 5. 3. Which texts candidates are expected to be able to deal with? • Text types • Text forms • Graphic features • Topics • Style • Intended readership • Lenght • Readability • Range of vocabulary • Range of grammar • Authenticity Parameters We want the texts included in a test to be representative of the texts candidates should be able to read successfully. Content validity and backwash.
  • 6. 4. Criterial level of performance Traditional passmarks expressed in percentages: no direct interpretation To use the test tasks themselves to define the level When can we compare performance on the test using scales: ACTFL or ILR?
  • 7. 5. Setting tasks • Advices: • Representative sample: many texts and operations • Appropriate length • Content validity & reliability: Many passages (Fresh starts) VS. Practicality • Search reading: discrete information • Scanning: Texts with the specified elements • Structure ability: Clear structure • Interest but not overexcite or disturb • Avoid texts about general knowledge • Avoid too culturally laden texts • New texts for students a. Selecting texts: Experience, judgement and common sense
  • 8. • Measure the ability in which we are interested • Elicit reliable behaviour from candidates • Permit highly reliable scoring b. Writing items that… • Multiple choices • Short answer • Gap filling • Information transfer c. Possible techniques
  • 9. Multiple choice The man with a dog was attacked in the street by a woman True/False: by chance? -> Add another distractor
  • 10. Short answer It is better with an unique correct response  For testing the ability to identify referents  For testing the ability to predict the meaning of a word in context  For testing the ability to make various distinctions  For testing scanning  For testing the ability to structure a text (Problems on scoring of sequencing items)
  • 11.
  • 12.
  • 13.
  • 14.
  • 15. Gap filling When the required response is so complex and it may cause writing and scoring problems • To test if the candidate had grasped the main idea • To test the ability to recognise detail presented support a main idea • Summary cloze
  • 16.
  • 17.
  • 18.
  • 19. Information transfer  Minimising demands on writing ability  Example: a table, following a route, labelling a picture etc.
  • 20. • Items: Less demanding than the text itself • Responses: Minimal demands on writing ability • Target language or native language? d. Which language for items and responses? • 1. Careful reading: operations in mind • 2. What a competent reader should derive from the text? • 3. To take notes • 4. To decide the tasks • 5. Paragraph and line numbers (to reference) • 6. Moderation by colleagues and modification e. Procedures for writing items – Practical advice
  • 23. 6. What should we test on a reading test? Grammar, vocabulary, spelling or punctuation To test receptive and productive skills at the same time makes the measurement less valid
  • 24. 7. References  Hughes, A. (2003). Testing for language teachers. Testing Reading, 136-160.