SlideShare a Scribd company logo
1 of 13
The Association Between TOEFL iBT®
Test Scores and the Common
European Framework of Reference
(CEFR) Levels
Spiros Papageorgiou
Richard J. Tannenbaum
Brent Bridgeman
Yeonsuk Cho
Table of Contents
Research
Objectives
Contains rationale for
the revision of CEFR
cut score & claims
01
Theoretical
Framework
Covers a brief
overview of the CEFR
and the process of
mapping test scores
to its levels
02
Research
Design
How the researcher
conduct the study
03
Findings
Presents the evidence
supporting the claims
04
Research
Objective
The research memorandum
presents the rationale for the
revision of the CEFR cut
scores and offer validity
evidence supporting claims
related to the cut scores
Claims related to the
interferences
Claim 1 (reasonableness
of the cut scores)
The revised CEFR cut scores are
reasonable for making decisions
about admission into higher
education.
Claim 2 (impact of the
cut scores)
The revised CEFR cut scores do
not negatively impact
admissions decisions due to
classification errors.
Theoretical
Framework
Brief overview of the CEFR & Process
of Mapping Test Scores to Its Levels
Mapping Test
Scores to the CEFR
Mapping TOEFL iBT
Test Scores to the
CEFR
Alignment of the
Content of the
TOEFL iBT Test to
the CEFR Levels
Research
Design
Argument-based approach (Kane,
2006, 2013) through the use of
external, non-assessment criteria
(Kane, 2001)
Findings
Investigating the Reasonableness
of the Revised Cut Scores
● Investigation of university admission requirements for TOEFL iBT test scores in
English speaking countries
● Review on admission web-pages of 155 top ranked universities (based on the
2014 – 2015 Times Higher Education World University Rankings)
● CEFR B2 level descriptors are relevant as language objectives for further &
higher education
● Comparing the revised cut score range mapped to the B2 level to the
recommended cut scores
● The revised TOEFL iBT test score range for B2 seems to better capture the
current practice in university entry requirements among the surveyed
institutions  revised CEFR cut scores are reasonable
● Investigating the impact by utilizing data from two previous studies
○ Cho & Bridgeman (2012) - 2,594 international students’
TOEFL iBT test scores & cumulative GPA
○ Bridgeman et al. (in press) – TOEFL iBT test scores & overall
GPA from first 3 terms of 787 undergraduate international
students
● The studies show that TOEFL iBT test scores have a meaningful
relationship with academic performance as indicated by the GPA.
● Using the revised score range for CEFR Level B2 will not likely result
in admitting university students who do not have sufficient English-
language skills to cope with instructional demands in the English
language.
Investigating the Impact of
the Revised Cut Scores
Conclusion
Education professionals and researchers advocate adaptation
of the CEFR to meet local needs because the CEFR is a
dynamic, rather than fixed, framework. Consequently, it is
appropriate to periodically review and reconsider the
relationship between test scores and the CEFR in light of
changes in decision makers’ needs and changing assessment
contexts, as we demonstrate in this research memorandum
because “cut scores are constructed, not found” (Zieky,
2001, p. 45).
CREDITS: This presentation template was created by
Slidesgo, including icons by Flaticon, infographics &
images by Freepik and illustrations by Stories
Thanks!
Does anyone have any questions?
addyouremail@freepik.com
+91 620 421 838
yourcompany.com
Please keep this slide for attribution

More Related Content

Similar to TOEFL IBT vz CEFR - Panca Eka Septiardi.pptx

Influence of Table of Specification on the Construction of Ordinary Level Phy...
Influence of Table of Specification on the Construction of Ordinary Level Phy...Influence of Table of Specification on the Construction of Ordinary Level Phy...
Influence of Table of Specification on the Construction of Ordinary Level Phy...ijtsrd
 
Basic Testing Terminology
Basic Testing TerminologyBasic Testing Terminology
Basic Testing TerminologyYee Bee Choo
 
Norm-referenced & Criterion-referenced Tests
Norm-referenced & Criterion-referenced TestsNorm-referenced & Criterion-referenced Tests
Norm-referenced & Criterion-referenced TestsFariba Chamani
 
evaluator-report-Part-B-pg-engg-v0.pdf
evaluator-report-Part-B-pg-engg-v0.pdfevaluator-report-Part-B-pg-engg-v0.pdf
evaluator-report-Part-B-pg-engg-v0.pdfAnbuselvi Mathivanan
 
MCCVLC webinar - Online Program Review
MCCVLC webinar - Online Program ReviewMCCVLC webinar - Online Program Review
MCCVLC webinar - Online Program ReviewBarry Dahl
 
Evaluating professional development opportunities for Teaching Assistants wit...
Evaluating professional development opportunities for Teaching Assistants wit...Evaluating professional development opportunities for Teaching Assistants wit...
Evaluating professional development opportunities for Teaching Assistants wit...Simon Haslett
 
Evaluation & assessment
Evaluation & assessmentEvaluation & assessment
Evaluation & assessmentNeil McMahon
 
CHANGES Poster for ASEE 2016
CHANGES Poster for ASEE 2016CHANGES Poster for ASEE 2016
CHANGES Poster for ASEE 2016Bethany Smith
 
Enhanced Teacher Education Curriculum.pptx
Enhanced Teacher Education Curriculum.pptxEnhanced Teacher Education Curriculum.pptx
Enhanced Teacher Education Curriculum.pptxSTEVENREPE1
 
AC23 - carwyn hooper kate everett.pdf
AC23 - carwyn hooper kate everett.pdfAC23 - carwyn hooper kate everett.pdf
AC23 - carwyn hooper kate everett.pdfUKCGE
 
The effect of entry grades on academic performance of university accounting s...
The effect of entry grades on academic performance of university accounting s...The effect of entry grades on academic performance of university accounting s...
The effect of entry grades on academic performance of university accounting s...Alexander Decker
 
Thesis presentation on Computer-Assisted Language Testing in Iran
Thesis presentation on Computer-Assisted Language Testing in IranThesis presentation on Computer-Assisted Language Testing in Iran
Thesis presentation on Computer-Assisted Language Testing in IranSedighehHajizadeh
 
An automated continuous quality improvement framework for failing student out...
An automated continuous quality improvement framework for failing student out...An automated continuous quality improvement framework for failing student out...
An automated continuous quality improvement framework for failing student out...GodistheDoerofEveryt
 
IJSRED-V3I6P13
IJSRED-V3I6P13IJSRED-V3I6P13
IJSRED-V3I6P13IJSRED
 
Using lab exams to ensure programming practice in an introductory programming...
Using lab exams to ensure programming practice in an introductory programming...Using lab exams to ensure programming practice in an introductory programming...
Using lab exams to ensure programming practice in an introductory programming...Luis Estevens
 

Similar to TOEFL IBT vz CEFR - Panca Eka Septiardi.pptx (20)

Influence of Table of Specification on the Construction of Ordinary Level Phy...
Influence of Table of Specification on the Construction of Ordinary Level Phy...Influence of Table of Specification on the Construction of Ordinary Level Phy...
Influence of Table of Specification on the Construction of Ordinary Level Phy...
 
Basic Testing Terminology
Basic Testing TerminologyBasic Testing Terminology
Basic Testing Terminology
 
Norm-referenced & Criterion-referenced Tests
Norm-referenced & Criterion-referenced TestsNorm-referenced & Criterion-referenced Tests
Norm-referenced & Criterion-referenced Tests
 
evaluator-report-Part-B-pg-engg-v0.pdf
evaluator-report-Part-B-pg-engg-v0.pdfevaluator-report-Part-B-pg-engg-v0.pdf
evaluator-report-Part-B-pg-engg-v0.pdf
 
MCCVLC webinar - Online Program Review
MCCVLC webinar - Online Program ReviewMCCVLC webinar - Online Program Review
MCCVLC webinar - Online Program Review
 
Evaluating professional development opportunities for Teaching Assistants wit...
Evaluating professional development opportunities for Teaching Assistants wit...Evaluating professional development opportunities for Teaching Assistants wit...
Evaluating professional development opportunities for Teaching Assistants wit...
 
Evaluation & assessment
Evaluation & assessmentEvaluation & assessment
Evaluation & assessment
 
CHANGES Poster for ASEE 2016
CHANGES Poster for ASEE 2016CHANGES Poster for ASEE 2016
CHANGES Poster for ASEE 2016
 
Enhanced Teacher Education Curriculum.pptx
Enhanced Teacher Education Curriculum.pptxEnhanced Teacher Education Curriculum.pptx
Enhanced Teacher Education Curriculum.pptx
 
AC23 - carwyn hooper kate everett.pdf
AC23 - carwyn hooper kate everett.pdfAC23 - carwyn hooper kate everett.pdf
AC23 - carwyn hooper kate everett.pdf
 
Third-Year Reviews 2013
Third-Year Reviews 2013Third-Year Reviews 2013
Third-Year Reviews 2013
 
The effect of entry grades on academic performance of university accounting s...
The effect of entry grades on academic performance of university accounting s...The effect of entry grades on academic performance of university accounting s...
The effect of entry grades on academic performance of university accounting s...
 
Nrt and crt
Nrt and crtNrt and crt
Nrt and crt
 
IB TESTA Report3
IB TESTA Report3IB TESTA Report3
IB TESTA Report3
 
Caehandbook
CaehandbookCaehandbook
Caehandbook
 
Thesis presentation on Computer-Assisted Language Testing in Iran
Thesis presentation on Computer-Assisted Language Testing in IranThesis presentation on Computer-Assisted Language Testing in Iran
Thesis presentation on Computer-Assisted Language Testing in Iran
 
An automated continuous quality improvement framework for failing student out...
An automated continuous quality improvement framework for failing student out...An automated continuous quality improvement framework for failing student out...
An automated continuous quality improvement framework for failing student out...
 
IJSRED-V3I6P13
IJSRED-V3I6P13IJSRED-V3I6P13
IJSRED-V3I6P13
 
Using lab exams to ensure programming practice in an introductory programming...
Using lab exams to ensure programming practice in an introductory programming...Using lab exams to ensure programming practice in an introductory programming...
Using lab exams to ensure programming practice in an introductory programming...
 
Integrating Generic Competences in an Engineering Degree Curriculum: the Stud...
Integrating Generic Competences in an Engineering Degree Curriculum: the Stud...Integrating Generic Competences in an Engineering Degree Curriculum: the Stud...
Integrating Generic Competences in an Engineering Degree Curriculum: the Stud...
 

Recently uploaded

Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon AUnboundStockton
 
Meghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentMeghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentInMediaRes1
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTiammrhaywood
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxNirmalaLoungPoorunde1
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceSamikshaHamane
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 
EPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptxEPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptxRaymartEstabillo3
 
Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...jaredbarbolino94
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPCeline George
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxiammrhaywood
 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaVirag Sontakke
 
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfFraming an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfUjwalaBharambe
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxthorishapillay1
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Celine George
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementmkooblal
 
AmericanHighSchoolsprezentacijaoskolama.
AmericanHighSchoolsprezentacijaoskolama.AmericanHighSchoolsprezentacijaoskolama.
AmericanHighSchoolsprezentacijaoskolama.arsicmarija21
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
 

Recently uploaded (20)

Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon A
 
Meghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentMeghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media Component
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptx
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in Pharmacovigilance
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 
EPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptxEPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptx
 
ESSENTIAL of (CS/IT/IS) class 06 (database)
ESSENTIAL of (CS/IT/IS) class 06 (database)ESSENTIAL of (CS/IT/IS) class 06 (database)
ESSENTIAL of (CS/IT/IS) class 06 (database)
 
Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERP
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of India
 
9953330565 Low Rate Call Girls In Rohini Delhi NCR
9953330565 Low Rate Call Girls In Rohini  Delhi NCR9953330565 Low Rate Call Girls In Rohini  Delhi NCR
9953330565 Low Rate Call Girls In Rohini Delhi NCR
 
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfFraming an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of management
 
AmericanHighSchoolsprezentacijaoskolama.
AmericanHighSchoolsprezentacijaoskolama.AmericanHighSchoolsprezentacijaoskolama.
AmericanHighSchoolsprezentacijaoskolama.
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
 

TOEFL IBT vz CEFR - Panca Eka Septiardi.pptx

  • 1. The Association Between TOEFL iBT® Test Scores and the Common European Framework of Reference (CEFR) Levels Spiros Papageorgiou Richard J. Tannenbaum Brent Bridgeman Yeonsuk Cho
  • 2. Table of Contents Research Objectives Contains rationale for the revision of CEFR cut score & claims 01 Theoretical Framework Covers a brief overview of the CEFR and the process of mapping test scores to its levels 02 Research Design How the researcher conduct the study 03 Findings Presents the evidence supporting the claims 04
  • 4. The research memorandum presents the rationale for the revision of the CEFR cut scores and offer validity evidence supporting claims related to the cut scores
  • 5. Claims related to the interferences Claim 1 (reasonableness of the cut scores) The revised CEFR cut scores are reasonable for making decisions about admission into higher education. Claim 2 (impact of the cut scores) The revised CEFR cut scores do not negatively impact admissions decisions due to classification errors.
  • 7. Brief overview of the CEFR & Process of Mapping Test Scores to Its Levels Mapping Test Scores to the CEFR Mapping TOEFL iBT Test Scores to the CEFR Alignment of the Content of the TOEFL iBT Test to the CEFR Levels
  • 8. Research Design Argument-based approach (Kane, 2006, 2013) through the use of external, non-assessment criteria (Kane, 2001)
  • 10. Investigating the Reasonableness of the Revised Cut Scores ● Investigation of university admission requirements for TOEFL iBT test scores in English speaking countries ● Review on admission web-pages of 155 top ranked universities (based on the 2014 – 2015 Times Higher Education World University Rankings) ● CEFR B2 level descriptors are relevant as language objectives for further & higher education ● Comparing the revised cut score range mapped to the B2 level to the recommended cut scores ● The revised TOEFL iBT test score range for B2 seems to better capture the current practice in university entry requirements among the surveyed institutions  revised CEFR cut scores are reasonable
  • 11. ● Investigating the impact by utilizing data from two previous studies ○ Cho & Bridgeman (2012) - 2,594 international students’ TOEFL iBT test scores & cumulative GPA ○ Bridgeman et al. (in press) – TOEFL iBT test scores & overall GPA from first 3 terms of 787 undergraduate international students ● The studies show that TOEFL iBT test scores have a meaningful relationship with academic performance as indicated by the GPA. ● Using the revised score range for CEFR Level B2 will not likely result in admitting university students who do not have sufficient English- language skills to cope with instructional demands in the English language. Investigating the Impact of the Revised Cut Scores
  • 12. Conclusion Education professionals and researchers advocate adaptation of the CEFR to meet local needs because the CEFR is a dynamic, rather than fixed, framework. Consequently, it is appropriate to periodically review and reconsider the relationship between test scores and the CEFR in light of changes in decision makers’ needs and changing assessment contexts, as we demonstrate in this research memorandum because “cut scores are constructed, not found” (Zieky, 2001, p. 45).
  • 13. CREDITS: This presentation template was created by Slidesgo, including icons by Flaticon, infographics & images by Freepik and illustrations by Stories Thanks! Does anyone have any questions? addyouremail@freepik.com +91 620 421 838 yourcompany.com Please keep this slide for attribution