The TOEFL iBT vs. PBT: Which is harder?
Upcoming SlideShare
Loading in...5
×

Like this? Share it with your network

Share

The TOEFL iBT vs. PBT: Which is harder?

  • 2,397 views
Uploaded on

Poster presentation of a quantitative study comparing the TOEFL iBT to the PBT presented at the doctoral forum of TESOL 2011 in New Orleans, Louisiana and the Graduate Research Forum of UCF in......

Poster presentation of a quantitative study comparing the TOEFL iBT to the PBT presented at the doctoral forum of TESOL 2011 in New Orleans, Louisiana and the Graduate Research Forum of UCF in Orlando, Florida

More in: Education , Business
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
2,397
On Slideshare
2,389
From Embeds
8
Number of Embeds
1

Actions

Shares
Downloads
17
Comments
0
Likes
0

Embeds 8

https://twitter.com 8

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Presenter BiosFirst-year TESOL Doctoral students atthe University of Central Florida.Alison Youngblood has taught ESP,EAP, and K-12 in Japan and South Korea
  • 2. Theoretical FrameworkThe iBT speaking section is met with unfavorable attitudes by test- takers from across the globe (Stricker&Atali, 2010)Researchers also observed this negative attitude while teaching in an EAP
  • 3. Our SampleBased on ETS’s 2009 Score ReportLooked at the average composite score and average section score on the iBT and PBT listed by countrySample included scores from countries where both iBT and PBT were reported by ETS
  • 4. MethodologyResearchers believe it is logical to assume that composite scores include individual test takers’ multiple attemptsStatistical procedures used:1. Dependent t-test 2. Repeated measures
  • 5. Research Question 1Is there a significant difference in the mean composite scores for iBT and PBT?
  • 6. ResultsThe test was statistically significant t(143)=-2.65, p<.05. There is a significant difference in mean composite iBT scores (M=551.79, sd=25.87) and mean composite PBT scores (M=545.67, sd=38.05). The 95% confidence interval for the mean
  • 7. DiscussionOur results indicate that students on average actually score higher on the iBTThis challenges student perceptions that the iBT is ‘harder’However, the converted mean composite of 551.79 on the iBT is
  • 8. Even though the test showed significance, our effect size was calculated by eta squared and found to be .046. This means only 5% of the variance in composite scores can be attributed to test versionDifficult to make exact comparisons based on composite scores because of differences in
  • 9. Research Question 2Do students score significantly lower on the speaking section of the iBT in comparison to the other three sections?
  • 10. ResultsThere is a statistically significant difference in section score ( p<.05) on the iBT sections (F3, 429=95.21). 40% of the variance in score can be accounted for by section.
  • 11. DiscussionThe speaking section had the highest mean composite score (m=21, sd=1.99).The reading section had the lowest mean composite score(m=18.80, sd= 3.28)The is the opposite of student
  • 12. LimitationsSmall sample sizeUse of mean composite scores instead of individual scoresUnable to determine the number of individuals who took the test multiple times versus the individuals who only attempted
  • 13. Further ResearchStudies exist that compare the CBT and PBT, but unable to find studies that compare the PBT to iBTDirect research comparing the iBT to PBT could be helpfulObtain individual scores
  • 14. References Educational Testing Service (2010). Test and score data summary for TOEFL internet-based and paper- based tests. January 2009-December 2009 Test Data. Retrieved from http://www.ets.org/Media/Research/pdf/71943_web.p df Educational Testing Service (2005). Score Comparison Tables.TOEFL Internet-based Test. Retrieved from http://www.ets.org/Media/Tests/TOEFL/pdf/TOEFL_i BT_Score_Comparison_Tables.pdf Stricker, L.J., &Attali, Y. (2010). Test taker’s attitudes