A Study of Task Type for L2 Speaking Assessment Instructor: Dr. Lee Chin-Lin Presenter: Elly, Irene and Polly Date: 2008/0...
Resource <ul><li>Teng, Huei-Chun. (2007). A study of task types for    L2 speaking assessment. 2007 Conference    of the I...
Contents Introduction 1 Literature Review 2 Method 3 Data Analysis  4 Result 5 Discussion 6 Conclusion 7
Introduction Background and Motivation 1 Statement of the Problems 2 Purposes of the Study 3
Background <ul><li>Developing  speaking proficiency  rates high among the objectives of most L2 programs w ith the prevale...
Background <ul><li>The earlier tests of oral proficiency can be termed ‘precommunicative’ since the speaking tasks were un...
Background <ul><li>Direct tests  of speaking proficiency have been developed by involving a test setting in which the exam...
Background <ul><li>Semi-direct oral tests  were developed to ensure reliability and validity without compromising the comm...
Statement of the Problems <ul><li>For the past decades, a great deal of attention has been devoted to  the development of ...
Statement of the Problems <ul><li>Many problems remain to be examined, such as the subjectivity of the rating process, the...
Purposes of the Study <ul><li>The purpose of the present study is to investigate  the effect of task type  on the  perform...
Research Questions <ul><li>Will test takers perform differently on  various task types  of EFL speaking test?  </li></ul><...
Literature Review <ul><li>The effects on task difficulty of performance conditions associated with the code complexity of ...
Literature Review <ul><li>Foster & Skehan (1996) investigated the effects of planning time and three different tasks (pers...
Literature Review <ul><li>Skehan & Foster (1999) also explored the effects of inherent task structure and processing load ...
Method Subjects 1 Instrumentation 2 Procedures 3
Subjects Subjects 30 AFL students in Taiwan At level of  High-intermediate  (approximately)
Instrumentation <ul><li>An EFL speaking test </li></ul>1 answering questions 2 picture descriptions 3 presentation
Instrumentation <ul><li>An affective questionnaire  (mainly based on Scott’s work in 1986) </li></ul>1 4  parts ;  35  que...
Task 1 answering questions 3 questions recorded in the tape 30 seconds to answer each question answering  questions
T ask 2 picture descriptions picture  descriptions 1 picture 3 guided written questions in Chinese 30 seconds to read 90 s...
Task 3 presentation presentation 1 printed statement  90 seconds to prepare what to say  90 seconds to make a presentation
Procedures Procedures   2 Procedures   3 Procedures   4 Procedures 1 30 subjects were well informed about the research.   ...
Data Analysis
Data Analysis <ul><li>The recorded speech samples were transcribed and coded to measure the accuracy, complexity, and flue...
Data Analysis <ul><li>Complexity was indexed by dividing the number of clauses by the number of c-units  (communication un...
Results
Results
Results <ul><li>make pairwise comparisons of group means  </li></ul><ul><li>As for the performance of  complexity :  answe...
Results
Subjects’ Perceptions of the Speaking Test 2.56 2.41 2.29 I think I did well on the task.  3.5 3.06 2.71 I think the task ...
Results <ul><li>Subjects’ Perceptions of the Whole Test </li></ul>0.77 3.75 30 I think the oral test should include more t...
Discussion <ul><li>Q1 :  Will test takers perform differently on various task types of EFL speaking tests? </li></ul><ul><...
Discussion <ul><li>However, significant main effects were found for task type on the two analytic measures, i.e.,  complex...
Discussion <ul><li>Q2 :  Are there any differences in the  accuracy,  </li></ul><ul><li>complexity, and fluency  of test t...
Discussion <ul><li>According to Skehan & Foster (1999),  complexity  of language was influenced by  processing load .  </l...
Discussion <ul><li>Besides, the current study found that  subject got higher scores in  fluency  when they took the task o...
Discussion <ul><li>Q3 :  What are  test takers’ perceptions  toward    the three speaking tasks?  </li></ul><ul><li>Result...
Discussion <ul><li>For test takers,  answering questions appeared to be a kind of  semi-interview , and they might feel li...
Conclusion <ul><li>The present research proposes that Taiwanese college students performed better in the EFL speaking task...
Conclusion <ul><li>By providing empirical evidences and descriptions of speaking assessment tasks,  the study can contribu...
Thank You !
Upcoming SlideShare
Loading in …5
×

20080603 Assessment Final

833 views

Published on

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
833
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

20080603 Assessment Final

  1. 1. A Study of Task Type for L2 Speaking Assessment Instructor: Dr. Lee Chin-Lin Presenter: Elly, Irene and Polly Date: 2008/06/03
  2. 2. Resource <ul><li>Teng, Huei-Chun. (2007). A study of task types for L2 speaking assessment. 2007 Conference of the International Society for Language Studies (ISLS), Hawaii. (ERIC Clearinghouse on Languages and Linguistics, ED496075 ) . </li></ul>
  3. 3. Contents Introduction 1 Literature Review 2 Method 3 Data Analysis 4 Result 5 Discussion 6 Conclusion 7
  4. 4. Introduction Background and Motivation 1 Statement of the Problems 2 Purposes of the Study 3
  5. 5. Background <ul><li>Developing speaking proficiency rates high among the objectives of most L2 programs w ith the prevalence of Communicative Language Teaching (CLT) . </li></ul>
  6. 6. Background <ul><li>The earlier tests of oral proficiency can be termed ‘precommunicative’ since the speaking tasks were unauthentic and mechanical drills. </li></ul><ul><li>Shohamy, Reves, and Bejerano (1986) </li></ul>
  7. 7. Background <ul><li>Direct tests of speaking proficiency have been developed by involving a test setting in which the examinee and one or more human interlocutors engage in communicative oral interactions. </li></ul><ul><li>(Clark, 1975) </li></ul>
  8. 8. Background <ul><li>Semi-direct oral tests were developed to ensure reliability and validity without compromising the communicative features of oral tests. In these tests, test-takers respond to authentic recorded and visual tasks which require the production of discursive reactions. </li></ul>
  9. 9. Statement of the Problems <ul><li>For the past decades, a great deal of attention has been devoted to the development of tests of oral language proficiency for use with foreign language learners. However, the field has been largely neglected. </li></ul><ul><li>(Cohen, 1980) </li></ul>
  10. 10. Statement of the Problems <ul><li>Many problems remain to be examined, such as the subjectivity of the rating process, the non-interval nature of the scales adopted for rating, the absence of high demonstrated validity across a variety of instruments and language abilities, and a paucity of testing methods beyond the oral interview. </li></ul><ul><li>(Henning, 1987) </li></ul>
  11. 11. Purposes of the Study <ul><li>The purpose of the present study is to investigate the effect of task type on the performance of EFL speaking test for Taiwanese college students. </li></ul>
  12. 12. Research Questions <ul><li>Will test takers perform differently on various task types of EFL speaking test? </li></ul><ul><li>Are there any differences in the accuracy , complexity , and fluency of test takers’ discourse in terms of different task types ? </li></ul><ul><li>What are test takers’ perceptions toward the three speaking tasks? </li></ul>
  13. 13. Literature Review <ul><li>The effects on task difficulty of performance conditions associated with the code complexity of written input in the read-aloud tasks of a semi-direct speaking test. </li></ul><ul><li>(Wu, R., 2002) </li></ul>
  14. 14. Literature Review <ul><li>Foster & Skehan (1996) investigated the effects of planning time and three different tasks (personal information exchange, narrative, and decision-making) on the variables of fluency, complexity, and accuracy. </li></ul><ul><li>Interactions were found between task types and planning conditions, such that planning had more influence on narrative and decision-making tasks than on personal information exchange task. </li></ul>
  15. 15. Literature Review <ul><li>Skehan & Foster (1999) also explored the effects of inherent task structure and processing load on the performance on a narrative retelling task. </li></ul><ul><li>They suggested that more structured tasks generated more fluent language, and complexity of language was influenced by processing load. </li></ul>
  16. 16. Method Subjects 1 Instrumentation 2 Procedures 3
  17. 17. Subjects Subjects 30 AFL students in Taiwan At level of High-intermediate (approximately)
  18. 18. Instrumentation <ul><li>An EFL speaking test </li></ul>1 answering questions 2 picture descriptions 3 presentation
  19. 19. Instrumentation <ul><li>An affective questionnaire (mainly based on Scott’s work in 1986) </li></ul>1 4 parts ; 35 questions 2 It is to elicit the test takers’ affective reaction toward speaking test and the three tasks.
  20. 20. Task 1 answering questions 3 questions recorded in the tape 30 seconds to answer each question answering questions
  21. 21. T ask 2 picture descriptions picture descriptions 1 picture 3 guided written questions in Chinese 30 seconds to read 90 seconds to describe the picture
  22. 22. Task 3 presentation presentation 1 printed statement 90 seconds to prepare what to say 90 seconds to make a presentation
  23. 23. Procedures Procedures 2 Procedures 3 Procedures 4 Procedures 1 30 subjects were well informed about the research. 30 subjects were randomly grouped into 3 groups and had their speaking test in different order. Then they answered affective questionnaire. It took 10 minutes for them to finish speaking test.
  24. 24. Data Analysis
  25. 25. Data Analysis <ul><li>The recorded speech samples were transcribed and coded to measure the accuracy, complexity, and fluency of subjects’ performance. </li></ul><ul><li>Accuracy was measured by calculating the </li></ul><ul><li>number of error-free clauses as a percentage of the total number of clauses (Skehan & Foster,1999). </li></ul>
  26. 26. Data Analysis <ul><li>Complexity was indexed by dividing the number of clauses by the number of c-units (communication units). According to Foster & Tonkyn (1997), c-unit is defined as a simple clause, or an independent subclausal unit, together with the subordinated clauses associated with them. </li></ul><ul><li>Fluency was measured by dividing the number of syllables in a given speech sample by the time taken to produced them (measured in seconds) and multiplying the result by 60 (Mehnert, 1998). </li></ul>
  27. 27. Results
  28. 28. Results
  29. 29. Results <ul><li>make pairwise comparisons of group means </li></ul><ul><li>As for the performance of complexity : answering question > picture description (p = 0.028) </li></ul><ul><li>As for the performance on fluency : answering questions > picture description (p = 0.000) answering questions > presentation (p = 0.008). </li></ul>
  30. 30. Results
  31. 31. Subjects’ Perceptions of the Speaking Test 2.56 2.41 2.29 I think I did well on the task. 3.5 3.06 2.71 I think the task is too difficult. 3.38 3.18 3.53 I think the task corresponds to what I learn in class. 3.38 3.65 3.29 I understand what I was supposed to do during the task. 2.88 3.53 3.06 I prefer the task to others. 2.75 2.94 2.76 I think the task was too short. 3.62 3.53 3.12 I think I had an adequate opportunity to demonstrate my ability to speak English with the task. 4.00 4.06 3.82 I think the task should be included in the speaking test. 3.93 3.76 3.88 I feel nervous during the task. 3.88 3.71 4.00 I feel nervous before the task. 3.81 3.65 3.82 I think this task can assess my speaking ability accurately. Presentation Picture Description Answering Questions Task Statement
  32. 32. Results <ul><li>Subjects’ Perceptions of the Whole Test </li></ul>0.77 3.75 30 I think the oral test should include more tasks. 1.29 2.94 30 I feel more comfortable when I take an oral test by talking to a real person. 0.96 2.56 30 I would like my English teacher to be present during the test. 1.05 2.19 30 If I take the same test on another day, the result will be the same. 1.06 2.94 30 I would rather take a written test than an oral test. SD Mean N Statement
  33. 33. Discussion <ul><li>Q1 : Will test takers perform differently on various task types of EFL speaking tests? </li></ul><ul><li>In this research, results indicated that there was no significant difference in the subjects’ holistic rating scores for the three task types , including answering questions, picture description, and presentation. </li></ul>
  34. 34. Discussion <ul><li>However, significant main effects were found for task type on the two analytic measures, i.e., complexity and fluency . </li></ul><ul><li>The findings may be explained by the difference in scoring methods . </li></ul>
  35. 35. Discussion <ul><li>Q2 : Are there any differences in the accuracy, </li></ul><ul><li>complexity, and fluency of test takers’ </li></ul><ul><li>discourse in terms of different task types? </li></ul><ul><li>Results of this study showed that there were significant differences in the complexity and fluency of test takers’ discourse in terms of different task types. </li></ul>
  36. 36. Discussion <ul><li>According to Skehan & Foster (1999), complexity of language was influenced by processing load . </li></ul><ul><li>In the current study, there seemed to be more processing load for answering questions since test takers were expected to provide answers directly related to the questions. </li></ul>
  37. 37. Discussion <ul><li>Besides, the current study found that subject got higher scores in fluency when they took the task of answering questions than the scores for the other two tasks. </li></ul><ul><li>One possibility is that answering questions seems to be the most common task of EFL speaking tests and activities for college students in Taiwan among the three task types. </li></ul>
  38. 38. Discussion <ul><li>Q3 : What are test takers’ perceptions toward the three speaking tasks? </li></ul><ul><li>Results of the affective questionnaire demonstrated that subjects averagely felt more nervous before the task of answering questions. </li></ul>
  39. 39. Discussion <ul><li>For test takers, answering questions appeared to be a kind of semi-interview , and they might feel like communicating with real people. </li></ul><ul><li>Subjects’ perceptions of tasks also revealed that they preferred the task of picture description to others and that they thought the task should be included in all speaking tests. </li></ul>
  40. 40. Conclusion <ul><li>The present research proposes that Taiwanese college students performed better in the EFL speaking task of answering questions by exhibiting more fluency and complexity . </li></ul>
  41. 41. Conclusion <ul><li>By providing empirical evidences and descriptions of speaking assessment tasks, the study can contribute to our understanding of L2 speech performance, and further to offer implications for designing EFL speaking tests. </li></ul>
  42. 42. Thank You !

×