Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.



Published on

Universidad Técnica Particular de Loja
Carrera: Inglés
Docente: Mgs. Vanesa Toro
Ciclo: Sexto
Bimestre: Segundo

Published in: Education, Business, Technology


  1. 1. LANGUAGE TESTING ESCUELA : NOMBRES: Inglés Mgs. Vanessa Toro G. BIMESTRE : Segundo Octubre 2011-Febrero 2012
  2. 2. Unit 5 Validity: Testing the test According to McNamara (2008), “The purpose of validation in language testing is to ensure the defensibility and fairness of interpretations based on test performance.” According to Hughes (2008), “ A test is said to be valid if it measures accurately what it is intended to measure.”
  3. 3. Unit 5 Threats to test validity
  4. 4. Unit 5 Validity: Testing the test <ul><li> </li></ul><ul><li>Hughes (2008, p. 26) argues that a test has content validity if its content constitutes a representative of the language skills, structures, etc. For example, “we would not expect an achievement test for intermediate learners to contain just the same set of structures as one for advanced learners.” </li></ul>
  5. 5. Unit 5 Validity: Testing the test <ul><li> </li></ul><ul><li> Regarding test method , “it is the way in which the candidate is asked to engage with the materials and tasks in the test, and how these responses will be scored .” For example, fixed and constructed response formats and short answer questions. </li></ul>
  6. 6. Unit 5 Validity: Testing the test <ul><li> Test construct is “ what is being measured by the test; those aspects of the candidate’s underlying knowledge or skill which are the target of measurement in a test.” In addition, “it refers to those aspects of knowledge or skill possessed by the candidate which are being measured.” </li></ul>
  7. 7. Unit 5 Validity: Testing the test <ul><li>The impact of tests </li></ul><ul><li>Changes such as an assessment reform which changes the emphasis from formal tests to ongoing assessment of complex projects and assignments may have an impact on what is being measured by the test. </li></ul>
  8. 8. Unit 6 Measurement <ul><li> Measurement investigates the quality of the process of assessment by looking at scores. Two main steps are involved: </li></ul><ul><li>Quantification, the assigning of scores to various outcomes of assessment. </li></ul><ul><li>Checking for various kinds of mathematical and statistical patterning within the matrix to investigate the extend to which consistency of performance by candidates, or by judges are presented in the assessment. </li></ul>
  9. 9. Unit 6 Measurement Approaches to testing
  10. 10. Unit 6 Measurement <ul><li> </li></ul><ul><li> Norm-referenced tests: are designed to enable the test user to make “normative” interpretations of test results. That is, test results are interpreted with reference to the performance of a given group, or norm. “The norm group” is a large group of individuals who are similar to the individuals for whom the test is designed. </li></ul>
  11. 11. Unit 6 Measurement <ul><li> </li></ul><ul><li> In the development of norm-referenced tests the norm group is given the test, and then the characteristics, or norms, of this group’s performance are used as reference points for interpreting the performance of other students who take the test. </li></ul>
  12. 12. Unit 6 Measurement <ul><li> Criterion-referenced tests: are designed to enable the test user to interpret a test score with reference to a criterion level of ability or domain of content. For example, students are evaluated in terms of their relative degree of mastery of course content, rather than with respect to their relative ranking in the class. </li></ul>
  13. 13. Unit 6 Measurement <ul><li> </li></ul><ul><li> Item response theory: an approach to measurement which uses complex statistical modeling of test performance data to make powerful generalizations about item characteristics, the relation of items to candidate ability, and about the overall quality of tests. </li></ul>
  14. 14. Unit 7 The social character of language tests <ul><li>The institutional character of assessment </li></ul><ul><li>Assessment is done not by someone acting in a private capacity or motivated by personal curiosity, but in an institutional role, and serving institutional purposes. It involves the fulfillment of policy objectives in education and other areas of social policy. </li></ul>
  15. 15. Unit 7 The social character of language tests <ul><li>Assessment and educational policy </li></ul><ul><li> In international education, tests are used to control access to educational opportunities. Typically, international students need to meet a standard on a test of language for academic purposes before they are admitted to the university of their choice. </li></ul>
  16. 16. Unit 7 The social character of language tests <ul><li>The social responsibility of the language tester </li></ul><ul><li> Individuals who may apply for immigration are part of a selection process. The selection criteria include educational level, type of work expertise, age, and proficiency in English. </li></ul><ul><li> There is unfairness to individuals when they are not assessed by trained language evaluators. Therefore, it is necessary a carefully constructed test, more relevant in its content and reliable </li></ul><ul><li>in its decisions. </li></ul>
  17. 17. Unit 7 Ethical language testing <ul><li>Three main areas of concern can be distinguished here. </li></ul><ul><li> Accountability: minimally, accountability would required test developers to provide test-takers with complete information on what is expected of them in the test. </li></ul><ul><li> Washback: it is the effect of tests on teaching and learning. Performance assessments have better washback than multiple choice test formats. </li></ul>
  18. 18. Unit 7 Ethical language testing <ul><li> However, research both on the presume negative washback of conservative test formats and on the presume positive washback of communicative assessment has shown that washback is often rather than predictable. </li></ul><ul><li> In relation to this, some factors may affect washback such as conditions in the classroom, the immediate motivation of learner, etc. </li></ul>
  19. 19. Unit 7 Ethical language testing <ul><li> Test impact: tests can also have effects beyond the classroom. Test impact is the wider effect of tests on the community as a whole, including the school. </li></ul><ul><li> For example the TOEFL has effects beyond the classroom, in terms of educational policy and the allocation of resources to education. </li></ul>
  20. 20. Unit 7 Codes of professional ethics for language testers <ul><li> Professional bodies of language testers should formulate codes of practice which will guide language testers in their work. The emphasis is on good professional practice: that is language testers should in general take responsibility for the development of quality language tests. </li></ul>
  21. 21. Unit 7 Critical language testing <ul><li> From the perspective of critical language testing, the emphasis in ethical language testing on the individual responsibility of the language tester is misguided because it presupposed that this would operate within the established institution of testing, and so essentially accept the status quo and concede its legitimacy. </li></ul>
  22. 22. Unit 8 New directions – and dilemmas? <ul><li> Computers and language testing: many national and international language tests, including TOEFL, are moving to computer based testing (CBT) where stimulus texts and prompts are presented on the screen, and the candidates are required to key in their responses. It represents a change in test method not in test content. </li></ul>
  23. 23. Unit 8 New directions – and dilemmas? <ul><li> Computers and language testing: CBT require the prior creation of an item bank, a large group of items which have been thoroughly trialed, and whose likely difficulty for candidates at given levels of ability has been estimated as precisely as possible. </li></ul><ul><li> Automatically scoring and the fact that candidates can be given a score immediately are both examples of the advantages of CBT. </li></ul><ul><li> </li></ul>
  24. 24. Unit 8 New directions – and dilemmas? <ul><li>Technology and the testing of speaking </li></ul><ul><li>(Semi-direct tests of speaking) </li></ul><ul><li> Computers represent the most rapid point of technological change. </li></ul><ul><li> Tape recorders can be used in the administration of speaking tests. Candidates are presented with a prompt on tape, and are asked to respond as if they were talking to a person, the response being recorded on tape. </li></ul>
  25. 25. Unit 8 New directions – and dilemmas? <ul><li> The potential limitations of computerized language testing are serious enough to warrant the careful attention of those planning to use this medium. </li></ul><ul><li>High cost of computer hardware and software </li></ul><ul><li>Time required to acquaint examinees with the computer. </li></ul><ul><li>Inadvertently evaluating not only language but also computer expertise. </li></ul><ul><li>The potential of subjecting test candidates to debilitating levels of anxiety as a result of the need to manipulate the new technology. </li></ul>
  26. 26. References <ul><li>Brown, D. (2004). Language Assessment: Principles and Classroom Practices. White Plains, NY: Pearson Education, Inc. </li></ul><ul><li>Hughes, A. (2008) Testing for Language Teachers. United Kingdom: Cambridge University Press. </li></ul><ul><li>McNamara, T. (2008). Language Testing. , Oxford, NY: Oxford University Press. </li></ul>
  27. 28. <ul><li>PROGRAMA: Language Testing Carrera: Inglés </li></ul><ul><li>Fecha: 19 de enero de 2012 </li></ul><ul><li>Docente: Mgs. Vanessa Toro. </li></ul><ul><li>Hora Inicio: 19h15 Hora Final: 20h15 </li></ul>GUIÓN DE PRESENTACIÓN Puntos de la Presentación Intervienen Duración Aprox. en minutos Material de Apoyo - Presentación - Objetivos Mgs. Vanessa Toro <ul><li>2 minutos </li></ul><ul><li>3 minutos </li></ul>Sin material. Sin material. <ul><li>Desarrollo del contenido: </li></ul><ul><li>Capítulo I </li></ul><ul><li>Capítulo II </li></ul><ul><li>…………… . </li></ul>Mgs. Vanessa Toro Estudiantes Language testing <ul><li>35 minutos </li></ul>Diapositivas (cambios cada 5 seg.), videos, otro o ningún material. - Preguntas - Despedida (Contactos, Sugerencias) <ul><li>Desarrollo del contenido: </li></ul><ul><li>Capítulo I </li></ul><ul><li>Capítulo II </li></ul><ul><li>…………… . </li></ul>Mgs. Vanessa Toro Estudiantes Language testing [email_address] 07 2 570 275 ext. 2934 Miércoles: 15h30-17h30 Jueves: 08h30 – 10h30