Testing: Back to Basics.



                    Abdellatif Zoubair
             zoubair2@hotmail.com



          June 09
Outline
1.   Definition
2.   Main principles
3.   Test types
4.   Test design procedure
5.   Use of statistics
6.   Technolgy and testing
7.   Bibliography


                     June 09
I. Definition:


« a . . . . . . of measuring a person’s

ability, . . . . . . . . . . or . . . . . . . . . . .

in a given . . . . . . . . «


                            June 09
« a method of measuring a person’s ability,

knowledge or performance in a given

domain. »

               D. Brown, 2004.
                    June 09
Terminolgy

-Performance vs knowledge

-Quiz vs test

-Testing vs assessment

-Assessment vs evaluation
                   June 09
II. Main principles

1. Usefulness

2. Practicality

3. Validity

4. Reliability

5. Authenticity




                          June 09
Main principles (cont’d)


6. Transparency

7. Washback

8. Security

9. Fairness

10. . . .

                      June 09
III. Taxonomies
 a. Henning (1987):
1. Diagnosis and feedback
2. Screening and selection
3. Placement
4. Program evaluation
5. Providing research criteria
6. Assessment of attitudes and socio-
   psychological differences

                      June 09
b. Alderson, Clapham and Wall (1995):

  1.   placement
  2.   progress
  3.   achievement
  4.   proficiency
  5.   diagnostic
                June 09
c. objective vs. subjective tests

d. high- vs. low-stakes tests

e. formative vs summative

-.....


                      June 09
h. Traditional vs. Alternative
        Assessment.




 Refer to comparative chart




             June 09
Types:

-self-assessment
-portfolios
-student-designed tests
-projects
-presentations
-....


          June 09
IV. Test design procedure:

a. planning:

 -decide on purpose

 -check course content

 -write specifications
                June 09
b. development:

  -format

  -grading

  -piloting
                  June 09
c. administration:

  -test conditions and procedures

  -organize equipment needed



                     June 09
d. post-test
    -grading
    -statistics
    -item analysis
    -reporting



                 June 09
e. reflection:

   -purpose

   -validity and reliability

   -future changes
                   June 09
V. Statistics:

a. what
b. rationale:
   -information on students' performance
   -test reliability
   -course content
   -teaching


                 June 09
c. how:
   -the mean
   -the pass/failure rate
   -histograms
   - .....



                   June 09
VI. Technology and testing
a. history:

   -1935: IBM model 805

   -1970: Book on computerized testing
          (Holtzman)

   -...?

                    June 09
b. main uses:
    -CMT/CAT
    -CBT
    -CAT
    -Web/internet-based testing



                 June 09
VII. Bibliography:
-Alderson, J. Charles, Caroline Clapham and Dianne Wall. 1995. Test
 Construction and Evaluation. Cambridge, U.K.: Cambridge University
 Press.

-Bachman, Lyle F. 1990. Fundamental Considerations in Language Testing.
 Oxford, U.K.: Oxford University Press.

-Brown, H.D. 2004. Language Assessment: Principles and classroom
 practices. New York: Pearson Longman.

-Coombe, C., Folse, K., & Hubley, N. (2007). A Practical Guide to Assessing
 English Language Learners. Ann Arbor, MI.: University of Michigan Press.




                                  June 09
-Fulcher, G. Computers in Language Testing. In Brett, P. and G.
Motteram (Eds) 2000, A Special Interest in Computers. Manchester:
IATEFL Publications, 93 – 107.

-Fulcher, G. & Davidson, F. 2007. Language Testing and
Assessment: An Advanced Resource Book. Routledge Applied
Linguistics Series.

-Fulcher, G. 1995. The Language Tester's Guide to Cyberspace.
Language Testing Update July 1995, 17, 62 - 65.
 Last updated: 9th June 2008.
Also available at:
http://www.le.ac.uk/education/testing/ltrfile/cybertxt.html#top




                               June 09
-Fulcher, G. Resources in Language Testing (website)
 (http://www.dundee.ac.uk/languagestudies/ltest/ltr.html)

-Heaton, J. B. 1988. Writing English Language Tests.
  Harlow, England:Longman Press.

-Hughes, Arthur. 2003. Testing for Language Teachers (2nd Edition).
  Cambridge, U.K.: Cambridge University Press.




                               June 09
Thank you for your patience!



         June 09

Testing backto basics

  • 1.
    Testing: Back toBasics. Abdellatif Zoubair zoubair2@hotmail.com June 09
  • 2.
    Outline 1. Definition 2. Main principles 3. Test types 4. Test design procedure 5. Use of statistics 6. Technolgy and testing 7. Bibliography June 09
  • 3.
    I. Definition: « a. . . . . . of measuring a person’s ability, . . . . . . . . . . or . . . . . . . . . . . in a given . . . . . . . . « June 09
  • 4.
    « a methodof measuring a person’s ability, knowledge or performance in a given domain. » D. Brown, 2004. June 09
  • 5.
    Terminolgy -Performance vs knowledge -Quizvs test -Testing vs assessment -Assessment vs evaluation June 09
  • 6.
    II. Main principles 1.Usefulness 2. Practicality 3. Validity 4. Reliability 5. Authenticity June 09
  • 7.
    Main principles (cont’d) 6.Transparency 7. Washback 8. Security 9. Fairness 10. . . . June 09
  • 8.
    III. Taxonomies a.Henning (1987): 1. Diagnosis and feedback 2. Screening and selection 3. Placement 4. Program evaluation 5. Providing research criteria 6. Assessment of attitudes and socio- psychological differences June 09
  • 9.
    b. Alderson, Claphamand Wall (1995): 1. placement 2. progress 3. achievement 4. proficiency 5. diagnostic June 09
  • 10.
    c. objective vs.subjective tests d. high- vs. low-stakes tests e. formative vs summative -..... June 09
  • 11.
    h. Traditional vs.Alternative Assessment. Refer to comparative chart June 09
  • 12.
  • 13.
    IV. Test designprocedure: a. planning: -decide on purpose -check course content -write specifications June 09
  • 14.
    b. development: -format -grading -piloting June 09
  • 15.
    c. administration: -test conditions and procedures -organize equipment needed June 09
  • 16.
    d. post-test -grading -statistics -item analysis -reporting June 09
  • 17.
    e. reflection: -purpose -validity and reliability -future changes June 09
  • 18.
    V. Statistics: a. what b.rationale: -information on students' performance -test reliability -course content -teaching June 09
  • 19.
    c. how: -the mean -the pass/failure rate -histograms - ..... June 09
  • 20.
    VI. Technology andtesting a. history: -1935: IBM model 805 -1970: Book on computerized testing (Holtzman) -...? June 09
  • 21.
    b. main uses: -CMT/CAT -CBT -CAT -Web/internet-based testing June 09
  • 22.
    VII. Bibliography: -Alderson, J.Charles, Caroline Clapham and Dianne Wall. 1995. Test Construction and Evaluation. Cambridge, U.K.: Cambridge University Press. -Bachman, Lyle F. 1990. Fundamental Considerations in Language Testing. Oxford, U.K.: Oxford University Press. -Brown, H.D. 2004. Language Assessment: Principles and classroom practices. New York: Pearson Longman. -Coombe, C., Folse, K., & Hubley, N. (2007). A Practical Guide to Assessing English Language Learners. Ann Arbor, MI.: University of Michigan Press. June 09
  • 23.
    -Fulcher, G. Computersin Language Testing. In Brett, P. and G. Motteram (Eds) 2000, A Special Interest in Computers. Manchester: IATEFL Publications, 93 – 107. -Fulcher, G. & Davidson, F. 2007. Language Testing and Assessment: An Advanced Resource Book. Routledge Applied Linguistics Series. -Fulcher, G. 1995. The Language Tester's Guide to Cyberspace. Language Testing Update July 1995, 17, 62 - 65. Last updated: 9th June 2008. Also available at: http://www.le.ac.uk/education/testing/ltrfile/cybertxt.html#top June 09
  • 24.
    -Fulcher, G. Resourcesin Language Testing (website) (http://www.dundee.ac.uk/languagestudies/ltest/ltr.html) -Heaton, J. B. 1988. Writing English Language Tests. Harlow, England:Longman Press. -Hughes, Arthur. 2003. Testing for Language Teachers (2nd Edition). Cambridge, U.K.: Cambridge University Press. June 09
  • 25.
    Thank you foryour patience! June 09