June 09 Testing: Back to Basics. Abdellatif Zoubair Abdellatif [email protected].

June 09June 09

Testing: Back to Testing: Back to Basics.Basics.

Abdellatif Abdellatif ZoubairZoubair

[email protected] [email protected]

June 09June 09

OutlineOutline

1. Definition1. Definition

2. Main principles2. Main principles

3. Test types 3. Test types

4. Test design procedure4. Test design procedure

5. Use of statistics5. Use of statistics

6. Technolgy and testing 6. Technolgy and testing

7. Bibliography7. Bibliography

June 09June 09

I. Definition:I. Definition:

« a . . . . . . of measuring a person’s « a . . . . . . of measuring a person’s

ability, . . . . . . . . . . or . . . . . . . . . . . ability, . . . . . . . . . . or . . . . . . . . . . .

in a given . . . . . . . . « in a given . . . . . . . . «

June 09June 09

« a method of measuring a person’s « a method of measuring a person’s ability,ability,

knowledge or performance in a given knowledge or performance in a given

domain. »domain. »

D. Brown, 2004.D. Brown, 2004.

June 09June 09

TerminolgyTerminolgy

-Performance vs knowledge-Performance vs knowledge

-Quiz vs test-Quiz vs test

-Testing vs assessment-Testing vs assessment

-Assessment vs evaluation-Assessment vs evaluation

June 09June 09

II. Main principlesII. Main principles

1. Usefulness1. Usefulness

2. Practicality2. Practicality

3. Validity3. Validity

4. Reliability4. Reliability

5. Authenticity5. Authenticity

June 09June 09

Main principles (cont’d)Main principles (cont’d)

6. Transparency6. Transparency

7. Washback7. Washback

8. Security8. Security

9. Fairness9. Fairness

10. . . .10. . . .

June 09June 09

III. TaxonomiesIII. Taxonomies

a. Henning (1987):a. Henning (1987):

1.1. Diagnosis and feedbackDiagnosis and feedback

2.2. Screening and selectionScreening and selection

3.3. PlacementPlacement

4.4. Program evaluationProgram evaluation

5.5. Providing research criteriaProviding research criteria

6.6. Assessment of attitudes and socio- Assessment of attitudes and socio- psychological differencespsychological differences

June 09June 09

b. Alderson, Clapham and Wall b. Alderson, Clapham and Wall (1995):(1995):

1. placement1. placement

2. progress2. progress

3. achievement3. achievement

4. proficiency4. proficiency

5. diagnostic 5. diagnostic

June 09June 09

c. objective vs. subjective testsc. objective vs. subjective tests

d. high- vs. low-stakes tests d. high- vs. low-stakes tests

e. formative vs summative e. formative vs summative

- . . . . .- . . . . .

June 09June 09

h. Traditional vs. Alternative h. Traditional vs. Alternative Assessment.Assessment.

Refer to comparative chartRefer to comparative chart

June 09June 09

Types:Types:

-self-assessment-self-assessment

-portfolios-portfolios

-student-designed tests-student-designed tests

-projects-projects

-presentations-presentations

- . . . .- . . . .

June 09June 09

IV. Test design procedure:IV. Test design procedure:

a. planning:a. planning:

-decide on purpose-decide on purpose

-check course content-check course content

-write specifications-write specifications

June 09June 09

b. development:b. development:

-format-format

-grading-grading

-piloting-piloting

June 09June 09

c. administration: c. administration:

-test conditions and procedures-test conditions and procedures

-organize equipment needed-organize equipment needed

June 09June 09

d. post-testd. post-test

-grading-grading

-statistics-statistics

-item analysis-item analysis

-reporting-reporting

June 09June 09

e. reflection:e. reflection:

-purpose-purpose

-validity and reliability-validity and reliability

-future changes -future changes

June 09June 09

V. Statistics: V. Statistics:

a. whata. what

b. rationale:b. rationale:

-information on students' -information on students' performanceperformance

-test reliability-test reliability

-course content-course content

-teaching-teaching

June 09June 09

c. how:c. how:

-the mean-the mean

-the pass/failure rate-the pass/failure rate

-histograms-histograms

- . . . . .- . . . . .

June 09June 09

VI. Technology and testing VI. Technology and testing

a. history:a. history:

-1935: IBM model 805 -1935: IBM model 805

--19701970: Book on computerized testing: Book on computerized testing

((HoltzmanHoltzman))

- . . . ?- . . . ?

June 09June 09

b. main uses:b. main uses:

-CMT/CAT-CMT/CAT

-CBT -CBT

-CAT-CAT

--Web/internet-based testingWeb/internet-based testing

June 09June 09

VII. Bibliography:VII. Bibliography:

-Alderson, J. Charles, Caroline Clapham and Dianne Wall. 1995. -Alderson, J. Charles, Caroline Clapham and Dianne Wall. 1995. Test Test Construction and EvaluationConstruction and Evaluation. Cambridge, U.K.: Cambridge . Cambridge, U.K.: Cambridge University Press.University Press.

-Bachman, Lyle F. 1990. -Bachman, Lyle F. 1990. Fundamental Considerations in Language Fundamental Considerations in Language TestingTesting. Oxford, U.K.: Oxford University Press.. Oxford, U.K.: Oxford University Press.

-Brown, H.D. 2004. -Brown, H.D. 2004. Language Assessment: Principles and Language Assessment: Principles and classroom practices. classroom practices. New York: Pearson Longman.New York: Pearson Longman.

-Coombe, C., Folse, K., & Hubley, N. (2007).  -Coombe, C., Folse, K., & Hubley, N. (2007).  A Practical Guide to A Practical Guide to Assessing English Language Learners.Assessing English Language Learners. Ann Arbor, MI.: University of Ann Arbor, MI.: University of Michigan Press.Michigan Press.

June 09June 09

-Fulcher, G. Computers in Language Testing. In Brett, P. and -Fulcher, G. Computers in Language Testing. In Brett, P. and G. Motteram (Eds) 2000, A Special Interest in Computers. G. Motteram (Eds) 2000, A Special Interest in Computers. Manchester: IATEFL Publications, 93 – 107.Manchester: IATEFL Publications, 93 – 107.

-Fulcher, G. & Davidson, F. 2007. Language Testing and -Fulcher, G. & Davidson, F. 2007. Language Testing and Assessment: An Advanced Resource Book. Routledge Assessment: An Advanced Resource Book. Routledge Applied Linguistics Series.Applied Linguistics Series.

--Fulcher, G. 1995. The Language Tester's Guide to Fulcher, G. 1995. The Language Tester's Guide to Cyberspace. Cyberspace. Language Testing UpdateLanguage Testing Update July 1995, 17, 62 - July 1995, 17, 62 - 65.65. Last updated: Last updated: 9th June 2008.9th June 2008.Also available at: Also available at: http://www.le.ac.uk/education/testing/ltrfile/cybertxt.html#thttp://www.le.ac.uk/education/testing/ltrfile/cybertxt.html#topop

June 09June 09

-Fulcher, G. -Fulcher, G. Resources in Language TestingResources in Language Testing (website) ( (website) (http://www.dundee.ac.uk/languagestudies/ltest/ltr.htmlhttp://www.dundee.ac.uk/languagestudies/ltest/ltr.html))

-Heaton, J. B. 1988. -Heaton, J. B. 1988. Writing English Language TestsWriting English Language Tests. Harlow, . Harlow, England:Longman Press.England:Longman Press.

-Hughes, Arthur. 2003. -Hughes, Arthur. 2003. Testing for Language Teachers (2nd Testing for Language Teachers (2nd Edition)Edition). Cambridge, U.K.: Cambridge University Press.. Cambridge, U.K.: Cambridge University Press.

June 09June 09

Thank you for your Thank you for your patience!patience!