June 09 Testing: Back to Basics. Abdellatif Zoubair Abdellatif Zoubairzoubair2@hotmail.com.
Post on 29-Dec-2015
220 Views
Preview:
Transcript
June 09June 09
Testing: Back to Testing: Back to Basics.Basics.
Abdellatif Abdellatif ZoubairZoubair
zoubair2@hotmail.com zoubair2@hotmail.com
June 09June 09
OutlineOutline
1. Definition1. Definition
2. Main principles2. Main principles
3. Test types 3. Test types
4. Test design procedure4. Test design procedure
5. Use of statistics5. Use of statistics
6. Technolgy and testing 6. Technolgy and testing
7. Bibliography7. Bibliography
June 09June 09
I. Definition:I. Definition:
« a . . . . . . of measuring a person’s « a . . . . . . of measuring a person’s
ability, . . . . . . . . . . or . . . . . . . . . . . ability, . . . . . . . . . . or . . . . . . . . . . .
in a given . . . . . . . . « in a given . . . . . . . . «
June 09June 09
« a method of measuring a person’s « a method of measuring a person’s ability,ability,
knowledge or performance in a given knowledge or performance in a given
domain. »domain. »
D. Brown, 2004.D. Brown, 2004.
June 09June 09
TerminolgyTerminolgy
-Performance vs knowledge-Performance vs knowledge
-Quiz vs test-Quiz vs test
-Testing vs assessment-Testing vs assessment
-Assessment vs evaluation-Assessment vs evaluation
June 09June 09
II. Main principlesII. Main principles
1. Usefulness1. Usefulness
2. Practicality2. Practicality
3. Validity3. Validity
4. Reliability4. Reliability
5. Authenticity5. Authenticity
June 09June 09
Main principles (cont’d)Main principles (cont’d)
6. Transparency6. Transparency
7. Washback7. Washback
8. Security8. Security
9. Fairness9. Fairness
10. . . .10. . . .
June 09June 09
III. TaxonomiesIII. Taxonomies
a. Henning (1987):a. Henning (1987):
1.1. Diagnosis and feedbackDiagnosis and feedback
2.2. Screening and selectionScreening and selection
3.3. PlacementPlacement
4.4. Program evaluationProgram evaluation
5.5. Providing research criteriaProviding research criteria
6.6. Assessment of attitudes and socio- Assessment of attitudes and socio- psychological differencespsychological differences
June 09June 09
b. Alderson, Clapham and Wall b. Alderson, Clapham and Wall (1995):(1995):
1. placement1. placement
2. progress2. progress
3. achievement3. achievement
4. proficiency4. proficiency
5. diagnostic 5. diagnostic
June 09June 09
c. objective vs. subjective testsc. objective vs. subjective tests
d. high- vs. low-stakes tests d. high- vs. low-stakes tests
e. formative vs summative e. formative vs summative
- . . . . .- . . . . .
June 09June 09
h. Traditional vs. Alternative h. Traditional vs. Alternative Assessment.Assessment.
Refer to comparative chartRefer to comparative chart
June 09June 09
Types:Types:
-self-assessment-self-assessment
-portfolios-portfolios
-student-designed tests-student-designed tests
-projects-projects
-presentations-presentations
- . . . .- . . . .
June 09June 09
IV. Test design procedure:IV. Test design procedure:
a. planning:a. planning:
-decide on purpose-decide on purpose
-check course content-check course content
-write specifications-write specifications
June 09June 09
c. administration: c. administration:
-test conditions and procedures-test conditions and procedures
-organize equipment needed-organize equipment needed
June 09June 09
d. post-testd. post-test
-grading-grading
-statistics-statistics
-item analysis-item analysis
-reporting-reporting
June 09June 09
e. reflection:e. reflection:
-purpose-purpose
-validity and reliability-validity and reliability
-future changes -future changes
June 09June 09
V. Statistics: V. Statistics:
a. whata. what
b. rationale:b. rationale:
-information on students' -information on students' performanceperformance
-test reliability-test reliability
-course content-course content
-teaching-teaching
June 09June 09
c. how:c. how:
-the mean-the mean
-the pass/failure rate-the pass/failure rate
-histograms-histograms
- . . . . .- . . . . .
June 09June 09
VI. Technology and testing VI. Technology and testing
a. history:a. history:
-1935: IBM model 805 -1935: IBM model 805
--19701970: Book on computerized testing: Book on computerized testing
((HoltzmanHoltzman))
- . . . ?- . . . ?
June 09June 09
b. main uses:b. main uses:
-CMT/CAT-CMT/CAT
-CBT -CBT
-CAT-CAT
--Web/internet-based testingWeb/internet-based testing
June 09June 09
VII. Bibliography:VII. Bibliography:
-Alderson, J. Charles, Caroline Clapham and Dianne Wall. 1995. -Alderson, J. Charles, Caroline Clapham and Dianne Wall. 1995. Test Test Construction and EvaluationConstruction and Evaluation. Cambridge, U.K.: Cambridge . Cambridge, U.K.: Cambridge University Press.University Press.
-Bachman, Lyle F. 1990. -Bachman, Lyle F. 1990. Fundamental Considerations in Language Fundamental Considerations in Language TestingTesting. Oxford, U.K.: Oxford University Press.. Oxford, U.K.: Oxford University Press.
-Brown, H.D. 2004. -Brown, H.D. 2004. Language Assessment: Principles and Language Assessment: Principles and classroom practices. classroom practices. New York: Pearson Longman.New York: Pearson Longman.
-Coombe, C., Folse, K., & Hubley, N. (2007). -Coombe, C., Folse, K., & Hubley, N. (2007). A Practical Guide to A Practical Guide to Assessing English Language Learners.Assessing English Language Learners. Ann Arbor, MI.: University of Ann Arbor, MI.: University of Michigan Press.Michigan Press.
June 09June 09
-Fulcher, G. Computers in Language Testing. In Brett, P. and -Fulcher, G. Computers in Language Testing. In Brett, P. and G. Motteram (Eds) 2000, A Special Interest in Computers. G. Motteram (Eds) 2000, A Special Interest in Computers. Manchester: IATEFL Publications, 93 – 107.Manchester: IATEFL Publications, 93 – 107.
-Fulcher, G. & Davidson, F. 2007. Language Testing and -Fulcher, G. & Davidson, F. 2007. Language Testing and Assessment: An Advanced Resource Book. Routledge Assessment: An Advanced Resource Book. Routledge Applied Linguistics Series.Applied Linguistics Series.
--Fulcher, G. 1995. The Language Tester's Guide to Fulcher, G. 1995. The Language Tester's Guide to Cyberspace. Cyberspace. Language Testing UpdateLanguage Testing Update July 1995, 17, 62 - July 1995, 17, 62 - 65.65. Last updated: Last updated: 9th June 2008.9th June 2008.Also available at: Also available at: http://www.le.ac.uk/education/testing/ltrfile/cybertxt.html#thttp://www.le.ac.uk/education/testing/ltrfile/cybertxt.html#topop
June 09June 09
-Fulcher, G. -Fulcher, G. Resources in Language TestingResources in Language Testing (website) ( (website) (http://www.dundee.ac.uk/languagestudies/ltest/ltr.htmlhttp://www.dundee.ac.uk/languagestudies/ltest/ltr.html))
-Heaton, J. B. 1988. -Heaton, J. B. 1988. Writing English Language TestsWriting English Language Tests. Harlow, . Harlow, England:Longman Press.England:Longman Press.
-Hughes, Arthur. 2003. -Hughes, Arthur. 2003. Testing for Language Teachers (2nd Testing for Language Teachers (2nd Edition)Edition). Cambridge, U.K.: Cambridge University Press.. Cambridge, U.K.: Cambridge University Press.
top related