TSL3123_Lecture3

LANGUAGE ASSESSMENT

LANGUAGE ASSESSMENTTSL3123 LECTURE 3

LEARNING OUTCOMESDefine practicality, objectivity, washback effect, authenticity and interpretabilityDescribe positive and negative effects or washback of tests Demonstrate an understanding of the features of authentic test items and discuss its importance Discuss how interpretability can be ensured in language testing

TSL3123 Lecture3_yhhTSL3123 Lecture3_yhhPrinciples of Language AssessmentPracticalityObjectivityReliabilityValidityWashback effectAuthenticityInterpretability

Lecture (Week 16)TSL3123 Lecture3_yhhPracticality Not expensive, Within appropriate time constraint, Relatively easy to administer, A scoring/evaluation procedure that is specific and time-efficient.

TSL3123 Lecture3_yhhExample of Practicality Checklist1. Are administrative details clearly established before the test?2. Can students complete the test reasonably within the set time frame?3. Is the cost of the test within budget limits?4. Are all materials and equipment ready?5. Is the scoring/ evaluation system feasible in the teachers time frame?

TSL3123 Lecture3_yhhObjectivityThe fairness of a test to the testee, bias test does not portray objectivity and hence is not reliable. A test that is objective has high validity and reliabilityA test is objectively scored if everyone scoring it arrives at the same score.Tests like essay examinations, though, will obviously fall short of this ideal. TSL3123 Lecture3_yhhHow to ensure practicality and objectivity in test designPracticalityCost-effective Time frame i.e. not too long to evaluate, takes a few hours to complete Appropriate scoring procedures.ObjectivityProper training of scorers proper monitoring of scoring can produce essay examinations total objectivitythe interpretation of essay test results, or of the results of any test - should include consideration of statistical analysis of its objectivity.

TSL3123 Lecture3_yhh8AuthenticityThe language - as natural as possible.Items - contextualized rather than isolated.Topics - meaningful (relevant, interesting) for the learner.Some thematic organization to items is provided, e.g. a story line or episode.Tasks represent, or closely approximate, real-world tasks.

TSL3123 Lecture3_yhhExample of Authenticity ContextualizedDecontextualizedGoing to

What _______ this weekend? a. you are going to do b. are you going to do c. your gonna do

There are three countries I would like to visit. One is Italy. a. The other is New Zealand and other is Nepal b. The others are New Zealand and Nepal c. Others are New Zealand and Nepal

TSL3123 Lecture3_yhhExample of AuthenticityContextualizedDecontextualized

2. Im not sure. _______ anything special?Are you going to doYou are going to doIs going to do2. When I was twelve years old, I used ______every day. a. swimming b. to swimming c. to swimTSL3123 Lecture3_yhhWashback effect The effect of testing on teaching and learning (Hughes in Brown, 2004).Generally refers to the effects tests have on instruction in terms of how students prepare for the test (Brown, 2004).

TSL3123 Lecture3_yhhWashback in testing.TSL3123 Lecture3_yhhWashback in testing.TSL3123 Lecture3_yhhInterpretability Test interpretation encompasses all the ways that meaning is assigned to the scores. Interpretability consideration is especially important when persons other than the designers of the test are to interpret the results.

TSL3123 Lecture3_yhhIn order to be interpretable, the measuring instrument must be supplemented by the following:detailed instructions for administering the test,scoring keys,evidence about the reliability, andguides for using the test and interpreting results.

TSL3123 Lecture3_yhhReferencesBrown, H.D. (2004). Language assessment: Principles and classroom practices. New York: Longmanhttp://www.ux1.eiu.edu/~cfcge/respoftestusers.htmhttp://blog.reseapro.com/2013/02/test-of-practicality-of-a-measuring-instrument/TSL3123 Lecture3_yhhTutorial #3Pairwork:Study some commercially produced tests and evaluate the authenticity of these tests/ test itemsDiscuss the importance of authenticity in testing.

TSL3123 Lecture3_yhh