Top Banner
An Outline of Washback 1. Definition 2. Conceptualization of washback 3. Manipulation of washback 4. Empirical studies on washback
15
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
  • An Outline of Washback

    DefinitionConceptualization of washbackManipulation of washbackEmpirical studies on washback

  • Please God may I not failPlease God may I get over sixty percentPlease God may I get a high placePlease God may all those likely to beat meget killed in road accidents and may they die roaring.

    (Shohamy,1994, p.57)

  • 1.Definition- Impact- Washback (backwash)- Curricular alignment - Systemic validity- An instance of consequential aspect of construct validity

  • Washback is frequently used to refer to the effects of tests on teaching and learning whereas impact refers to any of the effects that a test may have on individuals, policies or practices, within the classroom, the school, the educational system, or society as a whole (Wall, 1997:291).

  • 2. Conceptualization of washback- Debate over incorporating washback into the concept of validity Proponents: Opponents: Messick, Morrow, Popham, Mehrense, Li Xiaju, Linn Alderson, Davis

    The best way of encouraging adequate consideration of major intended positive effects and plausible unintended negative effects of test use is to recognize the evaluation of such effects as a central aspect of test validation" Linn (1997:16).The apparent open-ended offer of consequential validity goes too far. I maintain that it is not possible for a tester as a member of a profession to take account of all possible social consequences" Davis (1997:335).

  • - The Scope, Pattern, and Mechanisms of WashbackBachman and Palmer (1996:30)

  • Washback hypotheses (Alderson and Wall,1993)(1) A test will influence teaching.(2) A test will influence learning.(3) A test will influence what teachers teach: and(4) A test will influence how teachers teach; and therefore by extension from (2) above:(5) A test will influence what learners learn: and(6) A test will influence how learners learn.(7) A test will influence the rate and sequence of teaching: and(8) A test will influence the rate and sequence of learning.(9) A test will influence the degree and depth of teaching: and(10) A test will influence the degree and depth of learning.(11) A test will influence attitudes to the content, method, etc. of teaching and learning.(12) Tests that have important consequences will have washback; and conversely(13) Tests that do not have important consequences will have no washback.(14) Tests will have washback on all learners and teachers.(15) Tests will have washback effects for some learners and some teachers, but not for others.

  • High-stakes tests are those whose results are seen rightly or wrongly by students, teachers, administrators, parents or the general public, as being used to make important decisions that immediately and directly affect them... In contrast to a high-stakes test, a low-stakes test is one which is perceived as not having important rewards or sanctions tied directly to test performance.

  • A basic model of washback (Bailey, 1996)

    PARTICIPANTS PROCESSES PRODUCTS

    TEST

    Learning

    Students

    Teaching

    Teachers

    New materials and new curriculum

    Materials writers and curriculum designers

    Research results

    Researchers

  • 3. Manipulation of washback Test as an agent for change - The Sri Lanka English test (lever for change) - The Hong Kong CEE (tail wags the dog)- The NMET

  • 4 Empirical studies on washbackApproachesThe existence of washback (establishing washback)The scope and pattern of washbackThe quality of washback (positive vs. negative)The intended washback

  • MethodsInterviewClassroom observationQuestionnaire surveyAnalysis of documents

  • FindingsCausal relationship established (baseline data and follow-up data)Test effects on different aspect of education and teaching/learningPositive vs. negative effectsIntended effects failing to occur

  • An example of the study on the intended washback of a high-stakes test

    The Intended Washback Effect of the National Matriculation English Test in China: Intentions and Reality