Represented by Gemma Bellhouse, Test Production Manager Language Testing Forum, University of Oxford, 20–22 November 2015 Example: Graded Examinations in Spoken English interactive prompt GESE Grade 12 (C2) Example 3 (resubmitted) Some people claim that the tabloid press and sensationalist journalism and media around the world merely reflects society and does not shape it. I sometimes wonder if that really is the case. Resubmission: Some people claim that the tabloid press and sensationalist journalism and media all around the world simply reflects a society and does not shape it. I sometimes wonder if that really is the case. Prompt after panel edit: Some people claim that sensationalist journalism all around the world simply reflects a society and doesn’t shape it. I wonder if that really is the case. Final live prompt: Some people claim that sensationalist journalism simply reflects a society and doesn’t shape it. I wonder if that really is the case. The Test Production Process Stage 1 Item writers are recruited Initial and ongoing training www.trinitycollege.com/GESE Stage 2 (see examples) Items are commissioned Items are pre-edited in-house Items are accepted or rejected Items are resubmitted in line with feedback Items are edited by a panel Items are typeset and proofread Stage 3 Items are trialled/pretested Items are reviewed for bias Items are banked or rejected Stage 4 Exam materials/test papers go live Post-test analysis Examples: Graded Examinations in Spoken English interactive prompts GESE Grade 10 (C1) Example 1 (resubmitted) Nowadays entertainment seems to be too focused on technology with downloads readily available to phones, computers and tablets. If we continue this way I fear that real social interaction will become a thing of the past. Resubmission: Nowadays technology seems to have taken over in all areas of life, especially entertainment. If this trend continues I think that the consequences can only be detrimental to traditional family pastimes. Prompt after panel edit: Nowadays technology seems to have taken over many areas of life, especially entertainment. If this trend continues, I think that the consequences will be detrimental to traditional family pastimes. Final live prompt: Nowadays technology seems to have taken over many areas of life, especially entertainment. If this trend continues, I think that the consequences will be detrimental to traditional pastimes. Example 2 (rejected) These days people spend a lot of time campaigning on environmental issues. However, in my opinion there can be no rational debate on these issues until people understand the science involved. THE JOURNEY OF A TEST ITEM Pre-editing feedback: Similar to old task: DVD vs cinema; and too dependent on technology. Tighten up the phrasing. Pre-editing feedback: Reject: Requires specific scientific knowledge Pre-editing feedback: Edit to avoid UK bias: ‘tabloid’.