E-asTTle writing Fraser 14 May 2012. Scores for e-asTTle writing Raw rubric scores tell us which is the best descriptive category for the student’s work.

e-asTTle writing

Fraser14 May 2012

Scores for e-asTTle writing

• Raw rubric scores tell us which is the best descriptive category for the student’s work for each element.

• The e-asTTle application converts rubric scores to scale scores.

• Scale scores are linked to curriculum levels.

Scale scores

• Scale scores take into account the “difficulty” of the prompt.

• Scale scores form an interval scale.• Scale scores are generally between 1000 and

2000 units.• Very useful for tracking progress over time.

Linking the scale to curriculum levels

• Scale scores are linked to curriculum levels.• Descriptions provided in the literacy learning

progressions used to define this linking.• Curriculum levels are divided into basic,

proficient and advanced stages (B,P,A).

Linking scale scores and curriculum levels

New Consideration

• Unlike old tool it does NOT show “This student is a 3P”

• Unlike old tool it does NOT show “ This writing is a 3P”

• It DOES show “ This writing/writer shows many competencies of level 3P”

• When marking err on side of caution – needs to be a lot of evidence

• Scaled scores of old tool can track to new.

The scale

The level of the blue shading indicates the NZ mean at Year 6

The height of the red circle shows the scale score and the “error” range for this student (1600 ± 44 aWS units)

How precise are these scores?

1600 ± 44The student’s “true” score most probably falls in the range 1556 to 1644 units.

The “± 44” is known as the “measurement error”.

Students who score at very low or very high levels will have greater errors associated with their scores.

The e-asTTle writing score is reported as a range. For instance:

Reporting

• All the same reports are available.• Some changes to:– The Individual learning Pathways Report– Curriculum Levels Report.

Individual Learning Pathways Report

Strengths, Gaps and Achieved

When a score on an element is:• high given the overall score then it is

listed as a Strength.• low given the overall score then it is

listed as a Gap.• about what would be expected given the

overall score then it is listed as Achieved.

e-asTTle writing scores

Notice:• No scores related to deep and surface

features.• No scale scores for the individual elements.

The Curriculum Levels Report

National reference information for e-asTTle writing

National reference information is available for:• Year level• Year level by gender• Year level by ethnicity• Year level by region• Year level by “English at home”• Year level by “schools like us”

e-asTTle scores by year level

Entering results

Annotated exemplar

Characteristics of the annotated exemplars

• The 76 annotated exemplars:- developed from student responses to the 20 prompts- marked using the rubric- cover all prompts (each prompt has at least 3, covering a range of scores—low,

medium, and high)

• The student scripts exemplify: - typical, not ideal, writing- tricky features to score (e.g., possibly off-topic; multiple purposes)

• The annotations:- justify scores

• The generic exemplars:- from the same group of 76- used to check interpretation of individual categories

Marking process• Markers need:

- student script- prompt- marking rubric (ideas, structure and language, organisation, vocabulary, sentence

structure, punctuation, and spelling)- structure and language notes- annotated exemplars- glossary and definitions

• A step by step approach:- read through whole script- work through rubric element by element- check writing against category descriptors and notes to identify best fit category (R1, R2 , R3

etc)- use exemplars to clarify and confirm decisions- moderate decisions- record each score on front page of student writing booklet