WESTELL District Test Administrator Training February 18 th, 2015 PLANNING Information for District-level Administrators Mami Itamochi – WVDE Miquela Darnall.

WESTELL District Test Administrator Training

February 18th, 2015PLANNING Information for District-level Administrators

Mami Itamochi – WVDEMiquela Darnall – Measurement Inc

Introduction• This presentation contains general information

for administration PLANNING of the West Virginia Test of English Language Learning WESTELL (English Language Development Assessment ELDA).

• Unless otherwise noted, the information in this presentation refers to grades 3-12 test administration.

• The WESTELL is a required statewide assessment of all students with Limited English Proficiency (LEP) in grades K-12.

Overview

• Timelines & Planning Tool• Schedule & Time Allotments• Handling Test Materials• Preparing Test Materials• Security Concerns & Procedures• Administration• Training

– Security, K-2, Scoring Speaking

Timelines

And

Planning Tool

2015 WESTELL TIMELINES

Planning Tool

http://wvconnections.k12.wv.us/documents/2011DistrictPlanningTool.xls

WESTELL DISTRICT PLANNING TOOL

Scheduling Materials Training Administration

School Contact Date Ordered Rec'd Overage K-2 3~12Scoring Speaking

Security Signed

Commu-nication

Labels Affix

Tape Recorder

Room Prep.

Materials RETURN



Schedule

And

Time Allotments

Schedule and Time Allotments

The 2015 administration of the WESTELL will take place

March 16 through April 24, 2015•Districts may set their own schedules in conformance with the state testing calendar.

•Make-ups for absentees are permitted as long as they are in the testing window.

•WESTELL/ELDA is not a timed assessment.

•Local flexibility in sequencing of tests is permitted.

Approximate WESTELL/ ELDA Test Times

Cluster Listening Speaking Reading Writing

Kand1-2

7 Items - Inventory

8 Items - Inventory

14 Items - Inventory

9 Items - Inventory

3-5 35 minutes 20 minutes 42 minutes 1 hour





Breaks

•Test Administrator’s discretion.

•A short break between Parts 2 and 3 of the Reading test and between Parts 1 and 2 of the Writing test is recommended.

•One 10-minute break between Parts 3 and 4 of the Listening assessment is recommended.

•The Speaking assessment will take less than 30 minutes, so no break is recommended.

Handling

Test

Materials

District Test Coordinator Will Receive:

• Packing List – lists all materials in the district package

• Box List – lists all materials in each box/package

• District Order Summary List – Lists all materials sent to each school, and lists Central Office materials, if applicable• District Test Coordinator Manual• Return Shipping Labels• Important Test Dates Sheet and Instructions for

Completing Demographic Information• Materials packaged for each of the schools• Instructions for Completing the ELDA Security List

Handling Testing Materials

District Test Coordinator Will:•Confirm receipt of a District Coordinator Manual, FedEx

return shipping label(s), and boxes for each of the schools listed on the packing list.

•Send each school its respective box(es). •The School Test Coordinator (STC) will verify the contents of

the box(es).•After testing, schools will return all materials to the district in

their original school box(es).•Be sure boxes are taped securely.•Use supplied return shipping label(s) to send to MI.

ELDA/WESTELL Help Line InformationQuestions and Extra Materials

Help Line: 888-612-0180 (8:30am – 4:30pm Eastern Time)Email: [email protected]


The STC will:• Check the materials against the School Packing

List• Sign the Security List• Inform District Test Coordinator (DTC) of any

discrepancies

If there are any discrepancies, the DTC should:Inform MI ([email protected]) and

Mami Itamochi ([email protected])Use the Missing/Extra ELDA Materials Reporting

Form in the back of the DTC Manual to report any discrepancies.


mailto:[email protected]



Student Answer document

Speaking Prompt Tape or Disc

Listening Prompt Tape or Disc

School Test Coordinator InformationApply pre-printed student identification labels to the Student Answer documents. For students who DID NOT receive a Pre ID Student Label, fill in the Demographic section of each Student Answer document. *Recording Speaking Response Tapes will also be included for Districts who are requesting Meas. Inc. to score Speaking.

Listening/SpeakingTest Book

Reading/WritingTest Book

Test Administration Manual

SpeakingScoring Guide

E N G L I S H L A N G U A G E

D E V E L O P M E N T

A S S E S S M E N T

S P E A K IN G

S C O R IN G G U ID E

S p r in g 2 0 0 5F ie ld T e s t

Preparing

Test

Materials

Pre-ID Student Labels• Collected from WVEIS in mid-December• Include all students with:

–Active Bilingual Record–No EXIT Date

• Districts must affix Pre-ID labels to student answer documents

• Districts will receive generic student labels for each additional test that is ordered –Generic labels will be school specific (include county & school ID #s)–Generic labels will not be student-specific (will not include student ID #)

• Be sure to affix the labels with barcode numbers beginning with “AD” to the answer documents.

Pre ID Labels – Scenario A

If you have a Pre-ID label for a student who does NOT NEED to test:– Check WVEIS file to see why label was

generated– Correct/add additional data to WVEIS– Affix label to answer document– Bubble in the Correct Reason Not Tested on

the answer documents.

Reason Not Tested

• Once a Pre-ID label is affixed, fill in the circle on the answer folder that corresponds to the reason the student did NOT test:

– Absent for the entire/partial testing window– No longer enrolled– Emergency medical waiver– Student completed more than 1 answer folder– Student misclassified (no longer LEP)

Pre-ID Labels – Scenario B

If you do not have a Pre-ID label for a student who NEEDS to test:– Affix a generic student label for that student, if available– Bubble (hand enter) student demographic information on

student answer document– Hand-entered information will NOT over-ride label

• You have the record change roster correction window from May 18-22, you can correct data at that time.

– Example: Smith County, Jones Elementary enrolled a new LEP student on January 19th

• Smith Co Title III Director ordered an additional test for this student.

• When test materials arrive, the new student will receive a test booklet and a generic student label. New student will NOT have a Pre-ID label.

• The School Test Coordinator will affix generic school label and will bubble in student information on answer document.

After testing, be sure the answer document is placed under a header sheet from the correct school and grade cluster!

Security Concerns

And

Procedures

Security Concerns and ProceduresMaintaining assessment security is one of your most important responsibilities as a test administrator.

•At all times, district and state procedures for protecting secure assessment materials should be followed.

•You are responsible for ensuring the security of not only the physical test booklets and answer documents but also the individual assessment questions and materials.

•Your responsibility for maintaining the security of the assessment questions and materials continues throughout the entire testing window and through the return of testing materials.

•Under no circumstances should students have access to assessment materials before or after the assessment session.

•All 3-5, 6-8, and 9-12 test booklets, Speaking Scoring Guides, and Listening and Speaking prompt CDs or cassettes are individually numbered with secure barcodes.

•All WESTELL/ELDA materials must be accounted for throughout the assessment.

•BOTH USED AND UNUSED test materials must be returned to Measurement Incorporated after testing.

Grade K is ORANGEGrades 1-2 are RedGrades 3-5 are GREENGrades 6-8 are BLUEGrades 9-12 are PURPLE

Security Concerns and Procedures

Security Concerns and ProceduresStudent-Teacher Ratio

During each assessment administration, a Test Administrator must be in the room at all times.

Reading, Writing, and Listening

20 : 1

Speaking (scored live)

1 : 1

Security Concerns and Procedures

School Test Coordinator Information •Confirm all materials using the school packing list•Note any missing materials on the Security List•Place header sheet on top of student answer documents•Put all student test materials (used and unused) back into the original box

that came from the district•Put all teacher administrator materials back in the same box•All materials must be returned -- double check that you have accounted

for and packed everything•You can use fewer boxes to return materials as long as all materials are

returned

District Test Coordinator Information•Use the Pre-Addressed Address Label to Return the box to Measurement

Inc. immediately

After Testing

Administration

Assessment Room Preparation

Arrive at the assessment room early to make sure that it is ready for the assessment session.

•Assessment materials not in use should be stored securely and away from students.

•Before the students arrive, do the following (the STC must ensure that this procedure is carried out in a secure manner):

•Apply Pre-ID labels to student answer document (if applicable)

•For each student who does not have a Pre-ID label, complete all required demographic information on each student’s answer document.

•Return all materials to a designated secure location until the assessment begins.


If MI will score the Speaking test for your district, the STCs should follow the procedures below:

• If you have a pre-ID label for the student, apply the label with the barcode beginning “SR” to the Speaking Response Tape.

• If you do NOT have a pre-ID label for the student, apply a generic label marked “Speaking Response Tape Label” to the student's Speaking Response Tape.

• In either case, the last 5 digits of the barcode number on the tape label should match the last 5 digits of the barcode number on the student's answer document label.

•This information MUST match in order for MI to assign the correct Speaking scores to the student.

NOTE: You should also write the student’s name on his/her Speaking Response Tape using permanent marker, but you must follow the steps above to ensure accurate scoring.

The following testing materials will be used in addition to the ELDA Test Administration Manual:

• Listening Prompt Cassette or Compact Disc• Speaking Prompt Cassette or Compact Disc• Speaking Scoring Guide• Header sheet

You will be shipped the following materials for each student:

• One test booklet containing the Reading and Writing Tests• One test booklet containing the Listening and Speaking Tests• Student answer document • Pre-ID or generic label(s) • One Student Speaking Response Tape (only if MI is scoring the

Speaking test)


Check the assessment room for possible assessment question “clues” prior to each assessment session.

•Charts, maps, and other materials in the classroom should be covered or removed prior to the assessment administration.

Give each student a work space that is large enough to accommodate an open test booklet.

•Work spaces should be cleared of all other materials.

•Students should be separated by a reasonable distance to encourage independent work and to prevent collaboration.

•Plan to provide two # 2 pencils with erasers for each student and to have extra pencils on hand.


Scripted DirectionsOral scripts for each of the four assessments are in Appendices A-D of the Grades 3-12 Test Administration Manual.

The Appendices include information on preparing for the administration, specific directions for administering each assessment, and oral scripted materials to be read aloud to students.

The oral scripts should be reviewed by all test administrators prior to the assessment session.

The scripted directions that are in bold print must be read verbatim to students.

Appendix A = Reading ELDA ScriptAppendix B = Writing ELDA ScriptAppendix C = Listening ELDA ScriptAppendix D = Speaking ELDA Script

Administration: Grades K and 1-2

• 4 content areas, inventory-based• Test should be administered by classroom teacher,

ESL teacher, or other qualified person(s) familiar with the student’s abilities. Multiple individuals may collaborate on the student’s assessment.

• Test Administrators observe students for a minimum of 2 weeks

• K and 1-2 Test Administration Manuals define the skills to be assessed and how to evaluate student performance

• K and 1-2 Teacher Support Materials provide examples of prompts to which students may respond

• Test Administrators should feel free to use their own resource materials to evaluate student performance

WESTELL/ELDA

Reading and Writing

Assessments

Grades 3-12

Preparation For Administering the Reading and Writing Assessments

Practice for the AdministrationPrior to administering the Reading and Writing assessments you should:•Read through the scripted Reading directions (Appendix A) that

you are expected to read to students.•Read through the scripted Writing directions (Appendix B) that

you are expected to read to students.

Assessment Setting•Appropriate seating for each student •Free from outside noise from the hallway and adjoining classrooms •Students seated far enough apart so that they do not distract one another

•Students should not be seated at the same table or have the opportunity to see one another’s answer documents.

Assessment Groups

You may assess up to 20 students in a classroom. If more than 20 students are present, a proctor must assist in the test administration.

Assessment Materials

Each student will need the following for the Reading and Writing assessments:

1. One Student Reading/Writing test booklet

2. One Student answer document

3. Two #2 pencils with erasers


Interruptions in the Administration

It is important that the test administration be smooth and free of interruptions. In the event of an interruption, follow the general guidelines below.

These guidelines may be superseded by guidelines provided by your school or state testing coordinator.

1. If the interruption is serious and affects all students, stop the assessment at the time of the interruption.

2. After the interruption, restart the administration from the point where you stopped.


Format of the Reading BookletsThe Reading assessment is divided into three parts. You will be asked to read the scripted directions prior to part one and prior to part three. The format of the Reading booklet is as follows.Part 1: Short Passages This section tests the student’s ability to understand information in short reading passages. There are one or more questions about each passage.Part 2: Instructions This section tests the student’s ability to understand directions. There is a different set of instructions for each question. The student will need to identify which person followed the directions correctly.Part 3: Longer Passages This section tests the student’s ability to understand information in longer reading passages. The student will answer several questions about each passage.

Preparation For Administering the Reading Assessment

Format of the Writing BookletsThe Writing assessment is divided into three parts. You will be asked to read the scripted directions prior to part each part of the assessment. The format of the Writing assessment is as follows.

Part 1: Open Ended

Students write responses to prompts.

Part 2: Revise and Edit

Students choose the best answer to correct grammar and usage errors in passages.

Part 3: Graphic Organizers

Students answer questions about graphic organizers.

Preparation For Administeringthe Writing Assessment

Directions for Administering the Reading and Writing Tests

•At the start of the test, pass out the test booklets. Give each student one booklet.

•Students may NOT open the test booklet until directed to do so.

•Make sure that each student has two #2 pencils with erasers.

•Follow the scripts in Appendices A and B of the Test Administration Manual to administer the Reading and Writing tests.

•When the test has ended, collect each student’s test booklet and answer document.

•Do not dismiss students until you have carefully counted the test booklets.


WESTELL/ELDA

Listening and

Speaking

Assessments

Grades 3-12

Preparation For Administering the Listening and Speaking Assessments

Equipment• You will need an audiocassette or

compact disc player to play the prompt recording. – The player must provide adequate clarity

and volume so that all students in the administration can hear the Listening and Speaking tasks clearly.

– Make sure that you test the sound quality of the prompt recording before the administration to identify an appropriate volume setting.


Equipment Testing

You must test both the audiocassette or compact disc player and the audiocassette or compact disc before administering the Listening and Speaking assessments. – Make sure to use the appropriate grade level

audiocassette or compact disc.

– Place the prompt cassette or compact disc player at a centrally located place in the room. Turn it on and listen to it from each student’s seat. Adjust the volume if it is not clearly audible.

– Make sure that the audiocassette is fully rewound.

– Make sure that the player has fresh batteries, if necessary.

Interruptions in the AdministrationIt is important that the test administration be smooth and free of interruptions. In the event of an interruption (such as a fire alarm or cassette/compact disc player malfunction), follow the general guidelines below.

These guidelines may be superseded by guidelines provided by your school or state testing coordinator.

1. If the interruption is serious and affects all students, pause the prompt recording at the time of the interruption.

2. After the interruption, restart the administration from the point where you paused the prompting recording.


Assessment GroupsYou may assess up to 20 students in a classroom. If more than 20 students are present, a proctor must assist in the test administration.

Preparation For Administering the Listening Assessment

Assessment Setting• Appropriate seating for each student • Free from outside noise from the hallway and adjoining

classrooms • Students seated far enough apart so that they do not

distract one another • Students should not be seated at the same table or have the

opportunity to see one another’s answer documents.

Practice for the AdministrationPrior to administering the Listening assessment you should:

•Read through the scripted administration directions (Appendix C) that you are expected to read to students.

•Listen to the first 2 minutes of the prompt recording; then rewind or restart.



Each student will need the following for the Listening assessment:

1. One Student Listening/Speaking test booklet 2. One Student answer document3. Two #2 pencils with erasers


Format of the Prompt Recordings• You will receive one Listening assessment audiocassette or

compact disc with each set of administration materials. • The narrator will read the entire content of the test booklet. • The questions and answer choices are read once.• The stimulus material is read once, except for Part 5 (long

presentations) – only 6-8 and 9-12 have part 5. • Students have 10 seconds to respond to each question after

the narrator has read the last option. • The Listening assessment is divided into 5 parts:

1. Short Phrases2. Short Dialogues3. Long Dialogues4. Short Presentations5. Long Presentations (grades 6-8 and 9-12 only)

Directions for Administering the Listening Test•At the start of the Listening section, pass out the test booklets. Give

each student one booklet.

•Students may NOT open the test booklet until directed to do so.

•Make sure that each student has two #2 pencils with erasers.

•Play the Listening prompt cassette or CD, following the instructions in Appendix C of the Test Administration Manual.

•When the Listening test has ended, collect each student’s test booklet and answer document.



Assessment GroupsBecause you will be scoring students’ oral responses in real time, the Speaking assessment will need to be administered individually.

* In order to avoid subjectivity bias, it is recommended that any teacher who provides direct services to a student NOT score that student’s Speaking test. (This does not apply to the Listening, Reading, and/or Writing administration).

Preparation For Administering the Speaking Assessment

Assessment Setting• Appropriate seating for each student • Free from outside noise from the hallway and adjoining

classrooms

Practice for the AdministrationPrior to administering the Speaking assessment you should:

•Read through the scripted administration directions (Appendix D) that you are expected to read to students.

•Listen to the first 2 minutes of the prompt recording. During the first two minutes, you will hear the administration practice tasks 1 and 2.

•Rewind the prompt recording if you are using an audiocassette.

•Practice using the rubrics and sample responses in the Speaking Scoring Guide.




Each student will need the following for the Speaking assessment:

• One Student Listening/Speaking test booklet• One Student Speaking Response Tape (only if your

district has opted to have MI score the Speaking test)

The Test Administrator will need the following during the test administration:

• One Student answer document• Two #2 pencils with erasers• The Speaking Scoring Guide• The grades 3-12 Test Administration Manual

Format of the Prompt Recording• You will receive one Speaking assessment audiocassette or

compact disc with each set of administration materials.• The narrator will read most of the assessment, but you will read

some introductory directions (see Appendix D of the Test Administration Manual).

• After the practice tasks, there are 3 groups of 4 related tasks.• Each group of related tasks has one of each type of item, in this

order: Connect, Tell, Expand, Reason.

The recording is divided into six sections:

1. Practice Task 12. Practice Task 23. English-Language Arts Tasks4. Mathematics, Science, and Technology Tasks5. Social Studies Tasks6. Closing



Directions for Administering the Speaking Test• At the start of the Speaking test, pass out the test

booklets. • Each student should receive one test booklet. • Students may NOT open the test booklet until

directed to do so. • Students will respond orally to audio prompts.• Test administrators should score the student’s

responses in real time as they are spoken.*• Use the Speaking Scoring Guide to aid in scoring.• Record the scores on page 8 of the student’s answer

document. • Collect each student’s test booklet and answer

document before dismissing students.• *Note: If you are recording student responses for MI

to score, minimize background noise so that each student can be heard clearly on his or her Speaking Response Tape. Otherwise correct scores may not be assigned.

Things to Remember: Before Students Arrive

•Verify that you have the correct number of test books and answer documents.

•Gather and organize all necessary testing materials:- Student test booklets- Student answer documents- Supply of sharpened #2 pencils (DO NOT use pens)- The Test Administration Manuals- The Speaking Scoring Guide- Listening and Speaking prompt cassettes or CDs- Student Speaking Response Tapes (if using)- Silent work for students

•Arrange for an appropriate test setting

•Decide whether and when to give breaks to students

•Arrange to have a proctor present if assessment groups are larger than the recommended size

Things to Remember: Before Testing

• Be sure students have all necessary testing materials.• Students should raise their hands if they have

questions.• Otherwise, students should not talk (except during the

Speaking test).• Use the scripts located in the Appendices of the Test

Administration Manual. The script is printed in bold type.

• You may repeat the directions or answer questions regarding the directions.

• Do not alter the meaning or intent of the directions.

Things to Remember: During Testing

•Make sure students are marking their answers in the appropriate places on their answer documents.

•Do not interfere with students’ concentration as you check their progress. Encourage students to complete all questions.

•Students who finish the assessment early should remain silent. •Test Administrators will provide materials for students to work on

after they finish the test and close their booklets.•Toward the end of the assessment period, remind students to

complete the entire assessment. •Do not review a student’s test booklet after it is handed in and then

give it back to the student with instructions to complete the assessment. This action would constitute a breach of test security.

•Collect all test booklets and answer documents.

•Do not allow students to “pass around” assessment materials.

•Allow students who have finished the assessment to work quietly at their desks. Have a supply of generic silent work to distribute to these students.


•Thank students for their efforts on the WESTELL.

•Return all testing materials to the STC.

•The STC should be sure all materials are accounted for and sign the Security List.

Things to Remember: After Testing

Procedures for Students with Accommodations

•Accommodations that change the content of the assessment are NOT allowable.

•Accommodations in the administration procedures for ELDA are allowable if specified in a student’s IEP or 504 plan and provided for the ELDA.

•Any accommodations for an individual must be specified before the student takes the assessment and must be documented in the student’s IEP.

Contact your District Coordinator for additional state guidelines on accommodations for the ELDA.

Accommodations should always be related to the student’s specific disability.

•Computerized Assessment•Dictation of Responses•Extended/Adjusted Time• Individual/Small Group Administration

See the grades 3-12 Test Administration Manual for further information about these accommodations.

The accommodations listed below, or any accommodations specifically identified in the student’s IEP or 504 plan, may be provided on the WESTELL.


Modified Test Booklets•Braille and Large Print versions of the Reading and Writing ELDA only are available upon request.

Braille and Large Print are only available for grades 3-12

•District Test Coordinators should contact Measurement Incorporated to order these materials.


Training

Training - Test Administrators

• Test Administration Manuals (grades K, 1-2, 3-12) and other training materials are available online and must be reviewed prior to administration.

• Speaking - Districts opting to score Speaking tests locally must provide appropriate training using the posted Speaking scoring materials.

• Security - Code of Ethics/Security Agreement is available online and must be reviewed & signed prior to administration.

Training - Test Administrators

• Test Administrators Training (2 options)– Elluminate Web Session

• March 5th - 3:00-4:30 https://meet.lync.com/wvk12/mitamochi/HQ6DCBMH

OR

– Local training coordinated by DTCs

• Additional training may be scheduled upon request

https://meet.lync.com/wvk12/mitamochi/HQ6DCBMH

https://meet.lync.com/wvk12/mitamochi/HQ6DCBMH

Important Information: Grades K & 1-2

• K and 1-2 Inventory Items are NOT secure• K and 1-2 Tests DO have intellectual property rights• Preview / Inventory Compilation may be initiated in

advance of testing window• K and 1-2 Documents posted on WV website

– Kindergarten Administration Manual (including Inventory) http://wvconnections.k12.wv.us/documents/ELDAKAdminManual_2015.pdf

– Kindergarten Support Materials http://wvconnections.k12.wv.us/documents/2015ELDAKTSM.pdf

– 1-2 Administration Manual (including Inventory) http://wvconnections.k12.wv.us/documents/ELDA_1-2AdminManual_2015.pdf

– 1-2 Support Materials http://wvconnections.k12.wv.us/documents/2015ELDA1-2TSM.pdf

• Teachers will receive hard copy grades K and 1-2 materials along with the grades 3-12 materials

http://wvconnections.k12.wv.us/documents/ELDAKAdminManual_2015.pdf

http://wvconnections.k12.wv.us/documents/ELDAKAdminManual_2015.pdf

http://wvconnections.k12.wv.us/documents/2015ELDAKTSM.pdf

http://wvconnections.k12.wv.us/documents/2015ELDAKTSM.pdf

http://wvconnections.k12.wv.us/documents/ELDA_1-2AdminManual_2015.pdf

http://wvconnections.k12.wv.us/documents/ELDA_1-2AdminManual_2015.pdf

http://wvconnections.k12.wv.us/documents/2015ELDA1-2TSM.pdf

http://wvconnections.k12.wv.us/documents/2015ELDA1-2TSM.pdf

Communication

• Documents on WVConnections website http://wvconnections.k12.wv.us/assessment.html

– Principals Letter (FAQ document is included)– Student Excuse Letter– Letter to Parents

• English • Chinese• Spanish

• Local Communication Venues– ESL Newsletter– Parent Involvement Committees– Principal meetings

http://wvconnections.k12.wv.us/assessment.html

http://wvconnections.k12.wv.us/assessment.html

Overage Materials

• Please contact ELDA Helpline - Complete the request form for overage materials http://wvconnections.k12.wv.us/documents/2015WESTELLCountyOverageRequest_000.xls

- Send email to [email protected]

*WVDE Federal Program office will not have additional testing material.

http://wvconnections.k12.wv.us/documents/2014WESTELLCountyOverageRequest_000.xls




Need Help?

• ELDA Helpline 888-612-0180

[email protected]

• Mami Itamochi 304-558-0200

[email protected]



WESTELL District Test Administrator Training February 18 th, 2015 PLANNING Information for District-level Administrators Mami Itamochi – WVDE Miquela Darnall.

Documents

materials return slide

test administration

reading test

writing test

speaking slide

planning tool slide

extra materials

school test coordinator