SBAC Field Test in RUSD After-Action Review

SBAC Field Test in RUSDAfter-Action Review

Brian HuffMay 30, 2014

Welcome• Get in groups of three. • Take turns completing the following two

sentences:The biggest thing I learned this year

during the SBAC field test was . . .

In thinking about my summer break, the one thing I am most excited about is. . .

Predict

• In your groups of three, find a poster on the wall.

• Read the student survey question and make a prediction about how students in RUSD responded.

• Include your rationale for your prediction.

RUSD Completion Rate

RUSD reached an SBAC field test completion rate of 98.24%,

compared to the current state average of just over 95%.

Majority Test 100% Completion!

Blandford (5 students)Northam (2 students)Rorimer (2 students)Oswalt (3 students)Telesis (2 students)

SBAC Preparation - Team Effort• Training and Preparation:

– Test Site Coordinator Training: February 20– Special Education Teacher Training: February 6, 18– SBAC Scheduling support:

• January 16, 21, 30, 31• February 4, 7, 11, 14, 20, 21, 27, 28• March 4, 7, 13, 14

– Lab Technician Training: March 10– SBAC Technology Readiness County meetings:

• December 17• February 13, 20

– SBAC Technology/Assessment debrief meetings in RUSD:• February 21, 26• March 7, 12• April 11• May 8, 15

– SBAC Test Administrators training: Site based

Lessons Learned

• SBAC manuals are unwieldy for teacher use• Issues with using designated supports and

accommodations– Glitches in applying universal access features– Matching to IEPs– Kudos to SPED district PS for applying features

• Need better guidance on coordinating NPS

Lessons Learned

• TIDE system needs improvement:– Need efficient way to reset passwords (e.g. link)– Need to see access history– Need to reset test sessions locally– Need more than one district account– Need more advanced access to TIDE to verify data

• Classroom activities need more standardized administration

Lessons Learned

• Scheduling make-up students is challenging with classroom activity

• Students need explicit instruction in utilizing the SBAC features, especially note-taking

• Assigning additional RUSD staff as TA• Spreading testing out better for students than

compacting into short timeframe, which increases testing fatigue

Lessons Learned

• Roles of district Assessment and Technology departments are changing – requires more collaboration

• Heavy impact on Technology Department• Technology glitches required significant staff

support; lab technicians are valuable support• Resources provided by state were too much,

too late

Student Feedback Survey

3,438 students completed the online RUSD SBAC Field Test Survey

Student Survey Participation

What type of technology did you use?

How would you rate the difficulty of the SBAC Field Test?

Using the keyboard to type my answers was

Using the tools provided by the SBAC online system was

Agree or disagree: The lessons and activities I completed in school helped me feel prepared to take the SBAC Field Test.

What activities would help you to prepare for the SBAC test next year?

Teacher Survey Participation

How was your overall experience with the SBAC Field Test?

Extremely challenging

Outstanding

As a TA, how prepared did you feel to give the test?

Not at all

Extremely prepared

How would you rate the support and assistance from the district PRIOR to the test?

Inadequate

Outstanding

How would you rate the timeliness of support DURING the test?

Inadequate

Outstanding

After administering the SBAC to your students, how prepared do you feel to administer the SBAC next year?

Not prepared at all

Very prepared

Next Steps• Testing window for 2014-2015–66% (12-week window): grades 3-8–80% (7-week window): grade 11

• Clear scheduling guidelines from state for 14-15• Clear guidelines for districts to identify UA

features provided by state for 14-15 (modules for SPED departments on entire process)

• Clear, concise DFA instructions for TA manual• Videos provided of classroom activities

Next Steps

• EAP will be embedded in SBAC next year• ETS understands they provided too much

information, too late, during the field test• SBAC Digital Library• Practice tests are updated with full features• Everything housed under CAASPP online

Next Steps – Testing Labs

• Schools clear testing lab rooms by June 13; work with custodians to complete task, submit facilities work order if need assistance moving

• Tables begin delivery June 16• Per Stuart Moe:– Schools completed in June: Villacorta, Shelyn, Giano,

Rowland High School– Schools completed in July: Remaining schools

• Detailed schedule provided by Stuart Moe and Phil George on Friday, May 30