Interim Assessment Training September 20 & 26, 2012

Interim Assessment Training September 20 & 26, 2012

1

Rhode Island Interim Assessments

RIDE Introductions

Jessica Brown, Assessment Specialist

Kevon Tucker-Seeley, Assessment Specialist

Measured Progress Introductions

Amanda Smith, Program Manager

Phil Robakiewicz, Client Services Division Director

Shelby Pouliot, Program Assistant

2

Rhode Island Interim Assessments

Purpose of Training

Training Objectives1. Understand RIIA program and Fixed Form

Assessments

2. Become familiar with RIIA Test Management system

3. Become familiar with online student testing software

3

Rhode Island Interim Assessments

Purpose of Training

Participant Role Become equipped to train other users on the

RIIA Test Management system and student testing system

Available resources (webinar, user guides)

Parking Lot Use for RIIA-related questions, but not directly

related to the objectives of today’s training

4

Rhode Island Interim Assessments

Overview of Today’s Training

Interim Assessment Program

Test Designs and Content

Interim Assessment Systems

Testing

Before, During, After

Scoring & Results

System Demonstrations

5

Interim Assessment Program

Two Major Components

Fixed Form Assessments

Test Construction Tool

Characteristics of Both ComponentsGrades 3-11Online or paper-based administrationAccessed through the IMS, including reportsAccessibility features available online: e.g., magnificationMultiple-choice items scored automatically in system; teachers score CR items* (Year 1 FF Measured Progress will score)

6

Interim Assessment Program

Fixed Form Sets of tests in Math and ELA

Monitor progress toward proficiency on selected critical content and skills in the Common Core State Standards

Administered 3 times during year

November 1 - 16

February April

7

Interim Assessment Program

Test Construction Tool Locally-created tests by teachers and/or

District Grades 3-11 Math & ELA (January 2013)

• CCSS Science & Social Studies (Sept 2013)

• New Standards Performance tasks

8

ELA Fixed-Form Test Design

Common Core State Standards Organizing Elements in Reading

Key Ideas & Details Author’s Craft & Structure Integration of Knowledge

Item Types Multiple Choice (1 pt) Evidence-Based Selected Response (2 pts) Constructed Response (4 pts)

Three test sessions, 30-45 minutes each Paired reading selection and 12 items per

session (36 items total)9

ELA Fixed-Form Test Design

10

Math Fixed-Form Test Design Common Core State Standards

Five to seven Common Core clusters were chosen to be measured at each grade level

The majority of the clusters are those identified by PARCC as major clusters in the PARCC Model Content Frameworks for Mathematics

Item Types Multiple Choice (1 pt) Short Answer – 1 point Short Answer – 2 points Constructed Response (4 pts)

Two test sessions, 30-45 minutes each 15 items in session 1, 16 items in session 2

11

Interim Assessment Systems

Component/System

Function Availability

Test Management Assign and schedule testsPrint materials

Now

Scoring Teachers score responses to open-response items

Practice available in Nov.Measured Progress will score fixed-form this yearTeachers score locally-created tests (avail. Jan. ‘13)

Scanning Locally scan paper-based answers

Measured Progress will scan fixed-form testsJanuary for locally-created tests only

Test Construction Tool

Districts, Schools, and Teachers create own tests

January 2013

12

Interim Assessment Systems

IMS

Test Management

Scanning

Scoring

Test Construction Tool

Student Testing

Software

13

Before Testing – Test Management

Assigning and Scheduling Tests

District administrator:

Assign tests to schools (after October 16) Option to narrow test windows Assign and schedule practice test (after

September 28)

14

Before Testing – Test Management

Student Assignment and Materials

Teacher: Access and print teacher test materials:

administrator manual, roster Determine paper & pencil or computer

testing for each student Print test forms and answer sheets Print computer login tickets

15

Before Testing – Test Management

Student Assignment and MaterialsTeacher-Course-Student data determines test availability to teachers and student assignment

Students must be in the system to test

Contact RIDE helpdesk to update students or change student information

16

Before Testing – Student Software

Nimble Online Assessment kiosk must be downloaded to every student computer prior to testing

Browser-based software, prevents students from accessing other applications while testing

Requires login with information from Student Login Ticket

17

Before Testing – Student Software

Available for download at:http://www.ride.ri.gov/Assessment/Interim.aspx

Instructions for download to Windows, Mac, and Apple Remote Desktop (multiple Macintosh computers)

Mac OS 10.5 to 10.7

Windows XP, Vista, and 7

18

Before Testing – Computer Testing

Practice Test1.District schedules practice test2.Teacher selects and prints Student Login Tickets3.Teacher prints or downloads Practice Test Manual4.Student computers have Nimble Online Assessment software loaded5.Students take Practice Test

19

Before Testing – Computer Testing

Practice Test TipsContent of the test is not Common CoreIntent is to help students become comfortable using the systemLearn to navigate the system and experiment using toolsUnderstand two reading selections and answering questionsPractice answering math questions in text and with drawing tool

20

Before Testing – Computer Testing

1. Ensure every student has taken the practice test and is comfortable with the system

2. Print Student Login Tickets for each student for each test he or she will be taking

3. Print or download the Test Administration Manual

4. Print a paper answer sheet for any student who needs one for a math test*

*Students who find the math drawing tool difficult may elect to use a paper answer sheet for those questions

21

Before Testing – Paper Testing

1. Print individual Student Answer Sheets for each test

2. Print one copy of Test file3. Use roster to determine quantity of forms4. Photocopy test forms5. Match correct test form with each student’s

answer sheet6. Print or download Test Administration

ManualNote: There is no practice test for paper testing

22

Before Testing – Paper Testing

Matching Test Forms – Answer Sheet

Student Name: Demo Student Student ID: 1234567890Grade: 03Test Name: Fall 2012 Reading Grade 3Form: Form 3School Name: Demo School ATeacher Name: Demo Teacher

23

Before Testing – Paper Testing

Matching Test Forms – Test Form

24

Before Testing – Accommodations

Use NECAP Accommodations as you see fit, including extra time. Note many NECAP accommodations will not apply.

Accommodations do not need to be coded on booklets

Computer-based testing Magnification Answer Masking Line Reader Color Chooser

25

During Testing

Actively monitor testing

Manage materials and maintain security between test sessions

Ensure students start sessions 2 and 3 correctly

Receive return shipment materials for paper tests (shipped to Principal on October 29) Store until testing is complete

26

After Testing – Computer Testing

Submit all computer tests Each student must navigate to the final

summary screen and “submit” his or her test

Collect any paper answer sheets used during math tests and give them to the administrator coordinating the return of paper materials

27

After Testing – Paper Testing

Collect all used answer sheets from each classroom in the school

Sort answer sheets by content area and place in appropriate return envelope

Use original box for return shipment Apply UPS Return Service label Pickup on November 19th (late returns

will not be scanned and scored) Shred or recycle test forms and unused

materials28

Interim Assessment Results

Computer and paper tests will be scored by Measured Progress

Results available through IMS Raw scores this year; scaled scores next

year Access to student responses and

items Item, Student, Classroom, School and

District reports will be available

29

Interim Assessment Scoring System

Online system for teachers who gave the test by computer to practice scoring a set of items from the test. Available after test administration.

Training modules available in November

In person professional development after each administration

30

Steps after Training

1. Nimble Online Assessment download for every student computer

2. Train others in school (starting October 1st)

3. District assigns and schedules practice test during October

4. Students take online practice test

5. October 16 or later: district assigns and schedules November administration

31

Support Interim Assessment system issues:

[email protected], 7:00 A.M. – 5:00 P.M.

Login issues, incorrect student data, trouble with Instructional Management System:

RIDE Helpdesk https://support.ride.ri.gov/

Policy and procedure questions:Jessica Brown, RIDE

[email protected], 401-222-8253

Amanda Smith, Measured [email protected],

603-749-9102 x2259

32

System Demonstration

Test Management

Nimble Online Assessment Practice Test

33

Thank you!

34