1 District Assessment Training for 2010-11 Good morning! Thank you for all you do and will be asked to do! Please have some coffee, water or juice Get.

1

District Assessment Training for 2010-11

• Good morning!• Thank you for all you do and will be asked to do!• Please have some coffee, water or juice• Get assessment notebook materials• Sign-in for CPD credit• Submit leave requests to Wayne Goates• Good news – state testing is generally the same as

last year

2

3

4

District Assessment Notebook• Orchid Information At-A-Glance• 2010-11 Test Coordinators• Salmon Oregon Achievement Standards Summary• Grey 2010-11 District Assessment Calendar• 2010-11 Oregon’s Assessment of Knowledge & Skills (OAKS)• Statewide Testing Schedule• Tan OAKS Online Keyboard Navigation Key• Pink STC – School Test Coordinator Assurance of Test Security• Canary TA – Test Administrator Assurance of Test Security • Blue NTA – Non-Administrator Assurance of Test Security• Ivory Security Practices & Examples• Green 2010-11 Test Administration Manual• Canary 2010-11 Appendices for Test Administration Manual• Buff OAKS Online User Guide for the Test Information Distribution Engine

(TIDE) • Ivory Extended Assessment Updates and Information• Pink English Language Proficiency Assessment (ELPA)• Blue 2010-11 Oregon Online Assessment Reporting System Users Guide

5

6

A new secure test browser is required for OAKS testing.

The installation is automatic when logging into Novell on computers having the secure

test browser last year.

7

8

Test Administration Manual (green)

Foreword is OAR 581-022-0610 Administration of State Tests (5 pages)I. Introduction - who must read what on page 2II. Test Roles – DTC, STC, TA & regional helpIII. Student Confidentiality – No names with SSIDIV. Test Security with reporting & security formsV. Accommodations and ModificationsVI. Students and Assessment OptionsVII. English Language LearnersVIII.Students with Disabilities

9

Test Administration Manual Requirements

• School Test Coordinators must read and understand Parts I – VIII and the appendices.

• Test Administrators must read and understand Parts I – V and Appendices A & Q, as well as appendices specific to assessments which they will be administering.

10

11

• The Assessment options generally are the same this year as last year, except high school is now grade 11 and there is no OAKS Paper/Pencil or Large Print tests

• Oaks Online Writing will be available to all Grade 7 and HS students

• STCs must ensure that a student does not use OAKS Online in the content area in which a student will use a paper test (e.g., Braille, Extended, or Paper/Pencil Writing)

In a Nutshell

12

Oregon Assessment of Knowledge and Skills (OAKS)

• OAKS Online • OAKS Braille• OAKS Writing Performance Assessment• OAKS Extended• English Language Proficiency Assessment

(ELPA)

• Appendices includes information about PSAT, NAEP, and Work Samples

13

Required Assessment Options

• Reading & Math: at grades 3 – 8, and 11• Science: at grades 5, 8, and 11• Writing: at grades 4, 7, and 11

Students in grades 9, 10, and 12 may also take the High School level test.

14

Online Assessment Options

• Reading & Mathematics: Up to 3 online opportunities at grades 3 – 8, and 11

• Science: Up to 3 online opportunities at grades 5, 8, and 11

• Writing: 1 online opportunity – grades 7 & 11

Students in grades 9, 10, and 12 may also take the grade 11 test.

15

Up to 3 Online Opportunities

Multiple Opportunities are a means of limiting the impact of the “real world” on a student’s results including: Adult errors, network problems, student illness, etc. Therefore 3 opportunities for each student are not guaranteed.

16

OAKS Writing Assessment

OAKS Paper Writing Performance • 1 opportunity at grades 4, 7, and 11.

OAKS Online Writing Performance• 1 opportunity at grades 7 & 11.

• Students in grades 9, 10 and 12 may also take the High School level test.

• Students must not under any circumstance take more than 1 opportunity!

17

OAKS Extended Assessments

• Reading & Math : 1 opportunity at grades

3 – 8, and 11.

• Science: 1 opportunity at grades 5, 8, and 11.

• Writing: 1 opportunity at grades 4, 7, and 11.

18

OAKS General Review

• The Assessment options generally are the same this year as last year

• ELPA will be integrated into OAKS Online

• OAKS online or paper writing will be available to all grade 7 and H.S. students, but each student only has 1 writing opportunity.

19

School Test Coordinator Role

• May set school test schedules for OAKS tests.• Must coordinate determination of appropriate

assessment options for students.• Must coordinate secure storage, distribution, and

inventory of paper test materials for the school.• Must ensure that all test administrators receive test

administration and security training.• Must report any test improprieties.• Help code students who do not test because they were

not enrolled during the school test window using Administration Code 8 in student centered staging.

• May not Set school test schedules for Extended Assessments or the ELPA.

20

Test Administrators

• TAs must read the 2010-11 Test Administration Manual, receive annual test administration and security training, and sign an Assurance of Test Security form before administering state tests.

• TAs may only provide upon request students with allowable resources listed by content area in the 2010-11 Test Administration Manual Appendices.

• TAs may only provide the version of allowable resources provided by ODE. These are posted online at

http://www.ode.state.or.us/search/page/?=2346• TAs must read verbatim the student directions provided by

content area in the 2010-11 Test Administration Manual Appendices.

• TAs must sign the Test Security form in order to administer tests.

21

Test Administrators

• TAs may not allow untrained aides, volunteers, or substitutes to assist with test administration.

• TAs may not coach students (including requiring students to show their work).

• Students may not access non-allowable resources such as textbooks or class notes

• Students must not talk to or help other students during testing.

22

Test Administrators

• TA reviews the Test Administration Manual before testing, focusing on test security and content-specific allowable resources and accommodations.

• TA spaces students appropriately or provides visual barriers to prevent students from seeing others’ tests.

• TA reads student directions verbatim and circulates through test environment to ensure proper testing conditions.

• TA makes available but does not require students to use allowable resources.

23

Test Administrators Review

• TAs must receive training each year

• TAs enforce valid test environment for students

• When in doubt about a particular testing practice:

– Check the Manual

– Check your training notes

– Ask your School Test Coordinator

– If all else fails, assume the answer is “no”

24

Test Security

• Purpose: To protect the integrity and confidentiality of secure test items, prompts, and passages. The security of these materials is necessary so that they can be used in later years to measure trends in performance. In addition, test security helps to ensure test results can be used in accountability reporting

• Definition: A test impropriety is any instance where a test is not administered in a manner consistent with the Test Administration Manual or OAR 581-022-0610 Administration of State Tests

25

Secure Testing Environment

• A quiet environment, void of distractions and supervised by a trained test administrator

• Visual barriers or adequate spacing between students

• Student access to only allowable resources

• All paper test materials collected and accounted for after each testing event

• Student data is treated as confidential

26

• Reading aloud words, numbers and symbols on OAKS math test is allowable – see Read-Aloud handout for grade 3-5, 6-8 and HS

• Test Administrators may not explicitly or implicitly direct a student to identify reasons or strategies used to determine test answers, nor otherwise provide instructional or learning strategies for guidance during the assessment process (see Administration Manual for examples of Allowable Resources)

• Any teacher review or analysis of test items constitutes a breach in test security – both districts and teachers are responsible

• Do not score the tests or otherwise give students any feedback as to how well you believe they are performing

Secure Testing Environment

27

Test Security Do’s

• TAs must ensure that students use the correct SSID and take the correct test.

• TAs must securely shred test materials such as reading passages, scratch paper, or other paper hand-outs written on by students after each testing event

• Test materials must be securely stored at all times

• Test improprieties must be reported to ODE within 1 day of learning of them and the investigation must be completed within 30 days.

• If a DTC can not investigate an impropriety, the district must assign someone else to the task

28

29

Test Security Don’ts

• TAs must not review or analyze secure test items

• Students must not access non-allowable resources such as cell phones, iPods, or e-mail

• Students must not remove test materials from the test environment

• TAs must not copy or retain any test materials, including secure test booklets, writing prompts, or reading passages

• DTCs, STCs, and TAs must not share their TIDE log-in information with anyone (even other authorized TIDE users)

30

Test Security Do’s

• Using colorful materials to identify which students have printed reading passages remaining at their stations

• When setting up the test environment, the TA should ensure that the TA’s computer is set to print in the computer lab where the students are testing.

• The TA uses the class roster to mark which students received printed reading passages and then matches the class roster to the printed reading passages collected at the end of the testing event to account for all printed reading passages

31

Security Review

• Test materials must be inventoried and securely stored both before and after each testing event.

• Only authorized staff who have signed an Assurance of Test Security Form may have access to secure test materials.

• Scratch paper and all other printed materials written on by students during testing must be collected and securely shredded at the end of each testing event.

• DTCs must report all test improprieties to ODE within 1 day of learning of them. Report form is available at:

www.ode.state.or.us/go/testsecurity

32

New TIDE System (Test Information Distribution Engine)

• Centralized login to access multiple OAKS systems

• Found at www.oaks.k12.or.us

• Includes test administration, training, practice tests and online reporting system

• New design for ease-of-use and simplified navigation

• View performance data from previous test administrations

33

Student Information for OAKS Online (See Appendix B for Student Directions)

• SSID• Student’s legal name• Student’s enrolled grade• Language of assessment (English or Spanish)• Print size• Any student restrictions for accessing OAKS online

for students taking Braille or Extended Assessments• Accommodations to be administered to the student

34

35

Test Administration Procedures

• Oregon assessment tests are NOT timed tests

• Students should be allowed to continue working as long as they are making reasonable progress

• Administering the test in smaller segments is an acceptable practice (remember test security)

• Providing less time than indicated by the guidelines in the Test Administration Manual is an extreme disadvantage to students

• If a student “rushes” through the test, this will be counted as one of their opportunities. Test Administrators must monitor student progress to reduce this risk.

36

Breaking Up the Test

• If you know you will be administering the test in multiple sessions, remind students before they begin testing that they will be resuming the test at another date/time

• When students resume a test, the test will start on the same number/passage where he/she previously stopped

• If a student pauses an OAKS Online test for 20 minutes or more, the student will not be able to return to previously answered or marked questions.

• When resuming a test, Test Administrators should review the process and re-read the student directions.

37

Student Readiness for Testing

– Familiarize students with test format by allowing them to take Sample/Practice Tests, if available

– Explain to students that the purpose of the assessment is to “measure your current progress on state content standards” and remind them that “I can’t help you with reading passages, test questions, test answers or formulas.”

– Encourage students to “do their best”

38

Accommodations Overview

Accommodation — a change in how a test is presented to or responded to by a student.

– Provides the student equal access and equal opportunity to demonstrate proficiency.

– Is considered “standard administration;” students have the opportunity to “meet” or “exceed” the standard.

– Should be consistent with support provided during individual student’s instruction.

– Listed at www.ode.state.or.us/search/page/?=487

39

• Necessary accommodations should be identified and implemented during classroom instruction prior to the student’s participation in the state assessment. Accommodations used in state assessment must have been previously approved by the Accommodations Panel and listed in the Accommodations

Accommodations

40

• For students with disabilities who take the general education assessment, accommodations must be coded. OAKS tests allow for test administrators to pre-set the flag in TIDE or to set the flag during approval for testing.

• In Tide, the required field is “Number of Accommodations”.

• More detailed codes are optional this year. This field is called “Accommodation Code”.

• Different naming convention in Student Centered Staging.

Accommodations

41

• Refer to the accommodations tables and or manual as posted for accommodations implementation guidance.

• Refer to student’s IEP or classroom practices to determine which accommodations should be provided.

• Note that although writing prompts may now be translated locally, they must be completed in advance by a trained translator endorsed by the district and must be stored securely. Translator also needs to be trained in Test Security and sign an Assurance of Test Security form.

Accommodations Do’s

42

• TAs may now read numerals and math symbols aloud on the math test if they follow the guidance and examples posted on the ODE website.– In general, numbers and symbols can be read according

to their common English usage. For example, > would be read as “is greater than.”

– Numbers 99 and less should be read using standard place value language. For example, 23 would be read as “twenty-three.”

– However, numbers greater than 99 should be read as individual numbers. For example, 579 would be read as “five seven nine.”

Accommodations Do’s

43

• TA may not instruct students to print reading passages.

• TAs may not provide instruction or give suggestions regarding process.

• TAs may not read Reading items or response choices aloud.

• Do not choose to administer an accommodation for all students in a class or a grade.

• TAs may not read ELPA items or response choices aloud.

• Items may not be translated.

• If you can’t find it in the TAM, don’t do it.

Accommodations Don’ts

44

Extended Assessments

• Extended assessments must be identified on a student’s IEP

• IEP teams should determine whether the student would be best served by the standard or scaffolded extended assessment

• Results will be included in AYP calculations

• Only “qualified” assessors should administer extended assessments

45

ELPA - English Language Proficiency Assessment

• Enrolled after May 1, 2010 – Must take ELPA and OAKS Math & Science

• Enrolled before May 1, 2010 – must take ELPA and all other OAKS tests

• Must be flagged for ELPA in SSID system prior to ELPA testing

46

English Language Proficiency Assessment (ELPA)

• 1 opportunity for grade bands:

K – 1, 2 – 3, 4 – 5, 6 – 8, and 9 – 12.

• ELPA will be integrated into OAKS Online.

47

DIBELS, Maze & Common Math

DIBELS Grades K – 5Sept 24, Dec 3, March 16 & June 3

Maze (optional)

Grades 6 – 8 September & March

Common Math

Grades K – 8Pre & Post Test

at Trimester

48

Writing Test Schedule

• Grades 4, 7, & HS students Paper & Pencil– January 12- February 24– For HS students only: April 13 – 28

• Online Writing for grade 7 & HS students – January 12 to March 17

• Students in High School must not under any circumstance take more than 1 opportunity.

49

Essential Skills

• Class of 2012 (Juniors) – Reading

• Class or 2013 (Sophomores) – Reading and Writing

• Class of 2014 (Freshmen) – Reading, Writing and Apply Mathematics

50