North Carolina Department of Public Instruction Division of Accountability Services/Testing Section September, 2002 1 Hope Tesh-Blum Division of Accountability.

1

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionSeptember, 2002

Hope Tesh-BlumDivision of Accountability Services

Testing Section

The North Carolina Alternate Assessment Academic Inventory

2


• Individuals with Disabilities Education Act (IDEA) of 1997– All students, including those with IEPs or

Section 504 plans, must participate in the statewide testing program.

– NC Alternate Assessment Portfolio (NCAAP)– NC Computerized Adaptive Testing System

(NCCATS) Accommodation

Why was the NCAAAI Developed?

3


New Way of Thinking• The NCAAAI is an ALTERNATE

ASSESSMENT for ANY student who cannot access the traditional test even with accommodations (must meet requirements).

• Students with Disabilities just happened to be the first group required by federal law.

4


What is the NCAAAI?• Checklist of competencies based on the

NCSCS scored using individual scales for each content area:– Reading (Grades 3-8, 10)– Mathematics (Grades 3-8, 10)– Writing (Grades 4, 7, & 10)– EOC (Pilot Spring 2003)

• Envelope format• Collection of evidence to support FINAL scores

5


What’s New?

• No Child Left Behind

• No exemptions

• Same standard, Same content

• Options:– Multiple-Choice Test

– State-Developed Portfolio

– Checklist

6


ESEA Requirements: Changes for 2002-03?

North Carolina Department of Public InstructionDivision of Accountability Services/Testing Section

Reading and Math at grades 3-8 annually & 10-12 spanScience (2005-06) in each grade span (3-5, 6-9, &10-12)LEP Students tested in English at 3 consecutive years in USAnnual measurable assessment of All students

7


Which EC students are Eligible?• Current Individualized Education Program

(IEP) or Section 504 Plan• Following the NC Standard Course of Study

(NC SCS) {important}

• Unable to access statewide testing with or without accommodations {important}

• Assigned grade level of 3-8 or 10

8


Who decides?

• The IEP TeamIEP Team determines student participation in the NCAAAI and the grade level at which the student will be assessed.

• Assigned grade level is determined by the School PrincipalSchool Principal.

• Different options

9


Why should you use the NCAAAI?• Flexibility in showing performance

• Show growth

• Instructional value from year to year

• No test anxiety for the student

• AYP

• OCR

10


Who Completes?

• Must have training in the content area

• Must work routinely with the student

• Principal has authority

• HSCT

11


Concerns and Quandaries

• No Exemptions

• NC Standard Course of Study (NC SCS)

• Workload/Myths

• Training

• It’s STILL NEW

• Adding LEP Students

12


Training?

• Train-the-Trainer Model (RACS)• LEA TC trains the Test Coordinator

– Training for local staff is a collaboration between Testing and LEA staff (local decision)

• NCDPI/EC Training (Summer 2002)

• Testing Section Training (Fall 2002)

13


Training Website

www.ncpublicschools.org/accountability/testing/ncaaaitraining/

Registration by City (10 Sites)Lists of ParticipantsSites/Directions to be announcedEC and LEP Sessions

14


LEP & IEP

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionAugust 28, 2002

• Which is the overriding factor?

–No definitive guidelines

–Best judgement

–Review the different testing instruments

15


When are the Inventories Scored?

• Three times per year– First month of participation=Baseline data– Interim Month– Last month of school=Final data

• Evidence is collected to support Final Spring scores Only.

16


How is the Inventory Scored?

• Description of Student Performance to give each competency a score from 1-8

• Objectives by Goals, Categories, or Sections

• Overall Score

• Growth is ANY growth


17

MATHEMATICS SKILLSNorth Carolina Testing Program

North Carolina Alternate Assessment Academic InventoryDescription of Student Performance

Descriptors Description of Performance

Distinguished8 – High7 – Low

Student consistently demonstrates mastery beyond grade-level skills,strategies, competencies, and expectations.

Student makes applications and extensions beyond grade level.

Proficient6 – High5 – Low

Student consistently demonstrates mastery of grade-level skills,strategies, and competencies.

Student responds with appropriate answers or procedures.

Apprentice4 – High3 – Low

Student occasionally demonstrates mastery of grade-level skills,strategies, and competencies.

Student sometimes responds with appropriate answers or procedures.

Novice2 – High1 – Low

Student rarely or never demonstrates mastery of grade-level skills,strategies, and competencies.

Student frequently responds with inappropriate answers and/orprocedures.

ScaleNovice Apprentice Proficient Distinguished

1 2 3 4 5 6 7 8

18


Achievement Levels: Final Spring Overall Score• Assessed On-Grade

Level:– Level 4 (7-8)– Level 3 (5-6)– Level 2 (3-4)– Level 1 (1-2)

• Assessed Off-Grade Level:– Student may only

receive a Level 1 or Level 2

– Grade level standard

19


On v/s Off Grade Level

• LEP Students cannot be assessed off-grade level

• EC students may be assessed off-grade level

• Writing cannot be assessed off-grade level– options

20


Examples of Evidence

• Local Tests (LT)

• Samples of Student Work (SW)

• Teacher Observations (TO)

• Teacher-Made Tests (TT)

• Audio Tapes (AT)

• Other (specify) – Any Means to show performance

21


Reporting

• 2001-2002 Operational

—Locally scanned—School rosters—Frequency distributions—Individual Student Report—Summary Reports—Preliminary Report/Green Book

22


Data Collection 2002-03

• Scores transferred to scannable sheets during the last month of school

• Local Test Coordinators scan the sheets

• Data transferred to the NCDPI during the end-of-year process

• Student Notebooks will be stored locally for six months (sample returned)

23


2001-02 Sample Review (and 2002-2003)

• April 1 release of LEA sample list/10%

• Return everything (inventories, evidence, forms, etc.)

• Report percentages for each area to the LEA

• Review in August

• Return to LEAs in September

24


NCAAAI and the ABCs

2001-20022001-2002• Operational

administration• Performance

Composite

2002-20032002-2003

• Operational administration Operational administration for Grades 3-8 &10for Grades 3-8 &10

• Pilot administration for Pilot administration for EOC (Spring only)EOC (Spring only)

• Pending data analysisPending data analysis– Growth ComponentGrowth Component

• Performance CompositePerformance Composite

25


2002-2003 Timeline

• August 2002– Inventories available

on-line (TNN) to TC– Order system up

• August-Sept. 2002– Intact NCAAAI are

shipped– Begin Baseline

• May-June 2003– NCAAAIs scanned and

locally stored• July-August 2003

– Audit

26


More Information

• Testing Section Website:http://www.NCPublicSchools.org/accountability/testing

• Regional Accountability Coordinators may be contacted for questions

• Exceptional Children Website: http://www.ncpublicschools.org/ec/

North Carolina Department of Public Instruction Division of Accountability Services/Testing Section September, 2002 1 Hope Tesh-Blum Division of Accountability.

Documents

testing section training

final scores slide

portfolio checklist

different options slide

authority hsct slide

student ayp ocr slide

test coordinator training

training website