The North Carolina Alternate Assessment Academic Inventory Pamela F. Biggs Education Consultant Technical Outreach for Public Schools North Carolina State.

The North CarolinaAlternate AssessmentAcademic Inventory

Pamela F. BiggsEducation Consultant

Technical Outreach for Public SchoolsNorth Carolina State University

Conference on Exceptional ChildrenOctober 2003

What is the NCAAAI?

• Year-long or course-long assessment

• Checklist of objectives based on the NCSCS scored using individual scales for each content area:– Reading (Assigned Grades 3-8, 10)– Mathematics (Assigned Grades 3-8, 10)– Writing (Assigned Grades 4, 7, 10)– End-of-Course (EOC) (Nine courses)

• Collection of evidence to support scores

Why was it developed?

• Individuals with Disabilities Education Act (IDEA) of 1997

– All students, including those with IEPs or Section 504 plans, must participate in the statewide testing program.

– NC Alternate Assessment Portfolio (NCAAP)

– NC Computerized Adaptive Testing System (NCCATS) Accommodation

North Carolina Testing

Program

End-of-Grade Test without Accommodations

Alternate Assessment Academic Portfolio (NCAAP)

Alternate Assessment Academic Inventory (NCAAAI)

End-of-Grade Test with Accommodations

Which EC students are eligible?

Students with Disabilities are eligible if they

– Have current IEP or Section 504 Plan

– Are following the Standard Course of Study which includes the Occupational Course of Study

– Are unable to access statewide testing with or without the use of accommodations

– Are assigned to grade level 3-8, or 10, or are enrolled in an End-of-Course (EOC) subject

Who decides participation?

IEP team decides

– if an eligible student will participate in the NCAAAI

– the grade level at which the student will be assessed

Key Terms

• Assigned Grade Level – Determined by School Principal– What student is listed as in student

management system (Ex. SIMS,NCWISE)

• Assessed Grade Level – Determined by IEP Team– May be below assigned grade level for

reading and math (EC only)– Must be at assigned grade level for writing

Who completes it?

• Must have training in content area

• Must work routinely with the student

• Principal assigns assessor

• May be more than one assessor for an inventory

• Often general education, EC, or ESL teacher

• Ideal (depending on student’s instruction) – combination of general ed. and EC teachers

How is it scored?

• Classroom Assessment/Performance

• Descriptions of Student Performance

• Every objective scored using 1-8 scale three times per year

• Overall score derived from objective scores

• Growth defined by improvement in any objective

MATHEMATICS SKILLSNorth Carolina Testing Program

North Carolina Alternate Assessment Academic InventoryDescription of Student Performance

Descriptors Description of Performance

Distinguished8 – High7 – Low

Student consistently demonstrates mastery beyond grade-level skills,strategies, competencies, and expectations.

Student makes applications and extensions beyond grade level.

Proficient6 – High5 – Low

Student consistently demonstrates mastery of grade-level skills,strategies, and competencies.

Student responds with appropriate answers or procedures.

Apprentice4 – High3 – Low

Student occasionally demonstrates mastery of grade-level skills,strategies, and competencies.

Student sometimes responds with appropriate answers or procedures.

Novice2 – High1 – Low

Student rarely or never demonstrates mastery of grade-level skills,strategies, and competencies.

Student frequently responds with inappropriate answers and/orprocedures.

ScaleNovice Apprentice Proficient Distinguished

1 2 3 4 5 6 7 8

Description of Student Performance

When is it scored?

• BaselineFirst 30 days of student participation

• InterimMidpoint in student participation

• FinalLast 30 days of student participation

Fall 2003 Training

Checklist Completion Training

• Train-the-Trainer Model

Regional Accountability Coordinators (RACS)

• LEA Test Coordinator (TC) trains local TC

• Training for local staff through TC or other LEA staff

Fall 2003 Training (cont’d)

Supplemental training: Linking Instruction with Assessment– See training website

• //www.ncpublicschools.org/accountability/testing/ ncaaaitraining

– To register for remaining Math sessions• Check website for space availability• If space available, contact

Hope Tesh

[email protected]

(919)807-3778

NEW for 2003-2004

• Evidence required for 2 objectives in– Each category for reading– Each section for math– Each goal for writing– Each goal or section for EOC

• Evidence required at Baseline and Final Data Collection

• NEW Evidence Collection Sheet

READING, MATHEMATICS, AND WRITING NCAAAI (Grades K-2-IEP/504 ONLY, 3–8, and 10) EVIDENCE COLLECTION SHEET

Directions: A separate EVIDENCE COLLECTION SHEET is required for each goal, category, or section. List all evidence for a goal on one sheet. If necessary, use a second copy of this sheet to continue to document evidence for the goal. If a piece of evidence is used for more than one goal or content area, it must be documented on an EVIDENCE COLLECTION SHEET corresponding to each goal with another copy of the attached evidence. All information must be completed below. (Exception: do not complete the Directions Given to the Student column if the directions are clearly printed on the attached evidence). STUDENT NAME: SCHOOL NAME: STUDENT ID: Circle All that Apply for Student: LEP IEP 504 ASSESSOR NAME (for this piece of evidence): Subject (Circle one): Reading Math Writing Position (Circle one): Classroom Teacher LEP Teacher EC Teacher Other

NC SCS Objective

Number(s)

Type of Evidence

(Use Codes)

Date of Activity or Evidence

Title of Activity or Evidence (Must be printed on the

attached evidence)

Directions Given to the Student (if not clearly printed on the

attached evidence)

Teacher Cue Levels (Use Codes)

Student Responses

(Use Codes)

Score (e.g., 9/10, 90%, 90)

*Evidence Codes Evidence Types Code

Student Work Samples WS or SW **Teacher Observation TO Local Test LT Teacher-Made Test TT Data Sheet DS *Other Specify

* See the Test Administration Guide for more details. Some evidence types CANNOT be used.

** Comments MUST be attached to support any TO.

Teacher Cue Levels Teacher Cue Levels Code

None (No Cue) NC Verbal Cue VC Prompt Cue PC Written Cue WC Scribe SC Other Specify

Student Responses Student Responses Code

Independent (No Cue) IR Gestural GR Written WR Verbal VR Model MR Computer-Generated CR Student Revised Work SR No Response NR Other (e.g., used dictionary) Specify

Evidence Collection Sheet

TEACHER OBSERVATION COMMENTS (Optional)

Comments MUST be provided for all Teacher Observations to accompany the Evidence Sheet. BOTH parts must be completed for Teacher Observation evidence: (1) evidence sheet and (2) comments. This sheet is an optional sheet to use to document teacher comments although other formats may be used for teacher documentation/comments. A Teacher Observation must be a specific event including directions, observations, and quantification. Supporting comments MUST be specific.

Objective Number(s): ______________________________________________ Date of Activity:_______________________________________________________________________________________ Activity/Task Title:_________________________________________________________________________________________ Directions to Student:_______________________________________________________________________________________ Student’s Response/Result:________________________________________________________________________________ Extra Comments: _______________________________________________________________________________ ______________________________________________________________________________________________ ______________________________________________________________________________________________ ______________________________________________________________________________________________ ______________________________________________________________________________________________

Objective Number(s): ______________________________________________ Date of Activity:_______________________________________________________________________________________ Activity/Task Title:_________________________________________________________________________________________ Directions to Student:_______________________________________________________________________________________ Student’s Response/Result:________________________________________________________________________________ Extra Comments: _______________________________________________________________________________ ______________________________________________________________________________________________ ______________________________________________________________________________________________ _____

Optional Teacher

Observation Form

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Student Name _____________________ Objective No. _____________________ Date Assessed ____________________ Evidence Code ____________________ Score ___________________________

Optional Evidence Labels

NEW for 2003-2004 (cont’d)

• LEP/IEP/504 designation added• NEW Principal Checklist (Optional)• Principal must sign name, not use stamp• Photographs, videotapes, audio tapes, computer

disks– Should not be physically included– Performance data can be written as teacher

observation

• Overall score boxes moved to bottom of score summary chart

North Carolina Alternate Assessment Academic Inventory

Student Name _____________________________________

Student ID# _______________________________________

Assessor Name ____________________________________

School Year _______________________________________

Assigned Grade Level (circle one): 3 4 5 6 7 8 10

Circle All That Apply: LEP IEP 504

Did the student achieve growth in Reading Performance?

YES____ NO ____

Reading Skills

3rd Grade

Baseline

(Date)

Interim

(Date)

Final

(Date)

CATEGORY

1 Cognition 1

CATEGORY

2 Interpretation 2

CATEGORY

3 Critical Stance 3

CATEGORY

4 Connections 4

FINAL

READING

SCORE

Reading Skills Scale Placement Score (Categories 1, 2, 3, and 4)

Scale Novice Apprentice Proficient Distinguished

1 2 3 4 5 6 7 8

(Baseline) Signature (Assessor)___________________________________ Date___________________

(Interim) Signature (Assessor)___________________________________ Date___________________

(Final) Signature (Assessor)_____________________________________ Date___________________

(Final) Signature (Principal)____________________________________ Date___________________

Be sure to answer this question!

LEP/IEP/504 designation

Don’t forget the overall

scores!Assessor(s) and

principal must sign, not stamp their

names

Web Resources

//www.ncpublicschools.org/accountability/ testing/ncaaai

• Reproducible Evidence Forms

• FAQ

• Step-by-Step Guide

• Curricular Links

Coming Attractions

• Format Redesign– NCDPI Test Development and Curriculum Staff,

TOPS Test Development Staff– Stakeholder Input

• Listserv

• 2004 Summer Training Sessions– Regional– Registration before end of school year

• Science NCAAAI field test in 2005-2006 for grades 5, 8, 10

NCAAAI Timeline

• August (January for spring EOCs)– Inventories available for download by TC – Orders submitted via online ordering system– Orders filled by TOPS– Baseline data collection

• Midpoint in student participation– Interim data collection

Timeline (cont’d)

• Last 30 days of course/year– Final data collection– Overall scores completed – Student information sheets completed

• NCAAAI student information sheets scanned and locally stored

• August – Audit

Further Questions?

• Visit NCAAAI website

//www.ncpublicschools.org/accountability/ testing/ncaaai

• Contact Pam Biggs [email protected]

(919)515-1431