Systems Performance Review & Improvement (SPR&I) Training Oregon Department of Education Fall 2007.

Systems Performance Systems Performance Review & Improvement Review & Improvement

(SPR&I) Training(SPR&I) Training

Oregon Department of EducationOregon Department of Education

Fall 2007Fall 2007

Training OverviewTraining Overview

Please sure to sign in – include Please sure to sign in – include what district/program you are what district/program you are representingrepresenting

You should have a packet of You should have a packet of handouts (EI/ECSE or school handouts (EI/ECSE or school age) and today’s agendaage) and today’s agenda

IntroductionsIntroductions Agenda review (today and Agenda review (today and

tomorrow)tomorrow)

AgendaAgenda Day 1Day 1

General supervision overviewGeneral supervision overview Data: Timely & accurate, usesData: Timely & accurate, uses Final determinations: School age and EI-Final determinations: School age and EI-

ECSE - breakoutECSE - breakout Compliance: Correction of Compliance: Correction of

noncompliance and policies procedures noncompliance and policies procedures updateupdate

TransitionTransition Day 2Day 2

Updates Updates Transition continuedTransition continued Comprehensive file review and Comprehensive file review and

personalized technical assistancepersonalized technical assistance

State Performance

Plan

Policies, Procedures, and Effective

Implementation

Data on Processes

and Results

Targeted Technical

Assistance & Professional Development

Effective Dispute

Resolution

Integrated Monitoring Activities

Improvement, Correction,

Incentives & Sanctions

Components of General Supervision: District perspective

Fiscal Management

State Performance Plan

Consists of compliance and performance indicators covering parts B (20) and C 14) of IDEA

Implementation of the SPP leads to improved results

Reporting is critical to ensuring accountability to the public

The SPP is the blueprint for systems change

State Performance

Plan

Policies, Procedures & Effective Implementation

Need to be aligned with IDEA Can use ODE or OSBA versions Need to have methods to detect

noncompliance and ensure correction of noncompliance (SPR&I)

Program improvement through strategic planning and trainingPolicies,

Procedures & Effective

Implementation

Effective Dispute Resolution

Are timely Track issues Inform improvement activities Should influence process Determine that parents and

families and students understand their rights, especially in cases where there are few or no complaints, hearings, or other resolutions

Effective Dispute

Resolution

Data on Processes & ResultsCollection

• Multiple data submissions• SPR&I - PCR and KPI

Examination and analyses• Areas of concern (thresholds) • Analysis of related indicators (worksheets)

Reporting• LEA Performance compared to state targets

(Special Education Report Card)Status determination

• 4 categories (same as for states)• Enforcement activities

Improvement• Data are used to plan and revise activities(single file corrections and trainings for

systemic change)

Data on Processes & Results

Integrated Monitoring Activities

Investigation related to noncomplianceActivities include continuous examination

of process for compliance and performance (file reviews)

Need to show evidence of correction and improvement

Technical assistance and professional development support improvement and correction

Integrated Monitoring Activities

Targeted Technical Assistance & Professional Development

Directly connected to the SPR&I and improvement activities

Provided to correct noncompliance and improve results

Measure effectiveness of implementation Distribute promising practices and

evidence based practices to local schools/programs

Targeted T/A &

Prof Dev

Improvement, Correction, Incentives & Sanctions

Ensure timely correction of noncompliance

Improvement planning to meet key performance targets

Corrective action planning and follow-up tracking of correction and improvement

Impacts the annual determination of districts/programs

Incentives? Sanctions?

Improvement & Correction,

Incentives & Sanctions

Fiscal Management Funds distributed in accordance with

federal requirements

Funds are used in accordance with federal and state requirements

States provide oversight on the use of funds

Funds are aligned to problem areas in the SPP/APR

Fiscal Management

Describing a ‘System’ Describing a ‘System’ of General Supervisionof General Supervision

Problems in DescriptionProblems in Description Equating general supervision as Equating general supervision as

only being monitoredonly being monitored Viewing administration as a Viewing administration as a

collection of separate and isolated collection of separate and isolated functionsfunctions

Defining accountability as an event Defining accountability as an event rather than a ‘state’ and processrather than a ‘state’ and process

Others?Others?

DiscussionDiscussion

Take five – ten minutes to Take five – ten minutes to discuss with your team:discuss with your team: How comprehensive is your current How comprehensive is your current

system?system? What are the strengths – What are the strengths –

weaknesses?weaknesses? What are specific challenges you What are specific challenges you

face?face? What have you done to overcome What have you done to overcome

those challenges?those challenges?

State Performance

Plan

Policies, Procedures, and Effective

Implementation

Data on Processes

and Results

Targeted Technical

Assistance & Professional Development

Effective Dispute

Resolution

Integrated Monitoring Activities

Improvement, Correction,

Incentives & Sanctions

General Supervision - State integrated system

Fiscal Management

The componentsThe components Each of the Big 8 is required by IDEA Each of the Big 8 is required by IDEA

and the and the General Education General Education Provisions Act (Provisions Act (GEPA)GEPA)

ODE has established an integrated ODE has established an integrated system to assist districts/programs system to assist districts/programs (SPR&I – focused (SPR&I – focused monitoring/assistance)monitoring/assistance)

System is continuously being updated System is continuously being updated based on OSEP directives and ODE based on OSEP directives and ODE refinements (district feedback)refinements (district feedback)

Understanding system and updates is Understanding system and updates is crucial for ongoing compliance and crucial for ongoing compliance and improved outcomes improved outcomes

Why an “Integrated System”?Why an “Integrated System”?

General Supervision system must General Supervision system must be accountable for:be accountable for: improving educational results and improving educational results and

functional outcomesfunctional outcomes ensuring that public agencies meet ensuring that public agencies meet

program requirementsprogram requirements

To be effective, components mustTo be effective, components must connectconnect interactinteract articulatearticulate inform each other inform each other

Integration of Integration of Big 8 Big 8 ComponentsComponents

1.1. State Performance Plan (SPP)State Performance Plan (SPP)2.2. Policies, Procedures, and Effective Policies, Procedures, and Effective

ImplementationImplementation3.3. Data on Processes and ResultsData on Processes and Results4.4. Targeted Technical Assistance and Targeted Technical Assistance and

Professional DevelopmentProfessional Development5.5. Effective Dispute ResolutionEffective Dispute Resolution6.6. Integrated Monitoring ActivitiesIntegrated Monitoring Activities7.7. Improvement, Correction, Incentives Improvement, Correction, Incentives

and Sanctionsand Sanctions8.8. Fiscal ManagementFiscal Management

State Performance

Plan

Policies, Procedures, and

Effective Implementation

Data on Processes

and Results

Targeted T/A & Professional

Development

Effective Dispute

Resolution

Integrated Monitoring Activities

Improvement, Correction,

Incentives & Sanctions

Fiscal Manage-

ment

What is‘System ?’

State Performance Plan State Performance Plan

Blueprint for systems changeBlueprint for systems change All other components must be All other components must be

integrated with SPPintegrated with SPP

SPP- Part C• Indicator 1: Timely Service Delivery• Indicator 2: Settings• Indicator 3: Child Outcomes• Indicator 4: Family Outcomes• Indicator 5: Child Find Birth -1• Indicator 6: Child Find Birth - 3• Indicator 7: Timeliness of IFSP• Indicator 8: Early Childhood Transition• Indicator 9: Part C Monitoring System• Indicator 10: Administrative Complaints

SPP - Part C cont’d

• Indicator 11: Due Process Hearings

• Indicator 12: Resolution Agreements

• Indicator 13: Mediations

• Indicator 14: Data Accuracy

SPP – Part B• Indicator 1: Graduation• Indicator 2: Dropout• Indicator 3: Statewide Assessment• Indicator 4: Suspension/Expulsion• Indicator 5: LRE Placement• Indicator 6: Preschool Settings• Indicator 7: Preschool Skills• Indicator 8: Parent Involvement• Indicator 9: Disproportionate Rep. in Sped• Indicator 10: Disproportionate Rep. in specific

disability category

SPP – Part B cont’d• Indicator 11: Child Find• Indicator 12: Part C to B Transition• Indicator 13: Secondary Transition w/IEP Goals• Indicator 14: Secondary Transition/Post School

Outcomes• Indicator 15: Monitoring, Complaints & Hearings• Indicator 16: Written Complaints• Indicator 17: Due Process Hearings• Indicator 18: Hearing Requests that went to

Resolution• Indicator 19: Mediations• Indicator 20: Timeliness of State Reported Data

& Reports

Public ReportingPublic Reporting

Make the state’s performance plan Make the state’s performance plan available through public means, available through public means, including by posting on the state including by posting on the state educational agency’s (SEA’s) website, educational agency’s (SEA’s) website, distribution to the media, and distribution to the media, and distribution through public agenciesdistribution through public agencies

http://www.ode.state.or.us/initihttp://www.ode.state.or.us/initiatives/idea/spp_apr2005.docatives/idea/spp_apr2005.doc

SPP years and corresponding SPP years and corresponding APR due datesAPR due dates

1. 2005-06 – February 20071. 2005-06 – February 2007

2. 2006-07 – due February 20082. 2006-07 – due February 2008

3. 2007-08 – due February 20093. 2007-08 – due February 2009

4. 2008-09 – due February 20104. 2008-09 – due February 2010

5. 2009-10 – due February 20115. 2009-10 – due February 2011

6. 2010-11 – due February 20126. 2010-11 – due February 2012

Policies, Procedures and Effective Policies, Procedures and Effective ImplementationImplementation Aligned with IDEAAligned with IDEA District/program policies and procedures District/program policies and procedures

aligned with statealigned with state District/program policies and procedures District/program policies and procedures

designed and implemented to improve designed and implemented to improve resultsresults

District/program policies and procedures District/program policies and procedures personnel adequately prepared personnel adequately prepared

Establish and maintain specifications for Establish and maintain specifications for highly qualified personnelhighly qualified personnel

State and districts/programs have written State and districts/programs have written policies and procedures in place, including policies and procedures in place, including assurances (April 08)assurances (April 08)

Required memoranda of understanding Required memoranda of understanding (MOUs) in place and current(MOUs) in place and current

Data on Processes and ResultsData on Processes and Results Collection and verificationCollection and verification

618618 Dispute resolutionDispute resolution Previous monitoring efforts (SPR&I database & Previous monitoring efforts (SPR&I database &

onsite visits)onsite visits) Examination and analysesExamination and analyses

Areas of concern across the state Areas of concern across the state Clusters of related indicators (FAPE, LRE, Clusters of related indicators (FAPE, LRE,

Disproportionality)Disproportionality) ReportingReporting

Annual Performance Report (APR) Annual Performance Report (APR) LEA performance against state targets (Special LEA performance against state targets (Special

Education Report Card)Education Report Card) Annual status determination for each Annual status determination for each

district/program (final determinations)district/program (final determinations) ImprovementImprovement

Data are used to plan and revise activitiesData are used to plan and revise activities

Integrated Monitoring Integrated Monitoring ActivitiesActivities Activities include continuous Activities include continuous

examination of performance for examination of performance for compliance and resultscompliance and results

Written reports (APR) specify Written reports (APR) specify evidence of correction and evidence of correction and improvementimprovement

Internal and external TA and Internal and external TA and professional development support professional development support improvement and correctionimprovement and correction

Monitoring Priority AreasMonitoring Priority Areas Provision of a free appropriate public Provision of a free appropriate public

education (FAPE) in the least education (FAPE) in the least restrictive environment (LRE)restrictive environment (LRE)

State exercise of general State exercise of general supervision, including child find, supervision, including child find, effective monitoring, the use of effective monitoring, the use of resolution meetings, mediation, and resolution meetings, mediation, and a system of transition services as a system of transition services as defined in defined in §300.43 and in 20 U.S.C. 1437(a)(9)§300.43 and in 20 U.S.C. 1437(a)(9)

Disproportionate representation of Disproportionate representation of racial and ethnic groups in special racial and ethnic groups in special education and related services, to education and related services, to the extent the representation is the the extent the representation is the result of inappropriate identificationresult of inappropriate identification

Oregon’s SPR&I SystemOregon’s SPR&I System Provides accountability for enforcing Provides accountability for enforcing

federal and state regulations and federal and state regulations and ensuring continuous improvementensuring continuous improvement

Focuses of procedural compliance Focuses of procedural compliance and key performance indicators and key performance indicators from IDEA and Oregon’s SPPfrom IDEA and Oregon’s SPP

Facilitates the collection and Facilitates the collection and analysis of data, reporting, and analysis of data, reporting, and improvement planning for state, improvement planning for state, districts and programsdistricts and programs

Provides ODE with a mechanism to Provides ODE with a mechanism to review district/program policies, review district/program policies, procedures, and process for procedures, and process for meeting the IDEA 2004 meeting the IDEA 2004 requirementsrequirements

SPR&I Activities SPR&I Activities Small sub grants are distributed Small sub grants are distributed

each summer to help facilitate each summer to help facilitate attendance of key personnel at attendance of key personnel at required trainings.required trainings.

Trainings consist of:Trainings consist of: Updates to special education Updates to special education

general supervision and SPR&I general supervision and SPR&I systemsystem

Themes districts/programs had Themes districts/programs had difficulty with during the previous difficulty with during the previous yearyear

Comprehensive file review Comprehensive file review processprocess

SPR&I Activities cont’dSPR&I Activities cont’d Procedural compliance review (PCR) Procedural compliance review (PCR)

ODE randomly selects (by age and ODE randomly selects (by age and disability type) files based on SECCdisability type) files based on SECC

Charter schools, unique programs and Charter schools, unique programs and EI/ECSE are includedEI/ECSE are included

Districts/programs review files (targeted-Districts/programs review files (targeted-comprehensive) and submit procedural comprehensive) and submit procedural compliance data within SPR&I systemcompliance data within SPR&I system

Compliance also includes complaints Compliance also includes complaints and due process hearingsand due process hearings

SPR&I Activities cont’dSPR&I Activities cont’d Procedural compliance indicators (PCR) Procedural compliance indicators (PCR)

verificationverification ODE conducts verification of district/program ODE conducts verification of district/program

compliance data and determines noncompliance compliance data and determines noncompliance to be corrected within established timelinesto be corrected within established timelines

May require district/program to submit files they May require district/program to submit files they review, or additional files as part of this processreview, or additional files as part of this process

Analysis of key performance indicators Analysis of key performance indicators (KPI) (KPI) ODE reports through SPR&I district/program ODE reports through SPR&I district/program

performance against state and federally set performance against state and federally set targets identified in SPPtargets identified in SPP

Districts/programs not meeting targets are Districts/programs not meeting targets are flagged for further analysis (worksheets)flagged for further analysis (worksheets)

SPR&I Activities cont’dSPR&I Activities cont’d Improvement planning, Improvement planning,

implementation and reportingimplementation and reporting Districts/programs use SPR&I Districts/programs use SPR&I

system to identify improvement system to identify improvement activities using data-based decision activities using data-based decision makingmaking

Improvement plans should be based Improvement plans should be based on PCR and KPI results, and include on PCR and KPI results, and include individual file corrections and individual file corrections and professional development for staffprofessional development for staff

SPR&I Activities cont’dSPR&I Activities cont’d Final DeterminationsFinal Determinations

FFY 2005 based on noncompliance FFY 2005 based on noncompliance identified in 2005-2006 that was not identified in 2005-2006 that was not corrected within one yearcorrected within one year

Also included timely and accurate Also included timely and accurate submission of data (PCR)submission of data (PCR)

Did not include key performance Did not include key performance indicators this timeindicators this time

Key performance indicator compliance Key performance indicator compliance and timely/accurate status was and timely/accurate status was identified (located on your district identified (located on your district summary sheet) - may be included summary sheet) - may be included next year next year

Take AwaysTake Aways

IDEA 2004 includes parallel federal IDEA 2004 includes parallel federal and state accountability provisionsand state accountability provisions

OSEP review of states’ APRsOSEP review of states’ APRs States’ analysis of and reporting on States’ analysis of and reporting on

district/program performance against SPP district/program performance against SPP targetstargets

Primary focus of federal and state Primary focus of federal and state monitoring monitoring activities are onactivities are on

Improving educational results and Improving educational results and functional outcomesfunctional outcomes

Ensuring requirements of Part B and C are Ensuring requirements of Part B and C are metmet

It’s about Better Results