Top Banner
RTI in Pennsylvania: RTI in Pennsylvania: A Statewide Initiative A Statewide Initiative Joseph F. Kovaleski Lynanne Joseph F. Kovaleski Lynanne Black Black Indiana University of PA Indiana University of PA Edward S. Shapiro Edward S. Shapiro Lehigh University Lehigh University
29

RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Jan 12, 2016

Download

Documents

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

RTI in Pennsylvania:RTI in Pennsylvania:A Statewide InitiativeA Statewide Initiative

Joseph F. Kovaleski Lynanne BlackJoseph F. Kovaleski Lynanne BlackIndiana University of PAIndiana University of PA

Edward S. ShapiroEdward S. ShapiroLehigh UniversityLehigh University

Page 2: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

RTI Project Training Team

• Edward S. Shapiro & Joseph F. Kovaleski, Co-Principal Investigators

• Joy Eichelberger, Project Director• Other university faculty and graduate

assistants from Indiana University of PA and Lehigh University

• Technical assistance providers from the Pennsylvania Training and Technical Assistance Network (PaTTAN) and from Pennsylvania Intermediate Units.

Page 3: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

RTI in PA: A General-Special Education Collaboration

Pennsylvania Department of Education

• Bureau of Teaching and Learning– Edward Vollbrecht, Director– Angela Kirby-Wehr, Assistant Director

• Bureau of Special Education– John Tommasini, Director– Patricia Hozella, Assistant Director– Fran Warkomski, Director, PaTTAN

Page 4: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Strategic Interventions for

Students at Risk of Academic Failure

Tier 3:IntensiveInterventions

forLow Performing Students

Alter curriculum, Add time, support resources…

Tier I: Benchmark and School Wide Interventionsfor

Students on Grade-level (benchmark) and

All Students (Effective Instructional Practices provided within the General Education Curriculum)

Tier 2: Strategic and Targeted Interventionsfor

Students At –Risk for FailureStrategic Instruction, Increased Time and

Opportunity to Learn

PaTTAN (2005)

Page 5: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Key Characteristics of RtI

• Universal Screening of academics and behavior• Data-analysis teaming • Multiple tiers of increasingly intense

interventions• Differentiated curriculum-tiered intervention

strategy• Use of evidence-based interventions• Continuous monitoring of student performance

Page 6: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Training Modules Developed by Statewide RTI team

• Administration and Preparing for RTI• School-Based Behavioral Health• Data Analysis Teaming• Eligibility Determination• Overview• Principals and RTI• Progress Monitoring• Scientifically Based Core Programs• Standard Protocol Interventions• Differentiated Instruction• Universal Screening

Page 7: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

RTI Pilot Program

• 7 geographically representative elementary schools selected on the basis of presence of readiness factors.

• Training began in 2005-2006.

• Implementation in place since 2006-2007.

Page 8: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Pilot Sites

• East– Overlook Elementary, Abington School District– Highland Park Elementary, Upper Darby School District

• Central– Reid Elementary, Middletown Area School District– Loyalsock Elementary, Montoursville Area School

District

• West– Oswayo Valley Elementary, Oswayo School District– Bellevue Elementary, Northgate School District– Washington Park Elementary, Washington School

District

Page 9: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Pilot Site Summaries• All 7 sites have in common

– Universal screening in all sites in reading– Universal screening in 3 eastern/central and 3 western sites in

math– Data based decision team meetings held at all sites– Standard protocols for reading implemented across sites – Each of the 7 sites has slight variation on the PA RTI model– School-wide data analysis teams established at each school– Data on all sites by Lehigh and IUP research teams and are

being analyzed through support of Ed Shapiro and research team at Lehigh

– Professional development provided to all sites in areas targeted as needed by each site through a combination of PaTTAN, IU personnel in some sites, University consultant, and ongoing on-site meetings with University consultants

Page 10: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

TIER 1: All Students in Core Program(Everyone is taught reading from H-M)

Fall Benchmark(Reading Passages Given)

Student BenchmarkScore = BENCHMARK

(90% will do fine)

Student BenchmarkScore = STRATEGIC

(Might be at risk)

Student BenchmarkScore = INTENSIVE

(Definitely at risk)

TIER 1: All Students in Core ProgramEnrichment, flexible grouping, regular ed teachers

TIER TIME- TIER 2 Intervention(additional specific interv

Reg ed/reading sp)30 min 5x week

PM every other week

TIER TIME TIER 3 Intervention(additional specific interv

Rdg sp/SpEd)30 min 5x week + 60-120 min wk

PM 1x week+ +

Winter Benchmark(Reading Passages Given)

TIER TIME- TIER 1

(enrichment)30 min 5x week

PM every other week+

Page 11: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Abington School District: Overlook Elementary School

RtI Instructional Programs

RTI Level

Curriculum Component Grade Level

K-2 3-6

Tier 1 Houghton Mifflin Invitations to Literacy X X

Open Court Phonics X

Compass Learning X X

Tier 2 Open Court Phonics X

Breakthrough to Literacy X

Soar to Success X

Tier 3 Breakthrough to Literacy X

Fundations X

Soar to Success X

Wilson Reading X

Page 12: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Important Key Training Accomplishments

• Strong support from PaTTAN consultants from 3 centers

• Development of RTI training teams at 2 IUs. These technical assistance personnel provided extensive training and guided practice support at the pilot sites.

• Development of 10 training modules ready for use on a statewide basis.

• Provision of four trainer-of-trainers workshops attended by technical assistance staff from 29 IUs.

Page 13: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Project Accomplishments

• All sites established models with 3 tiers• Strength of tier 1 and core programs in

reading/math were emphasized in all sites• Most sites established clearly defined standard

protocol interventions at tiers 2 and 3• All sites established school wide data analysis

teams that met around data-based decisions regarding student assignment to tiers

• All sites emphasized RTI in reading, a few also involved math

Page 14: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

• All sites administered universal screening (DIBELS or AIMSweb passages) in reading 3x per year

• 6 of 7 sites administered 4sight in reading and/or math at least 3 times per year

• Analysis of Level of Implementation assessed across most sites for at least one major component of RTI

• Analysis of integrity of implementation of data analysis team meetings obtained across many sites

• All sites provided multiple forms of ongoing professional development

Page 15: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Methods – The Nature of the Models Across Sites

• All sites had well established core program at tier 1• Many sites established “tier time” (called different titles at

different sites) where all students received some form of supplemental instruction including those at benchmark

• Tiered intervention consisted of 30 to 45 minutes, 3 to 7x per week (tiers 2 or 3) across sites

• Progress monitoring for students at tier 2 (once every other week) and tier 3 (once per week) implemented primarily in reading across sites

• Special education students were included among those in tiered intervention across most sites

Page 16: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Risk Data

– Strong outcomes across sites at K-1. – Across 7 sites, students at low risk in ORF at

end of Grade 1 was 72% (range 62% to 83%), those at risk 8% (3% to 11%). (See Figures 1 to 5)

– Percentage of Students At Low Risk increased by as much as 12% over the students at low risk comparing spring 2007 to spring 2006 in 4 sites where spring 2006 data were available. (See Table 1)

Page 17: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

– Reading outcomes as assessed by ORF at grade 2 through 6 were variable across sites with those ending at Low Risk ranging from 42% to 74% across sites

– Consistently found across all sites that administered 4sight multiple times during the year (n=6) that a high percentage (between 33% and 100%, average of 65% at grade 3, 75% at grade 4, 83% at grade 5 across sites) of students who were found to score at “Some risk” according to DIBELS or AIMSweb benchmarks and scored as Proficient/Advanced on the end-of-year 4sight and PSSA.

Page 18: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Figure 1.Summary of risk levels across sites for K, along with comparisons to Spring 06.

K- PSFAverage Across Sites - Spring 07 and Spring 06

88

11

1

91

7

2

0

10

20

30

40

50

60

70

80

90

100

Low Risk Some Risk At Risk

K-PSF

Percent of Students

Sp 07 (n =6)

Sp 06 (n = 4)

Page 19: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

K-NWF Average Across Sites - Spring 07 and Spring 06

78

15

7

68

24

9

0

10

20

30

40

50

60

70

80

90

100

Low Risk Some Risk At Risk

K- NWF

Percent of Students

Sp 07 (n =6)

Sp 06 (n = 4)

Figure 2 Summary of risk levels across sites for K, along with comparisons to Spring 06.

Page 20: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Figure 3.Summary of risk levels across sites for Grade 1, along with comparisons to Spring 06.

Grade 1- PSF Average Across Sites - Spring 07 and Spring 06

90

10

0

95

51

0

10

20

30

40

50

60

70

80

90

100

Low Risk Some Risk At Risk

1-PSF

Percent of Students

Sp 07 (n =7)

Sp 06 (n = 4)

Page 21: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Grade 1 - NWF - Average Across Sites- Spring 07 and Spring 06

78

19

4

71

24

6

0

10

20

30

40

50

60

70

80

90

100

Low Risk Some Risk At Risk

1-NWF

Percent of Students

Sp 07 (n =7)

Sp 06 (n = 4)

Figure 4.Summary of risk levels across sites for Grade 1, along with comparisons to Spring 06.

Page 22: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Gr 1- ORF Average Across Sites- Spring 07 and Spring 06

72

20

8

60

24

16

0

10

20

30

40

50

60

70

80

90

100

Low Risk Some Risk At Risk

1-ORF

Percent of Students

Sp 07 (n =7)

Sp 06 (n = 4)

Figure 5.Summary of risk levels across sites for Grade 1, along with comparisons to Spring 06.

Page 23: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Tier Movement

– Most movement across tiers occurred from Fall to Winter

– Across 4 sites, 36% of students moved from more to less intensive tiers (T3 to T2 or T2 to T1), while 20% moved from less intensive to more intensive tiers (T1 to T2 or T2 to T3). (see Figures 6)

Page 24: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Average Movement Across Tiers

5%

15%

23%

13%

0%

5%

10%

15%

20%

25%

T1 to T2 T2 to T3 T2 to T1 T3 to T2

Percent Students

Less Intensive to More Intensive

More Intensive to Less Intensive

Figure 6. Tier Movement from Fall to Winter Across 4 Pilot Sites.

Page 25: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Movement Within Tiers

– Reflected in change in progress monitoring among students

– Across sites where tier 2 and tier 3 progress monitoring were collected, data reflected substantial growth across students against expected target levels of growth

– Examples shown in graphs reflect gains at or above levels expected of typical students for that grade (see Figures 7, 8)

– Substantial gains were evident for those at tier 2 and tier 3

Page 26: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Overlook-AbingtonTargeted vs Attained PM Slope- Tier 2- March 15, 2007

1.13

1.78

1.10

1.56

1.25

0.97 0.92

0.53

0.91

2.07

1.47

1.14

1.66

0.810.72

-0.51

-1

-0.5

0

0.5

1

1.5

2

2.5

K-ISF (n= 9)

1-NWF- (n= 13)

1-ORF- (n = 15)

2 (n=9) 3 (n =18) 4 (n=10) 5 (n =11) 6 (n=10)

Correct Per Min/Week

Targeted

Attained

Sounds Per Min/Week Words Correct Per Min/

Week

0.74

1.31

0.940.56

0.71

Red bars indicate expected gains of typical students at each grade

1.11

Figure 7.Targeted vs Attained Levels of Progress Monitoring of Students at Tier 2 for Abington.

Page 27: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Overlook Elementary-Targeted vs Attained PM Slope- Tier 3- March 15, 2007

2.23

1.25

2.04 2.011.92

1.64

1.75

1.95

1.80

0.64

1.41

0.87

1.19

0.20

0.00

0.50

1.00

1.50

2.00

2.50

1-NWF- (n= 5)

1-ORF- (n = 5)

2 (n=10) 3 (n =9) 4 (n=7) 5 (n =6) 6 (n=6)

Correct Per Min/Week

Targeted

Attained

0.74

1.31

0.94

0.71

0.56

Sounds Per Min/Week

Words Correct Per Min/Week

Red bars indicate expected gains of typical students at each grade

1.11

Figure 7.Targeted vs Attained Levels of Progress Monitoring of Students at Tier 3 for Abington.

Page 28: RTI in Pennsylvania: A Statewide Initiative Joseph F. Kovaleski Lynanne Black Indiana University of PA Edward S. Shapiro Lehigh University.

Figure 8 Targeted vs Attained Levels of Progress Monitoring of Students at Tier 2 and Tier 3 for Montoursville.

Loyalsock- Targeted vs Attained- April and June

1.54

0.69

1.67

1.40

1.891.84

1.52

2.62

1.24

2.09

1.86

1.17

1.611.56

2.26

1.13

1.41 1.41

0.85

1.09

0.91

0.00

0.20

0.40

0.60

0.80

1.00

1.20

1.40

1.60

1.80

2.00

2.20

2.40

2.60

2.80

K-PSF (n=7) K-NWF (n=9) 1-NWF (n=8) 1-ORF (n=11) 2 (n=5) 3 (n=21) 4 (n=10)

Rate Per Minute/Week

Targeted

Attained-March

Attained-May

0.94

0.7

1.531.31

0.94

0.71

Letter Sounds Per min/Week

Words Correct Per Min/Week

1.11