EVALUATION FOR SCHOOL-WIDE PBIS Bob Algozzine University of North Carolina: Charlotte Rob Horner University of Oregon www.pbis.org December 9, 2011 Acknowledgements : George Sugai, Susan Barrett, Celeste Rossetto Dickey, Lucille Eber Donald Kincaid, Timothy Lewis,
Evaluation for School-wide PBIS. Bob Algozzine University of North Carolina: Charlotte Rob Horner University of Oregon www.pbis.org December 9, 2011. Acknowledgements : George Sugai, Susan Barrett, Celeste Rossetto Dickey, Lucille Eber Donald Kincaid, Timothy Lewis, Tary Tobin. - PowerPoint PPT Presentation
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
EVALUATION FORSCHOOL-WIDE PBIS
Bob AlgozzineUniversity of North Carolina: Charlotte
Rob HornerUniversity of Oregonwww.pbis.orgDecember 9, 2011
Acknowledgements: George Sugai, Susan Barrett, Celeste Rossetto Dickey, Lucille EberDonald Kincaid, Timothy Lewis, Tary Tobin
• Goals: Participants will be able to…– Define the core elements of an evaluation plan– Define a schedule for evaluation data collection– Define the core elements of an evaluation report
• Assumptions: Participants already can…– Define core features of SWPBIS– Are implementing SWPBIS– Have reviewed the SWPBIS Evaluation Blueprint
Assumptions
• Every evaluation is unique. Any specific evaluation report will be affected by:– Funding and political focus – Number of years implementing PBIS – Focus on Tier II and Tier III– Additional emphasis areas
– Stakeholders, Implementers, Adopters, Evaluators– Define the purpose of the evaluation
– What decisions are to be affected by the evaluation?– What questions need to be answered to make
informed decisions?– Define the basic goals, timeline and constraints
associated with the implementation effort
Evaluation Plan• Input
– Who will provide what training and technical assistance… on what schedule… to improve the capacity of the leadership team to establish capacity to sustain and scale up SWPBIS?
– Who will provide what training and technical assistance to school teams to result in Tier I implementation of SWPBIS?
– Who will provide what training and technical assistance to school teams to result in Tier II an Tier III implementation of SWPBIS.
Evaluation Plan
• FidelityContent Measure(s) Schedule
Tier I SWPBIS Fidelity TIC (Progress Monitor)BoQ (once TIC is at criterionSET (for research measures
TIC (every 3-4 meetings)BoQ or SET (Annually in Spring)
Tier II and Tier III SWPBIS Fidelity
MATT (Progress Monitor)BAT (Annual)ISSET (for formal research)
MATT (every 3-4 team meetings)BAT or ISSET (Annually in Spring)
Evaluation Plan• Impact
Content Measure Schedule
Leadership Team Capacity Implementation Self-Assessment
Annually (Spring) for use in planning for Fall.
Behavior ODRs (SWIS)AttendanceGraduation Rate
ContinuousContinuousAnnual
Academic (CBM)Oral Reading Fluency
Standardized Assessments
Graduation
Start of school, Winter, Early Spring
Annually (Spring)
Spring
Data Collection
• 8 core PBIS measures – (Tobin et al., 2011; Childs et al., 2011)
– SWPBIS is a framework for establishing a school-wide social culture with the necessary individualized supports needed for all students to achieve academic and social success.
• Define Goals of the specific project– Number of schools per year implementing SWPBIS
• How schools were selected• Expectation of 2-3 years for Tier I implementation to criterion• Expectation of 2 years of criterion implementation to affect academic outcomes.
– Development of district/state capacity• Capacity needed for sustained and scaled implementation
– Behavioral and academic outcomes for students• Student outcomes linked to fidelity of implementation
• Define Stakeholders/ Evaluation Questions– Evaluation report is written at the request of:– Evaluation report is focused on the following key questions:
Evaluation Report
• Input• Who received what support, and from
whom?– Leadership team– Local Capacity Building
• Training, Coaching, Behavioral Expertise, Evaluation– School teams
• Leadership Team– Planning Dates– Development of Implementation Plan– Dates of SWPBIS Implementation Self-Assessment
Capacity DevelopmentNumber of trainers/coaches available to support teams/districtsBehavioral expertise available to support Tier II and Tier III implementationEvaluation capacity (data collection, data use, information distribution)
School TeamsTier I Implementation (TIC, BoQ, SET, SAS)
Collectively, and/or by training cohortTier II / Tier III Implementation (MATT, BAT, ISSET)
Collectively, and/or by training cohortAdditional measures of fidelity
Phases of ImplementationCICO checklist
Evaluation Report
Year1 Year 2 Year 30%
10%20%30%40%50%60%70%80%90%
100%
Lead Team Self-Assessment TotalLead Team Self-Assessment Total
Evaluation Report
• Fidelity of Leadership Team development– SWPBIS Implementation Self-Assessment sub-scales
Lead
Team
Funding
Visibilit
y
Political
Sup
Policy
Training
Coaching
Evaluati
on
Expertise
Demo Schools
0
20
40
60
80
100
Year 1Year 2Year3
Evaluation Report
• Fidelity (TIC, BoQ, SET, SAS) Total Score– Schools