Top Banner
Working Smarter Susan Barrett www.pbis.org
94

Working Smarter Susan Barrett . Building the Plane in Flight 3-5 year process Moving Beyond Universals- same logic- Systems, Systems,

Dec 16, 2015

Download

Documents

Emery Randall
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Working SmarterSusan Barrett

www.pbis.org

Page 2: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Building the Plane in Flight 3-5 year process Moving Beyond Universals- same logic- Systems, Systems, Systems

Outcomes Implementing and Sustaining Evidence Based Practices

through Data Based Decision Making Build skill development

“Knowledge about and skill to do”

Build capacity

Page 3: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Spooner Elementary School: Working Smarter Activity Form

Committee/ initiative/ work

group

Purpose Target Group

Membership Relationship to school mission &

School Improvement plan

1= low 3= high

Overall priority1= low 3= high

Discipline Committee

To deal with behavioral/discipline issues across campus – meets monthly

All student’s across campus

Mrs. JonesMrs. SmithMr. GarciaMr. Black

1 2 3 1 2 3

School Safety Committee

To ensure safety across the school campus – meets monthly

All students across campus

Mr. RogersMrs. SmithMr. Williams Mrs. Ford

1 2 3 1 2 3

Skills Streaming Initiative

To create social skills curriculum for all grade levels across campus – meets mthly

All students across campus

Mrs. HappyMr. O’ConnorMrs. GeorgeMr. Black

1 2 3 1 2 3

Social Initiative Is to schedule activities across the members- meets monthly

All faculty and staff across campus

Mrs. O’ShannonMrs. PopeMr. SmithMrs. Cole

1 2 3 1 2 3

Page 4: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

WORKING SMARTER

Committee/ initiative/

Work Group

Purpose Target Group Membership Relationship to School Mission &

School Improvement Plan

1= low 3= high

Overall Priority1= low 3= high

1 2 3 1 2 3

1 2 3 1 2 3

1 2 3 1 2 3

1 2 3 1 2 3

1 2 3 1 2 3

1 2 3 1 2 3

Page 5: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Six Basic Recommendations for Implementing PBIS Never stop doing what is already working

Always look for the smallest change that will produce the largest effect

Avoid defining a large number of goals Do a small number of things well

Do not add something new without also defining what you will stop doing to make the addition possible.

Page 6: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Six Basic Recommendations for Implementing PBIS Collect and use data for decision-making

Adapt any initiative to make it “fit” your school community, culture, context.

Families Students Faculty Fiscal-political structure

Establish policy clarity before investing in implementation LAUSD.pptx

Page 7: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Primary Prevention:School-/Classroom-Wide Systems for

All Students,Staff, & Settings

Secondary Prevention:Specialized Group

Systems for Students with At-Risk Behavior

Tertiary Prevention:Specialized

IndividualizedSystems for Students

with High-Risk Behavior

~80% of Students

~15%

~5%

SCHOOL-WIDE POSITIVE BEHAVIOR

SUPPORT

Page 8: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

9 Indicators of Effective Schools

1. A clear and shared focus2. High standards and expectations

for all students3. Effective school leadership

– (create school culture conducive to student learning)

4. High levels of collaboration and communication

5. Curriculum, instruction and assessments aligned with state standards

6. Frequent monitoring of learning and teaching

7. Focused professional development

8. A supportive learning environment

9. High levels of family and community involvement

Office of the Superintendent of Public Instruction, 2003

Page 9: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Competing or Coordinated

• Need for a framework, the anchor, for all school improvement efforts

• Common language, Common logic

Page 10: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

© Dean Fixsen, Karen Blase, Robert Horner, George Sugai, 2008

Federal SPENDING on K-12 Education under the Elementary and Secondary Education Act and NAEP READING Scores (Age 9)

Page 11: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Financial Crisis or Opportunity? Tiered Logic offers platform for connecting

best practice to achieve academic and social emotional outcomes for school improvement

Must braid resources and work smarter Must be better consumers of the research

Page 12: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Educational Initiatives

• Guiding Principles (Coyne 2008)– Promoting evidence based practices– Supporting change at the systems level (feasible,

consistent and relevant to local needs)– Developing local capacity to sustain effective

practices over time

Page 13: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Academic Systems Behavioral Systems

1-5% 1-5%

5-10% 5-10%

80-90% 80-90%

Intensive, Individually Designed Interventions• Address individual needs of student• Assessment-based• High Intensity

Intensive, Individually Designed Interventions• Strategies to address needs of individual students with intensive needs• Function-based assessments• Intense, durable strategies

Targeted, Group Interventions• Small, needs-based groups for at risk students who do not respondto universal strategies• High efficiency• Rapid response

Targeted, Group Interventions• Small, needs-based groups for at- risk students who do not respond to universal strategies• High efficiency/ Rapid response• Function-based logic

Core Curriculum and Differentiated Instruction• All students• Preventive, proactive•School-wide or classroomsystems for ALL students

Core Curriculum and Universal Interventions• All settings, all students• Preventive, proactive• School-wide or classroom systems for ALL students and staff

Maryland’s Tiered Instructional and Positive Behavioral Interventions and

Supports (PBIS) Framework

Page 14: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

School Mental

Health

Student Services

Social E

motio

nal

Learn

ing

Curricu

lum

Trua

ncy

Reduc

tion

Strat

egie

sSuspension

Reduction

Strategies

Special Education Assessment and

Referral Bullying Reduction Strategies

Maryland’s Tiered Instructional and Positive Behavioral Interventions and Supports (PBIS) Framework

Page 15: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Tier 3 FBA / BIP IEP / 504 Wilson Reading Inclusion PD Assistive Technology

Framing Your ThoughtsTouch Math

Tier 2 Focused Guidance Groups IST AEL, EIR, SOAR

Check-in / Check-out SuccessMaker+

Behavior Contracts Double Dose Instruction

PST; PPW RIT Resource

Fundations

Student Intervention Plans

Tier 1 PBIS Expectations Leadership Team Explicit Instruction

Chippy Coupons Inclusive School Gradual Release Model

Schoolwide Celebrations Data Binders Specific Learning Targets

PBIS Lesson Plans & Matrix PTA Partnership Objective Deconstruction

PBIS Brochure & Home Connection Formative Assessment PD

Character Education Community Partners Habits of Mind Focus

Guidance Counselor Progress Monitoring-SIT

Aligned Discipline Referrals Grades 3-5 SuccessMaker

Celebree Daycare Assessment-Data PDSA

Check Club Volunteers

Yearbook Club Gr. 4-5 Geography Club

Triangle Triangle Activity:Activity:

Applying the Applying the Three-Tiered Three-Tiered

Logic to Logic to Charles Charles CarrollCarroll

Page 16: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Tier 3

Tier 2

Tier 1

Triangle Triangle Activity:Activity:

Applying the Applying the Three-Tiered Three-Tiered Logic to Your Logic to Your

SchoolSchool

Page 17: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

SYST

EMS

PRACTICES

DATASupportingStaff behavior

SupportingDecisionMaking

SupportingStudent behavior

PositivebehaviorSupport OUTCOMES

Social Responsibility &Academic Achievement

Page 18: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Outcome: How is the practice linked to overall outcome outlined in your school improvement plan?

Systems: Identify System of support for teachers?(Service Delivery Team- Leadership Team, Student

Services Team, School Counseling)What are roles and responsibilities of each team? How do teachers and support staff access these supports?

What are the structures that support skill development?

Data: What tools to measure fidelity and progress monitoring tools used to measure effectiveness-How do you know the practice makes the impact?

Working SmarterFor each practice…

Page 19: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Building Solutions: Using Data to Drive Decisions to Improve Behavior in Your School

Presented by Susan Barrett

Rob Horner, Anne Todd, Steve Newton,

Bob Algozzine, Kate Algozzine

www.pbis.org

www.swis.org

www.pbssurveys.org

Page 20: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Goals Logic for school-wide Positive Behavior

Support Design of “decision-systems” for schools Collection and use of data for decision-

making Whole school Targeted groups Individual student

Page 21: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Main Messages Supporting social behavior is central to achieving

academic gains.

School-wide PBS is an evidence-based practice for building a positive social culture that will promote both social and academic success.

Implementation of any evidence-based practice requires a more coordinated focus than typically expected.

Page 22: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Get honest about issues concerns in your building-

Administrator is key!! Establish a kind of “haven”- place that individuals can get feel safe about reporting concerns, supported by school community and empowered to be a part of the decision making process- “Community of Practice”

Tools: EBS Self assessment, climate surveys, satisfaction surveys- provide data summaries within a week of return – decide best approach to deliver feedback

Page 23: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Elements to the Data Process

A. Establish A Coherent Process for Discipline

Behavior Definitions Minor v. Major Written procedures for staff Flow chart showing process Office referral form ( includes poss. Motivation)

Other tracking forms

Time during staff meetings to get agreement, learn about process and follow through all year!!

Page 24: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,
Page 25: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

B. Computer Application

Easy, efficient No more than 30 seconds to enter Able to generate reports quickly

Available in picture form (bar graphs) Custom Reports

Page 26: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

C. Data For Decision Making

Generate reports for various meetings Action Plan

Build Precision Statements Determine Intervention Track Data, Continue, Modify, Terminate Share with Faculty Celebrate!!!!!

Page 27: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Triangle of Student Referrals

1-5%

5-10% 5-10%

80-90% 80-90%

Intensive, Individual InterventionsIndividual StudentsAssessment-basedHigh Intensity

6+ referrals

Targeted Group InterventionsSome Students (at-risk)High EfficiencyRapid Response

2-5 referrals

Universal InterventionsAll Students Preventive, proactive

0-1 referral

1-5%

Page 28: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

07%%

10-15%

03%

80-90%

90%

Intensive, Individual Interventions Individual Students Assessment-based Intense, durable procedures

Targeted Group Interventions Some Students (at-risk) High Efficiency Rapid Response

Universal Interventions All Settings All Students, Preventive, proactive

1-5% Students with 2 or more referrals

Students with 1 referral

Students with 0 referrals

Triangle of Student Referrals:August/September 2005

Page 29: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

(n = 201)

Michigan: Distribution of Elementary Reading Intervention Level

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

All Students Students with 6+ ODRs

Benchmark Strategic Intensive

Reading Intervention Level (based on DIBELS)

24%

33%

43%

56%

24%

20%

(n = 4074)

Dr. Steve Goodman

Page 30: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Using Data within PBIS Use data to assess current status

EBS Self-assessment Survey

Use data to assess implementation fidelity Team Implementation Checklist (TIC) School-wide Evaluation Tool (SET) Benchmarks of Quality (BoQ)

Use data to assess impact on students Office Discipline referrals

pbssurveys.org

Page 31: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Use Data for Decision-making

“We are all continually faced with a series of great opportunities, brilliantly disguised as insoluble problems.”

John Gardner

Page 32: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Main Ideas Decisions are more likely to be effective and

efficient when they are based on data.

The quality of decision-making depends most on the first step (defining the problem to be solved)

Define problems with precision and clarity

Page 33: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Main Ideas Data help us ask the right questions…they do

not provide the answers: Use data to Identify problems Refine problems Define the questions that lead to solutions

Data help place the “problem” in the context rather than in the students.

Page 34: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Main Ideas The process a team uses to “problem solve”

is important: Roles:

Facilitator; Recorder; Data analyst; Active member

Organization Agenda; Old business (did we do what we said we would

do); New business; Action plan for decisions. What happens BEFORE a meeting What happens DURING a meeting What happen AFTER a meeting

Agenda, data summary, positive nagUpdates, identify problem, problem solve

Minutes posted, tasks completed

Page 35: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Decision-making at many levels Whole school Small groups or school areas Individual student

------------------------------------------------------- Same basic process

Carol

SWIS

Page 36: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

CollectCollect and Useand Use

DataData

Review Status and

Identify Problems

Develop andRefine

Hypotheses

Discuss andSelect

Solutions

Develop andImplementAction Plan

Evaluate andRevise

Action Plan

Problem Solving Foundations

Team Initiated Problem Solving (TIPS) Model

Page 37: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Using Data Use data to identify a possible problem?

Use data to build a precise “problem statement?

Use data to select a solution (intervention)

Use data to assess if a solution is (a) being implemented, and (b) being effective.

Page 38: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Use data within “decision systems” not “data systems”

Question Decision Data Source

Is there a problem?Primary/Precise problem statement.

Should we allocate resources to this problem?

Compare “observed” with “expected” (ODRs, ORF)

Is there a reasonable solution?

Do we have a reasonable intervention, and should it be implemented?

Technical adequacyContextual Fit

Is the intervention being implemented as planned?

Do we need more resources to implement the intervention?

On-going data related to fidelity of implementation

Is the intervention proving effective?

Should we continue the intervention, modify it, or terminate it?

On-going data related to impact of the intervention on student behavior

Page 39: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Using Data

Use data in “decision layers”

Don’t drown in the data

It’s “OK” to be doing well

Page 40: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Six things to avoid Define a solution before defining the problem

Build solutions from broadly defined, or fuzzy problem statements

Failure to use data to confirm/define problem

Agree on a solution without building a plan for how to implement or evaluate the solution

Agree on a solution but never assess if the solution was implemented

Serial problem solving without decisions

Page 41: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Using Data for Decision-making at the Whole School Level

Identifying “problems” with “precision” Well defined problems prompt functional

solutions Poorly defined problems prompt discussions in

which the problem is admired, but not addressed.

“Well begun is half done” Aristotle, quoting a proverb

Page 42: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Precise Problem Statements(What are the data we need for a decision?)

Solvable problem statements include information about the five core “W” questions. What is problem, and how often is it happening Where is it happening Who is engaged in the behavior When the problem is most likely Why the problem is sustaining

Page 43: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Primary versus Precision Statements Primary Statements

Too many referrals September has more

suspensions than last year

Gang behavior is increasing

The cafeteria is out of control

Student disrespect is out of control

Precision Statements There are more ODRs

for aggression on the playground than last year. These are most likely to occur during first recess, with a large number of students, and the aggression is related to getting access to the new playground equipment.

Page 44: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Primary versus Precision Statements Primary Statements

Too many referrals September has more

suspensions than last year

Gang behavior is increasing

The cafeteria is out of control

Student disrespect is out of control

Precision Statements There are more ODRs

for aggression on the playground than last year. These are most likely to occur during first recess, with a large number of students, and the aggression is related to getting access to the new playground equipment.

Page 45: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Precise or Primary Statement? Children are using inappropriate language

with a high frequency in the presence of both adults and other children. This is creating a sense of disrespect and incivility in the school

James D. is hitting others in the cafeteria during lunch, and his hitting is maintained by peer attention.

Page 46: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Precise or Primary Statement? ODRs during December are higher than in any other

month.

Minor disrespect and disruption are increasing over time, and are most likely during the last 15 minutes of our block periods when students are engaged in independent seat work. This pattern is most common in 7th and 8th grades, involves many students, and appears to be maintained by escape from work (but may also be maintained by peer attention… we are not sure).

Page 47: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Precise or Primary Statement? Three 5th grade boys are name calling and

touching girls inappropriately during recess in an apparent attempt to obtain attention and possibly unsophisticated sexual expression.

Boys are engaging in sexual harassment

Page 48: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Organizing Data for Decision-making

Compare data across time Moving from counts to count/month

Page 49: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Using Data Identifying a possible problem: A difference

between what you want and what you have. What data to review?

Office discipline referrals per day per month Avoid simple counts Avoid one data point (look at trends)

How to use data Compare with national standards Compare with local standards Compare with prior experience

Page 50: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Tot

al O

ffic

e D

isci

plin

e R

efer

rals

Total Office Discipline Referrals as of January 10

Page 51: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Average Office Discipline Referrals per day per month as of January 10

Change Report OptionsChange Report Options1.41.82.72.52.753.4900.000

Page 52: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

SWIS summary 07-08 (Majors Only)2,532 schools; 1,300,140 students; 1,139,119 ODRs

Grade Range Number of Schools

Mean Enrollment per school

Mean ODRs per 100 per school day

K-6 1762 444 .35 (sd=.46)

(1 /300 / day)

6-9 482 653 .92 (sd=1.42)

(1/ 110 / day)

9-12 176 914 1.06 (sd=.1.57)

(1/105 / day)

K-(8-12) 312 401 1.00 (sd=.1.86)

(1/ 155 / day

Page 53: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Interpreting Office Referral Data:Is there a problem? Absolute level (depending on size of school)

Middle, High Schools (> 1 per day per 100) Elementary Schools (>1 per day per 300)

Trends Peaks before breaks? Gradual increasing trend across year?

Compare levels to last year Improvement?

Page 54: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Office Discipline Referrals per Day per Month per 100 Students

0

2

4

6

8

10

12

14

16

Sept Oct Nov Dec Jan Feb March April May June

# p

er d

ay p

er 1

00 s

tud

ents

Series1

Application Activity: Absolute ValueIs there a Problem?

Middle School of 625 students?Compare with national average: 625/100 = 6.25 6.25 X .92 = 5.75

Off

ice

Dis

cipl

ine

Ref

erra

ls p

er S

choo

l Day

Page 55: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

0

0.5

1

1.5

2

Ave R

efe

rrals

per

Day

Sept Oct Nov Dec Jan Feb Mar Apr May Jun

School Months

Office Referrals per Day per MonthLast year

Elementary School with 150 StudentsCompare with National Average 150 / 100 = 1.50 1.50 X .35 = .53

Page 56: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

0

5

10

15

20

Ave R

efe

rrals

per

Day

Sept Oct Nov Dec Jan Feb Mar Apr May Jun

School Months

Office Referrals per Day per MonthLast year

High School of 1800 students

Compare with National Average 1800 / 100 = 18 18 X 1.06 = 19.08

Page 57: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

0

5

10

15

20

Ave R

efe

rrals

per

Day

Sept Oct Nov Dec Jan Feb Mar Apr May Jun

School Months

Office Referrals per Day per MonthThis Year

Middle School of 700 students

Page 58: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

0

5

10

15

20

Ave R

efe

rrals

per

Day

Sept Oct Nov Dec Jan Feb Mar Apr May Jun

School Months

Office Referrals per Day per MonthLast Year and This Year

Page 59: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

0

5

10

15

20

Ave R

efe

rrals

per

Day

Sept Oct Nov Dec Jan Feb Mar Apr May Jun

School Months

Office Referrals per Day per MonthLast Year and This Year

Page 60: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

0

5

10

15

20

Ave R

efe

rrals

per

Day

Sept Oct Nov Dec Jan Feb Mar Apr May

School Months

Office Referrals per Day per MonthThis Year

Middle School

N= 495

Page 61: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Is There a Problem? #2Absolute - Trend - Compare

0

5

10

15

20

Ave R

efe

rrals

per

Day

Sept Oct Nov Dec Jan Feb Mar Apr May Jun

School Months

Office Referrals per Day per MonthThis year (Middle)

Middle School

N= 495

Page 62: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

0

5

10

15

20

Ave R

efe

rrals

per

Day

Sept Oct Nov Dec Jan Feb Mar Apr May Jun

School Months

Office Referrals per Day per MonthLast Year and This Year

Middle School

N= 495

Page 63: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

0

5

10

15

20

Ave R

efe

rrals

per

Day

Sept Oct Nov Dec Jan Feb Mar Apr May Jun

School Months

Office Referrals per Day per MonthLast Year and This Year

Middle School

N= 495

Page 64: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

What are the data you are most likely to need to move from a Primary to a Precise statement? What problem behaviors are most common?

ODR per Problem Behavior Where are problem behaviors most likely?

ODR per Location When are problem behaviors most likely?

ODR per time of day Who is engaged in problem behavior?

ODR per student Why are problem behaviors sustaining?

No graph

Page 65: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

What other data may you want? ODR by staff ODR by IEP ODR by grade ODR by gender by grade

Page 66: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Test precision problem statement Use precision problem statement to build and

test hypotheses. Problems are most common in D-Hall wing Problems are more likely during second recess Problems are most common during assembly schedule Problems are more likely during state testing periods

Page 67: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

What behaviors are problematic?

0

10

20

30

40

50

Num

ber

of R

efe

rrals

Lang Achol ArsonBombCombsDefianDisruptDressAgg/fgtTheftHarassProp D Skip Tardy Tobac Vand Weap

Types of Problem Behavior

Referrals per Prob Behavior

Page 68: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

What behaviors are problematic?

0

10

20

30

40

50

Num

ber

of R

efe

rrals

Lang Achol ArsonBombCombsDefianDisruptDressAgg/fgtTheftHarassProp D Skip Tardy Tobac Vand Weap

Types of Problem Behavior

Referrals per Prob Behavior

Page 69: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

What behaviors are problematic?

0

5

10

15

Num

ber

of R

efe

rrals

Lang Achol ArsonBombCombsDefianDisruptDressAgg/fgtTheftHarassProp D Skip Tardy Tobac Vand Weap

Types of Problem Behavior

Referrals per Prob Behavior

Page 70: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Where are the problems occurring?

0

10

20

30

40

50

Num

ber

of O

ffic

e R

efe

rrals

Bath RBus A Bus Caf ClassComm Gym Hall Libr Play G Spec Other

School Locations

Referrals by Location

Page 71: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

0

10

20

30

40

50

Num

ber

of O

ffic

e R

efe

rrals

Bath RBus A Bus Caf ClassComm Gym Hall Libr Play G Spec Other

School Locations

Referrals by Location

Where are the problems occurring?

Page 72: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Who is contributing to the problem?Referrals per Student

0

10

20

Num

ber

of R

efe

rrals

per

Stu

dent

Students

Page 73: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Who is contributing to the problem?

0

10

20

Num

ber

of R

efe

rrals

per

Stu

dent

Students

Students per Number of Referrals

Page 74: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

When are the problems occurring?

0

5

10

15

20

25

30

Num

ber

of R

efe

rrals

7:00 7:30 8:00 8:30 9:00 9:30 10:0010:3011:00 11:3012:0012:30 1:00 1:30 2:00 2:30 3:00 3:30

Time of Day

Referrals by Time of Day

Page 75: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

When are the problems occurring?

0

5

10

15

20

25

30

Num

ber

of R

efe

rrals

7:00 7:30 8:00 8:30 9:00 9:30 10:0010:3011:00 11:3012:0012:30 1:00 1:30 2:00 2:30 3:00 3:30

Time of Day

Referrals by Time of Day

Page 76: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Moving to fine-grained analysis SWIS Custom Reports

Page 77: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

09/20/2007Neal Anderson

4Dean Smith

10:15AM Plygd Disrespt Unknown None Conf

2 09/22/2007Neal Anderson

4Dean Smith

10:00AM Plygd Disrespt Unknown None Conf

3 09/23/2007Neal Anderson

4Dean Smith

10:00AM Plygd Disrespt Unknown Staff Loss priv

4 09/25/2007Neal Anderson

4Dean Smith

10:00AM Plygd Disrespt Ob a attn None Loss priv

5 09/30/2007Neal Anderson

4Dean Smith

10:15AM Plygd Disrespt Unknown Staff Conf

6 10/02/2007Neal Anderson

4Dean Smith

10:15AM Plygd Disrespt Unknown Staff Conf

7 10/07/2007Neal Anderson

4Dean Smith

10:00AM Plygd Disrespt Unknown Staff In-sch susp

8 10/09/2007Neal Anderson

4Dean Smith

10:15AM Plygd Disrespt Unknown None Out-sch susp

9 11/03/2007David Anderson-Jones

4 Jason Cline 10:00AM Class M-Contact Ob a attn Staff Conf

10 01/05/2008David Anderson-Jones

4Dale Cocker

10:30AM Plygd M-Contact Ob a attn Peers Office

Describe the challenges Neal appears to be experiencing? Data Student Staff Time Location Behavior

ViewViewViewViewViewViewViewViewView

Page 78: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

8Debbie Calhoun

3:15:PMPark lot

Agg/Fight Ob p attn Peers Out-sch susp

119 04/01/2008Mark Banks

8Dale Cocker

8:00:AM Park lot Tobacco Ob p attn Peers In-sch susp

120 03/13/2008Brian Bender

7 Sally Post 3:00:PM Park lot M-Disrespt DK Peers Parent

121 04/21/2008Dottie Denner

8Brenda Franken

8:00:AM Park lot Dress Ob p attn Staff Parent

122 01/27/2008Joe Franklin

7Frannie James

3:15:PM Park lot Tobacco DK Peers In-sch susp

123 02/01/2008Joe Franklin

7Carol Earley

3:30:PM Park lot Vandal Ob a attn Peers Out-sch susp

124 01/12/2008Samual Fullerton

7Frannie James

3:15:PM Park lot Tobacco DK Peers In-sch susp

125 10/30/2007 Bruce Gil 8Starla Paulson

2:15:PM Park lot Skip Avoid a Staff In-sch susp

126 03/08/2008Willie Loman

7Anne Harrison

3:30:PM Park lot Tobacco Ob p attn Peers In-sch susp

Describe the challenges we are experiencing in the Parking lot

Date Student Staff Location Behavior

ViewViewViewViewViewViewViewView

Page 79: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

A Context for Designing Solutions Behavior support is the redesign of

environments, not the redesign of individuals Attend as much, or more, to what happens

between problem behavior bouts as what happens during instances of problem behavior.

(Edward Carr)

Positive Behavior Support plans define changes in the behavior of those who will implement the plan.

Page 80: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,
Page 81: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Building Solutions Packages versus Practices

Many good ideas, packages and procedures exist Most are expensive to implement, and not a perfect fit

with your problem Be efficient as well as effective

Most good interventions will be multi-component

Be wary of the one-trick strategy.

Page 82: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Using Data to Build Solutions:Four Elements to Consider Prevention: How can we avoid the problem context?

Who, When, Where Schedule change, curriculum change, etc

Teaching: How can we define, teach, and monitor what we want? Teach appropriate behavior Use problem behavior as negative example

Recognition: How can we build in systematic reward for desired behavior?

Extinction: How can we prevent problem behavior from being rewarded?

Consequences: What are efficient, consistent consequences for problem behavior?

Monitoring: How will we collect and use data to evaluate (a) implementation fidelity, and (b) impact on student outcomes?

Page 83: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Solution DevelopmentPrevention

Teaching

Reward

Extinction

Corrective Consequence

Data Collection

Page 84: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Problem solving Mantra Do we have a problem?

(Identify the primary problem)

What is the precise nature of the problem? (Define, clarify, confirm/disconfirm inferences)

Why does the problem exist, & what should we do about it? (Hypothesis & solution)

What are the actual elements of our plan? (Action Plan… what will we do, who will do it, when it get done)

Is our plan being implemented? (Evaluate & revise plan)

Is the plan having the desired effect? (Maintain, modify or terminate the plan)

Page 85: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Quick example of the five step process with East Elementary

500 students K-5

Page 86: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Rose Elementary

Enrollment: 500 studentsGrades: K – 5

National Mean Level of ODRs for Elementary Schools is .35 per 100 students per day, or 1.75 for a school of 500 (downloaded from www.swis.org Aug 30, 2007)

Step one: review status and identify problems

Page 87: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Rose Elementary Problem Identified

1. For all but one month during last year (2004-2005), the rate of ODRs per day exceeded the national average reported by elementary schools across the United States

2. The data show a minimal trend across months, but there are noticeable increases in the ODR level in December and March.

3. For each month of the last school year, the level of ODRs per day exceeded the level from the corresponding month during the prior school year (2003-2004)

4. Teachers, families, and students themselves have reported that student problem behavior is unacceptable and presents a barrier to effective instruction.

Page 88: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Step two: develop and clarify hypothesis

Page 89: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,
Page 90: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,
Page 91: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Rose Elementary Hypothesis Statement A large proportion of students are engaging in

disruption & aggression on the playground during recess because We have not developed playground specific expectations

and taught them to students Playground supervisors have not been included as

participants in the planning, teaching and evaluation Disruption and aggression are resulting in access to peer

attention and time with preferred equipment.

Page 92: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Prevent problem behavior situation Ensure that supervisors are on the playground and are engaged in active supervision .

Teach appropriate behavior Teach the school-wide behavior expectations of being safe, respectful, and responsible, and do the teaching on the playground where problem behaviors are most likely.

Reward appropriate behavior Provide a formal system for playground supervisors to recognize appropriate play on the playground.

Reduce reward for problem behavior Teach all students to signal “stop” when they are treated disrespectfully.Teach playground supervisors to ensure that aggression and disruption are not allowed to gain access to preferred activities or materials.

Deliver corrective consequences for problem behavior Review continuum of consequences for problem behavior on playground with students and supervisors and make sure continuum is in effect.

Collect data to assess if the intervention (a) is implemented with fidelity and (b) produces desired impact on student behavior.

Collect, summarize and report data.

Step 3: Discuss and Select Solutions

Rose Elementary Example

Page 93: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Designing Solutions If many students are making the same mistake

it typically is the system that needs to change not the students.

Teach, monitor and reward before relying on punishment.

An example (hallways)

Page 94: Working Smarter Susan Barrett . Building the Plane in Flight  3-5 year process  Moving Beyond Universals- same logic-  Systems, Systems,

Examples