BENCHMARKS OF QUALITY (BOQ) January 30 th, 2007 Joey Ledvina Parr, Ph.D. Elsa Velez, Ph. D.

BENCHMARKS OF QUALITY(BOQ)

January 30th, 2007

Joey Ledvina Parr, Ph.D.

Elsa Velez, Ph. D.

School-wide Benchmarks of Quality

• Lists components of PBIS programs that address the critical elements of PBIS implementation

• Completed by school teams on a yearly basis to assess how they score on a 100 point scale with regard to developing and implementing school-wide PBIS

• Useful in developing action plans for following year

• One of the measures used by MSDE-SEPH-JHU to determine schools achieving Exemplar Status

Three Components of Benchmarks of Quality

• Team Member Rating Form– Completed by team members independently– Returned to coach

• Scoring Form– Completed by coach using Scoring Guide– Used for reporting back to team

• Scoring Guide– Describes procedure for completing BOQ– Includes a rubric for scoring each item

BOQ Will Provide:• Summary of team members’ perceptions of

PBIS implementation (scored: ++ in place, + needs improvement, and - not in place)

• Objective assessment of school’s implementation based on criteria described in a rubric (100 point scale)

• Comparison between the above factors which will encourage discussion of strengths and weaknesses and provides ideas for action planning

STEP 1

• PBIS Coach uses Scoring Guide to complete: School-Wide Benchmarks of Quality: Scoring Form

Critical Elements

STEP 1STEP 2++, +, or

_

STEP 3

PBIS Team 1. Team has broad representation 1 0

2 Team has administrative support 3 2 1 0

3 Team has regular meetings (at least monthly)

2 1 0

4 Team has established a clear mission/purpose

1 0

Benchmarks Practice:Scoring Form, Scoring Guide

Benchmark 3 points 2 points 1 point 0 points

1. Team has broad representation

Includes all of the following: Administrator, reg ed teacher, spec ed teacher, member with behavior expertise, and coach

Some groups are not represented on the team.

2. Team has administrative support

Administrator(s) attended training, play an active role in the PBIS process, actively communicate their commitment, support the decisions of the PBIS team, and attend all team meetings.

Administrator(s) support the process, take as active a role as the rest of the team, and/or attend most meetings

Adminstrator(s) support the process but don’t take as active a role as the rest of the team, and/or attends only a few meetings

Adminstrator(s) do not actively support the PBIS process

Benchmarks Practice:Scoring Form, Scoring Guide

STEP 2

• PBIS Coach asks every PBIS Team Member to complete the: School-Wide Benchmarks of Quality Team Member Rating Form independently

• Do not give a Scoring Guide to Team Members

• Giving a deadline may be helpful

• Coach collects Team Member Rating Forms

• Coach tallies all responses provided by team members using the Team Member Rating Form: Tally Sheet

Critical Elements

Benchmarks of Quality Questions

In Place (++)

Needs Improvement

(+)

Not n Place (-)

1. 2. 3.

PBS Team

4. 5. 6.

Faculty Commitment

7. 8. 9. 10. 11. 12. 13.

Effective Procedures for Dealing with Discipline

14. 15. 16. 17. 18.

Data Entry & Analysis Plan Established

19. 20. 21. 22. 23.

Expectations & Rules Developed

24. 25. 26. 27. 28. 29. 30. 31.

Reward / Recognition Program Established

32. 33. 34. 35. 36. 37.

Lesson Plans for Teaching Expectations / Rules

38. 39. 40. 41. 42. 43. 44.

Implementation Plan

45. 46. 47.

Crisis Plan

48. 49. 50. 51. 52. S

cho

ol-w

ide

Ben

chm

ark

s of

Qu

alit

y

– T

eam

Mem

ber

Rat

ing

Form

–

Tal

ly S

hee

t

Evaluation

53.

Completing Step 2

• Using the Team Member Rating Form: Tally Sheet, the PBIS Coach will record on the Benchmarks of Quality Scoring Form the team’s most frequent response for each item

• If there is a tie, score the higher score

Critical Elements

STEP 1STEP 2++, +, or

_

STEP 3

PBS Team 1. Team has broad representation 1 0 ++

2 Team has administrative support 3 2 1 0 +

3 Team has regular meetings (at least monthly)

2 1 0

4 Team has established a clear mission/purpose

1 0

Benchmarks Practice:Scoring Form, Scoring Guide

STEP 3

• PBIS Coach places a next to any item where there is a discrepancy between the coach’s rating and the item’s most frequent response.

Critical Elements

STEP 1STEP 2++, +, or

_

STEP 3

PBS Team 1. Team has broad representation 1 0 +

2 Team has administrative support

3 2 1 0 ++ √

3 Team has regular meetings (at least monthly)

2 1 0 ++

4 Team has established a clear mission/purpose

1 0 ++ √

Benchmarks Practice:Scoring Form, Scoring Guide

More Practice

Completing Step 3

• The coach will then complete the Team Summary on p. 3 of the Benchmarks of Quality Scoring Form recording areas of discrepancy, strength and weakness.

• The Team Member Rating Form: Tally Sheet will be useful in defining and explaining the areas of discrepancy

Areas of Discrepancy

Item #

Team Response

Coach’sScore

Scoring Guide Description

Areas of Strength

Critical Element

Description of Areas of Strength

Critical Element

Description of Areas in Need of Development

Areas in Need of Development

2 ++, ++, +

0 Administrator does not actively support the process

Important:

• If upon sharing areas of discrepancy (formally or informally), the coach realizes that there is new information that according to the Scoring Guide would result in a different score, the item and the adjusted final score should be recorded on the Scoring Form

• It is recommended that changes be noted with a different color ink

Critical Elements

STEP 1STEP 2++, +, or

_

STEP 3

PBS Team 1. Team has broad representation 1 0 +

2 Team has administrative support 3 2 1 0 ++ √

3 Team has regular meetings (at least monthly)

2 1 0 ++

4 Team has established a clear mission/purpose

1 0 ++ √

Adjusting scores after discussion

STEP 4• Coach will report back to the team using the

Team Report page of the Benchmarks of Quality: Scoring Form

• Again, adjustments to scores may be made using different color ink

• Coach leads team through a discussion of the identified areas of strength (high ratings) and weakness (low ratings). This information should be conveyed as “constructive feedback” to assist with action planning.

STEP 5

• Coach adds up all the points on the Benchmarks of Quality: Scoring Form

(maximum score is 100)

• Coach turns in copies of Benchmarks of Quality Scoring Form and School-Wide Benchmarks of Quality Team Member Rating Forms to PBIS Facilitator in their school district

QUESTIONS????