Top Banner
www.signetwork.or www.signetwork.or Implementation Conversations Jennifer Coffey [email protected] Audrey Desjarlais [email protected] gon.edu Steve Goodman [email protected] May 11, 2010 3:00PM- 4:PM EST 1
30

Www.signetwork.org Implementation Conversations Jennifer Coffey [email protected] Audrey Desjarlais [email protected] Steve Goodman.

Jan 14, 2016

Download

Documents

Brett Dorsey
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Implementation Conversations

Jennifer [email protected]

Audrey [email protected]

u

Steve [email protected]

May 11, 20103:00PM- 4:PM EST

1

Page 2: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Agenda

• Vision (for next few years)

• Supporting each other

• Implementation- Big Picture

• Beginning with effective practice

• Implementation Support through Leadership Team

2

Page 3: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Vision• What is the purpose of this group?, What do we

hope to accomplish?

3

Page 4: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

How can we support each other in achieving this Vision?

• Possibilities…

– Continued discussions every other month with conference calls

– Providing structured activities, application of implementation science to your current work

– Breakfast meeting at Project Director’s Conference

4

Page 5: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Your TurnYour TurnThink of an “unsuccessful” initiative that you have been Think of an “unsuccessful” initiative that you have been involved in or you are familiar with…what were involved in or you are familiar with…what were contributing factors to this?contributing factors to this?

A.A. Lack of staff capacity to implement with fidelityLack of staff capacity to implement with fidelity

B.B. The organization did not provide sufficient The organization did not provide sufficient supports for staffsupports for staff

C.C. There was a lack of information to improve the There was a lack of information to improve the implementation processimplementation process

D.D. There was a lack of effective leadershipThere was a lack of effective leadership

E.E. OtherOther5

Page 6: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

The NIRN

Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M. & Wallace, F. (2005). Implementation Research: A Synthesis of the Literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231). 

Implementation Research: A Synthesis of the Literature

© Dean Fixsen, Karen Blase, Robert Horner, George Sugai, 2008

6

Page 7: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

InstallationInstallationExplorationExploration

Initial ImplementationInitial Implementation

Full ImplementationFull ImplementationInnovationInnovation

Prac

tices

Supp

orts

Sustained Successful Outcomes

Sustained Successful Outcomes

Main Ideas of Implementation Research

7

Page 8: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Two components that when combined, result in successful and sustainable outcomes

• Program/Initiative (Innovation)

– Set of evidence-based practices

– Selected on: Need, Fit, Resource Availability, Evidence, Readiness for Replication, Capacity to Implement

• Supporting Infrastructure (Implementation)

– Ensuring that the interventions are implemented correctly with the “right people”, at the “right time”, in the “right amounts” (Implementation Fidelity)

8

Page 9: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Much time and resources have been invested into improving student outcomes at the building, district, and county levels. After all this effort, a major concern is how do we sustain implementation with staff change over or within new settings?

9

Page 10: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Practice Selection

10

Page 11: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Your TurnYour Turn

How do your schools choose the practices to How do your schools choose the practices to implement?implement?

A.A. Mandated by District/StateMandated by District/State

B.B. Careful review of research and fit to student Careful review of research and fit to student needneed

C.C. Popular approach of school culturePopular approach of school culture

D.D. ““Pet project” of influential individual(s)Pet project” of influential individual(s)

E.E. Other Other

11

Page 12: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

It is important to Choose the “Right” Practice

– Based on need, documented effectiveness, and “goodness of fit”

– Some practices are chosen for you

• We need to help practitioners see how the chosen practices address need, documented and “goodness of fit”

12

Page 13: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Practice Selection Considerations

• Need• Fit• Resource Availability• Evidence• Intervention Readiness for Replication• Capacity to Implement

13

Page 14: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Practice Selection:Practice Selection:TOOLTOOL

Practice Selection:Practice Selection:TOOLTOOL

14

Page 15: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

We find it helpful to create policy statements around categories of selection for educational practice

• Standard Practices are those used regularly as part of on-going educational efforts.

• Emerging Practices are ideas, curricula, programs, or procedures that have a reasonable likelihood to improve the core outcomes of education in schools in the LEA, but have not yet met the criteria to be a Scalable Practice.

• Scalable Practices are innovations that have sufficient practical verification and scientific validation to warrant the large-scale investment needed to transform these practices into Standard Practice within [LEA] schools.

15

Page 16: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

“Discovering what works does not solve the problem of program effectiveness.

Once models and best practices are identified, practitioners are faced with the challenge of implementing programs properly.

A poorly implemented program can lead to failure as easily as a poorly designed one.”

- Mihalic, Irwin, Fagan, Ballard & Elliott, 2004

16

Page 17: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Implementation Drivers

17

Page 18: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Core Implementation

Components

Core Implementation

Components

© Fixsen & Blase, 2008

Successful Student/Family Outcomes

Com

pete

ncy

Driv

ers

Com

pete

ncy

Driv

ers O

rganization Drivers

Organization D

rivers

LeadershipLeadership

Program/Initiative (set of practices)

How:

What:

Why:

18

Page 19: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Core Implementation

Components

Core Implementation

Components

© Fixsen & Blase, 2008

Successful Student/Family Outcomes

Com

pete

ncy

Driv

ers

Com

pete

ncy

Driv

ers O

rganization Drivers

Organization D

rivers

LeadershipLeadership

Program/Initiative (set of practices)

Capacity to provide direction/vision of process

Staff capacity to support students/families with the selected practices

Institutional capacity to support staff in implementing practices with fidelity

19

Page 20: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

From “The Checklist Manifesto”

We have accomplished stupendous know-how. We have put it in the hands of some of the most highly trained, highly skilled, and hard working people in our society.

Nonetheless…the volume and complexity of what we know has exceeded our individual ability to deliver its benefits correctly, safely, or reliably.

Atul Gawande, 2009

20

Page 21: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Leadership/ Implementation Support Teams

21

Page 22: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Leadership and Implementation Team

• Both are necessary and either one without the other is insufficient for producing noticeable changes in education and student outcomes.

• “Leadership” consists of those individuals with policy and management expertise who are responsible for oversight and supports for sustaining and improving student education in all schools in a “District.”

• “Implementation” involve special expertise to help create and sustain school-based resources to assure that each teacher and staff person is using designated education innovations fully and effectively.

22

Page 23: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Local Demonstration SchoolsLocal Demonstration Schools

Implementation Support

•Implementation Drivers

•Feedback Cycles

•Improvement Cycles

Implementation Support

•Implementation Drivers

•Feedback Cycles

•Improvement Cycles

Leadership Support

•Provide Visibility

•Provide Political Support

•Provide Funding

•Provide Vision

•Provide Allocation of Resources

Leadership Support

•Provide Visibility

•Provide Political Support

•Provide Funding

•Provide Vision

•Provide Allocation of Resources

Leadership TeamLeadership TeamLeadership TeamLeadership TeamActive Coordination and ManagementActive Coordination and Management

Content Expertise

•Understanding of critical features of the priority evidence-based practice

•Theory and Practice

Content Expertise

•Understanding of critical features of the priority evidence-based practice

•Theory and Practice

23

Page 24: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Various Levels of Leadership Team Work

1. Preparing for and Organization of Leadership Team

2. Creating Readiness for Local Implementation

– Developing commitment (priority)

– Develop or enhance infrastructure (local team structures)

3. Implementation

– Developing implementation capacity

– Focus on fidelity

4. Scale-Up/Sustainability

24

Page 25: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Organization of Leadership Team

• Conduct discovery or exploratory work to clarify the shared context and identify collective the purpose(s) of the work.

• Establish meeting dates and times as well as the meeting locations for the year.

• Try to keep meeting times consistent (e.g., second Tuesday each month or after the monthly ISD administration meeting.

• Leadership teams meet at a minimum of four times per year.

25

Page 26: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Your TurnYour Turn

• Please look at the Leadership Please look at the Leadership Implementation Support Team Implementation Support Team Self-Assessment…Self-Assessment…

• What existing structure (e.g., What existing structure (e.g., committee, team, etc) do you committee, team, etc) do you have in place that currently have in place that currently serves (or could serve) the serves (or could serve) the function of a leadership and function of a leadership and implementation support team?implementation support team?

26

Page 27: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

BUILDING STAFF BUILDING STAFF & STUDENTS& STUDENTS

Cascading System of Supports

Providing supports for effective practices implemented with fidelity

Providing feedback and data on implementation efforts

District Team

BUILDING TEAMBUILDING TEAM

DISTRICT TEAMDISTRICT TEAM

ISD TEAMISD TEAM

STATE TEAMSTATE TEAM

27

Page 28: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Framework for Addressing Practice and Supports

28

Page 29: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

Braiding School Building and District Initiatives

29

Page 30: Www.signetwork.org Implementation Conversations Jennifer Coffey Jennifer.Coffey@ed.gov Audrey Desjarlais Audrey.Desjarlais@tacs.uoregon.edu Steve Goodman.

www.signetwork.orgwww.signetwork.org

System Change

“For every increment of performance I demand from you, I have an equal responsibility to provide you with the capacity to meet that expectation”

(R. Elmore, 2002)

30