Evolution of the Evolution of the Revolution: Revolution: How Can Evidence-Based How Can Evidence-Based Practice Work in the Real Practice Work in the Real World? World? Bruce F. Chorpita Bruce F. Chorpita Wing Institute Annual Summit on Evidence Based Wing Institute Annual Summit on Evidence Based Special Education Special Education April 24, 2008 April 24, 2008
95
Embed
Evolution of the Revolution: How Can Evidence-Based Practice Work in the Real World? Bruce F. Chorpita Wing Institute Annual Summit on Evidence Based Special.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Evolution of the Revolution: Evolution of the Revolution: How Can Evidence-Based Practice How Can Evidence-Based Practice
Work in the Real World?Work in the Real World?
Bruce F. ChorpitaBruce F. ChorpitaWing Institute Annual Summit on Evidence Based Wing Institute Annual Summit on Evidence Based
Special EducationSpecial Education
April 24, 2008April 24, 2008
Acknowledgments
Acknowledgments
Acknowledgments
Acknowledgments
The Story of JohnThe Story of John
A Tale of Two CulturesA Tale of Two Cultures
This is John.
Evidence Based Practice:Evidence Based Practice:Not As Easy As It LooksNot As Easy As It Looks
Attributes of Innovations1. Relative Advantage2. Compatibility3. Complexity4. Observability
Diffusion of InnovationDiffusion of Innovation
Communication Channels1. Mass Media2. Interpersonal
Change Agent Properties1. Effort2. Homophily
Rate of Adoption
Adapted from Rogers (1995)
Diffusion CurveDiffusion Curve%
of
adop
ters
Adoption
Time
ATTRIBUTES OF THE ATTRIBUTES OF THE INNOVATIONINNOVATION
Practitioner ConcernsPractitioner Concerns
Fixed contentFixed content Fixed intensityFixed intensity Fixed lengthFixed length Single target Single target
Some EBS Effect SizesSome EBS Effect Sizes(Chorpita et al. 2002)(Chorpita et al. 2002)
CBT for anxiety: ES =1.05CBT for anxiety: ES =1.05 Exposure for anxiety: ES=2.02 Exposure for anxiety: ES=2.02 Modeling for anxiety: ES=0.55Modeling for anxiety: ES=0.55 CBT with Parent/Child for anxiety: ES=1.68CBT with Parent/Child for anxiety: ES=1.68 Behavior Therapy for ADHD: ES=1.24Behavior Therapy for ADHD: ES=1.24 CBT for depression: ES=1.74CBT for depression: ES=1.74 IPT for depression: ES=1.51IPT for depression: ES=1.51 Relaxation for depression: ES=1.48Relaxation for depression: ES=1.48 Parent training for ODD: ES=0.89Parent training for ODD: ES=0.89 MST for delinquency: ES=0.50MST for delinquency: ES=0.50
Diffusion strategies: Relative Advantage
Comparison with Usual CareComparison with Usual Care(Weisz et al. 1995)(Weisz et al. 1995)
-0.5-0.4-0.3-0.2-0.1
00.10.20.30.40.50.60.70.80.9
EBT Usual Care
Diffusion strategies: Relative Advantage
Throw out the Bath Water:Throw out the Bath Water:Keep the BabyKeep the Baby
Move away from the idea that Move away from the idea that “Problem A gets Treatment B”“Problem A gets Treatment B”
We decided to map the decisions We decided to map the decisions made at the system level – not just made at the system level – not just the IF-THEN of treatment selectionthe IF-THEN of treatment selection
Goal: To build an Evidence Based Goal: To build an Evidence Based SystemSystem
Where should we treat the client?Where should we treat the client?
ServiceSetting
How should we treat the client?How should we treat the client?
TherapeuticPractices
ServiceSetting
Are we providing quality service to the Are we providing quality service to the client?client?
TherapeuticPractices
ServiceSetting
TreatmentIntegrity
Is the client getting better?Is the client getting better?
TherapeuticPractices
ServiceSetting
Who should treat the client?Who should treat the client?
TherapeuticPractices
ServiceSetting
How should we manage the treatment?How should we manage the treatment?
TherapeuticPractices
ServiceSetting
Treatment programs formalize these elementsTreatment programs formalize these elements
TherapeuticPractices
ServiceSetting
Selecting a program structures other Selecting a program structures other decisionsdecisions
Tx Program Selection
TherapeuticPractices
ServiceSetting
Selecting a program structures other Selecting a program structures other decisionsdecisions
Tx Program Selection
TherapeuticPractices
ServiceSetting
Multisystemic Therapy (MST) Example
Home & Community Based
TAMS & SAMS
Instrumental &Ultimate Outcomes
MST
4 – 5 Members
Team Supervisor
Cross-Team Supervisor
Family Therapy, etc.
Tx Program Selection
Valid alternatives to deciding by Valid alternatives to deciding by program?program?
TherapeuticPractices
ServiceSetting
How should we make decisions?How should we make decisions?
Tx Program Selection
TherapeuticPractices
ServiceSetting
Treatment Team
Supervision
How should we make decisions?How should we make decisions?
GeneralServicesResearch
Tx Program Selection
TherapeuticPractices
ServiceSetting
Treatment Team
Supervision
Evidence-Based Services Model
How should we make decisions?How should we make decisions?
Case-SpecificHistorical
Information
CausalMechanismResearch
Tx Program Selection
TherapeuticPractices
ServiceSetting
Treatment Team
Supervision
Individualized Case Conceptualization Model
How should we make decisions?How should we make decisions?
LocalAggregateEvidence
Case-SpecificHistorical
Information
Tx Program Selection
TherapeuticPractices
ServiceSetting
Treatment Team
Supervision
Practice-Based Evidence Model
The Full System ModelThe Full System ModelGeneralServicesResearch
LocalAggregateEvidence
Case-SpecificHistorical
Information
CausalMechanismResearch
Tx Program Selection
TherapeuticPractices
ServiceSetting
The Phases of EvidenceThe Phases of Evidence
1.1. Data: Discretely identifiable unitsData: Discretely identifiable units
2.2. Information: Data in a context that provides it Information: Data in a context that provides it meaningmeaning
3.3. Knowledge: Information helpful to decision-Knowledge: Information helpful to decision-makingmaking
4.4. Wisdom: Knowing when to apply our Wisdom: Knowing when to apply our knowledgeknowledge
c.f., Speigler, I. (2000). Knowledge management: A new idea or a recycled concept? Communications of the Association for Information Systems, 3, 1 – 23.
The Phases of Evidence: The Phases of Evidence: ExampleExample1.1. Data: 70Data: 70
2.2. Information: 70Information: 70ºº F F
3.3. Knowledge: It is warm enough to wear shorts.Knowledge: It is warm enough to wear shorts.
4.4. Wisdom: I am giving a professional talk today, Wisdom: I am giving a professional talk today, so my knowledge that it is warm enough to so my knowledge that it is warm enough to wear shorts is irrelevant to my attire.wear shorts is irrelevant to my attire.
General Services Research:General Services Research:Turning Data into Knowledge ITurning Data into Knowledge I
Meta Analysis of Children’s Treatment Meta Analysis of Children’s Treatment ResearchResearch– Over 350 studies, 40 yearsOver 350 studies, 40 years– Largest meta-analysis to dateLargest meta-analysis to date– Made dynamic for providersMade dynamic for providers
How do we get this knowledge to the How do we get this knowledge to the treatment team?treatment team?
GeneralServicesResearch
LocalAggregateEvidence
Case-SpecificHistorical
Information
CausalMechanismResearch
Tx Program Selection
TherapeuticPractices
ServiceSetting
Treatment Team
Supervision
ClientProgress
TreatmentIntegrity
Other OptionsOther Options
SAMHSA NREPSAMHSA NREP Published meta-analysesPublished meta-analyses Evidence based practice guidelinesEvidence based practice guidelines Paper/web reports Paper/web reports
The Blue Menu is being substantially updated based on hundreds of additional studies. Some problem areas that are now omitted will reappear in updated form on future editions.
Assertiveness Training, Cognitive Behavior Therapy and Medication, Cognitive Behavior Therapy with Parents, Hypnosis, Relaxation
None Biofeedback, Play Therapy, Psychodynamic Therapy, Rational Emotive Therapy
Client Centered Therapy, EMDR, Relationship Counseling, Teacher Psychoeducation [poorly tested: CBT with Parents Only; CBT with Child and CBT with Parent separately]
Attention and Hyperactivity Behaviors
Behavior Therapy and Medication, Self Verbalization
Biofeedback, Contingency Management, Education, Parent Management Training, Parent Management Training and Problem Solving, Physical Exercise, Relaxation and Physical Exercise, Relaxation and Physical Exercise, Social Skills and Medication, Working Memory Training
None Parent Management Training and Social Skills, Relaxation, Social Skills
Client Centered Therapy [poorly tested: Parent Management Training and Self-Verbalization, Self Control Training, Self Verbalization and Medication, Skill Development]
Autistic Spectrum Disorders
Intensive Behavior Therapy, Intensive Communication Training
Anger Control, Client Centered Therapy, Communication Skills, Functional Family Therapy, Multidimensional Treatment Foster Care, Parent Management Training and Problem Solving, Problem Solving, Rational Emotive Therapy, Relaxation, Transactional Analysis
Outreach Counseling, Peer Pairing, Self Control Training
Physical Exercise, Stress Inoculation
Education, Exposure, Family Systems Therapy, Group Therapy (!!), Life Skills, Project CARE (!!),Skill Development [poorly tested: Catharsis, Collaborative Problem Solving, Family Empowerment, Physical Exercise, Psychodynamic Therapy, Self Verbalization]
Depressive or Withdrawn Behaviors
Cognitive Behavior Therapy, Cognitive Behavior Therapy and Medication
Client Centered Therapy, Cognitive Behavior Therapy with Parents, Interpersonal Therapy, Family Therapy, Relaxation
None Self Control Training, Self Modeling
Attention, Counselors Care, Counselors Care and Anger Management, Life Skills[poorly tested: Problem Solving, Social Skills]
Eating Disorders None Family Therapy (anorexia only) None None None
Substance Use None Cognitive Behavior Therapy, Contingency Management, Purdue Brief Family Therapy, Family Therapy, Family Systems Therapy
None None Client Centered Therapy, Education, Group Therapy (!!), Project CARE (!!), Twelve Step Program
Traumatic Stress Cognitive Behavior Therapy with Parents Cognitive Behavior Therapy None Play Therapy, Psychodrama Client Centered Therapy, Cognitive Behavior Therapy with Parents Only[poorly tested: EMDR]
“Blue Menu” - Evidence-Based Child and Adolescent Psychosocial InterventionsThis tool has been developed to guide teams (inclusive of youth, family, educators and mental health practitioners) in developing appropriate plans using psychosocial interventions. Teams should use this information to prioritize promising options. For specific details about these interventions and their applications (e.g., age setting, gender) see the most recent Evidence Based Services Committee Biennial Report (http://www.hawaii.gov/health/mental-health/camhd/library/webs/ebs/ebs-index.html).<<NOTICE>>Note: Level 5 refers to treatments that were tested and found ineffective. Risk of harm is noted by the symbol (!!), which indicates that at least one study found negative effects on the main outcome measure. The risk of using such treatments should be weighed against potential benefits.
General Services Research:General Services Research:Turning Data into Knowledge IITurning Data into Knowledge II
Common Elements approachCommon Elements approach– Identified components of evidence based Identified components of evidence based
practicespractices– Complements integrated program Complements integrated program
approachapproach
Diffusion strategies: Compatibility, Complexity
Is there a different Is there a different level of analysis?level of analysis?
Protocol Protocol Protocol
Family
Is there a different Is there a different level of analysis?level of analysis?
IncredibleYears
PCITDefiant Children
Parent Training
Is there a different Is there a different level of analysis?level of analysis?
Protocol Protocol Protocol
Family
PracticeElement
PracticeElement
PracticeElement
PracticeElement
PracticeElement
PracticeElement
Is there a different Is there a different level of analysis?level of analysis?
Incredible Years
PCITDefiant
Children
Parent Training
Commands CommandsAttending
Time Out
Rewards
Time Out
These are “practice elements.
”
ExampleExample
Attending
Objectives: to increase the amount of positive attention provided to the child, even if the child has misbehaved
at other times during the day
to teach the caregiver to attend to positive behaviors
to promote the child’s sense of self-worth
Steps:
Provide rationale Emphasize the importance of providing positive attention to the child. Elicit the caregiver’s opinion about how attention affects behavior and
people’s motivation to do a good job. Have the caregiver describe his or her best and worst “managers”
and the caregiver’s motivation to work for each. Lead the caregiver to recognize that how he or she was treated
affected the caregiver’s desire to work. Discuss how the child’s behavior may be affected by the caregiver’s
behavior towards the child and how the child’s desire to behave can be increased by improving the caregiver-child relationship.
Set aside one-on-one time for caregiver and child
Encourage the caregiver to set aside a block of time (e.g., 10 minutes) each day devoted to joining the child in an activity the child has chosen.
Teach caregiver to provide positive and descriptive commentary
Show the caregiver how to demonstrate sincere interest in the child’s activities while they are playing.
Instruct the caregiver to provide enthusiastic descriptive (e.g., “You are drawing a tree”) and/or positive (e.g., “I like the way you stacked the blocks”) commentary and praise regarding the child’s behavior.
Encourage caregiver to engage in child’s activity
Suggest that the caregiver become actively involved in the play activity by imitating the child’s behavior in order to demonstrate approval.
Restrict criticism, questions, and commands
It is important that the child lead the activity; that is, the caregiver should refrain from making suggestions, asking questions, and criticizing the child.
Allow the child to use his or her imagination (e.g., coloring the green or making up new rules to a game) without caregiver input about the “correct” way to do things.
Anticipate difficulties When the procedure is initially implemented, the child may engage in negative behavior that characterizes the usual caregiver-child interaction. When this occurs, the caregiver should:
consistently ignore negative behavior by looking away; refrain from scolding the child so as to avoid providing negative
attention for misbehavior; end one-to-one time if disruptive behavior continues or is
dangerous. Over time, however, it is expected that consistent positive attending will result in decreased negative behavior and increased positive caregiver-child interactions.
Attending
Use This When:
To improve the quality of the caregiver-child relationship.
Practitioner Guide
For CaretakerFor Caretaker
AnxietyAnxiety
ADHDADHD
AutismAutism
DepressionDepression
Disruptive Disruptive BehaviorBehavior
Disruptive Disruptive BehaviorBehavior
TraumaticTraumaticStressStress
The Full System ModelThe Full System ModelGeneralServicesResearch
LocalAggregateEvidence
Case-SpecificHistorical
Information
CausalMechanismResearch
Tx Program Selection
TherapeuticPractices
ServiceSetting
Case Specific History:Case Specific History:Turning Data into Knowledge IIITurning Data into Knowledge III
ProblemsProblems Community therapistsCommunity therapists SMT, MMT, Usual CareSMT, MMT, Usual Care 185 children enrolled so far185 children enrolled so far
Training ResultsTraining Results
p < .01
Attributes of Innovations1. Relative Advantage2. Compatibility3. Complexity4. Observability
Diffusion of InnovationDiffusion of Innovation
Communication Channels1. Mass Media2. Interpersonal
Change Agent Properties1. Effort2. Homophily
Rate of Adoption
Adapted from Rogers (1995)
Attributes of Innovations1. Relative Advantage2. Compatibility3. Complexity4. Observability
Diffusion of InnovationDiffusion of Innovation
Communication Channels1. Mass Media2. Interpersonal
Change Agent Properties1. Effort2. Homophily
Rate of Adoption
Adapted from Rogers (1995)
Diffusion CurveDiffusion Curve%
of
adop
ters
InterpersonalMass media
Time From Rogers (1995)
Why have a review Why have a review committeecommittee
Generates “buy-in” (homophily)Generates “buy-in” (homophily) Establishes an organizational Establishes an organizational