1 Choices and Outcomes: The Effects of Improvement Project Portfolio Choices on Clinical Outcomes Anita L. Tucker Assistant Professor, U. of Pennsylvania Senior Fellow, Leonard Davis Institute of Health Economics Ingrid M. Nembhard Doctoral Candidate, Harvard Business School Harvard Graduate School of Arts and Sciences KLIC 4: INFORMS Conference November 6, 2006 Financial Support from HBS DOR, Wharton’s Fishman Davidson Center In Collaboration with Jeffrey Horbar, Richard Bohmer and Amy Edmondson
14
Embed
1 Choices and Outcomes: The Effects of Improvement Project Portfolio Choices on Clinical Outcomes Anita L. Tucker Assistant Professor, U. of Pennsylvania.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1
Choices and Outcomes: The Effects of Improvement Project
Portfolio Choices on Clinical Outcomes
Anita L. Tucker Assistant Professor, U. of Pennsylvania
Senior Fellow, Leonard Davis Institute of Health Economics
Ingrid M. NembhardDoctoral Candidate, Harvard Business SchoolHarvard Graduate School of Arts and Sciences
KLIC 4: INFORMS ConferenceNovember 6, 2006
Financial Support from HBS DOR, Wharton’s Fishman Davidson CenterIn Collaboration with Jeffrey Horbar, Richard Bohmer and Amy Edmondson
2
Background: Health Care in America
1999: Institute of Medicine (IOM) reports 100,000 Americans die annually from preventable medical errors
1998: National Roundtable reports “serious and
widespread problems” exist in American medicine” . .
Problems of underuse, overuse, misuse . . “Quality of care is
the problem.”
2003: RAND Study reports only 55% of patients receive the recommended care for their condition
2000: IOM finds quality problems are a systemic property, requiring process improvement
1996: Dartmouth Atlas Project shows inappropriately geographic variations in care
Need for improvement projects in health care organizations
The Data:
=
+
Publicity:
3
Improvement Projects
Improvement Projects “solve complex organizational problems through the work of formal teams that use a structured improvement method” (Christianson et al., 2005: p. 610)
Healthcare Project Examples Target Area• Increase handwashing (Reduce Infections)• Reduce heelsticks in Neonates (Pain management)• Increase collaboration among MDs and RNs (Staff Retention)
Portfolio of Improvement Projects: An organization’s set of improvement projects that are in progress at the same time and draw on the same limited set of human, managerial and financial resources (Cooper, Edgett & Kleinschmidt, 1999; Wheelwright & Clark, 1992)
4
Research Question
How should health care organizations structure their portfolios of improvement projects to
achieve better outcomes?
Hypotheses about Portfolio Choices1) Number of projects (+)2) Concentration within a target area (+)3) Level of evidence for portfolio (+)4) Novices should start with clinically-
oriented portfolio (+) 5) Extent of physician involvement (+)
5
Collaborative of Neonatal Intensive Care Units (NICU)
44 NICUs working together for 2 ½ years (Apr 2002 - Oct 2004)
Identified 7 target areas for improvement and 93 improvement projects across those areas
Met twice a year to learn QI methods (PDSA cycles), work on developing best practice guidelines and share experiences
In between meetings, implemented practices, conducted site visits to other NICUs and phone conferences
Research Setting: Vermont Oxford Network
Horbar, J. D. et al, 2001. Collaborative quality improvement for neonatal intensive care. Pediatrics 107 (1) 14-22.
6
Portfolio Project OptionsTarget Area Aim # of
practices
Sample practice project(s)
Pain & Sedation Decrease mean pain score by 50% during
NICU stay
10 Pain management during heelsticks
Intubation of medications
Infection Control Decrease hospital-acquired infections by
25-50% over 2 years
7 Promote hand washing education and
practices to prevent nosocomial infection
Respiratory Care Decrease chronic lung disease by 10%,
23 Develop "trigger point" checklist for discharge
teaching
93 Potential Projects in the Portfolio
Cli
nic
all
y-o
rien
ted
Op
erat
ion
ally
-ori
ente
d
**Each NICU indicated which projects they included in their project portfolio to the collaborative sponsor.
7
Unique Portfolios of Practices
PBP Ho
spit
al 1
00
Hos
pita
l 101
Ho
spit
al 1
02
Hos
pita
l 103
Hos
pita
l 104
Hos
pita
l 105
1 Intubation Medications # # + #10 Pharmacological Factors affecting Opioid Tolerance # #2 Reduce frequency of tracheal suctioning o + o + o3 Reduce frequency of heelsticks + + x o + #4 Standardized Recommendations for Sucrose Analgesia o + + o # x5 Pain Management During Heelsticks + o + x6 Peripheral Vascular Procedures o + o + +7 Circumcision o + o x x8 Postoperative Pain Management x + + o x #9 Guidelines for weaning from opioids x + + #
Sum of + Have in place prior to NIC/Q 2002 1 6 3 1 6 1Sum of o Implemented during NIC/Q 2002 4 0 0 7 0 1Sum of X Working on 2 0 1 0 2 3Sum of # plan to work on 2 0 0 1 1 5Sum of not working on and don't plan to 1 4 6 1 1 0
Excerpt from the practices from Pain Management
Implemented during collaborative
Working on
Hospital 100 Implemented/Working on: Reducing frequency of tracheal suctioning, standarized sucrose analgesia, peripheral vascular procedures, circumcision, post op pain, weaning from opiods
VERSUSHospital 102: Reducing frequency of heelsticks
8
Evidence-base for the portfolio
Level of evidence for all projects within each target area assessed by target area team using Muir-Gray (MG) score to rate articles1 = strong evidence from at least one systematic review of multiple,
well-designed, randomized, controlled trials
2 = properly designed randomized control trial of appropriate size
3 = well-designed trials without randomization
4 = well-designed non-experimental trials
5 = opinions of respected authorities, based on clinical evidence,
descriptive studies or reports of expert committees
Evidence base for NICU portfolio = the average MG score of the portfolio
9
Outcome: Standardized Mortality Ratio
SMR level of analysis: Babies nested in NICU
1.LOGIT model (clustered by NICU) Outcome Death (0,1)
• Independent Variables: Established risk factors (Zupanic et al. 2006)
2.Predict probability of death for each baby
3.By NiCU, sum up probability of death, actual deaths