AUSTRALASIAN COCHRANE CENTRE Cochrane Systematic reviews: for best practice in assisted reproduction Hesham Al-inany, PhD Cairo University
Jul 10, 2015
AUSTRALASIAN
COCHRANE CENTRE
Cochrane Systematic reviews:
for best practice in assisted
reproduction
Hesham Al-inany, PhDCairo University
AUSTRALASIAN
COCHRANE CENTRE
Our challenge as clinicians/fertility specialists…
Meeting our patients needs
Offering the best treatments to improve their
chances of conceiving
Being up to date
Delays in dissemination
Competing knowledge sources
Medical journals – single studies, reviews
Conferences
AUSTRALASIAN
COCHRANE CENTRE
30-40% patients do not get treatments of
proven effectiveness
20-25% patients get care that is not needed or
potentially harmful
McGlyn et al 2003 NEJM
Grimshaw et al 2012 Implementation Science
The delivery of health care is variable
AUSTRALASIAN
COCHRANE CENTRE
What about fertility treatments?
Are we offering our patients the most effective treatments?
How do we know that we are not doing more harm than good?
AUSTRALASIAN
COCHRANE CENTRE
Reasoning
based on
patho-physiology Guidelines
Reasoning based on
observational studies Systematic
reviews
Improved health
care
There’s been a culture change
Randomised
controlled trials
AUSTRALASIAN
COCHRANE CENTRE
systematic reviews ……
Key features of a systematic review?
clearly stated objectives
pre-defined eligibility criteria
explicit, reproducible methodology
systematic search
assessment of validity of included studies
systematic synthesis and presentation of findings
AUSTRALASIAN
COCHRANE CENTRE
Preparing, maintaining and disseminating systematic reviews of the effects of health care
The Cochrane Collaboration
AUSTRALASIAN
COCHRANE CENTRE
Producing high-quality systematic reviews
Dissemination of review findings
Training in systematic reviews
What is the Cochrane Collaboration about?
AUSTRALASIAN
COCHRANE CENTRE
Advantages of Cochrane reviews
Updating of reviews regularly
Methodologically robust
Less likely to be biased
AUSTRALASIAN
COCHRANE CENTRE
How do (Cochrane) systematic reviews
reduce bias?
Prestated methods published
Limit publication bias
Systematic methodology
Limit commercial and industry
sponsorship of reviews
AUSTRALASIAN
COCHRANE CENTRE
“..we observed far superior
reporting standards of Cochrane
reviews compared to non-
Cochrane therapeutic ones.”
“For therapeutic reviews, all the
Cochrane ones reported assessing
the quality of included studies
whereas only half of the non-
Cochrane did.”
“The seven industry supported
reviews that had conclusions
recommended the
experimental drug without
reservations, compared with
none of the Cochrane reviews,
although the estimated
treatment effect was similar on
average
Better quality reviews
AUSTRALASIAN
COCHRANE CENTRE
Studies with funding bias are more likely to have
favourable results (Lundh et al 2012)
Add reviews on this topic
AUSTRALASIAN
COCHRANE CENTRE
The Cochrane Menstrual Disorders and
Subfertility Group
Produces systematic reviews for the Cochrane
Library
Editorial office at the University of Auckland
26 editors – methodologists, statisticians,
content experts
Work with about 800 authors
13
AUSTRALASIAN
COCHRANE CENTRE
The life cycle of a Cochrane reviewTitle
(registered)
Prepare Protocol
Register Protocol
Systematic Review
Review online
Time Frame
6 Months
12 Months
Lifelong
editorial + external review
searchesinclusions
qualitydata extraction
meta-analysis
editorial + external review
outside comments and criticisms
new data
2 or more reviewers
AUSTRALASIAN
COCHRANE CENTRE
An assisted reproduction cycle is a
series of individual steps….
Complex with
interactions between
steps
Benefits and harms
can take place with
each step
Trade-offs may be
necessary
Two patients to
consider – mother and
baby
Pre ARTDown
regulationOvulation induction
Ovulation trigger
Oocyte retrieval
+/- Sperm retrieval
Laboratory procedures
Embryotransfer
Luteal phase support
Thaw transfers
AUSTRALASIAN
COCHRANE CENTRE
Subfertility Cochrane reviews by
topic (August 2013) (n=110)
0
10
20
30
40
50
60
70
Assisted
conception
Male
subfertility
Female
subfertility
Unexplained
subfertility
Ectopic
pregnancy
Reviews
Protocols
Titles
16
AUSTRALASIAN
COCHRANE CENTRE
Classification
Effective interventions Review found evidence of effectiveness or improved safety for an intervention
Promising interventions Review found some evidence of effectiveness or improved safety for an intervention, but more evidence is needed
Ineffective interventions Review found evidence of a lack of effectiveness or reduced safety for an intervention: 10 reviews
Possibly ineffective interventions Review found evidence suggesting a lack of effectiveness of reduced safety for an intervention, but more evidence is needed: 3 reviews
No conclusions possible due to lack of evidence
Review found insufficient evidence to comment on the effectiveness or safety of an intervention.
www.cochranejournalclub.com
AUSTRALASIAN
COCHRANE CENTRE
Examples of effective interventions
Endometrial injury performed in the month prior to ovulation induction for ART increases both the live birth rate and clinical pregnancy rate
Laparoscopic tubal occlusion is an alternative to laparoscopic salpingectomy in improving IVF pregnancy rates in women with hydrosalpinges
The administration of GnRHa for a period of 3-6 months prior to IVF or ICSI in women with endometriosis increased the odds of clinical pregnancy by fourfold
Increased live birth rate associated with embryo culture using low oxygen concentrations
Increase in clinical pregnancy rate using ultrasound guided embryo transfer compared with clinical touch
www.cochranejournalclub.com
AUSTRALASIAN
COCHRANE CENTRE
Examples of ineffective interventions
Preimplantation genetic screening as currently performed significantly decreases live birth rates in women of advanced maternal age and those with repeated IVF failure. Trials in which PGS was offered to women with a good prognosis suggested similar outcomes
www.cochranejournalclub.com
AUSTRALASIAN
COCHRANE CENTRE
Examples of lack of evidence
Intralipids for elevated NK cells
Timelapse cinematography
Type of culture media
Fast track IVF
Mucous aspiration before ET
www.cochranejournalclub.com
AUSTRALASIAN
COCHRANE CENTRE
How Cochrane SR can make an impact…..
PGS for advanced maternal age in IVF
cycles
GnRh agonist for triggering ovulation
Gn for COH
GnRH agonist vs GnRH antagonist
AUSTRALASIAN
COCHRANE CENTRE
There was enthusiasm for PGS
Advanced maternal age
Gianaroli 1999, Munne 1999, Kahraman 2000,
Obasaji 2001, Munne 2003; Montag 2004; Platteau
2005
Repeated IVF failure
Gianaroli 1999, Kahraman 2000, Pehlivan
2003,Munne 2003, Wilding 2004
Recurrent miscarriage
Pellicer 1999, Rubio 2003, Rubio 2005, Munne
2005
Severe male factor
Silber 2003, Platteau 2004
AUSTRALASIAN
COCHRANE CENTRE
Cochrane review 1st published in 2005
Only one RCT
Updated in 2010
9 RCTs – 1589 women
All used FISH
3 different populations
AUSTRALASIAN
COCHRANE CENTRE
Preimplantation genetic screening for
advanced maternal age – reduced live
birth rates
OR 0.59
(0.44, 0.81)
AUSTRALASIAN
COCHRANE CENTRE
ESHRE PGS Consortium
By 2008 over 16000 cycles of PGS were
undertaken…
Assuming a 20% live birth rate, it is estimated
that between 640 to 1728 fewer babies born
as a result
AUSTRALASIAN
COCHRANE CENTRE
ASRM Practice Committee 2008
Available evidence does not support
the use of PGS as currently performed to
improve live-birth rates in patients with
advanced maternal age or in patients
with previous implantation failure.
AUSTRALASIAN
COCHRANE CENTRE
The only effective way to resolve the
debate is to perform more well-designed
and well-executed clinical trials
AUSTRALASIAN
COCHRANE CENTRE
an ESHRE trial has recently been started
on patients with AMA using
polar body biopsy and array-comparative
genomic hybridization, which should bring
more information on this patient group in the
near future.
AUSTRALASIAN
COCHRANE CENTRE
Triggering – GnRH agonist or hCG?
Youssef et al, updated CR 2013
17 RCTs
9 report OHSS
5 report live birth rate
Risk of bias
Only 2/17 used blinding
4/17 studies stopped prematurely for
differing reasons
All studies were either funded by
pharmaceutical companies or did not
report their funding
AUSTRALASIAN
COCHRANE CENTRE
Ovarian hyperstimulation rate is reduced with
agonist trigger in high risk women only
OR 0.06
(0.01, 0.34)
Youssef et al, updated 2013
*4 studies no events in either arm
AUSTRALASIAN
COCHRANE CENTRE
Live birth rate reduced with GnRHa
triggering
AUSTRALASIAN
COCHRANE CENTRE
The trade off
Fewer live births – difference of 10%
between HCG and GnRHa triggers
Fewer cases of OHSS – difference of 2-3%
for high risk women
Who decides?
AUSTRALASIAN
COCHRANE CENTRE
Professor Hans Evers
Editorial, Human Reproduction
September 2013
“As an Editor of this journal, I would whole-heartedly
welcome a manuscript on the first sufficiently powered
RCT of GnRHa triggering in one arm, and traditional hCG
triggering in the other; with subsequent secondary
randomization to a ‘freeze-all’ strategy or a ‘fresh
transfer’ strategy in either of the two arms. “
AUSTRALASIAN
COCHRANE CENTRE
Gn,
Several systematic reviews compared
recombinantFSH with urinary
gonadotrophins (hMG, FSH-P, FSH-HP) Daya 1998; Larizgoitia 2000; Agrawal 2000; Daya2002;Van Wely 2003;NCC-WCH 2004;Al-Inany 2003;
Al-Inany 2008;Coomarisamy 2008).
AUSTRALASIAN
COCHRANE CENTRE
Effectiveness
Meta-analysis :
Al-Inany et al, 2005
AUSTRALASIAN
COCHRANE CENTRE
Conflicting results
Two reviews compared rFSH to urinary
FSH and found higher pregnancy rates
per cycle started for rFSH (Daya 2002,
updated from Daya 1998).
Three reviews compared rFSH with hMG
and reported evidence of a difference
in live birth and clinical pregnancy rate
per cycle between rFSH and hMG (Van
Wely 2002;Al-Inany 2008; Coomarisamy 2008).
Gn: Cochrane Word
Madelon van Wely1, Irene Kwan2, Anna L Burt3, Jane
Thomas4, Andy Vail5, Fulco Van der Veen6, Hesham G
Al-Inany
AUSTRALASIAN
COCHRANE CENTRE
Cochrane SR
Randomised controlled trials only.
Quasi-randomised controlled trials, in
which allocation was, for example, by
alternation or reference to case record
number or to dates of birth, were
excluded.
Crossover trials were excluded since the
design is not appropriate in this context
(Vail 2003)
AUSTRALASIAN
COCHRANE CENTRE
42 RCTs The total number of participants was
9606 There was no evidence of a difference
in live birth or pregnancy ongoing
beyond 20 weeks (OR 0.97, 95% CI 0.87 -
1.08) for rFSH versus urinary Gn.
Meaning 25% live birth rate (22-26% in
different centers)
AUSTRALASIAN
COCHRANE CENTRE
Severe OHSS
There was no evidence of a difference
in the primary safety outcome OHSS
(32 trials, N=7740; OR 1.18, 95% CI 0.86 -
1.61).
Typical rate of 2% OHSS
AUSTRALASIAN
COCHRANE CENTRE
Live Birth Rate
AUSTRALASIAN
COCHRANE CENTRE
OHSS
AUSTRALASIAN
COCHRANE CENTRE
Gonadotrophins
are
Gonadotrophins
AUSTRALASIAN
COCHRANE CENTRE
GnRH agonist vs antagonist,
2001
AUSTRALASIAN
COCHRANE CENTRE
Al-inany et al., 2006
O.R = 0.82, 95% CI = 0.68 to 0.97
AUSTRALASIAN
COCHRANE CENTRE
Al-Inany et al., 2011
45 RCTs
7532 participants
Conclusion
differed
AUSTRALASIAN
COCHRANE CENTRE
WHY:
AUSTRALASIAN
COCHRANE CENTRE
How to Explain
OHSS is an uncommon complication
Uncommon complications need large
number of participants to show if there is a
real difference between two drugs
In our current situation: agonist vs.
antagonist
OHSS in agonist group: 3.74% (84/3165)
OHSS in antagonist group: 1.91% (149/
2252)
AUSTRALASIAN
COCHRANE CENTRE
How to explain (continue)
More Studies were conducted on
women with PCOS after 2006 which
illustrated this difference
AUSTRALASIAN
COCHRANE CENTRE
CPR
AUSTRALASIAN
COCHRANE CENTRE
The trade off
Less CPR – difference of 3%
Less OHSS – mostly in PCOS women
Who decides?
AUSTRALASIAN
COCHRANE CENTRE
In Conclusion
There are many highly valid Cochrane
reviews in subfertiilty
Useful for clinicians seeking a summary
of studies
Highlight gaps in research
AUSTRALASIAN
COCHRANE CENTRE
@CochraneMDSG www.cochrane.org