EBM Workshop EBM Workshop EBM Workshop EBM Workshop EBM Workshop EBM Workshop EBM Workshop EBM Workshop Five Steps to Practice EBM Step 1 – asking a question Step 2 – searching for the best evidence Step 3 – critically appraising Step 4 – applying Step 5 – evaluating Step 1: Ask an answerable clinical question--P. I. C. O. _Patient / Problem : Male Smokers _Intervention / Exposure: Vitamin E, Beta-carotene _Comparison: None _Outcome Coronary heart disease Ex: In high cardiovascular risk male smokers, do vitamin E and carotene prevent clinical events or death? Step 2: Effective searches for the best Evidence Sources: _Textbook _Primary journal _Secondary journal _Internet _E-mail _Medline _Best evidence _Cochrane Library _Expert / Colleagues Websites recommended: _Evidence Based Medicine Reviews (OVID) _Cochrane Library Systematic Reviews (OVID) _Bandolier http://www.jr2.ox.ac.uk/bandolier/ _National Guideline Clearinghouse http://www.guideline.gov/ _PubMed http://www.ncbi.nlm.nih.gov/pubmed/ _PubMed Clinical Queries http://www.ncbi.nlm.nih.gov/entrez/query/static/clinical.shtml _Google http://www.google.com/ _ACP journal club (formerly BestEvidence) http://www.acpjc.org/ _Evidence Based Nursing http://ebn.bmjjournals.com _Evidence Based Mental Health http://ebmh.bmjjournals.com Step 3: Critically appraise that evidence for its validity and importance _ Diagnosis and Screening _ Prognosis _ Therapy _ Systematic Review _ Decision Analysis _ Harm / Etiology _ Guideline Step 4: Apply to your patient: Integrate with patients’ values and preferences Are these valid, important results applicable to our patient ? _ Is our patient so different form those in the study that its results cannot apply? _ Is the treatment feasible in our setting? _ What are our patient’s potential benefits and harms from the therapy? _ What are our patient’s value and expectations for both the outcome we are trying to prevent and the treatment we are offering?
10
Embed
EBM Workshop - web1.fyh.mohw.gov.twweb1.fyh.mohw.gov.tw/depweb/ebm/download/實證醫學種子教師培訓課程.pdf · STEP 3: Critical Appraisal of a Therapy Study You are seeing
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
EBM WorkshopEBM WorkshopEBM WorkshopEBM WorkshopEBM WorkshopEBM WorkshopEBM WorkshopEBM Workshop陸建陸建陸建陸建民醫師民醫師民醫師民醫師Five Steps to Practice EBM
Step 1 – asking a question
Step 2 – searching for the best evidence
Step 3 – critically appraising
Step 4 – applying
Step 5 – evaluating
Step 1: Ask an answerable clinical question--P. I. C. O.
_Patient / Problem : Male Smokers
_Intervention / Exposure: Vitamin E, Beta-carotene
_Comparison: None
_Outcome Coronary heart disease
Ex: In high cardiovascular risk male smokers, do vitamin E and carotene prevent clinical events or death?
_ACP journal club (formerly BestEvidence) http://www.acpjc.org/
_Evidence Based Nursing http://ebn.bmjjournals.com
_Evidence Based Mental Health http://ebmh.bmjjournals.com
Step 3: Critically appraise that evidence for its validity and importance
_ Diagnosis and Screening
_ Prognosis
_ Therapy
_ Systematic Review
_ Decision Analysis
_ Harm / Etiology
_ Guideline
Step 4: Apply to your patient: Integrate with patients’ values and preferences
Are these valid, important results applicable to our patient ?
_ Is our patient so different form those in the study that its results
cannot apply?
_ Is the treatment feasible in our setting?
_ What are our patient’s potential benefits and harms from the therapy?
_ What are our patient’s value and expectations for both the outcome
we are trying to prevent and the treatment we are offering?
Objectives of the workshop :
you should be able to:1. Recognise and formulate your own answerable clinical questions2. Identify the type of research that best answers the different classes of clinical questions.3. Appraise, and apply the results of different types of research studies to help in the management of individual patients. ( therapy studies and other types –diagnosis, prognosis, aetiology, etc)4. Express the results of clinical trials in terms of both relative and absolute risk reductions, and be able to explain the numerical results to a patient.5. Know which of several research databasesdatabases (MEDLINE, Cochrane, Embase, etc) and secondary resources (Clinical Evidence, Guidelines) are most likely to be helpful in answering different types of clinical questions.6. Search using multiple text words and MeSH heading connected by Booleans (AND, OR, NOT) and truncations (* and $)“Evidence-based medicine is the integration of best research
evidence with clinical expertise and patient values”
- Dave Sackett
My student are dismayed when I say to them “half of what you
are taught as medical students will in 10 years have been show
to be wrong. And the trouble is, none of your teachers knows
which half.”
--Dr Sydney Burwell, Dean of Harvard Medical School
Recommended Text
� Straus SE, Richardson WS, Glasziou PP, Haynes RB. Evidence-based Medicine: How to Practise and Teach EBM. Third Edition. Churchill Livingstone: Edinburgh, 2005 or
� Badenoch D, Heneghan C. Evidence-Based Medicine Toolkit, 2nd Edition BMJ Publishing, 2006.
Session ONE: Step 1: Asking QuestionsPart A. Exercise: study designs
This first session aims to familiarise you with the PICO structure of questions, and being able rapidly recognise these in research articles.
PART A. Exercise: study designs� Read the abstracts from published studies on the following pages and answer the following questions
for each study:1. What is the question (PICO) of the study?2. What is the purpose of the study?
a. Interventionb. Frequency (incidence or prevalence)c. Diagnostic accuracyd. Prognosis (or natural history)e. Aetiology and risk factors
3. Which study type would give the highest quality evidence to answer the question? (see
‘Levels of evidence table’)4. Which is the best study type that is also feasible? (You can use the Table below as a
guide)5. What is the study type used?
PART B. Formulate the questions for the scenarios provided and for one or more of your
own scenarios
Session ONE: Step 1: Asking QuestionsPart B: formulate the questions for the scenarios provided
and for one or more of your own scenarios
Example – Stockings for long flights?� A 43 year old male asked for some repeat prescriptions and advice about
preventing deep vein thrombosis on a 12 hour flight (his brother had had one last year). You suggest stockings as the most effective prevention.
Question� Patient or Population: _ In patients on long flights � Intervention or Indicator: __ do compression stockings � Comparator: ___ no compression stockings � Outcome: ____ prevent Deep Vein Thrombosis
(DVT)___________________________Question sentence: In patients on long flights (P), do compression stockings (I)
prevent DVT (O)?� What type of question is this (phenomena, frequency, diagnosis, prediction, or
intervention)?� What would be the ideal study type? (Randomised Trial, Inception cohort,
Survey, etc)
� What would be the best feasible study type?
STEP 2: TRACK DOWN THE BEST EVIDENCE TRACK DOWN THE BEST EVIDENCE
� Use the ACTUAL SEARCHES tables for each of the questions to record the different terms you searched on, the number of hits, and the final “best evidence” you chose.
� "For intervention questions you should try searching either the Cochrane Library (available via www.library.nhs.uk ), or PubMed (available at www.pubmed.gov ) and possibly Embase (available via OVID at www.bodley.ox.ac.uk/oxlip ).
� We would suggest the following steps (using PubMed as an example):
� 1. Go to www.pubmed.gov and select Clinical Queries (left hand menu)
� 2. Select the appropriate Category (usually ‘therapy’ which is the default)
� 3. Type in the most crucial single element of your PICO search (usually the I or the
P)
� 4. If your search returns no articles then click the ‘Broad’ scope
� 5. If your search returns more than 30 articles then try adding more PICO elements,
e.g, if you used only the ‘I’ now try searching the I AND P (not use capitals for the
AND)
� 6. Select the best single article (eg the largest or longest trial NOT necessarily the
most recent). Please record why you chose the article you did.
TRACK DOWN THE BEST EVIDENCE: Searching Tips and Tactics
Session TWO: STEP 3: Critical Appraisal of a Therapy Study
You are seeing a 48 year old man who has just recovered from idopathic pericardititisand he is asking about the chance of recurrence and whether he can do anything to prevent it. You recall hearing something about a new trial recently, but can’t remember the details.
Suppose you had tracked down the attached paper. Work though the critical appraisal worksheets for this article, and:
� 1. decide what question (PICO) the study asked and answered� Patients ……” middle-aged men with idiopathic pericarditis……….
� Intervention …Aspirin (NSAIDs)……………………………………….
� Comparator …None……………………………………………
� Outcome ……Recurrence rate…………………………………………
� 2. whether the internal validity of the study is sufficient to allow firm conclusions(all studies have some flaws; but are these flaws sufficient to discard the study?)
� 3. if the study is sufficiently valid, look at and interpret the results – what is therelevance or size of the effects of the intervention? What is the Relative Risk Reduction (RRR) and Absolute Risk Reduction (ARR)?
� 4. decide whether and how the results would apply to our patient above.Then role play explaining the condition and treatment to a patient using the following steps: (a) the prognosis, ie chance of recurrence
(b) the impact of treatment on this
Endarterectomy for asymptomatic carotid artery stenosis. Executive Committee for the Asymptomatic Carotid Atherosclerosis Study
JAMA 1995; 273 (18): 1421-8
� OBJECTIVE--To determine whether the addition of carotid endarterectomy to aggressive medical management can reduce the incidence of cerebral infarction in patients with asymptomatic carotid artery stenosis.
� SETTING--Thirty-nine clinical sites across the United States and Canada.
� PATIENTS--Between December 1987 and December 1993, a total of 1662 patients with asymptomatic carotid artery stenosis of 60% or greater reduction in diameter were randomized; follow-up data are available on 1659. At baseline, recognized risk factors for stroke were similar between the two treatment groups.
� INTERVENTION--Daily aspirin administration and medical risk factor management for all patients; carotid endarterectomy for patients randomized to receive surgery.
� MAIN OUTCOME MEASURES--Initially, transient ischemic attack or cerebral infarction occurring in the distribution of the study artery and any transient ischemic attack, stroke, or death occurring in the perioperative period. In March 1993, the primary outcome measures were changed to cerebral infarction occurring in the distribution of the study artery or any stroke or death occurring in the perioperative period.
� RESULTS--After a median follow-up of 2.7 years, with 4657 patient-years of observation, the aggregate risk over 5 years for ipsilateral stroke and any perioperative stroke or death was estimated to be 5.1% for surgical patients and 11.0% for patients treated medically (aggregate risk reduction of 53% [95% confidence interval, 22% to 72%]).
� CONCLUSION--Patients with asymptomatic carotid artery stenosis of 60% or greater reduction in diameter and whose general health makes them good candidates for elective surgery will have a reduced 5-year risk of ipsilateral stroke if carotid endarterectomy performed with less than 3% perioperative morbidity and mortality is added to aggressive management of modifiable risk factors.
PICO
� In individual with asymptomatic hemodynamically
significant carotid artery stenosis (>60%), will CEA
added to aggressive reduction of modified risk
factors and administration of aspirin reduce the 5-
year risk of ipsilateral cerebral infarction ?
THERAPY STUDY: Are the results of the trial validvalid? (Internal Validity)
Are the results of the trial validvalid? (Internal Validity)
THERAPY STUDY: What were the results? (Are the results important?)
What were the results?Will the results help me in caring for my patient?
(External Validity/Applicability)
� Angiographic complication rate:
1.2%
� Perioperative risk rate of
surgical group: 2.3 % (0.4% of
medical group)
� Estimated overall perioperative
risk rate: 2.7% for cerebral infarction or death
Session 4: Prepare a critically appraised topic
You should aim to set aside 2-3 hours to prepare you brief presentation at your final session. For this you will need:
� 1. To identify an article you found during the library session, and get the fulltext article
� 2. To critically appraise the article using the appropriate appraisal sheet (seeextra readings for systematic review and diagnosis appraisal sheets).
� 3. Prepare a brief presentation – you will be given an single OHP (see attachedexample) but are welcome to use other methods. For other examples youmight look at
(i) the CATbank on the CEBM website (www.cebm.net) or
(ii) the BestBets: www.bestbets.org which has CATs for A&E
� STRUCTURE OF YOUR PRESENTATION (with guide times)� 1. Describe the clinical situation and the clinical question (PICO) you need to answer.
(2 mins)
� 2. Describe your search (1 min)
� 3. Write a brief description of the question (PICO) and methods of the study.
Appraise the validity of the study. (3 mins)
� 4. State how the study applies to the patient you identified. (1 min)
� A template for this is attached, but you are free to use another approach if you wish.
Critically Appraised Topic Presentation Template
� 1. Give a description of the clinical situation and the clinicalquestion you need to answer.
� Question (PICO):
� 2. Give your search strategy including: � (a) database used,
� (b) search terms used, and� (c) number of papers identified, and (d) why did you choose the
particular article?
� 3. What was the question of the study. Appraise the validityof the study
� 4. What were the results of the study?� 5. State how the study applies to the patient you identified.
Three modes of teaching EBM
The top 10 successes we’ve had or seen in teaching EBM The top 10 mistakes we’ve made or seen in teaching EBM
Incorporating EBM into inpatient rounds
A guide for learners presenting an “old” patient at
follow-up round Incorporating EBM into outpatient rounds
Developing EBM skills in and out of morning report Take-home Message
EBM JOURNAL CLUB ?In most clinical centes, journal club runs like Cheyne-Stoke
breathing—alternating a few raspy grunts with prolonged apneic inactivity .
� Needs-driven: PBL
� Evidence-driven: keeping current
� Skills-driven: learning EBM skills
�Session 1: Topic selection
�Session 2: Results of evidence search
�Session 3: Critical appraisal
Three (potentially competing) goals for
evidence-based journal clubs
Six maneuvers to successfully introduce EBM into
your journal club1. Find and cultivate the allies, whether from within your department or
elsewhere, who will help you achieve your aims.
2. Negotiate teaching and learning EBM to be one of the main goals of journal club, again either by meeting with or by becoming those who run the conference. Table 7.9
3. Negotiate the use of group learning techniques and the development of a healthy learning climate into your journal club.
4. Help assemble the infrastructure needed to learn, practice, and teach in evidence-based ways, including quick access to evidence resources and opportunities to learn more about EBM skills outside of journal club.
5. Prepare some learning materials for EBM, including introductory materials on how to get started, samples of concise evidence summaries, whether your
own CATs or from evidence-based pre-appraised sources, and even concise explanations of methods underlying the practice of EBM.
6. Refine further your own skills in facilitating group discussions and in teaching EBM, whether by getting local coaching or by attending a course on how to teach EBM.
Each journal club session can be thought of as consisting of three parts:
� In part 1, journal club members identify some learning
needs to be addressed in the future. 1. For a needs-driven group, this can take the form of learners presenting
cases where they faced uncertainty in clinical decisions, continuing until there is group consensus that a particular problem (we’ll call this “problem C”) is worth the time and effort necessary to find its solution.
2. For an evidence-driven group, group members can debate which part of their field they most need to update next (this could be called “field segment C”).
3. For a skills-driven group, the members would discuss and decide which skill for evidence-based practice they most need to develop or refine (this could then be called “skill C”).
� Group members then take responsibility (either volunteering or on rotation) for
performing a search for evidence to be used—whether the best available for
problem C, the newest strong evidence for field segment C, or a useful teaching
example for skill C. Groups may have members do this in pairs or triplets, so more
experienced members can teach skills to newer folks.
Each journal club session can be thought of as consisting of three parts:
� In part 2, the results of the evidence search (which we’ll label “B”) on the previous session’s problem, field segment,
or skill are shared in the form of photocopies of the abstracts of 4–6 systematic reviews, original articles or other evidence.
� Club members decide which one or two pieces of evidence are
worth studying, and arrangements are made to get copies of
the clinical question and evidence to all members well in advance of the next meeting.
Each journal club session can be thought of as
consisting of three parts:� The main part of the journal club (part 3) is spent in a
critical appraisal of the evidence found in response to a
clinical question posed two sessions ago and selected for detailed study last session.
� This segment often begins with the admission that most learners
haven’t read the articles, so time (6–10 minutes) can be provided
for everyone to see if they can determine the validity and clinical applicability of one of the articles, thereby reinforcing rapid critical
appraisal.
� After that interlude, the evidence is critically appraised for its
validity, importance, and applicability, and a decision is made about
whether and how it could be applied to the patient problems (for
needs-driven groups), whether and how it should change current practice (for evidence-driven groups), or whether and how it can
build skills for evidence-based practice (for skills-driven groups).