Peggy Cruse and Shandra Protzko Library & Knowledge Services, National Jewish Health COLLABORATING TO PRODUCE SYSTEMATIC REVIEWS 1
Jan 12, 2016
Peggy Cruse and Shandra Protzko
Library & Knowledge Services, National Jewish Health
COLLABORATING TO PRODUCE SYSTEMATIC
REVIEWS
1
Agenda
BackgroundSRs in the context of publishingSRs and the librarian
The SR processFor the investigatorFor the librarian
Discussion
2
Why is everyone talking about SRs?
“attempts to collate empirical evidence that fits pre-specified eligibility criteria to answer a specific research question.”
(Liberati et al)
Climate of best practiceIoM StandardsSociety publishing standardsPRISMA - Preferred Reporting Items for
Systematic Reviews and Meta-Analysis Grade - Grading of Recommendations
Assessment, Development and Evaluation
Resources: GRADE, IoM report, PRISMA, J Amer Dental Assoc
3
Why do a systematic review? Reduce bias in how conclusions are
reached Improve the power and precision of results Too much information - summarize
evidence about the effectiveness of particular approaches for addressing a public health problem
Analyze generalizability of findings Too little information - identify knowledge
gaps and need for additional research
4
MOU/Level of service
Getting paid Authorship Timeline Services
Formulate a searchable questionPeer review searchCitations in reference management softwareScreening sheetsDocument the results/methodology
Resources: ICJME, AGREE
5
Resources: ICJME
6
What the investigator is doing
Resources: Cochrane handbook
7
Define the question/ inclusion criteria
Search for studies
Select studies/collect data
Assess risk of bias in studies
Address reporting bias
Present results and ‘summary of findings’ tables
Interpret results/ draw conclusions
What you are doingDefine the
question/inclusion criteria
Define the question
Search for studies Peer reviewed search
Select studies/collect data
Export results/screening sheets/document
Assess risk of bias in studies Wait
Address reporting bias Wait some more
Present results and ‘summary of findings’
tables
Document the results and write the methodology
Interpret results/draw conclusions Wait for publication
8
Reference interview: define the question
PICO
Resources: GRADE, IoM report, Journal of the American Dental Association
9
In children with influenza-like illness, does treatment with oseltamivir (compared to combination therapy or no drug) reduce mortality and duration of symptoms?
Searching Scope Search
MeSH and text wordsNumbersSample results
Final SearchRevisions Peer reviewSelect databasesGrey lit
○ Pharma, .gov, etc.○ Publication bias
10
11
Explaining the search
Tips and Tricks[square brackets] to annotate linesExcel to group related conceptsOther visualization tools?
○ Adobe Illustrator○ eulerAPE
12
Resources: eulerAPE
Concepts drawn in Illustrator
13
EulerAPE
14
Export
Tips and tricksDe-dup Save everything!!Name EN files w standard conventions
○ Date_Subject_Screen#.enlx○ 20140825_IPF_1stScreen.enlx
15
Record keeping
16
Resources: PRISMA
Write the methodology
17
PRISMA Flow Diagram
18
Tools RevMan: prepare reviews http://ims.cochrane.org/revman/
download
GRADEPro: create ‘summary of findings’ (SoF) table
http://www.gradeworkinggroup.org/toolbox/index.htm
HLWiki International, Software for Systematic Reviewing http://hlwiki.slais.ubc.ca/index.php/Software_for_systematic_reviewing
CADTH Peer Review Checklist for Search Strategies http://www.cadth.ca/en/resources/finding-evidence-is/peer-review-search-strat
19
Resources AHRQ Effective Health Care Program Guides
http://www.effectivehealthcare.ahrq.gov/search-for-guides-reviews-and-reports/?pageaction=displayproduct&mp=1&productID=318
Appraisal of Guidelines Research and Evaluation (AGREE)AGREE is an international collaboration of researchers and policy makers who work together to improve the quality and effectiveness of clinical practice guidelines by establishing a shared framework for their development, reporting and assessment.
Centre for Reviews and Dissemination Guide http://www.york.ac.uk/inst/crd/SysRev/!SSL!/WebHelp/SysRev3. htm
Cochrane Handbook for Systematic reviews of Interventions. Updated Version 5.1.0http://handbook.cochrane.org/ Updated: March 2011
Cruse PE and Protzko SP (2014). Librarian Contributions to Clinical Practice Guidelines, Medical Reference Services Quarterly, 33:3, 327-334, DOI: 10.1080/02763869.2014.925710
EulerAPE. Area-proportional Venn diagrams. http://www.eulerdiagrams.org/eulerAPE/
20
Resources Grading of Recommendations Assessment, Development and Evaluation (GRADE)
A systematic approach to grading the strength of management recommendations can minimize bias and aid interpretation of expert-created medical guidelines. The IDSA began to employ the use of the GRADE system in new guidelines and guideline updates initiated after October 2008.
IoM: Finding What Works in Health Care: Standards for Systematic Reviews http://iom.edu/Reports/2011/Finding-What-Works-in-Health-Care-Standards-for-Systematic-Reviews.aspx Released: March 23, 2011
JADA Submissions and Author guidelines http://www.ada.org/en/publications/jada/submissions-and-author-guidelines
Liberati A, Altman DG, Tetzlaff J, et al. (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med 6(7): e1000100. doi:10.1371/journal.pmed1000100
Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med 6(6): e1000097. doi:10.1371/journal.pmed1000097
PRISMA: http://www.prisma-statement.org/statement.htm PICO: McMaster Formulating questions and choosing outcomes
http://cebgrade.mcmaster.ca/QuestionsAndOutcomes/index.html Systematic Reviews and Protocol Registries
http://nihlibrary.campusguides.com/c.php?g=38332&p=244525 21
Questions/Comments
22