CoChat

Comprehensive computer searches and reporting in systematic reviews: Computer searches and reporting in reviews

Fehrmann, Paul, Thomas, Joelle · 2011 · Research Synthesis Methods
Cited by 27

The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.

Abstract

Systematic reviews (SR) are a strategic resource for many who may assume that comprehensive computer searches are used to identify the studies that are used in SR. The current study assessed the reports of comprehensive computer searching in SR in psychology. Comprehensive computer search methods listed as basic in SR manuals and publications of major SR organizations (e.g., Cochrane Collaboration) were the "recommended methods" that became items on a checklist used to assess computer search reports. A methodology index search in PsycINFO identified SR in psychology that were compared to SR identified in the Cochrane Database of SR. Checklist item frequencies supported descriptive analyses, and Mann-Whitney U-test was used to compare the PsycINFO and Cochrane SR. Two recommended computer search methods were significantly more common in Cochrane SR: truncation (z = -5.64, p < .001), controlled vocabulary (z = -5.08, p < .001 ). A third search method (Cited Reference Searching) was virtually absent (SR in psychology: 0/25; and Cochrane SR: 1/25). Confidence in SR conclusions may be undermined when evidence of recommended or empirically-based search methods is not seen. Results and suggestions might have value for those who use, evaluate, or develop guidelines for SR; research topics are also described. Copyright © 2011 John Wiley & Sons, Ltd.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/jrsm.31

Cites

20 of 20 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 33

  1. Balas, 1997, In search of controlled evidence for health care quality improvement, J Med Syst, 21, 21, 10.1023/A:1022887224126 · DOI
  2. Booth, 2006, “Brimful of STARLITE”: toward standards for reporting literature searches, J Med Libr Assoc, 94, 421
  3. Centre for Reviews and Dissemination, 2009, Systematic reviews: CRD's Guidance for Undertaking Reviews in Health Care
  4. Cooper, 1994, The Handbook of Research Synthesis
  5. Cooper, 2009, The Handbook of Research Synthesis and Meta-Analysis
  6. Dieckmann, 2009, An empirical assessment of meta-analytic practice, Rev Gen Psychol, 13, 101, 10.1037/a0015107 · DOI · Paper page
  7. Eady, 2008, PsycINFO search strategies identified methodologically sound therapy studies and review articles for use by clinicians and researchers, J Clin Epidemiol, 61, 34, 10.1016/j.jclinepi.2006.09.016 · DOI
  8. EPPI-Centre, 2007, EPPI-Centre Methods For Conducting Systematic Reviews
  9. Farbey, 1997, Searching the literature: be creative with Medline, BMJ, 307, 66, 10.1136/bmj.307.6895.66 · doi:10.1136/bmj.307.6895.66
  10. Grant, 2009, A typology of reviews: an analysis of 14 review types and associated methodologies, Health Info Libr J, 26, 91, 10.1111/j.1471-1842.2009.00848.x · DOI · Paper page
  11. Green, 2009, Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.2
  12. Jenuwine, 2004, Comparison of medical subject headings and text-word searches in MEDLINE to retrieve studies on sleep in healthy individuals, J Med Libr Assoc, 92, 349
  13. Lefebvre, 2009, Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.2
  14. Liberati, 2009, The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration, PLoS Med, 6, e1000100, 10.1371/journal.pmed.1000100 · DOI · Paper page
  15. Lipsey, 2001, Practical Meta-Analysis
  16. Littell JH Higgins JPT 2009 The HuGENet™ HuGE Review Handbook, version 1.0 http://www.hugenet.org.uk/resources/handbook.php
  17. Littell, 2008, Systematic Reviews and Meta-Analysis, 10.1093/acprof:oso/9780195326543.001.0001 · DOI · Paper page
  18. Moher, 2001, The CONSORT statement: revised recommendations for improving the quality of reports of parallel group randomized trials, BMC Med Res Methodol, 1, 2, 10.1186/1471-2288-1-2 · DOI · Paper page
  19. Moher, 2007, Epidemiology and reporting characteristics of systematic reviews, PLoS Med, 4, e78, 10.1371/journal.pmed.0040078 · DOI · Paper page
  20. Ogilvie, 2005, Systematic reviews of health effects of social interventions: 1. Finding the evidence: how far should you go?, J Epidemiol Community Health, 59, 804, 10.1136/jech.2005.034181 · DOI · Paper page
  21. Petticrew, 2006, Systematic Reviews in the Social Sciences: A Practical Guide, 10.1002/9780470754887 · DOI · Paper page
  22. Portney, 1993, Foundations of Clinical Research: Applications to Practice
  23. Reed, 2003, Library Use: A Handbook for Psychology
  24. Sampson M McGowan J Lefebvre C Moher D Grimshaw J 2008 PRESS: Peer Review of Electronic Search Strategies Canadian Agency for Drugs and Technologies in Health Ottawa 1 41 http://www.cadth.ca/index.php/en/publication/781
  25. Sandelowski, 2007, Handbook for Synthesizing Qualitative Research
  26. Stroup, 2000, Meta-analysis of observational studies in epidemiology: a proposal for reporting, JAMA, 283, 2008, 10.1001/jama.283.15.2008 · DOI · Paper page
  27. Torgerson, 2003, Systematic Reviews
  28. Tricco, 2009, Non-Cochrane vs. Cochrane reviews were twice as likely to have positive conclusion statements: cross-sectional study, J Clin Epidemiol, 62, 380, 10.1016/j.jclinepi.2008.08.008 · DOI
  29. Valentine, 2010, A method for evaluating research syntheses: the quality, conclusions, and consensus of 12 syntheses of the effects of after-school programs, Res Synth Meth, 1, 20, 10.1002/jrsm.3 · DOI · Paper page
  30. Watson, 1999, Identifying randomized controlled trials of cognitive therapy for depression: comparing the efficiency of Embase, Medline and PsycINFO bibliographic databases, Br J Med Psychol, 72, 535, 10.1348/000711299160220 · DOI · Paper page
  31. Whiting, 2003, The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews, BMC Med Res Methodol, 3, 25, 10.1186/1471-2288-3-25 · DOI · Paper page
  32. Wilczynski, 2004, Developing optimal search strategies for detecting clinically sound prognostic studies in MEDLINE: an analytic survey, BMC Med, 2, 23, 10.1186/1741-7015-2-23 · DOI · Paper page
  33. Wilczynski, 2007, EMBASE search strategies achieved high sensitivity and specificity for retrieving methodologically sound systematic reviews, J Clin Epidemiol, 60, 29, 10.1016/j.jclinepi.2006.04.001 · DOI

Cited by

See all 27

Metadata

Authors
Fehrmann, P., & Thomas, J.
Venue
Research Synthesis Methods
Publisher
Wiley
Published
2011-03
Volume
2
Issue
1
Pages
15-32
ISSN
1759-2879 (ISSN-L)
OpenAlex
W1783530167
Cited by
27
References
20
FWCI
0.67
Type
journal article
Language
en
Open access
closed
Licence
doi.wiley.com/10.1002/tdm_license_1.1 (tdm, 1645 d)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.