The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Use of Recommended Search Strategies in Systematic Reviews and the Impact of Librarian Involvement: A Cross-Sectional Survey of Recent Authors
Open accessAbstract
BACKGROUND: Previous research looking at published systematic reviews has shown that their search strategies are often suboptimal and that librarian involvement, though recommended, is low. Confidence in the results, however, is limited due to poor reporting of search strategies the published articles. OBJECTIVES: To more accurately measure the use of recommended search methods in systematic reviews, the levels of librarian involvement, and whether librarian involvement predicts the use of recommended methods. METHODS: A survey was sent to all authors of English-language systematic reviews indexed in the Database of Abstracts of Reviews of Effects (DARE) from January 2012 through January 2014. The survey asked about their use of search methods recommended by the Institute of Medicine, Cochrane Collaboration, and the Agency for Healthcare Research and Quality and if and how a librarian was involved in the systematic review. Rates of use of recommended methods and librarian involvement were summarized. The impact of librarian involvement on use of recommended methods was examined using a multivariate logistic regression. RESULTS: 1560 authors completed the survey. Use of recommended search methods ranged widely from 98% for use of keywords to 9% for registration in PROSPERO and were generally higher than in previous studies. 51% of studies involved a librarian, but only 64% acknowledge their assistance. Librarian involvement was significantly associated with the use of 65% of recommended search methods after controlling for other potential predictors. Odds ratios ranged from 1.36 (95% CI 1.06 to 1.75) for including multiple languages to 3.07 (95% CI 2.06 to 4.58) for using controlled vocabulary. CONCLUSIONS: Use of recommended search strategies is higher than previously reported, but many methods are still under-utilized. Librarian involvement predicts the use of most methods, but their involvement is under-reported within the published article.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Preliminary research suggests that librarian or information specialist involvement is correlated with reproducibility of searches [16 -18], likely due to their expertise surrounding search development and documentation.”
From PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews (2021) · cites this paper as [16]
The cited source says what the claim attributes to it.
In the citing paper
“Another part of the challenge may be that many systematic reviews do not include librarians or information specialists as members of the systematic review team or as authors on the final manuscript [11, 16 -18].”
From PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews (2021) · cites this paper as [16]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
Why the impact factor of journals should not be used for evaluating research
Seglen, P. O. (1997) · BMJ · doi:10.1136/bmj.314.7079.497 · Cited by 2,447
Finding What Works in Health Care: Standards for Systematic Reviews
Eden, J., Levit, L. A., Berg, A. O., & Morton, S. C. (2013) · Cited by 943
Epidemiology and reporting characteristics of systematic reviews.
Moher, D., Tetzlaff, J., Tricco, A. C., Sampson, M., & Altman, D. G. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040078 · Cited by 891
Panic, N., Leoncini, E., de Belvis, G., Ricciardi, W., & Boccia, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0083138 · Cited by 883
An evidence-based practice guideline for the peer review of electronic search strategies
Sampson, M., McGowan, J., Cogo, E., Grimshaw, J., Moher, D., & Lefebvre, C. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.012 · Cited by 608
Rethlefsen, M. L., Farrell, A. M., Osterhaus Trzasko, L. C., & Brigham, T. J. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.11.025 · Cited by 331
Systematic reviews need systematic searchers.
(2005) · Europe PMC (PubMed Central) · Cited by 257
Moseley, A. M., Elkins, M. R., Herbert, R. D., Maher, C. G., & Sherrington, C. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.09.018 · Cited by 202
Are systematic reviews up-to-date at the time of publication?
Beller, E. M., Chen, J. K.-H., Wang, U. L.-H., & Glasziou, P. P. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-36 · Cited by 196 · cited 1×
“Recommended Search Strategy/ Method [2, 4, 5] Current Study N = 1476 Previous Studies [9–13, 20, 33, 37–50] Unadjusted Odds Ratio N = 1456 Adjusted Odds Ratio N = 1271”
MethodAn optimal search filter for retrieving systematic reviews and meta-analyses
Lee, E. H. M., Dobbins, M., DeCorby, K., McRae, L., Tirilis, D., & Husson, H. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-51 · Cited by 169
Network meta-analyses could be improved by searching more sources and by involving a librarian
Li, L., Tian, J., Tian, H., Moher, D., Liang, F., Jiang, T., Yao, L., & Yang, K. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.04.003 · Cited by 169
Errors in search strategies were identified by type and frequency
Sampson, M., & McGowan, J. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.01.007 · Cited by 142
Analysis of the reporting of search strategies in Cochrane systematic reviews
Yoshii, A., Plaut, D. A., McGraw, K. A., Anderson, M. J., & Wellik, K. E. (2009) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.97.1.004 · Cited by 137 · cited 2×
“In other cases, such as inclusion of a full search strategy, it was difficult to make an accurate comparison since definitions differ widely [14].”
BackgroundSystematic reviews published in higher impact clinical journals were of higher quality
Fleming, P. S., Koletsi, D., Seehra, J., & Pandis, N. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.01.002 · Cited by 118
Tao, K.-M., Li, X.-Q., Zhou, Q.-H., Moher, D., Ling, C.-Q., & Yu, W.-F. (2011) · PLoS ONE · doi:10.1371/journal.pone.0027611 · Cited by 101 · cited 1×
“These include specialized knowledge in or training on systematic review methods [31, 32], publishing in a higher impact journal [32, 33], previous experience writing systematic reviews [34], use of a reporting guidelines [35, 36], years of professional practice, time taken to write the review, year of publication and…”
BackgroundPoor reporting and inadequate searches were apparent in systematic reviews of adverse effects
Golder, S., Loke, Y. K., & McIntosh, H. M. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.06.005 · Cited by 97
Systematic reviews of diagnostic tests in cancer: review of methods and reporting
Mallett, S., Deeks, J. J., Halligan, S., Hopewell, S., Cornelius, V., & Altman, D. G. (2006) · BMJ · doi:10.1136/bmj.38895.467130.55 · Cited by 94
Systematic Reviews and Librarians
McKibbon, A. (2006) · Library trends · doi:10.1353/lib.2006.0049 · Cited by 84
Engaging Medical Librarians to Improve the Quality of Review Articles
Rethlefsen, M. L., Murad, M. H., & Livingston, E. H. (2014) · JAMA · doi:10.1001/jama.2014.9263 · Cited by 78
Quality of systematic reviews in pediatric oncology – A systematic review
Lundh, A., Knijnenburg, S. L., Jørgensen, A. W., van Dalen, E. C., & Kremer, L. C. M. (2009) · Cancer Treatment Reviews · doi:10.1016/j.ctrv.2009.08.010 · Cited by 78
Reproducibility of Literature Search Reporting in Medical Education Reviews
Maggio, L. A., Tannery, N. H., & Kanter, S. L. (2011) · Academic Medicine · doi:10.1097/acm.0b013e31822221e7 · Cited by 77
Comparison of search strategies in systematic reviews of adverse effects to other systematic reviews
Golder, S., Loke, Y. K., & Zorzela, L. (2014) · Health Information & Libraries Journal · doi:10.1111/hir.12041 · Cited by 67
Methodology and reporting of meta-analyses in the neurosurgical literature: A review
Klimo, P., Thompson, C. J., Ragel, B. T., & Boop, F. A. (2014) · Journal of neurosurgery · doi:10.3171/2013.11.jns13195 · Cited by 65
No consensus exists on search reporting methods for systematic reviews
Sampson, M., McGowan, J., Tetzlaff, J., Cogo, E., & Moher, D. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.10.009 · Cited by 63 · cited 3×
“Systematic reviews published by the Cochrane Collaboration were excluded from this study since they are required to follow the guidelines of the Cochrane Collaboration [2], which include recommending the use of a Trial Search Coordinator or similar expert, and have been shown to have different quality and reporting of…”
BackgroundMethodCornelius, V. R., Perrio, M. J., Shakir, S., & Smith, L. A. (2009) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1844 · Cited by 61
Search strategies in systematic reviews in periodontology and implant dentistry
Faggion, C. M., Atieh, M. A., & Park, S. (2013) · Journal Of Clinical Periodontology · doi:10.1111/jcpe.12132 · Cited by 60
Papageorgiou, S. N., Papadopoulos, M. A. A. P., & Athanasiou, A. E. (2013) · European Journal of Orthodontics · doi:10.1093/ejo/cjt008 · Cited by 53
Lawson, M. L., Pham, B., Klassen, T. P., & Moher, D. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.08.022 · Cited by 40
An evaluation of search and selection methods used in dental systematic reviews published in English
Major, M. P., Major, P. W., & Flores‐Mir, C. (2006) · The Journal of the American Dental Association · doi:10.14219/jada.archive.2006.0382 · Cited by 38
Benchmarking of reported search and selection methods of systematic reviews by dental speciality
Major, M. P., Major, P. W., & Flores‐Mir, C. (2007) · Evidence-Based Dentistry · doi:10.1038/sj.ebd.6400504 · Cited by 35
Survey of the Reporting Characteristics of Systematic Reviews in Rehabilitation
Gianola, S., Gasparini, M., Agostini, M., Castellini, G., Corbetta, D., Gozzer, P., LI, L. C., Sirtori, V., Taricco, M., Tetzlaff, J., et al. (2013) · Physical Therapy · doi:10.2522/ptj.20120382 · Cited by 35
Search and selection methodology of systematic reviews in orthodontics (2000-2004)
Flores‐Mir, C., Major, M. P., & Major, P. W. (2006) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2006.02.028 · Cited by 34
Golder, S., Loke, Y. K., & Zorzela, L. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.09.013 · Cited by 34
Comprehensive computer searches and reporting in systematic reviews
Fehrmann, P. G., & Thomas, J. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.31 · Cited by 30
Turner, L., Galipeau, J., Garritty, C., Manheimer, E. W., Wieland, L. S., Yazdi, F., & Moher, D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0053536 · Cited by 29
Ge, L., Wang, J., Li, J., Li, L., An, N., Shi, X., Liu, Y., & Tian, J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0085908 · Cited by 28
Reporting of the Role of the Expert Searcher in Cochrane Reviews
Zhang, L., Sampson, M., & McGowan, J. (2006) · Evidence Based Library and Information Practice · doi:10.18438/b85k52 · Cited by 26
Weller, A. C. (2004) · Europe PMC (PubMed Central) · Cited by 18
Methodological quality and descriptive characteristics of prosthodontic‐related systematic reviews
Aziz, T., Compton, S. M., Nassar, U., Matthews, D., Ansari, K., & Flores‐Mir, C. (2013) · Journal of Oral Rehabilitation · doi:10.1111/joor.12028 · Cited by 17
The role of medical librarians in medical education review articles
Tannery, N. H., & Maggio, L. A. (2012) · Journal of the Medical Library Association JMLA · doi:10.3163/1536-5050.100.2.015 · Cited by 12
Survey of systematic review authors in dentistry: challenges in methodology and reporting.
Major, M. P., Warren, S., & Flores-Mir, C. (2009) · Journal of Dental Education · doi:10.1002/j.0022-0337.2009.73.4.tb04718.x · Cited by 9
Finding Evidence for Comparing Medical Interventions
Relevo, R., & Balshem, H. (2011) · Europe PMC (PubMed Central) · Cited by 9
Research works printed but not linked: 1
- About Cochrane Reviews [website]. London, UK: The Cochrane Collaboration; 2015. Available: http://www.cochranelibrary.com/about/about-cochrane-systematic-reviews.html. Accessed 1 April 2015.
Cited by
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., & Koffel, J. (2019) · doi:10.31219/osf.io/sfc38 · Cited by 3,696
Self-citationRethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., Koffel, J. B., PRISMA-S Group, Blunt, H., Brigham, T., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-020-01542-z · Cited by 3,714
Self-citationGusenbauer, M., & Haddaway, N. R. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1378 · Cited by 2,379
“Accordingly, collaboration with librarians, as information experts in these complex literature search processes, has been shown to benefit study quality.(9,11,12) In evidence syntheses, online databases should “form the backbone of any comprehensive literature search.”
BackgroundPreferred Reporting Items for Systematic Reviews and Meta-Analyses
Vrabel, M. (2015) · Oncology Nursing Forum · doi:10.1188/15.onf.552-554 · Cited by 669
Cooper, C., Booth, A., Varley-Campbell, J., Britten, N., & Garside, R. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0545-3 · Cited by 561
Metadata
- Authors
- Koffel, J. B.
- Affiliations
- University of Minnesota (US)
- Corresponding author
- Koffel, Jonathan B.
- ORCID
- Koffel, Jonathan B.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-05-04
- Volume
- 10
- Issue
- 5
- Pages
- e0125931
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4418838
- OpenAlex
- W2130019206
- Cited by
- 159
- References
- 48
- Citations by year
- 2026: 11 · 2025: 7 · 2024: 26 · 2023: 16 · 2022: 14 · 2021: 22 · 2020: 25 · 2019: 15 · 2018: 9 · 2017: 7 · 2016: 5 · 2015: 2
- FWCI
- 1.26
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Minnesota Digital Conservancy (University of Minnesota) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- systematic reviews, literature search strategies, librarian involvement, search strategy reporting, PROSPERO registration, controlled vocabulary, multilingual information retrieval, Institute of Medicine guidelines
- MeSH terms
- Cross-Sectional Studies, Humans, Surveys and Questionnaires, Databases, Factual, Librarians, Information Storage and Retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
