The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Use of Recommended Search Strategies in Systematic Reviews and the Impact of Librarian Involvement: A Cross-Sectional Survey of Recent Authors
Open accessAbstract
BACKGROUND: Previous research looking at published systematic reviews has shown that their search strategies are often suboptimal and that librarian involvement, though recommended, is low. Confidence in the results, however, is limited due to poor reporting of search strategies the published articles. OBJECTIVES: To more accurately measure the use of recommended search methods in systematic reviews, the levels of librarian involvement, and whether librarian involvement predicts the use of recommended methods. METHODS: A survey was sent to all authors of English-language systematic reviews indexed in the Database of Abstracts of Reviews of Effects (DARE) from January 2012 through January 2014. The survey asked about their use of search methods recommended by the Institute of Medicine, Cochrane Collaboration, and the Agency for Healthcare Research and Quality and if and how a librarian was involved in the systematic review. Rates of use of recommended methods and librarian involvement were summarized. The impact of librarian involvement on use of recommended methods was examined using a multivariate logistic regression. RESULTS: 1560 authors completed the survey. Use of recommended search methods ranged widely from 98% for use of keywords to 9% for registration in PROSPERO and were generally higher than in previous studies. 51% of studies involved a librarian, but only 64% acknowledge their assistance. Librarian involvement was significantly associated with the use of 65% of recommended search methods after controlling for other potential predictors. Odds ratios ranged from 1.36 (95% CI 1.06 to 1.75) for including multiple languages to 3.07 (95% CI 2.06 to 4.58) for using controlled vocabulary. CONCLUSIONS: Use of recommended search strategies is higher than previously reported, but many methods are still under-utilized. Librarian involvement predicts the use of most methods, but their involvement is under-reported within the published article.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Preliminary research suggests that librarian or information specialist involvement is correlated with reproducibility of searches [16 -18], likely due to their expertise surrounding search development and documentation.”
From PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews (2021) · cites this paper as [16]
The cited source says what the claim attributes to it.
In the citing paper
“Another part of the challenge may be that many systematic reviews do not include librarians or information specialists as members of the systematic review team or as authors on the final manuscript [11, 16 -18].”
From PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews (2021) · cites this paper as [16]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
Why the impact factor of journals should not be used for evaluating research
Seglen, P. O. (1997) · BMJ · doi:10.1136/bmj.314.7079.497 · Cited by 2,447
Finding What Works in Health Care: Standards for Systematic Reviews
Eden, J., Levit, L. A., Berg, A. O., & Morton, S. C. (2013) · Cited by 943
Epidemiology and reporting characteristics of systematic reviews.
Moher, D., Tetzlaff, J., Tricco, A. C., Sampson, M., & Altman, D. G. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040078 · Cited by 891
Panic, N., Leoncini, E., de Belvis, G., Ricciardi, W., & Boccia, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0083138 · Cited by 883
Research works printed but not linked: 1
- About Cochrane Reviews [website]. London, UK: The Cochrane Collaboration; 2015. Available: http://www.cochranelibrary.com/about/about-cochrane-systematic-reviews.html. Accessed 1 April 2015.
Cited by
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., & Koffel, J. (2019) · doi:10.31219/osf.io/sfc38 · Cited by 3,696
Self-citationRethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., Koffel, J. B., PRISMA-S Group, Blunt, H., Brigham, T., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-020-01542-z · Cited by 3,714
Self-citationGusenbauer, M., & Haddaway, N. R. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1378 · Cited by 2,379
“Accordingly, collaboration with librarians, as information experts in these complex literature search processes, has been shown to benefit study quality.(9,11,12) In evidence syntheses, online databases should “form the backbone of any comprehensive literature search.”
BackgroundPreferred Reporting Items for Systematic Reviews and Meta-Analyses
Vrabel, M. (2015) · Oncology Nursing Forum · doi:10.1188/15.onf.552-554 · Cited by 669
Cooper, C., Booth, A., Varley-Campbell, J., Britten, N., & Garside, R. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0545-3 · Cited by 561
Meeting the review family: exploring review types and associated information retrieval requirements
Sutton, A., Clowes, M., Preston, L., & Booth, A. (2019) · Health Information & Libraries Journal · doi:10.1111/hir.12276 · Cited by 570
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., Koffel, J. B., & Group, P.-S. (2021) · Journal of the Medical Library Association · doi:10.5195/jmla.2021.962 · Cited by 409
Self-citationHarari, M. B., Parola, H. R., Hartwell, C. J., & Riegelman, A. (2020) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2020.103377 · Cited by 291
Errors in search strategies used in systematic reviews and their effects on information retrieval
Salvador-Oliván, J. A., Marco-Cuenca, G., & Arquero-Avilés, R. (2019) · Journal of the Medical Library Association · doi:10.5195/jmla.2019.567 · Cited by 199
“To improve search quality, the following approaches have been proposed: (a) the participation of librarians and information professionals in teams who, as search experts, develop strategic reviews [1, 16–19], an approach that has been associated with higher quality search strategies [20, 21] and fewer errors [22], and…”
MethodInfluentialShades of grey: Two forms of grey literature important for reviews in conservation
Haddaway, N. R., & Bayliss, H. R. (2015) · Biological Conservation · doi:10.1016/j.biocon.2015.08.018 · Cited by 180
Koffel, J. B., & Rethlefsen, M. L. (2016) · PLOS ONE · doi:10.1371/journal.pone.0163309 · Cited by 107
Self-citationMisaki, E., Apiola, M., Gaiani, S., & Tedre, M. (2018) · The Electronic Journal of Information Systems in Developing Countries · doi:10.1002/isd2.12034 · Cited by 102
“The foundation of SLRs is a comprehensive and systematic search that identifies entirely eligible studies on the topic and uses specialized search tools and methods (Koffel, 2015).”
BackgroundCharacteristics of systematic reviews in the social sciences
Chapman, K. (2021) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2021.102396 · Cited by 93
Defining the external implementation context: an integrative systematic literature review
Watson, D. P., Adams, E. L., Shue, S. A., Coates, H., McGuire, A. B., Chesher, J., Jackson, J. R., & Omenka, O. I. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3046-5 · Cited by 123
It takes longer than you think: librarian time spent on systematic review tasks
Bullers, K., Howard, A. M., Hanson, A., Kearns, W. D., Orriola, J. J., Polo, R. L., & Sakmar, K. A. (2018) · Journal of the Medical Library Association · doi:10.5195/jmla.2018.323 · Cited by 88
“Librarians play a number of ancillary roles, such as peerreviewing searches, writing or editing other portions of the manuscript, conducting statistical analyses, or acting as a consultant to the study team [5]; however, these activities are less common.”
Benton, M., Salter, A., Tape, N., Wilkinson, C., & Turnbull, D. (2019) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-019-2687-7 · Cited by 91
Systematic reviews: Structure, form and content
Phillips, V., & Barker, E. (2021) · Journal of Perioperative Practice · doi:10.1177/1750458921994693 · Cited by 91
“A number of recent studies have indicated that librarian involvement improves the reproducibility of the literature searching (Hameed et al 2020, Koffel 2015, Rethlefsen et al 2015).”
BackgroundEvaluation of a new method for librarian‐mediated literature searches for systematic reviews
Bramer, W. M., Rethlefsen, M. L., Mast, F., & Kleijnen, J. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1279 · Cited by 71
“Other studies examining librarian or information specialist involvement in systematic reviews have had difficulty identifying these contributors due to ambiguous names or reporting conventions.(7,9)”
BackgroundDigital authoritarianism: a systematic literature review
Roberts, T., & Oosterom, M. (2025) · Information Technology for Development · doi:10.1080/02681102.2024.2425352 · Cited by 74
“We used the systematic literature review to impose a structure on a body of literature in order to guide a comprehensive and systematic search relevant to de fi ned research questions (Ko ff el, 2015).”
The effect of librarian involvement on the quality of systematic reviews in dental medicine
Schellinger, J., Sewell, K. B., Bloss, J., Ebron, T., & Forbes, C. (2021) · PLoS ONE · doi:10.1371/journal.pone.0256833 · Cited by 71
“First, the rate of librarian assistance may be higher than reported in articles, and therefore, data may be skewed [23].”
BackgroundMental health and wellbeing of undergraduate students in engineering: A systematic literature review
Asghar, M., Minichiello, A., & Ahmed, S. (2023) · Journal of Engineering Education · doi:10.1002/jee.20574 · Cited by 74
“The methodological literature indicates that this limitation can be mitigated by consulting a librarian to help develop robust search strategies (Koffel, 2015).”
Database selection in systematic reviews: an insight through clinical neurology
Vassar, M. B., Yerokhin, V., Sinnett, P., Weiher, M., Muckelrath, H. D., Carr, B., Varney, L., & Cook, G. (2017) · Health Information & Libraries Journal · doi:10.1111/hir.12176 · Cited by 78
Yang, Z., Hotterbeex, P., Marent, P.-J., Cerin, E., Thomis, M. A., & van Uffelen, J. G. Z. (2024) · Ageing Research Reviews · doi:10.1016/j.arr.2024.102283 · Cited by 70
Rethlefsen, M. L., Brigham, T., Price, C. L., Moher, D., Bouter, L. M., Kirkham, J. J., Schroter, S., & Zeegers, M. P. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.111229 · Cited by 77
Frandsen, T. F., Eriksen, M. B., Hammer, D. M. G., & Christensen, J. B. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.04.015 · Cited by 44
“Involvement of an information specialist or librarian in the search process seems to play a role for the quality of searches (4, 5).”
BackgroundBates, J. A., Best, P., McQuilkin, J., & Taylor, B. J. (2016) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2016.11.003 · Cited by 57
McKeown, S., & Ross‐White, A. (2019) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2019.443 · Cited by 54
Fisher behaviour in coastal and marine fisheries
Andrews, E. J., Pittman, J. B., & Armitage, D. R. (2020) · Fish and Fisheries · doi:10.1111/faf.12529 · Cited by 40
Librarians as methodological peer reviewers for systematic reviews: results of an online survey
Nardini, H. K. G., Batten, J., Funaro, M. C., García-Milian, R., Nyhan, K., Spak, J. M., Wang, L., & Glover, J. G. (2019) · Research Integrity and Peer Review · doi:10.1186/s41073-019-0083-5 · Cited by 41
Assessment of Language and Indexing Biases Among Chinese-Sponsored Randomized Clinical Trials
Jia, Y., Huang, D., Wen, J., Wang, Y., Rosman, L. M., Chen, Q., Robinson, K. A., Gagnier, J. J., Ehrhardt, S., & Celentano, D. D. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.5894 · Cited by 36
Nunn, J., & Chang, S. (2020) · WikiJournal of Medicine · doi:10.15347/wjm/2020.005 · Cited by 64
Collaboration challenges in systematic reviews: a survey of health sciences librarians
Nicholson, J., McCrillis, A. M., & Williams, J. D. (2017) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2017.176 · Cited by 46
“There is a robust body of literature examining librarian involvement in the systematic review process, including articles focusing on emerging roles of librarians [11–13] and how librarian involvement improves review quality [14–17], improves search accuracy [14, 16, 18, 19], and increases retrieval of grey literature…”
BackgroundWHICH DATABASES SHOULD BE USED TO IDENTIFY STUDIES FOR SYSTEMATIC REVIEWS OF ECONOMIC EVALUATIONS?
Arber, M. R., Glanville, J., Isojärvi, J., Baragula, E., Edwards, M., Shaw, A., & Wood, H. (2018) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462318000636 · Cited by 34
Scoping review search practices in the social sciences: A scoping review
Logan, J. R., Webb, J., Singh, N. K., Tanner, N., Barrett, K., Wall, M., Walsh, B., & Ayala, A. P. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1742 · Cited by 35
“While LIS professionals' participation in systematic reviews has been well studied (Koffel, 2015), 7,8,29,30 scoping reviews have received less attention.”
InfluentialOptimising the process for conducting scoping reviews
Pawliuk, C., Brown, H. L., Widger, K., Dewan, T., Hermansen, A., Grégoire, M.-C., Steele, R., & Siden, H. B. (2020) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2020-111452 · Cited by 34
“[8-10] The librarian should work closely with other team members to create the search strategy.”
Bakker, C., Boughton, S., Faggion, C. M., Fanelli, D., Kaiser, K., & Schneider, J. (2024) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2022-111921 · Cited by 28
“22 23 26 The citation of retracted publications is not always problematic, as authors may be making note of publications, they have chosen not to include or may be discussing issues around retraction.”
BackgroundPawliuk, C., Cheng, S. S. Y., Zheng, A., & Siden, H. B. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.111237 · Cited by 39
Riley, S. P., Swanson, B. T., Sawyer, S. F., Brismée, J., & Staysniak, G. (2020) · Journal of Manual & Manipulative Therapy · doi:10.1080/10669817.2020.1839728 · Cited by 28
Justesen, T. F., Freyberg, J., & Schultz, A. N. Ø. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01281-2 · Cited by 41
“These results contradicts a prior quantitative study that reported 51% of SRs used a librarian, though only 64% of these SRs actually reported this use [5].”
BackgroundResultAn assessment of the quality of current clinical meta-analyses
Hameed, I., Demetres, M. R., Tam, D. Y., Rahouma, M., Khan, F., Wright, D., Mages, K. C., DeRosa, A. P., Nelson, B. B., Pain, K. J., et al. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-00999-9 · Cited by 26
A Tailored Approach: A model for literature searching in complex systematic reviews
Cooper, C., Booth, A., Husk, K., Lovell, R., Frost, J., Schauberger, U., Britten, N., & Garside, R. (2022) · Journal of Information Science · doi:10.1177/01655515221114452 · Cited by 26
Giang, H. T. N., Ahmed, A. M., Fala, R. Y., Khattab, M. M., Othman, M., Abdelrahman, S. A. M., Le, T. P., Gabl, A. E. A. E., Elrashedy, S. A., Lee, P. N., et al. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0780-2 · Cited by 24
Riegelman, A., & Kocher, M. (2018) · Reference & User Services Quarterly · doi:10.5860/rusq.58.1.6837 · Cited by 26
The Help-Seeking Behavior of Victims of Image-Based Sexual Harassment and Abuse: A Scoping Review
Pijlman, V., de Waardt, M., Schoonmade, L. J., Eichelsheim, V. I., & Pemberton, A. (2024) · Trauma Violence & Abuse · doi:10.1177/15248380241289435 · Cited by 30
“…the review comprise the inclusion of an information specialist, which is known to improve the quality and reproducibility of the search and review (Koffel, 2015), the use of an open-access screening program (Rayyan), which allows for further transparency and replicability, and the inclusion of…”
Ramírez, D., Foster, M., Kogut, A., & Xiao, D. Y. (2022) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2022.102567 · Cited by 26
Replicable Services for Reproducible Research: A Model for Academic Libraries
Sayre, F., & Riegelman, A. (2019) · College & Research Libraries · doi:10.5860/crl.80.2.260 · Cited by 25
Martínez-López, J. I., Barrón-González, S., & López, A. M. (2019) · Publications · doi:10.3390/publications7030059 · Cited by 30
Borrego, A., & Pinfield, S. (2020) · portal Libraries and the Academy · doi:10.1353/pla.2020.0031 · Cited by 20
Demetres, M. R., Wright, D., & DeRosa, A. P. (2020) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2020.665 · Cited by 19
Interdisciplinary Collaboration: Librarian Involvement in Grant Projects
Brandenburg, M. D., Cordell, S. A., Joque, J., MacEachern, M., & Song, J. Y. (2017) · College & Research Libraries · doi:10.5860/crl.78.3.272 · Cited by 19
Xu, L., Fields, N. L., Highfill, C., & Troutman, B. A. (2023) · Behavioral Sciences · doi:10.3390/bs13120998 · Cited by 19
“Our search strategy (see Table 2) was designed by an expert in library science, which is consistent with best practices for systematic literature searches [35,36].”
MethodGhezzi‐Kopel, K., Ault, J., Chimwaza, G., Diekmann, F., Eldermire, E., Gathoni, N., Kelly, J. A., Kinengyere, A. A., Kocher, M., Lwoga, E. T., et al. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1528 · Cited by 17
“Guidelines across disciplines for evidence synthesis preparation recommend collaboration with a librarian to improve the quality of information retrieval and organization of primary studies.(23,24) The librarian team led information retrieval practices for Ceres2030 with a focus on searching agriculture-focused grey l…”
BackgroundSteen, S., Melfie, J., Carro, A., & Shi, Q. (2022) · Professional School Counseling · doi:10.1177/2156759x221086739 · Cited by 17
“We reviewed the 42 studies to determine whether they met inclusion criteria, which were clearly defined and reviewed per the systematic review process (Koffel, 2015).”
MethodRios, J. A., Ihlenfeldt, S. D., Dosedel, M., & Riegelman, A. (2019) · Educational Measurement Issues and Practice · doi:10.1111/emip.12282 · Cited by 21
Assessment of Duplicate Publication of Chinese-Sponsored Randomized Clinical Trials
Jia, Y., Huang, D., Wen, J., Qureshı, R., Wang, Y., Rosman, L. M., Chen, Q., Robinson, K. A., Gagnier, J. J., Ehrhardt, S., et al. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.27104 · Cited by 16
A Step-by-Step Approach to Systematic Reviews in Educational Research
Ghamrawi, N., Shal, T., Ghamrawi, N. A. R., Abu-Tineh, A. M. H., Alshaboul, Y. M. K., & Alazaizeh, M. (2025) · European Journal of Educational Research · doi:10.12973/eu-jer.14.2.549 · Cited by 87
Why do researchers co‐author evidence syntheses with librarians? A mixed‐methods study
Logan, J. R. (2023) · Research Synthesis Methods · doi:10.1002/jrsm.1629 · Cited by 19
O’Connor, G., Reis, K., Desha, C., & Burkett, I. (2024) · Agriculture and Human Values · doi:10.1007/s10460-024-10601-3 · Cited by 25
“Whilst investigating values, motivations , and concerns, the authors chose to omit these terms from the search strategy to allow for search results that were not biased towards the research questions (Harari et al. 2020; Koffel 2015; Liberati et al. 2009).”
Brunskill, A., & Hanneke, R. (2023) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2022.1505 · Cited by 17
“In another study, some systematic review authors themselves stated that a librarian not referenced in the final publication had made a sizable contribution to the work [9].”
BackgroundResultInfluentialOliván, J. A. S., Cuenca, G. M., & Avilés, R. A. (2018) · Revista española de Documentación Científica · doi:10.3989/redc.2018.2.1491 · Cited by 20
“ISSN-L: 0210-0614. https://doi.org/10.3989/redc.2018.2.1491 tan información más completa y reproducible de las búsquedas (Rethlefsen y otros, 2015; Koffel, 2015; Meert y otros, 2016), consultan un mayor número de bases de datos (Golder y otros, 2008) y, por consiguiente, presentan un menor riesgo…”
BackgroundInfluentialCooper, C., Garside, R., Varley‐Campbell, J., Talens‐Bou, J., Booth, A., & Britten, N. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1426 · Cited by 17
Neilson, C. J. (2021) · Health Information & Libraries Journal · doi:10.1111/hir.12367 · Cited by 16
Building the Systematic Review Core in an academic health sciences library
Lackey, M. J., Greenberg, H., & Rethlefsen, M. L. (2019) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2019.711 · Cited by 18
Frati, F., Oja, L. A., & Kleinberg, J. (2021) · Journal of the Canadian Health Libraries Association / Journal de l Association de bilbiothèques de la santé du Canada · doi:10.29173/jchla29526 · Cited by 16
“Services provided by health information professionals can also help improve research productivity and quality — in particular knowledge synthesis [27-31], and reduce waste [32-35].”
BackgroundQuality of Literature Searches Published in Leading Neurosurgical Journals: A Review of Reviews
O’Donohoe, T. J., Bridson, T. L., Shafik, C. G., Wynne, D., Dhillon, R., & Tee, J. (2020) · Neurosurgery · doi:10.1093/neuros/nyaa573 · Cited by 15
Lee, M. S., Hughes, A., Lockmiller, C., Day, A., Brown, M., & Jenson, R. J. (2022) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2022.102626 · Cited by 15
Rethlefsen, M. L., Schroter, S., Bouter, L. M., Moher, D., Ayala, A. P., Kirkham, J. J., & Zeegers, M. P. (2021) · Trials · doi:10.1186/s13063-021-05738-z · Cited by 17
Lê, M., Neilson, C. J., & Winkler, J. (2024) · College & Research Libraries · doi:10.5860/crl.85.4.606 · Cited by 17
Research Support in Health Sciences Libraries: A Scoping Review
Visintini, S. M., Boutet, M., Helwig, M., & Manley, A. (2018) · Journal of the Canadian Health Libraries Association / Journal de l Association de bilbiothèques de la santé du Canada · doi:10.29173/jchla29366 · Cited by 18
Bodnaruc, A. M., Khan, H., Shaver, N., Bennett, A., Wong, Y. L., Gracey, C., Ly, V., Shea, B., Little, J., Brouwers, M. C., et al. (2024) · American Journal of Clinical Nutrition · doi:10.1016/j.ajcnut.2024.10.013 · Cited by 16
Nature and Challenges of Transnational Family Caregiving: A Scoping Review
Hossain, M. S., Pope, N. D., Benner, K., & Choi, Y. J. (2025) · Journal of Evidence-Based Social Work · doi:10.1080/26408066.2025.2456751 · Cited by 11
Search Strategies for [Systematic] Literature Reviews
Dekkers, R., Carey, L., & Langhorne, P. (2022) · Springer eBooks · doi:10.1007/978-3-030-90025-0_5 · Cited by 18
A decade of systematic reviews: an assessment of Weill Cornell Medicine's systematic review service
Demetres, M. R., Wright, D., Hickner, A., Jedlicka, C. M., & Delgado, D. (2023) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2023.1628 · Cited by 18
A Microsoft Excel Approach to Reduce Errors and Increase Efficiency in Systematic Searching
Brunskill, A. (2020) · Medical Reference Services Quarterly · doi:10.1080/02763869.2020.1704598 · Cited by 12
Who's Publishing Systematic Reviews? An Examination Beyond the Health Sciences
Slebodnik, M., Pardon, K., & Hermer, J. (2022) · Issues in Science and Technology Librarianship · doi:10.29173/istl2671 · Cited by 12
“Reports of librarian involvement in health sciences SRs range from 6% (Li et al., 2014) to 51% (Koffel, 2015).”
BackgroundA Systematic Literature Review on Energy Efficiency Analysis of Building Energy Management
Fang, M., Misnan, M. S., & Halim, N. H. F. A. (2024) · Buildings · doi:10.3390/buildings14103136 · Cited by 17
“Firstly, it is necessary to develop appropriate search strategies, determine the scope of the literature review, identify specific keywords, and choose appropriate database sources in order to find the most suitable studies [31].”
Pretto, G., & Curró, G. (2016) · New Review of Academic Librarianship · doi:10.1080/13614533.2016.1227861 · Cited by 12
“…to the trajectory of training/development for librarians, there is evidence of increasing demand for librarians to be involved in supporting doctoral students who are searching a range of literature review genres (Boell & Cecez-Kecmanovic, 2010; Koffel, 2015; McKibbon, 2006; Murphy & Boden, 2015).”
BackgroundEybye, M. N., Madsen, S. D., Schultz, A. N. Ø., & Nim, C. G. (2022) · Chiropractic & Manual Therapies · doi:10.1186/s12998-022-00468-8 · Cited by 12
Riley, S. P., Swanson, B. T., Shaffer, S. M., Somma, M. J., Flowers, D. W., & Sawyer, S. F. (2022) · Journal of Manual & Manipulative Therapy · doi:10.1080/10669817.2022.2110419 · Cited by 10
Roy, K., Khandelwal, V., Lookingbill, V., Surana, H., Heckman, H., & Sheth, A. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i21.30577 · Cited by 15
Systematic Reviews and Meta-Analyses in Cardiac Surgery: Rules of the Road – Part 1
Gaudino, M. F. L., Fremes, S. E., Bagiella, E., Bangalore, S., Demetres, M. R., D’Ascenzo, F., Biondi‐Zoccai, G., & Franco, A. D. (2020) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2020.05.148 · Cited by 10
Effect of librarian collaboration on otolaryngology systematic review and meta-analysis quality
Whitney, R., Shih, M. C., Gordis, T. M., Nguyen, S. A., Meyer, T. A., & Brennan, E. A. (2024) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2024.1774 · Cited by 9
“These studies found low rates of librarian acknowledgment or co-authorship, yet involvement of librarians yielded improved search quality, better adherence to reporting standards, and lower risk of bias [1, 4, 6, 13-15].”
BackgroundGaeta, L., Stark, R. K., & Ofili, E. (2021) · American Journal of Audiology · doi:10.1044/2020_aja-20-00092 · Cited by 11
Iverson, S., Seta, M. D., Lefebvre, C., Ritchie, A., Traditi, L., & Baliozian, K. (2021) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2021.1301 · Cited by 8
“This is the case despite reporting guidelines like PRISMA having been widely known for a decade [11] and the benefits of information specialists’ involvement in the conduct of systematic and scoping reviews having been well documented [1, 3, 12].”
BackgroundKogut, A., Foster, M., Ramírez, D., & Xiao, D. Y. (2019) · College & Research Libraries · doi:10.5860/crl.80.7.973 · Cited by 12
A plan for systematic reviews for high-need areas in forensic science
Chin, J. M., Arabia, A.-M., McKinnon, M., Page, M. J., & Searston, R. A. (2024) · Forensic Science International Synergy · doi:10.1016/j.fsisyn.2024.100542 · Cited by 9
“This research finds, for example, that systematic reviews with authorship teams that include review experts better report their methodology (i.e., comply better with PRISMA) [31] and are more likely to search beyond standard databases [34].”
BackgroundPhrasing in Reproducible Search Methodology: The Consequences of Straight and Curly Quotation Marks
Barrick, K., & Riegelman, A. (2021) · College & Research Libraries · doi:10.5860/crl.82.7.978 · Cited by 6
Sadeghi‐Ghyassi, F., Gavgani, V. Z., Fathifar, Z., Makani, N., Vaez, R., & Montazeri, M. (2022) · Journal of Information Science · doi:10.1177/01655515221087649 · Cited by 6
“The results of a study by Koffel shows that librarians’ involvement was significantly effective in the use of controlled vocabulary in search strategies (odds ratio: 3.07 (95% CI: 2.06–4.58)) [36].”
BackgroundInfluentialIntegrating research into practice
Eldredge, J. D. (2016) · Journal of the Medical Library Association JMLA · doi:10.3163/1536-5050.104.4.017 · Cited by 7
Pieper, D., Mathes, T., Palm, R., & Hoffmann, F. (2016) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2016.08.007 · Cited by 7
Rethlefsen, M. L., Brigham, T., Price, C. L., Moher, D., Bouter, L. M., Kirkham, J. J., Schroter, S., & Zeegers, M. P. (2023) · medRxiv · doi:10.1101/2023.05.11.23289873 · Cited by 6
“[4-7] Systematic review searches are particularly vulnerable to incomplete reporting.[8-12] Estimates of systematic review search reproducibility vary widely, in part because many researchers have developed their own criteria for estimating reproducibility.”
BackgroundMcKeown, S., Mir, Z. M., Ritonja, J. A., & Soleas, E. (2021) · Journal of the Canadian Health Libraries Association / Journal de l Association de bilbiothèques de la santé du Canada · doi:10.29173/jchla29571 · Cited by 6
Misaki, E. (2023) · African Journal of Science Technology Innovation and Development · doi:10.1080/20421338.2023.2259880 · Cited by 6
“The study took a comprehensive Systematic Literature Review (SLR) due to its appropriateness in evidence-based practice (Koffel 2015; Manyati and Mutsau 2021a; Misaki et al. 2018).”
BackgroundRethlefsen, M. L., Schroter, S., Bouter, L. M., Kirkham, J. J., Moher, D., Ayala, A. P., Blanco, D., Brigham, T., Nardini, H. K. G., Kirtley, S., et al. (2025) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2024-113527 · Cited by 10
“10 44–49 Prior research has shown a difference in search quality (equivalent to ROBIS 2.3 and 2.4) between LIS mentioned in the manuscript versus in the acknowl-edgements without differentiating between named LIS and generic mentions.”
InfluentialEstructura genérica de revisiones sistemáticas odontológicas publicadas en español
Morales, Ó. A., Perdomo, B., Cassany, D., & Izarra, É. (2020) · Círculo de lingüística aplicada a la comunicación · doi:10.5209/clac.70569 · Cited by 5
“A modo de ejemplo, se pueden mencionar: van Tulder, Assendelft, Koes y Bouter (1997), van Tulder, Furlan, Bombardier y Bouter (2003), de Craen, van Vliet y Helmerhorst (2005), Major, Major y FloresMir (2006), Major, Major y Flores-Mir (2007), McGraw y Anderson (2009) y Koffel (2015).”
BackgroundFast‐and‐frugal decision tree for the rapid critical appraisal of systematic reviews
Lorenz, R. C., Jenny, M. A., Jacobs, A., & Matthias, K. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1754 · Cited by 5
“Previous studies showed that involving librarians or information specialists may improve the reproducibility of literature searches (Koffel, 2015; Rethlefsen et al., 2015) and may be associated with a lower risk of bias of the SRs as shown in a small sample (Aamodt et al.”
Popoola, B. O., Monde, M. W., & Rosenberg, J. (2024) · Medical Reference Services Quarterly · doi:10.1080/02763869.2024.2370756 · Cited by 4
“6,15,16 As advocates of EBM, medical librarians play a unique role in promoting clinical decision tools that are crucial for EBMP, 17 facilitating access to the tools, training, and providing technical support.”
Improving the Quality of Literature Reviews in Chemistry: Tools and Techniques
Álvaro, E., & Zwicky, D. A. (2021) · ACS Chemical Health & Safety · doi:10.1021/acs.chas.1c00046 · Cited by 5
An Examination of Systematic Reviews in the Engineering Literature
Henry, A., & Stieglitz, L. (2020) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--34121 · Cited by 4
MacNeil, B. A., Baran, K., Wilson, K., Boni, L., & Bolch, C. (2024) · The Journal of Men s Studies · doi:10.1177/10608265241286048 · Cited by 4
“Consistent with the recommended search strategies of Koffel (2015) a librarian was involved for the development and execution of the search.”
Metadata
- Authors
- Koffel, J. B.
- Affiliations
- University of Minnesota (US)
- Corresponding author
- Koffel, Jonathan B.
- ORCID
- Koffel, Jonathan B.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-05-04
- Volume
- 10
- Issue
- 5
- Pages
- e0125931
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4418838
- OpenAlex
- W2130019206
- Cited by
- 159
- References
- 48
- Citations by year
- 2026: 11 · 2025: 7 · 2024: 26 · 2023: 16 · 2022: 14 · 2021: 22 · 2020: 25 · 2019: 15 · 2018: 9 · 2017: 7 · 2016: 5 · 2015: 2
- FWCI
- 1.26
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Minnesota Digital Conservancy (University of Minnesota) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- systematic reviews, literature search strategies, librarian involvement, search strategy reporting, PROSPERO registration, controlled vocabulary, multilingual information retrieval, Institute of Medicine guidelines
- MeSH terms
- Cross-Sectional Studies, Humans, Surveys and Questionnaires, Databases, Factual, Librarians, Information Storage and Retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
