The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Best practice guidelines for abstract screening large‐evidence systematic reviews and meta‐analyses
Open accessAbstract
Abstract screening is one important aspect of conducting a high‐quality and comprehensive systematic review and meta‐analysis. Abstract screening allows the review team to conduct the tedious but vital first step to synthesize the extant literature: winnowing down the overwhelming amalgamation of citations discovered through research databases to the citations that should be “full‐text” screened and eventually included in the review. Although it is a critical process, few guidelines have been put forth since the publications of seminal systematic review textbooks. The purpose of this paper, therefore, is to provide a practical set of best practice guidelines to help future review teams and managers. Each of the 10 proposed guidelines is explained using real‐world examples or illustrations from applications. We also delineate recent experiences where a team of abstract screeners double‐screened 14 923 abstracts in 89 days.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rayyan-a web and mobile app for systematic reviews.
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0384-4 · Cited by 26,092
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group (2015) · BMJ · doi:10.1136/bmj.g7647 · Cited by 13,120 · cited 1×
“The abstract screening tool is based on the inclusion criteria of the study guiding the review and preferably published in a research protocol created prior to the literature search.(19) The abstract screening tool guides screeners in their decisions about whether a citation is eligible for the review and thus plays a…”
MethodLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
(2000) · Cited by 9,198
Meta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635 · cited 1×
“Double‐screening all available abstracts is not a new practice and has been suggested as a best practice for decades.(18) Guidance from the Cochrane Collaboration,(8) the Institute of Medicine,(10) and the Center for Review and Dissemination(9) all include the importance of independent screening of identified studies…”
MethodThe Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,245
When and Why Incentives (Don't) Work to Modify Behavior
Gneezy, U., Meier, S., & Rey-Biel, P. (2011) · Journal of Economic Perspectives · doi:10.1257/jep.25.4.191 · Cited by 1,735
Research Synthesis and Meta-Analysis: A Step-by-Step Approach
Cooper, H. (2017) · doi:10.4135/9781071878644 · Cited by 1,716
Social network changes and life events across the life span: A meta-analysis.
Wrzus, C., Hänel, M., Wagner, J., & Neyer, F. J. (2013) · Psychological Bulletin · doi:10.1037/a0028601 · Cited by 1,381
Cited by
Methodological guidance paper: High-quality meta- analysis in a systematic review
Pigott, T. D., & Polanin, J. R. (2020) · Review of Educational Research · doi:10.3102/0034654319877153 · Cited by 568
Self-citationAutomated Paper Screening for Clinical Reviews Using Large Language Models
Guo, E., Gupta, M., Deng, J., Park, Y.-J., Paget, M., & Naugler, C. (2023) · arXiv · doi:10.48550/arxiv.2305.00844 · Cited by 230
Automated paper screening for clinical reviews using large language models: Data analysis study
Guo, E., Gupta, M., Deng, J., Park, Y.-J., Paget, M., & Naugler, C. (2024) · Journal of Medical Internet Research · doi:10.2196/48996 · Cited by 205
Chai, K. E. K., Lines, R. L. J., Gucciardi, D. F., & Ng, L. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01635-3 · Cited by 190
Polanin, J. R., Espelage, D. L., Grotpeter, J. K., Ingram, K., Michaelson, L., Spinney, E., Valido, A., Sheikh, A. E., Torgal, C., & Robinson, L. (2022) · Prevention Science · doi:10.1007/s11121-021-01259-y · Cited by 171
Self-citationGeoffroy, M.-C., Bouchard, S., Per, M., Khoury, B., Chartrand, E., Renaud, J., Turecki, G., Colman, I., & Orri, M. (2022) · The Lancet Psychiatry · doi:10.1016/s2215-0366(22)00193-6 · Cited by 133
Simonsmeier, B. A., Flaig, M., Simacek, T., & Schneider, M. (2022) · Health Psychology Review · doi:10.1080/17437199.2021.1967184 · Cited by 81
Shumba, A.-T., Montanaro, T., Sergi, I., Bramanti, A., Ciccarelli, M., Rispoli, A., Carrizzo, A., De Vittorio, M., & Patrono, L. (2023) · Sensors · doi:10.3390/s23156896 · Cited by 74
Li, Y., Datta, S., Rastegar-Mojarad, M., Lee, K., Paek, H., Glasgow, J., Liston, C., He, L., Wang, X., & Xu, Y. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf030 · Cited by 69
Development of Prompt Templates for Large Language Model–Driven Screening in Systematic Reviews
Cao, C., Sang, J., Arora, R., Chen, D., Kloosterman, R., Cecere, M., Gorla, J., Saleh, R., Drennan, I., Teja, B., et al. (2025) · Annals of Internal Medicine · doi:10.7326/annals-24-02189 · Cited by 91
“This represents the median of estimates we identi fi ed searching the literature (4.3 to 20 minutes for a single full-text article) (29, 30).”
InfluentialMatsui, K., Utsumi, T., Aoki, Y., Maruki, T., Takeshima, M., & Takaesu, Y. (2024) · Journal of Medical Internet Research · doi:10.2196/52758 · Cited by 50
Galli, C., Gavrilova, A. V., & Calciolari, E. (2025) · Information · doi:10.3390/info16050378 · Cited by 36
Choosing the Right Tool for the Job: Screening Tools for Systematic Reviews in Education
Zhang, Q., & Neitzel, A. (2024) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2023.2209079 · Cited by 28
Muller, A. E., Ames, H. M. R., Jardim, P. S. J., & Rose, C. J. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1541 · Cited by 21
Ethnic Minorities’ Experiences of Cardiac Rehabilitation: A Scoping Review
Carew Tofani, A., Taylor, E., Pritchard, I., Jackson, J., Xu, A., & Kotera, Y. (2023) · Healthcare · doi:10.3390/healthcare11050757 · Cited by 16
Tsubota, T., Bollegala, D., Zhao, Y., Jin, Y., & Kozu, T. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2022.104185 · Cited by 11
Exploring public health education’s integration of critical race theories: A scoping review
Collins, S. L., Smith, T. C., Hack, G., & Moorhouse, M. D. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1148959 · Cited by 10
Pisegna, J., Anderson, S., & Krok-Schoen, J. L. (2022) · American Journal of Occupational Therapy · doi:10.5014/ajot.2022.049068 · Cited by 7
Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis
Mihaylova, M., Zocca, M., Kliegel, M., & Rothen, N. (2025) · Swiss Psychology Open · doi:10.5334/spo.101 · Cited by 1
Metadata
- Authors
- Polanin, J. R., Pigott, T. D., Espelage, D. L., & Grotpeter, J. K.
- Venue
- Research Synthesis Methods
- Publisher
- Wiley
- Published
- 2019-06-24
- Volume
- 10
- Issue
- 3
- Pages
- 330-342
- ISSN
- 1759-2879 (ISSN-L)
- 1759-2887
- OpenAlex
- W2944878516
- Cited by
- 401
- References
- 22
- FWCI
- 3.86
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.