Checklists to detect potential predatory biomedical journals: a systematic review
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Background: The increase in the number of predatory journals puts scholarly communication at risk. In order to guard against publication in predatory journals, authors may use checklists to help detect predatory journals. We believe there are a large number of such checklists yet it is uncertain whether these checklists contain similar content. We conducted a systematic review to identify checklists that help to detect potential predatory journals and examined and compared their content and measurement properties. Methods: We searched MEDLINE, Embase, PsycINFO, ERIC, Web of Science and Library, and Information Science & Technology Abstracts (January 2012 to November 2018); university library websites (January 2019); and YouTube (January 2019). We identified sources with original checklists used to detect potential predatory journals published in English, French or Portuguese. Checklists were defined as having instructions in point form, bullet form, tabular format or listed items. We excluded checklists or guidance on recognizing “legitimate” or “trustworthy” journals. To assess risk of bias, we adapted five questions from A Checklist for Checklists tool a priori as no formal assessment tool exists for the type of review conducted. Results: Of 1528 records screened, 93 met our inclusion criteria. The majority of included checklists to identify predatory journals were in English ( n = 90, 97%), could be completed in fewer than five minutes ( n = 68, 73%), included a mean of 11 items (range = 3 to 64) which were not weighted ( n = 91, 98%), did not include qualitative guidance ( n = 78, 84%), or quantitative guidance (n = 91, 98%), were not evidence-based (n = 90, 97%) and covered a mean of four of six thematic categories. Only three met our criteria for being evidence-based, i.e. scored three or more “yes” answers (low risk of bias) on the risk of bias tool. Conclusion: There is a plethora of published checklists that may overwhelm authors looking to efficiently guard against publishing in predatory journals. The continued development of such checklists may be confusing and of limited benefit. The similarity in checklists could lead to the creation of one evidence-based tool serving authors from all disciplines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement
McGowan, J., Sampson, M., Salzwedel, D. M., Cogo, E., Foerster, V., & Lefebvre, C. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.01.021 · Cited by 5,700
When choice is demotivating: can one desire too much of a good thing?
Iyengar, S. S., & Lepper, M. R. (2000) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.79.6.995 · Cited by 2,878
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232
Self-citationPredatory’ open access: a longitudinal study of article volumes and market characteristics
Shen, C., & Björk, B.-C. (2015) · BMC Medicine · doi:10.1186/s12916-015-0469-2 · Cited by 819
Predatory journals: no definition, no defence
Grudniewicz, A., Moher, D., Cobey, K. D., Bryson, G. L., Cukier, S., Allen, K., Ardern, C., Balcom, L., Barros, T., Berger, M., et al. (2019) · Nature · doi:10.1038/d41586-019-03759-y · Cited by 726
Self-citationMedical Publishing Triage - Chronicling Predatory Open Access Publishers
Beall, J. (2013) · Annals of Medicine & Surgery · doi:10.1016/s2049-0801(13)70035-9 · Cited by 125 · cited 3×
“…[10] Criteria for Determining Predatory Open-Access Publishers 5 No 10+ min Criteria based on AOSPAa Code of Conduct, two COPEb publications No No Beall, 2013 [15] Some warning signs of questionable publishers 7 No 0–5 min Observational research on own emails received No No Crawford, 2014 [82]…”
BackgroundInfluentialThe Surge of Predatory Open-Access in Neurosciences and Neurology
Manca, A., Martinez, G., Cugusi, L., Dragone, D., Dvir, Z., & Deriu, F. (2017) · Neuroscience · doi:10.1016/j.neuroscience.2017.04.014 · Cited by 99
Predatory and fake scientific journals/publishers: A global outbreak with rising trend: A review
Lukic, T., Blesic, I., Basarin, B., Ivanovic, B., Milosevic, D., & Sakulski, D. (2014) · Geographica Pannonica · doi:10.5937/geopan1403069l · Cited by 80
Cited by
Predatory journals: no definition, no defence
Grudniewicz, A., Moher, D., Cobey, K. D., Bryson, G. L., Cukier, S., Allen, K., Ardern, C., Balcom, L., Barros, T., Berger, M., et al. (2019) · Nature · doi:10.1038/d41586-019-03759-y · Cited by 726
Self-citationReporting guidelines in medical artificial intelligence: a systematic review and meta-analysis
Kolbinger, F. R., Veldhuizen, G. P., Zhu, J., Truhn, D., & Kather, J. N. (2024) · Communications Medicine · doi:10.1038/s43856-024-00492-0 · Cited by 160
“…tools developed for systematic reviews of observational or interventional trials 24,25 would not be appropriate for a methodological review, an in-depth analysis with a custom, methods-centered tool 26 could have provided more insights on the speci fi c shortcomings of the included guidelines.”
Common issues of systematic reviews in the sports and exercise medicine field.
Memon, A. R., Owen, P. J., Anderson, N., Verhagen, E., Mundell, N. L., & Belavy, D. L. (2024) · BMJ Open Sport & Exercise Medicine · doi:10.1136/bmjsem-2023-001784 · Cited by 3
Metadata
- Authors
- Cukier, S., Helal, L., Rice, D. B., Pupkaite, J., Ahmadzai, N., Wilson, M., Skidmore, B., Lalu, M. M., & Moher, D.
- Venue
- BMC Medicine
- Published
- 2020-05-18
- Volume
- 18
- Issue
- 1
- Pages
- 104-104
- ISSN
- 1741-7015 (ISSN-L)
- OpenAlex
- W3023976011
- Cited by
- 138
- References
- 8
- FWCI
- 24.06
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Checklists to detect potential predatory biomedical journals: a systematic review. https://app.cochat.ai/papers/10.1186/s12916-020-01566-1
- The paper
- Cukier, S., Helal, L., Rice, D. B., Pupkaite, J., Ahmadzai, N., Wilson, M., Skidmore, B., Lalu, M. M., & Moher, D. (2020). Checklists to detect potential predatory biomedical journals: a systematic review. BMC Medicine. https://doi.org/10.1186/s12916-020-01566-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.