Who's Afraid of Peer Review?
The DOI matches its Crossref record.
Abstract
A spoof paper concocted by Science reveals little or no scrutiny at many open-access journals.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because of the increasing complexity of the knowledge being created and increased specialization, the system relies on the good-faith assumption of genuine contributions by all participants (7–10).”
From The entities enabling scientific fraud at scale are large, resilient, and growing rapidly (2025) · cites this paper as [9]
In the citing paper
“These nonsensical papers submitted can be written by humans (e.g., the Sokal Affair and Bohannon, 2013) or computer generated (e.g., SCIgen, Mathgen).”
From Tortured phrases: A dubious writing style emerging in science. Evidence of critical issues affecting established journals (2021) · cites this paper as Bohannon, 2013
In the citing paper
“In 2013, a journalist working for the journal Science launched a ‘sting’ operation to highlight perceived flaws in the peer-review processes operated by Open Access journals (Bohannon, 2013).”
From Publishing ethics in the era of paper mills (2020) · cites this paper as Bohannon, 2013
In the citing paper
“Faulty and even fraudulent research slips through peer review at alarming rates (Stroebe et al. 2012; Bohannon 2013; Lee et al. 2013; van der Heyden et al. 2009; Claxton 2005).”
From The ability of different peer review procedures to flag problematic publications (2019) · cites this paper as Bohannon 2013
Citations
Cites
Still being checked.
Cited by
Items 201–300 of 1,002
Identifying Predatory or Pseudo-Journals
Laine, C. M., & Winker, M. A. (2017) · The International Journal of Occupational and Environmental Medicine · doi:10.15171/ijoem.2017.1048 · Cited by 33
Identifying Predatory or Pseudo-Journals
Laine, C. M., & Winker, M. A. (2017) · Journal of Enam Medical College · doi:10.3329/jemc.v7i2.32650 · Cited by 33
Fake facts and alternative truths in medical research
Hofmann, B. (2018) · BMC Medical Ethics · doi:10.1186/s12910-018-0243-z · Cited by 34
Demeter, M., Jele, A., & Major, Z. B. (2021) · Publishing Research Quarterly · doi:10.1007/s12109-021-09814-9 · Cited by 40
Xue, Z., He, G., Liu, J., Jiang, Z., Zhao, S. X., & Lu, W. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103216 · Cited by 38
The Battle for Open - a perspective
Weller, M. (2013) · Journal of Interactive Media in Education · doi:10.5334/2013-15 · Cited by 38
Beware of the predatory science journal: A potential threat to the integrity of medical research
Johal, J., Ward, R. J., Gielecki, J. S., Walocha, J. A., Natsis, K., Tubbs, R. S., & Loukas, M. (2017) · Clinical Anatomy · doi:10.1002/ca.22899 · Cited by 38
Manuscript Submission Invitations from ‘Predatory Journals’: What Should Authors Do?
Kebede, M. M., Schmaus-Klughammer, A. E., & Tesfaye, B. (2017) · Journal of Korean Medical Science · doi:10.3346/jkms.2017.32.5.709 · Cited by 33
Risk evaluation in peer review of grant applications
Gallo, S. A., THOMPSON, L. A., Schmaling, K. B., & Glisson, S. R. (2018) · Environment Systems & Decisions · doi:10.1007/s10669-018-9677-6 · Cited by 37
Faculty Applicants’ Attempt to Inflate CVs Using Predatory Journals
Pond, B. B., Brown, S. D., Stewart, D. W., Roane, D. S., & Harirforoosh, S. (2019) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe7210 · Cited by 32
On the benefits of systematic reviews for wildlife parasitology
Haddaway, N. R., & Watson, M. J. (2016) · International Journal for Parasitology: Parasites and Wildlife · doi:10.1016/j.ijppaw.2016.05.002 · Cited by 31
In Trust We Trust: Epistemic Vigilance and Responsibility
Levy, N. L. (2022) · Social Epistemology · doi:10.1080/02691728.2022.2042420 · Cited by 36
David versus Goliath: Early career researchers in an unethical publishing system
Receveur, A., Bonfanti, J., D’Agata, S., Helmstetter, A. J., Moore, N. A., Oliveira, B. F., Petit‐Cailleux, C., Borges, É. R., Schultz, M., Sexton, A. N., et al. (2024) · Ecology Letters · doi:10.1111/ele.14395 · Cited by 31
On the recalcitrant use of Arnon's method for chlorophyll determination
Esteban, R., García‐Plazaola, J. I., Hernández, A., & Fernández‐Marín, B. (2017) · New Phytologist · doi:10.1111/nph.14932 · Cited by 31
Peer Review - Essential For Article and Journal Scientific Assessment and Validity
Mašić, I. (2016) · Medical Archives · doi:10.5455/medarh.2016.70.168-171 · Cited by 34
The art of scholarly reviewing: Principles and practices
Bannister, F., & Janssen, M. (2018) · Government Information Quarterly · doi:10.1016/j.giq.2018.12.002 · Cited by 31
Richtig, G., Berger, M., Koeller, M., Richtig, M., Richtig, E., Scheffel, J., Maurer, M., & Siebenhaar, F. (2023) · PLoS ONE · doi:10.1371/journal.pone.0287547 · Cited by 35
Information Literacy in the Sciences: Faculty Perception of Undergraduate Student Skill
Perry, H. M. (2017) · College & Research Libraries · doi:10.5860/crl.78.7.964 · Cited by 36
Cuschieri, S. (2018) · Early Human Development · doi:10.1016/j.earlhumdev.2018.02.017 · Cited by 33
Use of Benford's law on academic publishing networks
Tošić, A., & Vičič, J. (2021) · Journal of Informetrics · doi:10.1016/j.joi.2021.101163 · Cited by 34
García, J. A., Sánchez, R. M. R., & Fdez-Valdivia, J. (2015) · Scientometrics · doi:10.1007/s11192-015-1566-x · Cited by 36
Challenges and Controversies in Peer Review
Kusumoto, F. M., Bittl, J. A., Creager, M. A., Dauerman, H. L., Lala, A., McDermott, M. M., Turco, J. V., Taqueti, V. R., & Fuster, V. (2023) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2023.08.056 · Cited by 42
Predatory Conferences: What Are the Signs?
Pecorari, D. (2021) · Journal of Academic Ethics · doi:10.1007/s10805-021-09406-4 · Cited by 29
Sad State of Phage Electron Microscopy. Please Shoot the Messenger
Ackermann, H. (2013) · Microorganisms · doi:10.3390/microorganisms2010001 · Cited by 29
Peer Review: A Vital Gatekeeping Function and Obligation of Professional Scholarly Practice
Caputo, R. K. (2018) · Families in Society The Journal of Contemporary Social Services · doi:10.1177/1044389418808155 · Cited by 29
Kenakin, T., Bylund, D. B., Toews, M. L., Mullane, K., Winquist, R. J., & Williams, M. J. (2013) · Biochemical Pharmacology · doi:10.1016/j.bcp.2013.10.024 · Cited by 28
Predatory journals in psychiatry: A note of caution
Bhad, R., & Hazari, N. (2015) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2015.06.008 · Cited by 28
Houghton, F. T., & Houghton, S. (2018) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2018.490 · Cited by 28
Predatory publishing and the Ghana experience: A call to action for information professionals
Atiso, K., Kammer, J., & Bossaller, J. (2019) · IFLA Journal · doi:10.1177/0340035219868816 · Cited by 33
Connecting Chemistry to Social Justice in a Seminar Course for Chemistry Majors
Gerdon, A. E. (2020) · Journal of Chemical Education · doi:10.1021/acs.jchemed.0c01043 · Cited by 28
Dinis‐Oliveira, R. J. (2021) · Forensic Sciences Research · doi:10.1080/20961790.2021.1989548 · Cited by 21
Open peer review at four STEM journals: an observational overview
Ford, E. (2015) · F1000Research · doi:10.12688/f1000research.6005.1 · Cited by 28
The missing metric: quantifying contributions of reviewers
Cantor, M., & Gero, S. (2015) · Royal Society Open Science · doi:10.1098/rsos.140540 · Cited by 32
Stings, Hoaxes and Irony Breach the Trust Inherent in Scientific Publishing
Al‐Khatib, A., & da Silva, J. A. T. (2016) · Publishing Research Quarterly · doi:10.1007/s12109-016-9473-4 · Cited by 31
Publishing Addiction Science: A Guide for the Perplexed
O’Reilly, J. (2017) · Ubiquity Press eBooks · doi:10.5334/bbd · Cited by 32
Open Access Publishing in India: Coverage, Relevance, and Future Perspectives
Misra, D. P., & Agarwal, V. (2019) · Journal of Korean Medical Science · doi:10.3346/jkms.2019.34.e180 · Cited by 35
Bairi, K. E., Fourtassı, M., Fatimy, R. E., & Kadmiri, N. E. (2023) · International Journal for Educational Integrity · doi:10.1007/s40979-023-00122-7 · Cited by 27
Predatory publishing in medical education: a rapid scoping review
Tomlinson, O. W. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05024-x · Cited by 33
On the money value of peer review
Copiello, S. (2018) · Scientometrics · doi:10.1007/s11192-018-2664-3 · Cited by 33
Copiello, S. (2019) · Learned Publishing · doi:10.1002/leap.1235 · Cited by 32
Beall’s List and Cabell’s Blacklist: A Comparison of Two Lists of Predatory OA Journals
Chen, X. (2019) · Serials Review · doi:10.1080/00987913.2019.1694810 · Cited by 27
Bergh, D. D., Sharp, B. M., & Li, M. (2016) · Academy of Management Learning and Education · doi:10.5465/amle.2015.0406 · Cited by 28
The money behind academic publishing
Hagve, M. (2020) · Tidsskrift for Den norske legeforening · doi:10.4045/tidsskr.20.0118 · Cited by 26
Taubert, N., Bruns, A., Lenke, C., & Stone, G. (2021) · Insights the UKSG journal · doi:10.1629/uksg.526 · Cited by 27
The Inherent Drawbacks of the Pressure to Publish in Health Sciences: Good or Bad Science
Dinis‐Oliveira, R. J., & Magalhães, T. (2015) · F1000Research · doi:10.12688/f1000research.6809.2 · Cited by 29
Scientific misconduct: the dark side of science
Carafoli, E. (2015) · RENDICONTI LINCEI · doi:10.1007/s12210-015-0415-4 · Cited by 38
The Rise of Predatory Publishing: How To Avoid Being Scammed
Ward, S. (2016) · Weed Science · doi:10.1614/ws-d-16-00080.1 · Cited by 26
Perianes‐Rodríguez, A., & Olmeda‐Gómez, C. (2019) · Scientometrics · doi:10.1007/s11192-019-03265-y · Cited by 28
Editorial behaviors in peer review
Wang, W. W., Kong, X., Zhang, J., Chen, Z., Xia, F., & Wang, X. (2016) · SpringerPlus · doi:10.1186/s40064-016-2601-y · Cited by 33
The need for post-publication peer review in plant science publishing
da Silva, J. A. T. (2013) · Frontiers in Plant Science · doi:10.3389/fpls.2013.00485 · Cited by 25
Trends in scientific publishing: Dark clouds loom large
Wilson, V., Vishnu, V. Y., & Lal, V. (2016) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2016.02.040 · Cited by 25
Contemporary Trends in Radiation Oncology Resident Research
Verma, V., Burt, L., Gimotty, P. A., & Ojerholm, E. (2016) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2016.08.005 · Cited by 25
Li, D., & CORNELIS, G. C. (2020) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/1556264620927628 · Cited by 26
Eve, M. P. (2014) · Journal of Librarianship and Scholarly Communication · doi:10.7710/2162-3309.1131 · Cited by 25
Koppers, L., Wormer, H., & Ickstadt, K. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-016-9841-7 · Cited by 26
Open Science is for Aging Research, Too
Isaacowitz, D. M., & Lind, M. (2019) · Innovation in Aging · doi:10.1093/geroni/igz028 · Cited by 26
Editorial: Paying to Publish — What is Open Access and Why is it Important?
Leopold, S. S. (2014) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-014-3615-9 · Cited by 25
Open Access: Concepts, findings, and recommendations for stakeholders in dentistry
Hua, F., Shen, C., Walsh, T., Glenny, A., & Worthington, H. V. (2017) · Journal of Dentistry · doi:10.1016/j.jdent.2017.06.012 · Cited by 27
Academic Fraud: Solving the Crisis in Modern Academia
Wilson, P. F. (2020) · Exchanges The Interdisciplinary Research Journal · doi:10.31273/eirj.v7i3.546 · Cited by 37
Do Legitimate Publishers Benefit or Profit from Error, Misconduct or Fraud?
da Silva, J. T., & Vuong, Q. (2021) · Exchanges The Interdisciplinary Research Journal · doi:10.31273/eirj.v8i3.785 · Cited by 32
The Matter of Facts: Skepticism, Persuasion, and Evidence in Science
Leng, G., & Leng, R. (2020) · The MIT Press eBooks · doi:10.7551/mitpress/12228.001.0001 · Cited by 33
Editorial Misconduct—Definition, Cases, and Causes
Shelomi, M. (2014) · Publications · doi:10.3390/publications2020051 · Cited by 24
Predatory Journals: The Worst Thing in Publishing, Ever
Cook, C. E. (2017) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2017.0101 · Cited by 24
Strategies towards Evaluation beyond Scientific Impact. Pathways not only for Agricultural Research
Wolf, B., Häring, A. M., & Heß, J. (2015) · Organic Farming · doi:10.12924/of2015.01010003 · Cited by 30
Singh, M. K., Prasad, C. P., & Shankar, A. (2021) · Asian Pacific Journal of Cancer Prevention · doi:10.31557/apjcp.2021.22.9.2743 · Cited by 23
Four more reasons to be skeptical of open-access publishing
Agrawal, A. A. (2014) · Trends in Plant Science · doi:10.1016/j.tplants.2014.01.005 · Cited by 23
How many scientific papers are not original?
Lesk, M. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1422282112 · Cited by 23
Haider, J., & Åström, F. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23669 · Cited by 34
Evolving strategies of the predatory journals
Petrişor, A.-I. (2016) · Malaysian Journal of Library & Information Science · doi:10.22452/mjlis.vol21no1.1 · Cited by 27
Danevska, L., Spiroski, M. Z., Donev, D. M., Pop-Jordanova, N. D., & Polenakovic, M. H. (2016) · PRILOZI · doi:10.1515/prilozi-2016-0011 · Cited by 25
Questionable research practices following pre-registrationPreprint
Ikeda, A., Xu, H.-Q., Fuji, N., Zhu, S., & Yamada, Y. (2019) · PsyArXiv (OSF Preprints) · doi:10.24602/sjpr.62.3_281 · Cited by 26
Publishing ethics in the era of paper mills
Hackett, R., & Kelly, S. (2020) · Biology Open · doi:10.1242/bio.056556 · Cited by 22
Rey, S. J. (2014) · The Annals of Regional Science · doi:10.1007/s00168-014-0611-7 · Cited by 26
Detecting automatically generated sentences with grammatical structure similarity
Tien, N. M., & Labbé, C. (2018) · Scientometrics · doi:10.1007/s11192-018-2789-4 · Cited by 27
Scholarly publishing experience of postgraduate students in Nigerian Universities
Tella, A., & Onyancha, B. N. (2020) · Accountability in Research · doi:10.1080/08989621.2020.1843444 · Cited by 22
How to get published in English: Advice from the outgoing Editor-in-Chief
Coleman, J. A. (2014) · System · doi:10.1016/j.system.2014.01.004 · Cited by 22
Graziotin, D., Wang, X., & Abrahamsson, P. (2014) · Scientometrics · doi:10.1007/s11192-014-1278-7 · Cited by 21
Academics and the Field of Academic Publishing: Challenges and Approaches
Padmalochanan, P. (2019) · Publishing Research Quarterly · doi:10.1007/s12109-018-09628-2 · Cited by 31
Predatory Publishing and the Academic Librarian: Developing Tools to Make Decisions
Lopez, E., & Gaspard, C. S. (2020) · Medical Reference Services Quarterly · doi:10.1080/02763869.2020.1693205 · Cited by 23
Academic favoritism at work: insider bias in Turkish national journals
Tütüncü, L., Yücedoğru, R., & SARISOY, İ. (2022) · Scientometrics · doi:10.1007/s11192-022-04355-0 · Cited by 24
Naomi, F. (2017) · Scientometrics · doi:10.1007/s11192-017-2414-y · Cited by 23
Predatory journals: a different pandemic
Taylor, G. A. (2021) · Pediatric Radiology · doi:10.1007/s00247-020-04918-4 · Cited by 26
From Gutenberg to Open Science: An Unfulfilled Odyssey
Triggle, C. R., & Triggle, D. J. (2016) · Drug Development Research · doi:10.1002/ddr.21369 · Cited by 22
Cadman, K. (2017) · University of Adelaide Press eBooks · doi:10.20851/english-pathways-02 · Cited by 23
When peril responds to plague: predatory journal engagement with COVID-19
Allen, R. M. (2021) · Library Hi Tech · doi:10.1108/lht-01-2021-0011 · Cited by 22
Philosophy, Bullshit, and Peer Review
Levy, N. L. (2023) · Cambridge University Press eBooks · doi:10.1017/9781009256315 · Cited by 30
La ruta de oro de la publicación científica: del negocio de las revistas a las revistas negocio
López‐Cózar, E. D., & Martín‐Martín, A. (2024) · Revista Mediterránea de Comunicación · doi:10.14198/medcom.26763 · Cited by 32
Ethics of Dissent: A Plea for Restraint in the Scientific Debate About the Safety of GM Crops
Mampuys, R., & Brom, F. W. A. (2015) · Journal of Agricultural and Environmental Ethics · doi:10.1007/s10806-015-9564-9 · Cited by 21
Advice for Plagiarism Whistleblowers
Fox, M., & Beall, J. (2013) · Ethics & Behavior · doi:10.1080/10508422.2013.866047 · Cited by 21
Predatory journals and dishonesty in science
Grzybowski, A. E., Patryn, R. K., & Sak, J. J. (2017) · Clinics in Dermatology · doi:10.1016/j.clindermatol.2017.07.003 · Cited by 21
The stem cell market and policy options: a call for clarity
Zarzeczny, A., Atkins, H. L., Illes, J., Kimmelman, J., Master, Z., Robillard, J. M., Snyder, J., Turner, L. G., Zettler, P. J., & Caulfield, T. (2018) · Journal of Law and the Biosciences · doi:10.1093/jlb/lsy025 · Cited by 22
The forensic implications of predatory publishing
Byard, R. W. (2016) · Forensic Science Medicine and Pathology · doi:10.1007/s12024-016-9771-3 · Cited by 21
Taking a stand against predatory publishers
Darbyshire, P., McKenna, L., Lee, S. F., & East, C. E. (2016) · Journal of Advanced Nursing · doi:10.1111/jan.13004 · Cited by 21
Authors beware! The rise of the predatory publisher
Cartwright, V. A. (2016) · Clinical and Experimental Ophthalmology · doi:10.1111/ceo.12836 · Cited by 25
The Perils of Predatory Journals and Conferences
Ibrahim, S., & Saw, A. (2020) · Malaysian Orthopaedic Journal · doi:10.5704/moj.2007.003 · Cited by 20
Journal hijacking: Challenges and potential solutions
Moussa, S. (2021) · Learned Publishing · doi:10.1002/leap.1412 · Cited by 21
Ancient texts to PubMed: a brief history of the peer-review process
Farrell, P. R., Farrell, L., & Farrell, M. (2016) · Journal of Perinatology · doi:10.1038/jp.2016.209 · Cited by 21
Nonprofit Comparative Research: Recent Agendas and Future Trends
von Schnurbein, G., Pérez, M., & Gehringer, T. (2017) · VOLUNTAS International Journal of Voluntary and Nonprofit Organizations · doi:10.1007/s11266-017-9877-6 · Cited by 24
Incidence of predatory journals in computer science literature
Ibba, S., Pani, F. E., Stockton, J. G., Barabino, G., Marchesi, M., & Tigano, D. (2017) · Library Review · doi:10.1108/lr-12-2016-0108 · Cited by 20
Metadata
- Authors
- Bohannon, J.
- Corresponding author
- Bohannon, John
- Venue
- Science
- Published
- 2013-10-04
- Volume
- 342
- Issue
- 6154
- Pages
- 60-65
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2128186353
- Cited by
- 934
- References
- 0
- Citations by year
- 2026: 17 · 2025: 16 · 2024: 33 · 2023: 24 · 2022: 35 · 2021: 96 · 2020: 72 · 2019: 89 · 2018: 78 · 2017: 110 · 2016: 96 · 2015: 110 · 2014: 124 · 2013: 31
- Type
- other
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- peer review, open access journals, scholarly publishing
- MeSH terms
- Fraud, Peer Review, Scientific Misconduct, Access to Information
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.