Who's Afraid of Peer Review?
The DOI matches its Crossref record.
Abstract
A spoof paper concocted by Science reveals little or no scrutiny at many open-access journals.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because of the increasing complexity of the knowledge being created and increased specialization, the system relies on the good-faith assumption of genuine contributions by all participants (7–10).”
From The entities enabling scientific fraud at scale are large, resilient, and growing rapidly (2025) · cites this paper as [9]
In the citing paper
“These nonsensical papers submitted can be written by humans (e.g., the Sokal Affair and Bohannon, 2013) or computer generated (e.g., SCIgen, Mathgen).”
From Tortured phrases: A dubious writing style emerging in science. Evidence of critical issues affecting established journals (2021) · cites this paper as Bohannon, 2013
In the citing paper
“In 2013, a journalist working for the journal Science launched a ‘sting’ operation to highlight perceived flaws in the peer-review processes operated by Open Access journals (Bohannon, 2013).”
From Publishing ethics in the era of paper mills (2020) · cites this paper as Bohannon, 2013
In the citing paper
“Faulty and even fraudulent research slips through peer review at alarming rates (Stroebe et al. 2012; Bohannon 2013; Lee et al. 2013; van der Heyden et al. 2009; Claxton 2005).”
From The ability of different peer review procedures to flag problematic publications (2019) · cites this paper as Bohannon 2013
Citations
Cites
Still being checked.
Cited by
Items 401–500 of 1,002
Đức, N. M., Ha, H., Khoa, M. T., & Thông, P. M. (2020) · Acta Informatica Medica · doi:10.5455/aim.2020.28.152-156 · Cited by 12
The effect of Open Access on scientometric indicators of Russian economic journals
Chernova, O. (2022) · Upravlenets · doi:10.29141/2218-5003-2022-13-4-6 · Cited by 12
Kozok, U., & Siaputra, I. B. (2023) · ANIMA Indonesian Psychological Journal · doi:10.24123/aipj.v38i1.5490 · Cited by 12
Spotting the Wolf in Sheep's Clothing: Predatory Open Access Publications
Carroll, C. W. (2016) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-16-00128.1 · Cited by 11
Zou, C., Tsui, J., & Peterson, J. B. (2017) · Scientometrics · doi:10.1007/s11192-017-2540-6 · Cited by 11
Peer review policies in medical student journals
Al-Busaidi, I. S., & Alamri, Y. (2018) · Postgraduate Medical Journal · doi:10.1136/postgradmedj-2017-135425 · Cited by 11
Goyal, M., Misra, D. P., Rajadhyaksha, S., Singh, Y. P., Goyal, N., & Ravindran, V. K. (2018) · Indian Journal of Rheumatology · doi:10.4103/injr.injr_36_18 · Cited by 11
Economic Modelling of Predatory Journal Publishing
Xia, J. (2019) · Publishing Research Quarterly · doi:10.1007/s12109-019-09661-9 · Cited by 11
Open Access and Promotion and Tenure Evaluation Plans at the University of Wisconsin–Eau Claire
Wical, S. H., & Kocken, G. J. (2017) · Serials Review · doi:10.1080/00987913.2017.1313024 · Cited by 11
Burggren, W. W., Madasu, D. K., Hawkins, K., & Halbert, M. (2018) · Journal of Librarianship and Scholarly Communication · doi:10.7710/2162-3309.2246 · Cited by 11
The Evolving Ecosystem of Predatory Journals: A Case Study in Indian Perspective
Jain, N., & Singh, M. P. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-34058-2_9 · Cited by 11
Exploring Arguments Presented in Predatory Journals Using Toulmin’s Model of Argumentation
Ebadi, S., Ashtarian, S., & Zamani, G. (2020) · Journal of Academic Ethics · doi:10.1007/s10805-019-09346-0 · Cited by 14
A comparative study on characteristics of retracted publications across different open access levels
Zheng, E., & Fu, H. (2024) · Journal of Data and Information Science · doi:10.2478/jdis-2024-0010 · Cited by 11
Open access journals in educational technology: Results of a survey of experienced users
Perkins, R. A., & Lowenthal, P. R. (2016) · Australasian Journal of Educational Technology · doi:10.14742/ajet.2578 · Cited by 10
A Multidisciplinary Study of Faculty Knowledge and Attitudes Regarding Predatory Publishing
Webber, N., & Wiegand, S. (2022) · Journal of Librarianship and Scholarly Communication · doi:10.31274/jlsc.13011 · Cited by 13
Arlinghaus, R. (2014) · Fisheries · doi:10.1080/03632415.2014.903837 · Cited by 14
Las revistas electrónicas en acceso abierto: pasado, presente y futuro
López‐Cózar, E. D. (2015) · RELIEVE - Revista Electrónica de Investigación y Evaluación Educativa · doi:10.7203/relieve.21.1.5005 · Cited by 10
Bartneck, C. (2016) · Scientometrics · doi:10.1007/s11192-016-2176-y · Cited by 10
Williams, M. J., Mullane, K., & Curtis, M. J. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804725-5.00005-7 · Cited by 13
Should I publish in an open access journal?
Kurien, M., Sanders, D. S., Ashton, J. J., & Beattie, R. M. (2019) · BMJ · doi:10.1136/bmj.l1544 · Cited by 10
Predatory Publishing and the Response from the Scholarly Community
Murphy, J. A. (2019) · Serials Review · doi:10.1080/00987913.2019.1624910 · Cited by 10
Miller, G. W., Stoner, R. A., Boissaud-Cooke, M. A., Lim, J. S., Furness, H. N., Putt, O., & Lewis, T. (2020) · Clinical Anatomy · doi:10.1002/ca.23580 · Cited by 14
Open Access and Online Journals in Orthopaedics: What Does the Future Hold?
Franko, O. I., & Okike, K. M. (2014) · JBJS Reviews · doi:10.2106/jbjs.rvw.m.00118 · Cited by 11
Kaiser, H. (2013) · The Bulletin of zoological nomenclature · doi:10.21805/bzn.v70i4.a17 · Cited by 10
Measuring Altruistic Impact: A Model for Understanding the Social Justice of Open Access
Heller, M., & Gaede, F. (2016) · Journal of Librarianship and Scholarly Communication · doi:10.7710/2162-3309.2132 · Cited by 10
Chauvin, A., Moher, D., Altman, D. G., Schriger, D. L., Alam, S., Hopewell, S., Shanahan, D. R., Recchioni, A., Ravaud, P., & Boutron, I. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-017462 · Cited by 11
Ḥasan, Z. (2018) · ISRA International Journal of Islamic Finance · doi:10.1108/ijif-11-2017-0044 · Cited by 10
Constructive and collegial peer-review as a necessary precursor to data-driven environmental policy
Gerwing, T. G., & Rash, J. A. (2019) · Marine Policy · doi:10.1016/j.marpol.2019.103721 · Cited by 11
Unmasking the Hunter: An Exploration of Predatory Publishing
Bramstedt, K. A. (2020) · The Journal of Scientific Practice and Integrity · doi:10.35122/001c.13267 · Cited by 10
6. How credible are open access emerging journals? A situational analysis in the humanities
Bocanegra‐Valle, A. (2017) · University of Adelaide Press eBooks · doi:10.20851/english-pathways-06 · Cited by 13
Improving Scientific Judgments in Law and Government: A Field Experiment of Patent Peer Review
Ho, D. E., & Ouellette, L. L. (2020) · Journal of Empirical Legal Studies · doi:10.1111/jels.12249 · Cited by 12
Problems With Open Access Publishing in Radiology
Crim, J. R. (2020) · American Journal of Roentgenology · doi:10.2214/ajr.20.22835 · Cited by 10
Sotudeh, H., Saber, Z., Aloni, F. G., Mirzabeigi, M., & Khunjush, F. (2022) · Scientometrics · doi:10.1007/s11192-022-04502-7 · Cited by 10
Adams, T. M., & Bullard, K. (2014) · College & Undergraduate Libraries · doi:10.1080/10691316.2014.925415 · Cited by 9
The Science hoax: poor journalology reflects poor training in peer review
Kumar, R. (2013) · BMJ · doi:10.1136/bmj.f7465 · Cited by 9
Association Claims in the Sequencing Era
Pulit, S. L., Leusink, M., Menelaou, A., & de Bakker, P. I. W. (2014) · Genes · doi:10.3390/genes5010196 · Cited by 11
Spedding, S. J. (2016) · Publications · doi:10.3390/publications4010002 · Cited by 11
Using Certification to Promote Uptake of Real-World Evidence by Payers
Segal, J. B., Kallich, J. D., Oppenheim, E. R., Garrison, L. P., Iqbal, S. U., Kessler, M., & Alexander, G. C. (2016) · Journal of Managed Care & Specialty Pharmacy · doi:10.18553/jmcp.2016.22.3.191 · Cited by 10
da Silva, J. A. T., & Tsigaris, P. (2019) · Journal of Information Communication and Ethics in Society · doi:10.1108/jices-06-2018-0059 · Cited by 10
Evidence Engines: Common Rhetorical Features of Fraudulent Academic Articles
Pflugfelder, E. H. (2022) · Written Communication · doi:10.1177/07410883211069332 · Cited by 9
Uncertainty and precaution in hunting wolves twice in a year
Treves, A., & Louchouarn, N. X. (2022) · PLoS ONE · doi:10.1371/journal.pone.0259604 · Cited by 10
An Empirical Assessment of Reviewer 2
Worsham, C. M., Woo, J., Zimerman, A., Bray, C. F., & Jena, A. B. (2022) · INQUIRY The Journal of Health Care Organization Provision and Financing · doi:10.1177/00469580221090393 · Cited by 9
Disturbance of questionable publishing to academia
You, T., Park, J., Lee, J. Y., Yun, J., & Jung, W. (2022) · Journal of Informetrics · doi:10.1016/j.joi.2022.101294 · Cited by 15
PeerNomination: A novel peer selection algorithm to handle strategic and noisy assessments
Lev, O., Mattei, N., Turrini, P., & Zhydkov, S. (2022) · Artificial Intelligence · doi:10.1016/j.artint.2022.103843 · Cited by 14
open access journals: a sustainable and scalable solution in social and political sciences?
Hrynaszkiewicz, I. (2016) · European Political Science · doi:10.1057/eps.2015.87 · Cited by 9
Open Social Scholarship Annotated Bibliography
Khatib, R. E., Seatter, L., Hajj, T. E., Leibel, C., Arbuckle, A., Siemens, R., & Winter, C. (2019) · KULA knowledge creation dissemination and preservation studies · doi:10.5334/kula.58 · Cited by 9
Peer-Review and Rejection Causes in Submitting Original Medical Manuscripts
Mendiola-Pastrana, I. R., Hernández, A. V., Pérez-Manjarrez, F. E., López‐Ortiz, E., Henríquez, L. F. R., & López-Ortiz, G. (2020) · Journal of Continuing Education in the Health Professions · doi:10.1097/ceh.0000000000000295 · Cited by 10
How frequently are articles in predatory open access journals cited
B-C, B., Kanto-Karvonen, S., & Harviainen, J. T. (2020) · Yearbook of pediatric endocrinology · doi:10.1530/ey.17.14.6 · Cited by 9
Submitting a manuscript for peer review - integrity, integrity, integrity
Murphy, S. P., Bulman, C., Shariati, B., & Hausmann, L. (2013) · Journal of Neurochemistry · doi:10.1111/jnc.12644 · Cited by 9
Haeussler, C., & Sauermann, H. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2434327 · Cited by 10
Why published research is untrustworthy
Lose, G., & Klarskov, N. (2017) · International Urogynecology Journal · doi:10.1007/s00192-017-3389-1 · Cited by 10
Publishing addiction science – A guide for the perplexed.
Bühringer, G. (2018) · SUCHT - Zeitschrift für Wissenschaft und Praxis / Journal of Addiction Research and Practice · doi:10.1024/0939-5911/a000524 · Cited by 9
Retraction handling by potential predatory journals
Xu, S. B., Liu, T., Nejadghanbar, H., & Hu, G. (2024) · Accountability in Research · doi:10.1080/08989621.2024.2434245 · Cited by 9
Bibliometric review and mapping analysis of publication ethics research
Zhang, M., Xu, J., Xu, C., Zheng, Q., Liu, M., Zhang, J., Fu, H., Qi, W., Zhang, J., & Tian, J. (2024) · Ethics & Behavior · doi:10.1080/10508422.2024.2306134 · Cited by 9
Em, S., Serey, M., Sam, R., Pen, D., & Chin, P. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-0654-4.ch003 · Cited by 8
Open Access in Scholarly Publishing: Embracing Principles and Avoiding Pitfalls
Quinn, M. M. (2015) · The Serials Librarian · doi:10.1080/0361526x.2015.1036197 · Cited by 8
Applying Rational Choice Theory to Authors' Behaviors in Unethical Publishing in China
Xia, J. (2018) · Library trends · doi:10.1353/lib.2018.0035 · Cited by 8
Now you have to pay! A deeper look at publishing practices of predatory journals
Freiermuth, M. R. (2023) · Learned Publishing · doi:10.1002/leap.1583 · Cited by 8
A harm reduction approach to improving peer review by acknowledging its imperfections
Cooke, S. J., Young, N., Peiman, K. S., Roche, D. G., Clements, J. C., Kadykalo, A. N., Provencher, J. F., Raghavan, R., DeRosa, M. C., Lennox, R. J., et al. (2024) · FACETS · doi:10.1139/facets-2024-0102 · Cited by 12
Thiede, M. (2014) · The Serials Librarian · doi:10.1080/0361526x.2014.915608 · Cited by 8
Shaw, O., & Voss, S. (2017) · University of Adelaide Press eBooks · doi:10.20851/english-pathways-04 · Cited by 10
Publish and/or perish: A urological perspective on predatory publications
Lena, M. A. D., & Nickel, J. C. (2018) · Canadian Urological Association Journal · doi:10.5489/cuaj.4987 · Cited by 8
Violations of Standard Practices by Predatory Economics Journals
Trejo‐Pech, C. O., Thach, S. V., Thompson, J. M., & Manley, J. (2021) · Serials Review · doi:10.1080/00987913.2021.1959183 · Cited by 8
An imbalanced journal publishing market
Xia, J. (2014) · Learned Publishing · doi:10.1087/20140309 · Cited by 10
Publicar (casi exclusivamente) en revistas de impacto
Aretio, L. G. (2015) · RIED Revista Iberoamericana de Educación a Distancia · doi:10.5944/ried.18.2.14254 · Cited by 15
Understanding the science–policy interface in integrated coastal and ocean management
MacDonald, B., Soomai, S., Santo, E. D. D., & Wells, P. (2016) · CRC Press eBooks · doi:10.1201/b21483-4 · Cited by 3
How open access is crucial to the future of science
Bolick, J., Emmett, A., Greenberg, M. L., Rosenblum, B., & Peterson, A. T. (2017) · Journal of Wildlife Management · doi:10.1002/jwmg.21216 · Cited by 8
Sikdar, S., Marsili, M., Ganguly, N., & Mukherjee, A. (2017) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1109/jcdl.2017.7991572 · Cited by 10
Predatory Publishing and Academic Integrity
Jimenez, D. F., & Garza, D. N. (2017) · World Neurosurgery · doi:10.1016/j.wneu.2017.05.157 · Cited by 10
Nudging transparent behavioural science and policy
Maynard, O., & Munafo, M. R. (2018) · Behavioural Public Policy · doi:10.1017/bpp.2018.10 · Cited by 9
A shift in scholarly publishing practices and the growing menace of predatory journals
Munk, P. L., Coupal, T. M., & Peh, W. (2018) · The Medical Journal of Australia · doi:10.5694/mja17.00892 · Cited by 8
Koroulakis, A. I., Rice, S. R., DeCesaris, C. M., Knight, N., & Nichols, E. M. (2019) · Advances in Radiation Oncology · doi:10.1016/j.adro.2019.09.001 · Cited by 8
Risk of publication in worthless journals
Shrestha, J., Subedı, S., Timsina, K. P., & Tripathi, M. P. (2018) · Journal of Agriculture and Natural Resources · doi:10.3126/janr.v1i1.22217 · Cited by 8
Taubert, N. (2019) · transcript Verlag eBooks · doi:10.14361/9783839443576 · Cited by 8
Allan, A. (2020) · Psychiatry Psychology and Law · doi:10.1080/13218719.2020.1742243 · Cited by 9
Skin in the Game: Personal Accountability and Journal Peer Review
Sacco, D. F., Bruton, S. V., Brown, M., & Medlin, M. M. (2020) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/1556264620922651 · Cited by 9
Impact of Predatory Journals in Plastic Surgery Literature: Researchers Beware
Asaad, M., Elmorsi, R., Winocour, S. J., Mericli, A. F., Reece, E. M., Selber, J. C., Butler, C. E., & Chu, C. K.-C. (2022) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000009054 · Cited by 9
Perceptions of Open Access Publishing by Faculty at Pondicherry University: A Survey
Singson, M., Joy, M. G., Thiyagarajan, S., & Dkhar, V. (2015) · The International Information & Library Review · doi:10.1080/10572317.2015.1021625 · Cited by 12
Avoiding publishing in predatory journals: An evaluation algorithm
Qehaja, A. B. (2020) · Journal on Efficiency and Responsibility in Education and Science · doi:10.7160/eriesj.2020.130305 · Cited by 8
Welcome to Fungal Biology and Biotechnology
Idnurm, A., & Meyer, V. (2014) · Fungal Biology and Biotechnology · doi:10.1186/s40694-014-0008-5 · Cited by 8
Publish or Perish: Need to have another look?
Jawaid, S. A. (2016) · Pakistan Journal of Medical Sciences · doi:10.12669/pjms.322.10326 · Cited by 8
Witham, M. D., & Runcie, H. (2017) · The Journal of the Royal College of Physicians of Edinburgh · doi:10.4997/jrcpe.2017.101 · Cited by 8
Hering, J. G., Nunnenmacher, L., & von Waldow, H. (2018) · Wiley eBooks · doi:10.1002/9781119271659.ch1 · Cited by 8
Petrişor, A.-I. (2018) · DESIDOC Journal of Library & Information Technology · doi:10.14429/djlit.38.3.12551 · Cited by 10
Scholarly Open‐Access Publishing
Beall, J. (2019) · Wiley eBooks · doi:10.1002/9781118907283.ch41 · Cited by 9
Vegetation Classification and Survey is performing well
Dengler, J., Biurrun, I., Jansen, F., & Willner, W. (2024) · Vegetation Classification and Survey · doi:10.3897/vcs.118454 · Cited by 8
The 'Must Stock' Challenge in Academic Publishing: Pricing Implications of Transformative AgreementsPreprint
Schmal, W. B. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4818955 · Cited by 16
Delving into the analysis of scientific production and communication in academic literature
Sánchez‐García, E., Martínez‐Falcó, J., Seva‐Larrosa, P., & Marco‐Lajara, B. (2024) · Journal of Librarianship and Information Science · doi:10.1177/09610006231223168 · Cited by 9
Towards a More Structured Peer Review Process with Empirical Standards
Arshad, A., Ghaleb, T. A., & Ralph, P. (2021) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3463274.3463359 · Cited by 8
Humanising Peer Review with Artificial Intelligence: Paradox or Panacea?
Crawford, J., Allen, K., & Lodge, J. M. (2024) · Journal of University Teaching and Learning Practice · doi:10.53761/xeqvhc70 · Cited by 7
Scientific rot: Unsustainable publishing practices threatens trust in medicine
Heen, E., & Vogt, H. (2024) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13989 · Cited by 7
Sting operations in biomedical publishing violate truthfulness and undermine trust in research
da Silva, J. A. T., Türp, J. C., & Daly, T. P. (2024) · Current Medical Research and Opinion · doi:10.1080/03007995.2024.2441340 · Cited by 7
Partnerships: the engaged university and library publishing
Cruz, L. E., & Fleming, R. (2015) · OCLC Systems & Services · doi:10.1108/oclc-02-2014-0017 · Cited by 7
Reducing Ethical Hazards in Knowledge Production
Cottey, A. (2015) · Science and Engineering Ethics · doi:10.1007/s11948-015-9651-3 · Cited by 7
Os Equívocos do Artigo "Os Equívocos e Acertos da Campanha 'Não À Medicalização da Vida'"
Viégas, L. D. S., Gomes, J., & de Oliveira, A. R. F. (2013) · Revista Psicologia em Pesquisa · doi:10.5327/z0375-7536201200040015 · Cited by 7
Biomedical ethics education may benefit from integrating compliance and analysis approaches
Mumford, M. D., Watts, L. L., Medeiros, K. E., Mulhearn, T. J., Steele, L. M., & Connelly, S. (2016) · Nature Immunology · doi:10.1038/ni.3465 · Cited by 7
A prospective study on an innovative online forum for peer reviewing of surgical science
Almquist, M., von Allmen, R. S., Carradice, D., Oosterling, S. J., McFarlane, K., & Wijnhoven, B. P. L. (2017) · PLoS ONE · doi:10.1371/journal.pone.0179031 · Cited by 11
Thananusak, T., & Ansari, S. (2019) · Emerald Group Publishing Limited eBooks · doi:10.1108/s0733-558x20190000059005 · Cited by 9
Reilly, I. (2020) · Canadian Journal of Communication · doi:10.22230/cjc.2020v45n2a3667 · Cited by 7
Jones, A. W. (2022) · Forensic Science Medicine and Pathology · doi:10.1007/s12024-021-00447-0 · Cited by 8
Metadata
- Authors
- Bohannon, J.
- Corresponding author
- Bohannon, John
- Venue
- Science
- Published
- 2013-10-04
- Volume
- 342
- Issue
- 6154
- Pages
- 60-65
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2128186353
- Cited by
- 934
- References
- 0
- Citations by year
- 2026: 17 · 2025: 16 · 2024: 33 · 2023: 24 · 2022: 35 · 2021: 96 · 2020: 72 · 2019: 89 · 2018: 78 · 2017: 110 · 2016: 96 · 2015: 110 · 2014: 124 · 2013: 31
- Type
- other
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- peer review, open access journals, scholarly publishing
- MeSH terms
- Fraud, Peer Review, Scientific Misconduct, Access to Information
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.