Who's Afraid of Peer Review?
The DOI matches its Crossref record.
Abstract
A spoof paper concocted by Science reveals little or no scrutiny at many open-access journals.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because of the increasing complexity of the knowledge being created and increased specialization, the system relies on the good-faith assumption of genuine contributions by all participants (7–10).”
From The entities enabling scientific fraud at scale are large, resilient, and growing rapidly (2025) · cites this paper as [9]
In the citing paper
“These nonsensical papers submitted can be written by humans (e.g., the Sokal Affair and Bohannon, 2013) or computer generated (e.g., SCIgen, Mathgen).”
From Tortured phrases: A dubious writing style emerging in science. Evidence of critical issues affecting established journals (2021) · cites this paper as Bohannon, 2013
In the citing paper
“In 2013, a journalist working for the journal Science launched a ‘sting’ operation to highlight perceived flaws in the peer-review processes operated by Open Access journals (Bohannon, 2013).”
From Publishing ethics in the era of paper mills (2020) · cites this paper as Bohannon, 2013
In the citing paper
“Faulty and even fraudulent research slips through peer review at alarming rates (Stroebe et al. 2012; Bohannon 2013; Lee et al. 2013; van der Heyden et al. 2009; Claxton 2005).”
From The ability of different peer review procedures to flag problematic publications (2019) · cites this paper as Bohannon 2013
Citations
Cites
Still being checked.
Cited by
Items 301–400 of 1,002
Soler, J., & Cooper, A. (2019) · Publications · doi:10.3390/publications7010007 · Cited by 23
A New Method and Metric to Evaluate the Peer Review Process of Scholarly Journals
Etkin, A. (2013) · Publishing Research Quarterly · doi:10.1007/s12109-013-9339-y · Cited by 20
Review of the Ethics and Etiquettes of Time Management of Manuscript Peer Review
Kumar, M. N. (2014) · Journal of Academic Ethics · doi:10.1007/s10805-014-9220-4 · Cited by 21
Disseminating Research News in HCI: Perceived Hazards, How-To's, and Opportunities for Innovation
Smith, C. E., Nevarez, E., & Zhu, H. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376744 · Cited by 28
Fitzpatrick, K. (2015) · Wiley eBooks · doi:10.1002/9781118680605.ch30 · Cited by 20
Characteristics of ‘mega’ peer-reviewers
Rice, D. B., Pham, B., Presseau, J., Tricco, A. C., & Moher, D. (2022) · Research Integrity and Peer Review · doi:10.1186/s41073-022-00121-1 · Cited by 20
Pollock, D., & Michael, A. (2019) · Learned Publishing · doi:10.1002/leap.1209 · Cited by 19
One year of unsolicited e-mails: The modus operandi of predatory journals and publishers
de Sousa, F. S. D. O., Nadanovsky, P., Dhyppolito, I. M., & dos Santos, A. P. P. (2021) · Journal of Dentistry · doi:10.1016/j.jdent.2021.103618 · Cited by 22
Politicization of science in the Lancang–Mekong Basin: the Eyes on Earth Study
Grünwald, R., Feng, Y., & Wang, W. (2021) · International Journal of Water Resources Development · doi:10.1080/07900627.2021.1990025 · Cited by 20
Dunn, A. G., Coiera, E. W., & Mandl, K. D. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3331 · Cited by 19
The Problem of Publication-Pollution Denialism
Caplan, A. L. (2015) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2015.02.017 · Cited by 19
Open Access, Scholarly Communication, and Open Science in Psychology: An Overview for Researchers
Mullen, L. B. (2024) · SAGE Open · doi:10.1177/21582440231205390 · Cited by 23
Is open access sufficient? A review of the quality of open‐access nursing journals
Crowe, M., & Carlyle, D. (2014) · International Journal of Mental Health Nursing · doi:10.1111/inm.12098 · Cited by 18
The emerging landscape of scientific publishing
Fiala, C., & Diamandis, E. P. (2017) · Clinical Biochemistry · doi:10.1016/j.clinbiochem.2017.04.009 · Cited by 18
Thousands of Australian academics on the editorial boards of journals run by predatory publishers
Downes, M. (2020) · Learned Publishing · doi:10.1002/leap.1297 · Cited by 18
Babb, M. N., & Dingwall, O. (2019) · Journal of the Canadian Health Libraries Association / Journal de l Association de bilbiothèques de la santé du Canada · doi:10.29173/jchla29389 · Cited by 18
Open Peer Review in Scientific Publishing: A Web Mining Study of PeerJ Authors and Reviewers
Wang, P., You, S., Rath, M., & Wolfram, D. (2016) · Journal of Data and Information Science · doi:10.20309/jdis.201625 · Cited by 24
A “Trojan Horse” in the peer-review process of fee-charging economic journals
Dell’Anno, R., Caferra, R., & Morone, A. (2020) · Journal of Informetrics · doi:10.1016/j.joi.2020.101052 · Cited by 21
Disentangling Gold Open Access
Salinas, D. T., Robinson‐García, N., & Moed, H. (2018) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1311536 · Cited by 17
Bias in peer review: a case study
Walker, R. D., Barros, B., Conejo, R., Neumann, K., & Telefont, M. (2015) · F1000Research · doi:10.12688/f1000research.6012.1 · Cited by 20
The evolution of open access to research and data in Australian higher education
Picasso, V., & Phelan, L. (2014) · RUSC Universities and Knowledge Society Journal · doi:10.7238/rusc.v11i3.2076 · Cited by 21
Practical Suggestions for Improving Scholarly Peer Review Quality and Reducing Cycle Times
Ralph, P. (2016) · Communications of the Association for Information Systems · doi:10.17705/1cais.03813 · Cited by 23
Epistemic Consequences of Bibliometrics-based Evaluation: Insights from the Scientific Community
Castellani, T., Pontecorvo, E., & Valente, A. (2016) · Social Epistemology · doi:10.1080/02691728.2015.1065929 · Cited by 17
The hidden agenda of predatory journals: A warning call for junior researchers and student authors
Al-Busaidi, I. S., Alamri, Y., & Abu‐Zaid, A. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1414942 · Cited by 17
Scholarly work in the Internet age: Co-evolving technologies, institutions and workflows
Orlandi, L. B., Ricciardi, F., Rossignoli, C., & Marco, M. D. (2018) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2017.11.001 · Cited by 20
How to Choose a Journal: Scientific and Practical Considerations
Babor, T. F., Morisano, D., Stenius, K., & Ward, J. H. (2017) · Ubiquity Press eBooks · doi:10.5334/bbd.c · Cited by 17
Questioning the ethics of John Bohannon’s hoaxes and stings in the context of science publishing
da Silva, J. A. T., & Al‐Khatib, A. (2016) · KOME · doi:10.17646/kome.2016.16 · Cited by 18
The Division of Labor in Teams: A Conceptual Framework and Application to Collaborations in Science
Haeussler, C., & Sauermann, H. (2016) · National Bureau of Economic Research · doi:10.3386/w22241 · Cited by 18
Will technology trample peer review in ecology? Ongoing issues and potential solutions
Peres‐Neto, P. R. (2015) · Oikos · doi:10.1111/oik.02956 · Cited by 16
“Researchers’ perceptions and awareness of predatory publishing: A survey”
Kharumnuid, S. A., & Deo, P. S. (2022) · Accountability in Research · doi:10.1080/08989621.2022.2145470 · Cited by 20
Open Access: The Whipping Boy for Problems in Scholarly Publishing
Kingsley, D. A., & Kennan, M. A. (2015) · Communications of the Association for Information Systems · doi:10.17705/1cais.03714 · Cited by 20
The Problem of Biased Data and Potential Solutions for Health and Environmental Assessments
Suter, G. W., & Cormier, S. M. (2014) · Human and Ecological Risk Assessment An International Journal · doi:10.1080/10807039.2014.974499 · Cited by 17
What causes peer review scams and how can they be prevented?
Kulkarni, S. (2016) · Learned Publishing · doi:10.1002/leap.1031 · Cited by 17
Krasowski, M. D., Lawrence, J. C., Briggs, A. S., & Ford, B. A. (2019) · Journal of Pathology Informatics · doi:10.4103/jpi.jpi_12_19 · Cited by 16
Predator Effect: Understanding the Past, Present and Future of Deceptive Academic Journals
Linacre, S. (2022) · doi:10.3998/mpub.12739277 · Cited by 27
Open access, predatory publishing and peer-review
Fernández-Llimós, F. (2014) · Pharmacy Practice · doi:10.4321/s1886-36552014000100001 · Cited by 16
The Ethics of Scientific Publishing: Black, White, and “Fifty Shades of Gray”
Zietman, A. L. (2017) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2017.06.009 · Cited by 17
Nigerian Academics Patronizing Predatory Journals: Implications for Scholarly Communication
Tella, A. (2020) · Journal of Scholarly Publishing · doi:10.3138/jsp.51.3.02 · Cited by 17
Bales, S. E., Hubbard, D. E., vanDuinkerken, W., Sare, L., & Olivarez, J. (2019) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2019.02.005 · Cited by 18
ON THE ABUSE OF ONLINE SUBMISSION SYSTEMS, FAKE PEER REVIEWS AND EDITOR-CREATED ACCOUNTS
da Silva, J. A. T. (2016) · Persona y Bioética · doi:10.5294/pebi.2016.20.2.3 · Cited by 18
Pereira, A. Z., Martins, C. C., Campos, J., Faria, S. S., Notaro, S., Peričić, T. P., Costa, L. C. M., Costa, F. O., & Cota, L. (2023) · Journal of Clinical and Experimental Dentistry · doi:10.4317/jced.60197 · Cited by 15
Improving the reviewing process in Ecology and Evolutionary Biology
Grossman, G. D. (2014) · Animal Biodiversity and Conservation · doi:10.32800/abc.2014.37.0101 · Cited by 15
Preserving the Quality of Scientific Research: Peer Review of Research Articles
Silva, P. U. K. D., & Vance, C. K. (2017) · Fascinating life sciences · doi:10.1007/978-3-319-50627-2_6 · Cited by 22
Multiple Publications: The Main Reason for the Retraction of Papers in Computer Science
Hidabi, M. A., & Teh, P. L. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-03402-3_35 · Cited by 18
The DOAJ Spring Cleaning 2016 and What Was Removed—Tragic Loss or Good Riddance?
Frantsvåg, J. E. (2019) · Publications · doi:10.3390/publications7030045 · Cited by 15
Predatory journals: A threat to evidence-based science
Choudhary, M., & Kurien, N. (2019) · Indian Journal of Health Sciences and Biomedical Research (KLEU) · doi:10.4103/kleuhsj.kleuhsj_146_18 · Cited by 15
Beyond Beall's Blacklist: Automatic Detection of Open Access Predatory Research Journals
Adnan, A., Anwar, S., Zia, T., Razzaq, S., Maqbool, F., & Rehman, M. Z. U. (2018) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc/smartcity/dss.2018.00274 · Cited by 18
Re-evaluation of solutions to the problem of unprofessionalism in peer review
Gerwing, T. G., Gerwing, A. M. A., Choi, C., Avery‐Gomm, S., Clements, J. C., & Rash, J. A. (2021) · Research Integrity and Peer Review · doi:10.1186/s41073-020-00107-x · Cited by 17
Moussa, S. (2021) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2021.102388 · Cited by 18
Influence of accessibility (open and toll-based) of scholarly publications on retractions
Shah, T. A., Gul, S., Bashir, S., Ahmad, S., Huertas, A., Oliveira, A., Gulzar, F., Najar, A. H., & Chakraborty, K. (2021) · Scientometrics · doi:10.1007/s11192-021-03990-3 · Cited by 17
Houghton, F. T. (2022) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2022.1441 · Cited by 21
Panda, S. (2020) · Indian Journal of Dermatology Venereology and Leprology · doi:10.4103/ijdvl.ijdvl_22_20 · Cited by 15
Opening Pandora's box: cause and impact of errors on plant pigment studies
Fernández‐Marín, B., Artetxe, U., Barrutia, O., Esteban, R., Hernández, A., & García‐Plazaola, J. I. (2015) · Frontiers in Plant Science · doi:10.3389/fpls.2015.00148 · Cited by 15
Szkuta, K., & Osimo, D. (2016) · foresight · doi:10.1108/fs-06-2014-0040 · Cited by 16
Ranking predatory journals in dermatology: distinguishing the bad from the ugly
Tosti, A., & Maddy, A. J. (2017) · International Journal of Dermatology · doi:10.1111/ijd.13644 · Cited by 15
Rhetorical Citizenship and the Science of Science Communication
Fahnestock, J. (2019) · Argumentation · doi:10.1007/s10503-019-09499-7 · Cited by 17
Sobkowicz, P. (2015) · Journal of Artificial Societies and Social Simulation · doi:10.18564/jasss.2750 · Cited by 19
Arbitrariness of peer review: A Bayesian analysis of the NIPS experimentPreprint
François, O. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.06411 · Cited by 19
Spoof research paper is accepted by 157 journals
Hawkes, N. (2013) · BMJ · doi:10.1136/bmj.f5975 · Cited by 15
The Eighth International Congress on Peer Review and Biomedical Publication: A Call for Research
Rennie, D., Flanagin, A., Godlee, F., & Bloom, T. (2015) · JAMA · doi:10.1001/jama.2015.4665 · Cited by 16
Twelve Years Later: Second ASSAf Report on Research Publishing In and From South Africa
Academy of Science of South Africa (ASSAf) (2019) · doi:10.17159/assaf.2018/0030 · Cited by 15
Nelhans, G., & Bodin, T. (2020) · Quantitative Science Studies · doi:10.1162/qss_a_00033 · Cited by 14
Brandts‐Longtin, O., Lalu, M. M., Adie, E. A., Albert, M. A., Almoli, E., Almoli, F., Bryson, G. L., Dony, C., Dunleavy, D. J., Grudniewicz, A., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-059445 · Cited by 15
Intelligent Framework for Detecting Predatory Publishing Venues
Ateeq, W., & Al-Khalifa, H. S. (2023) · IEEE Access · doi:10.1109/access.2023.3250256 · Cited by 17
How difficult is the validation of clinical biomarkers?
Voskuil, J. L. A. (2015) · F1000Research · doi:10.12688/f1000research.6395.1 · Cited by 14
Is rational discussion of open access possible?
Anderson, R. (2014) · Insights the UKSG journal · doi:10.1629/2048-7754.162 · Cited by 14
Mora, M. C. F., Tur‐Viñes, V., & Miguel, B. G. S. (2014) · Revista española de Documentación Científica · doi:10.3989/redc.2014.4.1151 · Cited by 14
The research impact of school psychology faculty
Watkins, M. W., & Chan-Park, C. Y. (2015) · Journal of School Psychology · doi:10.1016/j.jsp.2015.03.003 · Cited by 14
Scholarly publishing landscapes: a geographical perspective
Sidaway, J. D. (2016) · Area · doi:10.1111/area.12268 · Cited by 14
Jager, P. G. D., van der Spuy, P., & de Kock, F. (2016) · South African Journal of Business Management · doi:10.2139/ssrn.2858750 · Cited by 16
Quality assurance and best research practices for non-regulated veterinary clinical studies
Davies, R., London, C. A., Lascelles, B. D. X., & Conzemius, M. G. (2017) · BMC Veterinary Research · doi:10.1186/s12917-017-1153-x · Cited by 17
Miller, T. J., Jones, C. M., Hanson, C., Heppell, S. S., Jensen, O. P., Livingston, P., Lorenzen, K., Mills, K. E., Patterson, W., Sullivan, P. J., et al. (2018) · Fisheries · doi:10.1002/fsh.10179 · Cited by 17
Spitale, G. (2020) · Heliyon · doi:10.1016/j.heliyon.2020.e04426 · Cited by 14
Islam, M. S. (2014) · Springer eBooks · doi:10.1007/978-94-007-6686-0 · Cited by 14
Manifesto for the Humanities: Transforming Doctoral Education in Good Enough Times
Smith, S. (2015) · University of Michigan Press eBooks · doi:10.3998/dcbooks.13607059.0001.001 · Cited by 13
Towards Quantifying Uncertainty in Data Analysis & Exploration.
Chung, Y., Servan-Schreiber, S., Zgraggen, E., & Kraska, T. (2018) · IEEE Data(base) Engineering Bulletin · Cited by 15
Predatory Publishing and Turkey
Koçak, Z. (2019) · Balkan Medical Journal · doi:10.4274/balkanmedj.2019.2019.4.001 · Cited by 13
Wyatt, J. C. (2019) · Journal of Medical Internet Research · doi:10.2196/16532 · Cited by 15
An insight into predatory journals
Pawar, V., & Jawade, J. (2020) · Indian Journal of Public Health · doi:10.4103/ijph.ijph_249_19 · Cited by 13
The Pioneering Role of Sci in Post Publication Public Peer Review (P4R)
Abdin, A. Y., Nasim, M. J., Ney, Y., & Jacob, C. (2021) · Publications · doi:10.20944/preprints202101.0395.v1 · Cited by 13
Quantifying the scientific output of new researchers using the zp-index
Zou, C., & Peterson, J. B. (2015) · Scientometrics · doi:10.1007/s11192-015-1807-z · Cited by 14
Curbing academic predators: JoTT’s policy regarding citation of publications from predatory journals
Raghavan, R., Dahanukar, N., & Molur, S. (2015) · Journal of Threatened Taxa · doi:10.11609/jott.o4388.7609-11 · Cited by 13
Glick, M. (2016) · The Journal of the American Dental Association · doi:10.1016/j.adaj.2016.04.002 · Cited by 13
Factors affecting global flow of scientific knowledge in environmental sciences
Sonne, C., Dietz, R., & Alstrup, A. K. O. (2019) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2019.135012 · Cited by 12
PolitePEER: does peer review hurt? A dataset to gauge politeness intensity in the peer reviews
Bharti, P. K., Navlakha, M., Agarwal, M., & Ekbal, A. (2023) · Language Resources and Evaluation · doi:10.1007/s10579-023-09662-3 · Cited by 37
Jingura, R. M., Chigwada, J. P., Diver, T., & Shangwa, D. (2023) · Accountability in Research · doi:10.1080/08989621.2023.2256672 · Cited by 12
Toward strategic, coherent, policy-relevant arctic science
Tesar, C., Dubois, M., & Shestakov, A. (2016) · Science · doi:10.1126/science.aai8198 · Cited by 12
The Fox and the Crow: Predatory Open Access Journals in Otolaryngology
Mudry, A. C., & Ruben, R. J. (2019) · Otolaryngology · doi:10.1177/0194599819838756 · Cited by 12
Stop blaming external factors: A historical-sociological argument
Schneider, J. W., Horbach, S. P. J. M., & Aagaard, K. (2021) · Social Science Information · doi:10.1177/05390184211018123 · Cited by 14
Nwagwu, W. E. (2016) · Project Muse (Johns Hopkins University) · Cited by 29
"Predatory Journals" or "Predatory Scholars?" The Essential Role of the Peer Review Process
Chirico, F. (2017) · The International Journal of Occupational and Environmental Medicine · doi:10.15171/ijoem.2017.1082 · Cited by 12
Williams, A. J., Peck, L., & Ekins, S. (2017) · F1000Research · doi:10.12688/f1000research.12185.1 · Cited by 13
The Credibility Chasm in Policy Research from Academics, Think Tanks, and Advocacy Organizations
Doberstein, C. (2017) · Canadian Public Policy · doi:10.3138/cpp.2016-067 · Cited by 23
Journals removed from DOAJ appearing within SCImago's ranks: A study of excluded journals
Sun, L. (2018) · Learned Publishing · doi:10.1002/leap.1216 · Cited by 12
Open Peer Review in the Era of Open Science: A Pilot Study of Researchers' Perceptions
Rath, M., & Wang, P. (2017) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1109/jcdl.2017.7991608 · Cited by 12
Submitting a Manuscript to a Scientific Journal
Moore, S. (2023) · Respiratory Care · doi:10.4187/respcare.11054 · Cited by 12
Evaluation of a “Flipped Classroom” Approach in Management Education
Bergfjord, O. J., & Heggernes, T. A. (2016) · Journal of University Teaching and Learning Practice · doi:10.53761/1.13.5.5 · Cited by 20
Conformity in Modern Science: An Engine of Societal Transformation?
Popova, N. G., Moiseenko, Y. Y., & Beavitt, T. A. (2017) · Changing Societies & Personalities · doi:10.15826/csp.2017.1.3.017 · Cited by 13
New research journals are needed and can compete with titans
Romanovsky, A. A. (2013) · Temperature · doi:10.4161/temp.27666 · Cited by 12
Ethics and Integrity in Academic Publishing
Caporale, C., & Zagarella, R. M. (2023) · UNIPA Springer series · doi:10.1007/978-3-031-24060-7_5 · Cited by 13
Metadata
- Authors
- Bohannon, J.
- Corresponding author
- Bohannon, John
- Venue
- Science
- Published
- 2013-10-04
- Volume
- 342
- Issue
- 6154
- Pages
- 60-65
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2128186353
- Cited by
- 934
- References
- 0
- Citations by year
- 2026: 17 · 2025: 16 · 2024: 33 · 2023: 24 · 2022: 35 · 2021: 96 · 2020: 72 · 2019: 89 · 2018: 78 · 2017: 110 · 2016: 96 · 2015: 110 · 2014: 124 · 2013: 31
- Type
- other
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- peer review, open access journals, scholarly publishing
- MeSH terms
- Fraud, Peer Review, Scientific Misconduct, Access to Information
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.