The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Impartial Judgment by the “Gatekeepers” of Science: Fallibility and Accountability in the Peer Review Process
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Matthew Effect in Science: The reward and communication systems of science are considered.
Merton, R. K. (1968) · Science · doi:10.1126/science.159.3810.56 · Cited by 6,720
The Existence of Publication Bias and Risk Factors for Its Occurrence
Dickersin, K. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100097014 · Cited by 1,417
Peer-review practices of psychological journals: The fate of published articles, submitted again
Peters, D. P., & Ceci, S. J. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011183 · Cited by 1,079 · cited 2×
“Despite the importance of fairness in the peer review process, it seems ironic that some view it as a “remote and mysterious business,” (Bailer and Patterson, 1985) or as a “religious mystique” (Goldbeck-Wood, 1999), as well as an unfair process and a biased system (Horrobin, 1982; Kassirer and Campion, 1994; Mahoney,…”
BackgroundConsequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022 · cited 1×
“of no relationship (null hypothesis) is accepted have a much lower chance of being recommended for publication (Sterling, 1959; Greenwald, 1975; Dickersin, 1990).”
BackgroundPublication prejudices: An experimental study of confirmatory bias in the peer review system
Mahoney, M. J. (1977) · Cognitive Therapy and Research · doi:10.1007/bf01173636 · Cited by 1,013
Godlee, F., Gale, C. R., & Martyn, C. N. (1998) · JAMA · doi:10.1001/jama.280.3.237 · Cited by 333
Does Masking Author Identity Improve Peer Review Quality?: A Randomized Controlled Trial
Justice, A. C., Cho, M. K., Winker, M. A., Berlin, J. A., Rennie, D., & and the PEER Investigators (1998) · JAMA · doi:10.1001/jama.280.3.240 · Cited by 278
The Effects of Blinding on Acceptance of Research Papers by Peer Review
Fisher, M. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520020069019 · Cited by 164
Reliability of Editors' Subjective Quality Ratings of Peer Reviews of Manuscripts
Callaham, M. L. (1998) · JAMA · doi:10.1001/jama.280.3.229 · Cited by 122
Masking Author Identity in Peer Review: What Factors Influence Masking Success?
Cho, M. K., Justice, A. C., Winker, M. A., Berlin, J. A., Waeckerle, J. F., Callaham, M. L., Rennie, D., & and the PEER Investigators (1998) · JAMA · doi:10.1001/jama.280.3.243 · Cited by 104
Cited by
Dissemination and publication of research findings: an updated review of related biases
Song, F., Parekh, Hooper, L., Loke, Y., Ryder, J., Sutton, A., Hing, C., Kwok, C., Pang, C., & Harvey, I. (2010) · Health Technology Assessment · doi:10.3310/hta14080 · Cited by 1,039
Gender practices in the construction of academic excellence: Sheep with five legs
van den Brink, M., & Benschop, Y. (2012) · Organization · doi:10.1177/1350508411414293 · Cited by 589
Bornmann, L. (2011) · Annual Review of Information Science and Technology · doi:10.1002/aris.2011.1440450112 · Cited by 567
The ups and downs of peer review
Benos, D. J., Bashari, E., Chaves, J. M., Gaggar, A., Kapoor, N., LaFrance, M., Mans, R., Mayhew, D., McGowan, S., Polter, A., et al. (2007) · Advances in Physiology Education · doi:10.1152/advan.00104.2006 · Cited by 294
Checco, A., Bracciale, L., Loreti, P., Pinfield, S., & Bianchi, G. (2021) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-00703-8 · Cited by 286
Metadata
- Authors
- Hojat, M., Gonnella, J. S., & Caelleigh, A. S.
- Venue
- Advances in Health Sciences Education
- Published
- 2003-03
- Volume
- 8
- Issue
- 1
- Pages
- 75-96
- ISSN
- 1382-4996 (ISSN-L)
- 1573-1677
- OpenAlex
- W1550927947
- Cited by
- 199
- References
- 12
- FWCI
- 38.07
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Impartial Judgment by the “Gatekeepers” of Science: Fallibility and Accountability in the Peer Review Process. https://app.cochat.ai/papers/10.1023/a:1022670432373
- The paper
- Hojat, M., Gonnella, J. S., & Caelleigh, A. S. (2003). Impartial Judgment by the “Gatekeepers” of Science: Fallibility and Accountability in the Peer Review Process. Advances in Health Sciences Education. https://doi.org/10.1023/a%3A1022670432373
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.