Barriers to scientific contributions: The author's formula
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Recently I completed a review of the empirical research on scientific journals (Armstrong 1982). This review provided evidence for an “author’s formula, ” a set of rules that authors can use to increase the likelihood and speed of acceptance of their manuscripts. Authors should: (1) not pick an important problem, (2) not challenge existing beliefs, (3) not obtain surprising results, (4) not use simple methods, (5) not provide full disclosure, and (6) not write clearly. Peters & Ceci (P&C) are obviously ignorant of the author’s formula. In their extension of the Kosinski study (Ross 1979; 1980), they broke most of the rules. Why, then, is P&C’s paper being published? In my search for an explanation, I learned the following from Peters: (a) After a long delay, the paper was rejected by Science, with advice that it would be appropriate for the American Psychologist. (b) After a long delay, the paper was rejected by the American Psychologist. This history illustrates the predictive power of the author’s formula. Submission was meanwhile encouraged by the editor of the Behavioral and Brain Sciences – a journal specializing in peer interaction on controversial papers – and, after a final round of major revision, the paper was accepted for publication. In this commentary, I describe how P&C violated many rules in the author’s formula. It may be too late to salvage their careers, but the discussion should be instructive to other authors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Structure of Scientific Revolutions: 50th Anniversary Edition
Kuhn, T. S., & Hacking, I. (2012) · doi:10.7208/chicago/9780226458144.001.0001 · Cited by 21,170
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
The Matthew Effect in Science: The reward and communication systems of science are considered.
Merton, R. K. (1968) · Science · doi:10.1126/science.159.3810.56 · Cited by 6,720
Falsification and the Methodology of Scientific Research Programmes
Lakatos, I. (1970) · Criticism and the Growth of Knowledge · doi:10.1017/cbo9781139171434.009 · Cited by 4,649
Interpersonal expectancy effects: the first 345 studies
Rosenthal, R., & Rubin, D. B. (1978) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00075506 · Cited by 1,158
Publication prejudices: An experimental study of confirmatory bias in the peer review system
Mahoney, M. J. (1977) · Cognitive Therapy and Research · doi:10.1007/bf01173636 · Cited by 1,013
Chance and Consensus in Peer Review
Cole, S., Cole, J. R., & Simon, G. A. (1981) · Science · doi:10.1126/science.7302566 · Cited by 623
The yin and yang of progress in social psychology: Seven koan.
McGuire, W. J. (1973) · Journal of Personality and Social Psychology · doi:10.1037/h0034345 · Cited by 490
Scientific communication: Its role in the conduct of research and creation of knowledge.
Garvey, W. D., & Griffith, B. C. (1971) · American Psychologist · doi:10.1037/h0032059 · Cited by 225
Review Paper : Psychology of the Scientist: An Evaluative Review
Mahoney, M. J. (1979) · Social Studies of Science · doi:10.1177/030631277900900304 · Cited by 180
Cited by
Cicchetti, D. V. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065675 · Cited by 496
What is open peer review? A systematic review
Ross-Hellauer, T. (2017) · F1000Research · doi:10.12688/f1000research.11369.2 · Cited by 449
The ups and downs of peer review
Benos, D. J., Bashari, E., Chaves, J. M., Gaggar, A., Kapoor, N., LaFrance, M., Mans, R., Mayhew, D., McGowan, S., Polter, A., et al. (2007) · Advances in Physiology Education · doi:10.1152/advan.00104.2006 · Cited by 294
Peer review for journals: Evidence on quality control, fairness, and innovation
Armstrong, J. S. (1997) · Science and Engineering Ethics · doi:10.1007/s11948-997-0017-3 · Cited by 262
Self-citationWhat is open peer review? A systematic review
Ross-Hellauer, T. (2017) · F1000Research · doi:10.12688/f1000research.11369.1 · Cited by 232
“…disclosure of identities aims usually at increasing accountability and minimizing bias, c.f. “referees should be more highly motivated to do a competent and fair review if they may have to defend their views to the authors and if they will be identified with the published papers” (Armstrong, 1982).”
BackgroundInfluential
Metadata
- Authors
- Armstrong, J. S.
- Venue
- Behavioral and Brain Sciences
- Publisher
- Cambridge University Press (CUP)
- Published
- 1982-06
- Volume
- 5
- Issue
- 2
- Pages
- 197-199
- ISSN
- 0140-525X (ISSN-L)
- 1469-1825
- OpenAlex
- W2150682664
- Cited by
- 152
- References
- 12
- FWCI
- 14.03
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Barriers to scientific contributions: The author's formula. https://app.cochat.ai/papers/10.1017/s0140525x00011201
- The paper
- Armstrong, J. S. (1982). Barriers to scientific contributions: The author's formula. Behavioral and Brain Sciences. https://doi.org/10.1017/s0140525x00011201
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.