The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
How Much Better Are the Most-Prestigious Journals? The Statistics of Academic Publication
Open accessAbstract
Articles in high-prestige journals receive more citations and more applause than articles in less-prestigious journals, but how much more do these articles contribute to knowledge? This article uses a statistical theory of review processes to draw inferences about differences value between articles in more-prestigious versus less-prestigious journals. This analysis indicates that there is much overlap in articles in different prestige strata. Indeed, theory implies that about half of the articles published are not among the best ones submitted to those journals, and some of the manuscripts that belong in the highest-value 20% have the misfortune to elicit rejections from as many as five journals. Some social science departments and business schools strongly emphasize publication in prestigious journals. Although one can draw inferences about an author’s average manuscript from the percentage in top-tier journals, the confidence limits for such inferences are wide. A focus on prestigious journals may benefit the most prestigious departments or schools but add randomness to the decisions of departments or schools that are not at the very top. Such a focus may also impede the development of knowledge when mediocre research receives the endorsement of high visibility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DiMaggio, P. J., & Powell, W. W. (1983) · American Sociological Review · doi:10.2307/2095101 · Cited by 38,435
DiMaggio, P. J., & Powell, W. W. (2004) · Advances in Strategic Management · doi:10.1016/s0742-3322(00)17011-1 · Cited by 25,802
The psychology of interpersonal relations.
Heider, F. (1958) · doi:10.1037/10628-000 · Cited by 13,457
The Psychology of Interpersonal Relations.
Newcomb, T., & Heider, F. (1958) · American Sociological Review · doi:10.2307/2089062 · Cited by 11,822
Peer-review practices of psychological journals: The fate of published articles, submitted again
Peters, D. P., & Ceci, S. J. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011183 · Cited by 1,079 · cited 2×
“Peters and Ceci (1982) conducted what may be the most discussed and controversial study of reviewing by journals.”
BackgroundPublication prejudices: An experimental study of confirmatory bias in the peer review system
Mahoney, M. J. (1977) · Cognitive Therapy and Research · doi:10.1007/bf01173636 · Cited by 1,013
The Slowdown of the Economics Publishing Process
Ellison, G. (2002) · Journal of Political Economy · doi:10.1086/341868 · Cited by 510
Cicchetti, D. V. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065675 · Cited by 496
Impact factors: use and abuse.
Amin, M., & Mabe, M. A. (2003) · PubMed · Cited by 491
The Philosophical Basis of Peer Review and the Suppression of Innovation
Horrobin, D. F. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100162024 · Cited by 436
How Are the Mighty Fallen: Rejected Classic Articles by Leading Economists
Gans, J. S., & Shepherd, G. B. (1994) · Journal of Economic Perspectives · doi:10.1257/jep.8.1.165 · Cited by 389
The Measurement of Intellectual Influence
Palacios-Huerta, I., & Volij, O. (2004) · Econometrica · doi:10.1111/j.1468-0262.2004.00519.x · Cited by 328
Publishing as Prostitution? – Choosing Between One's Own Ideas and Academic Success
Frey, B. S. (2003) · Public Choice · doi:10.1023/a:1024208701874 · Cited by 295
SERVING CONSTITUENCIES IN BUSINESS SCHOOLS: M.B.A. PROGRAM VERSUS RESEARCH PERFORMANCE.
Trieschmann, J. S., Dennis, A. R., Northcraft, G. B., & Nieme, A. W. (2000) · Academy of Management Journal · doi:10.2307/1556341 · Cited by 285
Peer review for journals: Evidence on quality control, fairness, and innovation
Armstrong, J. S. (1997) · Science and Engineering Ethics · doi:10.1007/s11948-997-0017-3 · Cited by 262
Gottfredson, S. D. (1978) · American Psychologist · doi:10.1037//0003-066x.33.10.920 · Cited by 257
Peer Review and the Social Construction of Knowledge in the Management Discipline
Bedeian, A. G. (2004) · Academy of Management Learning & Education · doi:10.5465/amle.2004.13500489 · Cited by 233
Paradigm Development and Particularism: Journal Publication in Three Scientific Disciplines
Pfeffer, J., Leong, A., & Strehl, K. (1977) · Social Forces · doi:10.1093/sf/55.4.938 · Cited by 197
Peer Review for Journals as it Stands Today—Part 1
CAMPANARIO, J. M. (1998) · Science Communication · doi:10.1177/1075547098019003002 · Cited by 195
Interrater agreement for journal manuscript reviews.
Whitehurst, G. J. (1984) · American Psychologist · doi:10.1037//0003-066x.39.1.22 · Cited by 189
Review Paper : Psychology of the Scientist: An Evaluative Review
Mahoney, M. J. (1979) · Social Studies of Science · doi:10.1177/030631277900900304 · Cited by 180
The Manuscript Review Process: The Proper Roles of Authors, Referees, and Editors
Bedeian, A. G. (2003) · Journal of Management Inquiry · doi:10.1177/1056492603258974 · Cited by 179
Turning Lemons into Lemonade: Where Is the Value in Peer Reviews?
Starbuck, W. H. (2003) · Journal of Management Inquiry · doi:10.1177/1056492603258972 · Cited by 175
Self-citationThe Noise in Natural Phenomena
Shlesinger, M. F. (2016) · American Scientist · Cited by 169
Scott, W. A. (1974) · American Psychologist · doi:10.1037/h0037631 · Cited by 166
Reliability of reviews for the American Psychologist: A biostatistical assessment of the data.
Cicchetti, D. V. (1980) · American Psychologist · doi:10.1037//0003-066x.35.3.300 · Cited by 160
Improving manuscript evaluation procedures.
Bowen, D. D., Perloff, R., & Jacoby, J. (1972) · American Psychologist · doi:10.1037/h0033849 · Cited by 159
Nylenna, M. (1994) · JAMA · doi:10.1001/jama.272.2.149 · Cited by 158
The reliability of reviews for the American Psychologist.
Scarr, S. W., & Weber, B. (1978) · American Psychologist · doi:10.1037/h0078544 · Cited by 150
Peer Review for Journals as it Stands Today—Part 2
CAMPANARIO, J. M. (1998) · Science Communication · doi:10.1177/1075547098019004002 · Cited by 132 · cited 2×
“Gossip about inconsistent reviews and biased reviewers pervades academe, and studies have documented various biases of reviewers (Armstrong 1997; Bedeian 2003; Campanario 1996, 1998b; Ellison 2002; Hargens 1990; Horrobin 1990; Mahoney et al. 1978; Nylenna et al. 1994).”
BackgroundMahoney, M. J., Kazdin, A. E., & Kenigsberg, M. (1978) · Cognitive Therapy and Research · doi:10.1007/bf01172515 · Cited by 125
Citation Patterns in the Journals of Statistics and Probability
Stigler, S. M. (1994) · Statistical Science · doi:10.1214/ss/1177010655 · Cited by 120
Hendrick, C. (1976) · Personality and Social Psychology Bulletin · doi:10.1177/014616727600300101 · Cited by 117
A study of criteria for journal manuscripts.
Wolff, W. M. (1970) · American Psychologist · doi:10.1037/h0029770 · Cited by 113
Have referees rejected some of the most-cited articles of all times?
Campanario, J. M. (1996) · Journal of the American Society for Information Science · Cited by 103
Variation in Journal Peer Review Systems
Hargens, L. L. (1990) · JAMA · doi:10.1001/jama.1990.03440100052008 · Cited by 92
Interjudgmental reliability of reviews for the Journal of Educational Psychology.
Marsh, H. W., & Ball, S. (1981) · Journal of Educational Psychology · doi:10.1037/0022-0663.73.6.872 · Cited by 89
Neglected considerations in the analysis of agreement among journal referees
Hargens, L. L., & Herting, J. R. (1990) · Scientometrics · doi:10.1007/bf02130467 · Cited by 82
Variation in journal peer review systems. Possible causes and consequences.
Hargens, L. L. (1990) · PubMed · Cited by 81
Hendrick, C. (1976) · Personality and Social Psychology Bulletin · doi:10.1177/014616727600200301 · Cited by 81
Publishing as Prostitution? Choosing between One's Own Ideas and Academic FailurePreprint
Frey, B. S. (2002) · SSRN Electronic Journal · doi:10.2139/ssrn.316699 · Cited by 77
Reliability, fairness, objectivity and other inappropriate goals in peer review
Bailar, J. C. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065705 · Cited by 56
A Note on Sadomasochism in the Review Process: I Hate When That Happens
Holbrook, M. B. (1986) · Journal of Marketing · doi:10.1177/002224298605000308 · Cited by 54
Cicchetti, D. V. (1985) · American Psychologist · doi:10.1037/0003-066x.40.5.563 · Cited by 43
Thoughts on the Making and Remaking of the Management Discipline
Bedeian, A. G. (1996) · Journal of Management Inquiry · doi:10.1177/105649269654003 · Cited by 33
Barriers to Creating KnowledgePreprint
Calhoun, M. A., & Starbuck, W. H. (2003) · SSRN Electronic Journal · Cited by 33
Self-citationCriminal Justice and (Reviewer) Behavior
Gottfredson, D. M., & Gottfredson, S. D. (1982) · Criminal Justice and Behavior · doi:10.1177/0093854882009003001 · Cited by 20
Confusion between reviewer reliability and wise editorial and funding decisions
Kiesler, C. A. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065869 · Cited by 16
Gottfredson, S. D., Garvey, W. D., & Goodnow, J. J. (1979) · Elsevier eBooks · doi:10.1016/b978-0-08-023344-4.50017-9 · Cited by 5
Cited by
When Knowledge Wins: Transcending the Sense and Nonsense of Academic Rankings
Adler, N. J., & Harzing, A.-W. (2009) · Academy of Management Learning & Education · doi:10.5465/amle.2009.37012181 · Cited by 853
Ways of constructing research questions: gap-spotting or problematization?
Sandberg, J., & Alvesson, M. (2011) · Organization · doi:10.1177/1350508410372151 · Cited by 781
Deep impact: unintended consequences of journal rank
Brembs, B., Button, K., & Munafò, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00291 · Cited by 441
Journal list fetishism and the perversion of scholarship: reactivity and the ABS list
Willmott, H. (2011) · Organization · doi:10.1177/1350508411403532 · Cited by 453
Wijen, F. (2014) · Academy of Management Review · doi:10.5465/amr.2012.0218 · Cited by 459
Metadata
- Authors
- Starbuck, W. H.
- Venue
- Organization Science
- Published
- 2005-04
- Volume
- 16
- Issue
- 2
- Pages
- 180-200
- ISSN
- 1047-7039 (ISSN-L)
- 1526-5455
- OpenAlex
- W2153706086
- Cited by
- 434
- References
- 49
- FWCI
- 25.44
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.