Is novel research worth doing? Evidence from peer review at 49 journals
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
There are long-standing concerns that peer review, which is foundational to scientific institutions like journals and funding agencies, favors conservative ideas over novel ones. We investigate the association between novelty and the acceptance of manuscripts submitted to a large sample of scientific journals. The data cover 20,538 manuscripts submitted between 2013 and 2018 to the journals Cell and Cell Reports and 6,785 manuscripts submitted in 2018 to 47 journals published by the Institute of Physics Publishing . Following previous work that found that a balance of novel and conventional ideas predicts citation impact, we measure the novelty and conventionality of manuscripts by the atypicality of combinations of journals in their reference lists, taking the 90th percentile most atypical combination as “novelty” and the 50th percentile as “conventionality.” We find that higher novelty is consistently associated with higher acceptance; submissions in the top novelty quintile are 6.5 percentage points more likely than bottom quintile ones to get accepted. Higher conventionality is also associated with acceptance (+16.3% top–bottom quintile difference). Disagreement among peer reviewers was not systematically related to submission novelty or conventionality, and editors select strongly for novelty even conditional on reviewers' recommendations (+7.0% top–bottom quintile difference). Manuscripts exhibiting higher novelty were more highly cited. Overall, the findings suggest that journal peer review favors novel research that is well situated in the existing literature, incentivizing exploration in science and challenging the view that peer review is inherently antinovelty.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Toward a new economics of science
Partha, D., & David, P. A. (1994) · Research Policy · doi:10.1016/0048-7333(94)01002-1 · Cited by 2,448
Lee, C. J., Sugimoto, C. R., Zhang, G., & Cronin, B. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22784 · Cited by 1,000
Visser, M., van Eck, N. J., & Waltman, L. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00112 · Cited by 865
Rescuing US biomedical research from its systemic flaws
Alberts, B., Kirschner, M. W., Tilghman, S., & Varmus, H. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1404402111 · Cited by 817
Reviewer bias in single- versus double-blind peer review
Tomkins, A., Zhang, M., & Heavlin, W. D. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1707323114 · Cited by 605
Manuscript Quality before and after Peer Review and Editing at Annals of Internal Medicine
Goodman, S. N., Berlin, J., Fletcher, S. W., & Fletcher, R. H. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-121-1-199407010-00003 · Cited by 324
Big names or big ideas: Do peer-review panels select the best science proposals?
Li, D., & Agha, L. (2015) · Science · doi:10.1126/science.aaa0185 · Cited by 227
Kravitz, R. L., Franks, P., Feldman, M. D., Gerrity, M., Byrne, C., & Tierney, W. M. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010072 · Cited by 178
What Do Editors Maximize? Evidence from Four Economics Journals
Card, D., & DellaVigna, S. (2020) · The Review of Economics and Statistics · doi:10.1162/rest_a_00839 · Cited by 123
Fresh teams are associated with original and multidisciplinary research
Zeng, A., Fan, Y., Di, Z., Wang, Y., & Havlin, S. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01084-x · Cited by 106
Peer review and competition in the Art Exhibition Game
Balietti, S., Goldstone, R. L., & Helbing, D. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1603723113 · Cited by 71
Novelty versus Replicability: Virtues and Vices in the Reward System of Science
Romero, F. (2017) · Philosophy of Science · doi:10.1086/694005 · Cited by 61
Cited by
Promotional language and the adoption of innovative ideas in science
Peng, H., Qiu, H. S., Fosse, H. B., & Uzzi, B. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2320066121 · Cited by 26
“…index that, based on the statistical referencing patterns of published work, quantifies the degree to which a grant combines past knowledge in ways that have been done in previously published work or in unfamiliar ways that have rarely been seen before in previously published work (14, 34–39).”
Self-citationThe gender gap in scholarly self-promotion on social media
Peng, H., Teplitskiy, M., Romero, D. M., & Horvát, E.-Á. (2025) · Nature Communications · doi:10.1038/s41467-025-60590-y · Cited by 17
“…– the Altmetric database of papers ’ online mentions and the Microsoft Academic Graph (MAG) database that contains metadata about papers and their authors such as publication venues, af fi liations, productivity metrics, and research fi elds 78 – 80 (See details in Methods and Supplementary Note A).”
Self-citationUse of Promotional Language in Grant Applications and Grant Success
Qiu, H. S., Peng, H., Fosse, H. B., Woodruff, T. K., & Uzzi, B. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.48696 · Cited by 5
Self-citationThe research we don’t need will persist until we dismantle the systems that sustain it
Schmidt, M., McDonald, J. K., & Moore, S. (2025) · Journal of Computing in Higher Education · doi:10.1007/s12528-025-09446-4 · Cited by 5
Metadata
- Authors
- Teplitskiy, M., Peng, H., Blasco, A., & Lakhani, K. R.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2022-11-17
- Volume
- 119
- Issue
- 47
- Pages
- e2118046119-e2118046119
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W4309264245
- Cited by
- 44
- References
- 12
- FWCI
- 4.41
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.