The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Aspiring to greater intellectual humility in science
Open accessAbstract
The replication crisis in the social, behavioural and life sciences has spurred a reform movement aimed at increasing the credibility of scientific studies. Many of these credibility-enhancing reforms focus, appropriately, on specific research and publication practices. A less often mentioned aspect of credibility is the need for intellectual humility or being transparent about and owning the limitations of our work. Although intellectual humility is presented as a widely accepted scientific norm, we argue that current research practice does not incentivize intellectual humility. We provide a set of recommendations on how to increase intellectual humility in research articles and highlight the central role peer reviewers can play in incentivizing authors to foreground the flaws and uncertainty in their work, thus enabling full and transparent evaluation of the validity of research. Although intellectual humility is a prerequisite for credible science, it is rarely practised. Hoekstra and Vazire make recommendations on how to increase intellectual humility in research articles and highlight the crucial role of peer reviewers in promoting intellectually humble manuscripts.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because of uncertainty around individual scientific findings, communication of scientific insights to policy makers, journalists and the public requires scientists to be intellectually humble 15 .”
From Predictors and consequences of intellectual humility (2022) · cites this paper as [15]
In the citing paper
“Although intellectual humility is fundamental for science, scientists often shy away from reporting complex data patterns, preferring (often unrealistically) clear, 'groundbreaking' results 15 .”
From Predictors and consequences of intellectual humility (2022) · cites this paper as [15]
In the citing paper
“The small increase in uncertainty for female reviewers may be a positive attribute, as it may show greater humility and a more considered recommendation [54].”
From Examining uncertainty in journal peer reviewers’ recommendations: a cross-sectional study (2024) · cites this paper as [54]
In the citing paper
“An open and transparent communication of uncertainty around scientific findings is a highly recommended research practice (1–4).”
From Expressions of uncertainty in online science communication hinder information diffusion (2024) · cites this paper as [2]
Citations
Cites
Moving to a World Beyond “ p < 0.05”
Wasserstein, R. L., Schirm, A. L., & Lazar, N. A. (2019) · The American Statistician · doi:10.1080/00031305.2019.1583913 · Cited by 2,976
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
Self-citationIncreasing Transparency Through a Multiverse Analysis
Steegen, S., Tuerlinckx, F., Gelman, A., & Vanpaemel, W. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616658637 · Cited by 1,372
An Agenda for Purely Confirmatory Research
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463078 · Cited by 1,042
Constraints on Generality (COG): A Proposed Addition to All Empirical Papers
Simons, D. J., Shoda, Y., & Lindsay, D. S. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617708630 · Cited by 986
Measurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them
Flake, J. K., & Fried, E. I. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920952393 · Cited by 969
Yarkoni, T. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x20001685 · Cited by 701
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2012) · doi:10.2139/ssrn.2160588 · Cited by 680
Intellectual Humility: Owning Our Limitations
Whitcomb, D., Battaly, H., Baehr, J., & Howard‐Snyder, D. (2017) · Philosophy and Phenomenological Research · doi:10.1111/phpr.12228 · Cited by 610
Registered Reports: A new publishing initiative at Cortex
Chambers, C. D. (2013) · Cortex · doi:10.1016/j.cortex.2012.12.016 · Cited by 570
Research works printed but not linked: 1
- Merton, R. K. Science and technology in a democratic order. J. Leg. Pol. Soc. 1, 115–126 (1942).
Cited by
Predictors and consequences of intellectual humility
Porter, T., Elnakouri, A., Meyers, E. A., Shibayama, T., Jayawickreme, E., & Grossmann, I. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00081-9 · Cited by 248
A manifesto for a globally diverse, equitable, and inclusive open science
Ghai, S., Thériault, R., Forscher, P., Shoda, Y., Syed, M., Puthillam, A., Peng, H. C., Basnight-Brown, D., Majid, A., Azevedo, F., et al. (2025) · Communications Psychology · doi:10.1038/s44271-024-00179-1 · Cited by 32
Expressions of uncertainty in online science communication hinder information diffusion
Stavrova, O., Kleinberg, B., Evans, A. M., & Ivanović, M. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae439 · Cited by 9
Stavrova, O., Kleinberg, B., Evans, A. M., & Ivanović, M. (2025) · Communications Psychology · doi:10.1038/s44271-025-00293-8 · Cited by 8
“Similarly, open science advocates and policy analysis researchers have repeatedly highlighted the importanceofacknowledgingtheuncertaintiesandlimitationsofpublished research fi ndings 67 – 69 – practices rather incompatible with hyping.”
Examining uncertainty in journal peer reviewers’ recommendations: a cross-sectional study
Barnett, A., Allen, L., Aldcroft, A., Lash, T. L., & McCreanor, V. (2024) · Royal Society Open Science · doi:10.1098/rsos.240612 · Cited by 10
“The small increase in uncertainty for female reviewers may be a positive attribute, as it may show greater humility and a more considered recommendation [54].”
Background
Metadata
- Authors
- Hoekstra, R., & Vazire, S.
- Affiliations
- University of Groningen (NL)
- The University of Melbourne (AU)
- Corresponding author
- Hoekstra, Rink
- Venue
- Nature Human Behaviour
- Published
- 2021-10-28
- Volume
- 5
- Issue
- 12
- Pages
- 1602-1607
- ISSN
- 2397-3374 (ISSN-L)
- OpenAlex
- W3208724384
- Cited by
- 117
- References
- 36
- Citations by year
- 2026: 16 · 2025: 25 · 2024: 31 · 2023: 29 · 2022: 14 · 2021: 2
- FWCI
- 3.59
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- other-oa
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature Human Behaviour (publishedVersion, other-oa)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, other-oa)
- Funders
- John Templeton Foundation (60937)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- intellectual humility, replication crisis, research credibility, peer review, research transparency, scientific uncertainty, scientific norms
- MeSH terms
- Humans, Research, Science
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Aspiring to greater intellectual humility in science. https://app.cochat.ai/papers/10.1038/s41562-021-01203-8
- The paper
- Hoekstra, R., & Vazire, S. (2021). Aspiring to greater intellectual humility in science. Nature Human Behaviour. https://doi.org/10.1038/s41562-021-01203-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.