The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
The Confidence Database
Open accessAbstract
Understanding how people rate their confidence is critical for the characterization of a wide range of perceptual, memory, motor and cognitive processes. To enable the continued exploration of these processes, we created a large database of confidence studies spanning a broad set of paradigms, participant populations and fields of study. The data from each study are structured in a common, easy-to-use format that can be easily imported and analysed using multiple software packages. Each dataset is accompanied by an explanation regarding the nature of the collected data. At the time of publication, the Confidence Database (which is available at https://osf.io/s46pr/) contained 145 datasets with data from more than 8,700 participants and almost 4 million trials. The database will remain open for new submissions indefinitely and is expected to continue to grow. Here we show the usefulness of this large collection of datasets in four different analyses that provide precise estimations of several foundational confidence-related effects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“These endeavors have been accelerated by the development of the Confidence Database and the adoption of consensus goals in the field (Rahnev et al. 2020(Rahnev et al. , 2022)).”
From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Rahnev et al. 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
lmerTest Package: Tests in Linear Mixed Effects Models
Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017) · Journal of Statistical Software · doi:10.18637/jss.v082.i13 · Cited by 24,346
(1966) · Medical Entomology and Zoology · Cited by 10,293
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Evaluating Effect Size in Psychological Research: Sense and Nonsense
Funder, D. C., & Ozer, D. J. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919847202 · Cited by 3,295
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
(1994) · The MIT Press eBooks · doi:10.7551/mitpress/4561.001.0001 · Cited by 1,763
Data Sharing by Scientists: Practices and Perceptions
Tenopir, C., Allard, S., Douglass, K., Aydinoglu, A. U., Wu, L., Read, E., Manoff, M., & Frame, M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021101 · Cited by 1,432
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408
Raincloud plots: a multi-platform tool for robust data visualization
Allen, M., Poggiali, D., Whitaker, K. J., Marshall, T. R., & Kievit, R. (2019) · Wellcome Open Research · doi:10.12688/wellcomeopenres.15191.1 · Cited by 1,125
Serial dependence in visual perception
Fischer, J., & Whitney, D. C. (2014) · Nature Neuroscience · doi:10.1038/nn.3689 · Cited by 807
Research works printed but not linked: 1
- Nikolov, S., Rahnev, D. & Lau, H. Probabilistic model of onset detection explains paradoxes in human time perception. Front. Psychol. 1, 37 (2010).
Cited by
Sorted by citations
Metacognition and Confidence: A Review and Synthesis
Fleming, S. M. (2024) · Annual Review of Psychology · doi:10.1146/annurev-psych-022423-032425 · Cited by 256
“These endeavours have been accelerated by the development of the Confidence Database and the adoption of consensus goals in the field (Rahnev et al., 2020, 2022).”
Spontaneous Brain Oscillations and Perceptual Decision-Making
Samaha, J., Iemi, L., Haegens, S., & Busch, N. A. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.05.004 · Cited by 209
Self-citationMækelæ, M. J., Reggev, N., Dutra, N. B., Tamayo, R. M., Silva-Sobrinho, R. A., Klevjer, K., & Pfuhl, G. (2020) · Royal Society Open Science · doi:10.1098/rsos.200644 · Cited by 147
Self-citationSources of Metacognitive Inefficiency
Shekhar, M., & Rahnev, D. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.10.007 · Cited by 125
Self-citationReliability of LLMs as medical assistants for the general public: a randomized preregistered study
Bean, A. M., Payne, R. E., Parsons, G., Kirk, H. R., Ciro, J., Mosquera-Gómez, R., Sara Hincapié, M., Ekanayaka, A. S., Tarassenko, L., Rocher, L., et al. (2026) · Nature Medicine · doi:10.1038/s41591-025-04074-y · Cited by 130
Metadata
- Authors
- Rahnev, D., Desender, K., Lee, A. L. F., Adler, W. T., Aguilar-Lleyda, D., Akdoğan, B., Arbuzova, P., Atlas, L. Y., Balcı, F., Bang, J. W., Bègue, I., Birney, D. P., Brady, T. F., Calder-Travis, J., Chetverikov, A., Clark, T. K., Davranche, K., Denison, R. N., Dildine, T. C., Double, K. S., Duyan, Y. A., Faivre, N., Fallow, K., Filevich, E., Gajdos, T., Gallagher, R. M., de Gardelle, V., Gherman, S., Haddara, N., Hainguerlot, M., Hsu, T.-Y., Hu, X., Iturrate, I., Jaquiery, M., Kantner, J., Koculak, M., Konishi, M., Koß, C., Kvam, P. D., Kwok, S. C., Lebreton, M., Lempert, K. M., Ming Lo, C., Luo, L., Maniscalco, B., Martin, A., Massoni, S., Matthews, J., Mazancieux, A., Merfeld, D. M., O’Hora, D., Palser, E. R., Paulewicz, B., Pereira, M., Peters, C., Philiastides, M. G., Pfuhl, G., Prieto, F., Rausch, M., Recht, S., Reyes, G., Rouault, M., Sackur, J., Sadeghi, S., Samaha, J., Seow, T. X. F., Shekhar, M., Sherman, M. T., Siedlecka, M., Skóra, Z., Song, C., Soto, D., Sun, S., van Boxtel, J. J. A., Wang, S., Weidemann, C. T., Weindel, G., Wierzchoń, M., Xu, X., Ye, Q., Yeon, J., Zou, F., & Zylberberg, A.
- Affiliations
- Georgia Institute of Technology (US)
- Ghent University (BE)
- Lingnan University (HK)
- New York University (US)
- Columbia University (US)
- Humboldt-Universität zu Berlin (DE)
- National Institutes of Health (US)
- Koç University (TR)
- NYU Langone Health (US)
- University of Geneva (CH)
- The University of Sydney (AU)
- University of California San Diego (US)
- University of Oxford (GB)
- University of Colorado Boulder (US)
- Centre National de la Recherche Scientifique (FR)
- Laboratoire de Psychologie et NeuroCognition (FR)
- University of Victoria (CA)
- The University of Queensland (AU)
- Feinstein Institute for Medical Research (US)
- Erasmus University Rotterdam (NL)
- Taipei Medical University (TW)
- Beijing Normal University (CN)
- California State University, Northridge (US)
- Jagiellonian University (PL)
- University of Florida (US)
- New York University Shanghai (CN)
- University of Pennsylvania (US)
- University of California, Riverside (US)
- Monash University (AU)
- The Ohio State University (US)
- Ollscoil na Gaillimhe – University of Galway (IE)
- University of California, San Francisco (US)
- Uniwersytet SWPS (PL)
- École Polytechnique Fédérale de Lausanne (CH)
- University of Glasgow (GB)
- UiT The Arctic University of Norway (NO)
- Universidad del Desarrollo (CL)
- Catholic University of Eichstätt-Ingolstadt (DE)
- Cornell University (US)
- University of California, Santa Cruz (US)
- Trinity College Dublin (IE)
- Brighton and Sussex Medical School (GB)
- Cardiff University (GB)
- Ikerbasque (ES)
- California Institute of Technology (US)
- University of Canberra (AU)
- West Virginia University (US)
- Swansea University (GB)
- East China Normal University (CN)
- University of Rochester (US)
- Corresponding author
- Rahnev, Dobromir
- ORCID
- Rahnev, Dobromir
- Desender, Kobe
- Lee, Alan L. F.
- Adler, William T.
- Aguilar-Lleyda, David
- Akdoğan, Başak
- Arbuzova, Polina
- Atlas, Lauren Y.
- Balcı, Fuat
- Bang, Ji Won
- Bègue, Indrit
- Birney, Damian P.
- Brady, Timothy F.
- Calder-Travis, Joshua
- Chetverikov, Andrey
- Clark, Torin K.
- Davranche, Karen
- Denison, Rachel N.
- Dildine, Troy C.
- Double, Kit S.
- Duyan, Yalçın A.
- Faivre, Nathan
- Fallow, Kaitlyn
- Filevich, Elisa
- Gajdos, Thibault
- Gallagher, Regan M.
- de Gardelle, Vincent
- Gherman, Sabina
- Haddara, Nadia
- Hsu, Tzu-Yu
- Hu, Xiao
- Iturrate, Iñaki
- Jaquiery, Matt
- Koculak, Marcin
- Konishi, Mahiko
- Koß, Christina
- Kvam, Peter D.
- Kwok, Sze Chai
- Lebreton, Maël
- Lempert, Karolina M.
- Ming Lo, Chien
- Luo, Liang
- Maniscalco, Brian
- Massoni, Sébastien
- Matthews, Julian
- Mazancieux, Audrey
- Merfeld, Daniel M.
- O’Hora, Denis
- Palser, Eleanor R.
- Paulewicz, Borysław
- Pereira, Michael
- Peters, Caroline
- Philiastides, Marios G.
- Pfuhl, Gerit
- Prieto, Fernanda
- Rausch, Manuel
- Recht, Samuel
- Reyes, Gabriel
- Rouault, Marion
- Sackur, Jérôme
- Sadeghi, Saeedeh
- Samaha, Jason
- Seow, Tricia X. F.
- Shekhar, Medha
- Sherman, Maxine T.
- Siedlecka, Marta
- Skóra, Zuzanna
- Song, Chen
- Soto, David
- Sun, Sai
- van Boxtel, Jeroen J. A.
- Wang, Shuo
- Weidemann, Christoph T.
- Weindel, Gabriel
- Wierzchoń, Michał
- Xu, Xinming
- Ye, Qun
- Yeon, Jiwon
- Zou, Futing
- Zylberberg, Ariel
- Venue
- Nature Human Behaviour
- Published
- 2020-02-03
- Volume
- 4
- Issue
- 3
- Pages
- 317-325
- ISSN
- 2397-3374 (ISSN-L)
- PMC
- PMC7565481
- OpenAlex
- W3003585144
- Cited by
- 151
- References
- 44
- Citations by year
- 2026: 19 · 2025: 20 · 2024: 20 · 2023: 25 · 2022: 30 · 2021: 24 · 2020: 12
- FWCI
- 12.23
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Nature Human Behaviour (publishedVersion, public-domain)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion, other-oa)
- VU Research Portal (publishedVersion)
- ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion, cc-by-sa)
- ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion, public-domain)
- PubMed Central (acceptedVersion)
- HAL (submittedVersion, public-domain)
- Homo Politicus (Academy of Humanities and Economics in Lodz) (submittedVersion, cc-by-nc-nd)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- HAL (submittedVersion)
- Communities in ADDI (Universidad del Pais Vasco) (submittedVersion, other-oa)
- Communities in ADDI (University of the Basque Country) (submittedVersion, other-oa)
- Ghent University Academic Bibliography (Ghent University) (submittedVersion)
- Digital Collections portal (Koç University) (submittedVersion)
- Publication Server of the Catholic University Eichstätt-Ingolstadt (Catholic University of Eichstätt-Ingolstadt) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Hispana (submittedVersion, other-oa)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Lirias (KU Leuven) (submittedVersion, other-oa)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- TUbilio (Technical University of Darmstadt) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- U.S. Department of Health & Human Services | NIH | National Institute of Mental Health (R56MH119189)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- confidence ratings, metacognition, metacognitive calibration, metacognitive sensitivity, perceptual confidence, memory confidence, cognitive confidence
- MeSH terms
- Metacognition, Adult, Choice Behavior, Humans, Mental Processes, Psychometrics, Reaction Time, Task Performance and Analysis, Databases, Factual, Datasets as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
