The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
The Confidence Database
Open accessAbstract
Understanding how people rate their confidence is critical for the characterization of a wide range of perceptual, memory, motor and cognitive processes. To enable the continued exploration of these processes, we created a large database of confidence studies spanning a broad set of paradigms, participant populations and fields of study. The data from each study are structured in a common, easy-to-use format that can be easily imported and analysed using multiple software packages. Each dataset is accompanied by an explanation regarding the nature of the collected data. At the time of publication, the Confidence Database (which is available at https://osf.io/s46pr/) contained 145 datasets with data from more than 8,700 participants and almost 4 million trials. The database will remain open for new submissions indefinitely and is expected to continue to grow. Here we show the usefulness of this large collection of datasets in four different analyses that provide precise estimations of several foundational confidence-related effects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“These endeavors have been accelerated by the development of the Confidence Database and the adoption of consensus goals in the field (Rahnev et al. 2020(Rahnev et al. , 2022)).”
From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Rahnev et al. 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
lmerTest Package: Tests in Linear Mixed Effects Models
Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017) · Journal of Statistical Software · doi:10.18637/jss.v082.i13 · Cited by 24,346
(1966) · Medical Entomology and Zoology · Cited by 10,293
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Evaluating Effect Size in Psychological Research: Sense and Nonsense
Funder, D. C., & Ozer, D. J. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919847202 · Cited by 3,295
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
(1994) · The MIT Press eBooks · doi:10.7551/mitpress/4561.001.0001 · Cited by 1,763
Data Sharing by Scientists: Practices and Perceptions
Tenopir, C., Allard, S., Douglass, K., Aydinoglu, A. U., Wu, L., Read, E., Manoff, M., & Frame, M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021101 · Cited by 1,432
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408
Raincloud plots: a multi-platform tool for robust data visualization
Allen, M., Poggiali, D., Whitaker, K. J., Marshall, T. R., & Kievit, R. (2019) · Wellcome Open Research · doi:10.12688/wellcomeopenres.15191.1 · Cited by 1,125
Serial dependence in visual perception
Fischer, J., & Whitney, D. C. (2014) · Nature Neuroscience · doi:10.1038/nn.3689 · Cited by 807
Research works printed but not linked: 1
- Nikolov, S., Rahnev, D. & Lau, H. Probabilistic model of onset detection explains paradoxes in human time perception. Front. Psychol. 1, 37 (2010).
Cited by
Sorted by citations
Items 101–151 of 151
Versprille, L. J. F. W., McKenzie, C., Amorim, F. E., Yano, K., Dalley, J. W., & Robbins, T. W. (2026) · Journal of Neuroscience · doi:10.1523/jneurosci.1696-25.2026 · Cited by 2
Rong, Y., & Peters, M. A. K. (2023) · Open Mind · doi:10.1162/opmi_a_00100 · Cited by 5
Advancing first-person access to experience through sense of certainty training
Göken, J., & Weger, U. (2023) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2023.101059 · Cited by 2
A THREE-LEVEL APPROACH TO UNDERSTAND CULTURAL VARIABILITY AND THE EVOLUTION OF HUMAN ATTENTION
Ueda, Y., Otsuka, S., & Saiki, J. (2021) · PSYCHOLOGIA · doi:10.2117/psysoc.2021-b015 · Cited by 2
Yeon, J., Shekhar, M., & Rahnev, D. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/439463 · Cited by 2
Self-citationYeon, J., Shekhar, M., & Rahnev, D. (2020) · doi:10.17605/osf.io/pn283 · Cited by 3
Self-citationOptimal confidence for unaware visuomotor deviationsPreprint
Pereira, M., Skiba, R. M., Cojan, Y., Vuilleumier, P. O., & Bègue, I. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.10.22.465492 · Cited by 2
Self-citationFeuerriegel, D., Murphy, M., Konski, A., Mepani, V., Sun, J., Hester, R., & Bode, S. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.11.22.469610 · Cited by 3
Post-Decision Gaze as a Behavioral Manifestation of Decision ConfidencePreprint
Stern, Y., Netzer, O., Goldsmith, M., Koren, D., Zvilichovsky, Y., Hertz, U., & Salomon, R. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.08.28.610145 · Cited by 3
Shirasuna, M., & Honda, H. (2023) · PLoS ONE · doi:10.1371/journal.pone.0280984 · Cited by 1
The Sense of Certainty and the Access to Inner Experience: A Qualitative Investigation
Göken, J., & Weger, U. (2024) · Journal of Humanistic Psychology · doi:10.1177/00221678241234779 · Cited by 1
Sun, W., Ripp, I., Borrmann, A., Moll, M., & Fairhurst, M. T. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e41330 · Cited by 1
statConfR: An R Package for Static Models of Decision Confidence and Metacognition
Rausch, M., Meyen, S., & Hellmann, S. (2025) · The Journal of Open Source Software · doi:10.21105/joss.06966 · Cited by 5
Self-citationDynamic modulation of confidence based on the metacognitive skills of collaborators
Hermans, F., Knogler, S., Corlazzoli, G., Friedemann, M., & Desender, K. (2025) · Cognition · doi:10.1016/j.cognition.2025.106151 · Cited by 2
Self-citationModeling meta-reasoning processes using diffusion and quantum random walk models
Malaiya, R. K., & Golden, R. M. (2025) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2025.102952 · Cited by 1
Correcting for unequal variance in signal detection models using response time
Miyoshi, K., Rahnev, D., & Lau, H. C. (2026) · iScience · doi:10.1016/j.isci.2026.114998 · Cited by 2
Self-citationMetacognition and metacognitive monitoring in aging
Pournaghdali, A., Cheng, G. L., Cosentino, S., & Eich, T. S. (2026) · Psychonomic Bulletin & Review · doi:10.3758/s13423-026-02968-7 · Cited by 1
Temporal error monitoring: Does agency matter?
Öztel, T., & Balcı, F. (2024) · Attention Perception & Psychophysics · doi:10.3758/s13414-024-02967-7 · Cited by 1
Self-citationOn the Dynamics of the Responses in Frydman and Jin (2022): Nullius in VerbaPreprint
Hertel, J., & Smith, J. B. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4496707 · Cited by 1
statConfR: An R Package for Static Models of Decision Confidence and MetacognitionPreprint
Rausch, M., & Hellmann, S. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/dk6mr · Cited by 1
Self-citationdynConfiR: The R package for sequential sampling models of decision confidencePreprint
Hellmann, S., Zehetleitner, M., & Rausch, M. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/e354s · Cited by 1
Self-citationLimited metacognitive access to one’s own facial expressionsPreprint
Ciston, A. B., Forster, C., Brick, T. R., Kühn, S., Verrel, J., & Filevich, E. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.03.08.434069
Self-citationJin, S., Verhaeghen, P., & Rahnev, D. (2021) · doi:10.31234/osf.io/mhbj9
Self-citationShirasuna, M., & Honda, H. (2022) · doi:10.31234/osf.io/fpw6m
Science of episodic memory: New insights in memory research
Ito, Y., Matsumoto, N., Kobayashi, M., Nishiyama, S., Miyoshi, K., Murayama, K., & Kawaguchi, J. (2022) · The Japanese Journal of Cognitive Psychology · doi:10.5265/jcogpsy.20.43
Reduced choice-confidence in negative numerals
Díaz, S. A., & Penagos-Londoño, G. I. (2022) · PLoS ONE · doi:10.1371/journal.pone.0272796
Redy, M. (2023) · International Journal of Social Science and Human Research · doi:10.47191/ijsshr/v6-i7-47
Sun, W., Ripp, I., Borrmann, A., Moll, M., & Fairhurst, M. T. (2023) · Research Square · doi:10.21203/rs.3.rs-3714585/v1
Sun, W., Ripp, I., Borrmann, A., Moll, M., & Fairhurst, M. T. (2024) · Research Square · doi:10.21203/rs.3.rs-3714585/v2
Fukuda, K., Kozlova, O., Gillies, G., Liesefeld, H. R., & Yamaguchi, M. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/jxh9v
Altered temporal awareness during Covid-19 pandemic
Runyun, Ş. L., van Wassenhove, V., & Balcı, F. (2024) · Psychological Research · doi:10.1007/s00426-024-02004-0
Self-citationAndraszewicz, S., Roberts, A. C., Wettstein, L., Popelka, D., & Hölscher, C. (2024) · doi:10.31219/osf.io/z8csh
Leaky evidence accumulation accounts for perceptual confidence and subjective durationPreprint
Msheik, R., Sirouet, E., Kelly, S. P., Faivre, N., & Pereira, M. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.03.17.643717 · Cited by 9
Self-citationReappraising Intuitions About ConsciousnessPreprint
Kim, C., & Chong, S. C. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5420626
Psychophysical dissection of temporal error monitoring
Öztel, T., & Balcı, F. (2025) · Cognitive Processing · doi:10.1007/s10339-025-01302-8
Self-citationLarge-scale experimental investigation of the reliability of confidence measures
Bouleau, C., Lebreton, M. P., & Jacquemet, N. (2025) · Communications Psychology · doi:10.1038/s44271-025-00330-6
Self-citationLakhlifi, C., Lejeune, F., Rouault, M., Khamassi, M., & Rohaut, B. (2024) · Figshare · doi:10.6084/m9.figshare.26583951
Self-citationScaltritti, M., Kamari, S., & Sulpizio, S. (2025) · Journal of Memory and Language · doi:10.1016/j.jml.2025.104728
Agrawal, A. (2025) · IEEE Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON) · doi:10.1109/iemcon67450.2025.11381252
Accumulated evidence as an additive performance measure based on confidence ratings
Meyen, S., Lin, L., Schrenk, C., & Franz, V. H. (2026) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2026.101249
A large-scale dataset of choice and response-time data in intertemporal choice
Pongratz, H., & Schoemann, M. (2026) · Scientific Data · doi:10.1038/s41597-026-06947-4
Reappraising intuitions about consciousness
Kim, C., & Chong, S. C. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1747924
dynConfiR: An R package for sequential sampling models of decision confidence
Hellmann, S., Zehetleitner, M., & Rausch, M. (2026) · Behavior Research Methods · doi:10.3758/s13428-026-03013-0
Self-citationA post-decision intervention gate in confidently committed high-ambiguity decisions.Preprint
McCallion, B. (2026) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.20628996
Metacognition and consciousness
Peters, M. A. K. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-29258-3.00052-5
Kurtev, S. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7166767
Dynamic Modulation of Confidence Based on the Metacognitive Skills of CollaboratorsPreprint
Corlazzoli, G., Knogler, S., Friedemann, M., Desender, K., & Hermans, F. (2026) · OSF Preprints (OSF Preprints)
Self-citationMudavath, U. K. N., Asadpour, A., Gherman, S., O’Connell, R. G., Kelly, S. P., Bickel, S., Ahamed, S. R., & Wong‐Lin, K. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.09.30.755781
Self-citationPerceptual decision-making: extending a standardized rodent task to humansPreprint
Hoxha, I., Johnson, P. A., Zang, F., Enwereuzor, C. U., & Urai, A. E. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.10.01.755923
The role of visual feedback in metacognitive judgments of motor performance
Brun, L., Porte, P., Cottin, M., Guinet, É., Chalabaev, A., Palluel, E., Faivre, N., & Souchay, C. (2026) · Consciousness and Cognition · doi:10.1016/j.concog.2026.104138
Self-citationPhysicians’ metacognition in medical decision-making
Lakhlifi, C., Kouzy, R., Lejeune, F., Beuzon, N., Mawet, J., Roos, C., Khamassi, M., Rohaut, B., & Rouault, M. (2026) · Neuroscience of Consciousness · doi:10.1093/nc/niag064
Self-citation
Metadata
- Authors
- Rahnev, D., Desender, K., Lee, A. L. F., Adler, W. T., Aguilar-Lleyda, D., Akdoğan, B., Arbuzova, P., Atlas, L. Y., Balcı, F., Bang, J. W., Bègue, I., Birney, D. P., Brady, T. F., Calder-Travis, J., Chetverikov, A., Clark, T. K., Davranche, K., Denison, R. N., Dildine, T. C., Double, K. S., Duyan, Y. A., Faivre, N., Fallow, K., Filevich, E., Gajdos, T., Gallagher, R. M., de Gardelle, V., Gherman, S., Haddara, N., Hainguerlot, M., Hsu, T.-Y., Hu, X., Iturrate, I., Jaquiery, M., Kantner, J., Koculak, M., Konishi, M., Koß, C., Kvam, P. D., Kwok, S. C., Lebreton, M., Lempert, K. M., Ming Lo, C., Luo, L., Maniscalco, B., Martin, A., Massoni, S., Matthews, J., Mazancieux, A., Merfeld, D. M., O’Hora, D., Palser, E. R., Paulewicz, B., Pereira, M., Peters, C., Philiastides, M. G., Pfuhl, G., Prieto, F., Rausch, M., Recht, S., Reyes, G., Rouault, M., Sackur, J., Sadeghi, S., Samaha, J., Seow, T. X. F., Shekhar, M., Sherman, M. T., Siedlecka, M., Skóra, Z., Song, C., Soto, D., Sun, S., van Boxtel, J. J. A., Wang, S., Weidemann, C. T., Weindel, G., Wierzchoń, M., Xu, X., Ye, Q., Yeon, J., Zou, F., & Zylberberg, A.
- Affiliations
- Georgia Institute of Technology (US)
- Ghent University (BE)
- Lingnan University (HK)
- New York University (US)
- Columbia University (US)
- Humboldt-Universität zu Berlin (DE)
- National Institutes of Health (US)
- Koç University (TR)
- NYU Langone Health (US)
- University of Geneva (CH)
- The University of Sydney (AU)
- University of California San Diego (US)
- University of Oxford (GB)
- University of Colorado Boulder (US)
- Centre National de la Recherche Scientifique (FR)
- Laboratoire de Psychologie et NeuroCognition (FR)
- University of Victoria (CA)
- The University of Queensland (AU)
- Feinstein Institute for Medical Research (US)
- Erasmus University Rotterdam (NL)
- Taipei Medical University (TW)
- Beijing Normal University (CN)
- California State University, Northridge (US)
- Jagiellonian University (PL)
- University of Florida (US)
- New York University Shanghai (CN)
- University of Pennsylvania (US)
- University of California, Riverside (US)
- Monash University (AU)
- The Ohio State University (US)
- Ollscoil na Gaillimhe – University of Galway (IE)
- University of California, San Francisco (US)
- Uniwersytet SWPS (PL)
- École Polytechnique Fédérale de Lausanne (CH)
- University of Glasgow (GB)
- UiT The Arctic University of Norway (NO)
- Universidad del Desarrollo (CL)
- Catholic University of Eichstätt-Ingolstadt (DE)
- Cornell University (US)
- University of California, Santa Cruz (US)
- Trinity College Dublin (IE)
- Brighton and Sussex Medical School (GB)
- Cardiff University (GB)
- Ikerbasque (ES)
- California Institute of Technology (US)
- University of Canberra (AU)
- West Virginia University (US)
- Swansea University (GB)
- East China Normal University (CN)
- University of Rochester (US)
- Corresponding author
- Rahnev, Dobromir
- ORCID
- Rahnev, Dobromir
- Desender, Kobe
- Lee, Alan L. F.
- Adler, William T.
- Aguilar-Lleyda, David
- Akdoğan, Başak
- Arbuzova, Polina
- Atlas, Lauren Y.
- Balcı, Fuat
- Bang, Ji Won
- Bègue, Indrit
- Birney, Damian P.
- Brady, Timothy F.
- Calder-Travis, Joshua
- Chetverikov, Andrey
- Clark, Torin K.
- Davranche, Karen
- Denison, Rachel N.
- Dildine, Troy C.
- Double, Kit S.
- Duyan, Yalçın A.
- Faivre, Nathan
- Fallow, Kaitlyn
- Filevich, Elisa
- Gajdos, Thibault
- Gallagher, Regan M.
- de Gardelle, Vincent
- Gherman, Sabina
- Haddara, Nadia
- Hsu, Tzu-Yu
- Hu, Xiao
- Iturrate, Iñaki
- Jaquiery, Matt
- Koculak, Marcin
- Konishi, Mahiko
- Koß, Christina
- Kvam, Peter D.
- Kwok, Sze Chai
- Lebreton, Maël
- Lempert, Karolina M.
- Ming Lo, Chien
- Luo, Liang
- Maniscalco, Brian
- Massoni, Sébastien
- Matthews, Julian
- Mazancieux, Audrey
- Merfeld, Daniel M.
- O’Hora, Denis
- Palser, Eleanor R.
- Paulewicz, Borysław
- Pereira, Michael
- Peters, Caroline
- Philiastides, Marios G.
- Pfuhl, Gerit
- Prieto, Fernanda
- Rausch, Manuel
- Recht, Samuel
- Reyes, Gabriel
- Rouault, Marion
- Sackur, Jérôme
- Sadeghi, Saeedeh
- Samaha, Jason
- Seow, Tricia X. F.
- Shekhar, Medha
- Sherman, Maxine T.
- Siedlecka, Marta
- Skóra, Zuzanna
- Song, Chen
- Soto, David
- Sun, Sai
- van Boxtel, Jeroen J. A.
- Wang, Shuo
- Weidemann, Christoph T.
- Weindel, Gabriel
- Wierzchoń, Michał
- Xu, Xinming
- Ye, Qun
- Yeon, Jiwon
- Zou, Futing
- Zylberberg, Ariel
- Venue
- Nature Human Behaviour
- Published
- 2020-02-03
- Volume
- 4
- Issue
- 3
- Pages
- 317-325
- ISSN
- 2397-3374 (ISSN-L)
- PMC
- PMC7565481
- OpenAlex
- W3003585144
- Cited by
- 151
- References
- 44
- Citations by year
- 2026: 19 · 2025: 20 · 2024: 20 · 2023: 25 · 2022: 30 · 2021: 24 · 2020: 12
- FWCI
- 12.23
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Nature Human Behaviour (publishedVersion, public-domain)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion, other-oa)
- VU Research Portal (publishedVersion)
- ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion, cc-by-sa)
- ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion, public-domain)
- PubMed Central (acceptedVersion)
- HAL (submittedVersion, public-domain)
- Homo Politicus (Academy of Humanities and Economics in Lodz) (submittedVersion, cc-by-nc-nd)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- HAL (submittedVersion)
- Communities in ADDI (Universidad del Pais Vasco) (submittedVersion, other-oa)
- Communities in ADDI (University of the Basque Country) (submittedVersion, other-oa)
- Ghent University Academic Bibliography (Ghent University) (submittedVersion)
- Digital Collections portal (Koç University) (submittedVersion)
- Publication Server of the Catholic University Eichstätt-Ingolstadt (Catholic University of Eichstätt-Ingolstadt) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Hispana (submittedVersion, other-oa)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Lirias (KU Leuven) (submittedVersion, other-oa)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- TUbilio (Technical University of Darmstadt) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- U.S. Department of Health & Human Services | NIH | National Institute of Mental Health (R56MH119189)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- confidence ratings, metacognition, metacognitive calibration, metacognitive sensitivity, perceptual confidence, memory confidence, cognitive confidence
- MeSH terms
- Metacognition, Adult, Choice Behavior, Humans, Mental Processes, Psychometrics, Reaction Time, Task Performance and Analysis, Databases, Factual, Datasets as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
