The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
The Confidence Database
Open accessAbstract
Understanding how people rate their confidence is critical for the characterization of a wide range of perceptual, memory, motor and cognitive processes. To enable the continued exploration of these processes, we created a large database of confidence studies spanning a broad set of paradigms, participant populations and fields of study. The data from each study are structured in a common, easy-to-use format that can be easily imported and analysed using multiple software packages. Each dataset is accompanied by an explanation regarding the nature of the collected data. At the time of publication, the Confidence Database (which is available at https://osf.io/s46pr/) contained 145 datasets with data from more than 8,700 participants and almost 4 million trials. The database will remain open for new submissions indefinitely and is expected to continue to grow. Here we show the usefulness of this large collection of datasets in four different analyses that provide precise estimations of several foundational confidence-related effects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“These endeavors have been accelerated by the development of the Confidence Database and the adoption of consensus goals in the field (Rahnev et al. 2020(Rahnev et al. , 2022)).”
From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Rahnev et al. 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
lmerTest Package: Tests in Linear Mixed Effects Models
Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017) · Journal of Statistical Software · doi:10.18637/jss.v082.i13 · Cited by 24,346
(1966) · Medical Entomology and Zoology · Cited by 10,293
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Evaluating Effect Size in Psychological Research: Sense and Nonsense
Funder, D. C., & Ozer, D. J. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919847202 · Cited by 3,295
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
(1994) · The MIT Press eBooks · doi:10.7551/mitpress/4561.001.0001 · Cited by 1,763
Data Sharing by Scientists: Practices and Perceptions
Tenopir, C., Allard, S., Douglass, K., Aydinoglu, A. U., Wu, L., Read, E., Manoff, M., & Frame, M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021101 · Cited by 1,432
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408
Raincloud plots: a multi-platform tool for robust data visualization
Allen, M., Poggiali, D., Whitaker, K. J., Marshall, T. R., & Kievit, R. (2019) · Wellcome Open Research · doi:10.12688/wellcomeopenres.15191.1 · Cited by 1,125
Serial dependence in visual perception
Fischer, J., & Whitney, D. C. (2014) · Nature Neuroscience · doi:10.1038/nn.3689 · Cited by 807
Two-stage dynamic signal detection: A theory of choice, decision time, and confidence.
Pleskac, T. J., & Busemeyer, J. R. (2010) · Psychological Review · doi:10.1037/a0019737 · Cited by 722
Nelson, L. D., Simmons, J., & Simonsohn, U. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011836 · Cited by 548
The poor availability of psychological research data for reanalysis.
Wicherts, J. M., Borsboom, D., Kats, J., & Molenaar, D. (2006) · American Psychologist · doi:10.1037/0003-066x.61.7.726 · Cited by 543
The Availability of Research Data Declines Rapidly with Article Age
Vines, T. H., Albert, A. Y. K., Andrew, R. L., Débarre, F., Bock, D. G., Franklin, M. T., Gilbert, K. J., Moore, J.-S., Renaut, S., & Rennison, D. J. (2014) · Current Biology · doi:10.1016/j.cub.2013.11.014 · Cited by 482
The Relationship Between Eyewitness Confidence and Identification Accuracy: A New Synthesis
Wixted, J. T., & Wells, G. L. (2017) · Psychological Science in the Public Interest · doi:10.1177/1529100616686966 · Cited by 467
Pupil-linked arousal is driven by decision uncertainty and alters serial choice bias
Urai, A. E., Braun, A., & Donner, T. H. (2017) · Nature Communications · doi:10.1038/ncomms14637 · Cited by 466
On small differences in sensation
Peirce, C. S., & Jastrow, J. (1884) · PhilPapers (PhilPapers Foundation) · Cited by 342
The citation advantage of linking publications to research data
Colavizza, G., Hrynaszkiewicz, I., Staden, I., Whitaker, K., & McGillivray, B. (2020) · PLOS ONE · doi:10.1371/journal.pone.0230416 · Cited by 335
Data Sharing in Psychology: A Survey on Barriers and Preconditions
Houtkoop, B. L., Chambers, C., Macleod, M. R., Bishop, D., Nichols, T. E., & Wagenmakers, E. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245917751886 · Cited by 320
An Introduction to the Dataverse Network as an Infrastructure for Data Sharing
King, G. (2007) · Sociological Methods & Research · doi:10.1177/0049124107306660 · Cited by 275
Morales, J., Lau, H., & Fleming, S. M. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.2360-17.2018 · Cited by 274
Recommendations for Increasing the Transparency of Analysis of Preexisting Data Sets
Weston, S. J., Ritchie, S. J., Rohrer, J. M., & Przybylski, A. K. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919848684 · Cited by 231
Failures of metacognition and lack of insight in neuropsychiatric disorders.
David, A. S., Bedford, N., Wiffen, B., & Gilleen, J. (2012) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2012.0002 · Cited by 227
Moran, R., Teodorescu, A. R., & Usher, M. (2015) · Cognitive Psychology · doi:10.1016/j.cogpsych.2015.01.002 · Cited by 201
Serial dependence in position occurs at the time of perception
Manassi, M., Liberman, A., Kosovicheva, A. A., Zhang, K., & Whitney, D. C. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-018-1454-5 · Cited by 187
Is blindsight like normal, near-threshold vision?
Azzopardi, P., & Cowey, A. (1997) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.94.25.14190 · Cited by 179
Preparing for Responsible Sharing of Clinical Trial Data
Mello, M. M., Francer, J. K., Wilenzick, M., Teden, P., Bierer, B. E., & Barnes, M. (2013) · New England Journal of Medicine · doi:10.1056/nejmhle1309073 · Cited by 175
Confidence Leak in Perceptual Decision Making
Rahnev, D., Koizumi, A., McCurdy, L. Y., D’Esposito, M., & Lau, H. C. (2015) · Psychological Science · doi:10.1177/0956797615595037 · Cited by 167
Self-citationAutocorrelation of choice-reaction times
Laming, D. (1979) · Acta Psychologica · doi:10.1016/0001-6918(79)90032-5 · Cited by 166
Mamassian, P. (2016) · Annual Review of Vision Science · doi:10.1146/annurev-vision-111815-114630 · Cited by 154
Assessment of the impact of shared brain imaging data on the scientific literature
Milham, M. P., Craddock, R. C., Son, J. J., Fleischmann, M., Clucas, J. C., Xu, H., Koo, B., Krishnakumar, A., Biswal, B. B., Castellanos, F. X., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-04976-1 · Cited by 147
Decision noise: An explanation for observed violations of signal detection theory
Mueller, S. T., & Weidemann, C. T. (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.3.465 · Cited by 136
Self-citationBehavioral, Modeling, and Electrophysiological Evidence for Supramodality in Human Metacognition
Faivre, N., Filevich, E., Solovey, G., Kühn, S., & Blanke, O. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0322-17.2017 · Cited by 129
Self-citationAssessing recognition memory using confidence ratings and response times
Weidemann, C. T., & Kahana, M. J. (2016) · Royal Society Open Science · doi:10.1098/rsos.150670 · Cited by 111
Self-citationProcess dissociation, single-process theories, and recognition memory.
Ratcliff, R., Zandt, T. V., & McKoon, G. (1995) · Journal of Experimental Psychology General · doi:10.1037//0096-3445.124.4.352 · Cited by 109
Martone, M. E., García, A., & VandenBos, G. R. (2018) · American Psychologist · doi:10.1037/amp0000242 · Cited by 94
Responsible practices for data sharing.
Alter, G. C., & Gonzalez, R. (2018) · American Psychologist · doi:10.1037/amp0000258 · Cited by 93
Hardwicke, T. E., & Ioannidis, J. P. A. (2018) · PLOS ONE · doi:10.1371/journal.pone.0201856 · Cited by 78
Learning and Recognition of a Non-conscious Sequence of Events in Human Primary Visual Cortex
Rosenthal, C. R., Andrews, S. K., Antoniades, C. A., Kennard, C., & Soto, D. (2016) · Current Biology · doi:10.1016/j.cub.2016.01.040 · Cited by 64
Self-citationTesting models of decision making using confidence ratings in classification.
Balakrishnan, J. D., & Ratcliff, R. (1996) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.22.3.615 · Cited by 63
Blind Insight : Metacognitive Discrimination Despite Chance Task Performance
Scott, R. B. Y., Dienes, Z. P., Barrett, A. B., Bor, D., & Seth, A. K. (2014) · Psychological Science · doi:10.1177/0956797614553944 · Cited by 56
Making Retrospective Confidence Judgments Improves Learners’ Ability to Decide What Not to Study
Robey, A., Dougherty, M. R. P., & Buttaccio, D. R. (2017) · Psychological Science · doi:10.1177/0956797617718800 · Cited by 33
A quantitative confidence signal detection model: 1. Fitting psychometric functions
Yi, Y., & Merfeld, D. M. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00318.2015 · Cited by 17
Self-citationProbabilistic model of onset detection explains previous puzzling findings in human time perception
Stanislav, S. (2010) · Frontiers in Psychology · doi:10.3389/fpsyg.2010.00037 · Cited by 4
Research works printed but not linked: 1
- Nikolov, S., Rahnev, D. & Lau, H. Probabilistic model of onset detection explains paradoxes in human time perception. Front. Psychol. 1, 37 (2010).
Cited by
Sorted by citations
Metacognition and Confidence: A Review and Synthesis
Fleming, S. M. (2024) · Annual Review of Psychology · doi:10.1146/annurev-psych-022423-032425 · Cited by 256
“These endeavours have been accelerated by the development of the Confidence Database and the adoption of consensus goals in the field (Rahnev et al., 2020, 2022).”
Spontaneous Brain Oscillations and Perceptual Decision-Making
Samaha, J., Iemi, L., Haegens, S., & Busch, N. A. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.05.004 · Cited by 209
Self-citationMækelæ, M. J., Reggev, N., Dutra, N. B., Tamayo, R. M., Silva-Sobrinho, R. A., Klevjer, K., & Pfuhl, G. (2020) · Royal Society Open Science · doi:10.1098/rsos.200644 · Cited by 147
Self-citationSources of Metacognitive Inefficiency
Shekhar, M., & Rahnev, D. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.10.007 · Cited by 125
Self-citationReliability of LLMs as medical assistants for the general public: a randomized preregistered study
Bean, A. M., Payne, R. E., Parsons, G., Kirk, H. R., Ciro, J., Mosquera-Gómez, R., Sara Hincapié, M., Ekanayaka, A. S., Tarassenko, L., Rocher, L., et al. (2026) · Nature Medicine · doi:10.1038/s41591-025-04074-y · Cited by 130
Metadata
- Authors
- Rahnev, D., Desender, K., Lee, A. L. F., Adler, W. T., Aguilar-Lleyda, D., Akdoğan, B., Arbuzova, P., Atlas, L. Y., Balcı, F., Bang, J. W., Bègue, I., Birney, D. P., Brady, T. F., Calder-Travis, J., Chetverikov, A., Clark, T. K., Davranche, K., Denison, R. N., Dildine, T. C., Double, K. S., Duyan, Y. A., Faivre, N., Fallow, K., Filevich, E., Gajdos, T., Gallagher, R. M., de Gardelle, V., Gherman, S., Haddara, N., Hainguerlot, M., Hsu, T.-Y., Hu, X., Iturrate, I., Jaquiery, M., Kantner, J., Koculak, M., Konishi, M., Koß, C., Kvam, P. D., Kwok, S. C., Lebreton, M., Lempert, K. M., Ming Lo, C., Luo, L., Maniscalco, B., Martin, A., Massoni, S., Matthews, J., Mazancieux, A., Merfeld, D. M., O’Hora, D., Palser, E. R., Paulewicz, B., Pereira, M., Peters, C., Philiastides, M. G., Pfuhl, G., Prieto, F., Rausch, M., Recht, S., Reyes, G., Rouault, M., Sackur, J., Sadeghi, S., Samaha, J., Seow, T. X. F., Shekhar, M., Sherman, M. T., Siedlecka, M., Skóra, Z., Song, C., Soto, D., Sun, S., van Boxtel, J. J. A., Wang, S., Weidemann, C. T., Weindel, G., Wierzchoń, M., Xu, X., Ye, Q., Yeon, J., Zou, F., & Zylberberg, A.
- Affiliations
- Georgia Institute of Technology (US)
- Ghent University (BE)
- Lingnan University (HK)
- New York University (US)
- Columbia University (US)
- Humboldt-Universität zu Berlin (DE)
- National Institutes of Health (US)
- Koç University (TR)
- NYU Langone Health (US)
- University of Geneva (CH)
- The University of Sydney (AU)
- University of California San Diego (US)
- University of Oxford (GB)
- University of Colorado Boulder (US)
- Centre National de la Recherche Scientifique (FR)
- Laboratoire de Psychologie et NeuroCognition (FR)
- University of Victoria (CA)
- The University of Queensland (AU)
- Feinstein Institute for Medical Research (US)
- Erasmus University Rotterdam (NL)
- Taipei Medical University (TW)
- Beijing Normal University (CN)
- California State University, Northridge (US)
- Jagiellonian University (PL)
- University of Florida (US)
- New York University Shanghai (CN)
- University of Pennsylvania (US)
- University of California, Riverside (US)
- Monash University (AU)
- The Ohio State University (US)
- Ollscoil na Gaillimhe – University of Galway (IE)
- University of California, San Francisco (US)
- Uniwersytet SWPS (PL)
- École Polytechnique Fédérale de Lausanne (CH)
- University of Glasgow (GB)
- UiT The Arctic University of Norway (NO)
- Universidad del Desarrollo (CL)
- Catholic University of Eichstätt-Ingolstadt (DE)
- Cornell University (US)
- University of California, Santa Cruz (US)
- Trinity College Dublin (IE)
- Brighton and Sussex Medical School (GB)
- Cardiff University (GB)
- Ikerbasque (ES)
- California Institute of Technology (US)
- University of Canberra (AU)
- West Virginia University (US)
- Swansea University (GB)
- East China Normal University (CN)
- University of Rochester (US)
- Corresponding author
- Rahnev, Dobromir
- ORCID
- Rahnev, Dobromir
- Desender, Kobe
- Lee, Alan L. F.
- Adler, William T.
- Aguilar-Lleyda, David
- Akdoğan, Başak
- Arbuzova, Polina
- Atlas, Lauren Y.
- Balcı, Fuat
- Bang, Ji Won
- Bègue, Indrit
- Birney, Damian P.
- Brady, Timothy F.
- Calder-Travis, Joshua
- Chetverikov, Andrey
- Clark, Torin K.
- Davranche, Karen
- Denison, Rachel N.
- Dildine, Troy C.
- Double, Kit S.
- Duyan, Yalçın A.
- Faivre, Nathan
- Fallow, Kaitlyn
- Filevich, Elisa
- Gajdos, Thibault
- Gallagher, Regan M.
- de Gardelle, Vincent
- Gherman, Sabina
- Haddara, Nadia
- Hsu, Tzu-Yu
- Hu, Xiao
- Iturrate, Iñaki
- Jaquiery, Matt
- Koculak, Marcin
- Konishi, Mahiko
- Koß, Christina
- Kvam, Peter D.
- Kwok, Sze Chai
- Lebreton, Maël
- Lempert, Karolina M.
- Ming Lo, Chien
- Luo, Liang
- Maniscalco, Brian
- Massoni, Sébastien
- Matthews, Julian
- Mazancieux, Audrey
- Merfeld, Daniel M.
- O’Hora, Denis
- Palser, Eleanor R.
- Paulewicz, Borysław
- Pereira, Michael
- Peters, Caroline
- Philiastides, Marios G.
- Pfuhl, Gerit
- Prieto, Fernanda
- Rausch, Manuel
- Recht, Samuel
- Reyes, Gabriel
- Rouault, Marion
- Sackur, Jérôme
- Sadeghi, Saeedeh
- Samaha, Jason
- Seow, Tricia X. F.
- Shekhar, Medha
- Sherman, Maxine T.
- Siedlecka, Marta
- Skóra, Zuzanna
- Song, Chen
- Soto, David
- Sun, Sai
- van Boxtel, Jeroen J. A.
- Wang, Shuo
- Weidemann, Christoph T.
- Weindel, Gabriel
- Wierzchoń, Michał
- Xu, Xinming
- Ye, Qun
- Yeon, Jiwon
- Zou, Futing
- Zylberberg, Ariel
- Venue
- Nature Human Behaviour
- Published
- 2020-02-03
- Volume
- 4
- Issue
- 3
- Pages
- 317-325
- ISSN
- 2397-3374 (ISSN-L)
- PMC
- PMC7565481
- OpenAlex
- W3003585144
- Cited by
- 151
- References
- 44
- Citations by year
- 2026: 19 · 2025: 20 · 2024: 20 · 2023: 25 · 2022: 30 · 2021: 24 · 2020: 12
- FWCI
- 12.23
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Nature Human Behaviour (publishedVersion, public-domain)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion, other-oa)
- VU Research Portal (publishedVersion)
- ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion, cc-by-sa)
- ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion, public-domain)
- PubMed Central (acceptedVersion)
- HAL (submittedVersion, public-domain)
- Homo Politicus (Academy of Humanities and Economics in Lodz) (submittedVersion, cc-by-nc-nd)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- HAL (submittedVersion)
- Communities in ADDI (Universidad del Pais Vasco) (submittedVersion, other-oa)
- Communities in ADDI (University of the Basque Country) (submittedVersion, other-oa)
- Ghent University Academic Bibliography (Ghent University) (submittedVersion)
- Digital Collections portal (Koç University) (submittedVersion)
- Publication Server of the Catholic University Eichstätt-Ingolstadt (Catholic University of Eichstätt-Ingolstadt) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Hispana (submittedVersion, other-oa)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Lirias (KU Leuven) (submittedVersion, other-oa)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- TUbilio (Technical University of Darmstadt) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- U.S. Department of Health & Human Services | NIH | National Institute of Mental Health (R56MH119189)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- confidence ratings, metacognition, metacognitive calibration, metacognitive sensitivity, perceptual confidence, memory confidence, cognitive confidence
- MeSH terms
- Metacognition, Adult, Choice Behavior, Humans, Mental Processes, Psychometrics, Reaction Time, Task Performance and Analysis, Databases, Factual, Datasets as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
