Cited by 151Memory Processes and InfluencesVisual perception and processing mechanismsNeural and Behavioral Psychology Studies

The Confidence Database

Open access
Rahnev, Dobromir, Desender, Kobe, Lee, Alan L. F., Adler, William T., Aguilar-Lleyda, David, Akdoğan, Başak, Arbuzova, Polina, Atlas, Lauren Y. +75 more·2020·Nature Human Behaviour

Abstract

Understanding how people rate their confidence is critical for the characterization of a wide range of perceptual, memory, motor and cognitive processes. To enable the continued exploration of these processes, we created a large database of confidence studies spanning a broad set of paradigms, participant populations and fields of study. The data from each study are structured in a common, easy-to-use format that can be easily imported and analysed using multiple software packages. Each dataset is accompanied by an explanation regarding the nature of the collected data. At the time of publication, the Confidence Database (which is available at https://osf.io/s46pr/) contained 145 datasets with data from more than 8,700 participants and almost 4 million trials. The database will remain open for new submissions indefinitely and is expected to continue to grow. Here we show the usefulness of this large collection of datasets in four different analyses that provide precise estimations of several foundational confidence-related effects.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41562-019-0813-1

Cites

44 of 44 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The development of the Confidence Database and the adoption of consensus goals in the field have accelerated efforts in the metaperception field.

    “These endeavors have been accelerated by the development of the Confidence Database and the adoption of consensus goals in the field (Rahnev et al. 2020(Rahnev et al. , 2022)).”

    From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Rahnev et al. 2020

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. [24]Nikolov S, Rahnev D & Lau H Probabilistic model of onset detection explains paradoxes in human time perception. Front. Psychol 1, 37 (2010). 21833206 PMC3153755

Cited by

Sorted by citations

Authors
Rahnev, D., Desender, K., Lee, A. L. F., Adler, W. T., Aguilar-Lleyda, D., Akdoğan, B., Arbuzova, P., Atlas, L. Y., Balcı, F., Bang, J. W., Bègue, I., Birney, D. P., Brady, T. F., Calder-Travis, J., Chetverikov, A., Clark, T. K., Davranche, K., Denison, R. N., Dildine, T. C., Double, K. S., Duyan, Y. A., Faivre, N., Fallow, K., Filevich, E., Gajdos, T., Gallagher, R. M., de Gardelle, V., Gherman, S., Haddara, N., Hainguerlot, M., Hsu, T.-Y., Hu, X., Iturrate, I., Jaquiery, M., Kantner, J., Koculak, M., Konishi, M., Koß, C., Kvam, P. D., Kwok, S. C., Lebreton, M., Lempert, K. M., Ming Lo, C., Luo, L., Maniscalco, B., Martin, A., Massoni, S., Matthews, J., Mazancieux, A., Merfeld, D. M., O’Hora, D., Palser, E. R., Paulewicz, B., Pereira, M., Peters, C., Philiastides, M. G., Pfuhl, G., Prieto, F., Rausch, M., Recht, S., Reyes, G., Rouault, M., Sackur, J., Sadeghi, S., Samaha, J., Seow, T. X. F., Shekhar, M., Sherman, M. T., Siedlecka, M., Skóra, Z., Song, C., Soto, D., Sun, S., van Boxtel, J. J. A., Wang, S., Weidemann, C. T., Weindel, G., Wierzchoń, M., Xu, X., Ye, Q., Yeon, J., Zou, F., & Zylberberg, A.
Affiliations
  • Georgia Institute of Technology (US)
  • Ghent University (BE)
  • Lingnan University (HK)
  • New York University (US)
  • Columbia University (US)
  • Humboldt-Universität zu Berlin (DE)
  • National Institutes of Health (US)
  • Koç University (TR)
  • NYU Langone Health (US)
  • University of Geneva (CH)
  • The University of Sydney (AU)
  • University of California San Diego (US)
  • University of Oxford (GB)
  • University of Colorado Boulder (US)
  • Centre National de la Recherche Scientifique (FR)
  • Laboratoire de Psychologie et NeuroCognition (FR)
  • University of Victoria (CA)
  • The University of Queensland (AU)
  • Feinstein Institute for Medical Research (US)
  • Erasmus University Rotterdam (NL)
  • Taipei Medical University (TW)
  • Beijing Normal University (CN)
  • California State University, Northridge (US)
  • Jagiellonian University (PL)
  • University of Florida (US)
  • New York University Shanghai (CN)
  • University of Pennsylvania (US)
  • University of California, Riverside (US)
  • Monash University (AU)
  • The Ohio State University (US)
  • Ollscoil na Gaillimhe – University of Galway (IE)
  • University of California, San Francisco (US)
  • Uniwersytet SWPS (PL)
  • École Polytechnique Fédérale de Lausanne (CH)
  • University of Glasgow (GB)
  • UiT The Arctic University of Norway (NO)
  • Universidad del Desarrollo (CL)
  • Catholic University of Eichstätt-Ingolstadt (DE)
  • Cornell University (US)
  • University of California, Santa Cruz (US)
  • Trinity College Dublin (IE)
  • Brighton and Sussex Medical School (GB)
  • Cardiff University (GB)
  • Ikerbasque (ES)
  • California Institute of Technology (US)
  • West Virginia University (US)
  • Swansea University (GB)
  • East China Normal University (CN)
  • University of Rochester (US)
Corresponding author
Rahnev, Dobromir
Venue
Nature Human Behaviour
Published
2020-02-03
Volume
4
Issue
3
Pages
317-325
ISSN
2397-3374 (ISSN-L)
OpenAlex
W3003585144
Cited by
151
References
44
Citations by year
2026: 19 · 2025: 20 · 2024: 20 · 2023: 25 · 2022: 30 · 2021: 24 · 2020: 12 · 2018: 1
FWCI
12.23
Type
journal article
Language
en
Open access
Locations
  • Nature Human Behaviour (publishedVersion, public-domain)
  • PubMed (publishedVersion)
  • EUR Research Repository (Erasmus University Rotterdam) (publishedVersion, other-oa)
  • VU Research Portal (publishedVersion)
  • ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion, cc-by-sa)
  • ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion, public-domain)
  • PubMed Central (acceptedVersion)
  • HAL (submittedVersion, public-domain)
  • Homo Politicus (Academy of Humanities and Economics in Lodz) (submittedVersion, cc-by-nc-nd)
  • EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
  • HAL (submittedVersion)
  • Communities in ADDI (Universidad del Pais Vasco) (submittedVersion, other-oa)
  • Communities in ADDI (University of the Basque Country) (submittedVersion, other-oa)
  • Ghent University Academic Bibliography (Ghent University) (submittedVersion)
  • Digital Collections portal (Koç University) (submittedVersion)
  • Publication Server of the Catholic University Eichstätt-Ingolstadt (Catholic University of Eichstätt-Ingolstadt) (submittedVersion)
  • eScholarship (California Digital Library) (submittedVersion)
  • Hispana (submittedVersion, other-oa)
  • Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
  • Lirias (KU Leuven) (submittedVersion, other-oa)
  • NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
  • TUbilio (Technical University of Darmstadt) (submittedVersion)
  • Data Archiving and Networked Services (DANS) (submittedVersion)
Funders
U.S. Department of Health & Human Services | NIH | National Institute of Mental Health (R56MH119189)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Keywords
confidence ratings, metacognition, metacognitive calibration, metacognitive sensitivity, perceptual confidence, memory confidence, cognitive confidence
MeSH terms
Metacognition, Adult, Choice Behavior, Humans, Mental Processes, Psychometrics, Reaction Time, Task Performance and Analysis, Databases, Factual, Datasets as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review