Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index; 4 of the 68 sources its claims cite were checked for support.

Psychiatric Symptom Dimensions Are Associated With Dissociable Shifts in Metacognition but Not Task Performance

Open access

Abstract

BACKGROUND: Distortions in metacognition-the ability to reflect on and control other cognitive processes-are thought to be characteristic of poor mental health. However, it remains unknown whether such shifts in self-evaluation are due to specific alterations in metacognition and/or a downstream consequence of changes in decision-making processes. METHODS: Using perceptual decision making as a model system, we employed a computational psychiatry approach to relate parameters governing both decision formation and metacognitive evaluation to self-reported transdiagnostic symptom dimensions in a large general population sample (N = 995). RESULTS: Variability in psychopathology was unrelated to either speed or accuracy of decision formation. In contrast, leveraging a dimensional approach, we revealed independent relationships between psychopathology and metacognition: a symptom dimension related to anxiety and depression was associated with lower confidence and heightened metacognitive efficiency, whereas a dimension characterizing compulsive behavior and intrusive thoughts was associated with higher confidence and lower metacognitive efficiency. Furthermore, we obtained a robust double dissociation-whereas psychiatric symptoms predicted changes in metacognition but not decision performance, age predicted changes in decision performance but not metacognition. CONCLUSIONS: Our findings indicate a specific and pervasive link between metacognition and mental health. Our study bridges a gap between an emerging neuroscience of decision making and an understanding of metacognitive alterations in psychopathology.

Overview

CoChat Summary

TL;DR

In two large online perceptual decision-making experiments (total N = 995), self-reported psychiatric symptom dimensions were associated with dissociable shifts in confidence and metacognitive efficiency but not with decision speed or accuracy. An anxious-depression dimension related to lower confidence and higher metacognitive efficiency, whereas a compulsive behavior/intrusive thought dimension related to higher confidence and lower metacognitive efficiency.

Key findings

  • Psychiatric symptoms were unrelated to decision formation: in experiment 1, symptoms were not associated with decision accuracy or drift-diffusion model parameters; experiment 2 replicated no association between psychiatric factors and accuracy/decision formation parameters.
  • In experiment 2, the anxious-depression (AD) factor was associated with lower confidence level (β = −.20, p < .001) and higher metacognitive efficiency (β = .11, p_uncorrected = .04), while the compulsive behavior and intrusive thought (CIT) factor was associated with higher confidence level (β = .23, p < .001) and lower metacognitive efficiency (β = −.12, p_uncorrected = .02); the metacognitive efficiency findings did not survive correction for multiple comparisons.
  • In experiment 1, depression, social anxiety, and generalized anxiety were associated with lower confidence (all β < −.12, all p < .05), whereas impulsivity, OCD, and schizotypy showed no association with confidence (all p > .05).
  • A double dissociation was observed: psychiatric symptoms predicted changes in metacognition but not decision performance, whereas age predicted changes in decision performance but not metacognition; older age was associated with slower, less accurate decisions, and neither age nor IQ was related to confidence.

Methods

  • Data were collected online via Amazon’s Mechanical Turk in two experiments (experiment 1: 663 participants; experiment 2: 637 participants); after exclusions, 498 participants remained in experiment 1 and 497 in experiment 2 (total N = 995).
  • Participants performed a perceptual decision-making task judging which of two boxes contained more dots and rated confidence on each judgment; across both experiments there were 210 trials in five blocks, and experiment 2 added a calibration/staircase procedure to equate performance and allow computation of metacognitive efficiency (meta-d′/d′).
  • Self-report questionnaires assessed depression, generalized anxiety, schizotypy, impulsivity, OCD, social anxiety, and IQ; experiment 2 added eating disorders, apathy, and alcoholism questionnaires. Experiment 2 used factor analysis on 209 items across nine questionnaires, identifying three factors (AD, CIT, social withdrawal), and analyses used drift-diffusion modeling, signal detection theory, linear regressions controlling for age, IQ, and gender, and Bayesian information criterion model comparison.

Limitations

  • The paper states that no structured clinical interviews were used and no information about psychiatric diagnosis or medication was recorded; the sample was a general population sample with continuous self-reported symptoms, limiting inferences about patients with psychiatric diagnoses.
  • The paper states that the metacognitive efficiency findings did not survive correction for multiple comparisons and should be interpreted with caution, and that the factor analysis sample (n = 497) had a relatively low subject-to-variable ratio, though the solution was compared with prior results from Gillan et al. (N = 1413).
  • The paper states that perceptual decision making was used as a model system and it remains to be explored how findings extend to other decision types or cognitive domains; evident from the design, the study is cross-sectional and correlational, so it cannot establish causal direction.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1016/j.biopsych.2017.12.017

Cites

71 of 71 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Decision-making task and behavior in experiment 1. (A) Perceptual decision-making task. Subjects were asked to judge which box contained the higher number of dots and to provide a confidence rating in each decision. Choice and confidence responses were unspeeded. (B, C) Behavioral data and drift-diffusion model fits. As difference in dots became greater, accuracy increased (B), and response times decreased (C). These features of the data were well captured by the drift-diffusion model. Error bars reflect SEM. (D) Average confidence rating distributions for correct and incorrect trials. Subjects gave higher confidence ratings for correct (green) than incorrect (red) trials. Shaded areas denote SEM; vertical lines denote the average confidence level for each response class. (E, F) Distributions of mean choice accuracy (E) and confidence level (F) across subjects (n = 498).
Figure 1 Decision-making task and behavior in experiment 1. (A) Perceptual decision-making task. Subjects were asked to judge which box contained the higher number of dots and to provide a confidence rating in each decision. Choice and confidence responses were unspeeded. (B, C) Behavioral data and drift-diffusion model fits. As difference in dots became greater, accuracy increased (B), and response times decreased (C). These features of the data were well captured by the drift-diffusion model. Error bars reflect SEM. (D) Average confidence rating distributions for correct and incorrect trials. Subjects gave higher confidence ratings for correct (green) than incorrect (red) trials. Shaded areas denote SEM; vertical lines denote the average confidence level for each response class. (E, F) Distributions of mean choice accuracy (E) and confidence level (F) across subjects (n = 498).CC BY · PubMed Central
Figure 2 Association between decision (left) and metacognitive (right) variables with self-reported psychopathology in experiment 1 (n = 498). Each psychiatric symptom was examined in a separate regression, additionally controlling for the influence of age, gender, and IQ. The y axis indicates the change in each dependent variable for each change of 1 SD of symptom scores. Anxiety and depression symptoms were related to lower confidence level in the absence of a change in decision accuracy. Error bars denote SE. *p < .05, **p < .01, corrected for multiple comparisons over the number of dependent variables tested. See also Supplemental Figure S7A. OCD, obsessive-compulsive disorder.
Figure 2 Association between decision (left) and metacognitive (right) variables with self-reported psychopathology in experiment 1 (n = 498). Each psychiatric symptom was examined in a separate regression, additionally controlling for the influence of age, gender, and IQ. The y axis indicates the change in each dependent variable for each change of 1 SD of symptom scores. Anxiety and depression symptoms were related to lower confidence level in the absence of a change in decision accuracy. Error bars denote SE. *p < .05, **p < .01, corrected for multiple comparisons over the number of dependent variables tested. See also Supplemental Figure S7A. OCD, obsessive-compulsive disorder.CC BY · PubMed Central
Figure 3 Three latent factors (dimensions) explained the shared variance between all questionnaire items. (A) Correlation matrix of 209 questionnaire items showing significant correlations between the answers to questionnaire items across subjects. The color scale indicates the correlation coefficient. (B) Eigenvalues from the factor analysis revealing a three-factor solution that best accounted for our data. We labeled these factors anxious-depression, compulsive behavior and intrusive thought, and social withdrawal, according to the strongest individual item loadings. The inset corresponds to a zoom on the first few factors. (C) Item loadings onto each factor, color-coded by questionnaire. See also Supplemental Figures S1 and S2. OCD, obsessive-compulsive disorder.
Figure 3 Three latent factors (dimensions) explained the shared variance between all questionnaire items. (A) Correlation matrix of 209 questionnaire items showing significant correlations between the answers to questionnaire items across subjects. The color scale indicates the correlation coefficient. (B) Eigenvalues from the factor analysis revealing a three-factor solution that best accounted for our data. We labeled these factors anxious-depression, compulsive behavior and intrusive thought, and social withdrawal, according to the strongest individual item loadings. The inset corresponds to a zoom on the first few factors. (C) Item loadings onto each factor, color-coded by questionnaire. See also Supplemental Figures S1 and S2. OCD, obsessive-compulsive disorder.CC BY · PubMed Central
Figure 4 Factor analysis on the correlation matrix of 209 questionnaire items revealed a three-factor solution comprising anxious-depression, compulsive behavior and intrusive thought, and social withdrawal dimensions. Entry of these factors into a multiple regression model predicting decision formation and metacognition revealed bidirectional effects of anxious-depression and compulsive behavior and intrusive thought factors on confidence level, despite no relationships with performance. op < .05 uncorrected, ***p < .001 corrected for multiple comparisons over the number of dependent variables tested. See also Supplemental Figures S7C and S8. NS, not significant.
Figure 4 Factor analysis on the correlation matrix of 209 questionnaire items revealed a three-factor solution comprising anxious-depression, compulsive behavior and intrusive thought, and social withdrawal dimensions. Entry of these factors into a multiple regression model predicting decision formation and metacognition revealed bidirectional effects of anxious-depression and compulsive behavior and intrusive thought factors on confidence level, despite no relationships with performance. op < .05 uncorrected, ***p < .001 corrected for multiple comparisons over the number of dependent variables tested. See also Supplemental Figures S7C and S8. NS, not significant.CC BY · PubMed Central
Figure 5 Model comparison. Taking into account both goodness of fit and parsimony, model comparison provided strong evidence for including psychiatric factors in addition to age and IQ for explaining confidence level. Age/IQ model: Variable ∼ age + IQ + gender. Age/IQ + psychiatric factors model: Variable ∼ anxious-depression factor score + compulsive behavior and intrusive thought factor score + social withdrawal factor score + age + IQ + gender. See also Supplemental Figure S6C. BIC, Bayesian information criterion.
Figure 5 Model comparison. Taking into account both goodness of fit and parsimony, model comparison provided strong evidence for including psychiatric factors in addition to age and IQ for explaining confidence level. Age/IQ model: Variable ∼ age + IQ + gender. Age/IQ + psychiatric factors model: Variable ∼ anxious-depression factor score + compulsive behavior and intrusive thought factor score + social withdrawal factor score + age + IQ + gender. See also Supplemental Figure S6C. BIC, Bayesian information criterion.CC BY · PubMed Central

Verification

Claims the paper makes

2 Valid · 0 Not valid · 45 Not checked · 59 Own results and interpretations

45 more claims

Create a free account to see all 106 claims and to verify the 63 references still open.

See all claims — free account
  • It may state two separate claims as one. 25
  • Probably not a substantial claim. 42
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

2 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Cited by

See all 394

Metadata

Authors
Rouault, M., Seow, T., Gillan, C. M., & Fleming, S. M.
Affiliations
  • Wellcome Centre for Human Neuroimaging (GB)
  • Trinity College Dublin (IE)
Corresponding author
  • Rouault, Marion
  • Fleming, Stephen M.
Venue
Biological Psychiatry
Publisher
Elsevier BV
Published
2018-09
Volume
84
Issue
6
Pages
443-451
ISSN
0006-3223 (ISSN-L)
OpenAlex
W2783564726
Cited by
393
References
71
Citations by year
2026: 58 · 2025: 62 · 2024: 63 · 2023: 63 · 2022: 37 · 2021: 51 · 2020: 33 · 2019: 19 · 2018: 7
FWCI
13.73
Type
journal article
Language
en
Open access
Licence
Locations
  • Biological Psychiatry (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by)
  • HAL (submittedVersion, cc-by)
  • UCL Discovery (University College London) (submittedVersion)
  • MPG.PuRe (Max Planck Society) (submittedVersion)
Funders
Wellcome Trust (203147/Z/16/Z)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
  • Social Sciences › Arts and Humanities › Philosophy › Mental Health and Psychiatry
Keywords
metacognition, perceptual decision making, metacognitive confidence, metacognitive efficiency, anxiety, depression, compulsive behavior, intrusive thoughts, computational psychiatry, transdiagnostic symptoms, decision performance, age effects
MeSH terms
Metacognition, Adolescent, Adult, Aged, Compulsive Behavior, Decision Making, Female, Humans, Male, Middle Aged, Models, Theoretical, Psychomotor Performance, Task Performance and Analysis, Linear Models, Young Adult, Self Report

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-18, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-18 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.