Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 97 of the 98 references it cites were found in a registry or an index; none of the 39 sources its claims cite is checked for support yet.

Conflation between self-report and neurocognitive assessments of cognitive flexibility: a critical review of the Jingle Fallacy

Open access

Abstract

Cognitive flexibility is a widely studied construct and is considered an important treatment target for several psychological disorders. The convergence of several independent fields of research has led to assumptions about the assessment of cognitive flexibility - assumptions that are not empirically supported and often conflate different notions of flexibility. This critical review discusses how the conflation of self-report and neurocognitive assessments has seemingly arisen from literature on eating disorders. We describe how seminal early observations of "inflexible" personality characteristics, communication competence research, and investigations of frontal lobe function after injury led to two methods of assessing "cognitive flexibility". We discuss the impact that conflation of self-report and neurocognitive assessments has had on the field, and we provide recommendations for assessing cognitive flexibility in both research and clinical settings.

Overview

CoChat Summary

TL;DR

This critical review argues that self-report and neurocognitive assessments of “cognitive flexibility” have been conflated through the jingle fallacy, especially in eating disorders research, despite little empirical evidence that they measure the same construct. It recommends ceasing interchangeable use, using precise construct language, and selecting assessments aligned with the intended research or clinical question.

Key findings

  • The review states that self-report questionnaires and neurocognitive tasks of cognitive flexibility are often used interchangeably, but empirical evidence shows they do not relate well in clinical or non-clinical samples.
  • Cited primary studies report little-to-no relationship: Gelonch et al. (2016) found no relationship between a shift subscale and TMT/WCST outcomes; Lounes et al. (2011) found no relationship between the Cognitive Flexibility Scale and the Brixton Spatial Anticipation Task; Gonzalez et al. (2013) reported no association between the Cognitive Flexibility Scale and TMT/novel flexibility task; Johnco et al. (2014) found no correlation in older adults with comorbid depressive and anxiety symptoms, though small correlations (r ≈ 0.28) appeared in the healthy comparison group.
  • Two recent meta-analytic reviews (Howlett et al., 2021, 2022) failed to detect a relationship between self-report and neurocognitive assessments in non-clinical or clinical cohorts; Miles et al. (2022) and Sternheim et al. (2022) also reported null correlations.
  • The paper identifies three apparent conceptual manifestations in the field—inflexible thoughts/behaviours causing neurocognitive inflexibility, neurocognitive inflexibility causing inflexible thoughts/behaviours, and a single construct assessed by either method—and argues the evidence conflicts with all three.

Methods

  • Design: critical review with a historical overview of how self-report and neurocognitive assessments of cognitive flexibility developed and became conflated.
  • Data/sample: no primary data; the paper synthesizes prior literature, focusing largely on eating disorders research and extending to other fields.
  • Analysis: narrative conceptual critique, including examination of rationales in prior papers, discussion of the jingle fallacy, and recommendations for research and clinical practice.

Limitations

  • The paper states that there is no clear empirical evidence to support causal claims between neurocognitive inflexibility and inflexible thoughts/behaviours, and that it is not yet possible to determine whether one or neither assessment accurately captures cognitive flexibility.
  • The paper notes limitations of existing measures: neurocognitive tasks may lack ecological validity, have reliability problems, and suffer from task impurity; self-report questionnaires may be confounded by negative affect, insight, meta-cognitive awareness, and response biases.
  • Evident from the text: as a critical review rather than a systematic review or meta-analysis, it does not provide new empirical data, and its heavy focus on eating disorders may limit generalizability to other fields.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1080/00049530.2023.2174684

Cites

97 of 97 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

0 Valid · 2 Not valid · 18 Not checked · 31 Own results and interpretations

27 more claims

Create a free account to see all 51 claims and to verify the 39 references still open.

See all claims — free account
  • Probably not a substantial claim. 15
  • It may state two separate claims as one. 9

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 98 references

Research works printed but not linked: 2

  1. 10.1007/978-3-642-39360-0-33 · doi:10.1007/978-3-642-39360-0-33
  2. Uznadze, D. (1966). The psychology of set. Consultants’ Bureau.

Cited by

See all 22

Metadata

Authors
Howlett, C. A., Miles, S., Berryman, C., Phillipou, A., & Moseley, G. L.
Affiliations
  • University of South Australia (AU)
  • Swinburne University of Technology (AU)
  • The University of Melbourne (AU)
Corresponding author
Moseley, G. Lorimer
Venue
Australian Journal of Psychology
Published
2023-02-19
Volume
75
Issue
1
Pages
2174684-2174684
ISSN
  • 0004-9530 (ISSN-L)
  • 1742-9536
OpenAlex
W4321351338
Cited by
22
References
98
Citations by year
2026: 4 · 2025: 6 · 2024: 9 · 2023: 3
FWCI
0.82
Type
journal article
Language
en
Open access
Locations
  • Australian Journal of Psychology (publishedVersion, cc-by-nc)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • UniSA Research Outputs Repository (University of South Australia) (submittedVersion, cc-by-nc)
  • Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion, cc-by-nc)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Minerva Access (University of Melbourne) (submittedVersion, cc-by-nc)
Funders
funding bodies h
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
  • Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
Keywords
cognitive flexibility, self-report measures, neuropsychological assessment, eating disorders, communication competence, frontal lobe function, frontal lobe lesions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Conflation between self-report and neurocognitive assessments of cognitive flexibility: a critical review of the Jingle Fallacy. https://app.cochat.ai/papers/10.1080/00049530.2023.2174684
The paper
Howlett, C. A., Miles, S., Berryman, C., Phillipou, A., & Moseley, G. L. (2023). Conflation between self-report and neurocognitive assessments of cognitive flexibility: a critical review of the Jingle Fallacy. Australian Journal of Psychology. https://doi.org/10.1080/00049530.2023.2174684

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.