On the validity of self-report assessment of cognitive abilities: attentional control scale associations with cognitive performance, emotional adjustment, and personality
The DOI matches its Crossref record; 70 of the 71 references it cites were found in a registry or an index.
Abstract
Individual differences in attentional control involve the ability to voluntarily direct, shift, and sustain attention. In studies of the role of attentional control in emotional adjustment, social relationships, and vulnerability to the effects of stress, self-report questionnaires are commonly used to measure this construct. Yet, convincing evidence of the association between self-report scales and actual cognitive performance has not been demonstrated. Across 2 independent samples, we examined associations between self-reported attentional control (Attentional Control Scale; ACS), self-reported emotional adjustment, Five-Factor Model personality traits (NEO Personality Inventory-Revised) and performance measures of attentional control. Study 1 examined behavioral performance on the Attention Network Test (ANT; Fan, McCandliss, Sommer, Raz, & Posner, 2002) and the Modified Switching Task (MST; Suchy & Kosson, 2006) in a large sample (n = 315) of healthy young adults. Study 2 (n = 78) examined behavioral performance on standardized neuropsychological tests of attention, including Conner's Continuous Performance Test-II and subtests from the Wechsler Adult Intelligence Scales, Third Edition (WAIS-III; Psychological Corporation, 1997) and Delis-Kaplan Executive Function System (D-KEFS; Delis, Kaplan, & Kramer, 2001). Results indicated that the ACS was largely unrelated to behavioral performance measures of attentional control but was significantly associated with emotional adjustment, neuroticism, and conscientiousness. These findings suggest that although self-reported attentional control may be a useful construct, researchers using the ACS should exercise caution in interpreting it as a proxy for actual cognitive ability or performance. (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, the lower the attentional control, the more susceptible the individual is to the stimulus drive system, and the more attention is captured by negative stimuli, leading to anxiety and depression (54–56).”
From Media multitasking, depression, and anxiety of college students: Serial mediating effects of attention control and negative information attentional bias (2022) · cites this paper as [56]
In the citing paper
“Individuals with good attentional control ability can regulate top-down attention allocation and avoid bottom-up stimulus drive systems that are overly enhanced and more easily attracted to negative stimuli.”
From Media multitasking, depression, and anxiety of college students: Serial mediating effects of attention control and negative information attentional bias (2022) · cites this paper as [56]
In the citing paper
“In line with this possibility, studies have reported strong associations between self-reported attentional difficulties and greater rumination, fears, worry, and internalizing symptoms (Devito et al., 2019; Hsu et al., 2015; Williams et al., 2017).”
From Disentangling the effects of attentional difficulties on fears of social evaluation and social anxiety symptoms: Unique interactions with sluggish cognitive tempo (2020) · cites this paper as Williams et al., 2017
In the citing paper
“In fact, recent research has found non-significant associations between self-reported scores on global measures of attentional difficulties and external measures of cognitive or attentional functioning (Williams et al., 2017).”
From Disentangling the effects of attentional difficulties on fears of social evaluation and social anxiety symptoms: Unique interactions with sluggish cognitive tempo (2020) · cites this paper as Williams et al., 2017
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116 · cited 4×
“From the perspective of traditional convergent–discriminant validity analyses (Campbell & Fiske, 1959; Strauss & Smith, 2009), this complicates the interpretation of results to some extent.”
BackgroundResultInfluentialAn inventory for measuring clinical anxiety: Psychometric properties.
Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.6.893 · Cited by 14,407 · cited 1×
“T hi s ar tic le is in te nd ed so le ly fo r th e pe rs on al us e of th e in di vi du al us er an d is no t to be di ss em in at ed br oa dl y. criminant validity and adequate test–retest reliability (Beck et al., 1988; Creamer, Foran, & Bell, 1995).”
High self-control predicts good adjustment, less pathology, better grades, and interpersonal success
Tangney, J. P., Baumeister, R. F., & Boone, A. L. (2004) · Journal of Personality · doi:10.1111/j.0022-3506.2004.00263.x · Cited by 6,557
Personality Structure: Emergence of the Five-Factor Model
Digman, J. M. (1990) · Annual Review of Psychology · doi:10.1146/annurev.ps.41.020190.002221 · Cited by 6,436 · cited 1×
“…control in two independent samples, as well as the association between the ACS and a range of competing constructs, including symptoms of emotional distress (e.g., depression, anxiety, worry) and the traits of the Five Factor Model (FFM) of personality (Costa & McCrae, 1992; Digman, 1990).”
BackgroundCognitive and emotional influences in anterior cingulate cortex
Bush, G., Luu, P., & Posner, M. I. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01483-2 · Cited by 6,259
Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients
Beck, A. T., Steer, R. A., Ball, R., & Ranieri, W. F. (1996) · Journal of Personality Assessment · doi:10.1207/s15327752jpa6703_13 · Cited by 5,965 · cited 1×
“The BDI-II evidences high internal consistency (Beck, Steer, Ball, & Ranieri, 1996) and test–retest reliability (Beck et al., 1996).”
BackgroundDevelopment and validation of the Penn State Worry Questionnaire
Meyer, T. J., Miller, M. L., Metzger, R. L., & Borkovec, T. D. (1990) · Behaviour Research and Therapy · doi:10.1016/0005-7967(90)90135-6 · Cited by 5,099 · cited 1×
“The PSWQ shows high internal consistency, good test–retest reliability, and strong discriminant validity in both clinical and nonclinical samples (Brown, Antony, & Barlow, 1992; Meyer et al., 1990).”
BackgroundTesting the efficiency and independence of attentional networks
Fan, J., McCandliss, B. D., Sommer, T., Raz, A., & Posner, M. I. (2002) · Journal of Cognitive Neuroscience · doi:10.1162/089892902317361886 · Cited by 3,717 · cited 1×
“…we replicated analyses of pre- dicted convergent associations of the ACS with a widely used performance-based measure of attentional control—the ANT (Fan et al., 2002)—also used by Reinholdt-Dunne and colleagues (2013), as well as the expected discriminant associations of the ACS with…”
MethodHealth complaints, stress, and distress: Exploring the central role of negative affectivity.
Watson, D., & Pennebaker, J. W. (1989) · Psychological Review · doi:10.1037/0033-295x.96.2.234 · Cited by 3,030 · cited 2×
“Similar to the issues outlined in the current article, several pointed critiques in the literature (e.g., Watson & Pennebaker, 1989) suggested that self-reported symptoms are an inadequate proxy for actual health, given their subjective nature and strong associations with personality.”
BackgroundResult
Cited by
Smith, T. W., Deits‐Lebehn, C., Williams, P. G., Baucom, B. R. W., & Uchino, B. N. (2020) · Social and Personality Psychology Compass · doi:10.1111/spc3.12516 · Cited by 88
Self-citationYang, X.-J., Liu, Q.-Q., Lian, S.-L., & Zhou, Z.-K. (2020) · Addictive Behaviors · doi:10.1016/j.addbeh.2020.106426 · Cited by 82
Does rumination mediate the relationship between attentional control and symptoms of depression?
DeJong, H., Fox, E., & Stein, A. (2019) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2018.12.007 · Cited by 67
The Role of Attentional Control in the Relationship Between Mindfulness and Anxiety
MacDonald, H. Z., & Olsen, A. (2020) · Psychological Reports · doi:10.1177/0033294119835756 · Cited by 64
“Evidence suggests that behavioral measures of attentional control differ from participants’ self-reported attentional control (Williams et al., 2017), and thus future studies should compare our findings with studies examining relationships between mindfulness, anxiety, and attentional control using objective measures.”
BackgroundResultInfluentialKönen, T., & Karbach, J. (2018) · Assessment · doi:10.1177/1073191118786800 · Cited by 64
“…that are conceptually related to the CFQ, such as the Attentional Control Scale, the Webexec Scale, and the Prospective and Retrospective Memory Questionnaire mentioned above, are also largely unrelated to objective cognitive performance measures (Buchanan, 2016, 2017; Williams et al., 2017).”
BackgroundMethodResultInfluential
Metadata
- Authors
- Williams, P. G., Rau, H. K., Suchy, Y., Thorgusen, S. R., & Smith, T. W.
- Affiliations
- University of Utah (US)
- Venue
- Psychological Assessment
- Published
- 2017-05
- Volume
- 29
- Issue
- 5
- Pages
- 519-530
- ISSN
- 1040-3590 (ISSN-L)
- 1939-134X
- OpenAlex
- W2514574418
- Cited by
- 97
- References
- 71
- Citations by year
- 2026: 5 · 2025: 14 · 2024: 16 · 2023: 10 · 2022: 12 · 2021: 13 · 2020: 13 · 2019: 8 · 2018: 6
- FWCI
- 2.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Assessment (publishedVersion)
- PubMed (publishedVersion)
- Funders
- University of Utah
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- attentional control, self-report validity, cognitive performance, emotional adjustment, personality traits, neuroticism, conscientiousness, attentional shift, executive function, Attention Network Test, neuropsychological assessment
- MeSH terms
- Emotional Adjustment, Adult, Attention, Cognition, Cognition Disorders, Female, Humans, Male, Neuropsychological Tests, Personality, Personality Disorders, Personality Inventory, Self-Assessment, Wechsler Scales, Reproducibility of Results, Young Adult, Self Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.