CoChat

Cognitive persistence: Development and validation of a novel measure from the Wisconsin Card Sorting Test

Open access
Teubner-Rhodes, Susan, Vaden, Kenneth I., Dubno, Judy R., Eckert, Mark A. · 2017 · Neuropsychologia
Cited by 45

The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.

Abstract

&NA; The Wisconsin Card Sorting Test (WCST) has long been used as a neuropsychological assessment of executive function abilities, in particular, cognitive flexibility or “set‐shifting”. Recent advances in scoring the task have helped to isolate specific WCST performance metrics that index set‐shifting abilities and have improved our understanding of how prefrontal and parietal cortex contribute to set‐shifting. We present evidence that the ability to overcome task difficulty to achieve a goal, or “cognitive persistence”, is another important prefrontal function that is characterized by the WCST and that can be differentiated from efficient set‐shifting. This novel measure of cognitive persistence was developed using the WCST‐64 in an adult lifespan sample of 230 participants. The measure was validated using individual variation in cingulo‐opercular cortex function in a sub‐sample of older adults who had completed a challenging speech recognition in noise fMRI task. Specifically, older adults with higher cognitive persistence were more likely to demonstrate word recognition benefit from cingulo‐opercular activity. The WCST‐derived cognitive persistence measure can be used to disentangle neural processes involved in set‐shifting from those involved in persistence. HighlightsThe Wisconsin Card Sorting Test can measure persistence to overcome task difficulty.Persistence predicts cingulo‐opercular error responses and performance benefits.The new measure can dissociate set‐shifting and persistence.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.neuropsychologia.2017.05.027

Cites

29 of 29 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 29 references

Research works printed but not linked: 77

  1. Anderson Gosselin, 2011, Older adults expend more listening effort than young adults recognizing speech in noise, J. Speech Lang. Hear. Res., 54, 944, 10.1044/1092-4388(2010/10-0069) · doi:10.1044/1092-4388(2010/10-0069
  2. Barceló, 1999, Electrophysiological evidence of two different types of error in the Wisconsin Card Sorting Test, NeuroReport, 10, 1299, 10.1097/00001756-199904260-00027 · DOI · Paper page
  3. Barceló, 2003, The Madrid Card Sorting Test (MCST): a task switching paradigm to study executive attention with event-related potentials, Brain Res. Protoc., 11, 27, 10.1016/S1385-299X(03)00013-8 · DOI
  4. Barceló, 1997, The Wisconsin Card Sorting Test and the assessment of frontal function: a validation study with event-related potentials, Neuropsychologia, 35, 399, 10.1016/S0028-3932(96)00096-6 · DOI
  5. Bordier, 2011, Temporal and spatial independent component analysis for fMRI data sets embedded in the AnalyzeFMRI R package, J. Stat. Softw., 44, 1, 10.18637/jss.v044.i09 · DOI
  6. Botvinick, 2007, Conflict monitoring and decision making: reconciling two perspectives on anterior cingulate function, Cogn. Affect. Behav. Neurosci., 7, 356, 10.3758/CABN.7.4.356 · DOI · Paper page
  7. Botvinick, 2001, Conflict monitoring and cognitive control, Psychol. Rev., 108, 624, 10.1037/0033-295X.108.3.624 · DOI · Paper page
  8. Botvinick, 2004, Conflict monitoring and anterior cingulate cortex: an update, Trends Cogn. Sci., 8, 539, 10.1016/j.tics.2004.10.003 · DOI · Paper page
  9. Busse, 2012, Detecting suboptimal cognitive effort: classification accuracy of the Conner's Continuous Performance Test-II, Brief Test of Attention, and Trail Making Test, Clin. Neuropsychol., 26, 675, 10.1080/13854046.2012.679623 · DOI
  10. Carter, 1998, Anterior cingulate cortex, error detection, and the online monitoring of performance, Science, 280, 747, 10.1126/science.280.5364.747 · DOI · Paper page
  11. Choi, 2010, Intrinsic motivation inventory: an adapted measure for schizophrenia research, Schizophr. Bull., 36, 966, 10.1093/schbul/sbp030 · DOI · Paper page
  12. Crone, 2006, Neural evidence for dissociable components of task-switching, Cereb. Cortex, 16, 475, 10.1093/cercor/bhi127 · DOI · Paper page
  13. Dang, 2012, Striatal dopamine influences the default mode network to affect shifting between object features, J. Cogn. Neurosci., 24, 1960, 10.1162/jocn_a_00252 · DOI · Paper page
  14. Daughters, 2005, Psychological distress tolerance and duration of most recent abstinence attempt among residential treatment-seeking substance abusers, Psychol. Addict. Behav., 19, 208, 10.1037/0893-164X.19.2.208 · DOI · Paper page
  15. Daughters, 2005, The relationship among negative affect, distress tolerance, and length of gambling abstinence attempt, J. Gambl. Stud., 21, 363, 10.1007/s10899-005-5554-6 · DOI
  16. de Zubicaray, 1996, Nelson's (1976) Modified Card Sorting Test: a review, Clin. Neuropsychol., 10, 245, 10.1080/13854049608406687 · DOI · Paper page
  17. Deci, 1996, Need satisfaction and the self-regulation of learning, Learn. Individ. Differ., 8, 165, 10.1016/S1041-6080(96)90013-8 · DOI · Paper page
  18. Dirks, 2001, Examination of the neighborhood activation theory in normal and hearing-impaired listeners, Ear Hear., 22, 1, 10.1097/00003446-200102000-00001 · DOI
  19. Doherty-Bigara, 2016, Development of the dimensions of adult mastery motivation questionnaire, Aust. Educ. Dev. Psychol., 32, 142, 10.1017/edp.2015.18 · DOI
  20. Drewe, 1974, The effect of type and area of brain lesion on Wisconsin Card Sorting Test performance, Cortex, 10, 159, 10.1016/S0010-9452(74)80006-7 · DOI · Paper page
  21. Durston, 2003, Parametric manipulation of conflict and response competition using rapid mixed-trial event-related fMRI, NeuroImage, 20, 2135, 10.1016/j.neuroimage.2003.08.004 · DOI · Paper page
  22. Eckert, 2016, Is listening in noise worth it? The neurobiology of speech recognition in challenging listening conditions, Ear Hear., 37, 101S, 10.1097/AUD.0000000000000300 · DOI · Paper page
  23. Edwards, 2007, The future of hearing aid technology, Trends Amplif., 11, 31, 10.1177/1084713806298004 · DOI · Paper page
  24. Efron, 1987, Better bootstrap confidence intervals, J. Am. Stat. Assoc., 82, 171, 10.1080/01621459.1987.10478410 · DOI · Paper page
  25. Eichele, 2008, Prediction of human errors by maladaptive changes in event-related brain networks, Proc. Natl. Acad. Sci. USA, 105, 6173, 10.1073/pnas.0708965105 · DOI · Paper page
  26. Fellows, 2005, Is anterior cingulate cortex necessary for cognitive control?, Brain, 128, 788, 10.1093/brain/awh405 · DOI · Paper page
  27. Godinez, 2012, Phenotypic and genetic analyses of the Wisconsin Card Sort, Behav. Genet., 42, 209, 10.1007/s10519-011-9502-1 · DOI
  28. Gold, 1997, Auditory working memory and Wisconsin Card Sorting Test performance in schizophrenia, Arch. Gen. Psychiatry, 54, 159, 10.1001/archpsyc.1997.01830140071013 · DOI · Paper page
  29. Graham, 2009, Role of medial cortical, hippocampal and striatal interactions during cognitive set-shifting, NeuroImage, 45, 1359, 10.1016/j.neuroimage.2008.12.040 · DOI
  30. Hampshire, 2008, Inefficiency in self-organized attentional switching in the normal aging population is associated with decreased activity in the ventrolateral prefrontal cortex, J. Cogn. Neurosci., 20, 1670, 10.1162/jocn.2008.20115 · DOI · Paper page
  31. Han, 2016, Are executive functioning deficits concurrently and predictively associated with depressive and anxiety symptoms in adolescents?, J. Clin. Child Adolesc. Psychol., 45, 44, 10.1080/15374416.2015.1041592 · DOI · Paper page
  32. Hartman, 2001, Accounting for age differences on the Wisconsin Card Sorting Test: decreased working memory, not inflexibility, Psychol. Aging, 16, 385, 10.1037/0882-7974.16.3.385 · doi:10.1037/0882-7974.16.3.385 · Paper page
  33. Holec, 2014, Not all effort is equal: the role of the anterior cingulate cortex in different forms of effort-reward decisions, Front. Behav. Neurosci., 8, 12, 10.3389/fnbeh.2014.00012 · DOI
  34. Kalikow, 1977, Development of a test of speech intelligibility in noise using sentence materials with controlled word predictability, J. Acoust. Soc. Am., 61, 1337, 10.1121/1.381436 · DOI · Paper page
  35. Kanfer, 1996, Motivational skills and self-regulation for learning: a trait perspective, Learn. Individ. Differ., 8, 185, 10.1016/S1041-6080(96)90014-X · DOI
  36. Kerns, 2004, Anterior cingulate conflict monitoring and adjustments in control, Science, 303, 1023, 10.1126/science.1089910 · DOI · Paper page
  37. Kopp, 2013, Electrophysiological indicators of surprise and entropy in dynamic task-switching environments, Front. Human. Neurosci., 7, 300, 10.3389/fnhum.2013.00300 · DOI
  38. Kuchinsky, 2013, Pupil size varies with word listening and response selection difficulty in older adults with hearing loss, Psychophysiology, 50, 23, 10.1111/j.1469-8986.2012.01477.x · DOI · Paper page
  39. Lange, 2016, Decomposing card-sorting performance: effects of working memory load and age-related changes, Neuropsychology, 30, 579, 10.1037/neu0000271 · DOI
  40. Luks, 2007, Preparatory allocation of attention and adjustments in conflict processing, NeuroImage, 35, 949, 10.1016/j.neuroimage.2006.11.041 · DOI
  41. Mars, 2005, Neural dynamics of error processing in medial frontal cortex, NeuroImage, 28, 1007, 10.1016/j.neuroimage.2005.06.041 · DOI
  42. Militello, L.G., Gentner, F.C., Swindler, S.D., Beisner, G.I., 2006. Conation: Its Historical Roots and Implications for Future Research. Paper presented at the International Symposium on Collaborative Technologies and Systems, Las Vegas, NV.
  43. Milner, 1963, Effects of different brain lesions on card sorting: the role of the frontal lobes, Arch. Neurol., 9, 90, 10.1001/archneur.1963.00460070100010 · DOI · Paper page
  44. Nagahama, 1998, Neural activity during attention shifts between object features, NeuroReport, 9, 2633, 10.1097/00001756-199808030-00038 · DOI · Paper page
  45. Nelson, 1976, A modified card sorting test sensitive to frontal lobe defects, Cortex, 12, 313, 10.1016/S0010-9452(76)80035-4 · DOI · Paper page
  46. Neta, 2014, Separable responses to error, ambiguity, and reaction time in cingulo-opercular task control regions, NeuroImage, 99, 59, 10.1016/j.neuroimage.2014.05.053 · DOI
  47. Nyhus, 2009, The Wisconsin Card Sorting Test and the cognitive assessment of prefrontal executive functions: a critical update, Brain Cogn., 71, 437, 10.1016/j.bandc.2009.03.005 · DOI · Paper page
  48. Onatsu-Arvilommi, 2000, The role of task-avoidant and task-focused behaviors in the development of reading and mathematical skills during the first school year: a cross-lagged longitudinal study, J. Educ. Psychol., 92, 478, 10.1037/0022-0663.92.3.478 · doi:10.1037/0022-0663.92.3.478 · Paper page
  49. Ord, 2010, Detection of malingering in mild traumatic brain injury with the Conners' Continuous Performance Test-II, J. Clin. Exp. Neuropsychol., 32, 380, 10.1080/13803390903066881 · DOI
  50. Orr, 2009, Anterior cingulate cortex makes 2 contributions to minimizing distraction, Cereb. Cortex, 19, 703, 10.1093/cercor/bhn119 · DOI · Paper page
  51. Potter, 2007, Prefrontal white matter lesions and prefrontal task impersistence in depressed and nondepressed elders, Neuropsychopharmacology, 32, 2135, 10.1038/sj.npp.1301339 · DOI
  52. Price, 2002, Redefining the factor structure of the Wechsler Memory Scale-III: confirmatory factor analysis with cross-validation, J. Clin. Exp. Neuropsychol., 24, 574, 10.1076/jcen.24.5.574.1013 · DOI · Paper page
  53. Quinn, 1996, Is task persistence related to smoking and substance abuse? The application of learned industriousness theory to addictive behaviors, Exp. Clin. Psychopharmacol., 4, 186, 10.1037/1064-1297.4.2.186 · DOI · Paper page
  54. Ravizza, 2008, Shifting set about task switching: behavioral and neural evidence for distinct forms of cognitive flexibility, Neuropsychologia, 46, 2924, 10.1016/j.neuropsychologia.2008.06.006 · DOI · Paper page
  55. Ravizza, 2014, Motivational enhancement of cognitive control depends on depressive symptoms, Emotion, 14, 646, 10.1037/a0036754 · DOI
  56. Ridderinkhof, 2004, The role of the medial frontal cortex in cognitive control, Science, 306, 443, 10.1126/science.1100301 · DOI · Paper page
  57. Robinson, 1991, Comparison of two short forms of the Wisconsin Card Sorting Test, Arch. Clin. Neuropsychol., 6, 27, 10.1093/arclin/6.1-2.27 · DOI
  58. Shenhav, 2013, The expected value of control: an integrative theory of anterior cingulate cortex function, Neuron, 79, 217, 10.1016/j.neuron.2013.07.007 · DOI · Paper page
  59. Shenhav, 2016, Dorsal anterior cingulate cortex and the value of control, Nat. Neurosci., 19, 1286, 10.1038/nn.4384 · DOI · Paper page
  60. Snow, 1996, Self-regulation as meta-cognition?, Learn. Individ. Differ., 8, 261, 10.1016/S1041-6080(96)90017-5 · DOI
  61. Steinberg, 2007, Relationship between self-reported task persistence and history of quitting smoking, plans for quitting smoking, and current smoking status in adolescents, Addict. Behav., 32, 1451, 10.1016/j.addbeh.2006.10.008 · DOI
  62. Steinberg, 2010, Lower task persistence in smokers with schizophrenia as compared to non-psychiatric control smokers, Psychol. Addict. Behav., 24, 724, 10.1037/a0020972 · DOI
  63. Steinberg, 2012, Task persistence predicts smoking cessation in smokers with and without schizophrenia, Psychol. Addict. Behav., 26, 850, 10.1037/a0028375 · DOI
  64. Steinmetz, 2011, What about inhibition in the Wisconsin Card Sorting Test?, Clin. Neuropsychol., 25, 652, 10.1080/13854046.2011.568525 · DOI
  65. Suhr, 2011, The relationship of noncredible performance to continuous performance test scores in adults referred for attention-deficit/hyperactivity disorder evaluation, Arch. Clin. Neuropsychol., 26, 1, 10.1093/arclin/acq094 · DOI · Paper page
  66. Tas, 2012, Intrinsic motivation and metacognition as predictors of learning potential in patients with remitted schizophrenia, J. Psychiatr. Res., 46, 1086, 10.1016/j.jpsychires.2012.04.027 · DOI
  67. Tow, 1953, Personality changes after operations on the cingulate gyrus in man, J. Neurol., Neurosurg., Psychiatry, 16, 186, 10.1136/jnnp.16.3.186 · DOI · Paper page
  68. Vaden, 2013, The cingulo-opercular network provides word-recognition benefit, J. Neurosci., 33, 18979, 10.1523/JNEUROSCI.1417-13.2013 · DOI · Paper page
  69. Vaden, 2015, Cortical activity predicts which older adults recognize speech in noise and when, J. Neurosci., 35, 3929, 10.1523/JNEUROSCI.2908-14.2015 · DOI
  70. Vaden, 2016, Cingulo-opercular function during word recognition in noise for older adults with hearing loss, Exp. Aging Res., 42, 67, 10.1080/0361073X.2016.1108784 · DOI
  71. van Veen, 2004, Errors without conflict: implications for performance monitoring theories of anterior cingulate cortex, Brain Cogn., 56, 267, 10.1016/j.bandc.2004.06.007 · DOI · Paper page
  72. Ventura, 2013, The relationship between video game use and a performance-based measure of persistence, Comput. Educ., 60, 52, 10.1016/j.compedu.2012.07.003 · DOI
  73. Wang, 2015, Brain activation of negative feedback in rule acquisition revealed in a segmented Wisconsin Card Sorting Test, PLoS One, 10, e0140731, 10.1371/journal.pone.0140731 · DOI
  74. Wechsler, 1950, Cognitive, conative, and non-intellective intelligence, Am. Psychol., 5, 78, 10.1037/h0063112 · DOI · Paper page
  75. Wolters, 1996, The relation between goal orientation and students' motivational beliefs and self-regulated learning, Learn. Individ. Differ., 8, 211, 10.1016/S1041-6080(96)90015-1 · DOI · Paper page
  76. Zekveld, 2011, Cognitive load during speech perception in noise: the influence of age, hearing loss, and cognition on the pupil response, Ear Hear., 32, 498, 10.1097/AUD.0b013e31820512bb · DOI · Paper page
  77. Zhang, 2011, A teacher-report measure of children's task-avoidant behavior: a validation study of the behavioral strategy rating scale, Learn. Individ. Differ., 21, 690, 10.1016/j.lindif.2011.09.007 · DOI

Cited by

See all 45

Metadata

Authors
Teubner-Rhodes, S., Vaden, K. I., Dubno, J. R., & Eckert, M. A.
Venue
Neuropsychologia
Publisher
Elsevier BV
Published
2017-07
Volume
102
Pages
95-108
ISSN
0028-3932 (ISSN-L)
OpenAlex
W2617900197
Cited by
45
References
29
FWCI
1.57
Type
journal article
Language
en
Open access
green
Licence
www.elsevier.com/tdm/userlicense/1.0/ (tdm)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Cognitive persistence: Development and validation of a novel measure from the Wisconsin Card Sorting Test. https://app.cochat.ai/papers/10.1016/j.neuropsychologia.2017.05.027
The paper
Teubner-Rhodes, S., Vaden, K. I., Dubno, J. R., & Eckert, M. A. (2017). Cognitive persistence: Development and validation of a novel measure from the Wisconsin Card Sorting Test. Neuropsychologia. https://doi.org/10.1016/j.neuropsychologia.2017.05.027

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.