The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Considerations for using the Wisconsin Card Sorting Test to assess cognitive flexibility
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Cognitive flexibility in autism spectrum disorder: Explaining the inconsistencies?
Van Eylen, L., Boets, B., Steyaert, J., Evers, K., Wagemans, J., & Noens, I. (2011) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2011.01.025 · Cited by 183
RetractedDiamond, A. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143750 · Cited by 13,268
A Modified Card Sorting Test Sensitive to Frontal Lobe Defects
Nelson, H. E. (1976) · Cortex · doi:10.1016/s0010-9452(76)80035-4 · Cited by 2,454
Effects of Different Brain Lesions on Card Sorting: The Role of the Frontal Lobes
MILNER, B. (1963) · Archives of Neurology · doi:10.1001/archneur.1963.00460070100010 · Cited by 2,217 · cited 1×
“Originally popular as an assessment of frontal lobe damage (Barceló & Knight, 2002; Milner, 1963), by 2005, the WCST was the seventh most frequent test implemented by clinical neuropsychologists (Rabin, Barr, & Burton, 2005).”
BackgroundDennis, J. P., & Vander Wal, J. S. (2010) · Cognitive Therapy and Research · doi:10.1007/s10608-009-9276-4 · Cited by 1,118
Demystifying cognitive flexibility: Implications for clinical and developmental neuroscience
Dajani, D. R., & Uddin, L. Q. (2015) · Trends in Neurosciences · doi:10.1016/j.tins.2015.07.003 · Cited by 1,046
Changes in executive control across the life span: Examination of task-switching performance.
Cepeda, N. J., Kramer, A. F., & Gonzalez de Sather, J. C. M. (2001) · Developmental Psychology · doi:10.1037/0012-1649.37.5.715 · Cited by 657
Yuan, P., & Raz, N. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.02.005 · Cited by 608
Cognitive complexity and cognitive flexibility
Scott, W. A. (1962) · Sociometry · doi:10.2307/2785779 · Cited by 533
Meta‐analysis of neuroimaging studies of the Wisconsin Card‐Sorting task and component processes
Buchsbaum, B. R., Greer, S., Chang, W., & Berman, K. F. (2005) · Human Brain Mapping · doi:10.1002/hbm.20128 · Cited by 477
Research works printed but not linked: 44
- Abbate-Daga, G., Buzzichelli, S., Marzola, E., Amianto, F., & Fassino, S. (2014). Clinical investigation of set-shifting subtypes in anorexia nervosa. Psychiatry Research, 219(3), 592–597. https://doi.org/10.1016/j.psychres.2014.06.024 · DOI
- Aloi, M., Rania, M., Caroleo, M., Bruni, A., Palmieri, A., Cauteruccio, M. A., … Segura-García, C. (2015). Decision making, central coherence and set-shifting: A comparison between binge eating disorder, anorexia nervosa and healthy controls. BMC Psychiatry, 15(1), 1–10. https://doi.org/10.1186/s12888-015-0395-z · DOI
- Axelrod, B. N., Goldman, R. S., & Woodard, J. L. (1992). Interrater reliability in scoring the Wisconsin Card Sorting Test. The Clinical Neuropsychologist, 6(2), 143–155. · DOI
- Baker, K. S., Georgiou-Karistianis, N., Lampit, A., Valenzuela, M., Gibson, S. J., & Giummarra, M. J. (2018a). Computerised training improves cognitive performance in chronic pain: A participant-blinded randomised active-controlled trial with remote supervision. Pain, 159(4), 644–655. https://doi.org/10.1097/j.pain.0000000000001150 · DOI
- Baker, K. S., Gibson, S. J., Georgiou-Karistianis, N., & Giummarra, M. J. (2018b). Relationship between self-reported cognitive difficulties, objective neuropsychological test performance and psychological distress in chronic pain. European Journal of Pain, 22(3), 601–613. https://doi.org/10.1002/ejp.1151 · DOI
- Berg, E. A. (1948). A simple objective technique for measuring flexibility in thinking. The Journal of General Psychology, 39, 15–22. · DOI · Paper page
- Bilgin, M. (2009). Developing a cognitive flexibility scale: Validity and reliability studies. Social Behavior and Personality: An International Journal, 37(3), 343–353. https://doi.org/10.2224/sbp.2009.37.3.343 · DOI
- Bischoff-Grethe, A., McCurdy, D., Grenesko-Stevens, E., Irvine, L. E., Wagner, A., Yau, W. Y. W., … Kaye, W. H. (2013). Altered brain response to reward and punishment in adolescents with anorexia nervosa. Psychiatry Research - Neuroimaging, 214(3), 331–340. https://doi.org/10.1016/j.pscychresns.2013.07.004 · DOI · Paper page
- Channon, S. (1996). Executive dysfunction in depression: The Wisconsin Card Sorting Test. Journal of Affective Disorders, 39(2), 107–114. https://doi.org/10.1016/0165-0327(96)00027-4 · DOI
- Cragg, L., & Chevalier, N. (2012). The processes underlying flexibility in childhood. Quarterly Journal of Experimental Psychology, 65(2), 209–232. https://doi.org/10.1080/17470210903204618 · DOI · Paper page
- Deák, G. O. (2003). The development of cognitive flexibility and language abilities. Advances in Child Development and Behavior, 31, 271–327. https://doi.org/10.1016/S0065-2407(03)31007-9 · DOI · Paper page
- Dickson, K. S., Ciesla, J. A., & Zelic, K. (2017). The role of executive functioning in adolescent rumination and depression. Cognitive Therapy and Research, 41(1), 62–72. https://doi.org/10.1007/s10608-016-9802-0 · DOI
- Eling, P., Derckx, K., & Maes, R. (2008). On the historical and conceptual background of the Wisconsin Card Sorting Test. Brain and Cognition, 67(3), 247–253. https://doi.org/10.1016/j.bandc.2008.01.006 · DOI
- Figueroa, I. J., & Youmans, R. J. (2013). Failure to maintain set: A measure of distractibility or cognitive flexibility? Proceedings of the Human Factors and Ergonomics Society, 57(1), 828–832. https://doi.org/10.1177/1541931213571180 · DOI
- Flashman, L. A., Horner, M. D., & Freides, D. (1991). Note on scoring perseveration on the Wisconsin Card Sorting Test. The Clinical Neuropsychologist, 5(2), 190–194. · DOI
- Friederich, H.-C., & Herzog, W. (2011). Cognitive-behavioural flexibility in anorexia nervosa. In R. A. H. Adan & W. H. Kaye (Eds.), Behavioral neurobiology of eating disorders (Current topics in behavioral neurosciences) (6th ed., pp. 111–123). Berlin: Springer-Verlag. https://doi.org/10.1007/7854_2010_83 · DOI
- Garcia-Willingham, N. E., Roach, A. R., Kasarskis, E. J., & Segerstrom, S. C. (2018). Self-regulation and executive functioning as related to survival in motor neuron disease: Preliminary findings. Psychosomatic Medicine, 80(7), 665–672. https://doi.org/10.1097/PSY.0000000000000602 · DOI
- Gelonch, O., Garolera, M., Valls, J., Rosselló, L., & Pifarré, J. (2016). Executive function in fibromyalgia: Comparing subjective and objective measures. Comprehensive Psychiatry, 66, 113–122. https://doi.org/10.1016/j.comppsych.2016.01.002 · DOI
- Grant, D. A., & Berg, E. A. (1948). A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. Journal of Experimental Psychology, 38(4), 404–411. · DOI · Paper page
- Greve, K. W. (1993). Can perseverative responses on the Wisconsin Card Sorting Test be scored accurately? Archives of Clinical Neuropsychology, 8(6), 511–517. https://doi.org/10.1016/0887-6177(93)90051-2 · DOI
- Greve, K. W., Stickle, T. R., Love, J. M., Bianchini, K. J., & Stanford, M. S. (2005). Latent structure of the Wisconsin Card Sorting Test: A confirmatory factor analytic study. Archives of Clinical Neuropsychology, 20(3), 355–364. https://doi.org/10.1016/j.acn.2004.09.004 · DOI · Paper page
- Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtiss, G. (1981). Wisconsin Card Sorting Test: Manual (1st ed.). Odessa: Psychological Assessment Resources.
- Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtiss, G. (1993). Wisconsin Card Sorting Test manual: Revised and expanded. Odessa: Psychological Assessment Resources.
- Heaton, R. K., & PAR Staff. (2008). Wisconsin Card Sorting Test: Computer Version 4–Research Edition. PAR.
- Herbrich, L. R., Kappel, V., Winter, S. M., & van Noort, B. M. (2019). Executive functioning in adolescent anorexia nervosa: Neuropsychology versus self- and parental-report. Child Neuropsychology, 25(6), 816–835. https://doi.org/10.1080/09297049.2018.1536200 · DOI
- Johnco, C., Wuthrich, V. M., & Rapee, R. M. (2014). Reliability and validity of two self-report measures of cognitive flexibility. Psychological Assessment, 26(4), 1381–1387. https://doi.org/10.1037/a0038009 · DOI
- Kortte, K. B., Horner, M. D., & Windham, W. K. (2002). The Trail Making Test, Part B: Cognitive flexibility or ability to maintain set? Applied Neuropsychology, 9(2), 106–109. https://doi.org/10.1207/S15324826AN0902_5 · DOI · Paper page
- Lie, C.-H., Specht, K., Marshall, J. C., & Fink, G. R. (2006). Using fMRI to decompose the neural processes underlying the Wisconsin Card Sorting Test. NeuroImage, 30(3), 1038–1049. https://doi.org/10.1016/j.neuroimage.2005.10.031 · DOI · Paper page
- McCallum, R. S. (2017). Handbook of nonverbal assessment. https://doi.org/10.1007/978-3-319-50604-3 · doi:10.1007/978-3-319-50604-3
- Miyake, A., Emerson, M. J., & Friedman, N. P. (2000). Assessment of executive functions in clinical settings: Problems and recommendations. Seminars in Speech and Language, 21(2), 169–183. · DOI · Paper page
- O’Donnell, J. P., Macgregor, L. A., Dabrowski, J. J., Oestreicher, J. M., & Romero, J. J. (1994). Construct validity of neuropsychological tests of conceptual and attentional abilities. Journal of Clinical Psychology, 50(4), 596–600. https://doi.org/10.1002/1097-4679(199407)50:4<596::AID-JCLP2270500416>3.0.CO;2-S · DOI
- Øverås, M., Kapstad, H., Brunborg, C., Landrø, N. I., & Lask, B. (2015). Are poor set-shifting abilities associated with a higher frequency of body checking in anorexia nervosa? Journal of Eating Disorders, 3(1), 1–8. https://doi.org/10.1186/s40337-015-0053-3 · DOI
- Perpiñá, C., Segura, M., & Sanchez-Reales, S. (2017). Cognitive flexibility and decision-making in eating disorders and obesity. Eating and Weight Disorders, 22(3), 435–444. https://doi.org/10.1007/s40519-016-0331-3 · DOI
- Pignatti, R., & Bernasconi, V. (2013). Personality, clinical features, and test instructions can affect executive functions in eating disorders. Eating Behaviors, 14(2), 233–236. https://doi.org/10.1016/j.eatbeh.2012.12.003 · DOI
- Rabin, L. A., Barr, W. B., & Burton, L. A. (2005). Assessment practices of clinical neuropsychologists in the United States and Canada: A survey of INS, NAN, and APA Division 40 members. Archives of Clinical Neuropsychology, 20(1), 33–65. https://doi.org/10.1016/j.acn.2004.02.005 · DOI · Paper page
- Reitan, R. M. (1958). Validity of the Trail Making Test as an indicator of organic brain damage. Perceptual and Motor Skills, 8, 271–276. · DOI · Paper page
- Specht, K., Lie, C.-H., Shah, N. J., & Fink, G. R. (2009). Disentangling the prefrontal network for rule selection by means of a non-verbal variant of the Wisconsin Card Sorting Test. Human Brain Mapping, 30(5), 1734–1743. https://doi.org/10.1002/hbm.20637 · DOI
- Strauss, E., Sherman, E. M. S., & Spreen, O. (2006). A compendium of neuropsychological tests: Administration, norms, and commentary (3rd ed.). Oxford University Press.
- Tchanturia, K., Davies, H., Roberts, M., Harrison, A., Nakazato, M., Schmidt, U., … Morris, R. (2012). Poor cognitive flexibility in eating disorders: Examining the evidence using the Wisconsin Card Sorting Task. PLoS ONE, 7(1). https://doi.org/10.1371/journal.pone.0028331 · DOI · Paper page
- Vall, E., & Wade, T. D. (2015). Trail Making Task performance in inpatients with anorexia nervosa and bulimia nervosa. European Eating Disorders Review, 23(4), 304–311. https://doi.org/10.1002/erv.2364 · DOI
- Van Autreve, S., De Baene, W., Baeken, C., van Heeringen, C., & Vervaet, M. (2013). Do restrictive and bingeing/purging subtypes of anorexia nervosa differ on central coherence and set shifting? European Eating Disorders Review, 21(4), 308–314. https://doi.org/10.1002/erv.2233 · DOI
- Wollenhaupt, C., Wilke, L., Erim, Y., Rauh, M., Steins-Loeber, S., & Paslakis, G. (2019). The association of leptin secretion with cognitive performance in patients with eating disorders. Psychiatry Research, 276, 269–277. https://doi.org/10.1016/j.psychres.2019.05.001 · DOI
- Wu, M., Brockmeyer, T., Hartmann, M., Skunde, M., Herzog, W., & Friederich, H.-C. (2014). Set-shifting ability across the spectrum of eating disorders and in overweight and obesity: A systematic review and meta-analysis. Psychological Medicine, 44(16), 3365–3385. https://doi.org/10.1017/S0033291714000294 · DOI · Paper page
- Zmigrod, L., Rentfrow, P. J., & Robbins, T. W. (2018). Cognitive underpinnings of nationalistic ideology in the context of Brexit. Proceedings of the National Academy of Sciences of the United States of America, 115(19), E4532–E4540. https://doi.org/10.1073/pnas.1708960115 · DOI
Cited by
Anxiety disorders and executive functions: A three-level meta-analysis of reaction time and accuracy
Majeed, N. M., Chua, Y. J., Kothari, M., Kaur, M., Quek, F. Y. X., Ng, M. H. S., Ng, W. Q., & Hartanto, A. (2023) · Psychiatry Research Communications · doi:10.1016/j.psycom.2022.100100 · Cited by 31
Baughman, F. D., Cook, S. A., Treasure, S. K., Morley, A., Dauer, E., & Haywood, D. (2025) · Australian Journal of Psychology · doi:10.1080/00049530.2024.2435318 · Cited by 2
Kaloğlu, H. A., Ünler, M., Koparal, B., Utku, Ç., & Yüksel, N. (2026) · Brain Sciences · doi:10.3390/brainsci16090922
“These indices were selected because they reflect key components of executive functioning, including concept formation, cognitive flexibility, and set shifting [21,22].”
Metadata
- Authors
- Miles, S., Howlett, C. A., Berryman, C., Nedeljkovic, M., Moseley, G. L., & Phillipou, A.
- Venue
- Behavior Research Methods
- Published
- 2021-03-22
- Volume
- 53
- Issue
- 5
- Pages
- 2083-2091
- ISSN
- 1554-351X (ISSN-L)
- 1554-3528
- OpenAlex
- W3135923138
- Cited by
- 189
- References
- 13
- FWCI
- 12.20
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Funders
- National Health and Medical Research Council (Project Grant [ID 1159953])
- Australian Government (Research Training Program Scholarship)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Considerations for using the Wisconsin Card Sorting Test to assess cognitive flexibility. https://app.cochat.ai/papers/10.3758/s13428-021-01551-3
- The paper
- Miles, S., Howlett, C. A., Berryman, C., Nedeljkovic, M., Moseley, G. L., & Phillipou, A. (2021). Considerations for using the Wisconsin Card Sorting Test to assess cognitive flexibility. Behavior Research Methods. https://doi.org/10.3758/s13428-021-01551-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.