Cited by 196Cognitive Abilities and TestingDevelopmental and Educational NeuropsychologyNeural and Behavioral Psychology Studies

NIH Toolbox Cognition Battery (NIHTB-CB): List Sorting Test to Measure Working Memory

Open access
Tulsky, David S., Carlozzi, Noelle, Chiaravalloti, Nancy D., Beaumont, Jennifer L., Kisala, Pamela A., Mungas, Dan, Conway, Kevin, Gershon, Richard·2014·Journal of the International Neuropsychological Society

Abstract

The List Sorting Working Memory Test was designed to assess working memory (WM) as part of the NIH Toolbox Cognition Battery. List Sorting is a sequencing task requiring children and adults to sort and sequence stimuli that are presented visually and auditorily. Validation data are presented for 268 participants ages 20 to 85 years. A subset of participants ( N =89) was retested 7 to 21 days later. As expected, the List Sorting Test had moderately high correlations with other measures of working memory and executive functioning (convergent validity) but a low correlation with a test of receptive vocabulary (discriminant validity). Furthermore, List Sorting demonstrates expected changes over the age span and has excellent test–retest reliability. Collectively, these results provide initial support for the construct validity of the List Sorting Working Memory Measure as a measure of working memory. However, the relationship between the List Sorting Test and general executive function has yet to be determined. ( JINS , 2014, 20 , 1–12)

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1017/s135561771400040x

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

No citation lists for this paper

No citation lists for this paper yet — checked again daily.

References 111 · Cited by 196

Research works printed but not linked: 15

  1. Baddeley A 1986 Working Memory Oxford, England Oxford University Press
  2. Baddeley A 1987 Working Memory 11 Clarendon Press
  3. Baddeley A Hitch GJ Bower GH 1974 Working Memory The psychology of learning and motivation: Advances in research and theory 8 47 90 San Diego, CA Academic Press
  4. D’Esposito M Onishi K Thompson H Robinson K Armstrong C Grossman M 1996 10 51 56 8822732 W. m. i. i. m. s. N 1996 Working memory impairments in multiple sclerosis Neuropsychology 10 51 56
  5. Dunn LM Dunn DM 2007 Peabody Picture Vocabulary Test 4 Minneapolis, MN NCS Pearson
  6. Engle RW Richardson J 1996 Working memory and retrieval: An inhibition-resource approach Working Memory and Human Cognition 89 119 New York Oxford University Press
  7. Fuster JM 1989 The Prefrontal Cortex New York Raven Press
  8. Heaton RK Taylor MJ Manly J Tulsky DS 2003 Demographic Effects and Use of Demographically Corrected Norms with the WAIS-III and WMS-III Clinical Interpretation of the WAIS-III and WMS-III 181 210 San Diego Academic Press
  9. Jonides J EES DNO 1995 Working memory and thinking Invitation to Cognitive Science: Thinking 2 3 215 265 Cambridge, MA MIT Press
  10. Logie RH Richardson J 1996 The seven ages of working memory Working memory and human cognition 31 65 New York Oxford University Press
  11. Milner B Warren JM Akert K 1964 Some effects of frontal lobectomy in man The Frontal Granular Cortex and Behavior 313 334 New York McGraw-Hill
  12. Miyake A Shah P 1999 Models of Working Memory: Mechanisms of Active Maintenance and Executive Control New York Cambridge University Press
  13. Newell A Chase WG 1973 Productions systems: Models of control structures Visual Information Processing 463 526 New York Academic Press
  14. Strauss E Sherman EMS Spreen O 2006 A compendium of neuropsychological tests: Administration, norms, and commentary 3 Oxford; New York Oxford University Press
  15. Tulsky DS Saklofske DH Zhu J 2003 Revising a Standard: Evaluation of the Origin and Development of the WAIS-III Clinical Interpretation of the WAIS-III and WMS-III 43 92 San Diego Elsevier Science

Authors
Tulsky, D. S., Carlozzi, N., Chiaravalloti, N. D., Beaumont, J. L., Kisala, P. A., Mungas, D., Conway, K., & Gershon, R.
Affiliations
  • Kessler Foundation (US)
  • University of Michigan (US)
  • Northwestern University (US)
  • NYU Langone Health (US)
  • University of California, Davis (US)
  • National Institutes of Health (US)
Corresponding author
Tulsky, David S.
Venue
Journal of the International Neuropsychological Society
Published
2014-06-24
Volume
20
Issue
6
Pages
599-610
ISSN
  • 1355-6177 (ISSN-L)
  • 1469-7661
OpenAlex
W2127949904
Cited by
196
References
111
Citations by year
2026: 24 · 2025: 30 · 2024: 24 · 2023: 14 · 2022: 30 · 2021: 31 · 2020: 15 · 2019: 7 · 2018: 9 · 2017: 7 · 2016: 3 · 2015: 2
FWCI
5.06
Type
journal article
Language
en
Open access
Locations
  • Journal of the International Neuropsychological Society (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
  • eScholarship (California Digital Library) (submittedVersion)
Funders
  • National Institutes of Health (n01ag60007-17-0-2)
  • National Institute on Aging (P30AG010129, R01AG010220, N01 AG060007)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
  • Social Sciences › Psychology › Neuropsychology and Physiological Psychology › Developmental and Educational Neuropsychology
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Keywords
working memory, NIH Toolbox Cognition Battery, cognitive assessment, test-retest reliability, construct validity, convergent validity, discriminant validity, age differences, executive function, children and adults
MeSH terms
Adult, Aged, Aged, 80 and over, Cognition, Female, Humans, Male, Memory, Short-Term, Middle Aged, National Institutes of Health (U.S.), Neuropsychological Tests, Time Factors, United States, Validation Studies as Topic, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review