The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Sensitivity and specificity of WAIS–III/WMS–III demographically corrected factor scores in neuropsychological assessment
Abstract
This study explored the neurodiagnostic utility of 6 factor scores identified by recent exploratory and confirmatory factor analyses of the WAIS–III and WMS–III: Verbal Comprehension, Perceptual Organization, Processing Speed, Working Memory, Auditory Memory and Visual Memory. Factor scores were corrected for age, education, sex and ethnicity to minimize their influences on diagnostic accuracy. Cut-offs at 1, 1.5 and 2 standard deviations (SD s) below the standardization sample mean were applied to data from the overlapping test normative samples (N = 1073) and 6 clinical samples described in the WAIS–III/WMS–III Technical Manual (N = 126). The analyses suggest that a 1 SD cut-off yields the most balanced levels of sensitivity and specificity; more strict (1.5 or 2 SD) cut-offs generally result in trading modest gains in specificity for larger losses in sensitivity. Finally, using combinations of WAIS–III/WMS–III factors together as test batteries, we explored the sensitivity and specificity implications of varying diagnostic decision rules (e.g., 1 vs. 2 impaired factors = “impairment”). For most of the disorders considered here, even a small (e.g., 3 factor) WAIS–III/WMS–III battery provides quite good overall diagnostic accuracy. (JINS, 2001, 7, 867–874.)
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“and several studies suggest that a cut-point for impairment of -1 SD below normative means provides an optimal balance of sensitivity and specificity [25, 44, 45].”
From Neuropsychological Criteria for Mild Cognitive Impairment Improves Diagnostic Precision, Biomarker Associations, and Progression Rates (2014) · cites this paper as [45]
In the citing paper
“More strict cut-points on cognitive tests of -1.5 or -2 SDs below normative means generally trade modest gains in specificity for larger losses in sensitivity [44, 45]”
From Neuropsychological Criteria for Mild Cognitive Impairment Improves Diagnostic Precision, Biomarker Associations, and Progression Rates (2014) · cites this paper as [45]
In the citing paper
“Demographically-corrected norms demonstrate better accuracy with less demographic bias (Casaletto et al., 2015; R. K. Heaton, Ryan, L., & Grant, I., 2009; Taylor & Heaton, 2001) on cognitive measures than age-only adjusted scores in neurological populations.”
From Using the NIH Toolbox Cognition Battery (NIHTB-CB) in individuals with traumatic brain injury. (2017) · cites this paper as Taylor & Heaton, 2001
Citations
Cites
Regression Using Fractional Polynomials of Continuous Covariates: Parsimonious Parametric Modelling
Royston, P. J., & Altman, D. G. (1994) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2986270 · Cited by 1,797
CATTELL, J. M. (1923) · The Annals of the American Academy of Political and Social Science · doi:10.1177/000271622311000117 · Cited by 911
Heaton, Grant, and Matthews' Comprehensive Norms: An Overzealous Attempt
Fastenau, P. S., & Adams, K. M. (1996) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/01688639608409000 · Cited by 44
Demographic Corrections with Comprehensive Norms: An Overzealous Attempt or a Good Start?
Heaton, R. K., Matthews, C. G., Grant, I., & Avitable, N. (1996) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/01688639608409001 · Cited by 23
Self-citation
Cited by
Sorted by citations
Items 101–174 of 174
Gupta, S. K., Iudicello, J. E., Shi, C., Letendre, S. L., Knight, A. F., Li, J., Riggs, P. K., Franklin, D. R., Duarte, N. A., Jin, H., et al. (2014) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2013.12.021 · Cited by 20
Self-citationExploratory analysis of normative performance on the UCSD Performance‐Based Skills Assessment‐Brief
Vella, L., Patterson, T. L., Harvey, P. D., McClure, M. M., Mausbach, B. T., Taylor, M. J., & Twamley, E. W. (2017) · Psychiatry Research · doi:10.1016/j.psychres.2017.06.025 · Cited by 19
Self-citationSmell identification in individuals at clinical high risk for schizophrenia
Gill, K. E., Evans, E., Jürgen Kayser, A., Ben‐David, S., Walsh‐Messinger, J., Bruder, G. E., Malaspina, D., & Corcoran, C. M. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2014.07.018 · Cited by 18
Dunham, K. J., Shadi, S., Sofko, C. A., Denney, R. L., & Calloway, J. (2014) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acu042 · Cited by 17
Bruzzone, S. E. P., Lumaca, M., Brattico, E., Vuust, P., Kringelbach, M. L., & Bonetti, L. (2022) · Scientific Reports · doi:10.1038/s41598-022-08521-5 · Cited by 19
Foley, J. A., Foltynie, T., Limousin, P. D., & Lisa Cipolotti, A. (2018) · Parkinson s Disease · doi:10.1155/2018/4328371 · Cited by 17
NILSSON, M. H. L., Lundh, L., Westrin, Å., & Westling, S. (2021) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2021.1894094 · Cited by 23
Pugh, E., Robinson, A. D., Vito, A. N. D., Bernstein, J. P. K., & Calamia, M. R. (2021) · The Clinical Neuropsychologist · doi:10.1080/13854046.2021.1958923 · Cited by 16
Validation of a Novel Multivariate Method of Defining HIV-Associated Cognitive Impairment
Underwood, J., Francesco, D. D., Cole, J. H., Caan, M. W. A., van Zoest, R. A., Schmand, B. A., Sharp, D. J., Sabin, C. A., Reiss, P., Winston, A., et al. (2019) · Open Forum Infectious Diseases · doi:10.1093/ofid/ofz198 · Cited by 15
An Investigation of the General Abilities Index in a Group of Diagnostically Mixed Patients
Harrison, A. G., DeLisle, M. M., & Parker, K. C. H. (2007) · Journal of Psychoeducational Assessment · doi:10.1177/0734282907304032 · Cited by 15
Tremblay, C., Monetta, L., Langlois, M., & Schneider, C. (2015) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2015.09.002 · Cited by 15
Empirical evidence for cognitive subgroups in body dysmorphic disorder
Malcolm, A., Brennan, S. N., Grace, S., Pikoos, T. D., Toh, W. L., Labuschagne, I., Buchanan, B. G., Kaplan, R. A., Castle, D. J., & Rossell, S. L. (2021) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867421998762 · Cited by 15
Clinical Utility of Demographically Corrected WAIS-III Subtest Scores After Traumatic Brain Injury
Blake, T. M., Fichtenberg, N. L., & Abeare, C. A. (2008) · The Clinical Neuropsychologist · doi:10.1080/13854040802279691 · Cited by 14
Iverson, G. L., & Karr, J. E. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.724888 · Cited by 13
The Association Between Metabolic Disturbance and Cognitive Impairments in Early-Stage Schizophrenia
Peng, X., Hei, G., Li, R., Yang, Y., Liu, C., Xiao, J., Long, Y., Shao, P., Huang, J., Zhao, J., et al. (2021) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.599720 · Cited by 13
Kohli, M., Fisher, A., Sun-Suslow, N., Heaton, A., Dawson, M., Marquie‐Beck, J., Franklin, D. R., Marquine, M. J., Iudicello, J. E., Heaton, R. K., et al. (2022) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617722000777 · Cited by 13
Self-citationNitsch, K. P., Casaletto, K. B., Carlozzi, N. E., Tulsky, D. S., Heinemann, A. W., & Heaton, R. K. (2017) · Rehabilitation Psychology · doi:10.1037/rep0000122 · Cited by 14
Self-citationMatías‐Guiu, J. A., Cortés‐Martínez, A., Curiel, R. E., Delgado‐Álvarez, A., Fernández-Oliveira, A., Pytel, V., Montero, P., Moreno‐Ramos, T., Loewenstein, D., & Matías‐Guiu, J. (2020) · Frontiers in Neurology · doi:10.3389/fneur.2020.00309 · Cited by 13
Validity of Demographically Corrected Norms for the WAIS–III
Strong, C.-A. H., Donders, J., & Dyke, S. V. (2005) · Journal of Clinical and Experimental Neuropsychology · doi:10.1081/13803390490919155 · Cited by 13
NIH toolbox premorbid ability adjustments: Application in a traumatic brain injury sample.
Holdnack, J. A., Tulsky, D. S., Slotkin, J., Tyner, C. E., Gershon, R. C., Iverson, G. L., & Heinemann, A. W. (2017) · Rehabilitation Psychology · doi:10.1037/rep0000198 · Cited by 14
Doing and reporting a neuropsychological assessment
Jurado, M. Á., & Pueyo, R. (2012) · Dipòsit Digital de la Universitat de Barcelona (Universitat de Barcelona) · Cited by 11
Serrano, V. B., Montoya, J. L., Campbell, L. M., Sundermann, E. E., Iudicello, J. E., Letendre, S. L., Heaton, R. K., & Moore, D. J. (2021) · Journal of NeuroVirology · doi:10.1007/s13365-021-01001-y · Cited by 10
Self-citationFactors influencing employment after minor stroke and NSTEMI
Morsund, Å. H., Ellekjær, H., Gramstad, A., Reiestad, M. T., Midgard, R., Sando, S. B., Jonsbu, E., & Næss, H. (2020) · Journal of Stroke and Cerebrovascular Diseases · doi:10.1016/j.jstrokecerebrovasdis.2020.105036 · Cited by 10
Association of physical and mental symptoms with cognition in people with spinal cord injury.
Carlozzi, N. E., GRAVES, C. M., Troost, J. P., Ehde, D. M., Miner, J. A., & Kratz, A. L. (2021) · Rehabilitation Psychology · doi:10.1037/rep0000416 · Cited by 10
Walker, A., Batchelor, J., Shores, E. A., & JONES, M. (2009) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617709990610 · Cited by 11
Holdnack, J. A., Lissner, D., Bowden, S. C., & McCarthy, K. A. L. (2004) · Australian Psychologist · doi:10.1080/00050060412331295072 · Cited by 10
Demographic Adjustments to WAIS–IV/WMS–IV Norms
Holdnack, J. A., & Weiss, L. G. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-386934-0.00004-3 · Cited by 9
Structural Validity of the Dutch-Language Version of the WAIS-III in a Psychiatric Sample
van der Heijden, P. T., van den Bos, P., Mol, B. A. W., & Kessels, R. P. C. (2012) · Applied Neuropsychology Adult · doi:10.1080/09084282.2012.670166 · Cited by 9
How Normal Are “Normal” Errors of Language and Cognition?
Cohen, M. L., Weatherford, S., & Nandakumar, R. (2019) · Journal of Speech Language and Hearing Research · doi:10.1044/2018_jslhr-l-18-0215 · Cited by 9
Hessen, E., Kirsebom, B., Eriksson, C. M., Eliassen, C. F., Nakling, A. E., Bråthen, G., Waterloo, K. K., Aarsland, D., & Fladby, T. (2018) · Journal of Alzheimer s Disease · doi:10.3233/jad-180964 · Cited by 7
Premorbid estimates of neuropsychological functioning for diverse groups
Meyers, J. E., Miller, R. M., Rohling, M. L., & Kalat, S. S. (2019) · Applied Neuropsychology Adult · doi:10.1080/23279095.2018.1550412 · Cited by 8
Malcolm, A., Pikoos, T. D., Castle, D. J., & Rossell, S. L. (2021) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2021.101674 · Cited by 7
Sokal, B., Uswatte, G., Barman, J., Brewer, M., Byrom, E., Latten, J., Joseph, J., Serafim, C., Ghaffari, T., & Sarkar, N. (2013) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2013.09.013 · Cited by 6
O teste de Rorschach e a Escala WAIS-III após um e dois Anos de psicoterapia
Yázigi, L., Semer, N. L., Amaro, T. A. D. C., Fiore, M. L. D. M., da Silva, J. F. R., & Botelho, N. L. P. (2011) · Americanae (AECID Library) · doi:10.1590/s0102-79722011000100003 · Cited by 6
Neuropsychological Assessment of Moderate to Severe Traumatic Brain Injury
Patry, B. N., & Mateer, C. A. (2006) · Kluwer Academic Publishers eBooks · doi:10.1007/0-387-25610-5_19 · Cited by 6
Sofer, S., Schweiger, A., Blumkin, L., Yahalom, G., Anikster, Y., Lev, D., Ben‐Zeev, B., Lerman‐Sagie, T., & Hassin‐Baer, S. (2015) · American Journal of Medical Genetics Part B Neuropsychiatric Genetics · doi:10.1002/ajmg.b.32296 · Cited by 6
Fazeli, P. L., Hopkins, C., Vance, D. E., Wadley, V. G., Li, P., Turan, B., Bowen, P. G., & Clay, O. J. (2022) · Nursing Research and Reviews · doi:10.2147/nrr.s339200 · Cited by 6
Sleep quality and cognitive impairments in remitted patients with schizophrenia in Nigeria
Esan, O., & Ephraim‐Oluwanuga, O. T. (2021) · L Encéphale · doi:10.1016/j.encep.2020.12.004 · Cited by 5
Considerations for the Neuropsychological Evaluation of Older Ethnic Minority Populations
Mindt, M. R., Arentoft, A., Coulehan, K., & Byrd, D. (2012) · Springer eBooks · doi:10.1007/978-1-4614-3106-0_3 · Cited by 5
Ferguson, C. J., & Negy, C. (2006) · Criminal Justice and Behavior · doi:10.1177/0093854806286194 · Cited by 5
An index of decline or recovery following nonimpact and impact mTBI
Sweeney, J. E., & Johnson, A. M. (2017) · Applied Neuropsychology Adult · doi:10.1080/23279095.2017.1392304 · Cited by 4
Seizures in patients with cerebral hemiatrophy: A prognostic evaluation
Garg, R., Jaiswal, A., Malhotra, H. S., Verma, R. K., & Singh, M. K. (2014) · Annals of Indian Academy of Neurology · doi:10.4103/0972-2327.144296 · Cited by 4
EPICOG-SCH: A brief battery to screen cognitive impact of schizophrenia in stable outpatients
Domingo, S. Z., Bobes, J., García‐Portilla, M. P., & Morralla, C. (2017) · Schizophrenia Research Cognition · doi:10.1016/j.scog.2017.03.001 · Cited by 4
Gouse, H., Thomas, K. G. F., Masson, C. J., Henry, M., Joska, J. A., Cysique, L. A., Ling, S., Ye, X., Liu, J., & Robbins, R. N. (2024) · Journal of NeuroVirology · doi:10.1007/s13365-024-01235-6 · Cited by 3
Adishesa, M. S., & Halim, M. S. (2015) · ANIMA Indonesian Psychological Journal · doi:10.24123/aipj.v31i1.560 · Cited by 3
Karzmark, P., & Deutsch, G. K. (2017) · Applied Neuropsychology Adult · doi:10.1080/23279095.2017.1286347 · Cited by 3
Lu, J. N., Sun, W., Li, S., Qu, Y., Liu, T., Guo, S., Feng, C., & Yang, T. (2025) · Frontiers in Neurology · doi:10.3389/fneur.2025.1618272 · Cited by 3
Neurocognitive Deficits, Negative Symptoms, and Insight in Schizophrenia
Preda, A., Bota, R. G., & Harvey, P. D. (2011) · Springer eBooks · doi:10.1007/978-94-007-0831-0_2 · Cited by 3
Exploration of salient risk factors involved in mild cognitive impairment
Samson, A. D., Shen, K., Grady, C. L., McIntosh, A. R., & Initiative, A. D. N. (2022) · European Journal of Neuroscience · doi:10.1111/ejn.15665 · Cited by 3
Zhuo, C., Chen, G., Chen, J., Yang, L., Zhang, Q., Li, Q., Wang, L., Ma, X., Sun, Y., Jia, F., et al. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.1012428 · Cited by 2
Xie, M., Yu, X., Ye, S., Han, H., Wu, R., Liu, D., Hu, S., Xu, Y. J., Liu, H., Wang, X., et al. (2025) · Nordic Journal of Psychiatry · doi:10.1080/08039488.2025.2539782 · Cited by 1
Conducting Assessments and Psychological Evaluations with African American Clients
Benuto, L. T., & Leany, B. D. (2014) · Springer eBooks · doi:10.1007/978-1-4939-1004-5_1 · Cited by 2
Developing new reading assessments to promote beginning reading in Singapore
Koh, K., & Paris, S. G. (2010) · Asia Pacific Education Review · doi:10.1007/s12564-010-9118-9 · Cited by 1
The Impact of Age and Alzheimer’s Disease Risk Factors on Memory Performance over Time
Kaiser, N. C., Miller, K. J., Siddarth, P., Ercoli, L. M., & Small, G. W. (2013) · Aging Health · doi:10.2217/ahe.12.77 · Cited by 2
Self-Esteem, Tenure, and Narcissistic Leader's Performance
Peltokangas, H. (2016) · International Journal of Business and Social Research · doi:10.18533/ijbsr.v5i12.899 · Cited by 1
STUDI LITERATUR : ANALISIS PEMANFAATAN TES WAIS DALAM DIAGNOSIS ASESMEN KLINIS
Rahmah, A. N., Nurasiah, A., & Riswari, A. A. (2022) · Flourishing Journal · doi:10.17977/um070v2i12022p64-69 · Cited by 1
Language Dysfunction in Traumatic Brain Injury While Controlling for Effort
Heinly, M. T. (2007) · ScholarWorks @ The University of New Orleans (The University of New Orleans) · Cited by 1
Is Drug Testing in the Workplace Worthwhile?
Barnwell, S. S., & Earleywine, M. (2006) · doi:10.1093/acprof:oso/9780195188028.003.0003 · Cited by 1
Siekierski, B. M. (2006) · OakTrust (Texas A&M University Libraries) · Cited by 1
Bruzzone, S. E. P., Lumaca, M., Brattico, E., Vuust, P., Kringelbach, M. L., & Bonetti, L. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.10.14.464389 · Cited by 1
Graduate student WAIS III evaluation reports: Are they thorough?
Moore, D. (2010) · CommonKnowledge Research Repository (Pacific University Oregon)
van der Heijden, P. T., van den Bos, P., Mol, B. A. W., & Kessels, R. P. C. (2010) · GZ - Psychologie · doi:10.1007/s41480-010-0045-5
Behavioural Correlates of Cognitive Skill Learning in Parkinson's Disease
Beauchamp, M. H., Dagher, A., Panisset, M., & Doyon, J. (2008) · The Open Behavioral Science Journal · doi:10.2174/1874230000802010001
Chemotherapy for Cancer and the Aging Brain: Blessing or Burden?
Morin, R. T., & Midlarsky, E. (2016) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2016.08.421
Fehlmann, B., & Jokeit, H. (2017) · Neurology International Open · doi:10.1055/s-0043-103267
Fehlmann, B., & Jokeit, H. (2017) · Aktuelle Neurologie · doi:10.1055/s-0043-103273
Moss, N. C., Erickson, S. J., Lowe, J. R., Verney, S. P., & Ho, J. W. C. (2019) · UNM’s Digital Repository (University of New Mexico)
(2011) · Wiley eBooks · doi:10.1002/9781119961307.refs
Measuring executive and underlying cognitive functions in schoolchildren in Ukraine
Toornstra (2019) · Research Publications (Maastricht University) · doi:10.26481/dis.20191204at
Executive function in adolescents with obesity: A systematic review and meta-analysis
Asgeirsdottir, U. A., Janssen, L., Villringer, A., & Witte, A. V. (2026) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2026.106828 · Cited by 1
Brew, B. J., & Cysique, L. A. (2026) · Current Opinion in HIV and AIDS · doi:10.1097/coh.0000000000001053
Klein, H., Fan, R. H., Ge, T., Asgharnejad, M., Brady, C., Hanson, E., Harvey, P. D., Sedway, J., Murthy, V., Keefe, R. S. E., et al. (2026) · Schizophrenia Research · doi:10.1016/j.schres.2026.07.021
Metadata
- Authors
- TAYLOR, M. J., & HEATON, R. K.
- Affiliations
- University of California San Diego (US)
- ORCID
- HEATON, ROBERT K.
- Venue
- Journal of the International Neuropsychological Society
- Publisher
- Cambridge University Press (CUP)
- Published
- 2001-11
- Volume
- 7
- Issue
- 7
- Pages
- 867-874
- ISSN
- 1355-6177 (ISSN-L)
- 1469-7661
- OpenAlex
- W2139390659
- Cited by
- 174
- References
- 5
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 2 · 2023: 3 · 2022: 9 · 2021: 15 · 2020: 5 · 2019: 10 · 2018: 6 · 2017: 16 · 2016: 5 · 2015: 11 · 2014: 9 · 2013: 8 · 2012: 6
- FWCI
- 4.82
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the International Neuropsychological Society (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Keywords
- WAIS-III, WMS-III, factor scores, sensitivity and specificity, diagnostic accuracy, cut-off values, verbal comprehension, perceptual organization, processing speed, working memory, auditory memory, visual memory, neuropsychological assessment, diagnostic decision rules, cognitive impairment diagnosis
- MeSH terms
- Adult, Aged, Aged, 80 and over, Brain Damage, Chronic, Brain Diseases, Disability Evaluation, Female, Humans, Intelligence, Male, Middle Aged, Psychometrics, Mental Recall, Reference Standards, Wechsler Scales, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review