The DOI matches its Crossref record; 84 of the 84 references it cites were found in a registry or an index.
Computerized Neuropsychological Assessment Devices: Joint Position Paper of the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology
Open accessAbstract
This joint position paper of the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology sets forth our position on appropriate standards and conventions for computerized neuropsychological assessment devices (CNADs). In this paper, we first define CNADs and distinguish them from examiner-administered neuropsychological instruments. We then set forth position statements on eight key issues relevant to the development and use of CNADs in the healthcare setting. These statements address (a) device marketing and performance claims made by developers of CNADs; (b) issues involved in appropriate end-users for administration and interpretation of CNADs; (c) technical (hardware/software/firmware) issues; (d) privacy, data security, identity verification, and testing environment; (e) psychometric development issues, especially reliability, and validity; (f) cultural, experiential, and disability factors affecting examinee interaction with CNADs; (g) use of computerized testing and reporting services; and (h) the need for checks on response validity and effort in the CNAD environment. This paper is intended to provide guidance for test developers and users of CNADs that will promote accurate and appropriate use of computerized tests in a way that maximizes clinical utility and minimizes risks of misuse. The positions taken in this paper are put forth with an eye toward balancing the need to make validated CNADs accessible to otherwise underserved patients with the need to ensure that such tests are developed and utilized competently, appropriately, and with due concern for patient welfare and quality of care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
“Ethical Principles of Psychologists and Code of Conduct”
(2000) · Ethical Reasoning in the Mental Health Professions · doi:10.4324/9781482274400-4 · Cited by 4,251
Measurement, Design, and Analysis: An Integrated Approach.
Funk, S. G., Pedhazur, E. J., & Schmelkin, L. P. (1992) · Journal of the American Statistical Association · doi:10.2307/2290248 · Cited by 4,018
Standards for Educational and Psychological Testing
(2007) · Encyclopedia of Measurement and Statistics · doi:10.4135/9781412952644.n432 · Cited by 3,126
DMDX: A Windows display program with millisecond accuracy
Forster, K. I., & Forster, J. C. (2003) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195503 · Cited by 2,759
Gaver, W. W. (1991) · Proceedings of the SIGCHI conference on Human factors in computing systems Reaching through technology - CHI '91 · doi:10.1145/108844.108856 · Cited by 1,536
Handbook of Normative Data for Neuropsychological Assessment
Mitrushina, M., Boone, K. B., & D'Elia, L. F. (1999) · Cited by 1,127
Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., Millis, S. R., & Participants1, C. (2009) · The Clinical Neuropsychologist · doi:10.1080/13854040903155063 · Cited by 869
Symptom validity assessment: Practice issues and medical necessityNAN Policy & Planning Committee
BUSH, S., RUFF, R., TROSTER, A., BARTH, J., KOFFLER, S., PLISKIN, N., REYNOLDS, C., & SILVER, C. (2005) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2005.02.002 · Cited by 835
Self-citationEssentials of Psychological Testing
(2005) · PsyPag Quarterly · doi:10.53841/bpspag.2005.1.54.23 · Cited by 737
Lane, S. (2015) · Routledge eBooks · doi:10.4324/9780203102961 · Cited by 728
Item Response Theory and Clinical Measurement
Reise, S. P., & Waller, N. G. (2009) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.032408.153553 · Cited by 719
Sweeney, J. A., Kmiec, J. A., & Kupfer, D. J. (2000) · Biological Psychiatry · doi:10.1016/s0006-3223(00)00910-0 · Cited by 461
Effort has a greater effect on test scores than severe brain injury in compensation claimants
Green, P., Rohling, M. L., Lees-Haley, P. R., & III, L. M. A. (2001) · Brain Injury · doi:10.1080/02699050110088254 · Cited by 460
The Kaohsiung Journal of Medical Sciences
(2019) · The Kaohsiung Journal of Medical Sciences · doi:10.1002/(issn)2410-8650 · Cited by 446
Assessment of feigned cognitive impairment: A neuropsychological perspective.
Boone, K. B. (2007) · Cited by 439
Status of computerized cognitive testing in aging: a systematic review
Wild, K., Howieson, D., Webbe, F., Seelye, A., & Kaye, J. (2008) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2008.07.003 · Cited by 436
Neuropsychological Outcomes of Army Personnel Following Deployment to the Iraq War
Vasterling, J. J., Proctor, S. P., Amoroso, P., Kane, R., Heeren, T., & White, R. F. (2006) · JAMA · doi:10.1001/jama.296.5.519 · Cited by 412
Assessment of Malingered Neuropsychological Deficits
(2008) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0b013e31816a70cb · Cited by 352
The value added of neurocognitive testing after sports-related concussion
Van Kampen, D. A., Lovell, M. R., Pardini, J. E., Collins, M. W., & Fu, F. H. (2006) · The American Journal of Sports Medicine · doi:10.1177/0363546506288677 · Cited by 331
Test-retest reliability of computerized concussion assessment programs.
Broglio, S. P., Ferrara, M. S., Macciocchi, S. N., Baumgartner, T. A., & Elliott, R. (2007) · PubMed · Cited by 330
Duration of Cognitive Impairment After Sports Concussion
Bleiberg, J., Cernich, A. N., Cameron, K., Sun, W., Peck, K., Ecklund, L. (. J., Reeves, C. D., Uhorchak, C. J., Sparling, M. B., & Warden, D. L. (2004) · Neurosurgery · doi:10.1227/01.neu.0000118820.33396.6a · Cited by 316
Self-citationHandbook of normative data for neuropsychological assessment, 2nd ed.
Mitrushina, M., Boone, K. B., Razani, J., & D'Elia, L. F. (2005) · Cited by 309
Tracking neuropsychological recovery following concussion in sport
Iverson, G. L., Brooks, B. L., Collins, M. W., & Lovell, M. R. (2006) · Brain Injury · doi:10.1080/02699050500487910 · Cited by 305
Self-citationBoone, K. B. (2009) · The Clinical Neuropsychologist · doi:10.1080/13854040802427803 · Cited by 288
Matarazzo, J. D. (1990) · American Psychologist · doi:10.1037/0003-066x.45.9.999 · Cited by 284
The Value of Item Response Theory in Clinical Assessment: A Review
Thomas, M. L. (2011) · Assessment · doi:10.1177/1073191110374797 · Cited by 283
No cumulative effects for one or two previous concussions: Table 1
Iverson, G. L., Brooks, B. L., Lovell, M. R., & Collins, M. W. (2006) · British Journal of Sports Medicine · doi:10.1136/bjsm.2005.020651 · Cited by 281
Self-citationCollins, M., Lovell, M. R., Iverson, G. L., Ide, T., & Maroon, J. (2006) · Neurosurgery · doi:10.1227/01.neu.0000200441.92742.46 · Cited by 261
Self-citationBoard of Directors (2007) · The Clinical Neuropsychologist · doi:10.1080/13825580601025932 · Cited by 261
Reliability and Validity in Neuropsychological Assessment
Franzen, M. D. (2002) · Critical Issues in Neuropsychology · doi:10.1007/978-1-4757-3224-5 · Cited by 254
Psychological Testing on the Internet: New Problems, Old Issues.
Naglieri, J. A., Drasgow, F., Schmit, M., Handler, L., Prifitera, A., Margolis, A., & Velasquez, R. (2004) · American Psychologist · doi:10.1037/0003-066x.59.3.150 · Cited by 246
Cognition in the days following concussion: comparison of symptomatic versus asymptomatic athletes
Collie, A. (2006) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.2005.073155 · Cited by 195
Chamberlain, S. R., Robbins, T. W., Winder-Rhodes, S., Müller, U., Sahakian, B. J., Blackwell, A. D., & Barnett, J. H. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.08.019 · Cited by 178
Constantinou, M., BAUER, L., Ashendorf, L., FISHER, J., & MCCAFFREY, R. (2004) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2004.06.002 · Cited by 146
Automated Neuropsychological Assessment Metrics sports medicine battery
Cernich, A. N., REEVES, D., SUN, W. M., & Bleiberg, J. (2006) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2006.10.008 · Cited by 140
Self-citationComputerized clinical psychological test interpretations: Unvalidated plus all mean and no sigma.
Matarazzo, J. D. (1986) · American Psychologist · doi:10.1037/0003-066x.41.1.14 · Cited by 129
Identifying a cognitive impairment subgroup in adults with mood disorders
Iverson, G. L., Brooks, B. L., Langenecker, S. A., & Young, A. H. (2011) · Journal of Affective Disorders · doi:10.1016/j.jad.2011.03.001 · Cited by 124
Self-citationStevens, A., Friedel, E., Mehren, G., & Merten, T. (2007) · Psychiatry Research · doi:10.1016/j.psychres.2007.01.003 · Cited by 119
Tornatore, J. B., Hill, E., Laboff, J. A., & McGann, M. E. (2005) · Journal of Neuropsychiatry · doi:10.1176/jnp.17.1.98 · Cited by 117
Newman, T. B., & Kohn, M. A. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511759512 · Cited by 117
Sources of error in computerized neuropsychological assessment
Cernich, A. N., BRENNANA, D., Barker, L. H., & Bleiberg, J. (2006) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2006.10.004 · Cited by 108
Self-citationBrooks, B. L., Iverson, G. L., Sherman, E. M. S., & Roberge, M.-C. (2010) · Applied Neuropsychology · doi:10.1080/09084280903526083 · Cited by 106
Self-citationMarx, B. P., Brailey, K., Proctor, S. P., MacDonald, H. Z., Graefe, A. C., Amoroso, P. J., Heeren, T., & Vasterling, J. J. (2009) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2009.109 · Cited by 103
Does familiarity with computers affect computerized neuropsychological test performance?
Iverson, G. L., Brooks, B. L., Ashton, V. L., Johnson, L. G., & Gualtieri, C. T. (2008) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803390802372125 · Cited by 99
Self-citationNeurocognitive testing supports a broader concept of mild cognitive impairment
Gualtieri, C. T., & Johnson, L. G. (2005) · American Journal of Alzheimer s Disease & Other Dementias® · doi:10.1177/153331750502000607 · Cited by 97
Plant, R. R., & Turner, G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.3.598 · Cited by 96
Computerized Wisconsin Card Sorting Test: comparison with manual administration.
Tien, A. Y., Spevack, T. V., Jones, D. W., Pearlson, G. D., Schlaepfer, T. E., & Strauss, M. E. (1996) · PubMed · Cited by 96
A Comparison of Computerized and Standard Versions of the Wisconsin Card Sorting Test
Feldstein, S. N., Keller, F. R., Portman, R. E., Durham, R. L., Klebe, K. J., & Davis, H. P. (1999) · The Clinical Neuropsychologist · doi:10.1076/clin.13.3.303.1744 · Cited by 86
Doniger, G. M., Dwolatzky, T., Zucker, D. M., Chertkow, H. M., Crystal, H., Schweiger, A., & Simon, E. S. (2006) · American Journal of Alzheimer s Disease & Other Dementias® · doi:10.1177/153331750602100105 · Cited by 82
A computerized test battery sensitive to mild and severe brain injury.
Gualtieri, C. T., & Johnson, L. G. (2008) · PubMed · Cited by 80
Self-validating presentation and response timing in cognitive paradigms: How and why?
Plant, R. R., Hammond, Ν. G. L., & Turner, G. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195575 · Cited by 74
Test-Retest Reliability of Psychological and Neurobehavioral Tests Self-Administered by Computer
Campbell, K. A., Rohlman, D. S., Storzbach, D. M., Binder, L. M., Anger, W. K., Kovera, C. A., Davis, K. L., & Grossmann, S. J. (1999) · Assessment · doi:10.1177/107319119900600103 · Cited by 73
Self-citation(2007) · American Psychologist · doi:10.1037/0003-066x.62.9.993 · Cited by 72
Validity of the Mindstreams Computerized Cognitive Battery for Mild Cognitive Impairment
Dwolatzky, T., Whitehead, V., Doniger, G. M., Simon, E. S., Schweiger, A., Jaffe, D. H., & Chertkow, H. M. (2008) · Journal of Molecular Neuroscience · doi:10.1007/s12031-007-9031-9 · Cited by 68
West, L. K., Curtis, K. L., Greve, K. W., & Bianchini, K. J. (2010) · Journal of Neuropsychology · doi:10.1348/174866410x521434 · Cited by 60
Gualtieri, C. T., & Johnson, L. G. (2006) · Journal of Attention Disorders · doi:10.1177/1087054705283758 · Cited by 60
Doniger, G. M., Zucker, D. M., Schweiger, A., Dwolatzky, T., Chertkow, H. M., Crystal, H., & Simon, E. S. (2005) · Current Alzheimer Research · doi:10.2174/1567205053585792 · Cited by 58
Raymond, P. D., Hinton-Bayre, A. D., Radel, M., Ray, M. J., & Marsh, N. A. (2005) · European Journal of Cardio-Thoracic Surgery · doi:10.1016/j.ejcts.2005.10.016 · Cited by 57
Validity of the Mindstreams™ Computerized Cognitive Battery for Mild Cognitive Impairment
Dwolatzky, T., Whitehead, V., Doniger, G. M., Simon, E. S., Schweiger, A., Jaffe, D. H., & Chertkow, H. M. (2004) · Journal of Molecular Neuroscience · doi:10.1385/jmn:24:1:033 · Cited by 56
Sweet, J. J., KING, J. H., Malina, A. C., Bergman, M. A., & Simmons, A. N. (2002) · The Clinical Neuropsychologist · doi:10.1076/clin.16.4.481.13914 · Cited by 53
Timing accuracy of PC programs running under DOS and Windows
Myors, B. (1999) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03207727 · Cited by 48
Neurobehavioral deficits in Persian Gulf veterans: Evidence from a population-based study
Anger, W. K., Storzbach, D. M., Binder, L. M., Campbell, K. A., Rohlman, D. S., McCauley, L., Kovera, C. A., & Davis, K. L. (1999) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617799533031 · Cited by 48
Self-citationAn Evaluation of the Effects of Methylphenidate on Outcomes in Adult Epilepsy Patients
Moore, J. L., McAuley, J. W., Long, L., & Bornstein, R. A. (2002) · Epilepsy & Behavior · doi:10.1006/ebeh.2001.0313 · Cited by 45
Clinical psychological test interpretations by computer: Hardware outpaces software
Matarazzo, J. D. (1985) · Computers in Human Behavior · doi:10.1016/0747-5632(85)90015-9 · Cited by 43
Reaction time assessment in children with ADHD
Bolfer, C. P. M., Casella, E. B., Baldo, M. V. C., Mota, A. M., Tsunemi, M. H., Pacheco, S. P., & Reed, U. C. (2010) · Arquivos de Neuro-Psiquiatria · doi:10.1590/s0004-282x2010000200025 · Cited by 40
Neurocognitive Function of Emergency Department Patients With Mild Traumatic Brain Injury
Peterson, S. E., Stull, M. J., Collins, M. W., & Wang, H. E. (2009) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2008.10.015 · Cited by 39
Adaptive cognitive testing in dementia
Wouters, H., Zwinderman, A. H., van Gool, W. A., Schmand, B. A., & Lindeboom, R. (2009) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.283 · Cited by 38
Administering the category test by computer: Equivalence of results
Choca, J. P., & Morris, J. (1992) · The Clinical Neuropsychologist · doi:10.1080/13854049208404112 · Cited by 36
Millisecond timing on PCs and Macs
MacInnes, W. J., & Taylor, T. L. (2001) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195363 · Cited by 36
Slick, D. J., Tan, J. E., Strauss, E., Mateer, C. A., Harnadek, M. C. S., & Sherman, E. M. S. (2003) · The Clinical Neuropsychologist · doi:10.1076/clin.17.3.390.18090 · Cited by 34
DORION, A. A., Sarazin, M., Hasboun, D., Hahn‐Barma, V., Dubois, B., Zouaoui, A., Marsault, C., & Duyme, M. (2002) · Neuropsychologia · doi:10.1016/s0028-3932(01)00150-6 · Cited by 30
Computer-Based Cognitive Testing
Crook, T. H., Kay, G. G., & Larrabee, G. J. (2008) · Cited by 26
McKinney, C., MacCormac, E. R., & Welsh-Bohmer, K. A. (1999) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03207703 · Cited by 24
The Relation Between ADHD Symptoms and Fine Motor Control: A Genetic Study
Polderman, T. J. C., van Dongen, J., & Boomsma, D. I. (2010) · Child Neuropsychology · doi:10.1080/09297049.2010.518142 · Cited by 23
Micromanaging time: Measuring and controlling timing errors in computer-controlled experiments
Creeger, C. P., Miller, K. F., & Paredes, D. R. (1990) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03203120 · Cited by 21
Adaptive Cognitive Testing in Cerebrovascular Disease and Vascular Dementia
Wouters, H., de Koning, I., Zwinderman, A. H., van Gool, W. A., Schmand, B. A., Buiter, M., & Lindeboom, R. (2009) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000250593 · Cited by 13
Construct validity of the computerized version of the category test
Berger, S. G., Chibnall, J. T., & Gfeller, J. D. (1997) · Journal of Clinical Psychology · Cited by 12
An introduction to accurate display timing for PCs under 'Windows'
Gofen, A., & MacKeben, M. (1997) · Spatial Vision · doi:10.1163/156856897x00285 · Cited by 10
Clinical Procedures for the Neuropsychological Evaluation of U.S. Air Force Pilots
Retzlaff, P. D., Callister, J. D., & King, R. E. (1999) · Military Medicine · doi:10.1093/milmed/164.7.514 · Cited by 9
Computer Access for People After Stroke
Hitchcock, E. (2006) · Topics in Stroke Rehabilitation · doi:10.1310/0hwa-djn8-jupc-get1 · Cited by 8
On the question of professional standards for computer-based test interpetation.
Kramer, J. J. (1987) · American Psychologist · doi:10.1037//0003-066x.42.9.889.b · Cited by 5
McLay, R. N., Spira, J. L., & Reeves, D. (2010) · Military Medicine · doi:10.7205/milmed-d-09-00237 · Cited by 5
Environmental medicine for all: getting there from here
Ozonoff, D. M. (1995) · The Lancet · doi:10.1016/s0140-6736(95)92706-9 · Cited by 4
(1997) · PubMed
Cited by
Morrison, G. E., Simone, C. M., Ng, N. F., & Hardy, J. L. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01652 · Cited by 100
Claessen, M. H. G., van der Ham, I. J. M., & van Zandvoort, M. J. E. (2015) · Applied Neuropsychology: Adult · doi:10.1080/23279095.2014.892488 · Cited by 63
Gates, N. J., & Kochan, N. A. (2015) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000141 · Cited by 56
Faria, A. L., Latorre, J., Silva Cameirão, M., Bermúdez i Badia, S., & Llorens, R. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1233346 · Cited by 46
Web-based cognitive assessment in older adults: Where do we stand?
Belleville, S., LaPlume, A. A., & Purkart, R. (2023) · Current Opinion in Neurology · doi:10.1097/wco.0000000000001192 · Cited by 18
Metadata
- Authors
- Bauer, R. M., Iverson, G. L., Cernich, A. N., Binder, L. M., Ruff, R. M., & Naugle, R. I.
- Venue
- Archives of Clinical Neuropsychology
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-03-01
- Volume
- 27
- Issue
- 3
- Pages
- 362-373
- ISSN
- 0887-6177 (ISSN-L)
- 1873-5843
- OpenAlex
- W2038051757
- Cited by
- 267
- References
- 84
- FWCI
- 12.48
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.