Digital neuropsychology: Challenges and opportunities at the intersection of science and software
The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Digital devices are now broadly accessible and have the capacity to measure aspects of human behavior with high precision and accuracy, in a standardized manner. The purpose of this article is to characterize opportunities and barriers for modern digital neuropsychology, particularly those that are unique to digital assessment. METHODS: We provide a critical overview of the state-of-the-art in digital neuropsychology, focusing on personal digital devices. RESULTS: We identify three major barriers associated with digital neuropsychology, which affect both the interpretation of test scores and test norms: (1) variability in the perceptual, motor and cognitive demands of the same test across digital device classes (e.g. personal computer, tablet and smartphone); (2) hardware and software variability between devices within the same class that affect stimulus presentation and measurement and (3) rapid changes over time in hardware, software and device ownership, which can lead to rapid obsolescence of particular tests and test norms. We offer specific recommendations to address these barriers and outline new opportunities to understand and measure neuropsychological functioning over time and in everyday environments. CONCLUSIONS: Digital neuropsychology provides new approaches for measuring and monitoring neuropsychological functioning, informed by an understanding of the limitations and potential of digital technology.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Third, rapid obsolescence of particular tests and test norms has to be considered as a result of fast iterations over time in both hardware and software (32).”
From Research on digital tool in cognitive assessment: a bibliometric analysis (2023) · cites this paper as [32]
Citations
Cites
Validity of the Trail Making Test as an Indicator of Organic Brain Damage
Reitan, R. M. (1958) · Perceptual and Motor Skills · doi:10.2466/pms.1958.8.3.271 · Cited by 7,928
User Centered System Design: New Perspectives on Human-computer Interaction
Norman, D. A., & Draper, S. W. (1986) · CRC Press eBooks · doi:10.1201/b15703 · Cited by 3,132
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708 · cited 1×
“…dedicated to open source software and related solutions — companies such as the nonprofit Center for Open Science (Foster & Deardorff, 2017; Nosek et al., 2015) and Sage Bionetworks (Bot et al., 2016; Wilbanks & Friend, 2016) — have demonstrated it is possible to build viable business…”
BackgroundjsPsych: A JavaScript library for creating behavioral experiments in a Web browser
de Leeuw, J. R. (2015) · Behavior Research Methods · doi:10.3758/s13428-014-0458-y · Cited by 1,778
Cognition assessment using the NIH Toolbox
Weintraub, S., Dikmen, S. S., Heaton, R. K., Tulsky, D. S., Zelazo, P. D., Bauer, P. J., Carlozzi, N. E., Slotkin, J., Blitz, D., Wallner-Allen, K., et al. (2013) · Neurology · doi:10.1212/wnl.0b013e3182872ded · Cited by 1,287 · cited 1×
“…— companies such as the nonprofit Center for Open Science (Foster & Deardorff, 2017; Nosek et al., 2015) and Sage Bionetworks (Bot et al., 2016; Wilbanks & Friend, 2016) — have demonstrated it is possible to build viable business models around open source software in ways that could be…”
BackgroundVision assessment using the NIH Toolbox
Varma, R., McKean-Cowdin, R., Vitale, S., Slotkin, J., & Hays, R. D. (2013) · Neurology · doi:10.1212/wnl.0b013e3182876e0a · Cited by 1,178
Chaytor, N., & Schmitter-Edgecombe, M. (2003) · Neuropsychology Review · doi:10.1023/b:nerv.0000009483.91468.fb · Cited by 1,055
Self-citationDigital Phenotyping: Technology for a New Science of Behavior
Insel, T. R. (2017) · JAMA · doi:10.1001/jama.2017.11295 · Cited by 833
Harnessing Smartphone-Based Digital Phenotyping to Enhance Behavioral and Mental Health
Onnela, J.-P., & Rauch, S. L. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.7 · Cited by 726 · cited 1×
“Personal digital devices and wearables are also equipped with increasingly sophisticated audiovisual and sensor technology (Onnela & Rauch, 2016), permitting the collection of primary and secondary data about behavior that can supplement traditional neuropsychological assessment (Giannouli, Bock, &…”
BackgroundFoster, E. D., & Deardorff, A. (2017) · Journal of the Medical Library Association · doi:10.5195/jmla.2017.88 · Cited by 715 · cited 2×
“Organizations dedicated to open source software and related solutions — companies such as the nonprofit Center for Open Science (Foster & Deardorff, 2017; Nosek et al., 2015) and Sage Bionetworks (Bot et al., 2016; Wilbanks & Friend, 2016) — have demonstrated it is possible to build viable business…”
Background
Research works printed but not linked: 6
- Anderson M., 2017, Technology use among seniors
- Byrom B., 2017, Scoliosis, 6, 4
- Climent G., 2011, AULA, ecological evaluation of attentional processes
- Hyun J., 2018, The Journal of Gerontology: Series B
- Koudritzky M., 2017, GitHub
- Siegal J, 2013, BGR
Cited by
The promise of machine learning in predicting treatment outcomes in psychiatry
Chekroud, A. M., Bondar, J., Delgadillo, J., Doherty, G., Wasil, A., Fokkema, M., Cohen, Z., Belgrave, D., DeRubeis, R., Iniesta, R., et al. (2021) · World Psychiatry · doi:10.1002/wps.20882 · Cited by 531
Revisiting the seven pillars of RDoC
Morris, S. E., Sanislow, C. A., Pacheco, J., Vaidyanathan, U., Gordon, J. A., & Cuthbert, B. N. (2022) · BMC Medicine · doi:10.1186/s12916-022-02414-0 · Cited by 174
Weizenbaum, E. L., Torous, J. B., & Fulford, D. (2020) · JMIR mhealth and uhealth · doi:10.2196/14328 · Cited by 95
Harris, C., Tang, Y., Birnbaum, E., Cherian, C., Mendhe, D., & Chen, M. H. (2024) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acae016 · Cited by 94
The TestMyBrain Digital Neuropsychology Toolkit: Development and Psychometric Characteristics
Singh, S. M., Strong, R. W., Jung, L., Li, F. H., Grinspoon, E. A., Scheuer, L., Passell, E. J., Martini, P., Chaytor, N. S., Soble, J. R., et al. (2021) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2021.2002269 · Cited by 92
Self-citation
Metadata
- Authors
- Germine, L., Reinecke, K., & Chaytor, N. S.
- Affiliations
- Harvard University (US)
- University of Washington (US)
- Washington State University Spokane (US)
- Corresponding author
- Germine, Laura
- Venue
- The Clinical Neuropsychologist
- Publisher
- Informa UK Limited
- Published
- 2019-01-06
- Volume
- 33
- Issue
- 2
- Pages
- 271-286
- ISSN
- 0920-1637 (ISSN-L)
- 1385-4046
- 1744-4144
- OpenAlex
- W2909802658
- Cited by
- 171
- References
- 63
- Citations by year
- 2026: 23 · 2025: 30 · 2024: 33 · 2023: 14 · 2022: 22 · 2021: 26 · 2020: 17 · 2019: 6
- FWCI
- 20.10
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Clinical Neuropsychologist (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Diabetes and Digestive and Kidney Diseases (R01DK121240)
- Topics
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Keywords
- digital assessment, personal digital devices, test norms, device variability, stimulus presentation, everyday environments, tablets, personal computers
- MeSH terms
- Smartphone, Humans, Neuropsychological Tests, Neuropsychology, Software, Therapy, Computer-Assisted, Telemedicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Digital neuropsychology: Challenges and opportunities at the intersection of science and software. https://app.cochat.ai/papers/10.1080/13854046.2018.1535662
- The paper
- Germine, L., Reinecke, K., & Chaytor, N. S. (2019). Digital neuropsychology: Challenges and opportunities at the intersection of science and software. The Clinical Neuropsychologist. https://doi.org/10.1080/13854046.2018.1535662
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.