The DOI matches its Crossref record; 53 of the 54 references it cites were found in a registry or an index.
Neuropsychological Test Administration by Videoconference: A Systematic Review and Meta-Analysis
Abstract
The purpose of the current systematic review and meta-analysis was to assess the effect of videoconference administration on adult neurocognitive tests. We investigated whether the scores acquired during a videoconference administration were different from those acquired during on-site administration. Relevant counterbalanced crossover studies were identified according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Twelve studies met criteria for analysis. Included samples consisted of healthy adults as well as those with psychiatric or neurocognitive disorders, with mean ages ranging from 34 to 88 years. Heterogenous data precluded the interpretation of a summary effect for videoconference administration. Studies including particpants with a mean age of 65-75, as well as studies that utilized a high speed network connection, indicated consistent performance across videoconference and on-site conditions, however studies with older participants and slower connections were more variable. Subgroup analyses indicated that videoconference scores for untimed tasks and those allowing for repetition fell 1/10th of a standard deviation below on-site scores. Test specific analyses indicated that verbally-mediated tasks including digit span, verbal fluency, and list learning were not affected by videoconference administration. Scores for the Boston Naming Test fell 1/10th of a standard deviation below on-site scores. Heterogenous data precluded meaningful interpretation of tasks with a motor component. The administration of verbally-mediated tasks by qualified professionals using existing norms was supported, and the use of visually-dependent tasks may also be considered. Variability in previous studies indicates a need for further investigation of motor-dependent tasks. We recommend the development of clinical best practices for conducting neuropsychological assessments via videoconference, and advocate for reimbursement structures that allow consumers to benefit from the increased access, convenience, and cost-savings that remote assessment provides.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Guidelines are available to allow for remote administration of this measure, and modality of administration has been shown not to affect performance [47].”
From A randomized controlled trial of yoga vs nonaerobic exercise for veterans with PTSD: Understanding efficacy, mechanisms of change, and mode of delivery (2021) · cites this paper as [47]
In the citing paper
“However, since data are still preliminary, there is no consensus on the best practices for conducting neuropsychological assessment by telemedicine (362).”
From The Multidisciplinary Approach to Alzheimer’s Disease and Dementia. A Narrative Review of Non-Pharmacological Treatment (2018) · cites this paper as [362]
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,417
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
A basic introduction to fixed-effect and random-effects models for meta-analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.12 · Cited by 6,793
Barak, A., Hen, L., Boniel-Nissim, M., & Shapira, N. (2008) · Journal of Technology in Human Services · doi:10.1080/15228830802094429 · Cited by 1,283
The Effectiveness of Telemental Health: A 2013 Review
Hilty, D. M., Ferrer, D. C., Parish, M. B., Johnston, B., Callahan, E. J., & Yellowlees, P. M. (2013) · Telemedicine and e-Health · doi:10.1089/tmj.2013.0075 · Cited by 1,048
Videoconferencing psychotherapy: a systematic review
Backhaus, A., Agha, Z., Maglione, M. L., Repp, A., Ross, B., Zuest, D., Rice-Thorp, N. M., Lohr, J., & Thorp, S. R. (2012) · Psychological Services · doi:10.1037/a0027924 · Cited by 586
The Empirical Evidence for Telemedicine Interventions in Mental Disorders
Bashshur, R. L., Shannon, G. W., Bashshur, N., & Yellowlees, P. (2015) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2015.0206 · Cited by 466
Flagged first, then by citations
1 of the 54 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Items 101–200 of 353
Chen, C., Wang, X., Han, X., & Li, Y. (2023) · Archives of Women s Mental Health · doi:10.1007/s00737-023-01327-y · Cited by 22
“Digital psychological interventions (a) overcome spatial and temporal constraints and increase access and convenience (Brearly et al. 2017), (b) improve the connectivity and flexibility of psychological interventions (Gordon et al. 2016), (c) reduce personnel costs (Osborne et al. 2019), and (d)…”
BackgroundDale, M. D., & Smith, D. (2020) · Psychology Public Policy and Law · doi:10.1037/law0000280 · Cited by 23
Sherwood, A. R., & MacDonald, B. (2020) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaa099 · Cited by 21
Left Ventricular Entry to Reduce Brain Lesions During Catheter Ablation: A Randomized Trial
Marcus, G. M., Tung, R. H., Gerstenfeld, E. P., Hue, T. F., Lin, F., Cheng, J., Weiss, J. P., Tzou, W. S., Hsia, H. H., Ehdaie, A., et al. (2025) · Circulation · doi:10.1161/circulationaha.124.071352 · Cited by 20
The COVID-19 pandemic altered the modality, but not the frequency, of formal cognitive assessment
Webb, S. S., Kontou, E., & Demeyere, N. (2021) · Disability and Rehabilitation · doi:10.1080/09638288.2021.1963855 · Cited by 20
“Encouragingly, when comparing remote and in-person assessments, research so far has shown performance to be similar across versions [15].”
BackgroundLupas, K. K., Mavrakis, A. A., Altszuler, A. R., Tower, D., Gnagy, E. M., Macphee, F. L., Ramos, M., Merrill, B. M., Ward, L., Gordon, C. T., et al. (2021) · School Psychology · doi:10.1037/spq0000474 · Cited by 22
Giromini, L., Pignolo, C., Young, G. C., Drogin, E. Y., Zennaro, A., & Viglione, D. J. (2021) · Psychological Injury and Law · doi:10.1007/s12207-021-09406-0 · Cited by 20
Remote neuropsychological evaluation of older adults
Tsiakiri, A., Koutzmpi, V., Megagianni, S., Toumaian, M., Geronikola, N., Despoti, A., Kanellopoulou, S., Arampatzi, X., Margioti, E. S., Davila, A. M., et al. (2022) · Applied Neuropsychology Adult · doi:10.1080/23279095.2022.2074850 · Cited by 20
“Another key factor is that the presented tele-neuropsych-ology protocol included tests that were previously validated for telehealth delivery, maximizing the feasibility of the assessment (Brearly et al., 2017; Carotenuto et al., 2021; Costanzo et al., 2020).”
Gardner, M. M., Aslanzadeh, F. J., Zarrella, G. V., Braun, S. E., Loughan, A. R., & Parsons, M. W. (2021) · Neuro-Oncology Practice · doi:10.1093/nop/npab021 · Cited by 21
“Characteristics of DTH-TNP patients (n = 79) Age: median (range) 59 (21-81) Sex: n (%) Male 38 (48) Female 41 (52) Highest education achieved: median (range) 16 (10-20) High school (0-12) 14 (18) Associate’s degree (13-15 y) 16 (20) Bachelor’s degree 26 (33) Graduate school (17-20+ y) 23 (29) KPS at time of evaluation…”
Bloch, A., Maril, S., & Kavé, G. (2021) · Israel Journal of Health Policy Research · doi:10.1186/s13584-021-00465-x · Cited by 19
“Retrospective observation of the tasks administered remotely during fully or partially remote assessments begun during the lockdown reveals that many were verbal in nature, in accordance with previous literature [17, 24, 30].”
BackgroundMethodResultNelson, N. W., & Plante, E. (2022) · Language Speech and Hearing Services in Schools · doi:10.1044/2022_lshss-21-00056 · Cited by 18
Patient’s Perspectives of Telepsychiatry: The Past, Present and Future
Naik, S. S., Manjunatha, N., Kumar, C. N., Math, S. B., & Moirangthem, S. (2020) · Indian Journal of Psychological Medicine · doi:10.1177/0253717620963341 · Cited by 18
Neuropsychologists’ practice adjustments: The impact of COVID-19
Zane, K. L., Thaler, N. S., Reilly, S., Mahoney, J. J., & Scarisbrick, D. M. (2020) · The Clinical Neuropsychologist · doi:10.1080/13854046.2020.1863473 · Cited by 18
McEwen, S. C., Merrill, D. A., Bramen, J. E., Porter, V. R., Panos, S. E., Kaiser, S. A., Hodes, J. F., Ganapathi, A. S., Bell, L., Bookheimer, T., et al. (2021) · Alzheimer s & Dementia Translational Research & Clinical Interventions · doi:10.1002/trc2.12191 · Cited by 17
Luxton, D. D., & Lexcen, F. J. (2018) · Professional Psychology Research and Practice · doi:10.1037/pro0000179 · Cited by 18
“, 2014; Sharp, Kobak, & Osman, 2011), including neuropsychological assessments (Brearly et al., 2017).”
BackgroundResultAlva, J. I., Brewster, R. C., Mahmood, Z., Harrell, K. M., Kaiser, N. C., Riesthuis, P., YoungSciortino, K., Brunet, H. E., Johnson, M. E., & Kovach, S. (2025) · The Clinical Neuropsychologist · doi:10.1080/13854046.2025.2493343 · Cited by 17
“The current review and meta-analysis expands upon prior foundational work investigating the comparability of teleNP and in-person assessment (Brearly et al., 2017; Brown & Zakzanis, 2023; Marra et al., 2020).”
InfluentialZeghari, R., Guerchouche, R., Tran, D.-M., Brémond, F., Langel, K., Ramakers, I. H. G. B., Amiel, N., Lemoine, M. P., Bultingaire, V., Manera, V., et al. (2022) · Diagnostics · doi:10.3390/diagnostics12040925 · Cited by 17
“Visual, motor and verbal cognitive tests showed a good validity and strong agreement between the tests administered face to face and in VTC [5].”
BackgroundMethodInfluentialComparability of iPad and Web-Based NIH Toolbox Cognitive Battery Administration in Veterans
Brearly, T. W., Rowland, J. A., Martindale, S. L., Shura, R. D., Curry, D. A., & Taber, K. H. (2018) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acy070 · Cited by 17
Telehealth in Rehabilitation Psychology and Neuropsychology
Wells, M. J., Dukarm, P. D., & Mills, A. (2021) · Physical Medicine and Rehabilitation Clinics of North America · doi:10.1016/j.pmr.2020.12.009 · Cited by 17
König, A., Zeghari, R., Guerchouche, R., Duc Tran, M., Bremond, F., Linz, N., Lindsay, H., Langel, K., Ramakers, I., Lemoine, P., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-047083 · Cited by 17
Messler, A. C., Kane, K. D., & Serrano, Y. (2023) · The Clinical Neuropsychologist · doi:10.1080/13854046.2023.2215954 · Cited by 16
“Recent video-based teleNP meta-analyses provide support for the validity and equivalence of verbally mediated neuropsychological tests with face-to-face tests (e.g. Brearly et al., 2017; Marra et al., 2020), which are the kinds of tests upon which telephone assessment relies.”
Hilari, K., Roper, A., Northcott, S., & Behn, N. (2023) · International Journal of Language & Communication Disorders · doi:10.1111/1460-6984.12996 · Cited by 16
Picciotto, Y. D., Algon, A. L., Amit, I., Vakil, E., & Saban, W. (2024) · The Clinical Neuropsychologist · doi:10.1080/13854046.2024.2397835 · Cited by 18
“Moreover, there can be large variance between home environments, including heterogeneity in background noises and computers screen size, as seen in other VC-based assessments (Brearly et al., 2017).”
Cross-cultural considerations for teleneuropsychology with Asian patients
Nguyen, C. M., Tan, A., Nguyen, A., Lee, G. J., Qi, W., Thaler, N. S., & Fujii, D. E. M. (2021) · The Clinical Neuropsychologist · doi:10.1080/13854046.2021.1948104 · Cited by 16
“…patients Medical and mental health care services delivered via telehealth have grown exponentially during the past 20 years and is transforming the delivery of health care for millions of individuals, particularly those living in underserved and distant rural locations (Brearly et al., 2017).”
BackgroundKanser, R. J., O’Rourke, J. J. F., & Silva, M. A. (2021) · Neurorehabilitation · doi:10.3233/nre-218019 · Cited by 15
“We selected two PVTs (See Methods) that rely solely on verbal communication given the concerns noted above as well as the finding that verbally mediated neuropsychological tasks translate more reliability and validly to TeleNP than visually dependent tasks (Brearly et al., 2017).”
BackgroundMethodAllott, K., van‐der‐EL, K., Bryce, S., Hamilton, M. P., Adams, S., Burgat, L., Killackey, E. J., & Rickwood, D. (2018) · Australian Journal of Psychology · doi:10.1111/ajpy.12225 · Cited by 15
“Alternative modes of access, such as tele-neuropsychology should be explored, with demonstrated feasibility in psychiatric populations (Brearly et al., 2017).”
BackgroundRemote Assessment of Verbal Memory in Youth With Cochlear Implants During the COVID-19 Pandemic
Kronenberger, W. G., Montgomery, C. J., Henning, S. C., Ditmars, A. M., Johnson, C. A., Herbert, C. J., & Pisoni, D. B. (2021) · American Journal of Speech-Language Pathology · doi:10.1044/2021_ajslp-20-00276 · Cited by 16
“Videoconference-based assessment methods (teleassessment; remote administration of tests over an audio–video platform) have become more prevalent and feasible with improvements in technology, offering an alternative to FTF assessment (Brearly et al., 2017).”
BackgroundMethodGoldenson, J., & Josefowitz, N. (2021) · Psychological Injury and Law · doi:10.1007/s12207-021-09404-2 · Cited by 16
Review of Systematic Reviews in the Field of Telemedicine
Goharinejad, S., Hajesmaeel-Gohari, S., Jannati, N., Goharinejad, S., & Bahaadinbeigy, K. (2021) · Medical Journal of The Islamic Republic of Iran · doi:10.47176/mjiri.35.184 · Cited by 18
MacDonald, B., Berrios-Siervo, G. M., Díaz‐Santos, M., Sánchez, O., Suárez, P., Diaz, A. L., Moss, N. C., & Strutt, A. M. (2023) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acac108 · Cited by 14
Brown, A., Kelso, W. M., Eratne, D., Loi, S. M., Farrand, S., Summerell, P., Neath, J., Walterfang, M., Velakoulis, D., & Stolwyk, R. J. (2024) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acad108 · Cited by 14
“Therefore, more evidence is required to guide future teleneuropsychology practice in determining which neuropsychologicalmeasuresarecomparablebetweenin-person andvideoconferenceassessments,andtoidentifyteststhatmay notbesuitableforremotedelivery(Brearlyetal.,2017).”
BackgroundMethodResultInfluentialTeleneuropsychology for vascular cognitive impairment: which tools do we have?
Salvadori, E., & Pantoni, L. (2023) · Cerebral Circulation - Cognition and Behavior · doi:10.1016/j.cccb.2023.100173 · Cited by 13
“2 by the COVID-19 pandemic, the research interest in the development of methods to conduct remote cognitive assessments by means of videoconferencing had started before [6,7].”
Colvin, M. K., Forchelli, G. A., Reese, K. L., Capawana, M. R., Beery, C. S., Murphy, J., Doyle, A. E., O’Keefe, S. M., & Braaten, E. B. (2022) · Child Neuropsychology · doi:10.1080/09297049.2021.2005010 · Cited by 13
“Prior to the COVID-19 pandemic, a few studies had explored administering standardized neuropsychological tests via telehealth, mostly in adult patients (reviewed in Brearly et al., 2017; Marra et al., 2020).”
BackgroundEvaluation of the Uniform Data Set version 3 teleneuropsychological measures
Gierzynski, T. F., Gregoire, A., Reader, J. M., Pantis, R., Campbell, S., Bhaumik, A., Rahman‐Filipiak, A., Heidebrink, J. L., Giordani, B., Paulson, H. L., et al. (2023) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617723000383 · Cited by 13
“…Story and Letter Fluency are consistent with prior research that has supported the cross-modal comparability of verbally mediated tasks across traditional, in-person and remote (i.e., telephone or video-based) testing conditions (Brearly et al., 2017; Carlew et al., 2020; Hunter et al., 2021).”
BackgroundResultInfluentialAbel, D. B., Vohs, J. L., Salyers, M. P., Wu, W., & Minor, K. S. (2024) · Schizophrenia Research · doi:10.1016/j.schres.2024.07.043 · Cited by 13
The One-Two Punch of Delirium and Dementia During the COVID-19 Pandemic and Beyond
LaHue, S. C., Douglas, V. C., & Miller, B. L. (2020) · Frontiers in Neurology · doi:10.3389/fneur.2020.596218 · Cited by 13
Womble, M. N., Reynolds, E., Kissinger-Knox, A. M., Collins, M. W., Kontos, A. P., West, R. V., Eagle, S. R., & Elbin, R. J. (2021) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0000000000000713 · Cited by 13
Weydmann, G. J., Palmieri, I., Simões, R. A. G., Cabral, J. C. C., Eckhardt, J., Tavares, P. D. S., Moro, C. C., Alves, P., Buchmann, S., Schmidt, E., et al. (2022) · Behavior Research Methods · doi:10.3758/s13428-022-01982-6 · Cited by 13
“Despite these limitations, data from studies comparing face-to-face and online behavioral data suggest that similar results are observed for both data collection methods (Brearly et al., 2017; Carr et al., 2020; Chaytor et al., 2021; Wadsworth et al., 2016).”
BackgroundResultInfluentialKrynicki, C. R., Hacker, D., & Jones, C. A. (2022) · Journal of Neuropsychology · doi:10.1111/jnp.12300 · Cited by 13
Kohli, M., Fisher, A., Sun-Suslow, N., Heaton, A., Dawson, M., Marquie‐Beck, J., Franklin, D. R., Marquine, M. J., Iudicello, J. E., Heaton, R. K., et al. (2022) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617722000777 · Cited by 13
“Furthermore, a recent systematic review (19 studies) of TNP validity concluded no significant effect related to videoadministration of certain cognitive screeners (i.e., MMSE, MoCA), language tests (i.e., Boston Naming Test, Letter Fluency), attention/working memory tasks (i.e., Digit Span Total), and memory tests (Ho…”
BackgroundMethodResultInfluentialInnovations in Neuropsychology: Future Applications in Neurosurgical Patient Care
McLean, E. A., Cornwell, M. A., Bender, H. A., Sacks-Zimmerman, A. L., Mandelbaum, S., Koay, J. M., Raja, N., Kohn, A., Meli, G., & Spat‐Lemus, J. (2023) · World Neurosurgery · doi:10.1016/j.wneu.2022.09.103 · Cited by 13
Gray, D., Lesley, R., Mayberry, E. J., Williams, L., McHutchison, C. A., Newton, J. L., Pal, S., Chandran, S., MacPherson, S. E., Abrahams, S., et al. (2023) · Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration · doi:10.1080/21678421.2023.2278512 · Cited by 13
“Several studies have demonstrated good agreement between remote cognitive assessments and traditional in-person assessments, particularly for tasks that rely on verbal responses (12).”
BackgroundParlar, M. E., Spilka, M. J., Gonzalez, D. W., Ballantyne, E. C., Dool, C. B., Gojmerac, C., King, J. P., McNeely, H. E., & MacKillop, E. (2020) · The Clinical Neuropsychologist · doi:10.1080/13854046.2020.1810324 · Cited by 13
Daffern, M., Shea, D. E., & Ogloff, J. R. P. (2021) · Psychology Public Policy and Law · doi:10.1037/law0000308 · Cited by 13
“Previous research broadly supports the validity of neuropsychological testing by videoconference, particularly for verbally mediated tasks, although the evidence for motor-dependent tasks is inconclusive (Brearly et al., 2017).”
BackgroundResultConsensus-Harmonized Neuropsychological Assessment for Vascular Cognitive Impairment and Dementia
Bentvelzen, A. C., Kochan, N. A., Saks, D., Chander, R. J., Koncz, R., Aam, S., Alves, G. S., Briceño, E. M., Brodtmann, A. G., Cerami, C., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.47948 · Cited by 15
Ales, F., Meyer, G. J., Mihura, J. L., Loia, A. C., Pasqualini, S., Zennaro, A., & Giromini, L. (2022) · Psychological Injury and Law · doi:10.1007/s12207-022-09447-z · Cited by 14
“This finding is consistent with emerging research suggesting that other performancebased tests yielded similar results when administered inperson vs online and remotely (Brearly et al., 2017; Wright, 2018; Wright & Raiford, 2021).”
BackgroundResultSantini, S., Rampioni, M., Stara, V., Rosa, M. D., Paciaroni, L., Paolini, S., Fioretti, S., Valenza, S., Riccardi, G. R., & Pelliccioni, G. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192214844 · Cited by 12
“Therefore, the use of remote neuropsychological evaluations and treatments has been shown to lead to clinical improvements that are just as effective as conventional face-to-face interventions [67].”
BackgroundBrown, A., Kelso, W. M., Velakoulis, D., Farrand, S., & Stolwyk, R. J. (2022) · Journal of Geriatric Psychiatry and Neurology · doi:10.1177/08919887221141653 · Cited by 12
Tuerk, C., Saha, T., Bouchard, M. F., & Booij, L. (2023) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acad039 · Cited by 12
Factors perpetuating functional cognitive symptoms after mild traumatic brain injury
Picon, E. L., Wardell, V., Palombo, D. J., Todd, R. M., Aziz, B., Bedi, S., & Silverberg, N. D. (2023) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2023.2247601 · Cited by 12
“There is prelimin-ary evidence that reliability and validity can be maintained in a remote testing set-up, particularly for tests relying on verbal responses from participants (Brearly et al., 2017).”
BackgroundExploring Asian maternal experiences and mHealth needs for postpartum mental health care
Kamarudin, S. S., Idris, I. B., Ahmad, N., & Sharip, S. (2024) · Digital Health · doi:10.1177/20552076241292679 · Cited by 12
Conducting a Virtual Study With Special Considerations for Working With Persons With Aphasia
Doub, A., Hittson, A. K., & Stark, B. C. (2021) · Journal of Speech Language and Hearing Research · doi:10.1044/2021_jslhr-20-00392 · Cited by 12
Lichtenstein, J. D., Amato, J., Holding, E. Z., Grodner, K. D., Pollock, E. N., Marschall, K. P., & Scull, S. (2021) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acab041 · Cited by 12
Battams, S., & Martini, A. (2023) · INQUIRY The Journal of Health Care Organization Provision and Financing · doi:10.1177/00469580231160898 · Cited by 12
“50 However, limitations to effective cognitive screening over the phone included challenges in evaluating visuospatial impairment and naming.”
BackgroundDuricy, E., Durisko, C., Dickey, M. W., & Fiez, J. A. (2022) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acac100 · Cited by 11
A survey of neuropsychological assessment feedback practices among neuropsychologists
Varela, J. L., Sperling, S. A., Block, C. K., O’Leary, K., Hart, E. S., & Kiselica, A. M. (2023) · The Clinical Neuropsychologist · doi:10.1080/13854046.2023.2233738 · Cited by 11
“Given that recent literature argues for the validity and satisfaction of teleneuropsychological assessment (Brearly et al., 2017; Parks et al., 2021), virtual NAF (Turner et al., 2012), telehealth psycho-therapy (Greenwood et al., 2022), and other telehealth interventions (Butzner & Cuffee, 2021),…”
BackgroundDipper, L. T., Devane, N., Barnard, R., Botting, N., Boyle, M., Cockayne, L., Hersh, D., Magdalani, C., Marshall, J., Swinburn, K., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0304385 · Cited by 13
Qiu, Y.-F., Hu, J., Wu, M., Liu, J., Li, C.-Y., Yu, Y.-Q., Zeng, L., Yang, F., & Zheng, L. (2024) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2024.10.014 · Cited by 14
Nussbaum, N. L., Young, S. R., DeLeon, R. C., Engelmann, M. L., & Schraegle, W. A. (2021) · Epileptic Disorders · doi:10.1684/epd.2021.1274 · Cited by 11
“We reviewed existing literature on teleneuropsychology (TNP) from prior to the COVID-19 pandemic [5-7], as well as research and practical information from the International Neuropsychological Society [8] and National Academy of Neuropsychology [9].”
MethodResultBroek, S. R. V. D., Bagot, K. L., Arthurson, L., Cadilhac, D. A.-M., & Stolwyk, R. J. (2021) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acab086 · Cited by 11
Hilsabeck, R. C., Lacritz, L. H., Colvin, M. K., Espe‐Pfeifer, P., Sperling, S. A., Arnett, P. A., & Perry, W. (2022) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/23727322221110261 · Cited by 11
“Telehealth administration of cognitive screening measures for older adults has shown promise in detecting cognitive deficits (Brearly et al., 2017; Marra et al., 2020).”
BackgroundInfluentialBehn, N., Hoepner, J. K., Meulenbroek, P. A., Capo, M., & Hart, J. (2022) · International Journal of Language & Communication Disorders · doi:10.1111/1460-6984.12834 · Cited by 12
Seghezzo, G., van Hoecke, Y., James, L., Davoren, D., Williamson, E., Pearce, N. E., McElvenny, D. M., & Gallo, V. (2020) · Journal of Neurology · doi:10.1007/s00415-021-10403-1 · Cited by 11
“Telemedicine is a growing field, becoming more relevant particularly with regards to assessing cognitive function, as it has an advantage of reaching more participants and reducing the burden of lengthy travelling, cutting time, cost and making the participant feel more comfortable in their own home [7, 11, 19, 20].”
Palmese, C. A., Wyman‐Chick, K. A., Racine, C. A., Pollak, L. E., Lin, G., Farace, E., Tran, B.-N. D., Floden, D. P., Bobholz, J. A., Turner, T. H., et al. (2021) · The Clinical Neuropsychologist · doi:10.1080/13854046.2021.1929496 · Cited by 11
“…reliability and validity of bi-directional audio/ video-conference-based teleNP in older patients, patients with PD, and patients with memory disorders (Brearly et al., 2017; Cullum et al., 2014; Parks et al., 2021; Wadsworth et al., 2018), suggesting feasibility in DBS populations, as well.”
BackgroundSarno, M., Buré-Reyes, A., Harcourt, S., Haq, I. U., Luca, C. C., Jagid, J. R., & Levin, B. E. (2022) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2022.04.009 · Cited by 10
“A meta-analysis conducted by Brearly and colleagues [23] was pivotal in first demonstrating validity and utility of TeleNP.”
MethodShakya, S., Saxena, A., Gulati, S., Kothari, S. S., Ramakrishnan, S., Gupta, S. K., Devagourou, V., Talwar, S., Rajashekar, P., & Sharma, S. (2022) · Annals of Pediatric Cardiology · doi:10.4103/apc.apc_149_21 · Cited by 10
“Although a good agreement has been shown in the literature between in-person and video conference-based neurodevelopmental assessment,[33,34] the two methods of assessment are different.”
Gold, D., Stockwood, J., Boulos, K., Kasha, S., Vyshedskiy, A., deTorres, L., Ostrovsky, S., Durakovic, D., Savchenko, A., & Piryatinsky, I. (2021) · The Clinical Neuropsychologist · doi:10.1080/13854046.2021.1933190 · Cited by 10
“That said, recent meta analytic studies have provided evidence of the utility and tolerability of remote assessment (Brearly et al., 2017; Cullum et al., 2006; Cullum et al., 2014; Grosch et al., 2015; Marra et al., 2020).”
Ceslis, A., Mackenzie, L., & Robinson, G. A. (2022) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acac037 · Cited by 12
“A meta-analysis of teleNP use in adult populations found no significant change in scores between FTF and teleNP setups, although there was a large heterogeneity reported between studies (Brearly et al., 2017).”
ResultValidating virtual administration of neuropsychological testing in Parkinson disease: a pilot study
Gallagher, J., Mamikonyan, E., Xie, S. X., Tran, B., Shaw, S., & Weintraub, D. A. (2023) · Scientific Reports · doi:10.1038/s41598-023-42934-0 · Cited by 10
“…indicated good reliability of virtual assessments compared with in-person assessments to diagnose dementia in general 3 , but a meta-analysis found that hetergenous data from published studies precluded interpretation, with special concern about tests that are either motor-or vision-dependent 4 .”
ResultSilva, J. D. D. A., Maranhão, D. C. M., Beltrão, N. B., Farah, B. Q., Damasceno, V. D. O., Cavalcante, B. R., & Pirauá, A. L. T. (2023) · Geriatrics Gerontology and Aging · doi:10.53886/gga.e0230002 · Cited by 10
Butterbrod, E., van den Heuvel, D. M. J., Zevenhoven, P., Waterink, L., van Leeuwenstijn, M. S. S. A., Jutten, R. J., van der Flier, W. M., & Sikkes, S. A. M. (2024) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617724000432 · Cited by 9
“Such tests are relatively easy to implement in remote assessment and appear to have largely sufficient reliability metrics (Brearly et al., 2017; Cullum et al., 2014; Fox-Fuller et al., 2022) and produce scores that are not significantly different from face-to-face assessment (Marra et al., 2020),…”
Telemedicine in Alzheimer's disease and other dementias: Where we are?
Angelopoulou, E., & Papageorgiou, S. G. (2024) · Journal of Alzheimer s Disease · doi:10.1177/13872877241298295 · Cited by 10
“31 Collectively, neuropsychological tools based on verbal communication are relatively reliable in tele-medicine settings, while the assessment of visuospatial abilities and executive functioning is rather more challenging.”
Craig, S. R., Dempster, M., Curran, D. B., Cuddihy, A., & Lyttle, N. (2025) · Applied Neuropsychology Adult · doi:10.1080/23279095.2025.2454983 · Cited by 9
Detecting Emotion in Speech: Validating a Remote Assessment Tool
Dor, Y. I., Algom, D., Shakuf, V., & Ben‐David, B. M. (2022) · Auditory Perception & Cognition · doi:10.1080/25742442.2022.2101841 · Cited by 9
Sachs, B. C., Latham, L. A., Bateman, J. R., Cleveland, M. J., Espeland, M. A., Fischer, E., Gaussoin, S. A., Leng, I., Rapp, S. R., Rogers, S. D., et al. (2024) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acae001 · Cited by 9
“Visually dependent tasks, like the Clock drawing task, tended to have lower ICCs than verbally mediated tasks, but differences in scores across modalities were not statistically significant (Brearly et al., 2017).”
BackgroundJensen, A., Thériault, K., Yılmaz, E., Pon, E., & Davidson, P. S. R. (2023) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2023.107720 · Cited by 9
Technology-based mental health assessment and intervention
Gould, C. E., Ma, F., Loup, J. R., Juang, C., Sakai, E. Y., & Pepin, R. L. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-800136-3.00024-7 · Cited by 12
Schwab, N. A., DesRuisseaux, L. A., Weinberg, M. S., & Arnold, S. E. (2020) · Alzheimer s & Dementia Translational Research & Clinical Interventions · doi:10.1002/trc2.12081 · Cited by 9
Use of Direct-to-Consumer Telemedicine to Access Mental Health Services
Hohman, J. A., Martinez, K. A., Anand, A., Rood, M. N., Martyn, T., Rose, S. L., & Rothberg, M. B. (2022) · Journal of General Internal Medicine · doi:10.1007/s11606-021-07326-y · Cited by 9
Evolution of clinical neuropsychology: Four challenges
Kent, P. L. (2018) · Applied Neuropsychology Adult · doi:10.1080/23279095.2018.1493483 · Cited by 9
“While recent articles have emphasized the benefits of innovative assessment procedures (see, for instance, Au et al., 2017 and Brearly et al., 2017), like with all technological advancements, there may result in unintended consequences, including the further erosion of privacy, and significant…”
BackgroundSeubert-Ravelo, A. N., Serrano‐Juárez, C. A., Cabañas-Tinajero, J.-Á., González-Gutiérrez, F. A., Moreno-Villagómez, J., Prieto‐Corona, B., Reyes-Méndez, C., Téllez-Rodríguez, M., & Yáñez-Téllez, M. G. (2023) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2023.2189229 · Cited by 8
“…for TeleNP assessment, with evidence for the equivalence of various cognitive measures in remote versus conventional face-toface administration (Brearly et al., 2017; Marra, Hoelzle et al., 2020; Rochette et al., 2021), for adequate to marginal test-retest reliability on some tasks…”
BackgroundCapacity evaluations for adult protective services: videoconference or in-person interviews
Halphen, J. M., Dyer, C. B., Lee, J. L., Ortíz, C., Murdock, C. C., Hiner, J. A., & Burnett, J. (2020) · Journal of Elder Abuse & Neglect · doi:10.1080/08946566.2020.1740127 · Cited by 8
“An on-site facilitator is needed when motor responses such as clock drawings are done (Brearly et al., 2017).”
BackgroundTest–Retest Reliability of Remote ImPACT Administration
Netzel, L., Moran, R., Hopfe, D., Salvatore, A. P., Brown, W., & Murray, N. G. (2021) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acab055 · Cited by 8
Trupp, G. F., Ricardo, M. M., Boccaccini, M. T., & Murrie, D. C. (2021) · Psychology Public Policy and Law · doi:10.1037/law0000322 · Cited by 9
Carvalho, C. M., de Andrade, K. R., Poltronieri, B. C., de Oliveira, Y. G., Ferreira, R. G., Woodruff, E., & Panizzutti, R. (2024) · BMC Geriatrics · doi:10.1186/s12877-023-04553-2 · Cited by 9
“Studies have demonstrated that cognitive screening instruments administered remotely have high psychometric and diagnostic quality, being considered comparable to tests carried out in person [16].”
BackgroundPanzavolta, A., Cerami, C., Caffarra, P., Vita, D. D., Dodich, A., Fonti, C., L’Abbate, F., Laganà, V., Lavorgna, L., Marra, C., et al. (2024) · Neurological Sciences · doi:10.1007/s10072-024-07403-0 · Cited by 9
“Administration of cognitive testing may also be performed by videoconferencing, with evidence of substantial comparability to in-person administration, as summarized in two recent reviews [15, 22].”
Pulsifer, M. B., Grieco, J. A., Burstein, S. M., Parsons, M. W., Gardner, M. M., & Sherman, J. C. (2021) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2021.1963683 · Cited by 8
“…interacted with a patient in a remote clinical space that ensured adequate internet connectivity and an environment that limited distractions (Brearly et al., 2017; C. Cullum et al., 2014; Hewitt & Loring, 2020; Loh et al., 2004; *CONTACT Janet C. Sherman jsherman@mgh.harvard.edu…”
BackgroundCognitive dysfunction in diabetes-related foot complications: A cohort study
Nguyen, M., Wong, D. K., Barson, E., Staunton, E., & Fisher, C. A. (2024) · Journal of Diabetes & Metabolic Disorders · doi:10.1007/s40200-023-01381-4 · Cited by 8
“In particular, the administration of verbally mediated tasks by qualified professionals have been reported to not be affected by vide-oconference administration [89], and therefore can reliably measure their relevant construct via telehealth.”
BackgroundMethodCharacterisation of psychological and neurocognitive processes accompanying functional seizures
Higson, L., O'Brien, T. J., Chen, Z. Z., Rayner, G., Alpitsis, R., & Winton‐Brown, T. (2024) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2024.110117 · Cited by 7
Wärn, E., Andersson, L., & Berginström, N. (2025) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaf013 · Cited by 7
“Previousresearch hasstressedtheneedtoevaluatemorecomprehensiveremote test-batteries,callingfortestswithstandardizedproceduresof administrationandscoring,butalsowithappropriatenormative datafortheremoteassessment(Barracloughetal.,2023; Bilderetal.,2020;Brearlyetal.,2017;Fox-Fulleretal.,2022; Gnassounouetal.,2022;Marrae…”
Assessing communicative-pragmatic ability in telehealth: e-ABaCo in autistic individuals
Traetta, I., Gabbatore, I., Aimar, A., Arduino, G. M., & Bosco, F. M. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1568108 · Cited by 7
“All these studies found similarities between tools used in a face-to-face setting and those adapted for the use in telehealth, particularly for synchronous tests requiring real-time interaction between examiner and participant (80).”
InfluentialHernández, D. A., Griffith, C. X., Deffner, A. M., Nkulu, H., Hovhannisyan, M., Ruiz, J. M., Andrews‐Hanna, J. R., & Grilli, M. D. (2024) · Psychological Research · doi:10.1007/s00426-024-01938-9 · Cited by 10
“Beyond autobiographical memory, recent research has in fact shown that many cognitive tasks, despite the reduction in control and translation to a home environment, produce similar outcomes when administered by videoconference (Brearly et al., 2017; Marra et al., 2020).”
Scherr, J., Albright, C. M., & Reyes, E. D. L. (2021) · Therapeutic Advances in Rare Disease · doi:10.1177/26330040211038564 · Cited by 7
Cruse, N., Piotto, V., COELHO, C. A., & Behn, N. (2022) · International Journal of Language & Communication Disorders · doi:10.1111/1460-6984.12813 · Cited by 7
Takakura, Y., Otsuki, M., Takagi, R., & Houkin, K. (2023) · BMC Geriatrics · doi:10.1186/s12877-023-04275-5 · Cited by 7
“On the other hand, previous studies have indicated that remote assessment may have a negative effect on synchronous tasks, and that movement-dependent tasks are heterogeneous [11].”
BackgroundDelagneau, G., Bowden, S. C., Bryce, S., van‐der‐EL, K., Hamilton, M. P., Adams, S., Burgat, L., Killackey, E. J., Rickwood, D., & Allott, K. (2019) · Early Intervention in Psychiatry · doi:10.1111/eip.12876 · Cited by 7
“The use of tele-neuropsychology (or the administration of assessments through a videoconference), for example, appears to be a feasible and accurate method of assessment in adults (Brearly et al., 2017).”
MethodTelemental Health in Rural and Remote Contexts
Simpson, S., Richardson, L., & Reid, C. L. (2019) · Springer eBooks · doi:10.1007/978-981-10-5012-1_37-1 · Cited by 7
Nunnerley, M., Mattek, N., Kaye, J. A., & Beattie, Z. (2022) · Alzheimer s & Dementia Diagnosis Assessment & Disease Monitoring · doi:10.1002/dad2.12373 · Cited by 7
Bettcher, B. M., Gunn-Sandell, L. B., Lopez‐Esquibel, N., Carlson, N. E., Krupa, J. R., Lum, H. D., Holden, S. K., & Greher, M. R. (2025) · The Clinical Neuropsychologist · doi:10.1080/13854046.2025.2482083 · Cited by 6
“…suggests that telehealth administration of neuropsychological assessments is a feasible, valid and reliable alternative to in-person assessments (Brearly et al., 2017; Despoti et al., 2024; Gierzynski et al., 2024; Krynicki et al., 2023; Messler et al., 2023), although limitations remain that…”
Sperling, S. A., Dong, J., Lapin, B. R., & Li, Y. (2025) · The Clinical Neuropsychologist · doi:10.1080/13854046.2025.2503374 · Cited by 6
“…tele-npt is feasible, (Cullum et al., 2006; Harrell et al., 2014; Parikh et al., 2013; Turner et al., 2012; Wadsworth et al., 2016) reliable, (Brearly et al., 2017; Cullum et al., 2014) sufficient for achieving clinicians’ goals (Parsons et al., 2022), and a satisfactory means of obtaining…”
Metadata
- Authors
- Brearly, T. W., Shura, R. D., Martindale, S. L., Lazowski, R. A., Luxton, D. D., Shenal, B. V., & Rowland, J. A.
- Affiliations
- W. G. (Bill) Hefner VA Medical Center (US)
- College Board (US)
- University of Washington (US)
- Salem VA Medical Center (US)
- Corresponding author
- Brearly, Timothy W.
- Venue
- Neuropsychology Review
- Published
- 2017-06
- Volume
- 27
- Issue
- 2
- Pages
- 174-186
- ISSN
- 1040-7308 (ISSN-L)
- 1573-6660
- OpenAlex
- W2625027748
- Cited by
- 353
- References
- 54
- Citations by year
- 2026: 20 · 2025: 37 · 2024: 49 · 2023: 47 · 2022: 51 · 2021: 71 · 2020: 59 · 2019: 9 · 2018: 10
- FWCI
- 3.47
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neuropsychology Review (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Keywords
- remote neuropsychological assessment, telemedicine, Boston Naming Test, digit span, verbal fluency, list learning, internet speed, older adults, mental illness, neurocognitive disorders, reimbursement
- MeSH terms
- Adult, Aged, Aged, 80 and over, Mental Disorders, Dementia, Humans, Middle Aged, Neuropsychological Tests, Telemedicine, Videoconferencing, Cognitive Dysfunction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review