The DOI matches its Crossref record; 53 of the 54 references it cites were found in a registry or an index.
Neuropsychological Test Administration by Videoconference: A Systematic Review and Meta-Analysis
Abstract
The purpose of the current systematic review and meta-analysis was to assess the effect of videoconference administration on adult neurocognitive tests. We investigated whether the scores acquired during a videoconference administration were different from those acquired during on-site administration. Relevant counterbalanced crossover studies were identified according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Twelve studies met criteria for analysis. Included samples consisted of healthy adults as well as those with psychiatric or neurocognitive disorders, with mean ages ranging from 34 to 88 years. Heterogenous data precluded the interpretation of a summary effect for videoconference administration. Studies including particpants with a mean age of 65-75, as well as studies that utilized a high speed network connection, indicated consistent performance across videoconference and on-site conditions, however studies with older participants and slower connections were more variable. Subgroup analyses indicated that videoconference scores for untimed tasks and those allowing for repetition fell 1/10th of a standard deviation below on-site scores. Test specific analyses indicated that verbally-mediated tasks including digit span, verbal fluency, and list learning were not affected by videoconference administration. Scores for the Boston Naming Test fell 1/10th of a standard deviation below on-site scores. Heterogenous data precluded meaningful interpretation of tasks with a motor component. The administration of verbally-mediated tasks by qualified professionals using existing norms was supported, and the use of visually-dependent tasks may also be considered. Variability in previous studies indicates a need for further investigation of motor-dependent tasks. We recommend the development of clinical best practices for conducting neuropsychological assessments via videoconference, and advocate for reimbursement structures that allow consumers to benefit from the increased access, convenience, and cost-savings that remote assessment provides.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Guidelines are available to allow for remote administration of this measure, and modality of administration has been shown not to affect performance [47].”
From A randomized controlled trial of yoga vs nonaerobic exercise for veterans with PTSD: Understanding efficacy, mechanisms of change, and mode of delivery (2021) · cites this paper as [47]
In the citing paper
“However, since data are still preliminary, there is no consensus on the best practices for conducting neuropsychological assessment by telemedicine (362).”
From The Multidisciplinary Approach to Alzheimer’s Disease and Dementia. A Narrative Review of Non-Pharmacological Treatment (2018) · cites this paper as [362]
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,417
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
A basic introduction to fixed-effect and random-effects models for meta-analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.12 · Cited by 6,793
Barak, A., Hen, L., Boniel-Nissim, M., & Shapira, N. (2008) · Journal of Technology in Human Services · doi:10.1080/15228830802094429 · Cited by 1,283
The Effectiveness of Telemental Health: A 2013 Review
Hilty, D. M., Ferrer, D. C., Parish, M. B., Johnston, B., Callahan, E. J., & Yellowlees, P. M. (2013) · Telemedicine and e-Health · doi:10.1089/tmj.2013.0075 · Cited by 1,048
Videoconferencing psychotherapy: a systematic review
Backhaus, A., Agha, Z., Maglione, M. L., Repp, A., Ross, B., Zuest, D., Rice-Thorp, N. M., Lohr, J., & Thorp, S. R. (2012) · Psychological Services · doi:10.1037/a0027924 · Cited by 586
The Empirical Evidence for Telemedicine Interventions in Mental Disorders
Bashshur, R. L., Shannon, G. W., Bashshur, N., & Yellowlees, P. (2015) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2015.0206 · Cited by 466
Cited by
Sorted by citations
Philippe, T. J., Sikder, N., Jackson, A., Koblanski, M. E., Liow, E., Pilarinos, A., & Vasarhelyi, K. (2022) · JMIR Mental Health · doi:10.2196/35159 · Cited by 436
The Current State Of Telehealth Evidence: A Rapid Review.
Shigekawa, E., Fix, M., Corbett, G., Roby, D. H., & Coffman, J. (2018) · Health Affairs · doi:10.1377/hlthaff.2018.05132 · Cited by 406
Dementia care and COVID-19 pandemic: a necessary digital revolution
Cuffaro, L., Lorenzo, F. D., Bonavita, S., Tedeschi, G., Leocani, L., & Lavorgna, L. (2020) · Neurological Sciences · doi:10.1007/s10072-020-04512-4 · Cited by 311
“Although further studies are needed to test the reliability of complex tasks requiring motor and visual abilities, there is growing scientific evidence supporting the use of videoconferencing technology in the remote administration of neuropsychological tests, particularly those that rely on verbal responses [6].”
BackgroundZucchella, C., Sinforiani, E., Tamburin, S., Federico, A., Mantovani, E., Bernini, S., Casale, R., & Bartolo, M. (2018) · Frontiers in Neurology · doi:10.3389/fneur.2018.01058 · Cited by 297
“However, since data are still preliminary, there is no consensus on the best practices for conducting neuropsychological assessment by telemedicine (362).”
BackgroundMarra, D. E., Hamlet, K. M., Bauer, R. M., & Bowers, D. (2020) · The Clinical Neuropsychologist · doi:10.1080/13854046.2020.1769192 · Cited by 250
“” (Brearly et al., 2017, pg. 176). Studies from Brearly’s analysis were also included in the following qualitative analysis when the average age of participants was 65+. Article extraction took place on 3/21/2020. A total of 591 articles were extracted across the three internet databases, with 532 remaining after dupl…”
BackgroundMethodResultInfluentialQuinn, T. J., Richard, E., Teuschl, Y., Gattringer, T., Hafdi, M., O'Brien, J. T., Merriman, N. A., Gillebert, C. R., Huygelier, H., Verdelho, A., et al. (2021) · European Journal of Neurology · doi:10.1111/ene.15068 · Cited by 201
Batastini, A. B., Paprzycki, P., Jones, A. C. T., & MacLean, N. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101944 · Cited by 181
Geriatric telepsychiatry: systematic review and policy considerations
Gentry, M. T., Lapid, M. I., & Rummans, T. A. (2019) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2018.10.009 · Cited by 156
Quinn, T. J., Richard, E., Teuschl, Y., Gattringer, T., Hafdi, M., O'Brien, J. T., Merriman, N. A., Gillebert, C. R., Huygelier, H., Verdelho, A., et al. (2021) · European Stroke Journal · doi:10.1177/23969873211042192 · Cited by 145
“A recent review found 12 studies that included mixed populations and compared video to standard in-person assessment.(111) The review authors reported that performance on certain tests was different when using a videobased platform, although differences weremodest andmay not have clinical importance.”
BackgroundGeddes, M. R., O'Connell, M. E., Fisk, J. D., Gauthier, S., Camicioli, R., Ismail, Z., & for the Alzheimer Society of Canada Task Force on Dementia Care Best Practices for COVID‐19 (2020) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1002/dad2.12111 · Cited by 127
Bilder, R. M., Postal, K., Barisa, M. T., Aase, D. M., Cullum, C. M., Gillaspy, S. R., Harder, L., Kanter, G., Lanca, M., Lechuga, D. M., et al. (2020) · The Clinical Neuropsychologist · doi:10.1080/13854046.2020.1767214 · Cited by 126
“It must first be acknowledged that, so far, the evidence base is limited (e.g. Mara et al, 2020; Brearly et al., 2017; Miller and Barr 2017).”
BackgroundCOVID-19 and telemental health: Benefits, challenges, and future directions.
Madigan, S. L., Racine, N. M., Cooke, J. E., & Korczak, D. J. (2020) · Canadian Psychology/Psychologie canadienne · doi:10.1037/cap0000259 · Cited by 138
Bilder, R. M., Postal, K., Barisa, M. T., Aase, D. M., Cullum, C. M., Gillaspy, S. R., Harder, L., Kanter, G., Lanca, M., Lechuga, D. M., et al. (2020) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaa046 · Cited by 121
Cognitive Assessment via Telephone: A Scoping Review of Instruments
Carlew, A. R., Fatima, H., Livingstone, J. R., Reese, C., Lacritz, L. H., Pendergrass, C., Bailey, K. C., Presley, C., Mokhtari, B. K., & Cullum, C. M. (2020) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaa096 · Cited by 105
Zhao, L., Chen, J., Lan, L., Deng, N., Liao, Y., Yue, L., Chen, I., Wen, S. W., & Xie, R. (2021) · JMIR mhealth and uhealth · doi:10.2196/32544 · Cited by 112
Hewitt, K. C., Rodgin, S., Loring, D. W., Pritchard, A. E., & Jacobson, L. A. (2020) · The Clinical Neuropsychologist · doi:10.1080/13854046.2020.1811891 · Cited by 77
Telemedicine: a Valuable Tool in Neurodegenerative Diseases
Adams, J., Myers, T. L., Waddell, E. M., Spear, K. L., & Schneider, R. B. (2020) · Current Geriatrics Reports · doi:10.1007/s13670-020-00311-z · Cited by 74
Home-Based Pediatric Teleneuropsychology: A validation study
Harder, L., Hernández, A., Hague, C. D., Neumann, J., McCreary, M., Cullum, C. M., & Greenberg, B. M. (2020) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaa070 · Cited by 72
Technology meets tradition: a hybrid model for implementing digital tools in neuropsychology
Singh, S. M., & Germine, L. T. (2020) · International Review of Psychiatry · doi:10.1080/09540261.2020.1835839 · Cited by 66
“…the neuropsychology literature provided some useful guidance on using technology in neuropsychology and switching from conducting traditional evaluations to implementing TeleNP (Bauer et al., 2012; Bilder, 2011; Bilder & Reise, 2019; Brearly et al., 2017; Germine et al., 2019; Miller & Barr, 2017).”
BackgroundNeurocognitive deficits in severe COVID-19 infection: Case series and proposed model
Whiteside, D. M., Oleynick, V. C., Holker, E. G., Waldron, E. J., Porter, J. N., & Kasprzak, M. (2021) · The Clinical Neuropsychologist · doi:10.1080/13854046.2021.1874056 · Cited by 71
“Video platforms are generally preferable to telephone platforms as they allow for assessment of a broader range of cognitive domains, provide additional modalities for assessing psychiatric symptoms such as anxiety and depression, and reduce concerns about extraneous environmental variables, which cannot directly be o…”
BackgroundInfluentialDeYoung, N. J., & Shenal, B. V. (2018) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x17752030 · Cited by 63
Implementing Remote Memory Clinics to Enhance Clinical Care During and After COVID-19
Owens, A. P., Ballard, C. G., Beigi, M., Kalafatis, C., Brooker, H. J., Lavelle, G., Brønnick, K., Sauer, J., Boddington, S., Velayudhan, L., et al. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.579934 · Cited by 58
Chiauzzi, E. J., Clayton, A. R., & Huh, J. (2020) · JMIR Mental Health · doi:10.2196/24021 · Cited by 62
“This has been demonstrated with brief cognitive test batteries [30], and obtaining such equivalence may work better with neuropsychological testing involving visually-dependent tasks rather than motor-dependent tasks [31].”
Neuropsychological Tests in Post-operative Cognitive Dysfunction: Methods and Applications
Jun, L., Huang, K., Zhu, B., Zhou, B., Harb, A. K. A., Liu, L., & Wu, X. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.684307 · Cited by 61
“Some initial evidence (Brearly et al., 2017) demonstrates the NPTmediated by language is less affected by video-related factors and particularly suitable as video-related subsets.”
BackgroundColvin, M. K., Reesman, J. H., & Glen, T. (2021) · The Clinical Neuropsychologist · doi:10.1080/13854046.2021.1970230 · Cited by 72
“…time, there were only a handful of studies investigating whether remote evaluations were comparable to in-person evaluations, primarily in older adult populations (e.g. Cullum et al., 2014; Kirkwood et al., 2000; Temple et al., 2010); reviewed in (Brearly et al., 2017) and (Marra et al., 2020).”
BackgroundResultHewitt, K. C., & Loring, D. W. (2020) · The Clinical Neuropsychologist · doi:10.1080/13854046.2020.1791960 · Cited by 59
“Greater empirical support is also described for verbally mediated tasks although support for visual tasks is present (Brearly et al., 2017).”
BackgroundHammers, D. B., Stolwyk, R. J., Harder, L., & Cullum, C. M. (2020) · The Clinical Neuropsychologist · doi:10.1080/13854046.2020.1810323 · Cited by 59
Telehealth Delivery of Memory Rehabilitation Following Stroke
Lawson, D. W., Stolwyk, R. J., Ponsford, J. L., McKenzie, D. P., Downing, M. G., & Wong, D. (2020) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617719000651 · Cited by 57
“A meta-analysis by Brearly et al. (2017) supported the equivalence of videoconferencing administration of synchronous-dependent tests (such as wordlist- learning) used in this study.”
MethodValidity of In-Home Teleneuropsychological Testing in the Wake of COVID-19
Parks, A. C., Davis, J., Spresser, C. D., Stroescu, I., & Ecklund-Johnson, E. P. (2021) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acab002 · Cited by 58
Chaytor, N. S., Barbosa‐Leiker, C., Germine, L. T., Fonseca, L. M., McPherson, S., & Tuttle, K. R. (2020) · The Clinical Neuropsychologist · doi:10.1080/13854046.2020.1811893 · Cited by 57
Farmer, R. L., McGill, R. J., Dombrowski, S. C., McClain, M. B., Harris, B., Lockwood, A. B., Powell, S. L., Pynn, C., Smith-Kellen, S., Loethen, E., et al. (2020) · Professional Psychology Research and Practice · doi:10.1037/pro0000349 · Cited by 56
Telemedicine for management of patients with amyotrophic lateral sclerosis through COVID-19 tail
Bombaci, A., Abbadessa, G., Trojsi, F., Leocani, L., Bonavita, S., Lavorgna, L., on behalf of the Digital Technologies, W. A. S. M. S. G. O. T. I. S. O. N., Tedeschi, G., Mancardi, G., Padovani, A., et al. (2020) · Neurological Sciences · doi:10.1007/s10072-020-04783-x · Cited by 55
“A review highlighted the usefulness of some neuropsychological test administered by videoconference in new diagnosis and in follow-up [18].”
BackgroundCysique, L. A., Łojek, E., Cheung, T. C. K., Cullen, B., Egbert, A. R., Evans, J. J., Garolera, M., Gawron, N., Gouse, H., Hansen, K., et al. (2021) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617721000862 · Cited by 54
“A meta-analysis of teleneuropsychology administration compared with in-person (Brearly et al., 2017) found that the difference between videoconference and in-person performance was very small (Hedges g=−0.03), and not statistically or clinically significant.”
BackgroundInfluentialTelemental health for clinical assessment and treatment
Sugarman, D. E., & Busch, A. B. (2023) · BMJ · doi:10.1136/bmj-2022-072398 · Cited by 60
Conducting Psychoeducational Assessments During the COVID-19 Crisis: the Danger of Good Intentions
Farmer, R. L., McGill, R. J., Dombrowski, S. C., Benson, N. F., Smith-Kellen, S., Lockwood, A. B., Powell, S. L., Pynn, C., & Stinnett, T. A. (2020) · Contemporary School Psychology · doi:10.1007/s40688-020-00293-x · Cited by 56
Iiboshi, K., Yoshida, K., Yamaoka, Y., Eguchi, Y., Sato, D., Kishimoto, M., Funaki, K., Mimura, M., & Kishimoto, T. (2019) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2019.0134 · Cited by 49
Pediatric neuropsychological evaluation via telehealth: Novel models of care
Pritchard, A. E., Sweeney, K. L., Salorio, C. F., & Jacobson, L. A. (2020) · The Clinical Neuropsychologist · doi:10.1080/13854046.2020.1806359 · Cited by 51
“Naturally, pre-established models of tele-neuropsychology set the foundation for this model of care (Brearly et al., 2017; Cullum et al., 2014; Grosch et al., 2011).”
MethodWilliams, L. M., Coman, J. T., Stetz, P. C., Walker, N. C., Kozel, F. A., George, M. S., Yoon, J. H., Hack, L. M., Madore, M. R., Lim, K. O., et al. (2021) · BMC Psychiatry · doi:10.1186/s12888-020-03030-z · Cited by 50
Nick, J. M., Roberts, L. R., & Petersen, A. B. (2021) · JBI Evidence Synthesis · doi:10.11124/jbies-20-00329 · Cited by 52
Parsons, M. W., Gardner, M. M., Sherman, J. C., Pasquariello, K., Grieco, J. A., Kay, C. D., Pollak, L. E., Morgan, A. K., Carlson-Emerton, B., Seligsohn, K., et al. (2021) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617721000436 · Cited by 52
“Although the early studies of reliability and validity using assisted-TNP are promising (Brearly et al., 2017; Cullum et al., 2014; Marra, Hamlet, Bauer, & Bowers, 2020; Sutherland et al., 2019; Wadsworth et al., 2016), the lack of control over the testing environment in DTH-TNP raises concerns for…”
BackgroundInfluentialStudy partners: essential collaborators in discovering treatments for Alzheimer’s disease
Largent, E. A., Karlawish, J. H., & Grill, J. D. (2018) · Alzheimer s Research & Therapy · doi:10.1186/s13195-018-0425-4 · Cited by 49
Teleneuropsychology in the time of COVID-19: The experience of The Australian Epilepsy Project
Tailby, C., Collins, A., Vaughan, D. N., Abbott, D. F., O’Shea, M. F., Helmstaedter, C., & Jackson, G. D. (2020) · Seizure · doi:10.1016/j.seizure.2020.10.005 · Cited by 49
“Indeed, the majority of evidence for telehealth administration comes from studies where examinees are tested via technology at a local research facility [47].”
InfluentialRabinovitz, B., Jaywant, A., & Fridman, C. B. (2020) · The Clinical Neuropsychologist · doi:10.1080/13854046.2020.1803408 · Cited by 46
“A recent meta-analysis found that performance on neuropsychological assessments—such as digit span, verbal fluency, list learning and memory, and confrontation naming—was equivalent when comparing in-person to telehealth administration (Brearly et al., 2017).”
BackgroundHunter, M. B., Jenkins, N. D., Dolan, C., Pullen, H., Ritchie, C. W., & Terrera, G. M. (2021) · Journal of Alzheimer s Disease · doi:10.3233/jad-210088 · Cited by 45
“Brearly et al. [2] noted a marginal bias for in-person administration, and the reasons for this are unknown.”
InfluentialIn-Home Video Telehealth for Dementia Management: Implications for Rehabilitation
Gately, M., Trudeau, S. A., & Moo, L. (2019) · Current Geriatrics Reports · doi:10.1007/s13670-019-00297-3 · Cited by 43
Tele-Neuropsychological Assessment of Alzheimer’s Disease
Carotenuto, A., Traini, E., Fasanaro, A. M., Battineni, G., & Amenta, F. (2021) · Journal of Personalized Medicine · doi:10.3390/jpm11080688 · Cited by 44
“technical, legal, and clinical intricacies of videoconference assessment before engaging in remote assessment [45].”
BackgroundChapman, J. E., Ponsford, J. L., Bagot, K. L., Cadilhac, D. A.-M., Gardner, B. K., & Stolwyk, R. J. (2020) · Australian Psychologist · doi:10.1111/ap.12471 · Cited by 45
“For example, Brearly et al. (2017) demonstrated meta-analytic evidence of the equivalence of videoconference and face- to-face administrations of traditional neuropsychological tasks.”
BackgroundGosse, P. J., Kassardjian, C. D., Masellis, M., & Mitchell, S. B. (2021) · Canadian Medical Association Journal · doi:10.1503/cmaj.201938 · Cited by 44
“24 A recent systematic review noted that cognitive impairment and the use of nontraditional assessment methods, including the use of the home environment and a lack of supervision, posed potential challenges to the validity of remote cognitive assessments.”
Pediatric Teleneuropsychology: Feasibility and Recommendations
Ransom, D. M. E., Butt, S. M., DiVirgilio, E. K., Cederberg, C. D., Srnka, K., Hess, C. T., Sy, M. C., & Katzenstein, J. M. (2020) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaa103 · Cited by 42
Rawlings, G. H., Gaskell, C. J., Rolling, K., & Beail, N. (2021) · Advances in Mental Health and Intellectual Disabilities · doi:10.1108/amhid-06-2020-0014 · Cited by 42
Assessment During the COVID-19 Pandemic: Ethical, Legal, and Safety Considerations Moving Forward
Stifel, S. W. F., Feinberg, D. K., Zhang, Y., Chan, M. M., & Wagle, R. (2020) · School Psychology Review · doi:10.1080/2372966x.2020.1844549 · Cited by 39
“…administration of verbally mediated tests showed consistent scores (e.g., Wechsler Adult Intelligence Scale, Wechsler Memory Scale) but more variabilities were observed on visually mediated and motor-dependent tests that require examinees to interact with physical objects (Brearly et al., 2017).”
BackgroundMethodResultInfluentialTeleneuropsychology clinic development and patient satisfaction
Appleman, E. R., O’Connor, M. K., Boucher, S., Rostami, R., Sullivan, S. K., Migliorini, R., & Kraft, M. L. (2021) · The Clinical Neuropsychologist · doi:10.1080/13854046.2020.1871515 · Cited by 44
“Initial work in this area has demonstrated some consistent performances when comparing in-person and video-administered evaluations (Brearly et al., 2017; Cullum et al., 2014; Jacobsen et al., 2003; Turner et al., 2012; Wadsworth et al., 2016).”
BackgroundResultPatient Satisfaction with Telephone Neuropsychological Assessment
Lacritz, L. H., Carlew, A. R., Livingstone, J. R., Bailey, K. C., Parker, A., & Diaz, A. (2020) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaa097 · Cited by 37
Chapman, J. E., Gardner, B. K., Ponsford, J. L., Cadilhac, D. A.-M., & Stolwyk, R. J. (2020) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617720001174 · Cited by 36
“Results from this body of research are broadly promising (for a review, see Brearly et al., 2017; Marra, Hamlet, Bauer, & Bowers, 2020).”
BackgroundInfluentialZanin, E., Aiello, E. N., Diana, L., Fusi, G., Bonato, M., Niang, A., Ognibene, F., Corvaglia, A., Caro, C. D., Cintoli, S., et al. (2021) · Neurological Sciences · doi:10.1007/s10072-021-05719-9 · Cited by 37
“Moreover, a discrete number of domain-specific tests are validated for web or videoconference administration for the English language [1, 11].”
BackgroundResultNkodo, J.-A., Gana, W., Debacq, C., Aidoud, A., Poupin, P., Camus, V., & Fougère, B. (2022) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2022.01.013 · Cited by 36
Nielsen, T. R., Franzen, S., Watermeyer, T., Jiang, J., Calia, C., Kjærgaard, D., Bothe, S. K., & Mukadam, N. (2024) · The Clinical Neuropsychologist · doi:10.1080/13854046.2024.2335113 · Cited by 46
“…teleneuropsychology may help ensure access to bilingual neuropsychologists providing remote assessments in the future (Sala et al., 2021), several technical, ethical, legal, assessment, and training issues need to be resolved before wider implementation of these technologies (Brearly et al., 2017).”
Krach, S. K., Paskiewicz, T. L., & Monk, M. M. (2020) · Journal of Psychoeducational Assessment · doi:10.1177/0734282920962839 · Cited by 36
“The fi eld of tele-assessment is relatively new (Brearly et al., 2017), but it does pre-date COVID-19.”
BackgroundMethodTele-Neuropsychology: From Science to Policy to Practice
Sperling, S. A., Acheson, S. K., Fox‐Fuller, J. T., Colvin, M. K., Harder, L., Cullum, C. M., Randolph, J. J., Carter, K. R., Espe‐Pfeifer, P., Lacritz, L. H., et al. (2023) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acad066 · Cited by 35
Caze, T. J., Dorsman, K. A., Carlew, A. R., Diaz, A., & Bailey, K. C. (2020) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaa098 · Cited by 34
Examining Older Adult Cognitive Status in the Time of COVID ‐19
Hantke, N. C., & Gould, C. E. (2020) · Journal of the American Geriatrics Society · doi:10.1111/jgs.16514 · Cited by 34
Hamner, T., Salorio, C. F., Kalb, L. G., & Jacobson, L. A. (2021) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617721001053 · Cited by 34
“Overall, the literature suggests no effect of testing for remote versus in-person administration for neuropsychological testing (for metanalysis, see Brearly et al., 2017), though this was limited by few available studies, selection bias related to participant age, and mixed designs.”
BackgroundMethodChappelle, S. D., Gigliotti, C. M., Léger, G. C., Peavy, G. M., Jacobs, D. M., Banks, S. J., Little, E. A., Galasko, D. R., & Salmon, D. P. (2023) · Alzheimer s & Dementia · doi:10.1002/alz.13039 · Cited by 32
Teleneuropsychology practice survey during COVID-19 within the United States
Rochette, A. D., Rahman‐Filipiak, A., Spencer, R. J., Marshall, D., & Stelmokas, J. (2021) · Applied Neuropsychology Adult · doi:10.1080/23279095.2021.1872576 · Cited by 32
“, 2020), and teleNP is associated with patient and provider satisfaction (Parikh et al., 2013; Hilty et al., 2013; Brearly et al., 2017).”
BackgroundInfluentialFox‐Fuller, J. T., Ngo, J., Pluim, C. F., Kaplan, R. I., Kim, D.-H., Anzai, J. A. U., Yucebas, D., Briggs, S. M., Aduen, P. A., Cronin‐Golomb, A., et al. (2021) · The Clinical Neuropsychologist · doi:10.1080/13854046.2021.1954244 · Cited by 32
“Research on the remote administration of cognitive tests was of great interest to neuropsychologists even prior to the rapid adoption of teleneuropsychology (tele-NP) during the COVID-19 pandemic (Brearly et al., 2017; Miller & Barr, 2017).”
BackgroundA Teleneuropsychology Protocol for the Cognitive Assessment of Older Adults During COVID-19
Kitaigorodsky, M., Loewenstein, D., Curiel, R. E., Crocco, E., Gorman, K., & González-Jiménez, C. J. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.651136 · Cited by 31
Pugliese, R., Sala, R., Regondi, S., Beltrami, B., & Lunetta, C. (2022) · Journal of Neurology · doi:10.1007/s00415-022-10971-w · Cited by 31
Sumpter, R. E., Camsey, E., Meldrum, S., Alford, M., Campbell, I. C., Bois, C., O’Connell, S., & Flood, J. (2022) · The Clinical Neuropsychologist · doi:10.1080/13854046.2022.2056922 · Cited by 31
“Authors have also highlighted the limited evidence in direct-to-home assessments (Brearly et al., 2017, Marra et al., 2020) whereby assessment is completed via a remote connection direct to the patient’s home, as has been necessary practice during the time of the pandemic lockdowns.”
BackgroundAtri, A., Dickerson, B. C., Clevenger, C. K., Karlawish, J. H., Knopman, D. S., Lin, P., Norman, M., Onyike, C. U., Sano, M., Scanland, S., et al. (2024) · Alzheimer s & Dementia · doi:10.1002/alz.14335 · Cited by 37
Arias, F., Safi, D., Miranda, M., Carrión, C. I., Santos, A. L. D., Armendariz, V., Jose, I. E., Vuong, K. D., Suárez, P., & Strutt, A. M. (2020) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaa100 · Cited by 30
“In nonHispanic white persons, video TeleNP has been shown to effectively evaluate global cognitive functioning and detect cognitive impairment (Brearly et al., 2017; Harrell, Wilkins, Connor, & Chodosh, 2014; Loh, Donaldson, Flicker, Maher, & Goldswain, 2007; Wadsworth et al., 2018).”
BackgroundScott, T. M., Marton, K. M., & Madore, M. R. (2021) · The Clinical Neuropsychologist · doi:10.1080/13854046.2021.1889678 · Cited by 30
“Telehealth in general, and TeleNP specifically, have been shown to be cost-effective, acceptable to patients with a variety of conditions, and preferred by patients in rural locations (Brearly et al., 2017; Jennett et al., 2003).”
BackgroundMethodInfluentialComparison of Neuropsychological Assessment by Videoconference and Face to Face
Gnassounou, R., Defontaines, B., Denolle, S., Brun, S. D. L., Germain, R., Schwartz, D., Schück, S., Michon, A., Belin, C., & Maillet, D. (2021) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617721000679 · Cited by 30
“The meta-analysis of Brearly et al. (2017) did not include studies involving an assistant because of considerable heterogeneity in the results of “motor-dependent” tasks between the two administration methods.”
BackgroundPatten, R. V. (2021) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2021.2021645 · Cited by 30
“Teleneuropsychology has been and is currently used clinically, with a surge of interest in the technique following the initial COVID-19 outbreak (Bilder et al., 2020; Brearly et al., 2017; Hammers et al., 2020; Marra et al., 2020; Pritchard et al., 2020; Sweet et al., 2021).”
MethodBenge, J. F., & Kiselica, A. M. (2020) · The Clinical Neuropsychologist · doi:10.1080/13854046.2020.1801848 · Cited by 29
“While preliminary research suggests that neuropsychological assessments delivered via telehealth can yield similar results to those obtained at in-person visits (Brearly et al., 2017), most settings and practitioners were not providing telehealth neuropsychology previously.”
ResultFrom Face-to-Face to Home-to-Home: Validity of a Teleneuropsychological Battery
Alegret, M., Espinosa, A., Ortega, G., Pérez‐Cordón, A., Sanabria, Á., Hernández, I., Marquié, M., Rosende‐Roca, M., Mauleón, A., Ruiz, C. A., et al. (2021) · Journal of Alzheimer s Disease · doi:10.3233/jad-201389 · Cited by 30
Forensic mental telehealth assessment (FMTA) in the context of COVID-19
Drogin, E. Y. (2020) · International Journal of Law and Psychiatry · doi:10.1016/j.ijlp.2020.101595 · Cited by 28
“Such concerns continue to be addressed to the present day, with regard to an array of specialized applications that include neuropsychological assessment (Brearly et al., 2017; Galusha-Glasscock, Horton, Weiner, & Cullum, 2016; Harrell, Wilkins, Connor, & Chodosh, 2014; Wadsworth et al., 2018), dementia evaluations (C…”
Udeh‐Momoh, C. T., de Jager-Loots, C. A., Price, G. J., & Middleton, L. T. (2020) · Alzheimer s & Dementia Translational Research & Clinical Interventions · doi:10.1002/trc2.12055 · Cited by 28
Frye, W. S., Gardner, L. M., Campbell, J. M., & Katzenstein, J. M. (2021) · Journal of Child Health Care · doi:10.1177/13674935211007329 · Cited by 30
“Research examining reliability and validity for providing neuropsychological evaluations via telehealth has demonstratedmixed results (Brearly et al., 2017), although previous studies have primarily focused on adults, underscoring questions regarding the suitability of this service when working with youth.”
BackgroundHewitt, K. C., Block, C. K., Bellone, J. A., Dawson, E. L., Garcia, P., Gerstenecker, A. T., Grabyan, J. M., Howard, C., Kamath, V. J., LeMonda, B. C., et al. (2022) · The Clinical Neuropsychologist · doi:10.1080/13854046.2022.2027022 · Cited by 28
“…on the literature for a general TeleNP framework where auditory-verbally administered tasks were found to be minimally affected (e.g., digit span, verbal fluency, and list learning; Brearly et al., 2017) and there was good support for test-level validity in older adults (Marra et al., 2020a).”
ResultFeasibility of administering the WAIS-IV using a home-based telehealth videoconferencing model
Mahon, S., Webb, J. W., Snell, D. L., & Theadom, A. (2021) · The Clinical Neuropsychologist · doi:10.1080/13854046.2021.1985172 · Cited by 26
“…in the last ten years, there has been a growing body of research on the efficacy of teleneuropsychology (TNP) across clinical and research settings (Brearly et al., 2017). however, implementation of TNP into clinical practice was limited until the emergence of the COVID-19 pandemic, where the…”
BackgroundWu, R., & Yu, Z. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2097779 · Cited by 29
“Most of the well-established online meeting platforms are compatible with any operating system, increasing access to resources (Brearly et al., 2017; Hensel et al., 2021).”
BackgroundTelehealth Trials to Address Health Equity in Stroke Survivors
Sharrief, A. Z., Guzik, A. K., Jones, E., Okpala, M. N., Love, M. F., Ranasinghe, T., & Bushnell, C. (2023) · Stroke · doi:10.1161/strokeaha.122.039566 · Cited by 30
Yoshida, K., Yamaoka, Y., Eguchi, Y., Sato, D., Iiboshi, K., Kishimoto, M., Mimura, M., & Kishimoto, T. (2019) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x19845278 · Cited by 26
“This finding is also consistent with that of a recent meta-analysis investigating the effect of VTC-administered neuropsychological testing.(10) In our sample, ICCs varied among diagnoses (MCI: 0.”
MethodResultInfluentialMatchanova, A., Babicz, M. A., Medina, L. D., Rahman, S., Johnson, B., Thompson, J. L., Beltran‐Najera, I., Brooks, J. R., Sullivan, K. L., Walker, R. L., et al. (2020) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaa111 · Cited by 25
Working Group Recommendations for the Practice of Teleneuropsychology in Latin America
Crivelli, L., Quiroz, Y. T., Calandri, I. L., Martín, M., Velilla, L. M., Cusicanqui, M., Yglesias, F. C., Rodríguez, J. J. L., Armele, M., Román, F., et al. (2021) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acab080 · Cited by 27
“…(BDAE), Brief Visuospatial Memory Test-Revised (BVMT-R), Montreal Cognitive Assessment (MoCA), Alzheimer’s Disease Assessment Scale-Cognitive Subscale (ADAS-Cog)) administered by qualified professionals using existing standards are recommended (Class B Recommendation) (Brearly et al., 2017).”
BackgroundMethodInfluentialAhmed, S. F., Skibbe, L. E., McRoy, K. Z., Tatar, B. H., & Scharphorn, L. (2022) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2022.03.002 · Cited by 32
Kumar, S., Tran, J. L., Moseson, H., Tai, C. G.-L., Glenn, J. M., Madero, E. N., Krebs, C., Bott, N. T., & Juusola, J. L. (2018) · JMIR Aging · doi:10.2196/12031 · Cited by 27
Cox, S. M., Butcher, J. L., Sadhwani, A., Sananes, R., Sanz, J. H., Blumenfeld, E., Cassidy, A. R., Cowin, J. C., Ilardi, D. L., Kasparian, N. A., et al. (2022) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsac003 · Cited by 24
“Research in adult teleneuropsychology demonstrates validity for remote administration of certain standardized measures such as digit span, list learning, and verbal fluency tasks as well as the Repeatable Battery for the Assessment of Neuropsychological Status (Brearly et al., 2017; Galusha-Glasscock et al., 2016).”
Avanesova, A. A., & Shamliyan, T. (2019) · Health Policy and Technology · doi:10.1016/j.hlpt.2019.04.001 · Cited by 28
“Telemedicine interventions show promise in improving patient utcomes and access to cost-effective healthcare in various popuations and settings [1-21] .”
BackgroundClinical Trials and Tribulations in the COVID-19 Era
Weinberg, M. S., Patrick, R. E., Schwab, N. A., Owoyemi, P., May, R., McManus, A. J., Gerber, J. A., Harper, D. G., Arnold, S. E., & Forester, B. P. (2020) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2020.05.016 · Cited by 22
Loman, M. M., Vogt, E. M., Miller, L., Landsman, R. A., Duong, P. H., Kasten, J., DeFrancisco, D., Koop, J. I., & Heffelfinger, A. K. (2020) · Child Neuropsychology · doi:10.1080/09297049.2020.1830962 · Cited by 23
Foote, W. E., Goodman‐Delahunty, J., & Young, G. C. (2020) · Psychological Injury and Law · doi:10.1007/s12207-020-09398-3 · Cited by 23
Naito, A., Wills, A.-M. A., Tropea, T. F., Ramirez‐Zamora, A., Hauser, R. A., Martino, D., Turner, T. H., Rafferty, M. R., Afshari, M., Williams, K. L., et al. (2021) · npj Parkinson s Disease · doi:10.1038/s41531-021-00177-8 · Cited by 23
Remote Assessment: Origins, Benefits, and Concerns
Mulligan, C. A., & Ayoub, J. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11060114 · Cited by 25
Zeghari, R., Guerchouche, R., Tran, D.-M., Brémond, F., Lemoine, M. P., Bultingaire, V., Langel, K., Groote, Z. D., Kuhn, F., Martin, E., et al. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18116108 · Cited by 24
“These results are in line with previous research demonstrating the validity of remote neuropsychological assessments performed via VC [17].”
BackgroundResultMartínez‐Pernía, D., Olavarría, L., Fernández‐Manjón, B., Cabello, V., Henríquez, F., Robert, P. H., Alvarado, L., Barría, S., Antivilo-Bruna, A., Velásquez, J. D., et al. (2023) · Applied Neuropsychology Adult · doi:10.1080/23279095.2023.2174438 · Cited by 28
“Firstly, this assessment requires the physical presence of an expert evaluator (Brearly et al., 2017; Valladares-Rodr (cid:1) ı guez et al., 2016), restricting access to neuropsychological services depending on the country ’ s health system (Adjorlolo, 2016; Jacobsen et al., 2003).”
Assessing Cognition Outside of the Clinic
Hays, R., Henson, P., Wisniewski, H., Hendel, V., Vaidyam, A. N., & Torous, J. B. (2019) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2019.08.003 · Cited by 22
COVID ‐19 and Telehealth in older adult psychiatry‐opportunities for now and the future
Sorinmade, O. A., Kossoff, L., & Peisah, C. (2020) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.5383 · Cited by 24
A Systematic Review and a Latin American Clinical Model for Teleneuropsychological Assessment
Serrano‐Juárez, C. A., Reyes-Méndez, C., Prieto‐Corona, B., Seubert-Ravelo, A. N., Moreno-Villagómez, J., Cabañas-Tinajero, J.-Á., Yáñez-Téllez, M. G., Quezada-Torres, R. A., Téllez-Rodríguez, M., Barrera-Rodríguez, B., et al. (2022) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acac077 · Cited by 21
“There are also studies that describe the advantages and limitations of the approach (Sherwood & MacDonald, 2020; Stead & Vinson, 2019) and that evaluate its use with older adults (Brearly et al., 2017; Cullum, Hynan, Grosch, Parikh, & Weiner, 2014; Kirkwood, Peck, & Bennie, 2000; Stead & Vinson, 2019).”
BackgroundMessler, A. C., Hargrave, D. D., Trittschuh, E. H., & Sordahl, J. A. (2023) · The Clinical Neuropsychologist · doi:10.1080/13854046.2023.2192422 · Cited by 22
“Results of available validity studies have not identified significant concerns with the validity of any specific test when administered via teleNP (see reviews conducted by Brearly et al., 2017; Marra, Hamlet, et al., 2020).”
Influential
Metadata
- Authors
- Brearly, T. W., Shura, R. D., Martindale, S. L., Lazowski, R. A., Luxton, D. D., Shenal, B. V., & Rowland, J. A.
- Affiliations
- W. G. (Bill) Hefner VA Medical Center (US)
- College Board (US)
- University of Washington (US)
- Salem VA Medical Center (US)
- Corresponding author
- Brearly, Timothy W.
- Venue
- Neuropsychology Review
- Published
- 2017-06
- Volume
- 27
- Issue
- 2
- Pages
- 174-186
- ISSN
- 1040-7308 (ISSN-L)
- 1573-6660
- OpenAlex
- W2625027748
- Cited by
- 353
- References
- 54
- Citations by year
- 2026: 20 · 2025: 37 · 2024: 49 · 2023: 47 · 2022: 51 · 2021: 71 · 2020: 59 · 2019: 9 · 2018: 10
- FWCI
- 3.47
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neuropsychology Review (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Keywords
- remote neuropsychological assessment, telemedicine, Boston Naming Test, digit span, verbal fluency, list learning, internet speed, older adults, mental illness, neurocognitive disorders, reimbursement
- MeSH terms
- Adult, Aged, Aged, 80 and over, Mental Disorders, Dementia, Humans, Middle Aged, Neuropsychological Tests, Telemedicine, Videoconferencing, Cognitive Dysfunction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review