The DOI matches its Crossref record; 53 of the 54 references it cites were found in a registry or an index.
Neuropsychological Test Administration by Videoconference: A Systematic Review and Meta-Analysis
Abstract
The purpose of the current systematic review and meta-analysis was to assess the effect of videoconference administration on adult neurocognitive tests. We investigated whether the scores acquired during a videoconference administration were different from those acquired during on-site administration. Relevant counterbalanced crossover studies were identified according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Twelve studies met criteria for analysis. Included samples consisted of healthy adults as well as those with psychiatric or neurocognitive disorders, with mean ages ranging from 34 to 88 years. Heterogenous data precluded the interpretation of a summary effect for videoconference administration. Studies including particpants with a mean age of 65-75, as well as studies that utilized a high speed network connection, indicated consistent performance across videoconference and on-site conditions, however studies with older participants and slower connections were more variable. Subgroup analyses indicated that videoconference scores for untimed tasks and those allowing for repetition fell 1/10th of a standard deviation below on-site scores. Test specific analyses indicated that verbally-mediated tasks including digit span, verbal fluency, and list learning were not affected by videoconference administration. Scores for the Boston Naming Test fell 1/10th of a standard deviation below on-site scores. Heterogenous data precluded meaningful interpretation of tasks with a motor component. The administration of verbally-mediated tasks by qualified professionals using existing norms was supported, and the use of visually-dependent tasks may also be considered. Variability in previous studies indicates a need for further investigation of motor-dependent tasks. We recommend the development of clinical best practices for conducting neuropsychological assessments via videoconference, and advocate for reimbursement structures that allow consumers to benefit from the increased access, convenience, and cost-savings that remote assessment provides.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Guidelines are available to allow for remote administration of this measure, and modality of administration has been shown not to affect performance [47].”
From A randomized controlled trial of yoga vs nonaerobic exercise for veterans with PTSD: Understanding efficacy, mechanisms of change, and mode of delivery (2021) · cites this paper as [47]
In the citing paper
“However, since data are still preliminary, there is no consensus on the best practices for conducting neuropsychological assessment by telemedicine (362).”
From The Multidisciplinary Approach to Alzheimer’s Disease and Dementia. A Narrative Review of Non-Pharmacological Treatment (2018) · cites this paper as [362]
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,417
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
A basic introduction to fixed-effect and random-effects models for meta-analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.12 · Cited by 6,793
Barak, A., Hen, L., Boniel-Nissim, M., & Shapira, N. (2008) · Journal of Technology in Human Services · doi:10.1080/15228830802094429 · Cited by 1,283
The Effectiveness of Telemental Health: A 2013 Review
Hilty, D. M., Ferrer, D. C., Parish, M. B., Johnston, B., Callahan, E. J., & Yellowlees, P. M. (2013) · Telemedicine and e-Health · doi:10.1089/tmj.2013.0075 · Cited by 1,048
Videoconferencing psychotherapy: a systematic review
Backhaus, A., Agha, Z., Maglione, M. L., Repp, A., Ross, B., Zuest, D., Rice-Thorp, N. M., Lohr, J., & Thorp, S. R. (2012) · Psychological Services · doi:10.1037/a0027924 · Cited by 586
The Empirical Evidence for Telemedicine Interventions in Mental Disorders
Bashshur, R. L., Shannon, G. W., Bashshur, N., & Yellowlees, P. (2015) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2015.0206 · Cited by 466
Duff, K. (2012) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acr120 · Cited by 452
Practice effects and the use of alternate forms in serial neuropsychological testing
BEGLINGER, L., GAYDOS, B., TANGPHAODANIELS, O., DUFF, K., KAREKEN, D., CRAWFORD, J., FASTENAU, P., & SIEMERS, E. (2005) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2004.12.003 · Cited by 362
Teleneuropsychology: Evidence for Video Teleconference-Based Neuropsychological Assessment
Cullum, C. M., Hynan, L. S., Grosch, M. C., Parikh, M., & Weiner, M. (2014) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617714000873 · Cited by 265
A Guide to Conducting a Meta-Analysis
Cheung, M. W.-L., & Vijayakumar, R. (2016) · Neuropsychology Review · doi:10.1007/s11065-016-9319-z · Cited by 239
Delivery of Evidence-Based Psychotherapy via Video Telehealth
Grös, D. F., Morland, L. A., Greene, C. J., Acierno, R. E., Strachan, M. K., Egede, L. E., Tuerk, P. W., Myrick, H., & Frueh, B. C. (2013) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-013-9363-4 · Cited by 226
Telepsychiatry integration of mental health services into rural primary care settings
Fortney, J. C., Pyne, J. M., Turner, E. E., Farris, K., Normoyle, T. M., Avery, M., Hilty, D. M., & Unützer, J. (2015) · International Review of Psychiatry · doi:10.3109/09540261.2015.1085838 · Cited by 208
Acierno, R. E., Grös, D. F., Ruggiero, K. J., Hernandez‐Tejada, M. A., Knapp, R. G., Lejuez, C. W., Muzzy, W. A., Frueh, C., Egede, L. E., & Tuerk, P. W. (2016) · Depression and Anxiety · doi:10.1002/da.22476 · Cited by 170
Two Decades of Teledermatology: Current Status and Integration in National Healthcare Systems
Tensen, E., van der Heijden, J. P., Jaspers, M. W. M., & Witkamp, L. (2016) · Current Dermatology Reports · doi:10.1007/s13671-016-0136-7 · Cited by 168
Best practices for remote psychological assessment via telehealth technologies.
Luxton, D. D., Pruitt, L. D., & Osenbach, J. E. (2014) · Professional Psychology: Research and Practice · doi:10.1037/a0034547 · Cited by 162
Self-citationLilly, C. M., Zubrow, M. T., Kempner, K. M., Reynolds, H. N., Subramanian, S., Eriksson, E. A., Jenkins, C. L., Rincon, T., Kohl, B., Groves, R. H., et al. (2014) · Critical Care Medicine · doi:10.1097/ccm.0000000000000539 · Cited by 161
Advantages and Limitations of Teleneurology
Wechsler, L. R. (2015) · JAMA Neurology · doi:10.1001/jamaneurol.2014.3844 · Cited by 160
Feasibility of Telecognitive Assessment in Dementia
Cullum, C. M., Weiner, M. F., Gehrmann, H. R., & Hynan, L. S. (2006) · Assessment · doi:10.1177/1073191106289065 · Cited by 158
The Method Quality of Cross-Over Studies Involved in Cochrane Systematic Reviews
Ding, H., Hu, G. L., Zheng, X. Y., Chen, Q., Threapleton, D. E., & Zhou, Z. H. (2015) · PLoS ONE · doi:10.1371/journal.pone.0120519 · Cited by 122
Development of a telemedicine protocol for the diagnosis of Alzheimer's disease
Loh, P., Donaldson, M., Flicker, L. A., Maher, S. M., & Goldswain, P. (2007) · Journal of Telemedicine and Telecare · doi:10.1258/135763307780096159 · Cited by 110
Loh, P. K., Ramesh, P., Maher, S., Saligari, J., Flicker, L. A., & Goldswain, P. (2004) · Internal Medicine Journal · doi:10.1111/j.1444-0903.2004.00531.x · Cited by 109
Sources of error in computerized neuropsychological assessment
Cernich, A. N., BRENNANA, D., Barker, L. H., & Bleiberg, J. (2006) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2006.10.004 · Cited by 108
Galusha-Glasscock, J. M., Horton, D. K., Weiner, M., & Cullum, C. M. (2015) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acv058 · Cited by 106
Remote Neuropsychological Assessment in Rural American Indians with and without Cognitive Impairment
Wadsworth, H. E., Galusha-Glasscock, J. M., Womack, K. B., Quiceno, M. E., Weiner, M., Hynan, L. S., Shore, J. H., & Cullum, C. M. (2016) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acw030 · Cited by 105
Davis, L. E., Coleman, J. K., Harnar, J., & King, M. K. (2014) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2013.0217 · Cited by 104
Long-term care services and support systems for older adults: The role of technology.
Czaja, S. J. (2016) · American Psychologist · doi:10.1037/a0040258 · Cited by 104
Harrell, K. M., Wilkins, S. S., Connor, M. K., & Chodosh, J. (2014) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2014.04.015 · Cited by 94
Shores, M. M., Ryan‐Dykes, P., Williams, R. M., Mamerto, B., Sadak, T. I., Pascualy, M., Felker, B. L., Zweigle, M., Nichol, P., & Peskind, E. R. (2004) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.1029 · Cited by 94
Hilty, D. M., Nesbitt, T. S., Kuenneth, C. A., Cruz, G. M., & Hales, R. E. (2007) · The Journal of Rural Health · doi:10.1111/j.1748-0361.2007.00084.x · Cited by 93
Barton, C., Morris, R., Rothlind, J., & Yaffe, K. (2011) · Telemedicine and e-Health · doi:10.1089/tmj.2011.0083 · Cited by 90
The consistency of neuropsychological assessments performed via telecommunication and face to face
Kirkwood, K., Peck, D. F., & Bennie, L. (2000) · Journal of Telemedicine and Telecare · doi:10.1258/1357633001935239 · Cited by 89
Parikh, M., Grosch, M. C., Graham, L. L., Hynan, L. S., Weiner, M., Shore, J. H., & Cullum, C. M. (2013) · The Clinical Neuropsychologist · doi:10.1080/13854046.2013.791723 · Cited by 89
Psychological impact of a remote psychometric consultation with hospitalized elderly people
Montani, C., Billaud, N., Tyrrell, J., Fluchaire, I., Malterre, C., Lauvernay, N., Couturier, P., & FRANCO, A. J. (1997) · Journal of Telemedicine and Telecare · doi:10.1258/1357633971931048 · Cited by 86
Ball, C. J., Scott, N., McLaren, P., & Watson, J. P. (1993) · British Journal of Clinical Psychology · doi:10.1111/j.2044-8260.1993.tb01060.x · Cited by 85
Initial Practice Recommendations for Teleneuropsychology
Grosch, M. C., Gottlieb, M. C., & Cullum, C. M. (2011) · The Clinical Neuropsychologist · doi:10.1080/13854046.2011.609840 · Cited by 84
Hildebrand, R., Chow, H., Williams, C., Nelson, M., & Wass, P. (2004) · Journal of Telemedicine and Telecare · doi:10.1258/135763304323070751 · Cited by 82
JACOBSEN, S. E., SPRENGER, T., Andersson, S., & Krogstad, J. M. (2003) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617703930128 · Cited by 77
Vestal, L., Smith-Olinde, L., Hicks, G., Hutton, T., & Hart, J. (2006) · Clinical Interventions in Aging · doi:10.2147/ciia.2006.1.4.467 · Cited by 76
Telemedicine and the Mini-Mental State Examination: Assessment from a Distance
Ciemins, E. L., Holloway, B., Coon, P. J., McClosky-Armstrong, T., & Min, S. (2009) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2008.0144 · Cited by 68
Reliability of the MMSE Administered In-Person and by Telehealth
McEachern, W., Kirk, A., Morgan, D., Crossley, M., & Henry, C. J. (2008) · Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques · doi:10.1017/s0317167100009458 · Cited by 65
Telepsychiatry for Neurocognitive Testing in Older Rural Latino Adults
Vahia, I. V., Ng, B., Camacho, A., Cárdenas, V., Cherner, M., Depp, C. A., Palmer, B. W., Jeste, D. V., & Agha, Z. (2014) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2014.08.006 · Cited by 64
In-Person Versus Telehealth Assessment of Discourse Ability in Adults With Traumatic Brain Injury
Turkstra, L. S., Quinn-Padron, M., Johnson, J., Workinger, M. S., & Antoniotti, N. M. (2011) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0b013e31823346fc · Cited by 60
Video teleconference-based neurocognitive screening in geropsychiatry
Grosch, M. C., Weiner, M., Hynan, L. S., Shore, J. H., & Cullum, C. M. (2015) · Psychiatry Research · doi:10.1016/j.psychres.2014.12.040 · Cited by 56
Temple, V. K., Drummond, C., Valiquette, S., & Jozsvai, E. (2010) · Journal of Intellectual Disability Research · doi:10.1111/j.1365-2788.2010.01282.x · Cited by 47
Real-time teleophthalmology in rural Western Australia
Johnson, K. A., Meyer, J., Yazar, S., & Turner, A. W. (2015) · Australian Journal of Rural Health · doi:10.1111/ajr.12150 · Cited by 44
Menon, A., Kondapavalru, P., Krishna, P. M., Chrismer, J. B., Raskin, A., Hebel, J. R., & Ruskin, P. E. (2001) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-200106000-00009 · Cited by 44
Turner, T. H., Horner, M. D., VanKirk, K. K., Myrick, H., & Tuerk, P. W. (2012) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2011.0272 · Cited by 34
Adjorlolo, S. (2015) · Applied Neuropsychology Adult · doi:10.1080/23279095.2014.949718 · Cited by 25
Wennergren, J., Munshi, I. A., Fajardo, A. D., & George, V. V. (2014) · International Journal of Clinical Medicine · doi:10.4236/ijcm.2014.512097 · Cited by 12
Cited by
Sorted by citations
Philippe, T. J., Sikder, N., Jackson, A., Koblanski, M. E., Liow, E., Pilarinos, A., & Vasarhelyi, K. (2022) · JMIR Mental Health · doi:10.2196/35159 · Cited by 436
The Current State Of Telehealth Evidence: A Rapid Review.
Shigekawa, E., Fix, M., Corbett, G., Roby, D. H., & Coffman, J. (2018) · Health Affairs · doi:10.1377/hlthaff.2018.05132 · Cited by 406
Dementia care and COVID-19 pandemic: a necessary digital revolution
Cuffaro, L., Lorenzo, F. D., Bonavita, S., Tedeschi, G., Leocani, L., & Lavorgna, L. (2020) · Neurological Sciences · doi:10.1007/s10072-020-04512-4 · Cited by 311
“Although further studies are needed to test the reliability of complex tasks requiring motor and visual abilities, there is growing scientific evidence supporting the use of videoconferencing technology in the remote administration of neuropsychological tests, particularly those that rely on verbal responses [6].”
BackgroundZucchella, C., Sinforiani, E., Tamburin, S., Federico, A., Mantovani, E., Bernini, S., Casale, R., & Bartolo, M. (2018) · Frontiers in Neurology · doi:10.3389/fneur.2018.01058 · Cited by 297
“However, since data are still preliminary, there is no consensus on the best practices for conducting neuropsychological assessment by telemedicine (362).”
BackgroundMarra, D. E., Hamlet, K. M., Bauer, R. M., & Bowers, D. (2020) · The Clinical Neuropsychologist · doi:10.1080/13854046.2020.1769192 · Cited by 250
“” (Brearly et al., 2017, pg. 176). Studies from Brearly’s analysis were also included in the following qualitative analysis when the average age of participants was 65+. Article extraction took place on 3/21/2020. A total of 591 articles were extracted across the three internet databases, with 532 remaining after dupl…”
BackgroundMethodResultInfluential
Metadata
- Authors
- Brearly, T. W., Shura, R. D., Martindale, S. L., Lazowski, R. A., Luxton, D. D., Shenal, B. V., & Rowland, J. A.
- Affiliations
- W. G. (Bill) Hefner VA Medical Center (US)
- College Board (US)
- University of Washington (US)
- Salem VA Medical Center (US)
- Corresponding author
- Brearly, Timothy W.
- Venue
- Neuropsychology Review
- Published
- 2017-06
- Volume
- 27
- Issue
- 2
- Pages
- 174-186
- ISSN
- 1040-7308 (ISSN-L)
- 1573-6660
- OpenAlex
- W2625027748
- Cited by
- 353
- References
- 54
- Citations by year
- 2026: 20 · 2025: 37 · 2024: 49 · 2023: 47 · 2022: 51 · 2021: 71 · 2020: 59 · 2019: 9 · 2018: 10
- FWCI
- 3.47
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neuropsychology Review (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Keywords
- remote neuropsychological assessment, telemedicine, Boston Naming Test, digit span, verbal fluency, list learning, internet speed, older adults, mental illness, neurocognitive disorders, reimbursement
- MeSH terms
- Adult, Aged, Aged, 80 and over, Mental Disorders, Dementia, Humans, Middle Aged, Neuropsychological Tests, Telemedicine, Videoconferencing, Cognitive Dysfunction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
