Image-based medical expert teleconsultation in acute care of injuries: a systematic review of effects on information accuracy, diagnostic validity, clinical outcome, and user satisfaction
Open accessThe DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To systematically review the literature on image-based telemedicine for medical expert consultation in acute care of injuries, considering system, user, and clinical aspects. DESIGN: Systematic review of peer-reviewed journal articles. DATA SOURCES: Searches of five databases and in eligible articles, relevant reviews, and specialized peer-reviewed journals. ELIGIBILITY CRITERIA: Studies were included that covered teleconsultation systems based on image capture and transfer with the objective of seeking medical expertise for the diagnostic and treatment of acute injury care and that presented the evaluation of one or several aspects of the system based on empirical data. Studies of systems not under routine practice or including real-time interactive video conferencing were excluded. METHOD: The procedures used in this review followed the PRISMA Statement. Predefined criteria were used for the assessment of the risk of bias. The DeLone and McLean Information System Success Model was used as a framework to synthesise the results according to system quality, user satisfaction, information quality and net benefits. All data extractions were done by at least two reviewers independently. RESULTS: Out of 331 articles, 24 were found eligible. Diagnostic validity and management outcomes were often studied; fewer studies focused on system quality and user satisfaction. Most systems were evaluated at a feasibility stage or during small-scale pilot testing. Although the results of the evaluations were generally positive, biases in the methodology of evaluation were concerning selection, performance and exclusion. Gold standards and statistical tests were not always used when assessing diagnostic validity and patient management. CONCLUSIONS: Image-based telemedicine systems for injury emergency care tend to support valid diagnosis and influence patient management. The evidence relates to a few clinical fields, and has substantial methodological shortcomings. As in the case of telemedicine in general, user and system quality aspects are poorly documented, both of which affect scale up of such programs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Hasselberg 2014 conducted a review on image‐based medical expert teleconsultation, with 24 studies, including non‐randomised and feasibility studies. The overall results were similar to ours.”
From Mobile technologies to support healthcare provider to healthcare provider communication and management of care (2020) · cites this paper as Hasselberg 2014
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
The DeLone and McLean Model of Information Systems Success: A Ten-Year Update
(2003) · Journal of Management Information Systems · doi:10.1080/07421222.2003.11045748 · Cited by 11,791 · cited 3×
“The DeLone and McLean Information System Success Model [20] was used as a framework to synthesise the results according to system quality, user satisfaction, information quality (diagnostic validity) and net benefits (management and clinical outcomes).”
MethodInfluentialMurray, C. J. L., Vos, T., Lozano, R., Naghavi, M., Flaxman, A. D., Michaud, C., Ezzati, M., Shibuya, K., Salomon, J. A., Abdalla, S., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(12)61689-4 · Cited by 8,888
Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.1. The Cochrane Collaboration
Higgins, J. P. T., Green, S. R., & Higgins, J. P. T. (2008) · Cited by 7,171
Effectiveness of telemedicine: A systematic review of reviews
Ekeland, A. G., Bowes, A., & Flottorp, S. (2010) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2010.08.006 · Cited by 1,162 · cited 1×
“reviews about the effectiveness of telemedicine [8].”
Wootton, R. (2001) · BMJ · doi:10.1136/bmj.323.7312.557 · Cited by 704
Scaling Up mHealth: Where Is the Evidence?
Tomlinson, M., Rotheram-Borus, M. J., Swartz, L., & Tsai, A. C. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001382 · Cited by 673 · cited 2×
“conditions prevailing in low- and middle-income countries where this kind of research is much needed [47,50].”
BackgroundSystematic review of cost effectiveness studies of telemedicine interventions
Whitten, P. S., Mair, F. S., Haycox, A., May, C. R., Williams, T. L., & Hellmich, S. (2002) · BMJ · doi:10.1136/bmj.324.7351.1434 · Cited by 526
Currell, R., Urquhart, C., Wainwright, P., & Lewis, R. (2000) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002098 · Cited by 463 · cited 1×
“health care outcome [7] and the other was a systematic review of”
BackgroundSystematic review of evidence for the benefits of telemedicine
Hailey, D., Roine, R., & Ohinmaa, A. (2002) · Journal of Telemedicine and Telecare · doi:10.1258/1357633021937604 · Cited by 400
E-health in low- and middle-income countries: findings from the Center for Health Market Innovations
Lewis, T., Synowiec, C., Lagomarsino, G., & Schweitzer, J. (2012) · Bulletin of the World Health Organization · doi:10.2471/blt.11.099820 · Cited by 319 · cited 2×
“quality of care [48,52] and health outcome [47,50–53] has been”
BackgroundThe Updated DeLone and McLean Model of Information Systems Success
Urbach, N., & Müller, B. (2012) · Integrated Series in Information Systems · doi:10.1007/978-1-4419-6108-2_1 · Cited by 307
Diagnosis, access and outcomes: Update of a systematic review of telemedicine services
Hersh, W. R., Hickam, D. H., Severance, S. M., Dana, T. L., Krages, K. P., & Helfand, M. (2006) · Journal of Telemedicine and Telecare · doi:10.1258/135763306778393117 · Cited by 188
Piette, J., Lun, K., Moura, L., Fraser, H., Mechael, P., Powell, J., & Khoja, S. (2012) · Bulletin of the World Health Organization · doi:10.2471/blt.11.099069 · Cited by 188 · cited 2×
“conditions prevailing in low- and middle-income countries where this kind of research is much needed [47,50].”
BackgroundA systematic review of the efficacy of telemedicine for making diagnostic and management decisions
Hersh, W., Helfand, M., Wallace, J., Kraemer, D., Patterson, P., Shapiro, S., & Greenlick, M. (2002) · Journal of Telemedicine and Telecare · doi:10.1258/135763302320272167 · Cited by 170
Assessing Telemedicine: A Systematic Review of the Literature
Roine, R., Öhinmaa, A., & Hailey, D. M. (2001) · Europe PMC (PubMed Central) · Cited by 147
Guidelines for the clinical and economic evaluation of health care technologies
Guyatt, G. H., Drummond, M., Feeny, D. H., Tugwell, P., Stoddart, G. L., Haynes, R. B., BENNETT, K. J., & Labelle, R. J. (1986) · Social Science & Medicine · doi:10.1016/0277-9536(86)90046-8 · Cited by 142
Teleconsultation with the Mobile Camera-Phone in Digital Soft-Tissue Injury: A Feasibility Study
Hsieh, C.-H., Tsai, H.-H., Yin, J.-W., Chen, C.-Y., Yang, J. C.-S., & Jeng, S.-F. (2004) · Plastic and Reconstructive Surgery · doi:10.1097/01.prs.0000142402.07896.21 · Cited by 113
Telemedicine for acute plastic surgical trauma and burns
Wallace, D. L., Jones, S., Milroy, C., & Pickford, M. (2007) · Journal of Plastic Reconstructive & Aesthetic Surgery · doi:10.1016/j.bjps.2006.03.045 · Cited by 98
Subtle orthopedic fractures: teleradiology workstation versus film interpretation.
Scott, W. W., Rosenbaum, J. E., Ackerman, S. J., Reichle, R., Magid, D., Weller, J. C., & Gitlin, J. N. (1993) · Radiology · doi:10.1148/radiology.187.3.8497636 · Cited by 83
A systematic review of the evidence for telemedicine in burn care: With a UK perspective
Wallace, D. L., Hussain, A., Khan, N., & Wilson, Y. T. (2012) · Burns · doi:10.1016/j.burns.2011.09.024 · Cited by 75 · cited 1×
“as regards clinical outcomes [18].”
Wootton, R., Geissbuhler, A., Jethwani, K., Kovarik, C., Person, D., Vladzymyrskyy, A., Zanaboni, P., & Zolfo, M. (2012) · Bulletin of the World Health Organization · doi:10.2471/blt.11.099143 · Cited by 74
Chandhanayingyong, C., Tangtrakulwanich, B., & Kiriratnikom, T. (2007) · Journal of Telemedicine and Telecare · doi:10.1258/135763307780908049 · Cited by 61
Teleconsultation with the Mobile Camera-Phone in Remote Evaluation of Replantation Potential
Hsieh, C.-H., Jeng, S.-F., Chen, C.-Y., Yin, J.-W., Yang, J. C.-S., Tsai, H.-H., & Yeh, M.-C. (2005) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/01.ta.0000175098.52974.fa · Cited by 60
Telemedicine in acute plastic surgical trauma and burns
Jones, S., Milroy, C., & Pickford, M. (2004) · Annals of The Royal College of Surgeons of England · doi:10.1308/147870804344 · Cited by 56
The Impact of a Telehealth Web-Based Solution on Neurosurgery Triage and Consultation
Moya, M. H., Valdez, J. M., Yonas, H., et al. (2010) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2010.0044 · Cited by 53
A review of the role of telemedicine in the accident and emergency department
Keane, M. G. (2009) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2009.003008 · Cited by 50
Evaluation of a Digital Camera for Acquiring Radiographic Images for Telemedicine Applications
Krupinski, E., Gonzales, M., Gonzales, C., & Weinstein, R. S. (2000) · Telemedicine Journal and e-Health · doi:10.1089/153056200750040156 · Cited by 49
Telemedicine in Plastic Surgery: E-Consult the Attending Surgeon
Pap, S. A., Lach, E., & Upton, J. (2002) · Plastic and Reconstructive Surgery · doi:10.1097/00006534-200208000-00012 · Cited by 47
Does Teleradiology Improve Inter-hospital Management of Head-Injury?
(1997) · Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques · doi:10.1017/s0317167100021867 · Cited by 45
Telemedicine in Acute-Phase Injury Management: A Review of Practice and Advancements
Lewis, E. R., Thomas, C. A., Wilson, M. L., & Mbarika, V. W. A. (2012) · Telemedicine and e-Health · doi:10.1089/tmj.2011.0199 · Cited by 43
A review of telemedicine in accident and emergency: the story so far
Benger, J. R. (2000) · Emergency Medicine Journal · doi:10.1136/emj.17.3.157 · Cited by 43
Jacobs, M. J. E., Edmondson, M. J., & Lowry, J. C. (2002) · British Journal of Oral and Maxillofacial Surgery · doi:10.1054/bjom.2001.0751 · Cited by 42
Telemedicine in the U.S.A. with Focus on Clinical Applications and Issues
Kim, Y. S. (2004) · Yonsei Medical Journal · doi:10.3349/ymj.2004.45.5.761 · Cited by 36
WILSON, A. J., & Hodge, J. C. (1995) · Radiology · doi:10.1148/radiology.196.2.7617878 · Cited by 36
A cohort study of acute plastic surgery trauma and burn referrals using telemedicine
Wallace, D. L., Smith, R. W., & Pickford, M. A. (2007) · Journal of Telemedicine and Telecare · doi:10.1258/135763307781644933 · Cited by 35
Telepresence and telemedicine in trauma and emergency care management
Latifi, R., Ong, C. A., Peck, K., et al. (2005) · European surgery. Supplement/European surgery · doi:10.1007/s10353-005-0180-1 · Cited by 31
Brebner, J. A., Brebner, E. M., & Ruddick-Bracken, H. (2006) · Journal of Telemedicine and Telecare · doi:10.1258/135763306777978542 · Cited by 30
Ricci, W. M., & Borrelli, J. (2002) · Journal of Orthopaedic Trauma · doi:10.1097/00005131-200201000-00001 · Cited by 29
Archbold, H., Guha, A., Shyamsundar, S., et al. (2005) · Injury · doi:10.1016/j.injury.2004.08.027 · Cited by 29
Diagnostic Performance of Teleradiology in Cervical Spine Fracture Detection
Yoshino, M. T., CARMODY, R., Fajardo, L. L., et al. (1992) · Investigative Radiology · doi:10.1097/00004424-199201000-00011 · Cited by 28
A review of minor injuries telemedicine
Benger, J. R. (1999) · Journal of Telemedicine and Telecare · doi:10.1258/1357633991933666 · Cited by 28
Accuracy of diagnosis of subtle chest disease and subtle fractures with a teleradiology system.
Larson, A., Lynch, D., Zeligman, B. E., et al. (1998) · American Journal of Roentgenology · doi:10.2214/ajr.170.1.9423590 · Cited by 21
Comparative performance of seven long-running telemedicine networks delivering humanitarian services
Wootton, R., Geissbuhler, A., Jethwani, K., Kovarik, C., Person, D. A., Vladzymyrskyy, A., Zanaboni, P., & Zolfo, M. (2012) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2012.120315 · Cited by 21
Telemedicine and trauma referrals--a plastic surgery pilot project.
Diver, A. J., Lewis, H., & Gordon, D. J. (2009) · PubMed Central · Cited by 15
Raikin, S. M., Bley, L., & Leb, R. (1999) · Journal of Orthopaedic Trauma · doi:10.1097/00005131-199909000-00012 · Cited by 13
Telepresence and Telemedicine in Trauma and Emergency Care Management
Latifi, R., Kim, P., Porter John, M., et al. (2004) · Studies in health technology and informatics · doi:10.3233/978-1-60750-947-9-193 · Cited by 12
The added value of video for consultations in telemedicine for minor injuries work
Mair, F., McClusky, C., Wilsgaard, T., et al. (2011) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2011.110318 · Cited by 12
Poca, M. A., Sahuquillo, J., Arikán, F., et al. (2004) · Neurocirugía · doi:10.1016/s1130-1473(04)70499-6 · Cited by 12
Télémédecine et urgences de la main : étude de faisabilité
Tout, Y. A. A., Taleb, C., Kosayer, M., et al. (2009) · Annales de Chirurgie Plastique Esthétique · doi:10.1016/j.anplas.2008.10.002 · Cited by 9
The quality of telemedicine research
Whited, J. D. (2006) · Journal of Telemedicine and Telecare · doi:10.1258/135763306778558114 · Cited by 9
Kayingo, G. (2012) · PubMed · Cited by 9
Desktop teleradiology in support of rural orthopedic trauma care.
Reid, J. G., McGowan, J. J., Ricci, M. A., et al. (1997) · PubMed · Cited by 8
Efficacy of telemedicine in the initial management of orthopedic trauma.
Egol, K. A., Helfet, D. L., & Koval, K. J. (2003) · PubMed · Cited by 4
Research works printed but not linked: 2
- MA Poca, 2004, [Use of teleradiology in the evaluation and management of head-injured patients. Results of a pilot study of a link between a district general hospital and a neurosurgical referral center], Neurocirugia (Astur), 15, 17
- WHO (2011) mHealth: New horizons for health through mobile technologies. Global Observatory for eHealth series - Volume 3. WHO Press, Geneva, Switzerland.
Cited by
Almathami, H. K. Y., Win, K. T., & Vlahu-Gjorgievska, E. (2020) · Journal of Medical Internet Research · doi:10.2196/16407 · Cited by 791
“Similarly, Hasselberg et al [6] reported that image-based telemedicine systems for medical expert consultation in acute care of injuries provided valid diagnosis and influenced patient management by ensuring diagnostic validity, system quality, and satisfaction for clinicians and users.”
BackgroundRecent directions in telemedicine: Review of trends in research and practice
Wilson, L. S., & Maeder, A. J. (2015) · Healthcare Informatics Research · doi:10.4258/hir.2015.21.4.213 · Cited by 203
Gonçalves-Bradley, D. C., J Maria, A. R., Ricci-Cabello, I., Villanueva, G., Fønhus, M. S., Glenton, C., Lewin, S., Henschke, N., Buckley, B. S., Mehl, G. L., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012927.pub2 · Cited by 145
Boissin, C., Laflamme, L., Wallis, L., Fleming, J., & Hasselberg, M. (2015) · Burns · doi:10.1016/j.burns.2014.12.014 · Cited by 25
Self-citationReview of Systematic Reviews in the Field of Telemedicine
Goharinejad, S., Hajesmaeel-Gohari, S., Jannati, N., Goharinejad, S., & Bahaadinbeigy, K. (2021) · Medical Journal of The Islamic Republic of Iran · doi:10.47176/mjiri.35.184 · Cited by 18
Metadata
- Authors
- Hasselberg, M., Beer, N., Blom, L., Wallis, L. A., & Laflamme, L.
- Affiliations
- Karolinska Institutet (SE)
- Stellenbosch University (ZA)
- University of South Africa (ZA)
- Corresponding author
- Wallis, Lee A.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-06-02
- Volume
- 9
- Issue
- 6
- Pages
- e98539
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4041890
- OpenAlex
- W1971049752
- Semantic Scholar
- 2353153a73423aaf6dab3e97c2e6ae05f678e401
- Cited by
- 37
- References
- 55
- Citations by year
- 2025: 2 · 2024: 2 · 2023: 2 · 2022: 1 · 2021: 5 · 2020: 6 · 2019: 2 · 2018: 5 · 2017: 3 · 2016: 4 · 2015: 4 · 2014: 1
- FWCI
- 0.63
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- SUNScholar (Stellenbosch University) (submittedVersion)
- Funders
- Styrelsen för Internationellt Utvecklingssamarbete
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Emergency Medicine › Trauma and Emergency Care Studies
- Keywords
- teleconsultation, emergency care, expert consultation, diagnostic validity, clinical outcomes, user satisfaction, information quality, DeLone and McLean IS success model, system quality
- MeSH terms
- Consumer Behavior, Humans, Wounds and Injuries, Telemedicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

