Maturity of teledermatology evaluation research: a systematic literature review
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
BACKGROUND: There is a growing interest in teledermatology in today's clinical practice, but the maturity of the evaluation research of this technology is still unclear. OBJECTIVES: This systematic review describes the maturity of teledermatology evaluation research over time and explores what kind of teledermatology outcome measures have been evaluated. METHODS: Systematic review of literature found in Medline database (1966 up to April 2006). A telemedicine evaluation strategy consisting of four consecutive research phases (parallel to drug and diagnostics evaluation research) extended with a fifth postimplementation phase was used to classify all included studies by two independent reviewers. In addition, main characteristics (store-and-forward or real-time, study design, outcome measures) were registered. RESULTS: Three hundred and forty-five papers were systematically selected from Medline, and 244 papers were excluded. For two randomized controlled trials (RCTs), multiple papers in phase III were found. After correcting for this, 99 studies remained included (11 phase I, 72 phase II, two phase III, six phase IV, eight postimplementation phase). The number of phase II studies is the largest and still growing, while other phases are much less represented. Diagnostic accuracy was the most often used outcome measure and was found in phase I, II and IV. Store-and-forward teledermatology has been evaluated more since 2001, but most phase IV studies (RCTs, including cost aspects) are on real-time teledermatology. CONCLUSIONS: Most teledermatology evaluation studies are classified as feasibility studies (phase II). The number of phase III and IV studies remains low through the years. Compared with other specialties in telemedicine (i.e. telesurgery, telepaediatrics), teledermatology seems to be a mature application. However, more evaluation studies with a focus on clinical outcomes such as preventable referrals or time to recovery are needed to prove that teledermatology indeed is a promising and cost-saving technology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Systematic review of studies of patient satisfaction with telemedicine
Mair, F. (2000) · BMJ · doi:10.1136/bmj.320.7248.1517 · Cited by 734
Systematic review of cost effectiveness studies of telemedicine interventions
Whitten, P. S., Mair, F. S., Haycox, A., May, C. R., Williams, T. L., & Hellmich, S. (2002) · BMJ · doi:10.1136/bmj.324.7351.1434 · Cited by 526
Systematic review of evidence for the benefits of telemedicine
Hailey, D., Roine, R., & Ohinmaa, A. (2002) · Journal of Telemedicine and Telecare · doi:10.1258/1357633021937604 · Cited by 400
Kaplan, B. (2001) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(01)00184-8 · Cited by 380
Clinical outcomes resulting from telemedicine interventions: a systematic review
Hersh, W. R., Helfand, M., Wallace, J., Kraemer, D., Patterson, P., Shapiro, S., & Greenlick, M. (2001) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-1-5 · Cited by 234
Eedy, D. J., & Wootton, R. (2001) · British Journal of Dermatology · doi:10.1046/j.1365-2133.2001.04124.x · Cited by 224
The Substitution of Digital Images for Dermatologic Physical Examination
Kvedar, J. C. (1997) · Archives of Dermatology · doi:10.1001/archderm.1997.03890380031005 · Cited by 187
Teledermatology research review
Whited, J. D. (2006) · International Journal of Dermatology · doi:10.1111/j.1365-4632.2004.02427.x · Cited by 186
Assessment of the accuracy of low-cost store-and-forward teledermatology consultation
High, W. A., Houston, M. S., Calobrisi, S. D., Drage, L. A., & McEvoy, M. T. (2000) · Journal of the American Academy of Dermatology · doi:10.1067/mjd.2000.104519 · Cited by 183
Reliability and accuracy of dermatologists’ clinic-based and digital image consultations
Whited, J. D., Hall, R. P., Simel, D. L., Foy, M. E., Stechuchak, K. M., Drugge, R. J., Grichnik, J. M., Myers, S. A., & Horner, R. D. (1999) · Journal of the American Academy of Dermatology · doi:10.1016/s0190-9622(99)70003-4 · Cited by 155
Diagnostic Accuracy and Image Quality Using a Digital Camera for Teledermatology
Krupinski, E. A., LeSueur, B., Ellsworth, L., Levine, N., Hansen, R., Silvis, N., Sarantopoulos, P., Hite, P., Wurzel, J., Weinstein, R. S., et al. (1999) · Telemedicine Journal · doi:10.1089/107830299312005 · Cited by 154
A comparison of real‐time and store‐and‐forward teledermatology: a cost–benefit study
Loane, M. A., Bloomer, S. E., Corbett, R., Eedy, D. J., Hicks, N., Lotery, H. E., Mathews, C., Paisley, J., Steele, K., & Wootton, R. (2000) · British Journal of Dermatology · doi:10.1046/j.1365-2133.2000.03895.x · Cited by 143
Teledermoscopy - results of a multicentre study on 43 pigmented skin lesions
Piccolo, D., Smolle, J., Argenziano, G., Wolf, I. H., Braun, R., Cerroni, L., Ferrari, A., Hofmann-Wellenhof, R., Kenet, R. O., Magrini, F., et al. (2000) · Journal of Telemedicine and Telecare · doi:10.1258/1357633001935202 · Cited by 136
Patient and referring provider satisfaction with teledermatology
Weinstock, M. A., Nguyen, F. Q., & Risica, P. M. (2002) · Journal of the American Academy of Dermatology · doi:10.1067/mjd.2002.119666 · Cited by 120
Telemedicine evaluation of cutaneous diseases: A blinded comparative study
Lesher, Jr., Davis, L. S., Gourdin, F. W., English, D., & Thompson, W. O. (1998) · Journal of the American Academy of Dermatology · doi:10.1016/s0190-9622(98)70534-1 · Cited by 105
Teledermatology's impact on time to intervention among referrals to a dermatology consult service
Whited, J. D., Hall, R. P., Foy, M. E., Marbrey, L. E., Grambow, S. C., Dudley, T. K., Datta, S., Simel, D. L., & Oddone, E. Z. (2002) · Telemedicine Journal and e-Health · doi:10.1089/15305620260353207 · Cited by 105
Evaluating a telemedicine system to assist in the management of dermatology referrals
Taylor, P., Goldsmith, P., Murray, K., Harris, D., & Barkley, A. (2001) · British Journal of Dermatology · doi:10.1046/j.1365-2133.2001.04023.x · Cited by 101
Lim, A. C., Egerton, I. B., See, A., & Shumack, S. P. (2001) · Australasian Journal of Dermatology · doi:10.1046/j.1440-0960.2001.00529.x · Cited by 93
Mahendran, R., Goodfield, M. J. D., & Sheehan-Dare, R. A. (2005) · Clinical and Experimental Dermatology · doi:10.1111/j.1365-2230.2005.01735.x · Cited by 80
Teledermatology as a filtering system in pigmented lesion clinics
Moreno-Ramirez, D., Ferrandiz, L., Bernal, A. P., Duran, R. C., Martín, J. J. R., & Camacho, F. (2005) · Journal of Telemedicine and Telecare · doi:10.1258/1357633054893364 · Cited by 75
The reliability of diagnosis using store-and-forward teledermatology
Du Moulin, M. F. M. T., Bullens-Goessens, Y. I. J. M., Henquet, C. J. M., Brunenberg, D. E. M., de Bruyn-Geraerds, D. P., Winkens, R. A. G., Dirksen, C. D., Vierhout, W. P. M., & Neumann, H. A. M. (2003) · Journal of Telemedicine and Telecare · doi:10.1258/135763303769211247 · Cited by 72
Teledermatology as a tool for communication between general practitioners and dermatologists
van den Akker, T. W., Reker, C. H. M., Knol, A., Post, J., Wilbrink, J., & van der Veen, J. P. W. (2001) · Journal of Telemedicine and Telecare · doi:10.1258/1357633011936390 · Cited by 70
A pilot trial of digital imaging in skin cancer
Whited, J. D., Mills, B. J., Hall, R. P., Drugge, R. J., Grichnik, J. M., & Simel, D. L. (1998) · Journal of Telemedicine and Telecare · doi:10.1258/1357633981932046 · Cited by 66
Evaluation of telemedical services
Holle, R., & Zahlmann, G. (1999) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/4233.767083 · Cited by 62
Baba, M., Seçkin, D., & Kapdağli, S. (2005) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x0501100706 · Cited by 61
Teledermatology—high technology or not?
Harrison, P. V., Kirby, B., Dickinson, Y., & Schofield, R. (1998) · Journal of Telemedicine and Telecare · doi:10.1258/1357633981931344 · Cited by 58
Potential effect of patient-assisted teledermatology on outpatient referral rates
Eminović, N., Witkamp, L., Ravelli, A. C. J., Bos, J. D., Van Den Akker, T. W., Bousema, M. T., Henquet, C. J. M., Koopman, R. J. J., Zeegelaar, J. E., & Wyatt, J. C. (2003) · Journal of Telemedicine and Telecare · doi:10.1258/135763303771005216 · Cited by 44
Self-citationPatient Satisfaction with Store-and-Forward Teledermatology
Williams, T., May, C., Esmail, A., Ellis, N., Griffiths, C., Stewart, E., Fitzgerald, D., Morgan, M., Mould, M., Pickup, L., et al. (2001) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x010070s118 · Cited by 41
Operational teledermatology in Broken Hill, Rural Australia
See, A., Lim, A. C., Le, K., See, J., & Shumack, S. P. (2005) · Australasian Journal of Dermatology · doi:10.1111/j.1440-0960.2005.00166.x · Cited by 34
Trial of low-cost teledermatology in primary care
Hockey, A. D., Wootton, R., & Casey, T. (2004) · Journal of Telemedicine and Telecare · doi:10.1258/1357633042614221 · Cited by 32
The Cornwall dermatology electronic referral and image-transfer project
White, H., Gould, D., Mills, W., & Brendish, L. (1999) · Journal of Telemedicine and Telecare · doi:10.1258/1357633991932694 · Cited by 25
Scheinfeld, N., Fisher, M., Genis, P., & Long, H. (2003) · SKINmed: Dermatology for the Clinician · doi:10.1111/j.1540-9740.2003.02187.x · Cited by 23
Cited by
Liddy, C., Drosinis, P., & Keely, E. (2016) · Family Practice · doi:10.1093/fampra/cmw024 · Cited by 195
“However, the international literature on the impact of eConsult is mostly limited to services offering access to a single speciality, commonly dermatology (13,14).”
BackgroundResultInnovation and evaluation: taming and unleashing telecare technology
Pols, J., & Willems, D. (2011) · Sociology of Health & Illness · doi:10.1111/j.1467-9566.2010.01293.x · Cited by 173
van der Heijden, J. P., de Keizer, N. F., Bos, J. D., Spuls, P. I., & Witkamp, L. (2011) · British Journal of Dermatology · doi:10.1111/j.1365-2133.2011.10509.x · Cited by 160
Effectiveness of Online vs In-Person Care for Adults With Psoriasis: A Randomized Clinical Trial
Armstrong, A. W., Chambers, C. J., Maverakis, E., Cheng, M. Y., Dunnick, C. A., Chren, M.-M., Gelfand, J. M., Wong, D. J., Gibbons, B. M., Gibbons, C. M., et al. (2018) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.3062 · Cited by 103
Armstrong, A. W., Johnson, M. A., Lin, S., Maverakis, E., Fazel, N., & Liu, F.-T. (2015) · JAMA Dermatology · doi:10.1001/jamadermatol.2014.2299 · Cited by 90
Metadata
- Authors
- Eminović, N., de Keizer, N. F., Bindels, P. J. E., & Hasman, A.
- Venue
- British Journal of Dermatology
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-03
- Volume
- 156
- Issue
- 3
- Pages
- 412-419
- ISSN
- 0007-0963 (ISSN-L)
- 1365-2133
- OpenAlex
- W2012366126
- Cited by
- 98
- References
- 32
- FWCI
- 1.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.