Telemedicine in dermatology: a randomised controlled trial
Open accessThe DOI matches its Crossref record; 89 of the 97 references it cites were found in a registry or an index; 1 of the 25 sources its claims cite were checked for support.
Abstract
OBJECTIVES: To compare the clinical equivalence, patient and clinician opinion of store-and-forward (SF) teledermatology with conventional face-to-face consultation in setting a management plan for new, adult outpatient referrals. To assess the equivalence of digital photography and dermoscopy with conventional face-to-face consultation in the management of suspected cases of malignant melanoma or squamous cell carcinoma. DESIGN: For the SF teledermatology aspect of the study, a prospective randomised controlled trial was carried out. SETTING: Eight general practices and a hospital dermatology department in Sheffield, England. PARTICIPANTS: For the SF teledermatology part of the study, adults (aged 16 years and over) requiring a new (not seen by a hospital dermatologist within the past year) consultant opinion. For the digital photography element of the study, adults (aged 16 years and over) requiring a consultant opinion due to suspicion of malignant melanoma or squamous cell carcinoma. INTERVENTIONS: Patients in the telemedicine intervention group were referred to the consultant, and managed as far as possible using one or more digital still images and a structured, electronic referral and reply. The control group was managed by conventional hospital outpatient consultation. Patients referred to the 2-week wait clinic were invited to have a series of digital photographs, with and without dermoscopy, immediately before their face-to-face consultation. A second consultant viewed these and outlined a diagnosis and management plan which was compared with the actual management. Both were compared with the definitive diagnosis (either the final clinical or histological diagnosis, where undertaken). MAIN OUTCOME MEASURE: The concordance between the consultant who had managed the case and an independent consultant who gave a second face-to-face opinion. RESULTS: A total of 208 patients were recruited. There was also a greater loss of control cases (26%) than intervention cases (17%). A statistically significant difference in ages between the two groups completing the study (mean age of intervention group 43.6 years, control group 49.7 years, p = 0.039) indicates that this may have introduced a bias between the two groups. A further possible source of bias is the delay (mean difference of 54 days, p = 0.0001) between the SF opinion and the second opinion in the SF group, whereas control patients usually received their second opinion on the same day as their outpatient appointment. In 55% (51/92) of telemedicine cases and 78% (57/73) of control cases, the diagnosis concurred, with the second opinion. In 55% (51/92) of telemedicine cases and 84% (61/73) of control cases, the management plan concurred with the second opinion. Of the 92 telemedicine cases, 53 were judged also to require a face-to-face consultation, mainly to establish a diagnosis and treatment plan. With the digital photography for suspected skin cancer aspect of the study, it was found that an unexpectedly high proportion (33%, 85/256) of referrals proved to have a malignancy or a severely dysplastic lesion, with almost 22% having a malignant melanoma or squamous cell carcinoma, possibly reflecting the rise in incidence of skin cancers reported elsewhere. When both standard and dermoscopic images were employed, diagnostic concordance was modest (68%). The approach was highly sensitive (98%, 95% CI: 92 to 99%), at the expense of specificity (43%, 95% CI: 36 to 51%). Overall, 30% of cases would not have needed to be seen face-to-face, though two squamous cell carcinomas would have been missed (a number-needed-to-harm of 153). If the highest level of clinician confidence had been applied, no cancers would have been missed, but only 20% of patients would have avoided an outpatient appointment. CONCLUSIONS: In view of the difficulties in recruitment and the potential biases introduced by selective loss of patients and the delay in obtaining a valid second opinion in the study group, no valid conclusions can be drawn regarding the clinical performance of this model of SF telemedicine. With regard to digital photography in suspected skin cancer, it is unlikely that this approach can dramatically reduce the need for conventional clinical consultations, whilst still maintaining clinical safety. Additional research on the assessment of diagnostic and management agreement between clinicians would be valuable in this and other fields of research.
Overview
CoChat Summary
TL;DR
In a Sheffield randomised trial, store-and-forward teledermatology could not be validly compared with face-to-face care because recruitment failed and biases emerged; observed diagnostic and management concordance was lower for telemedicine. In a linked digital photography study of suspected skin cancer, sensitivity was high but specificity low, with 30% potentially avoiding face-to-face review but two squamous cell carcinomas missed.
Key findings
- Store-and-forward teledermatology: diagnosis concurred with a second face-to-face opinion in 55% (51/92) of telemedicine cases vs 78% (57/73) of control cases (difference -23%, 95% CI -36 to -8; p = 0.002); management concurred in 55% (51/92) vs 84% (61/73) (difference -28%, 95% CI -40 to -14; p = 0.0001).
- Of 92 telemedicine cases, 53 (58%, 95% CI 47 to 67%) were judged also to require a face-to-face consultation, mainly to establish diagnosis and treatment plan.
- Digital photography for suspected skin cancer: 33% (85/256) had a malignancy or severely dysplastic lesion, with almost 22% having malignant melanoma or squamous cell carcinoma; diagnostic concordance was 68%, sensitivity 98% (95% CI 92 to 99%), specificity 43% (95% CI 36 to 51%).
- Overall, 30% of digital photography cases would not have needed face-to-face review, but two squamous cell carcinomas would have been missed (number-needed-to-harm 153); using the highest clinician confidence, no cancers would have been missed but only 20% would have avoided an outpatient appointment.
Methods
- Store-and-forward component: prospective randomised controlled trial in eight general practices and a hospital dermatology department in Sheffield, England; adults aged 16+ requiring a new consultant opinion were randomised to telemedicine (digital still images plus structured electronic referral/reply) or conventional hospital outpatient consultation.
- Primary outcome: concordance between the managing consultant and an independent consultant who gave a second face-to-face opinion; analyses used intention-to-treat and per-protocol approaches, with equivalence assessed via confidence intervals.
- Digital photography component: adults aged 16+ referred to the 2-week wait/target clinic for suspected malignant melanoma or squamous cell carcinoma had standard and dermoscopic photographs immediately before face-to-face consultation; a second consultant’s diagnosis and management plan were compared with actual management and the definitive clinical or histological diagnosis.
Limitations
- Stated: recruitment failed to reach the target of 446 per group; only 208 patients were recruited, with greater loss of control cases (26%) than intervention cases (17%) and a significant age difference between completers (mean 43.6 vs 49.7 years, p = 0.039).
- Stated: there was a mean 54-day delay (p = 0.0001) between the store-and-forward opinion and the second opinion in the intervention group, whereas control patients usually received their second opinion the same day; the authors conclude no valid conclusions can be drawn about clinical performance of this store-and-forward model.
- Stated/evident: economic data collection was poor, preventing direct cost comparison; the digital photography study may have had recruitment bias toward higher-risk patients, and the authors note that only 30% would avoid face-to-face review while two squamous cell carcinomas would be missed.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
1 Valid · 0 Not valid · 10 Not checked · 14 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Similar findings have also been reported in other RCTs of patient satisfaction in telemedicine.”
What the sources say
- Not checked — no full text of the sourcecites [39] 39. Brennan JA, Kealy JA, Gerardi LH, Shih R, Allegra J, Sannipoli L, et al . A randomised controlled trial of telemedicine in an emergency department. J Telemed Telecare 1998; 4 :18-20. source
- Supportedcites [40] 40. Chua R, Criag J, Wootton R, Patterson V . Randomised controlled trial of telemedicine for new neurological out-patient referral. J Neurosurg Psychiatry 2001; 71 :63-6. source
The Abstract identifies this as a randomised controlled trial comparing telemedicine with face-to-face consultations and reports patient-satisfaction findings. Patients were generally satisfied with both, although the telemedicine group expressed more concern about confidentiality and embarrassment. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites [41] 41. Woods KF, Kutlar A, Johnson JA, Waller JL, Grigby RK, Stachura ME, et al . Telemedicine and standard clinical encounters: a comparison of patient satisfaction. Telemed J 1999; 5 :349-56. source
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is unlikely that this approach can dramatically reduce the need for conventional clinical consultations whilst still maintaining clinical safety.”
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When both standard and dermoscopic images were employed, diagnostic concordance was modest (68%).”
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A statistically significant difference in ages between the two groups completing the study (mean age of intervention group 43.6 years, control group 49.7 years, p = 0.039) indicates that this may have introduced a bias between the two groups.”
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If the highest level of clinician confidence had been applied, no cancers would have been missed, but only 20% of patients would have avoided an outpatient appointment.”
- Also stated in: § Digital photography
“If the highest level of clinician confidence had been applied, no cancers would have been missed, but only 20% of patients would have avoided an outpatient appointment.”
- Also stated in: § Digital photography
20 more claims
Create a free account to see all 25 claims and every source verdict.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recognition of potential melanoma and carcinoma from transmitted images was shown to have high sensitivity (98%) but low specificity (43%) [46], resulting in excessive referrals.”
From Recent directions in telemedicine: Review of trends in research and practice (2015) · cites this paper as [46]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Recruitment
“the intervention group had a mean age some 6 years higher than the control group”
§ Clinical outcomes Patient recruitment
“| Age | Mean | 43.6 | 49.7 | 0.039 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Of the 16 paired responses, the four GPs who said they were confident with diagnosis and management pre-telemedicine, post-telemedicine two remained confident and two of them said they were not confident. Of the 10 GPs who said they were unsure pre-telemedicine, three said they were confident, two remained unsure and five said they were not confident posttelemedicine. Only one GP reported being unconfident pre-telemedicine”
Reported 16 · recomputed 15
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“| Total | 186 | 70.3 | 70 | 29.7 | 256 | 100 |”
Reported 70.3 · recomputed 72.65625
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Diagnostic equivalence
“In the control group, in 79% (57/72) of cases the diagnosis was agreed between the two consultants.”
§ Store-and-forward teledermatology
“In 55% (51/92) of telemedicine cases and 78% (57/73) of control cases, the diagnosis concurred”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Recruitment
“the intervention group had a mean age some 6 years higher than the control group”
§ Store-and-forward teledermatology
“mean age of intervention group 43.6 years, control group 49.7 years”
3 more findings
Create a free account to see every finding of this check.
Citations
Cites
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373
Consensus development methods, and their use in clinical guideline development.
Murphy, Black, Lamping, McKee, Sanderson, Askham, & Marteau (1998) · Health Technology Assessment · doi:10.3310/hta2030 · Cited by 2,051
Evaluating patient-based outcome measures for use in clinical trials.
Fitzpatrick, Davey, Buxton, & Jones (1998) · Health Technology Assessment · doi:10.3310/hta2140 · Cited by 1,715
Statistics with Confidence: Confidence Intervals and Statistical Guidelines.
Jolliffe, F. R., Gardner, M. J., & Altman, D. G. (1990) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982808 · Cited by 1,319
Defining and measuring patient satisfaction with medical care
Ware, J. E., Snyder, M. K., Wright, W. R., & Davies, A. R. (1983) · Evaluation and Program Planning · doi:10.1016/0149-7189(83)90005-8 · Cited by 1,259
Sackett, D. L. (1997) · Seminars in Perinatology · doi:10.1016/s0146-0005(97)80013-4 · Cited by 1,061
Trials to assess equivalence: the importance of rigorous methods: Fig 1
Jones, B., Jarvis, P., Lewis, J. A., & Ebbutt, A. F. (1996) · BMJ · doi:10.1136/bmj.313.7048.36 · Cited by 1,032
Dermoscopy of pigmented skin lesions – a valuable tool for early
Argenziano, G., & Soyer, H. P. (2001) · The Lancet Oncology · doi:10.1016/s1470-2045(00)00422-8 · Cited by 391
Antimicrobial prophylaxis in colorectal surgery: a systematic review of randomized controlled trials
Song, F., & Glenny, A.-M. (1998) · Journal of British Surgery · doi:10.1046/j.1365-2168.1998.00883.x · Cited by 372
Telemedicine: A guide to assessing telecommunications in healthcare
Field, M. J. (1997) · Journal of Digital Imaging · doi:10.1007/bf03168648 · Cited by 372
Research works printed but not linked: 3
- [17]17. Kim YS. Telemedicine in the USA with focus on clinical applications and issues. Yonsei Med J 2004; 45 :761-75.
- [15]15. physician perceptions and diagnostic agreement. Arch Dermatol 1998; 134 :471-6.
- [46]46. Taylor P , Goldsmith P , Murray K, Harris D, Barkley A, et al . Evaluating a telemedicine system to assist in the management of dermatology referrals. Br J Dermatol 2001; 144 :328-33.
Cited by
Teledermatology for diagnosis and management of skin conditions: A systematic review
Warshaw, E. M., Hillman, Y. J., Greer, N. L., Hagel, E. M., MacDonald, R., Rutks, I. R., & Wilt, T. J. (2011) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2010.08.026 · Cited by 310
Dermoscopy, with and without visual inspection, for diagnosing melanoma in adults
Dinnes, J., Deeks, J. J., Chuchu, N., Ferrante di Ruffano, L., Matin, R. N., Thomson, D. R., Wong, K. Y., Aldridge, R. B., Abbott, R., Fawzy, M., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011902.pub2 · Cited by 232
Integrating telecare for chronic disease management in the community: What needs to be done?
May, C. R., Finch, T. L., Cornford, J., Exley, C., Gately, C., Kirk, S., Jenkings, K. N., Osbourne, J., Robinson, A. L., Rogers, A., et al. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-131 · Cited by 220
Telemedicine in dermatology: findings and experiences worldwide—a systematic literature review.
Trettel, A., Eissing, L., & Augustin, M. (2018) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.14341 · Cited by 206
Recent directions in telemedicine: Review of trends in research and practice
Wilson, L. S., & Maeder, A. J. (2015) · Healthcare Informatics Research · doi:10.4258/hir.2015.21.4.213 · Cited by 203
Liddy, C., Drosinis, P., & Keely, E. (2016) · Family Practice · doi:10.1093/fampra/cmw024 · Cited by 195
“Ten studies in six different settings examined patients’ experiences with eConsult services (17,22,26,29,33,34,40,42,44,49).”
BackgroundMethodInfluentialTeledermatology for diagnosing skin cancer in adults.
Chuchu, N., Dinnes, J., Takwoingi, Y., Matin, R. N., Bayliss, S. E., Davenport, C., Moreau, J. F., Bassett, O., Godfrey, K., O'Sullivan, C., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013193 · Cited by 175
van der Heijden, J. P., de Keizer, N. F., Bos, J. D., Spuls, P. I., & Witkamp, L. (2011) · British Journal of Dermatology · doi:10.1111/j.1365-2133.2011.10509.x · Cited by 160
Impact of Telemedicine Upon Rural Trauma Care
Duchesne, J. C., Kyle, A., Simmons, J., Islam, S., Schmieg, R. E., Olivier, J., & McSwain, N. E. (2008) · Journal of Trauma: Injury, Infection & Critical Care · doi:10.1097/ta.0b013e31815dd4c4 · Cited by 152
Teledermatology: Key factors associated with reducing face-to-face dermatology visits
Landow, S. M., Mateus, A., Korgavkar, K., Nightingale, D., & Weinstock, M. A. (2014) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2014.02.021 · Cited by 131
Wootton, R., Bahaadinbeigy, K., & Hailey, D. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-185 · Cited by 123
Application of mobile teledermatology for skin cancer screening
Lamel, S. A., Haldeman, K. M., Ely, H., Kovarik, C. L., Pak, H., & Armstrong, A. W. (2012) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2011.11.957 · Cited by 125
Naka, F., Lu, J., Porto, A. F., Villagra, J. D., Wu, Z. H., & Anderson, D. (2017) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2017.09.017 · Cited by 115
A systematic review of satisfaction with teledermatology
Mounessa, J. S., Chapman, S., Braunberger, T., Qin, R., Lipoff, J. B., Dellavalle, R. P., & Dunnick, C. A. (2018) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x17696587 · Cited by 111
Practice Guidelines for Teledermatology
McKoy, K., Antoniotti, N. M., Armstrong, A., Bashshur, R., Bernard, J., Bernstein, D., Burdick, A., Edison, K., Goldyne, M., Kovarik, C., et al. (2016) · Telemedicine and e-Health · doi:10.1089/tmj.2016.0137 · Cited by 99
Liddy, C., Drosinis, P., Deri Armstrong, C., McKellips, F., Afkham, A., & Keely, E. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010920 · Cited by 92
Teledermatology: A Review of Reliability and Accuracy of Diagnosis and Management
S. Levin, Y., & Warshaw, E. M. (2009) · Dermatologic Clinics · doi:10.1016/j.det.2008.11.012 · Cited by 92
The Empirical Foundations of Teledermatology: A Review of the Research Evidence
Bashshur, R. L., Shannon, G. W., Tejasvi, T., Kvedar, J. C., & Gates, M. (2015) · Telemedicine and e-Health · doi:10.1089/tmj.2015.0146 · Cited by 90
Eminović, N., de Keizer, N. F., Wyatt, J. C., ter Riet, G., Peek, N., van Weert, H. C., Bruijnzeel-Koomen, C. A., & Bindels, P. J. E. (2009) · Archives of Dermatology · doi:10.1001/archdermatol.2009.44 · Cited by 89
Dinnes, J., Deeks, J. J., Chuchu, N., Matin, R., Wong, K. Y., Aldridge, R. B., Durack, A., Gulati, A., Chan, S. A., Johnston, L., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011901.pub2 · Cited by 138
Winpenny, E. M., Miani, C., Pitchforth, E., King, S., & Roland, M. O. (2016) · Journal of Health Services Research & Policy · doi:10.1177/1355819616648982 · Cited by 70
Reliability of store and forward teledermatology for skin neoplasms
Warshaw, E. M., Gravely, A. A., & Nelson, D. B. (2015) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2014.11.001 · Cited by 81
Li, Y., Yan, X., & Song, X. (2019) · Journal of Medical Internet Research · doi:10.2196/12126 · Cited by 63
Zanaboni, P., Scalvini, S., Bernocchi, P., Borghi, G., Tridico, C., & Masella, C. (2009) · BMC Health Services Research · doi:10.1186/1472-6963-9-238 · Cited by 69
The impact of store-and-forward teledermatology on skin cancer diagnosis and treatment
Hsiao, J. L., & Oh, D. H. (2008) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2008.04.011 · Cited by 68
Whited, J. D. (2015) · Medical Clinics of North America · doi:10.1016/j.mcna.2015.07.005 · Cited by 74
Livingstone, J., & Solomon, J. (2015) · London Journal of Primary Care · doi:10.1080/17571472.2015.11493433 · Cited by 60
Quigley, E. A., Tokay, B. A., Jewell, S. T., Marchetti, M. A., & Halpern, A. C. (2015) · JAMA Dermatology · doi:10.1001/jamadermatol.2015.33 · Cited by 55
Outpatient services and primary care: scoping review, substudies and international comparisons
Winpenny, E., Miani, C., Pitchforth, E., Ball, S., Nolte, E., King, S., Greenhalgh, J., & Roland, M. (2016) · Health Services and Delivery Research · doi:10.3310/hsdr04150 · Cited by 47
Emery, J. D., Hunter, J. E., Hall, P. N., Watson, A. J., Moncrieff, M. D., & Walter, F. M. (2010) · BMC Dermatology · doi:10.1186/1471-5945-10-9 · Cited by 59
Teledermatology: From Prevention to Diagnosis of Nonmelanoma and Melanoma Skin Cancer
Fabbrocini, G., Vita, V. D., Pastore, F., D′Arco, V., Mazzella, C., Annunziata, M. C., Cacciapuoti, S., Mauriello, M. C., & Monfrecola, A. (2011) · International Journal of Telemedicine and Applications · doi:10.1155/2011/125762 · Cited by 63
Augustin, M., Wimmer, J., Biedermann, T., Blaga, R., Dierks, C., Djamei, V., Elmer, A., Elsner, P. U., Enk, A., Gass, S., et al. (2018) · JDDG Journal der Deutschen Dermatologischen Gesellschaft · doi:10.1111/ddg.13512 · Cited by 54
McFarland, L. V., Raugi, G. J., & Reiber, G. E. (2013) · Telemedicine and e-Health · doi:10.1089/tmj.2012.0327 · Cited by 48
“19 20–24 One study that used domains originally defined by Ware et al. 13 to assess patient satisfaction with teledermatology failed to report results by domain groups, making suggestions to improve teledermatology programs difficult.”
Teledermatology Patient Satisfaction in the Pacific Northwest
Hsueh, M. T., Eastman, K., McFarland, L. V., Raugi, G. J., & Reiber, G. E. (2012) · Telemedicine and e-Health · doi:10.1089/tmj.2011.0181 · Cited by 47
May, C., Giles, L., & Gupta, G. (2008) · Clinical and Experimental Dermatology · doi:10.1111/j.1365-2230.2008.02850.x · Cited by 43
Thind, C. K., Brooker, I., & Ormerod, A. D. (2011) · Clinical and Experimental Dermatology · doi:10.1111/j.1365-2230.2011.04073.x · Cited by 42
Pediatric Teledermatology Consultations: Relationship Between Provided Data and Diagnosis
Philp, J. C., Frieden, I. J., & Cordoro, K. M. (2013) · Pediatric Dermatology · doi:10.1111/pde.12180 · Cited by 41
“Some authors have found the levels of concordance vary with the level of training of the teledermatologist in addition to the availability of historical data (6,16).”
BackgroundCommunity photo-triage for skin cancer referrals: an aid to service delivery
Morton, C. A., Downie, F., Auld, S., Smith, B., van der Pol, M., Baughan, P., Wells, J., & Wootton, R. (2011) · Clinical and Experimental Dermatology · doi:10.1111/j.1365-2230.2010.03960.x · Cited by 40
Teledermatology protocol for screening of Skin Cancer
Piccoli, M. F., Amorim, B. D. B., Wagner, H. M., & Nunes, D. H. (2015) · Anais Brasileiros de Dermatologia · doi:10.1590/abd1806-4841.20153163 · Cited by 38
Marchell, R., Locatis, C., Burges, G., Maisiak, R., Liu, W.-L., & Ackerman, M. (2017) · Telemedicine and e-Health · doi:10.1089/tmj.2016.0093 · Cited by 37
Latifi, R., Merrell, R. C., Doarn, C. R., Hadeed, G. J., Bekteshi, F., Lecaj, I., Boucha, K., Hajdari, F., Hoxha, A., Koshi, D., et al. (2009) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2009.0084 · Cited by 39
Ford, J. A., & Pereira, A. (2015) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12373 · Cited by 34
Hue, L., Makhloufi, S., Sall N'Diaye, P., Blanchet‐Bardon, C., Sulimovic, L., Pomykala, F., Colomb, M., Baccard, M., Lassau, F., Reuter, G., et al. (2016) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.13404 · Cited by 34
Overview of international teledermatology
Desai, B., McKoy, K. C., & Kovarik, C. (2011) · Pan African Medical Journal · doi:10.4314/pamj.v6i1.69065 · Cited by 41
Research in Child and Adolescent Telemental Health
Myers, K., Palmer, N. B., & Geyer, J. R. (2010) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2010.08.007 · Cited by 33
Teledermatology: Kids are not just little people
Naka, F., Makkar, H., & Lu, J. (2017) · Clinics in Dermatology · doi:10.1016/j.clindermatol.2017.08.009 · Cited by 29
Andrea, F., Garavaglia, G., Gehri, R., Maenza, F., Petri, G. J., & Fusetti, C. (2011) · Hand · doi:10.1007/s11552-011-9362-4 · Cited by 28
Fiabilidad de la teledermatología de almacenamiento en un escenario real
Romero Aguilera, G., Cortina de la Calle, P., Vera Iglesias, E., Sánchez Caminero, P., García Arpa, M., & Garrido Martín, J. A. (2014) · Actas Dermo-Sifiliográficas · doi:10.1016/j.ad.2013.12.007 · Cited by 25
Diagnostic Reliability of In-Person Versus Remote Dermatology: A Meta-Analysis
Bastola, M., Locatis, C., & Fontelo, P. (2021) · Telemedicine and e-Health · doi:10.1089/tmj.2020.0043 · Cited by 26
The Virtual Toxicology Service: Wearable Head-Mounted Devices for Medical Toxicology
Chai, P. R., Wu, R. Y., Ranney, M. L., Porter, P. S., Babu, K. M., & Boyer, E. W. (2014) · Journal of Medical Toxicology · doi:10.1007/s13181-014-0420-5 · Cited by 24
Teledermatology for Diagnosis and Management of Skin Conditions: A Systematic Review of the Evidence
Warshaw, E. M., Greer, N. L., Hillman, Y., Hagel, E. M., MacDonald, R., Rutks, I. R., & Wilt, T. J. (2010) · Europe PMC (PubMed Central) · Cited by 26
Are adverse effects incorporated in economic models? An initial review of current practice
Craig, D., McDaid, C., Fonseca, T., Stock, C., Duffy, S., & Woolacott, N. F. (2009) · Health Technology Assessment · doi:10.3310/hta13620 · Cited by 25
Has teledermatology in the U.K. finally failed?
English, J. S. C., & Eedy, D. J. (2007) · British Journal of Dermatology · doi:10.1111/j.1365-2133.2007.07750.x · Cited by 23
How Accurate Are First Visit Diagnoses Using Synchronous Video Visits with Physicians?
Ohta, M., Ohira, Y., Uehara, T., Keira, K., Noda, K., Hirukawa, M., Shikino, K., Kajiwara, H., Shimada, F., Hirota, Y., et al. (2016) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2015.0245 · Cited by 20
Telemedicina y teledermatología (II)
Romero, G., Cortina, P., & Vera, E. (2008) · Actas Dermo-Sifiliográficas · doi:10.1016/s0001-7310(08)74755-0 · Cited by 22
Baumeister, T. R., Weistenhöfer, W., Drexler, H., & Kütting, B. (2009) · Contact Dermatitis · doi:10.1111/j.1600-0536.2009.01606.x · Cited by 24
Nikolakis, G. D., Vaiopoulos, G., Georgopoulos, I., Papakonstantinou, E., Gaitanis, G., & Zouboulis, C. C. (2024) · Cancers · doi:10.3390/cancers16030578 · Cited by 27
Interobserver Reliability of Store-and-Forward Teledermatology in a Clinical Practice Setting
Romero Aguilera, G., Cortina de la Calle, P., Vera Iglesias, E., Sánchez Caminero, P., García Arpa, M., & Garrido Martín, J. A. (2014) · Actas Dermo-Sifiliográficas (English Edition) · doi:10.1016/j.adengl.2014.05.018 · Cited by 19
Digital image referral for suspected skin malignancy- A pilot study of 300 patients
Tadros, A. B., Murdoch, R., & Stevenson, J. H. (2008) · Journal of Plastic Reconstructive & Aesthetic Surgery · doi:10.1016/j.bjps.2008.02.005 · Cited by 21
Goh, L. J. (2017) · International Archives of Nursing and Health Care · doi:10.23937/2469-5823/1510070 · Cited by 17
TeleDerm Study Group, Koch, R., Polanc, A., Haumann, H., Kirtschig, G., Martus, P., Thies, C. J., Sundmacher, L., Gaa, C., Witkamp, L., et al. (2018) · Trials · doi:10.1186/s13063-018-2955-2 · Cited by 19
Teledermatología urbana: concepto, ventajas y desventajas
Romero-Aguilera, G., Ferrándiz, L., & Moreno-Ramírez, D. (2018) · Actas Dermo-Sifiliográficas · doi:10.1016/j.ad.2018.02.002 · Cited by 16
A comparative study of teledermatoscopy and face-to-face examination of pigmented skin lesions
Ishioka, P., Tenório, J. M., Lopes, P. R., Yamada, S., Michalany, N. S., Amaral, M. B., Pisa, I. T., Hirata, S. H., & Almeida, F. A. (2009) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2009.081107 · Cited by 17
Abouzid, M. R., Elshafei, S. M., Elkhawas, I., & Elbana, M. K. (2022) · Cureus · doi:10.7759/cureus.26611 · Cited by 25
Calafiore, R., Khan, A., Anderson, D., Wu, Z. H., & Lu, J. (2021) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x211068275 · Cited by 20
Lipworth, A. D., Park, J. M., Trefrey, B. L., Rubin, K. M., Geller, A. C., Sober, A. J., & Tsao, H. (2011) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2010.08.021 · Cited by 16
Electronic Collaboration: Using Technology to Solve Old Problems of Quality Care
Baumlin, K. M., Genes, N. G., Landman, A., Shapiro, J. S., Taylor, T. B., & Janiak, B. D. (2010) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2010.00933.x · Cited by 19
Telemedicine and Teledermatology (II): Current State of Research on Dermatology Teleconsultations
Romero, G., Cortina, P., & Vera, E. (2008) · Actas Dermo-Sifiliográficas · doi:10.1016/s1578-2190(08)70326-3 · Cited by 23
Koelink, C. J. L., Jonkman, M. F., Van Der Meer, K., & Van Der Heide, W. K. (2014) · European Journal of Dermatology · doi:10.1684/ejd.2014.2275 · Cited by 14
Teledermatology: Its Use in the Detection and Management of Actinic Keratosis
Janda, M. (2014) · Current problems in dermatology · doi:10.1159/000366545 · Cited by 14
Koop, C., Kruus, P., Hallik, R., Lehemets, H., Vettus, E., Niin, M., Ross, P., & Kingo, K. (2023) · JAAD International · doi:10.1016/j.jdin.2023.02.019 · Cited by 12
Gilling, S., Mortz, C. G., & Vestergaard, T. (2020) · Acta Dermato Venereologica · doi:10.2340/00015555-3459 · Cited by 13
Ríos-Yuil, J. M. (2012) · Actas Dermo-Sifiliográficas (English Edition) · doi:10.1016/j.adengl.2011.05.009 · Cited by 12
Fiabilidad diagnóstica de una consulta de teledermatología asíncrona
Taberner, R., Bezares, A. P., Llambrich, Á., Mas, A. T. V., Torné, I., Lladó, C. N., & Estaràs, G. M. (2009) · Atención Primaria · doi:10.1016/j.aprim.2008.11.012 · Cited by 18
Teledermatología, del debate a la calma
Moreno-Ramírez, D., & Romero-Aguilera, G. (2016) · Actas Dermo-Sifiliográficas · doi:10.1016/j.ad.2016.01.006 · Cited by 12
Use of Telemedicine to Diagnose Tinea in Kenyan Schoolchildren
Smith, S. E., Ludwig, J. T., Chinchilli, V. M., Mehta, K., & Stoute, J. A. (2013) · Telemedicine and e-Health · doi:10.1089/tmj.2012.0085 · Cited by 11
Teledermatology: The perspective of French general practitioners
Skayem, C., Rostom, H., Hirsch, G., et al. (2021) · Annales de Dermatologie et de Vénéréologie · doi:10.1016/j.annder.2021.04.002 · Cited by 10
Concordância entre diagnósticos dermatológicos feitos presencialmente e por imagens digitais
D'Elia, P. B., Fisher, P. D., Bordin, R., Harzheim, E., & Ramos, M. C. (2007) · Anais Brasileiros de Dermatologia · doi:10.1590/s0365-05962007000600004 · Cited by 12
Koch, R., Rösel, I., Polanc, A., Thies, C. J., Sundmacher, L., Eigentler, T., Martus, P., TELEDERM Study group, & Joos, S. (2022) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x221089133 · Cited by 7
Ríos-Yuil, J. M. (2011) · Actas Dermo-Sifiliográficas · doi:10.1016/j.ad.2011.05.011 · Cited by 11
Interventional STS: A Framework for Developing Workable Technologies
Lyle, K. (2020) · Sociological Research Online · doi:10.1177/1360780420915723 · Cited by 10
Teledermatology: From the Tempest of Debate to Calmer Waters
Moreno-Ramírez, D., & Romero-Aguilera, G. (2016) · Actas Dermo-Sifiliográficas · doi:10.1016/j.adengl.2016.01.029 · Cited by 6
Is perception of quality more important than technical quality in patient video cases?
Roland, D., Matheson, D., Taub, N. A., Coats, T., & Lakhanpaul, M. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0419-x · Cited by 7
Telehealth in primary health care settings within Australia and internationally
Bywood, P. T., Raven, M. K., & Butler, C. (2013) · Flinders Academic Commons (Flinders University) · Cited by 16
Point of care cutaneous imaging technology in melanoma screening and mole mapping
Higgins, H. W., Lee, K. C., & Leffell, D. J. (2014) · F1000Prime Reports · doi:10.12703/p6-34 · Cited by 9
Edison, K. E., Chance, L., Martin, K. L., Braudis, K., & Whited, J. D. (2011) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2010.0098 · Cited by 7
Urban Teledermatology: Concept, Advantages, and Disadvantages
Romero-Aguilera, G., Ferrándiz, L., & Moreno-Ramírez, D. (2018) · Actas Dermo-Sifiliográficas · doi:10.1016/j.adengl.2018.05.024 · Cited by 7
A telemedicina alkalmazása a bőrgyógyászatban: a teledermatológia
Danis, J., Forczek, E., & Bari, F. (2016) · Orvosi Hetilap · doi:10.1556/650.2016.30371 · Cited by 5
(2022) · doi:10.46994/ets_26 · Cited by 4
The Use of Telemedicine in the Diagnosis of Skin Diseases: Review of Clinical Outcomes
Mehdizadeh, H., & Esmaeili, N. (2014) · Research Information System of Ardabil University of Medical Sciences (Ardabil University of Medical Sciences) · Cited by 7
Montazeri, M., Bahaadinbeigy, K., Rahnama, Z., & Montazeri, M. (2013) · Research Information System of Ardabil University of Medical Sciences (Ardabil University of Medical Sciences) · Cited by 4
Diagnostic accuracy of teledermatology for skin diseases: a systematic review and meta-analysis
Martyin, K., Meznerics, F. A., Bokor, L. A., Szabó, B., Hegyi, P., Kiss, N., & Bánvölgyi, A. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1739592 · Cited by 4
Griffith, V., & Foy, V. (2025) · Dermatological Reviews · doi:10.1002/der2.70049 · Cited by 7
Teledermatology: Outcomes and Economic Considerations
Pathipati, A. S., & Armstrong, A. W. (2011) · InTech eBooks · doi:10.5772/18774 · Cited by 6
Potential Public Health Measures to Tackle Skin Diseases
Mphande, F. A. (2020) · Springer eBooks · doi:10.1007/978-981-15-3879-7_6 · Cited by 2
Teledermatologie en minder bezoeken aan de dermatoloog: Een clustergewijs, gerandomiseerd onderzoek
Eminović, N., de Keizer, N. F., Peek, N. B., Wyatt, J. C., Bindels, P., van Weert, H. C. P. M., ter Riet, G., & Bruijnzeel-Koomen, C. A. F. M. (2010) · Huisarts en Wetenschap · doi:10.1007/s12445-010-0034-3 · Cited by 2
Identifying Care Gaps and Referral Patterns in Acute Dermatology at Urgent Care CentersPreprint
Rahman, S. M., Bowden, A., Green, C. B., et al. (2024) · Research Square · doi:10.21203/rs.3.rs-4763112/v1 · Cited by 1
Telemedicine R&D Influencing Incoming Strategies and Organization Models
Gabbrielli, F. (2013) · IGI Global eBooks · doi:10.4018/978-1-4666-2979-0.ch017 · Cited by 1
Gardinal‐Galera, I., Livideanu, C. B., Lamant, L., et al. (2010) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/j.1468-3083.2010.03883.x · Cited by 1
Socioeconomic Evaluation of Pediatric Teledermatology in a Tertiary Hospital
Palazón‐Cabanes, J. C., Juan‐Carpena, G., Cabanes, B. P., de Gracia, L. B., Martínez-Miravete, M. T., & Betlloch, I. (2026) · Telemedicine Journal and e-Health · doi:10.1177/15305627261432980
Metadata
- Authors
- Bowns, I., Collins, K., Walters, S., & McDonagh, A.
- Affiliations
- University of Sheffield (GB)
- Royal Hallamshire Hospital (GB)
- ORCID
- Venue
- Health Technology Assessment
- Published
- 2006-11
- Volume
- 10
- Issue
- 43
- Pages
- iii-iv, ix
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2141631049
- Cited by
- 109
- References
- 97
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 1 · 2023: 3 · 2022: 3 · 2021: 2 · 2020: 4 · 2019: 1 · 2018: 9 · 2017: 5 · 2016: 10 · 2015: 10 · 2014: 10 · 2013: 7 · 2012: 3
- FWCI
- 6.00
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Health Technology Assessment (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- SHURA (Sheffield Hallam University Research Archive) (Sheffield Hallam University) (submittedVersion)
- Funders
- Health Technology Assessment programme (96/02/26)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Systems and Technology
- Keywords
- teledermatology, store-and-forward telemedicine, digital photography, dermoscopy, melanoma, squamous cell carcinoma, second opinion, outpatient referral, clinical equivalence, patient satisfaction, provider satisfaction, diagnostic agreement, skin cancer diagnosis, loss to follow-up
- MeSH terms
- Adolescent, Adult, Aged, Attitude of Health Personnel, Carcinoma, Squamous Cell, Dermatology, England, Family Practice, Female, Hospital Departments, Humans, Male, Melanoma, Middle Aged, Patient Acceptance of Health Care, Photography, Skin Neoplasms, State Medicine, Outcome Assessment, Health Care, Remote Consultation, Videoconferencing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-26 (prompt extract-v2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


