Telemedicine in dermatology: a randomised controlled trial
Open accessThe DOI matches its Crossref record; 90 of the 97 references it cites were found in a registry or an index; 1 of the 25 sources its claims cite were checked for support.
Abstract
OBJECTIVES: To compare the clinical equivalence, patient and clinician opinion of store-and-forward (SF) teledermatology with conventional face-to-face consultation in setting a management plan for new, adult outpatient referrals. To assess the equivalence of digital photography and dermoscopy with conventional face-to-face consultation in the management of suspected cases of malignant melanoma or squamous cell carcinoma. DESIGN: For the SF teledermatology aspect of the study, a prospective randomised controlled trial was carried out. SETTING: Eight general practices and a hospital dermatology department in Sheffield, England. PARTICIPANTS: For the SF teledermatology part of the study, adults (aged 16 years and over) requiring a new (not seen by a hospital dermatologist within the past year) consultant opinion. For the digital photography element of the study, adults (aged 16 years and over) requiring a consultant opinion due to suspicion of malignant melanoma or squamous cell carcinoma. INTERVENTIONS: Patients in the telemedicine intervention group were referred to the consultant, and managed as far as possible using one or more digital still images and a structured, electronic referral and reply. The control group was managed by conventional hospital outpatient consultation. Patients referred to the 2-week wait clinic were invited to have a series of digital photographs, with and without dermoscopy, immediately before their face-to-face consultation. A second consultant viewed these and outlined a diagnosis and management plan which was compared with the actual management. Both were compared with the definitive diagnosis (either the final clinical or histological diagnosis, where undertaken). MAIN OUTCOME MEASURE: The concordance between the consultant who had managed the case and an independent consultant who gave a second face-to-face opinion. RESULTS: A total of 208 patients were recruited. There was also a greater loss of control cases (26%) than intervention cases (17%). A statistically significant difference in ages between the two groups completing the study (mean age of intervention group 43.6 years, control group 49.7 years, p = 0.039) indicates that this may have introduced a bias between the two groups. A further possible source of bias is the delay (mean difference of 54 days, p = 0.0001) between the SF opinion and the second opinion in the SF group, whereas control patients usually received their second opinion on the same day as their outpatient appointment. In 55% (51/92) of telemedicine cases and 78% (57/73) of control cases, the diagnosis concurred, with the second opinion. In 55% (51/92) of telemedicine cases and 84% (61/73) of control cases, the management plan concurred with the second opinion. Of the 92 telemedicine cases, 53 were judged also to require a face-to-face consultation, mainly to establish a diagnosis and treatment plan. With the digital photography for suspected skin cancer aspect of the study, it was found that an unexpectedly high proportion (33%, 85/256) of referrals proved to have a malignancy or a severely dysplastic lesion, with almost 22% having a malignant melanoma or squamous cell carcinoma, possibly reflecting the rise in incidence of skin cancers reported elsewhere. When both standard and dermoscopic images were employed, diagnostic concordance was modest (68%). The approach was highly sensitive (98%, 95% CI: 92 to 99%), at the expense of specificity (43%, 95% CI: 36 to 51%). Overall, 30% of cases would not have needed to be seen face-to-face, though two squamous cell carcinomas would have been missed (a number-needed-to-harm of 153). If the highest level of clinician confidence had been applied, no cancers would have been missed, but only 20% of patients would have avoided an outpatient appointment. CONCLUSIONS: In view of the difficulties in recruitment and the potential biases introduced by selective loss of patients and the delay in obtaining a valid second opinion in the study group, no valid conclusions can be drawn regarding the clinical performance of this model of SF telemedicine. With regard to digital photography in suspected skin cancer, it is unlikely that this approach can dramatically reduce the need for conventional clinical consultations, whilst still maintaining clinical safety. Additional research on the assessment of diagnostic and management agreement between clinicians would be valuable in this and other fields of research.
Overview
CoChat Summary
TL;DR
In a Sheffield randomised trial, store-and-forward teledermatology could not be validly compared with face-to-face care because recruitment failed and biases emerged; observed diagnostic and management concordance was lower for telemedicine. In a linked digital photography study of suspected skin cancer, sensitivity was high but specificity low, with 30% potentially avoiding face-to-face review but two squamous cell carcinomas missed.
Key findings
- Store-and-forward teledermatology: diagnosis concurred with a second face-to-face opinion in 55% (51/92) of telemedicine cases vs 78% (57/73) of control cases (difference -23%, 95% CI -36 to -8; p = 0.002); management concurred in 55% (51/92) vs 84% (61/73) (difference -28%, 95% CI -40 to -14; p = 0.0001).
- Of 92 telemedicine cases, 53 (58%, 95% CI 47 to 67%) were judged also to require a face-to-face consultation, mainly to establish diagnosis and treatment plan.
- Digital photography for suspected skin cancer: 33% (85/256) had a malignancy or severely dysplastic lesion, with almost 22% having malignant melanoma or squamous cell carcinoma; diagnostic concordance was 68%, sensitivity 98% (95% CI 92 to 99%), specificity 43% (95% CI 36 to 51%).
- Overall, 30% of digital photography cases would not have needed face-to-face review, but two squamous cell carcinomas would have been missed (number-needed-to-harm 153); using the highest clinician confidence, no cancers would have been missed but only 20% would have avoided an outpatient appointment.
Methods
- Store-and-forward component: prospective randomised controlled trial in eight general practices and a hospital dermatology department in Sheffield, England; adults aged 16+ requiring a new consultant opinion were randomised to telemedicine (digital still images plus structured electronic referral/reply) or conventional hospital outpatient consultation.
- Primary outcome: concordance between the managing consultant and an independent consultant who gave a second face-to-face opinion; analyses used intention-to-treat and per-protocol approaches, with equivalence assessed via confidence intervals.
- Digital photography component: adults aged 16+ referred to the 2-week wait/target clinic for suspected malignant melanoma or squamous cell carcinoma had standard and dermoscopic photographs immediately before face-to-face consultation; a second consultant’s diagnosis and management plan were compared with actual management and the definitive clinical or histological diagnosis.
Limitations
- Stated: recruitment failed to reach the target of 446 per group; only 208 patients were recruited, with greater loss of control cases (26%) than intervention cases (17%) and a significant age difference between completers (mean 43.6 vs 49.7 years, p = 0.039).
- Stated: there was a mean 54-day delay (p = 0.0001) between the store-and-forward opinion and the second opinion in the intervention group, whereas control patients usually received their second opinion the same day; the authors conclude no valid conclusions can be drawn about clinical performance of this store-and-forward model.
- Stated/evident: economic data collection was poor, preventing direct cost comparison; the digital photography study may have had recruitment bias toward higher-risk patients, and the authors note that only 30% would avoid face-to-face review while two squamous cell carcinomas would be missed.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
1 Valid · 0 Not valid · 10 Not checked · 14 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Similar findings have also been reported in other RCTs of patient satisfaction in telemedicine.”
What the sources say
- Not checked — no full text of the sourcecites [39] 39. Brennan JA, Kealy JA, Gerardi LH, Shih R, Allegra J, Sannipoli L, et al . A randomised controlled trial of telemedicine in an emergency department. J Telemed Telecare 1998; 4 :18-20. source
- Supportedcites [40] 40. Chua R, Criag J, Wootton R, Patterson V . Randomised controlled trial of telemedicine for new neurological out-patient referral. J Neurosurg Psychiatry 2001; 71 :63-6. source
The Abstract identifies this as a randomised controlled trial comparing telemedicine with face-to-face consultations and reports patient-satisfaction findings. Patients were generally satisfied with both, although the telemedicine group expressed more concern about confidentiality and embarrassment. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites [41] 41. Woods KF, Kutlar A, Johnson JA, Waller JL, Grigby RK, Stachura ME, et al . Telemedicine and standard clinical encounters: a comparison of patient satisfaction. Telemed J 1999; 5 :349-56. source
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is unlikely that this approach can dramatically reduce the need for conventional clinical consultations whilst still maintaining clinical safety.”
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When both standard and dermoscopic images were employed, diagnostic concordance was modest (68%).”
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A statistically significant difference in ages between the two groups completing the study (mean age of intervention group 43.6 years, control group 49.7 years, p = 0.039) indicates that this may have introduced a bias between the two groups.”
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If the highest level of clinician confidence had been applied, no cancers would have been missed, but only 20% of patients would have avoided an outpatient appointment.”
- Also stated in: § Digital photography
“If the highest level of clinician confidence had been applied, no cancers would have been missed, but only 20% of patients would have avoided an outpatient appointment.”
- Also stated in: § Digital photography
20 more claims
Create a free account to see all 25 claims and every source verdict.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recognition of potential melanoma and carcinoma from transmitted images was shown to have high sensitivity (98%) but low specificity (43%) [46], resulting in excessive referrals.”
From Recent directions in telemedicine: Review of trends in research and practice (2015) · cites this paper as [46]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Recruitment
“the intervention group had a mean age some 6 years higher than the control group”
§ Clinical outcomes Patient recruitment
“| Age | Mean | 43.6 | 49.7 | 0.039 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Of the 16 paired responses, the four GPs who said they were confident with diagnosis and management pre-telemedicine, post-telemedicine two remained confident and two of them said they were not confident. Of the 10 GPs who said they were unsure pre-telemedicine, three said they were confident, two remained unsure and five said they were not confident posttelemedicine. Only one GP reported being unconfident pre-telemedicine”
Reported 16 · recomputed 15
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“| Total | 186 | 70.3 | 70 | 29.7 | 256 | 100 |”
Reported 70.3 · recomputed 72.65625
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Diagnostic equivalence
“In the control group, in 79% (57/72) of cases the diagnosis was agreed between the two consultants.”
§ Store-and-forward teledermatology
“In 55% (51/92) of telemedicine cases and 78% (57/73) of control cases, the diagnosis concurred”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Recruitment
“the intervention group had a mean age some 6 years higher than the control group”
§ Store-and-forward teledermatology
“mean age of intervention group 43.6 years, control group 49.7 years”
3 more findings
Create a free account to see every finding of this check.
Citations
Cites
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373
Consensus development methods, and their use in clinical guideline development.
Murphy, Black, Lamping, McKee, Sanderson, Askham, & Marteau (1998) · Health Technology Assessment · doi:10.3310/hta2030 · Cited by 2,051
Evaluating patient-based outcome measures for use in clinical trials.
Fitzpatrick, Davey, Buxton, & Jones (1998) · Health Technology Assessment · doi:10.3310/hta2140 · Cited by 1,715
Statistics with Confidence: Confidence Intervals and Statistical Guidelines.
Jolliffe, F. R., Gardner, M. J., & Altman, D. G. (1990) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982808 · Cited by 1,319
Defining and measuring patient satisfaction with medical care
Ware, J. E., Snyder, M. K., Wright, W. R., & Davies, A. R. (1983) · Evaluation and Program Planning · doi:10.1016/0149-7189(83)90005-8 · Cited by 1,259
Sackett, D. L. (1997) · Seminars in Perinatology · doi:10.1016/s0146-0005(97)80013-4 · Cited by 1,061
Trials to assess equivalence: the importance of rigorous methods: Fig 1
Jones, B., Jarvis, P., Lewis, J. A., & Ebbutt, A. F. (1996) · BMJ · doi:10.1136/bmj.313.7048.36 · Cited by 1,032
Dermoscopy of pigmented skin lesions – a valuable tool for early
Argenziano, G., & Soyer, H. P. (2001) · The Lancet Oncology · doi:10.1016/s1470-2045(00)00422-8 · Cited by 391
Antimicrobial prophylaxis in colorectal surgery: a systematic review of randomized controlled trials
Song, F., & Glenny, A.-M. (1998) · Journal of British Surgery · doi:10.1046/j.1365-2168.1998.00883.x · Cited by 372
Telemedicine: A guide to assessing telecommunications in healthcare
Field, M. J. (1997) · Journal of Digital Imaging · doi:10.1007/bf03168648 · Cited by 372
The New NHS: Modern and Dependable?
Orton, P. (1998) · Journal of Integrated Care · doi:10.1177/146245679800200102 · Cited by 352
Treatments for fatigue in multiple sclerosis: a rapid and systematic review.
Brañas, Jordan, Fry-Smith, Burls, & Hyde (2000) · Health Technology Assessment · doi:10.3310/hta4270 · Cited by 330
Elkan, Kendrick, Hewitt, Robinson, Tolley, Blair, Dewey, Williams, & Brummell (2000) · Health Technology Assessment · doi:10.3310/hta4130 · Cited by 297
Bricker, L., Garcia, J., Henderson, J., Mugford, M., Neilson, J. P., Roberts, T. E., & Martin, M. A. (2000) · PubMed · Cited by 293
Bradley, Cullum, N. A., Nelson, Petticrew, M. P., Sheldon, & Torgerson (1999) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.3310/hta3170 · Cited by 277
King, Sibbald, Ward, Bower, Lloyd, Gabbay, & Byford (2000) · Health Technology Assessment · doi:10.3310/hta4190 · Cited by 274
MacLeod, Grant, Donaldson, Khan, Campbell, Daly, Lawrence, Wallace, Vale, Cody, et al. (1998) · Health Technology Assessment · doi:10.3310/hta2050 · Cited by 254
Monitoring blood glucose control in diabetes mellitus: a systematic review.
Coster, Gulliford, Seed, Powrie, & Swaminathan (2000) · Health Technology Assessment · doi:10.3310/hta4120 · Cited by 245
Newborn screening for inborn errors of metabolism: a systematic review.
Seymour, Thomason, Chalmers, Addison, Bain, Cockburn, Littlejohns, Lord, & Wilcox (1997) · Health Technology Assessment · doi:10.3310/hta1110 · Cited by 234
Eedy, D. J., & Wootton, R. (2001) · British Journal of Dermatology · doi:10.1046/j.1365-2133.2001.04124.x · Cited by 224
The Substitution of Digital Images for Dermatologic Physical Examination
Kvedar, J. C. (1997) · Archives of Dermatology · doi:10.1001/archderm.1997.03890380031005 · Cited by 187
Assessment of the accuracy of low-cost store-and-forward teledermatology consultation
High, W. A., Houston, M. S., Calobrisi, S. D., Drage, L. A., & McEvoy, M. T. (2000) · Journal of the American Academy of Dermatology · doi:10.1067/mjd.2000.104519 · Cited by 183
Shepherd, Waugh, & Hewitson (2000) · Health Technology Assessment · doi:10.3310/hta4330 · Cited by 175
Marks, Wonderling, Thorogood, Lambert, Humphries, & Neil (2000) · Health Technology Assessment · doi:10.3310/hta4290 · Cited by 165
Reliability and accuracy of dermatologists’ clinic-based and digital image consultations
Whited, J. D., Hall, R. P., Simel, D. L., Foy, M. E., Stechuchak, K. M., Drugge, R. J., Grichnik, J. M., Myers, S. A., & Horner, R. D. (1999) · Journal of the American Academy of Dermatology · doi:10.1016/s0190-9622(99)70003-4 · Cited by 155
Diagnostic Accuracy and Image Quality Using a Digital Camera for Teledermatology
Krupinski, E. A., LeSueur, B., Ellsworth, L., Levine, N., Hansen, R., Silvis, N., Sarantopoulos, P., Hite, P., Wurzel, J., Weinstein, R. S., et al. (1999) · Telemedicine Journal · doi:10.1089/107830299312005 · Cited by 154
Liquid-based cytology in cervical screening: a rapid and systematic review.
Payne, Chilcott, & McGoogan (2000) · Health Technology Assessment · doi:10.3310/hta4180 · Cited by 153
Coronary artery stents in the treatment of ischaemic heart disease: a rapid and systematic review.
Meads, Cummins, Jolly, Stevens, Burls, & Hyde (2000) · Health Technology Assessment · doi:10.3310/hta4230 · Cited by 152
A comparison of real‐time and store‐and‐forward teledermatology: a cost–benefit study
Loane, M. A., Bloomer, S. E., Corbett, R., Eedy, D. J., Hicks, N., Lotery, H. E., Mathews, C., Paisley, J., Steele, K., & Wootton, R. (2000) · British Journal of Dermatology · doi:10.1046/j.1365-2133.2000.03895.x · Cited by 143
Face-to-Face Diagnosis vs Telediagnosis of Pigmented Skin Tumors: A Teledermoscopic Study
Piccolo, D., Smolle, J., Wolf, I. H., Peris, K., Hofmann-Wellenhof, R., Dell'Eva, G., Burroni, M., Chimenti, S., Kerl, H., & Soyer, H. P. (1999) · Archives of Dermatology · doi:10.1001/archderm.135.12.1467 · Cited by 136
Teledermoscopy - results of a multicentre study on 43 pigmented skin lesions
Piccolo, D., Smolle, J., Argenziano, G., Wolf, I. H., Braun, R., Cerroni, L., Ferrari, A., Hofmann-Wellenhof, R., Kenet, R. O., Magrini, F., et al. (2000) · Journal of Telemedicine and Telecare · doi:10.1258/1357633001935202 · Cited by 136
What role for statins? A review and economic model.
Ebrahim, Smith, D., McCabe, Payne, Pickin, Sheldon, Lampe, Sampson, Ward, & Wannamethee (1999) · Health Technology Assessment · doi:10.3310/hta3190 · Cited by 134
McQuay, & Moore (1998) · Health Technology Assessment · doi:10.3310/hta2120 · Cited by 131
Teledermatology in the nursing home
Zelickson, B. D. (1997) · Archives of Dermatology · doi:10.1001/archderm.133.2.171 · Cited by 124
Systematic review of endoscopic ultrasound in gastro-oesophageal cancer.
Harris, Kelly, Berry, Hutton, Roderick, Cullingworth, Gathercole, O'Connor, Boyce, & Smith (1998) · Health Technology Assessment · doi:10.3310/hta2180 · Cited by 121
French, Cowan, Mansour, Morris, Procter, Hughes, Robinson, & Guillebaud (2000) · Health Technology Assessment · doi:10.3310/hta4070 · Cited by 120
Disease-modifying drugs for multiple sclerosis: a rapid and systematic review.
Clegg, Bryant, & Milne (2000) · Health Technology Assessment · doi:10.3310/hta4090 · Cited by 118
Mowatt, Bower, Brebner, Cairns, Grant, & McKee (1997) · Health Technology Assessment · doi:10.3310/hta1140 · Cited by 112
Lister-Sharp, McDonagh, Khan, & Kleijnen (2000) · Health Technology Assessment · doi:10.3310/hta4170 · Cited by 109
Randomised controlled trial of telemedicine for new neurological outpatient referrals
Chua, R. (2001) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.71.1.63 · Cited by 105
Loane, M. A., Bloomer, S. E., Corbett, R., Eedy, D. J., Evans, C., Hicks, N., Jacklin, P., Lotery, H. E., Mathews, C., Paisley, J., et al. (2001) · Journal of Telemedicine and Telecare · doi:10.1258/1357633011936246 · Cited by 105
Quality of life, distress and self‐esteem: A focus group study of people with chronic bronchitis
Nicolson, P., & Anderson, P. (2003) · British Journal of Health Psychology · doi:10.1348/135910703322370842 · Cited by 104
Evaluating a telemedicine system to assist in the management of dermatology referrals
Taylor, P., Goldsmith, P., Murray, K., Harris, D., & Barkley, A. (2001) · British Journal of Dermatology · doi:10.1046/j.1365-2133.2001.04023.x · Cited by 101
Shapiro, M., James, W. D., Kessler, R., Lazorik, F. C., Katz, K. A., Tam, J., Nieves, D. S., & Miller, J. J. (2004) · Archives of Dermatology · doi:10.1001/archderm.140.5.525 · Cited by 96
Telemedicine: A Guide to Assessing Telecommunications in Health Care
Elford, R. (1997) · Telemedicine Journal · doi:10.1089/tmj.1.1997.3.297 · Cited by 95
Patient satisfaction with teledermatology is related to perceived quality of life
Williams, T. L., May, C. R., Esmail, A., Griffiths, C. E. M., Shaw, N. T., Fitzgerald, D., Stewart, E., Mould, M., Morgan, M., Pickup, L., et al. (2001) · British Journal of Dermatology · doi:10.1046/j.1365-2133.2001.04472.x · Cited by 94
Synchronous and asynchronous telemedicine
Allely, E. B. (1995) · Journal of Medical Systems · doi:10.1007/bf02257174 · Cited by 94
Lim, A. C., Egerton, I. B., See, A., & Shumack, S. P. (2001) · Australasian Journal of Dermatology · doi:10.1046/j.1440-0960.2001.00529.x · Cited by 93
Patient Satisfaction with Teleoncology: A Pilot Study
ALLEN, A., & HAYES, J. (1995) · Telemedicine Journal · doi:10.1089/tmj.1.1995.1.41 · Cited by 88
Antimicrobial prophylaxis in total hip replacement: a systematic review.
Glenny, A., & Song, F. (1999) · PubMed · Cited by 79
Telemedicine — The Way Ahead for Medicine in the Developing World
Graham, L. E., Zimmerman, M., Vassallo, D. J., Patterson, V, Swinfen, P., Swinfen, R., & Wootton, R. (2003) · Tropical Doctor · doi:10.1177/004947550303300118 · Cited by 73
Radiology services for remote communities: cost minimisation study of telemedicine
Halvorsen, P. A., & Kristiansen, I. S. (1996) · BMJ · doi:10.1136/bmj.312.7042.1333 · Cited by 71
Reliability of Web-based teledermatology consultations
Oztas, M. O., Calikoglu, E., Baz, K., Birol, A., Onder, M., Calikoglu, T., & Kitapci, M. T. (2004) · Journal of Telemedicine and Telecare · doi:10.1258/135763304322764158 · Cited by 71
Song, & Glenny (1998) · Health Technology Assessment · doi:10.3310/hta2070 · Cited by 67
Perednia, D. A. (1995) · Archives of Dermatology · doi:10.1001/archderm.131.3.292 · Cited by 67
A pilot trial of digital imaging in skin cancer
Whited, J. D., Mills, B. J., Hall, R. P., Drugge, R. J., Grichnik, J. M., & Simel, D. L. (1998) · Journal of Telemedicine and Telecare · doi:10.1258/1357633981932046 · Cited by 66
Teledermatoscopy in Switzerland: A preliminary evaluation
Braun, R. P., Meier, M., Pelloni, F., Ramelet, A., Schilling, M., Tapernoux, B., Thürlimann, W., Saurat, J. ‐., & Krischer, J. (2000) · Journal of the American Academy of Dermatology · doi:10.1067/mjd.2000.103977 · Cited by 66
Barnard, C. M., & Goldyne, M. E. (2000) · Telemedicine Journal and e-Health · doi:10.1089/15305620050503843 · Cited by 65
Teledermatology—high technology or not?
Harrison, P. V., Kirby, B., Dickinson, Y., & Schofield, R. (1998) · Journal of Telemedicine and Telecare · doi:10.1258/1357633981931344 · Cited by 58
Daya, S. (1996) · Journal SOGC · doi:10.1016/s0849-5831(16)30310-x · Cited by 58
Teledermatology in the Highlands of Scotland
Jones, D. H., Crichton, C., Macdonald, A., Potts, S., Sime, D., Toms, J., & Mckinlay, J. (1996) · Journal of Telemedicine and Telecare · doi:10.1258/1357633961929402 · Cited by 57
Telemedicine for Dermatology Care in Rural Patients
BURGISS, S. G., JULIUS, C. E., WATSON, H. W., HAYNES, B. K., BUONOCORE, E., & SMITH, G. T. (1997) · Telemedicine Journal · doi:10.1089/tmj.1.1997.3.227 · Cited by 56
A randomized controlled trial of telemedicine in an emergency department
Brennan, J. A., Kealy, J. A., Gerardi, L. H., Shih, R., Allegra, J., Sannipoli, L., & Lutz, D. (1998) · Journal of Telemedicine and Telecare · doi:10.1258/1357633981931911 · Cited by 54
Ferrara, G., Argenziano, G., Cerroni, L., Cusano, F., Di Blasi, A., Urso, C., & Soyer, H. P. (2004) · Journal of Telemedicine and Telecare · doi:10.1258/135763304322764176 · Cited by 50
Pilot study of store and forward teledermatology services in Perth, Western Australia
Tait, C. P., & Clay, C. D. (1999) · Australasian Journal of Dermatology · doi:10.1046/j.1440-0960.1999.00358.x · Cited by 49
Evaluation of the U.K. 2-week referral rule for skin cancer
Cox, N. H. (2004) · British Journal of Dermatology · doi:10.1111/j.1365-2133.2004.05793.x · Cited by 49
Teledermatology and teledermatopathology
Pak, H. S. (2002) · Seminars in Cutaneous Medicine and Surgery · doi:10.1053/sder.2002.34945 · Cited by 49
Evaluation of an Internet-based teledermatology system
Chao, L. W., Cestari, T. F., Bakos, L., Oliveira, M. R., Miot, H. A., Zampese, M., Andrade, C. B., & Böhm, G. M. (2003) · Journal of Telemedicine and Telecare · doi:10.1258/135763303322196169 · Cited by 49
Potential effect of patient-assisted teledermatology on outpatient referral rates
Eminović, N., Witkamp, L., Ravelli, A. C. J., Bos, J. D., Van Den Akker, T. W., Bousema, M. T., Henquet, C. J. M., Koopman, R. J. J., Zeegelaar, J. E., & Wyatt, J. C. (2003) · Journal of Telemedicine and Telecare · doi:10.1258/135763303771005216 · Cited by 44
Berry, E., Kelly, Hutton, J., Harris, Roderick, P., Boyce, Cullingworth, Gathercole, O’Connor, P., & Smith, M. A. (1999) · Health Technology Assessment · doi:10.3310/hta3180 · Cited by 43
User satisfaction with realtime teleneurology
Craig, J., Russell, C., Patterson, V., & Wootton, R. (1999) · Journal of Telemedicine and Telecare · doi:10.1258/1357633991933774 · Cited by 40
Telemedicine in the U.S.A. with Focus on Clinical Applications and Issues
Kim, Y. S. (2004) · Yonsei Medical Journal · doi:10.3349/ymj.2004.45.5.761 · Cited by 38
The Effect of Decreasing Digital Image Resolution on Teledermatology Diagnosis
Vidmar, D. A., Cruess, D. F., Hsieh, P., Dolecek, Q., Pak, H. S., Gwynn, M., Maggio, K., Montemorano, A., Powers, J. M., Richards, D., et al. (1999) · Telemedicine Journal · doi:10.1089/107830299311943 · Cited by 33
Design and Implementation of a Calibrated Store and Forward Imaging System for Teledermatology
Maglogiannis, I. G. (2004) · Journal of Medical Systems · doi:10.1023/b:joms.0000041172.70027.a0 · Cited by 33
An introduction to statistical methods for health technology assessment.
White, Ashby, & Brown (2000) · Health Technology Assessment · doi:10.3310/hta4080 · Cited by 31
Sickle Cell Telemedicine and Standard Clinical Encounters: A Comparison of Patient Satisfaction
Woods, K. F., Kutlar, A., Johnson, J. A., Waller, J. L., Grigsby, R. K., Stachura, M. E., & Rahn, D. W. (1999) · Telemedicine Journal · doi:10.1089/107830299311916 · Cited by 30
Oliveira, M. R., Wen, C. L., Neto, C. F., Silveira, P. S. P., Rivitti, E. A., & Böhm, G. M. (2002) · Telemedicine Journal and e-Health · doi:10.1089/15305620260353216 · Cited by 30
THE HISTORY OF TELEDERMATOLOGY IN THE DEPARTMENT OF DEFENSE
Vidmar, D. A. (1999) · Dermatologic Clinics · doi:10.1016/s0733-8635(05)70073-5 · Cited by 27
An introduction to statistical methods for health technology assessment.
White, S. J., Ashby, D., & Brown, P. J. (2000) · PubMed · Cited by 27
Zelickson, B. D. (2002) · International Journal of Dermatology · doi:10.1046/j.1365-4362.2002.01613.x · Cited by 26
The Cornwall dermatology electronic referral and image-transfer project
White, H., Gould, D., Mills, W., & Brendish, L. (1999) · Journal of Telemedicine and Telecare · doi:10.1258/1357633991932694 · Cited by 25
Can we use video images to triage pigmented lesions?
Jolliffe, V. M. L., Harris, D. W., Morris, R., Wallace, P., & Whittaker, S. J. (2001) · British Journal of Dermatology · doi:10.1046/j.1365-2133.2001.04525.x · Cited by 25
Chen, K., Lim, A., & Shumack, S. P. (2002) · Australasian Journal of Dermatology · doi:10.1046/j.1440-0960.2002.00589.x · Cited by 19
Visual tests for measuring the picture quality of teleconsultations for medical purposes
Lamminen, H., Ruohonen, K., & Uusitalo, H. M. T. (2001) · Computer Methods and Programs in Biomedicine · doi:10.1016/s0169-2607(00)00120-6 · Cited by 17
Teledermatology in New Zealand
Oakley, A. M. M. (2001) · Journal of Cutaneous Medicine and Surgery · doi:10.1007/bf02737864 · Cited by 17
A system for the acquisition of reproducible digital skin lesions images
Maglogiannis, I. G., & Kosmopoulos, D. (2003) · Technology and Health Care · doi:10.3233/thc-2003-11604 · Cited by 11
Teledermatology - UK Experience of Setting up an Integrated Teledermatology Service
Clarke, M., Jones, R. W., Lioupis, D., George, S., & Cairns, D. (1999) · Studies in health technology and informatics · doi:10.3233/978-1-60750-912-7-274 · Cited by 5
Lin, Y. J., & Speedie, S. M. (2003) · PubMed · Cited by 3
A visual telemedicine system: the integration of ordinary TV and HDTV still image transmission.
Nagase, T., Kaihara, S., Segami, K., et al. (1995) · PubMed · Cited by 2
Teledermatology in the Highlands of Scotland
Jones, D. H., Crichton, C., Macdonald, A., Sime, S. P. D., Toms, J., & McKinlay, J. (1996) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x9600201s03
Research works printed but not linked: 3
- [17]17. Kim YS. Telemedicine in the USA with focus on clinical applications and issues. Yonsei Med J 2004; 45 :761-75.
- [15]15. physician perceptions and diagnostic agreement. Arch Dermatol 1998; 134 :471-6.
- [46]46. Taylor P , Goldsmith P , Murray K, Harris D, Barkley A, et al . Evaluating a telemedicine system to assist in the management of dermatology referrals. Br J Dermatol 2001; 144 :328-33.
Cited by
Teledermatology for diagnosis and management of skin conditions: A systematic review
Warshaw, E. M., Hillman, Y. J., Greer, N. L., Hagel, E. M., MacDonald, R., Rutks, I. R., & Wilt, T. J. (2011) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2010.08.026 · Cited by 310
Dermoscopy, with and without visual inspection, for diagnosing melanoma in adults
Dinnes, J., Deeks, J. J., Chuchu, N., Ferrante di Ruffano, L., Matin, R. N., Thomson, D. R., Wong, K. Y., Aldridge, R. B., Abbott, R., Fawzy, M., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011902.pub2 · Cited by 232
Integrating telecare for chronic disease management in the community: What needs to be done?
May, C. R., Finch, T. L., Cornford, J., Exley, C., Gately, C., Kirk, S., Jenkings, K. N., Osbourne, J., Robinson, A. L., Rogers, A., et al. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-131 · Cited by 220
Telemedicine in dermatology: findings and experiences worldwide—a systematic literature review.
Trettel, A., Eissing, L., & Augustin, M. (2018) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.14341 · Cited by 206
Recent directions in telemedicine: Review of trends in research and practice
Wilson, L. S., & Maeder, A. J. (2015) · Healthcare Informatics Research · doi:10.4258/hir.2015.21.4.213 · Cited by 203
Metadata
- Authors
- Bowns, I., Collins, K., Walters, S., & McDonagh, A.
- Affiliations
- University of Sheffield (GB)
- Royal Hallamshire Hospital (GB)
- ORCID
- Venue
- Health Technology Assessment
- Published
- 2006-11
- Volume
- 10
- Issue
- 43
- Pages
- iii-iv, ix
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2141631049
- Cited by
- 109
- References
- 97
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 1 · 2023: 3 · 2022: 3 · 2021: 2 · 2020: 4 · 2019: 1 · 2018: 9 · 2017: 5 · 2016: 10 · 2015: 10 · 2014: 10 · 2013: 7 · 2012: 3
- FWCI
- 6.00
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Health Technology Assessment (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- SHURA (Sheffield Hallam University Research Archive) (Sheffield Hallam University) (submittedVersion)
- Funders
- Health Technology Assessment programme (96/02/26)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Systems and Technology
- Keywords
- teledermatology, store-and-forward telemedicine, digital photography, dermoscopy, melanoma, squamous cell carcinoma, second opinion, outpatient referral, clinical equivalence, patient satisfaction, provider satisfaction, diagnostic agreement, skin cancer diagnosis, loss to follow-up
- MeSH terms
- Adolescent, Adult, Aged, Attitude of Health Personnel, Carcinoma, Squamous Cell, Dermatology, England, Family Practice, Female, Hospital Departments, Humans, Male, Melanoma, Middle Aged, Patient Acceptance of Health Care, Photography, Skin Neoplasms, State Medicine, Outcome Assessment, Health Care, Remote Consultation, Videoconferencing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-26 (prompt extract-v2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


