Potential effect of patient-assisted teledermatology on outpatient referral rates
Abstract
We carried out a pilot study on the feasibility and accuracy of store-and-forward teledermatology based on patient-provided images and history as a triage tool for outpatient consultation. Patients referred by their general practitioner provided a history and images via the Internet. The information was reviewed by one of 12 teledermatologists and the patient then visited a different dermatologist in person within two days. Three independent dermatologists compared the remote and in-person diagnoses in random order to determine diagnostic agreement. Broader agreement was also measured, by comparing the main disease groups into which the two diagnoses fell. The teledermatologists indicated whether an in-person consultation or further investigations were necessary. There were 105 eligible patients, aged four months to 72 years, who were willing to participate. For the 96 cases included in the analysis, complete diagnostic agreement was found in 41% ( n= 39), partial diagnostic agreement in 10% ( n= 10) and no agreement in 49% ( n= 47). There was disease group agreement in 66% of cases ( n= 63). Nearly a quarter (23%) of participating patients could have safely been managed without an in-person visit to a dermatologist.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Image quality and diagnostic concordance are generally lower and more variable with patient-submitted images, which may impact their decision-making utility.
“Image quality and diagnostic concordance are generally lower and more variable with patient-submitted images, which may impact their decision-making utility.”
From Store-and-Forward Images in Teledermatology: Narrative Literature Review (2022) · cites this paper as [17]
Diagnostic concordance rates between dermatologists evaluating patient-generated SAF images and dermatologists evaluating patients at a face-to-face visit range from approximately 40% to 80%.
“Several studies indicate that diagnostic concordance rates between dermatologists evaluating patient-generated SAF images and dermatologists evaluating patients at a FTF visit range from approximately 40% to 80% [5,8,16,17] (Table 1).”
From Store-and-Forward Images in Teledermatology: Narrative Literature Review (2022) · cites this paper as [17]
23% of patients could have avoided face-to-face appointments when SAF teledermatology was used as a triage tool based on patient-submitted images collected by their primary care physicians.
“The authors found that 23% of patients could have avoided FTF appointments, as determined by a panel of 3 dermatologists [17] (Table 2).”
From Store-and-Forward Images in Teledermatology: Narrative Literature Review (2022) · cites this paper as [17]
Cites
The Substitution of Digital Images for Dermatologic Physical Examination
Kvedar, J. C. (1997) · Archives of Dermatology · doi:10.1001/archderm.1997.03890380031005 · Cited by 187 · see citing works
Assessment of the accuracy of low-cost store-and-forward teledermatology consultation
High, W. A., Houston, M. S., Calobrisi, S. D., Drage, L. A., & McEvoy, M. T. (2000) · Journal of the American Academy of Dermatology · doi:10.1067/mjd.2000.104519 · Cited by 183 · see citing works
Reliability and accuracy of dermatologists’ clinic-based and digital image consultations
Whited, J. D., Hall, R. P., Simel, D. L., Foy, M. E., Stechuchak, K. M., Drugge, R. J., Grichnik, J. M., Myers, S. A., & Horner, R. D. (1999) · Journal of the American Academy of Dermatology · doi:10.1016/s0190-9622(99)70003-4 · Cited by 155 · see citing works
Diagnostic Accuracy and Image Quality Using a Digital Camera for Teledermatology
Krupinski, E. A., LeSueur, B., Ellsworth, L., Levine, N., Hansen, R., Silvis, N., Sarantopoulos, P., Hite, P., Wurzel, J., Weinstein, R. S., et al. (1999) · Telemedicine Journal · doi:10.1089/107830299312005 · Cited by 154 · see citing works
Evaluating a telemedicine system to assist in the management of dermatology referrals
Taylor, P., Goldsmith, P., Murray, K., Harris, D., & Barkley, A. (2001) · British Journal of Dermatology · doi:10.1046/j.1365-2133.2001.04023.x · Cited by 101 · see citing works
The Cornwall dermatology electronic referral and image-transfer project
White, H., Gould, D., Mills, W., & Brendish, L. (1999) · Journal of Telemedicine and Telecare · doi:10.1258/1357633991932694 · Cited by 25 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Telemedicine in dermatology: findings and experiences worldwide—a systematic literature review.
Trettel, A., Eissing, L., & Augustin, M. (2018) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.14341 · Cited by 206 · see citing works
Diagnosis, access and outcomes: Update of a systematic review of telemedicine services
Hersh, W., Hickam, D. H., Severance, S. M., Dana, T. L., Krages, K. P., & Helfand, M. (2006) · Journal of Telemedicine and Telecare · doi:10.1258/135763306778393117 · Cited by 188 · see citing works
Teledermatology: From historical perspective to emerging techniques of the modern era
Coates, S. J., Kvedar, J., & Granstein, R. D. (2015) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2014.07.061 · Cited by 152 · see citing works
Teledermatology: Key factors associated with reducing face-to-face dermatology visits
Landow, S. M., Mateus, A., Korgavkar, K., Nightingale, D., & Weinstock, M. A. (2014) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2014.02.021 · Cited by 131 · see citing works
Pak, H., Triplett, C. A., Lindquist, J. H., Grambow, S. C., & Whited, J. D. (2007) · Journal of Telemedicine and Telecare · doi:10.1258/135763307779701185 · Cited by 125 · see citing works
Wootton, R., Bahaadinbeigy, K., & Hailey, D. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-185 · Cited by 125 · see citing works
Telemedicine in dermatology: a randomised controlled trial
Bowns, I., Collins, K., Walters, S., & McDonagh, A. (2006) · Health Technology Assessment · doi:10.3310/hta10430 · Cited by 109 · see citing works
Maturity of teledermatology evaluation research: a systematic literature review
Eminović, N., de Keizer, N. F., Bindels, P., & Hasman, A. (2006) · British Journal of Dermatology · doi:10.1111/j.1365-2133.2006.07627.x · Cited by 98 · see citing works
Self-citationPractice Guidelines for Teledermatology
McKoy, K., Antoniotti, N. M., Armstrong, A., Bashshur, R., Bernard, J., Bernstein, D., Burdick, A., Edison, K., Goldyne, M., Kovarik, C., et al. (2016) · Telemedicine and e-Health · doi:10.1089/tmj.2016.0137 · Cited by 99 · see citing works
Diagnostic value of written referral and/or images for skin lesions
Oakley, A., Reeves, F., Bennett, J., Holmes, S., & Wickham, H. (2006) · Journal of Telemedicine and Telecare · doi:10.1258/135763306776738620 · Cited by 56 · see citing works
Augustin, M., Wimmer, J., Biedermann, T., Blaga, R., Dierks, C., Djamei, V., Elmer, A., Elsner, P. U., Enk, A., Gass, S., et al. (2018) · JDDG Journal der Deutschen Dermatologischen Gesellschaft · doi:10.1111/ddg.13512 · Cited by 48 · see citing works
Telemedicina y teledermatología (I): concepto y aplicaciones
Romero, G., Garrido, J. A., & García‐Arpa, M. (2008) · Actas Dermo-Sifiliográficas · doi:10.1016/s0001-7310(08)74735-5 · Cited by 48 · see citing works
Overview of international teledermatology
Desai, B., McKoy, K. C., & Kovarik, C. (2011) · Pan African Medical Journal · doi:10.4314/pamj.v6i1.69065 · Cited by 34 · see citing works
“Multiple studies have evaluated the proportion of store-and-forward TD consults that avoided, or would have avoided, a clinic visit to a dermatologist (ranging from 18-58%) and cutting in half the number of “urgent” referrals (from 64% to 32%) [15-21].”
BackgroundStore-and-Forward Images in Teledermatology: Narrative Literature Review
Jiang, S. W., Flynn, M. S., Kwock, J. T., & Nicholas, M. W. (2022) · JMIR Dermatology · doi:10.2196/37517 · Cited by 32 · see citing works
“Eminović et al [17] 23% of patients could have avoided FTF care, as determined by 3 dermatologists 105 adults and children Single-center study in the Netherlands Observational”
BackgroundMethodResultInfluentialRemote Assessment of Acne: The Use of Acne Grading Tools to Evaluate Digital Skin Images
Bergman, H., Tsai, K., Seo, S.-J., Kvedar, J., & Watson, A. J. (2009) · Telemedicine journal and e-health · doi:10.1089/tmj.2008.0128 · Cited by 30 · see citing works
“10,13,14 It is not known, however, whether these images are of adequate quality to allow for the assessment of acne using tools more commonly employed in clinical trials than in clinical care.”
Telemedicine and Teledermatology (I): Concepts and Applications
Romero, G., Garrido, J. A., & García‐Arpa, M. (2008) · Actas Dermo-Sifiliográficas · doi:10.1016/s1578-2190(08)70307-x · Cited by 32 · see citing works
Newer insights in teledermatology practice
Kanthraj, G. R. (2011) · Indian Journal of Dermatology Venereology and Leprology · doi:10.4103/0378-6323.79696 · Cited by 35 · see citing works
“[63] Self-practicing dermatologists[99-102] and NHS dermatologists[63,103-105]”
Johansen, M., Wootton, R., Kimble, R., Mill, J., Smith, A. C., & Hockey, A. (2004) · Journal of Telemedicine and Telecare · doi:10.1258/1357633042614302 · Cited by 25 · see citing works
[Telemedicine and teledermatology (II): current state of research on dermatology teleconsultations].
Romero, G., Cortina, P., & Vera, E. (2008) · Actas Dermo-Sifiliográficas · doi:10.1016/s1578-2190(08)70326-3 · Cited by 25 · see citing works
Telemedicina y teledermatología (II)
Romero, G., Cortina, P., & Vera, E. (2008) · Actas Dermo-Sifiliográficas · doi:10.1016/s0001-7310(08)74755-0 · Cited by 22 · see citing works
Teledermatology by videoconference: Experience of a pilot project
Mars, M., & Dlova, N. (2008) · South African Family Practice · doi:10.1080/20786204.2008.10873725 · Cited by 22 · see citing works
Patient perceptions about a novel form of patient-assisted teledermatology.
Eminović, N., Witkamp, L., de Keizer, N. D., & Wyatt, J. (2006) · Archives of Dermatology · doi:10.1001/archderm.142.5.648 · Cited by 21 · see citing works
Self-citationLudwick, D., Lortie, C., Doucette, J., Rao, J., & Samoil-Schelstraete, C. (2010) · Journal of Cutaneous Medicine and Surgery · doi:10.2310/7750.2010.09012 · Cited by 20 · see citing works
Qureshi, A., Brandling-Bennett, H., Giberti, S., McClure, D., Halpern, E., & Kvedar, J. (2006) · Journal of Telemedicine and Telecare · doi:10.1258/135763306776084392 · Cited by 18 · see citing works
A longitudinal study of consistency in diagnostic accuracy of teledermatology tools
Kanthraj, G. (2013) · Indian Journal of Dermatology, Venereology, and Leprology · doi:10.4103/0378-6323.116735 · Cited by 16 · see citing works
Web-Based Triage in a College Health Setting
Sole, M. L., Stuart, P. L., & Deichen, M. (2006) · Journal of American College Health · doi:10.3200/jach.54.5.289-294 · Cited by 15 · see citing works
Eastman, K. L., Lutton, M. C., Raugi, G., Sakamoto, M., McDowell, J. A., Mcfarland, L. V., & Reiber, G. (2012) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2012.120417 · Cited by 13 · see citing works
Teledermatology: clinical case profiles and practical issues.
Kaliyadan, F., & Venkitakrishnan, S. (2009) · Indian Journal of Dermatology, Venereology and Leprology · doi:10.4103/0378-6323.45217 · Cited by 13 · see citing works
“It is also well documented that a well-organized teledermatology network can cut down patient waiting times, while serving as an effective triage system for dermatology cases.[17-19] It goes without saying that a purely SAF or a web-portal-based consultation has its own disadvantages, especially with respect to gaps i…”
BackgroundConcordância entre diagnósticos dermatológicos feitos presencialmente e por imagens digitais
D'Elia, P., Fisher, P., Bordin, R., Harzheim, E., & Ramos, M. C. (2007) · Anais Brasileiros de Dermatologia · doi:10.1590/s0365-05962007000600004 · Cited by 11 · see citing works
Teledermatology: Its Use in the Detection and Management of Actinic Keratosis
Janda, M. (2014) · Current problems in dermatology · doi:10.1159/000366545 · Cited by 12 · see citing works
Shannon, G., & Buker, C. M. (2010) · Telemedicine journal and e-health · doi:10.1089/tmj.2010.0002 · Cited by 10 · see citing works
Edison, K., Chance, L., Martin, K., Braudis, K., & Whited, J. (2011) · Telemedicine journal and e-health · doi:10.1089/tmj.2010.0098 · Cited by 8 · see citing works
Indicateurs en télédermatologie : une revue de la littérature
Ridard, E., Secember, H., Carvalho-Lallement, P., & Schuers, M. (2020) · Annales de Dermatologie et de Vénéréologie · doi:10.1016/j.annder.2020.01.024 · Cited by 10 · see citing works
Diagnostic accuracy of teledermatology for skin diseases: a systematic review and meta-analysis
Martyin, K., Meznerics, F. A., Bokor, L. A., Szabó, B., Hegyi, P., Kiss, N., & Bánvölgyi, A. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1739592 · Cited by 4 · see citing works
Teledermatology: Outcomes and Economic Considerations
Pathipati, A. S., & Armstrong, A. W. (2011) · InTech eBooks · doi:10.5772/18774 · Cited by 3 · see citing works
“63 (Eminovic et al., 2003) .”
Whited, J. (2015) · The Medical clinics of North America · doi:10.1016/j.mcna.2015.07.005 · Cited by 1 · see citing works
Telemedicine and Skin Cancer: Teledermatology and Teledermoscopy
van der Heijden, J. P., & Witkamp, L. (2013) · Springer eBooks · doi:10.1007/978-1-4614-7357-2_34
Self-citation
- Authors
- Eminović, N., Witkamp, L., Ravelli, A. C. J., Bos, J. D., Van Den Akker, T. W., Bousema, M. T., Henquet, C. J. M., Koopman, R. J. J., Zeegelaar, J. E., & Wyatt, J. C.
- Affiliations
- Amsterdam UMC Location University of Amsterdam (NL)
- KSYOS TeleMedical Centre (NL)
- Dermatology Department, Medical Centre Haaglanden, The Hague
- Meander Medisch Centrum (NL)
- Maastricht University Medical Centre (NL)
- Medisch Spectrum Twente (NL)
- Flevoziekenhuis (NL)
- Corresponding author
- Eminović, N
- Venue
- Journal of Telemedicine and Telecare
- Publisher
- SAGE Publications
- Published
- 2003-12
- Volume
- 9
- Issue
- 6
- Pages
- 321-327
- ISSN
- 1357-633X (ISSN-L)
- 1758-1109
- OpenAlex
- W2103510276
- Cited by
- 44
- References
- 0
- Citations by year
- 2026: 1 · 2023: 2 · 2022: 2 · 2020: 1 · 2018: 1 · 2017: 1 · 2016: 1 · 2015: 2 · 2014: 2 · 2013: 3 · 2012: 1
- FWCI
- 2.37
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Telemedicine and Telecare (publishedVersion)
- PubMed (publishedVersion)
- Discovery Research Portal (University of Dundee) (publishedVersion)
- Pure Amsterdam UMC (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Healthcare Systems and Technology
- Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
- Keywords
- teledermatology, store-and-forward telemedicine, outpatient referral, triage, diagnostic agreement, dermatology, general practitioner referral, remote diagnosis
- MeSH terms
- Adolescent, Adult, Aged, Ambulatory Care, Child, Child, Preschool, Dermatology, Feasibility Studies, Humans, Infant, Middle Aged, Netherlands, Pilot Projects, Referral and Consultation, Skin Diseases, Reproducibility of Results, Observer Variation, Telemedicine, Remote Consultation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review