Teledermatology consultation using a smartphone multimedia messaging service for common skin diseases in the Korean army: a clinical evaluation of its diagnostic accuracy
Abstract
We evaluated the diagnostic accuracy of teleconsultations for skin diseases common in the army using a smartphone multimedia messaging service (MMS). Images of skin lesions were obtained from 100 army patients using digital cameras built into smartphones. Three remotely located dermatologists received the dermatology images and associated clinical information via the MMS. The teledermatologists' diagnoses were compared with those obtained from face-to-face examinations. The three most common diagnoses made at the dermatology clinics were eczema, viral warts and fungal infections. The mean diagnostic agreement between face-to-face and teledermatology consultations was 71% (SD 2). The mean kappa coefficient was 0.73 (SD 0.06) for the three most common diagnostic categories. The mean values for sensitivity were 78% (SD 0), 88% (SD 21) and 61% (SD 11) for eczema, viral warts and fungal infections, respectively, and the specificity values were above 90% for these skin diseases. Teledermatology consultation using smartphones is simple. Although diagnoses using telemedicine do not perfectly match diagnoses from face-to-face consultations the diagnostic accuracy using smartphones is superior to that of clinicians who are not specialized in dermatology.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In adults, store-and-forward teledermatology has been shown to improve access to specialty care, consistently provide accurate diagnosis, reduce time to treatment, while achieving high patient satisfaction and cost-effectiveness.
“In adults, store-and-forward teledermatology has been shown to improve access to specialty care, consistently provide accurate diagnosis, and reduce time to treatment, while achieving high patient satisfaction and cost-effectiveness.[5][6][7]”
From Diagnostic Accuracy of Pediatric Teledermatology Using Parent-Submitted Photographs: A Randomized Clinical Trial (2017) · cites this paper as [5]
Cites
Teledermatology for diagnosis and management of skin conditions: A systematic review
Warshaw, E. M., Hillman, Y. J., Greer, N. L., Hagel, E. M., MacDonald, R., Rutks, I. R., & Wilt, T. J. (2011) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2010.08.026 · Cited by 310 · cited 3× · see citing works
“0.(14) We only determined sensitivity values for the three most common diagnostic categories.”
BackgroundResultInfluentialKroemer, S., Frühauf, J., Campbell, T. M., Massone, C., Schwantzer, G., Soyer, H. P., & Hofmann-Wellenhof, R. (2011) · British Journal of Dermatology · doi:10.1111/j.1365-2133.2011.10208.x · Cited by 202 · see citing works
Reliability and accuracy of dermatologists’ clinic-based and digital image consultations
Whited, J. D., Hall, R. P., Simel, D. L., Foy, M. E., Stechuchak, K. M., Drugge, R. J., Grichnik, J. M., Myers, S. A., & Horner, R. D. (1999) · Journal of the American Academy of Dermatology · doi:10.1016/s0190-9622(99)70003-4 · Cited by 155 · cited 1× · see citing works
“A review article about teledermatology demonstrated that the diagnostic accuracy of store and forward teledermatology consultations was inferior to that achieved during faceto-face consultations in dermatology clinics.(4) Agreement in relation to the primary diagnoses ranged from 46–88% in 15 previous studies that inv…”
Background
Flagged first, then by citations
Cited by
Sorted by citations
Telemedicine in dermatology: findings and experiences worldwide—a systematic literature review.
Trettel, A., Eissing, L., & Augustin, M. (2018) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.14341 · Cited by 206 · see citing works
Teledermatology for diagnosing skin cancer in adults.
Chuchu, N., Dinnes, J., Takwoingi, Y., Matin, R. N., Bayliss, S. E., Davenport, C., Moreau, J. F., Bassett, O., Godfrey, K., O'Sullivan, C., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013193 · Cited by 175 · see citing works
Teledermatology: From historical perspective to emerging techniques of the modern era
Coates, S. J., Kvedar, J., & Granstein, R. D. (2015) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2014.07.061 · Cited by 152 · see citing works
O’Connor, D. M., Jew, O. S., Perman, M. J., Castelo-Soccio, L. A., Winston, F. K., & McMahon, P. J. (2017) · JAMA Dermatology · doi:10.1001/jamadermatol.2017.4280 · Cited by 89 · see citing works
Teledermatology: From historical perspective to emerging techniques of the modern era
Coates, S. J., Kvedar, J. C., & Granstein, R. D. (2015) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2014.08.014 · Cited by 79 · see citing works
Augustin, M., Wimmer, J., Biedermann, T., Blaga, R., Dierks, C., Djamei, V., Elmer, A., Elsner, P. U., Enk, A., Gass, S., et al. (2018) · JDDG Journal der Deutschen Dermatologischen Gesellschaft · doi:10.1111/ddg.13512 · Cited by 48 · see citing works
mHealth for Integrated People-Centred Health Services in the Western Pacific: A Systematic Review
Godinho, M. A., Jonnagaddala, J., Gudi, N., Islam, R., Narasimhan, P., & Liaw, S. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104259 · Cited by 51 · see citing works
International Teledermatology Review
McKoy, K., Halpern, S., & Mutyambizi, K. (2021) · Current Dermatology Reports · doi:10.1007/s13671-021-00333-6 · Cited by 40 · see citing works
Systematic review of mobile phone-based teledermatology
Clark, A. K., Bosanac, S., Ho, B., & Sivamani, R. (2018) · Archives of Dermatological Research · doi:10.1007/s00403-018-1862-4 · Cited by 34 · see citing works
Okita, A. L., Molina Tinoco, L. J., Patatas, O. H. G., Guerreiro, A., Criado, P. R., Gabbi, T. V. B., Ferreira, P. S., & Neto, C. F. (2016) · Telemedicine and e-Health · doi:10.1089/tmj.2015.0086 · Cited by 29 · see citing works
An Analysis of Personal Technology Use by Service Members and Military Behavioral Health Providers.
Edwards-Stewart, A., Smolenski, D., Reger, G., Bush, N., & Workman, D. E. (2016) · Military Medicine · doi:10.7205/milmed-d-15-00041 · Cited by 20 · see citing works
Analysis of live interactive teledermatologic consultations for prisoners in Korea for 3 years
Seol, J., Park, S. H., & Kim, H. (2017) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x17732095 · Cited by 16 · see citing works
Gaffney, R., & Rao, B. (2016) · Global Dermatology · doi:10.15761/god.1000156 · Cited by 15 · see citing works
“Map of sustained teledermatology programs and active pilot programs *4 pilot programs are no longer active [8-40].”
BackgroundUtility of Store and Forward Teledermatology for Skin Patch Test Readings
Grey, K. R., Hagen, S. L., Hylwa, S. A., & Warshaw, E. M. (2017) · Dermatitis · doi:10.1097/der.0000000000000258 · Cited by 16 · see citing works
A Systematic Review of the Use of Telemedicine in the Military Forces Worldwide
Mohammadi, R., Tabanejad, Z., Abhari, S., Honarvar, B., Lazem, M., Maleki, M., & Garavand, A. (2020) · Shiraz E Medical Journal · doi:10.5812/semj.99343 · Cited by 11
“(32) To assess the accuracy of diagnostic tele-consultations in dermatology among military forces by a smartphone multimedia messaging service.”
BackgroundMadan, I., Parsons, V., Ntani, G., Wright, A., English, J., Coggon, D., McCrone, P., Smedley, J., Rushton, L., Murphy, C., et al. (2019) · Health Technology Assessment · doi:10.3310/hta23580 · Cited by 11 · see citing works
The value of teledermatology using a mobile app compared to conventional dermatology
Zink, A., Kolbinger, A., Leibl, M., Leon-Suarez, I., Gloning, J., Merkel, C., Biedermann, T., Ring, J., & Eberlein, B. (2017) · EJD. European journal of dermatology · doi:10.1684/ejd.2017.3044 · Cited by 9 · see citing works
“The concordance rates between the clinicians and teledermatologist observed in this study are consistent with previous studies [5-9].”
ResultA review of skin disease in military soldiers: challenges and potential solutions
Singal, A., & Lipner, S. (2023) · Annals medicus · doi:10.1080/07853890.2023.2267425 · Cited by 8
“Implementation of telemedicine can aid in diagnosing skin disease in military soldiers [162,163].”
BackgroundPersonal smartphones for neonatal diagnostic imaging: A prospective crossover study
Westberg, M., Vasko, T., Owen, L., Bhatia, R., Lluch, M., Donath, S., Davis, P., & Dawson, J. (2017) · Journal of Paediatrics and Child Health · doi:10.1111/jpc.13467 · Cited by 8
Wang, X., Yang, H., Wang, Y., Yuan, J., & Yu, Q. (2020) · BMJ Military Health · doi:10.1136/jramc-2019-001315 · Cited by 7
Avis dermatologiques à distance : une enquête interrégionale
Tesnière, A., Leloup, P., Quereux, G., Maillard, H., Pédaillès, S., Leccia, M., Kerever, S., & Dompmartin, A. (2014) · Annales de Dermatologie et de Vénéréologie · doi:10.1016/j.annder.2014.09.312 · Cited by 7 · see citing works
Review of Telemedicine for Management of Acne Patients
Gu, L., & Lipner, S. (2022) · Journal of Cutaneous Medicine and Surgery · doi:10.1177/12034754221083978 · Cited by 6 · see citing works
Indicateurs en télédermatologie : une revue de la littérature
Ridard, E., Secember, H., Carvalho-Lallement, P., & Schuers, M. (2020) · Annales de Dermatologie et de Vénéréologie · doi:10.1016/j.annder.2020.01.024 · Cited by 10 · see citing works
“…50 patients SAF (smartphone)/FTF pour triage consultations dermatos hospitalières (hopital universitaire) décision biopsie k=0,35- 0,61 inter-obs: k=0,63 Shin, 2014, Corée du Sud (95) Etude prospective contrôlée 100 patients SAF (smartphone)/FTF dans l'armée coréenne 70,7% k=0,73 inter- obs:…”
Design Requirements for a Teledermatology Scale-up Framework
Walters, L. E., Scott, R. E., & Mars, M. (2018) · South African Computer Journal · doi:10.18489/sacj.v30i1.559 · Cited by 5 · see citing works
Diagnostic accuracy of teledermatology for skin diseases: a systematic review and meta-analysis
Martyin, K., Meznerics, F. A., Bokor, L. A., Szabó, B., Hegyi, P., Kiss, N., & Bánvölgyi, A. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1739592 · Cited by 4 · see citing works
Teledermatology: current perspectives
Oliveira, J. A. D. Q., Wolff, I. S., Ribeiro, L. D., Souza-Silva, M. V. R., Silva, L. T. D., & Marcolino, M. S. (2017) · Smart Homecare Technology and TeleHealth · doi:10.2147/shtt.s104305 · Cited by 4 · see citing works
“Three studies were from the United States, 30,34,35 two studies from Germany, 27,28 and one from each of the following countries: Australia, 29 South Korea, 31 and New Zealand.”
InfluentialTeledermatology in Military Settings
Schafrank, L. A., Falkner, R. C., Lam, T. K., & Meyerle, J. H. (2021) · Current Dermatology Reports · doi:10.1007/s13671-021-00330-9 · Cited by 3 · see citing works
The use of teledermatology for the diagnosis of skin cancer in adults
Walter, F. (2018) · doi:10.17863/cam.34450 · Cited by 2
Nickles, M. A., Rustad, A. M., & Lio, P. (2022) · Journal of the Dermatology Nurses’ Association · doi:10.1097/jdn.0000000000000672 · Cited by 3 · see citing works
“…taken on smartphones have been reported to have diagnostic agreement between face-to-face and virtual dermatology consultants in 61%– 80% of cases (Boyce et al., 2011; Ebner et al., 2008; Kaliyadan et al., 2013; Lamel et al., 2012; Massone et al., 2006; Shin et al., 2014; Weingast et al., 2013).”
[Remote dermatological advice: a survey in three French regions].
Tesnière, A., Leloup, P., Quereux, G., Maillard, H., Pédaillès, S., Leccia, M., Kerever, S., & Dompmartin, A. (2015) · Annales de dermatologie et de vénéréologie · doi:10.1016/j.annder.2014.11.008 · Cited by 1 · see citing works
Stragyte, D., Mikalauskas, G., Tiškevičiūtė, U., Gaidulevič, K., Paukstaitiene, R., Stašaitis, K., & Valiukevičienė, S. (2026) · Diagnostics · doi:10.3390/diagnostics16172883
“Shin et al. reported good diagnostic performance in a structured military healthcare setting [6], whereas Fan et al. demonstrated the clinical utility of patient-acquired mobile teledermoscopy [7].”
Investigating the evidence for effective digital skin surveillance methods
Fabbri, F., Albusaidi, I., Ntani, G., Alden, K., & Parsons, V. (2026) · Occupational Medicine · doi:10.1093/occmed/kqag028
“Overall, the evidence shows that such tools can reliably and efficiently rule out clear (no dermatitis) cases in some settings, as shown by the high NPV, but at times underestimate early/mild disease and show limited PPV [12–15].”
InfluentialParandeh, R., Shajirat, Z., Pazyar, N., & Azizi, A. (2024) · Comprehensive Health and Biomedical Studies · doi:10.5812/chbs-149451
- Authors
- Shin, H., Kim, D. H., Ryu, H. H., Yoon, S. Y., & Jo, S. J.
- Affiliations
- Dongguk University Ilsan Hospital (KR)
- Leaders Clinic, Seoul, Korea
- Seoul National University (KR)
- Corresponding author
- Jo, Seong Jin
- Venue
- Journal of Telemedicine and Telecare
- Publisher
- SAGE Publications
- Published
- 2014-02-10
- Volume
- 20
- Issue
- 2
- Pages
- 70-74
- ISSN
- 1357-633X (ISSN-L)
- 1758-1109
- OpenAlex
- W2051363693
- Cited by
- 37
- References
- 0
- Citations by year
- 2026: 3 · 2025: 1 · 2024: 1 · 2023: 2 · 2022: 2 · 2021: 4 · 2020: 4 · 2019: 1 · 2018: 4 · 2017: 8 · 2016: 3 · 2015: 3 · 2014: 1
- FWCI
- 4.95
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Telemedicine and Telecare (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Digital Imaging in Medicine
- Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
- Keywords
- teledermatology, skin diseases, military personnel, diagnostic accuracy, atopic dermatitis, viral warts, fungal skin infection, telemedicine, dermatology consultation, kappa statistic, sensitivity and specificity
- MeSH terms
- Adolescent, Adult, Dermatomycoses, Eczema, Humans, Male, Military Medicine, Referral and Consultation, Sensitivity and Specificity, Skin Diseases, Warts, Telemedicine, Cell Phone, Republic of Korea
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
