CoChat

Interobserver Reliability of Store-and-Forward Teledermatology in a Clinical Practice Setting

Open access
Romero Aguilera, G., Cortina de la Calle, P., Vera Iglesias, E., Sánchez Caminero, P., García Arpa, M., Garrido Martín, J.A. · 2014 · Actas Dermo-Sifiliográficas (English Edition)
Cited by 19

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

Abstract

Although many studies have evaluated the diagnostic reliability of store-and-forward (SF) teledermatology, the reliability of the technique for the diagnosis of general skin conditions in a clinical practice setting has never been demonstrated. We evaluated the reliability of SF teledermatology in clinical practice by analyzing the diagnostic agreement achieved in a subgroup of patients from the DERMATEL-2 study. Patients referred from primary care settings were randomized to 3 groups: SF, a combination of videoconferencing and SF technology (VC-SF), and a control group. This article focuses on the SF group. Clinical data were recorded and photographs taken by primary care physicians, who forwarded the data digitally. Each SF consultation package was assessed by 3 dermatologists (D1,D2,D3). Subsequently all the patients were assessed by a single dermatologist (D1) in a face-to-face (FF) consultation. Finally, 2 other dermatologists (D4,D5) assessed the agreement between the diagnoses obtained by SF and FF. In total, 457 patients (200 males and 257 females) aged between 2 months and 86 years were randomized (192 to SF, 176 to VC-SF, and 89 to the control group). The diagnostic categories were as follows: tumors (49.4%), inflammatory (25.7%), adnexal (11%), infectious (9.4%) and other processes (4.4%). Since 170 patients had SF consultations deemed valid for analysis, the study included a total of 510 SF assessments. Most of the images and clinical records were of high quality (71.2% and 91.2% respectively), and diagnostic confidence was high in 81.4% of the cases studied. In 58.4% of cases the condition was managed exclusively by teledermatology. Levels of complete and aggregate interobserver agreement between SF and FF evaluators were 0.72 and 0.90, respectively, for diagnosis and 0.61 and 0.80 for treatment. Diagnostic agreement correlated with the image quality (P < .001), diagnostic confidence (P < .001), felt need for conventional consultation (P < .001), and the quality of the clinical record (P = .013). The interobserver reliability of SF diagnosis in clinical practice is good. Dermatologists are able to predict errors in diagnosis by analyzing their own diagnostic confidence and evaluating the quality of the images. Aunque existen múltiples estudios de fiabilidad diagnóstica en teledermatología de almacenamiento (TDA), aún no se ha demostrado una fiabilidad elevada para enfermedad general cutánea en un escenario real. DERMATEL-2 fue un estudio aleatorizado de concordancia diagnóstica en TDA en condiciones de práctica clínica. Pacientes remitidos desde atención primaria fueron aleatorizados en 3 grupos: TDA; híbrida videoconferencia-almacenamiento (VC-TDA) y grupo control (GC). Este artículo se centra en el grupo de almacenamiento. Médicos de atención primaria tomaron datos y fotografías clínicas remitiéndolas a distancia. Cada consulta de TDA fue evaluada por 3 dermatólogos diferentes (D1,D2,D3). Todos los pacientes fueron finalmente vistos por el mismo dermatólogo (D1) en la consulta presencial (CP). Dos dermatólogos adicionales (D4, D5) evaluaron las concordancias TDA-CP. Se aleatorizaron un total de 457 pacientes 4-4-2: 192 TDA, 176 VC-TDA y 89 GC; 200 varones y 257 mujeres, 0-86 años. Se incuyó enfermedad tumoral (49,4%), inflamatoria (25,7%), anexial (11%), infecciosa (9,4%) y otros (4,4%). Hubo 170 pacientes de TDA válidos para el análisis, rindiendo 510 teleconsultas-TDA. La imagen (71,2%), la historia clínica (91,2%) y la confianza diagnóstica (81,4%) fueron de calidad alta. En el 58,4% fue posible el manejo exclusivo on-line. Los acuerdos interobservador (completo/agregado) TDA-CP fueron 0,72/0,90 para el diagnóstico y 0,61/0,80 en el tratamiento. El acuerdo diagnóstico se correlacionó con la calidad de la imagen (p < 0,001), la confianza diagnóstica (p < 0,001), la necesidad de consulta presencial (p < 0,001) y la calidad de la historia clínica (p = 0,013). La fiabilidad diagnóstica de la TDA en condiciones de práctica clínica es elevada. Los dermatólogos pueden predecir errores diagnósticos analizando su confianza diagnóstica y la calidad de las fotografías.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.adengl.2014.05.018

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 18 references

Research works printed but not linked: 14

  1. Wootton, 2000, Multicentre randomised control trial comparing real time teledermatology with conventional outpatient dermatological care: Societal cost-benefit analysis, BMJ, 320, 1252, 10.1136/bmj.320.7244.1252 · DOI · Paper page
  2. Eminovic, 2007, Maturity of teledermatology evaluation research: A systematic literature review, Br J Dermatol, 156, 412, 10.1111/j.1365-2133.2006.07627.x · DOI · Paper page
  3. Lyon, 1997, Digital imaging and teledermatology: Educational and diagnostic applications of a portable digital imaging system for the trainee dermatologist, Clin Exp Dermatol, 22, 163, 10.1111/j.1365-2230.1997.tb01052.x · DOI · Paper page
  4. Kvedar, 1999, Teledermatology in a capitated delivery system using distributed information architecture: Design and development, Telemed J, 5, 357, 10.1089/107830299311925 · DOI · Paper page
  5. Pak, 2003, Teledermatology: An intraobserver diagnostic correlation study, part ii, Cutis, 71, 476
  6. Taylor, 2000, An assessment of the potential effect of a teledermatology system, J Telemed Telecare, 6, S74, 10.1258/1357633001934221 · DOI · Paper page
  7. Zelickson, 1997, Teledermatology in the nursing home, Arch Dermatol, 133, 171, 10.1001/archderm.1997.03890380041006 · DOI · Paper page
  8. Romero, 2008, Telemedicine and teledermatology (i): Concepts and applications, Actas Dermosifiliogr, 99, 506, 10.1016/S0001-7310(08)74735-5 · DOI
  9. Wootton, 2011, Estimating travel reduction associated with the use of telemedicine by patients and healthcare professionals: Proposal for quantitative synthesis in a systematic review, BMC Health Serv Res, 11, 185, 10.1186/1472-6963-11-185 · DOI · Paper page
  10. Ferrandiz, 2008, An economic analysis of presurgical teledermatology in patients with nonmelanoma skin cancer, Actas Dermosifiliogr, 99, 795
  11. Pak, 2009, Cost minimization analysis of a store-and-forward teledermatology consult system, Telemed J E Health, 15, 160, 10.1089/tmj.2008.0083 · DOI · Paper page
  12. Ferrandiz, 2012, Effect of teledermatology on the prognosis of patients with cutaneous melanoma, Arch Dermatol, 148, 1025, 10.1001/archdermatol.2012.778 · DOI · Paper page
  13. Warshaw, 2009, Accuracy of teledermatology for pigmented neoplasms, J Am Acad Dermatol, 61, 753, 10.1016/j.jaad.2009.04.032 · DOI · Paper page
  14. Nordal, 2001, A comparative study of teleconsultations versus face-to-face consultations, J Telemed Telecare, 7, 257, 10.1258/1357633011936507 · DOI · Paper page

Cited by

See all 19

Metadata

Authors
Romero Aguilera, G., Cortina de la Calle, P., Vera Iglesias, E., Sánchez Caminero, P., García Arpa, M., & Garrido Martín, J. A.
Venue
Actas Dermo-Sifiliográficas (English Edition)
Publisher
Elsevier BV
Published
2014-07
Volume
105
Issue
6
Pages
605-613
ISSN
  • 0001-7310 (ISSN-L)
  • 1578-2190
OpenAlex
W2126526970
Cited by
19
References
18
FWCI
1.53
Type
journal article
Language
en
Open access
hybrid
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Interobserver Reliability of Store-and-Forward Teledermatology in a Clinical Practice Setting. https://app.cochat.ai/papers/10.1016/j.adengl.2014.05.018
The paper
Romero Aguilera, G., Cortina de la Calle, P., Vera Iglesias, E., Sánchez Caminero, P., García Arpa, M., & Garrido Martín, J. A. (2014). Interobserver Reliability of Store-and-Forward Teledermatology in a Clinical Practice Setting. Actas Dermo-Sifiliográficas (English Edition). https://doi.org/10.1016/j.adengl.2014.05.018

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.