Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index; 11 of the 21 sources its claims cite were checked for support.

Diagnostic reliability in teledermatology: a systematic review and a meta-analysis

Open access
Bourkas, Adrienn N, Barone, Natasha, Bourkas, Matthew E C, Mannarino, Matthew, Fraser, Robert D J, Lorincz, Amy, Wang, Sheila C, Ramirez-GarciaLuna, Jose Luis · 2023 · BMJ Open

Abstract

OBJECTIVES: To compare teledermatology and face-to-face (F2F) agreement in primary diagnoses of dermatological conditions. DESIGN: Systematic review and meta-analysis METHODS: MEDLINE, Embase, Cochrane Library (Wiley), CINAHL and medRxiv were searched between January 2010 and May 2022. Observational studies and randomised clinical trials that reported percentage agreement or kappa concordance for primary diagnoses between teledermatology and F2F physicians were included. Titles, abstracts and full-text articles were screened in duplicate. From 7173 citations, 44 articles were included. A random-effects meta-analysis was conducted to estimate pooled estimates. Primary outcome measures were mean percentage and kappa concordance for assessing diagnostic matches between teledermatology and F2F physicians. Secondary outcome measures included the agreement between teledermatologists, F2F dermatologists, and teledermatology and histopathology results. RESULTS: 44 studies were extracted and reviewed. The pooled agreement rate was 68.9%, and kappa concordance was 0.67. When dermatologists conducted F2F and teledermatology consults, the overall diagnostic agreement was significantly higher at 71% compared with 44% for non-specialists. Kappa concordance was 0.69 for teledermatologist versus specialist and 0.52 for non-specialists. Higher diagnostic agreements were also noted with image acquisition training and digital photography. The agreement rate was 76.4% between teledermatologists, 82.4% between F2F physicians and 55.7% between teledermatology and histopathology. CONCLUSIONS AND RELEVANCE: Teledermatology can be an attractive option particularly in resource-poor settings. Future efforts should be placed on incorporating image acquisition training and access to high-quality imaging technologies. TRIAL REGISTRATION NUMBER: 10.17605/OSF.IO/FJDVG.

Overview

CoChat Summary

## TL;DR

This systematic review and meta-analysis found that teledermatology had moderate-to-substantial diagnostic agreement with face-to-face (F2F) assessment, with a pooled agreement rate of 68.9% and pooled kappa of 0.67 across 44 studies. Agreement was higher when dermatologists were involved, when image-acquisition training was provided, and when digital cameras were used.

## Key findings

  • Across 44 included studies, the pooled agreement rate between teledermatology and F2F diagnosis was 68.9% and pooled kappa was 0.67.
  • Agreement was higher when dermatologists performed the F2F comparison: 70.96% for teledermatologists vs F2F dermatologists, compared with 44.1% for non-specialists (p<0.001); kappa was 0.69 vs 0.52.
  • When image-acquisition training was provided, mean agreement was 75.9% versus 62.1% without training (p=0.033); concordance was 0.77 versus 0.60 (p=0.01).
  • Digital cameras outperformed smartphones/tablets: mean agreement 71.7% vs 59.8% (p=0.029), and concordance 0.70 vs 0.62 (p=0.003). Agreement between teledermatology and histopathology was 55.7%.

## Methods

  • Systematic review and meta-analysis following PRISMA; protocol registered on OSF.
  • Searched MEDLINE, Embase, Cochrane Library, CINAHL, and medRxiv for studies from January 2010 to May 2022; no language restrictions.
  • Included observational studies and randomized clinical trials reporting percentage agreement or kappa for primary diagnoses between teledermatology and F2F physician diagnosis; 44 studies were included from 7173 citations.
  • Used random-effects meta-analysis, with subgroup analyses and meta-regression to explore heterogeneity; risk of bias assessed with RoB 2 and QUADAS-2.

## Limitations

  • The paper states that heterogeneity was considerable, which limited meta-analysis and synthesis of predictors even after subgrouping.
  • It also states that there were a limited number of randomized controlled trials and a limited number of live video conferencing studies, restricting comparisons across study designs and modalities.
  • Evident from the text: the review only searched published literature and may have missed grey literature and reports from low-income and middle-income countries; it also did not incorporate AI effects, which the authors note are outside scope.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1136/bmjopen-2022-068207

Cites

61 of 61 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Preferred Reported Items for Systematic Reviews and Meta-Analyses (PRISMA flow diagram of study selection.
Figure 1 Preferred Reported Items for Systematic Reviews and Meta-Analyses (PRISMA flow diagram of study selection.CC BY-NC · PubMed Central
Figure 2 Forest plot representing F2F and teledermatology primary diagnostic agreement by whether imaging acquisition training was indicated by the study. Forest plot representing F2F and teledermatology primary diagnostic agreement when image acquisition training is involved. Studies were sorted into two groups, (a) did not conduct or did not report training personnel on image acquisition; (b) stated that person in charge of image acquisition was trained. (Left) Forest plot representing percentage agreement and 95% CI for overall concordance across 40 studies with a total of 72 unique number of comparisons, N of events and total included participants. (Right) Forest plot representing kappa concordance and 95% CI for overall concordance across 21 studies with a total of 45 unique number of comparisons, N of total included participants. F2F, face-to-face; PCP, primary care provider; TD, teledermatology or teledermatologist.
Figure 2 Forest plot representing F2F and teledermatology primary diagnostic agreement by whether imaging acquisition training was indicated by the study. Forest plot representing F2F and teledermatology primary diagnostic agreement when image acquisition training is involved. Studies were sorted into two groups, (a) did not conduct or did not report training personnel on image acquisition; (b) stated that person in charge of image acquisition was trained. (Left) Forest plot representing percentage agreement and 95% CI for overall concordance across 40 studies with a total of 72 unique number of comparisons, N of events and total included participants. (Right) Forest plot representing kappa concordance and 95% CI for overall concordance across 21 studies with a total of 45 unique number of comparisons, N of total included participants. F2F, face-to-face; PCP, primary care provider; TD, teledermatology or teledermatologist.CC BY-NC · PubMed Central
Figure 3 Forest plot representing F2F and teledermatology primary diagnostic agreement by device type used to capture clinical photographs. Forest plot representing F2F and teledermatology primary diagnostic agreement by imaging technology used. Studies were sorted into three groups, (i) digital photography; (ii) imaging technology not mentioned, (iii) smartphone or tablet. (Left) Forest plot representing percentage agreement and 95% CI for overall concordance across 40 studies with a total of 72 unique number of comparisons, N of events and total included participants. (Right) Forest plot representing kappa concordance and 95% CI for overall concordance across 21 studies with a total of 45 unique number of comparisons, N of total included participants. F2F, face-to-face; PCP, primary care provider; TD, teledermatology or teledermatologist.
Figure 3 Forest plot representing F2F and teledermatology primary diagnostic agreement by device type used to capture clinical photographs. Forest plot representing F2F and teledermatology primary diagnostic agreement by imaging technology used. Studies were sorted into three groups, (i) digital photography; (ii) imaging technology not mentioned, (iii) smartphone or tablet. (Left) Forest plot representing percentage agreement and 95% CI for overall concordance across 40 studies with a total of 72 unique number of comparisons, N of events and total included participants. (Right) Forest plot representing kappa concordance and 95% CI for overall concordance across 21 studies with a total of 45 unique number of comparisons, N of total included participants. F2F, face-to-face; PCP, primary care provider; TD, teledermatology or teledermatologist.CC BY-NC · PubMed Central

Verification

Claims the paper makes

7 Valid · 0 Not valid · 7 Not checked · 30 Own results and interpretations

14 more claims

Create a free account to see all 44 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 13
  • It may state two separate claims as one. 16

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 61 references

Research works printed but not linked: 1

  1. Zanini, 2013, Analyze of diagnostic concordance between face-to-face and teledermatology diagnosis, Med Cutan Ibero Lat Am, 41, 60

Cited by

See all 51

Metadata

Authors
Bourkas, A. N., Barone, N., Bourkas, M. E. C., Mannarino, M., Fraser, R. D. J., Lorincz, A., Wang, S. C., & Ramirez-GarciaLuna, J. L.
Affiliations
  • Queen's University (CA)
  • McGill University (CA)
  • University of Toronto (CA)
  • Western University (CA)
  • Independent Researcher, Montreal, Qubec, Canada
  • Department of Surgery, McGill University, Montreal, Qubec, Canada
Venue
BMJ Open
Publisher
BMJ
Published
2023-08
Volume
13
Issue
8
Pages
e068207
ISSN
2044-6055 (ISSN-L)
OpenAlex
W4385769600
Cited by
51
References
61
Citations by year
2026: 27 · 2025: 16 · 2024: 8
FWCI
2.52
Type
journal article
Language
en
Open access
Locations
  • BMJ Open (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Canadian Digital Technology Supercluster (Telewound Care Canada)
Topics
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
  • Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Digital Imaging in Medicine
Keywords
teledermatology, diagnostic agreement, face-to-face consultation, dermatological diagnosis, kappa concordance, histopathology, digital photography, telemedicine, resource-limited settings
MeSH terms
Dermatology, Humans, Physicians, Referral and Consultation, Skin Diseases, Reproducibility of Results, Telemedicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Diagnostic reliability in teledermatology: a systematic review and a meta-analysis. https://app.cochat.ai/papers/10.1136/bmjopen-2022-068207
The paper
Bourkas, A. N., Barone, N., Bourkas, M. E. C., Mannarino, M., Fraser, R. D. J., Lorincz, A., Wang, S. C., & Ramirez-GarciaLuna, J. L. (2023). Diagnostic reliability in teledermatology: a systematic review and a meta-analysis. BMJ Open. https://doi.org/10.1136/bmjopen-2022-068207

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.