The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index; 11 of the 21 sources its claims cite were checked for support.
Diagnostic reliability in teledermatology: a systematic review and a meta-analysis
Open accessAbstract
OBJECTIVES: To compare teledermatology and face-to-face (F2F) agreement in primary diagnoses of dermatological conditions. DESIGN: Systematic review and meta-analysis METHODS: MEDLINE, Embase, Cochrane Library (Wiley), CINAHL and medRxiv were searched between January 2010 and May 2022. Observational studies and randomised clinical trials that reported percentage agreement or kappa concordance for primary diagnoses between teledermatology and F2F physicians were included. Titles, abstracts and full-text articles were screened in duplicate. From 7173 citations, 44 articles were included. A random-effects meta-analysis was conducted to estimate pooled estimates. Primary outcome measures were mean percentage and kappa concordance for assessing diagnostic matches between teledermatology and F2F physicians. Secondary outcome measures included the agreement between teledermatologists, F2F dermatologists, and teledermatology and histopathology results. RESULTS: 44 studies were extracted and reviewed. The pooled agreement rate was 68.9%, and kappa concordance was 0.67. When dermatologists conducted F2F and teledermatology consults, the overall diagnostic agreement was significantly higher at 71% compared with 44% for non-specialists. Kappa concordance was 0.69 for teledermatologist versus specialist and 0.52 for non-specialists. Higher diagnostic agreements were also noted with image acquisition training and digital photography. The agreement rate was 76.4% between teledermatologists, 82.4% between F2F physicians and 55.7% between teledermatology and histopathology. CONCLUSIONS AND RELEVANCE: Teledermatology can be an attractive option particularly in resource-poor settings. Future efforts should be placed on incorporating image acquisition training and access to high-quality imaging technologies. TRIAL REGISTRATION NUMBER: 10.17605/OSF.IO/FJDVG.
Overview
CoChat Summary
## TL;DR
This systematic review and meta-analysis found that teledermatology had moderate-to-substantial diagnostic agreement with face-to-face (F2F) assessment, with a pooled agreement rate of 68.9% and pooled kappa of 0.67 across 44 studies. Agreement was higher when dermatologists were involved, when image-acquisition training was provided, and when digital cameras were used.
## Key findings
- Across 44 included studies, the pooled agreement rate between teledermatology and F2F diagnosis was 68.9% and pooled kappa was 0.67.
- Agreement was higher when dermatologists performed the F2F comparison: 70.96% for teledermatologists vs F2F dermatologists, compared with 44.1% for non-specialists (p<0.001); kappa was 0.69 vs 0.52.
- When image-acquisition training was provided, mean agreement was 75.9% versus 62.1% without training (p=0.033); concordance was 0.77 versus 0.60 (p=0.01).
- Digital cameras outperformed smartphones/tablets: mean agreement 71.7% vs 59.8% (p=0.029), and concordance 0.70 vs 0.62 (p=0.003). Agreement between teledermatology and histopathology was 55.7%.
## Methods
- Systematic review and meta-analysis following PRISMA; protocol registered on OSF.
- Searched MEDLINE, Embase, Cochrane Library, CINAHL, and medRxiv for studies from January 2010 to May 2022; no language restrictions.
- Included observational studies and randomized clinical trials reporting percentage agreement or kappa for primary diagnoses between teledermatology and F2F physician diagnosis; 44 studies were included from 7173 citations.
- Used random-effects meta-analysis, with subgroup analyses and meta-regression to explore heterogeneity; risk of bias assessed with RoB 2 and QUADAS-2.
## Limitations
- The paper states that heterogeneity was considerable, which limited meta-analysis and synthesis of predictors even after subgrouping.
- It also states that there were a limited number of randomized controlled trials and a limited number of live video conferencing studies, restricting comparisons across study designs and modalities.
- Evident from the text: the review only searched published literature and may have missed grey literature and reports from low-income and middle-income countries; it also did not incorporate AI effects, which the authors note are outside scope.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
7 Valid · 0 Not valid · 7 Not checked · 30 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“There is valid concern over the reliability of teledermatology given the significant variability in diagnostic accuracy predicted across pre-pandemic research.6”
§ Diagnostic reliability in teledermatology: a systematic review and a meta-analysis > Introduction
What the sources say
- Supportedcites [6] Finnane, 2017, Teledermatology for the diagnosis and management of skin cancer: a systematic review, JAMA Dermatol source
In 'Aim 1: Accuracy of teledermatology diagnosis compared to face to face diagnosis,' the review says studies reported variable results, with agreement between telediagnosis and reference standards ranging from 51% to 100%. The 'Quality of diagnostic accuracy and diagnostic concordance studies' section explicitly describes wide variation in results. Our copy provides section labels but no page numbers. (LLM, conf=0.93)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While our attempts to filter biased studies did not yield significant improvements to our meta-analysis model, we are mindful of the potential risk of publication bias in our review.”
§ Diagnostic reliability in teledermatology: a systematic review and a meta-analysis > Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The concordance values for digital photography were reported for 12 studies with a mean of 0.70 (CI 0.61 to 0.76). Concordance values for smartphone or tablet technologies were reported for eight studies with a mean of 0.62 (CI 0.38 to 0.78). The higher concordance with digital photography was statistically significant (p=0.003, heterogeneity: Iˆ2=100%).”
§ Diagnostic reliability in teledermatology: a systematic review and a meta-analysis > Sub-group analyses > Diagnostic reliability of teledermatology versus F2F by type of technology used for image acquisition
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The agreement rate was 76.4% between teledermatologists, 82.4% between F2F physicians and 55.7% between teledermatology and histopathology.”
§ Diagnostic reliability in teledermatology: a systematic review and a meta-analysis > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Concordance values were also higher when training was provided (mean 0.77, CI 0.66 to 0.84) compared with when no training was provided (mean 0.60, CI 0.49 to 0.69) (p=0.01, Iˆ2=98%).”
§ Diagnostic reliability in teledermatology: a systematic review and a meta-analysis > Sub-group analyses > Diagnostic reliability of teledermatology versus F2F by training provided for image acquisition
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
14 more claims
Create a free account to see all 44 claims and every source verdict.
- Probably not a substantial claim. 13
- It may state two separate claims as one. 16
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“however, the analysis was restricted to studies in which diagnoses were established by dermatologists, thereby providing a clinically more relevant assessment (177).”
From Diagnostic accuracy of teledermatology for skin diseases: a systematic review and meta-analysis (2026) · cites this paper as [177]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Citations
Cites
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Teledermatology for the Diagnosis and Management of Skin Cancer: A Systematic Review
Finnane, A., Dallest, K., Janda, M., & Soyer, H. P. (2017) · JAMA Dermatology · doi:10.1001/jamadermatol.2016.4361 · Cited by 257
Teledermatology: a review and update
Lee, J. J., & English, J. C. (2018) · American Journal of Clinical Dermatology · doi:10.1007/s40257-017-0317-6 · Cited by 238 · cited 1×
“56 This suggests that our greater sample size introduces more studies with poor agreement, which may better reflect the reality of adopting teledermatology at a larger scale and signal risk from a lack of standardisation.”
Mohammed, H. T., Hyseni, L., Bui, V., Gerritsen, B., Fuller, K., Sung, J., & Alarakhia, M. (2021) · PLoS ONE · doi:10.1371/journal.pone.0253665 · Cited by 130
Wang, R. H., Barbieri, J. S., Nguyen, H. P., Stavert, R., Forman, H. P., Bolognia, J. L., & Kovarik, C. L. (2020) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2020.01.065 · Cited by 127
Application of mobile teledermatology for skin cancer screening
Lamel, S. A., Haldeman, K. M., Ely, H., Kovarik, C. L., Pak, H., & Armstrong, A. W. (2012) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2011.11.957 · Cited by 125
Mobile applications in dermatology
Brewer, A. C., Endly, D. C., Henley, J., Amir, M., Sampson, B. P., Moreau, J. F., & Dellavalle, R. P. (2013) · JAMA Dermatology · doi:10.1001/jamadermatol.2013.5517 · Cited by 121
Tan, E., Yung, A., Jameson, M., Oakley, A., & Rademaker, M. (2010) · British Journal of Dermatology · doi:10.1111/j.1365-2133.2010.09673.x · Cited by 116
Tran, K., Ayad, M., Weinberg, J., Cherng, A., Chowdhury, M., Monir, S., El Hariri, M., & Kovarik, C. (2011) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2010.01.010 · Cited by 111
Research works printed but not linked: 1
- Zanini, 2013, Analyze of diagnostic concordance between face-to-face and teledermatology diagnosis, Med Cutan Ibero Lat Am, 41, 60
Cited by
The impact of tele-expertise in oncology: current state and future perspectives
Heudel, P., Amini‐Adlé, M., Anriot, J., et al. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1552182 · Cited by 6
“Bourkas et al., through a systematic review and meta-analysis, found a high concordance between remote and in-person consultations, af fi rming teledermatology ’ s diagnostic reliability, particularly in regions with limited access to specialists (11).”
Lin, V., Callado, G. Y., Pardo, I., Gutfreund, M. C., Hsieh, M. K., Pereira, A. M. R., Kwong, B. Y., Aleshin, M. A., Holubar, M. K., Salinas, J. L., et al. (2024) · Archives of Dermatological Research · doi:10.1007/s00403-024-03515-x · Cited by 5
López-Villegas, A., Bautista-Mesa, R. J., López‐Liria, R., Pérez-Heredia, M., Hernandez‐Montoya, C., Gutierrez‐Maldonado, M. G., Leal‐Costa, C., & Peiró, S. (2024) · Public Health Nursing · doi:10.1111/phn.13438 · Cited by 7
Using deep learning systems for diagnosing common skin lesions in sexual health
Soe, N. N., Latt, P. M., Lee, D. M., Yu, Z., Schmidt, M., Bissessor, M., Aung, E. T., Ge, Z., Rahman, R., Chow, E. P. F., et al. (2025) · Communications Medicine · doi:10.1038/s43856-025-01144-7 · Cited by 7
“In dermatology practice, healthcare providers adopted a teledermatology approach to improve service ef fi cacy and expand access to specialists 6 .”
Ashour, A., & Elkhawaga, G. (2026) · Journal of the Egyptian Public Health Association · doi:10.1186/s42506-025-00203-0 · Cited by 4
“However, the evidence is constrained by heterogeneity across studies, modest agreement with histopathology (55.7%), limited lesion-specific data, and variable methodological quality, which together limit the generalizability of findings [11].”
Influential
Metadata
- Authors
- Bourkas, A. N., Barone, N., Bourkas, M. E. C., Mannarino, M., Fraser, R. D. J., Lorincz, A., Wang, S. C., & Ramirez-GarciaLuna, J. L.
- Affiliations
- Queen's University (CA)
- McGill University (CA)
- University of Toronto (CA)
- Western University (CA)
- Independent Researcher, Montreal, Qubec, Canada
- Department of Surgery, McGill University, Montreal, Qubec, Canada
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2023-08
- Volume
- 13
- Issue
- 8
- Pages
- e068207
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC10423833
- OpenAlex
- W4385769600
- Cited by
- 51
- References
- 61
- Citations by year
- 2026: 27 · 2025: 16 · 2024: 8
- FWCI
- 2.52
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Canadian Digital Technology Supercluster (Telewound Care Canada)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Digital Imaging in Medicine
- Keywords
- teledermatology, diagnostic agreement, face-to-face consultation, dermatological diagnosis, kappa concordance, histopathology, digital photography, telemedicine, resource-limited settings
- MeSH terms
- Dermatology, Humans, Physicians, Referral and Consultation, Skin Diseases, Reproducibility of Results, Telemedicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Diagnostic reliability in teledermatology: a systematic review and a meta-analysis. https://app.cochat.ai/papers/10.1136/bmjopen-2022-068207
- The paper
- Bourkas, A. N., Barone, N., Bourkas, M. E. C., Mannarino, M., Fraser, R. D. J., Lorincz, A., Wang, S. C., & Ramirez-GarciaLuna, J. L. (2023). Diagnostic reliability in teledermatology: a systematic review and a meta-analysis. BMJ Open. https://doi.org/10.1136/bmjopen-2022-068207
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.