The DOI matches its Crossref record; 78 of the 85 references it cites were found in a registry or an index; 10 of the 86 sources its claims cite were checked for support.
A multimodal vision foundation model for clinical dermatology
Open accessAbstract
Diagnosing and treating skin diseases require advanced visual skills across domains and the ability to synthesize information from multiple imaging modalities. While current deep learning models excel at specific tasks such as skin cancer diagnosis from dermoscopic images, they struggle to meet the complex, multimodal requirements of clinical practice. Here we introduce PanDerm, a multimodal dermatology foundation model pretrained through self-supervised learning on over 2 million real-world skin disease images from 11 clinical institutions across 4 imaging modalities. We evaluated PanDerm on 28 diverse benchmarks, including skin cancer screening, risk stratification, differential diagnosis of common and rare skin conditions, lesion segmentation, longitudinal monitoring, and metastasis prediction and prognosis. PanDerm achieved state-of-the-art performance across all evaluated tasks, often outperforming existing models when using only 10% of labeled data. We conducted three reader studies to assess PanDerm’s potential clinical utility. PanDerm outperformed clinicians by 10.2% in early-stage melanoma detection through longitudinal analysis, improved clinicians’ skin cancer diagnostic accuracy by 11% on dermoscopy images and enhanced nondermatologist healthcare providers’ differential diagnosis by 16.5% across 128 skin conditions on clinical photographs. These results show PanDerm’s potential to improve patient care across diverse clinical scenarios and serve as a model for developing multimodal foundation models in other medical specialties, potentially accelerating the integration of artificial intelligence support in healthcare.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
PanDerm is a multimodal dermatology foundation model pretrained via self-supervised learning on over 2 million real-world skin images from 11 institutions across 4 imaging modalities. Across 28 benchmarks and 3 reader studies, it achieved state-of-the-art performance and improved clinician and nondermatologist diagnostic accuracy in several tasks.
Key findings
- Pretraining used 2,149,706 unlabeled multimodal skin images: 757,890 (35.3%) TBP tiles, 537,047 (25.4%) dermatopathology tiles, 460,328 (21.4%) clinical images and 384,441 (17.9%) dermoscopic images. PanDerm achieved state-of-the-art performance on all 28 evaluated tasks, often using only 5–10% of labeled training data; it outperformed SwAVDerm using 33% less training data and reached best performance in 200 epochs versus 500–800 for MILAN, DINOv2 and MAE.
- Diagnostic gains averaged 5.1%, 8.0%, 4.2% and 0.9% on dermoscopic, clinical, TBP and pathology datasets, respectively. On HAM10000 and PAD-UFES-20, PanDerm surpassed the next-best models by 4.7% and 9.0% (both P < 0.001). For broader skin conditions, weighted F1 improvements were 3.2%, 7.1% and 8.2% on MMT-09, DermNet and MMT-74.
- In longitudinal tasks, change detection AUROC improved from 0.596 to 0.706 on SDDI1 and from 0.683 to 0.767 on SDDI2; for malignant lesions, PanDerm reached AUROC 0.840, surpassing the next-best model by 15.0%. Metastasis prediction reached AUROC 0.964, and high-risk patients had shorter recurrence-free intervals (HR 5.63; 95% CI 2.87–11.02, P < 0.001), with time-dependent AUCs of 0.950, 0.931 and 0.909 at 3, 5 and 7 years.
- TBP tasks: photodamage weighted F1 0.896, nevus counting AUROC 0.983, risk stratification AUROC 0.705 and BACC 0.657. Malignant lesion screening sensitivity was 0.893, detecting malignant lesions in 79 of 80 patients while reducing unnecessary examinations by 60.8% versus melanographers (3,498 versus 8,913 lesions). Reader studies showed PanDerm outperformed average human reviewers by 10.2% in early melanoma detection, identified 77.5% (69/89) of melanomas at the first imaging time point versus 32.6% (29) for humans, improved skin cancer diagnostic accuracy from 0.69 to 0.80, and improved generalists’ top-3 accuracy by 16.5% across 128 skin conditions.
Methods
- Design: PanDerm is a self-supervised multimodal foundation model with a ViT-Large visual encoder, a mask regressor and a CLIP-Large teacher model. Pretraining used masked latent modeling and CLIP feature alignment, with 50% mask ratio, 224 × 224-pixel inputs, 500 epochs, batch size 480 per GPU (effective 1,920), and 4 × 80-GB NVIDIA H100 GPUs for approximately 5 days and 7 hours.
- Data and evaluation: Pretraining data came from 11 sources across 4 modalities. Evaluation covered 28 benchmarks, including 10 public datasets from 4 imaging modalities and 7 international sites, plus internal datasets such as MMT-09, MMT-74, SD-128, SDDI1, SDDI2, ComBineMel and TBP cohorts. Three reader studies assessed early melanoma detection, human–AI collaboration for skin cancer diagnosis, and human–AI collaboration for 128 skin conditions.
- Analysis: Main metrics included AUROC, weighted F1, Dice similarity coefficient, Jaccard index, sensitivity, top-1/top-3 accuracy and diagnostic confidence. Statistical approaches included k-fold cross-validation, nonparametric bootstrapping with 1,000 replicates, two-sided t-tests, permutation tests, Kaplan–Meier analysis and Cox proportional hazards regression.
Limitations
- The paper states that validation covered approximately 200 skin conditions, only a fraction of over 1,000 known dermatological diagnoses and smaller than some prior work (for example, 445 conditions), with limited coverage of rare genetic disorders, complex systemic diseases and clinical variants.
- The paper states that robustness and fairness evaluations mainly reflect overall accuracy rather than disease-specific analysis, have varying disease coverage across anatomical locations, and focus primarily on single imaging modalities; comprehensive bias assessment requires metrics beyond overall accuracy, and equitable stand-alone performance may not translate to unbiased human–AI collaboration.
- Evident from the text: the evaluations are retrospective benchmark and reader studies, and the paper does not report prospective clinical deployment or patient-outcome trials.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures















Verification
Claims the paper makes
66 Own result · 45 Not checked yet · 29 Own method · 14 Own interpretation · 4 No basis given · 3 Supported so far · 1 Supported · 1 Partly supported · accuracy not yet measured
Every source the paper cites for this claim was checked and supports it.
In the paper
“In a clinical validation study, PanDerm effectively identified malignant lesions among a large number of benign ones (216 malignant versus 197,716 benign lesions) from the high-risk melanoma of patients (HOP) study49 and mind your model (MYM) study50 cohort (Fig. 4e).”
§ A multimodal vision foundation model for clinical dermatology > Results > Risk assessment and malignant lesion screening using TBP
What the sources say
- Supportedcites [49] Primiero, C. A. et al. Evaluation of the efficacy of 3D total-body photography with sequential digital dermoscopy in a high-risk melanoma cohort: protocol for a randomised controlled trial. BMJ Open 9, e032969 (2019). source
Citation 49 is attached to the HOP study, not to the PanDerm validation result. The Introduction identifies this work as a trial recruiting people at high risk of melanoma for 3D total-body photography and dermoscopy surveillance, supporting its use to identify the high-risk cohort. The paper does not itself report PanDerm’s performance or the lesion counts. (LLM, conf=0.82)
- Supportedcites [50] Koh, U. et al. ‘Mind your moles’ study: protocol of a prospective cohort study of melanocytic naevi. BMJ Open 8, e025857 (2018). source
The Abstract (Methods and analysis; page unavailable) identifies ‘Mind your Moles’ as a cohort study that records skin-lesion images, supporting the citation’s identification of the MYM cohort. This protocol does not report PanDerm’s validation results; the citation to this source is attached to the cohort identification, not those results. (LLM, conf=0.90)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although our evaluations show stable cross-skin-tone performance without explicitly balanced training data (as shown to be necessary in a previous study63)”
§ A multimodal vision foundation model for clinical dermatology > Discussion
What the sources say
- Partly supportedcites [63] Daneshjou, R. et al. Disparities in dermatology AI performance on a diverse, curated clinical image set. Sci. Adv. 8, eabq6147 (2022). sourceExperimental — accuracy not yet measured
The citation supports the parenthetical point that diverse training data can help close a cross-skin-tone performance gap: the Results report that fine-tuning on diverse DDI data closed the gap, while fine-tuning on FST I–II images alone did not. The Discussion likewise argues for high-quality, diverse data, but the paper does not establish that explicitly balanced training data are necessary. The citing authors’ claim about their own stable performance without such data is not a finding attributed to this source. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Here we introduce PanDerm, a multimodal dermatology foundation model pretrained through self-supervised learning on over 2 million real-world skin disease images from 11 clinical institutions across 4 imaging modalities.”
- Also stated in: § Main · plain
“Here we introduce PanDerm, a general-purpose, multimodal dermatology foundation model. Uniquely designed to integrate multiple imaging modalities, PanDerm is pretrained on over 2 million images sourced from 11 institutions across multiple countries, covering 4 imaging modalities spanning diverse dermatological conditions”
§ A multimodal vision foundation model for clinical dermatology > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Main · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“PanDerm achieved state-of-the-art performance across all evaluated tasks, often outperforming existing models when using only 10% of labeled data.”
- Also stated in: § Main · plain
“PanDerm achieves state-of-the-art performance on all tasks, often using only 5–10% of the labeled training data typically required.”
§ A multimodal vision foundation model for clinical dermatology > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Main · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“PanDerm outperformed clinicians by 10.2% in early-stage melanoma detection through longitudinal analysis”
- Also stated in: § Reader studies · plain
“In terms of overall accuracy, PanDerm outperformed the average human reviewer by 10.2% and surpassed the best-performing human by 3.6%.”
§ A multimodal vision foundation model for clinical dermatology > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Reader studies · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“enhanced nondermatologist healthcare providers’ differential diagnosis by 16.5% across 128 skin conditions on clinical photographs”
- Also stated in: § Reader studies · plain
“greater improvements in both top 1 diagnostic scores (generalist group, +0.45; dermatology group, +0.25; Fig. 6g) and top 3 accuracy (generalist group, +16.5%; dermatology group, +10.3%; Fig. 6h).”
§ A multimodal vision foundation model for clinical dermatology > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Reader studies · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“PanDerm achieved state-of-the-art performance across all evaluated tasks, often outperforming existing models when using only 10% of labeled data.”
- Also stated in: § Main · plain
“PanDerm achieves state-of-the-art performance on all tasks, often using only 5–10% of the labeled training data typically required.”
§ A multimodal vision foundation model for clinical dermatology > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Main · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“improved clinicians’ skin cancer diagnostic accuracy by 11% on dermoscopy images”
- Also stated in: § Reader studies · plain
“PanDerm’s assistance significantly increased overall diagnostic accuracy from 0.69 (95% CI 0.65–0.73) to 0.80 (95% CI 0.76–0.84, P < 0.001; Fig. 5b).”
§ A multimodal vision foundation model for clinical dermatology > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Reader studies · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We evaluated PanDerm on 28 diverse benchmarks, including skin cancer screening, risk stratification, differential diagnosis of common and rare skin conditions, lesion segmentation, longitudinal monitoring, and metastasis prediction and prognosis.”
- Also stated in: § Main · plain
“We systematically evaluate PanDerm across 28 benchmarks (Fig. 1g), covering a diverse array of clinical tasks, including screening, risk stratification, phenotype assessment, nevus counting, longitudinal monitoring, lesion change detection, diagnosis of both common and rare skin conditions and skin lesion segmentation, as well as recurrence prediction and prognosis.”
§ A multimodal vision foundation model for clinical dermatology > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Main · plain
None of the sources cited for this claim have been checked yet.
In the paper
“When compared with other self-supervised training techniques, PanDerm showed remarkable computational efficiency, requiring only 200 training epochs to achieve the best performance, compared with 500–800 epochs needed by leading methods such as MILAN37, DINOv2 (ref. 38) and MAE19 (Fig. 1f, right).”
§ A multimodal vision foundation model for clinical dermatology > Results > Ablation studies and training strategy comparisons
What the sources say
- Not checked yetcites [37] Hou, Z., Sun, F., Chen, Y.-K., Xie, Y. & Kung, S.-Y. Milan: masked image pretraining on language assisted representation. Preprint at https://arxiv.org/abs/2208.06049 (2022).
- Not checked yetcites [38] Oquab, M. et al. DINOv2: learning robust visual features without supervision. Trans. Mach. Learn. Res. https://openreview.net/forum?id=a68SUt6zFt (2024).
- Not checked yetcites [19] He, K. et al. Masked autoencoders are scalable vision learners. In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition 16000–16009 (IEEE, 2022). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- It may state two separate claims as one. 44
- Probably not a substantial claim. 44
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“On representative dermoscopy and clinical benchmarks such as HAM10000 (ref. 34) and PAD-UFES-20 (ref. 43), PanDerm surpassed the next-best models by 4.7% (P < 0.001) and 9.0% (P < 0.001), respectively”
§ A multimodal vision foundation model for clinical dermatology > Results > Diagnostic performance and generalization ability across datasets
What the sources say
- Supportedcites [34] Tschandl, P., Rosendahl, C. & Kittler, H. The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Sci. Data 5, 180161 (2018). source
The citation is attached to HAM10000, identifying the dataset used as a dermoscopy benchmark, rather than to the PanDerm performance figures. The Methods section describes HAM10000 as a collection of 10,015 dermatoscopic images, and Data Records identifies it as a dataset. This source is not being cited for the 4.7% or 9.0% results. (LLM, conf=0.92)
- Not checked yetcites [43] Pacheco, A. G. et al. PAD-UFES-20: a skin lesion dataset composed of patient data and clinical images collected from smartphones. Data Brief 32, 106221 (2020). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Some efforts have focused on self-supervised learning specifically for dermatology using public datasets33,34 or web-sourced skin images35.”
§ A multimodal vision foundation model for clinical dermatology > Main
What the sources say
- Not checked yetcites [33] Wang, Z., Lyu, J. & Tang, X. autoSMIM: automatic superpixel-based masked image modeling for skin lesion segmentation. IEEE Trans. Med. Imaging 42, 3501–3511 (2023). source
- Supportedcites [34] Tschandl, P., Rosendahl, C. & Kittler, H. The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Sci. Data 5, 180161 (2018). source
The citation is attached to “public datasets,” and this paper identifies and releases one: HAM10000. The Abstract (page not provided) states that its dermatoscopic images are publicly available through the ISIC archive for machine-learning use. The paper does not itself report a self-supervised-learning effort, but the citation supports the dataset identification. (LLM, conf=0.88)
- Not checked yetcites [35] Shen, Y. et al. Optimizing skin disease diagnosis: harnessing online community data with contrastive learning and clustering techniques. NPJ Digit. Med. 7, 28 (2024). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Built on rich knowledge representations, these models have shown impressive performance across medical fields such as ophthalmology20, radiology21 and pathology22–25.”
§ A multimodal vision foundation model for clinical dermatology > Main
What the sources say
- Not checked yetcites [20] Zhou, Y. et al. A foundation model for generalizable disease detection from retinal images. Nature 622, 156–163 (2023). source
- Supportedcites [21] Pai, S. et al. Foundation model for cancer imaging biomarkers. Nat. Mach. Intell. 6, 354–367 (2024). source
Citation 21 is attached to radiology, not to ophthalmology or pathology. The Discussion reports robust performance of the paper’s cancer-imaging foundation model across three tasks and four cohorts, including superiority over baseline approaches for anatomical-site classification and malignancy prediction. (LLM, conf=0.92)
- Supportedcites [22] Xu, H. et al. A whole-slide foundation model for digital pathology from real-world data. Nature 630, 181–188 (2024). source
The citation range 22–25 is attached to pathology, not ophthalmology or radiology. The Abstract reports that this pathology foundation model achieves state-of-the-art performance on various digital pathology tasks, supporting the attributed claim. (LLM, conf=0.93)
- Supportedcites [23] Chen, R. J. et al. Towards a general-purpose foundation model for computational pathology. Nat. Med. 30, 850–862 (2024). source
This source supports the pathology portion of the citing sentence. The Introduction reports that its foundation model outperformed previous state-of-the-art models across pathology tasks, and the Discussion describes competitive performance across diverse clinical applications in pathology. The citations attached to ophthalmology and radiology are separate. (LLM, conf=0.91)
- Supportedcites [24] Vorontsov, E. et al. A foundation model for clinical-grade computational pathology and rare cancers detection. Nat. Med. 30, 2949–2935 (2024). source
This source supports the pathology portion of the multi-citation sentence. In the Results and Discussion, it reports strong performance by a pathology foundation model in cancer detection, including performance close to clinical-grade specialist models and better performance on some rare cancer variants. The ophthalmology and radiology portions are attached to other citations. (LLM, conf=0.93)
- Supportedcites [25] Wang, X. et al. A pathology foundation model for cancer diagnosis and prognosis prediction. Nature 634, 970–978 (2024). source
This source is cited for pathology, not for the separately cited ophthalmology and radiology examples. Its Abstract reports that the CHIEF pathology foundation model outperformed state-of-the-art deep-learning methods by up to 36.1%, supporting the performance claim. (LLM, conf=0.92)
boostedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Using TBP images alone, PanDerm achieved a sensitivity of 0.893, outperforming the next-best model by 4.2% (Fig. 4j, left).”
§ A multimodal vision foundation model for clinical dermatology > Results > Risk assessment and malignant lesion screening using TBP
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When clinical measurements were available for all models, PanDerm maintained its advantage with a 3.5% higher sensitivity (Fig. 4j, right), reaching a sensitivity of 0.893.”
§ A multimodal vision foundation model for clinical dermatology > Results > Risk assessment and malignant lesion screening using TBP
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“PanDerm showed exceptional accuracy in distinguishing melanomas likely to metastasize, achieving an AUROC of 0.964 (95% CI 0.937–0.991), surpassing the next-best model by 2.0% (P = 0.073) (Fig. 3d).”
§ A multimodal vision foundation model for clinical dermatology > Results > Melanoma metastasis prediction and survival analysis
boostedcorrelationaln = 370 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“showing superior data scalability and training efficiency compared with existing self-supervised algorithms (Fig. 1f).”
§ A multimodal vision foundation model for clinical dermatology > Main
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The model achieves unified representation learning across total-body photography (TBP) and clinical, dermoscopic and dermatopathology images, enabling comprehensive patient analysis throughout diverse clinical workflows (Fig. 1d).”
§ A multimodal vision foundation model for clinical dermatology > Main
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Using the optimized pipeline for all models, PanDerm achieved AUROC improvements of 4.3% in SDDI1 (P < 0.001) and 3.7% in SDDI2 over the next-best model (Fig. 3c, middle).”
§ A multimodal vision foundation model for clinical dermatology > Results > Short-term lesion change detection in sequential dermoscopic images
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Even using computationally efficient methods, PanDerm maintained its advantages, outperforming both linear-probe and fine-tune versions of BiomedGPT by 14.3% and 5.1%, respectively, in linear probing (Supplementary Table 3).”
§ A multimodal vision foundation model for clinical dermatology > Results > Ablation studies and training strategy comparisons
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“This processing system, combined with PanDerm’s advanced lesion change detection capabilities45, significantly improved change detection accuracy from 0.596 (95% confidence interval (CI) 0.567–0.624) to 0.706 (95% CI 0.686–0.725) in sequential digital dermoscopic imaging data (SDDI1) (Fig. 3a,c) (P < 0.001) and from 0.683 (95% CI 0.517–0.894) to 0.767 (95% CI 0.649–0.886) in SDDI2 (Fig. 3b,c, left”
§ A multimodal vision foundation model for clinical dermatology > Results > Short-term lesion change detection in sequential dermoscopic images
What the sources say
- Not checked yetcites [45] Zhang, B. et al. Short-term lesion change detection for melanoma screening with novel Siamese neural network. IEEE Trans. Med. Imaging 40, 840–851 (2020). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“PanDerm showed strong performance even with limited training data, achieving comparable results to other models while using only 10–30% of the labeled images (Fig. 2b and Supplementary Tables 5–10).”
§ A multimodal vision foundation model for clinical dermatology > Results > Diagnostic performance and generalization ability across datasets
boostedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It maintained high predictive accuracy over extended follow-up periods, with time-dependent areas under the curve (AUCs) of 0.950 (95% CI 0.910–0.991), 0.931 (95% CI 0.887–0.976) and 0.909 (95% CI 0.880–0.937) at 3 years, 5 years and 7 years, exceeding multi-clinical variables by 6.8%, 2.9% and 5.0%, respectively (Fig. 3i).”
§ A multimodal vision foundation model for clinical dermatology > Results > Melanoma metastasis prediction and survival analysis
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“while showing emergent capabilities in dermatology similar to those of DINOv2 in natural images, with linear probing performance comparable to full-parameter fine-tuning (Supplementary Table 2).”
§ A multimodal vision foundation model for clinical dermatology > Results > Ablation studies and training strategy comparisons
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For lesions later diagnosed as malignant, PanDerm achieved an AUROC of 0.840 (95% CI 0.769–0.911), surpassing the next-best model by 15.0% (P < 0.01) (Fig. 3c, right).”
§ A multimodal vision foundation model for clinical dermatology > Results > Short-term lesion change detection in sequential dermoscopic images
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“PanDerm achieved weighted F1 improvements of 3.2%, 7.1% and 8.2% on MMT-09, DermNet and MMT-74, respectively, compared with the next-best models (all P < 0.001).”
§ A multimodal vision foundation model for clinical dermatology > Results > Diagnostic performance and generalization ability across datasets
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“PanDerm also consistently outperformed other AI approaches (Fig. 3j), showing improvements of 2.3%, 3.0% and 2.5% at 3 years, 5 years and 7 years, respectively.”
§ A multimodal vision foundation model for clinical dermatology > Results > Melanoma metastasis prediction and survival analysis
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In lesion-specific risk stratification, PanDerm also ranked first with an AUROC of 0.705 (95% CI 0.698–0.712) and balanced accuracy (BACC) of 0.657 (95% CI 0.6513–0.663), with all results statistically significant (P < 0.001; Fig. 4d,h).”
§ A multimodal vision foundation model for clinical dermatology > Results > Risk assessment and malignant lesion screening using TBP
plainn = 480 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Significantly, it detected malignant lesions in 79 out of 80 patients while reducing unnecessary examinations by 60.8% compared with melanographers (3,498 versus 8,913 lesions recommended for detailed examination) (Fig. 4j,k and Supplementary Table 18).”
§ A multimodal vision foundation model for clinical dermatology > Results > Risk assessment and malignant lesion screening using TBP
boosteddirectn = 80- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Notably, it maintained high performance even on clinical photographs that were not used during training, with AUROC gains of 4.0%, 2.6% and 2.1% on the three external clinical datasets (all P < 0.001).”
§ A multimodal vision foundation model for clinical dermatology > Results > Diagnostic performance and generalization ability across datasets
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“PanDerm consistently outperformed all other models, achieving significant improvements on 9 of 10 datasets, with average gains of 5.1%, 8.0%, 4.2% and 0.9% on dermoscopic, clinical, TBP and pathology datasets, respectively (Fig. 2a).”
§ A multimodal vision foundation model for clinical dermatology > Results > Diagnostic performance and generalization ability across datasets
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In a cohort of 480 patients with 196,933 lesions from Australia, PanDerm achieved a weighted F1 score of 0.896 (95% CI 0.879–0.913) for photodamage assessment and an AUROC of 0.983 (95% CI 0.979–0.987) for nevus counting, surpassing all other models (P < 0.05 and P < 0.001, respectively; Fig. 4b,c,g).”
§ A multimodal vision foundation model for clinical dermatology > Results > Risk assessment and malignant lesion screening using TBP
plainn = 480 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“PanDerm showed significant superiority over all pretrained models, achieving higher AUROC scores across all external datasets (Fig. 2c).”
§ A multimodal vision foundation model for clinical dermatology > Results > Diagnostic performance and generalization ability across datasets
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“These advantages enabled PanDerm to improve upon both traditional models42,60 and recent generalist medical models such as BiomedGPT41.”
§ A multimodal vision foundation model for clinical dermatology > Discussion
What the sources say
- Not checked yetcites [42] Dosovitskiy, A. et al. An image is worth 16×16 words: transformers for image recognition at scale. In Proc. 9th International Conference on Learning Representations https://openreview.net/forum?id=YicbFdNTTy (OpenReview.net, 2021).
- Not checked yetcites [60] He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proc. IEEE Conference on Computer Vision and Pattern Recognition 770–778 (IEEE, 2016). source
- Not checked yetcites [41] Zhang, K. et al. A generalist vision–language foundation model for diverse biomedical tasks. Nat. Med. 30, 3129–3141 (2024). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In addition, PanDerm offers practical advantages in clinical settings, processing images about four to five times faster than MedSAM while using less computational resources (Supplementary Table 23).”
§ A multimodal vision foundation model for clinical dermatology > Results > Skin lesion segmentation
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In terms of overall accuracy, PanDerm outperformed the average human reviewer by 10.2% and surpassed the best-performing human by 3.6%.”
§ A multimodal vision foundation model for clinical dermatology > Results > Reader studies
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, when used independently, PanDerm achieved higher diagnostic accuracy than both unassisted readers (top 1 scores: 3.6 versus 2.83; P < 0.001) and human–AI collaboration (top 1 scores: 3.6 versus 3.08; P < 0.001).”
§ A multimodal vision foundation model for clinical dermatology > Results > Reader studies
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our model with CLIP-large teachers significantly improved performance and outperformed CLIP-large itself.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Detail of model architecture and pretraining
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The model showed robust performance, achieving an 80.4% mean (macro-averaged) recall, with notably high recall rates for critical skin lesions: 87.2% for melanoma and 86.0% for BCC.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Downstream evaluation details
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Notable diagnostic variability between pathologists was observed.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Pretraining dataset for developing PanDerm
plainn = 54- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Recent advances in foundation models have emerged as a promising direction to address this challenge15,16.”
§ A multimodal vision foundation model for clinical dermatology > Main
What the sources say
- Not checked yetcites [15] Gui, H., Omiye, J. A., Chang, C. T. & Daneshjou, R. The promises and perils of foundation models in dermatology. J. Invest. Dermatol. 144, 1440–1448 (2024). source
- Not checked yetcites [16] Moor, M. et al. Foundation models for generalist medical artificial intelligence. Nature 616, 259–265 (2023). source
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“In clinical practice, diagnosing and treating skin conditions involves a range of tasks, including total-body skin cancer detection and risk assessment2–5, differential diagnosis of hundreds of dermatological conditions such as inflammatory dermatoses and pigmentary disorders6, multimodal image analysis7,8, pathology interpretation9,10, monitoring lesion changes11,12 and predicting outcomes13,14.”
§ A multimodal vision foundation model for clinical dermatology > Main
What the sources say
- Not checked yetcites [2] Primiero, C. A. et al. A narrative review: opportunities and challenges in artificial intelligence skin image analyses using total body photography. J. Invest. Dermatol. 144, 1200–1207 (2024). source
- Not checked yetcites [3] Primiero, C. A. et al. A protocol for annotation of total body photography for machine learning to analyze skin phenotype and lesion classification. Front. Med. 11, 1380984 (2024). source
- Not checked yetcites [4] Olsen, C. M. et al. Risk stratification for melanoma: models derived and validated in a purpose-designed prospective cohort. J. Natl Cancer Inst. 110, 1075–1083 (2018). source
- Not checked yetcites [5] Usher-Smith, J. A., Emery, J., Kassianos, A. P. & Walter, F. M. Risk prediction models for melanoma: a systematic review. Cancer Epidemiol. Biomark. Prev. 23, 1450–1463 (2014). source
- Not checked yetcites [6] Liu, Y. et al. A deep learning system for differential diagnosis of skin diseases. Nat. Med. 26, 900–908 (2020). source
- Not checked yetcites [7] Yap, J., Yolland, W. & Tschandl, P. Multimodal skin lesion classification using deep learning. Exp. Dermatol. 27, 1261–1267 (2018). source
- Not checked yetcites [8] Luo, N. et al. Artificial intelligence-assisted dermatology diagnosis: from unimodal to multimodal. Comput. Biol. Med. https://doi.org/10.1016/j.compbiomed.2023.107413 (2023). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These results show PanDerm’s potential to improve patient care across diverse clinical scenarios and serve as a model for developing multimodal foundation models in other medical specialties, potentially accelerating the integration of artificial intelligence support in healthcare.”
§ A multimodal vision foundation model for clinical dermatology > Abstract
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“In general computer vision, foundation models are pretrained on massive datasets such as ImageNet31 or JFT-300M (ref. 32) and most existing dermatology AI models still rely on these models for downstream adaptation.”
§ A multimodal vision foundation model for clinical dermatology > Main
What the sources say
- Not checked yetcites [31] Russakovsky, O. et al. ImageNet large scale visual recognition challenge. Int. J. Comput. Vis. 115, 211–252 (2015). source
- Not checked yetcites [32] Sun, C., Shrivastava, A., Singh, S. & Gupta, A. Revisiting unreasonable effectiveness of data in deep learning era. In Proc. IEEE International Conference on Computer Vision 843–852 (IEEE, 2017). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“The performance of foundation models is inherently linked to the scale of their parameters and training data28–30.”
§ A multimodal vision foundation model for clinical dermatology > Main
What the sources say
- Not checked yetcites [28] Achiam, J. et al. Gpt-4 technical report. Preprint at https://arxiv.org/abs/2303.08774 (2023).
- Not checked yetcites [29] Zhai, X., Kolesnikov, A., Houlsby, N. & Beyer, L. Scaling vision transformers. In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition 12104–12113 (IEEE, 2022). source
- Not checked yetcites [30] Kaplan, J. et al. Scaling laws for neural language models. Preprint at https://arxiv.org/abs/2001.08361 (2020).
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“Monitoring suspicious melanocytic lesions over a 3-month period is a widely accepted procedure for early melanoma detection, as changes often prompt excision to rule out melanoma, while stability can be reassuring12.”
§ A multimodal vision foundation model for clinical dermatology > Results > Short-term lesion change detection in sequential dermoscopic images
What the sources say
- Not checked yetcites [12] Altamura, D., Avramidis, M. & Menzies, S. W. Assessment of the optimal interval for and sensitivity of short-term sequential digital dermoscopy monitoring for the diagnosis of melanoma. Arch. Dermatol. 144, 502–506 (2008). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“the evaluation mainly reflects overall accuracy rather than disease-specific analysis”
§ A multimodal vision foundation model for clinical dermatology > Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These findings suggest promising directions for developing foundation models in other medical specialties in which the integration of diverse imaging modalities and complex clinical workflows is crucial for patient care.”
§ A multimodal vision foundation model for clinical dermatology > Discussion
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our development approach, combining systematic data curation, advanced self-supervised learning and rigorous clinical validation, provides a framework for developing medical AI systems that can adapt to varying levels of clinical expertise and healthcare settings.”
§ A multimodal vision foundation model for clinical dermatology > Discussion
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These capabilities stem from its rich knowledge representation, developed through pretraining on varied dermatological image modalities and conditions, leading to consistent and significant performance improvements across tasks and modalities.”
§ A multimodal vision foundation model for clinical dermatology > Discussion
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“our results suggest that specialty-specific foundation models designed with clinical workflows in mind may offer more practical solutions for specialties in which multiple imaging modalities are crucial.”
§ A multimodal vision foundation model for clinical dermatology > Discussion
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Our strategy minimizes this risk, ensuring that benchmark evaluations accurately reflect real-world model performance.”
§ A multimodal vision foundation model for clinical dermatology > Discussion
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“comprehensive bias assessment requires metrics beyond overall accuracy.”
§ A multimodal vision foundation model for clinical dermatology > Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
None of the sources cited for this claim have been checked yet.
In the paper
“This approach contrasts with previous efforts, such as SwAVDerm35, which relied on web-sourced skin data, inadvertently incorporating images from commonly used benchmarks such as ISIC55 and DermNet44, increasing the risk of data leakage and compromising evaluation validity.”
§ A multimodal vision foundation model for clinical dermatology > Discussion
What the sources say
- Not checked yetcites [35] Shen, Y. et al. Optimizing skin disease diagnosis: harnessing online community data with contrastive learning and clustering techniques. NPJ Digit. Med. 7, 28 (2024). source
- Not checked yetcites [55] Codella, N. C. et al. Skin lesion analysis toward melanoma detection: a challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), hosted by the International Skin Imaging Collaboration (ISIC). In Proc. IEEE 15th International Symposium on Biomedical Imaging (eds Meijering, E. & Summers, R.) 168–172 (IEEE, 2018). source
- Not checked yetcites [44] Dermnet. Dermnet https://dermnet.com/ (2023).
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The HIBA55 dataset is curated from the HIBA data from the ISIC archive55, containing 1,635 dermoscopic images with melanoma and other classes.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Skin cancer and general skin condition classification datasets
What the sources say
- Not checked yetcites [55] Codella, N. C. et al. Skin lesion analysis toward melanoma detection: a challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), hosted by the International Skin Imaging Collaboration (ISIC). In Proc. IEEE 15th International Symposium on Biomedical Imaging (eds Meijering, E. & Summers, R.) 168–172 (IEEE, 2018). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The HOP study has received approval from the Human Research Ethics Committee (HREC) from Metro South Health HREC (HREC/17/QPAH/816) and the University of Queensland HREC (2018000074).”
§ A multimodal vision foundation model for clinical dermatology > Methods > Ethics statement
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The naevus surveillance study images (NSSI) dataset is part of the Brisbane Naevus Morphology Study, circa 2009–2014. The study followed the Declaration of Helsinki protocols and was approved by the Princess Alexandra Hospital human research ethics committee.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Ethics statement
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“To compare models, we implement pairwise permutation tests, conducting 1,000 permutations per pair and recalculating performance metrics after each permutation.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Downstream evaluation details
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“In addition, we perform t-tests to assess the statistical significance of inter-model performance variations.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Downstream evaluation details
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The dataset contains 647 clinical images from the United States.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Skin cancer and general skin condition classification datasets
What the sources say
- Not checked yetcites [63] Daneshjou, R. et al. Disparities in dermatology AI performance on a diverse, curated clinical image set. Sci. Adv. 8, eabq6147 (2022). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The Med-Node82 dataset contains 170 clinical images.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Skin cancer and general skin condition classification datasets
What the sources say
- Not checked yetcites [82] Giotis, I. et al. MED-NODE: a computer-assisted melanoma diagnosis system using non-dermoscopic images. Expert Syst. Appl. 42, 6578–6585 (2015). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We ensure robust evaluation through fivefold cross-validation, stratifying by both case and label attributes.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Downstream evaluation details
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“The BCN20000 (ref. 79) dataset comprises 12,413 dermoscopic images in 9 categories: nevus, melanoma, basal cell carcinoma, seborrheic keratosis, actinic keratosis, solar lentigo, squamous cell carcinoma, dermatofibroma and vascular lesions, including lesions in hard-to-diagnose locations.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Skin cancer and general skin condition classification datasets
What the sources say
- Not checked yetcites ref. 79
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The Fitzpatrick17K (ref. 62) dataset comprises 16,577 clinical images annotated with both dermatological diagnoses and Fitzpatrick skin types (I–VI). It encompasses 114 distinct conditions”
§ A multimodal vision foundation model for clinical dermatology > Methods > Skin cancer and general skin condition classification datasets
What the sources say
- Not checked yetcites ref. 62
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The HAM10000 (ref. 34) dataset contains 10,015 dermoscopic images across 7 classes: actinic keratoses, basal cell carcinoma, benign keratosis, dermatofibroma, melanocytic nevi, melanoma and vascular lesions.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Skin cancer and general skin condition classification datasets
What the sources say
- Not checked yetcites ref. 34
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“probably owing to the limited data scale of skin images in medical-domain CLIP models.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Detail of model architecture and pretraining
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“For skin tumor patch classification, melanoma slide classification, reader studies, metastasis prediction and skin lesion segmentation, we conduct k-fold cross-validation owing to either a relatively small sample size or following conventional practice.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Downstream evaluation details
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“To assess statistical significance, we conduct two-sided t-tests comparing PanDerm’s performance against the baseline model for each task.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Downstream evaluation details
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The SDDI2 dataset has been approved by the Ethics Review Board of the Medical University of Vienna.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Ethics statement
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The ACEMID pathology (ACEMID_path) pilot study has received approval from the Alfred Hospital Ethics Committee (approval number: 746/23)”
§ A multimodal vision foundation model for clinical dermatology > Methods > Ethics statement
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“PH2 (ref. 81) is a clinical image dataset from Portugal with 200 images and 3 classes.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Skin cancer and general skin condition classification datasets
What the sources say
- Not checked yetcites ref. 81
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Before the evaluation, four experienced dermatologists collaboratively developed a standard ontology to systematically categorize the 128 skin conditions and facilitate expert evaluation (Extended Data Fig. 8).”
§ A multimodal vision foundation model for clinical dermatology > Methods > Downstream evaluation details
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“To ensure a fair comparison, all images are resized to 224 × 224.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Downstream evaluation details
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“For the remaining datasets, we use nonparametric bootstrapping with 1,000 replicates to estimate 95% CIs for each model’s performance.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Downstream evaluation details
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Only de-identified retrospective data were used for research, without the active involvement of patients.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Ethics statement
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Subsequently, we fine-tuned these models using identical hyperparameter setups to ensure a fair comparison.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Downstream evaluation details
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The ComBineMel dataset is part of the Computer Biomarkers Evaluation of Invasive Melanoma (ComBine Mel) study. The study was approved by the Alfred Hospital Ethics Committee on 8 August 2023 (approval number: HREC/98200/Alfred-2023).”
§ A multimodal vision foundation model for clinical dermatology > Methods > Ethics statement
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“To mitigate bias, we included ten single time-point melanoma images, preventing reviewers from assuming that the first image in a series was benign.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Downstream evaluation details
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“The melanoma slide classification task83 from the National Cancer Institute’s Clinical Proteomic Tumor Analysis Consortium Cutaneous Melanoma (CPTAC-CM) cohort consists of histopathology WSIs for cancer detection.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Skin cancer and general skin condition classification datasets
What the sources say
- Not checked yetcites [83] Clark, K. et al. The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository. J. Digit. Imaging 26, 1045–1057 (2013). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“To enhance the robustness and mitigate potential data selection bias, we perform five iterations of dataset splitting into training and testing sets, stratified by melanoma stage.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Downstream evaluation details
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“DermNet44 contains 19,559 clinical images; this dataset consists of images of 23 types of skin diseases and captures common clinical presentations including inflammatory conditions (eczema, psoriasis), infections (bacterial, viral, fungal) and neoplastic diseases.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Skin cancer and general skin condition classification datasets
What the sources say
- Not checked yetcites [44] Dermnet. Dermnet https://dermnet.com/ (2023).
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The ISIC2018 dataset52 comprises 3,694 dermoscopic images with 2,594 images for training, 100 for validation and 1,000 for testing.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Longitudinal and melanoma metastasis datasets
What the sources say
- Not checked yetcites [52] Milton, M. A. A. Automated skin lesion classification using ensemble of deep neural networks in ISIC 2018: skin lesion analysis towards melanoma detection challenge. Preprint at https://arxiv.org/abs/1901.10802 (2019).
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The Memorial Sloan Kettering Cancer Center (MSKCC)55 dataset is curated from the MSKCC data from the ISIC archive55, containing 8,984 dermoscopic images with melanoma and other classes.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Skin cancer and general skin condition classification datasets
What the sources say
- Not checked yetcites [55] Codella, N. C. et al. Skin lesion analysis toward melanoma detection: a challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), hosted by the International Skin Imaging Collaboration (ISIC). In Proc. IEEE 15th International Symposium on Biomedical Imaging (eds Meijering, E. & Summers, R.) 168–172 (IEEE, 2018). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The MMT data study is part of a research agreement study with Monash eResearch Centre and was approved through the Monash University Human Research Ethics Committee.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Ethics statement
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“All other experiments used the clean version from a previous study78, which prevents data leakage by ensuring that lesions from the same patient are not split across sets.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Skin cancer and general skin condition classification datasets
What the sources say
- Not checked yetcites previous study78
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The PAD-UFES-20 (ref. 43) dataset from Brazil contains 2,298 close-up clinical images with 6 classes, including actinic keratosis, basal cell carcinoma of the skin, malignant melanoma, melanocytic nevus of the skin, squamous cell carcinoma and seborrheic keratosis.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Skin cancer and general skin condition classification datasets
What the sources say
- Not checked yetcites ref. 43
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The MYM study was approved by the Metro South Health Human Research Ethics Committee on 21 April 2016 (approval number: HREC/16/QPAH/125).”
§ A multimodal vision foundation model for clinical dermatology > Methods > Ethics statement
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The SDDI_Alfred study has received approval from the Alfred Hospital Ethics Committee (approval number: 198/19) for the use of sequential dermoscopic imaging data.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Ethics statement
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“To ensure robust assessment, each case was evaluated by three assessors, with cases showing significant scoring discordance (differences between 3/4 and 1/2) reviewed in consensus meetings to establish final scores.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Downstream evaluation details
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
In the paper
“ISIC2024 (ref. 47) is a multicenter dataset with skin lesion crops from TBP. We chose holdout data with 49,025 crop images with three institutions (FNQH Cairns, Alfred Hospital, Melanoma Institute Australia) as the evaluation dataset.”
§ A multimodal vision foundation model for clinical dermatology > Methods > Skin cancer and general skin condition classification datasets
What the sources say
- Not checked yetcites ref. 47
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper relies on this without support.
Current AI models for dermatology struggle to integrate various data types and imaging modalities, reducing their utility in different real-world clinical settings.
“These models struggle to integrate various data types and imaging modalities, reducing their utility in different real-world clinical settings.”
The paper relies on this without support.
The absence of integrated AI solutions capable of supporting various clinical workflows currently hampers the practical impact of AI in dermatology.
“The absence of integrated AI solutions capable of supporting these various workflows currently hampers the practical impact of AI in dermatology.”
The paper relies on this without support.
Through comprehensive pretraining on large and diverse data, foundation models develop versatile representations that can effectively adapt to various clinical scenarios, outperforming previous deep learning models in downstream tasks.
“Through comprehensive pretraining on large and diverse data, these models develop versatile representations that can effectively adapt to various clinical scenarios, outperforming previous deep learning models in downstream tasks.”
The paper relies on this without support.
Existing dermatology self-supervised approaches are often limited by dataset size, diversity or lack of real patient data.
“However, these approaches are often limited by dataset size, diversity or the lack of real patient data.”
The paper relies on this without support.
General biomedical foundation models struggle with domain-specific data scarcity and integrating heterogeneous modalities for comprehensive clinical analysis.
“while general biomedical models, despite their broad scope, struggle with domain-specific data scarcity and integrating heterogeneous modalities for comprehensive clinical analysis.”
The paper relies on this without support.
Current AI systems are often restricted to isolated tasks and unable to address diverse demands of medical decision-making.
“Current AI systems are often restricted to isolated tasks and are unable to address the diverse demands of medical decision-making.”
The paper relies on this without support.
There are over 1,000 known dermatological conditions.
“over 1,000 diagnoses”
The paper relies on this without support.
Biopsy serves as the reference standard for melanoma diagnosis.
“While biopsy serves as our reference standard”
The paper relies on this without support.
The DermaChallenge platform user base mean score is a valid measure of experience.
“The number of correct answers in the first iteration of these levels, normalized against the mean score of the entire DermaChallenge platform user base, served as a score of experience.”
The paper relies on this without support.
The 128 skin conditions ontology is a valid standard for evaluating diagnostic accuracy.
“four experienced dermatologists collaboratively developed a standard ontology to systematically categorize the 128 skin conditions”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In oncology, transformer-based methods support clinical text processing, whole-slide and radiologic image interpretation (vision transformers), and genomic sequence modeling [24,25,26,27].”
From Artificial Intelligence in Clinical Oncology: From Productivity Enhancement to Creative Discovery (2025) · cites this paper as [26]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“a foundation model such as PanDerm, trained on >2 million dermoscopic and clinical images, improved physicians’ diagnostic accuracy for skin cancer by >10%, with the greatest benefits observed for non-dermatologists [26].”
From Artificial Intelligence in Clinical Oncology: From Productivity Enhancement to Creative Discovery (2025) · cites this paper as [26]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Recent high-impact studies, such as (5), demonstrate the clinical utility of multimodal large language models in dermatology, combining visual and textual reasoning to improve diagnostic accuracy.”
From Revolutionizing dermatopathology using AI in skin diagnostics: scoping review (2026) · cites this paper as [5]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most publicly available dermatology datasets are unimodal, limited in size, and composed mainly of dermoscopic or clinical images 3,4,13,20,21,42-47 , often photographs, paired with heterogeneous metadata or categorical labels that are lacking expressive textual information 48 .”
From Synthesized clinical notes enable training robust multimodal AI models from unimodal dermatology datasets (2026) · cites this paper as [4]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This supports the findings of (5), especially in emphasizing the practical relevance and significance of multimodal inputs in enhancing diagnostic precision and clinical generalizability.”
From Revolutionizing dermatopathology using AI in skin diagnostics: scoping review (2026) · cites this paper as [5]
The cited source says what the claim attributes to it.
In the citing paper
“The development of foundation models is also reshaping the dermatology domain, with multiple models such as SkinGPT4 2 , PanDerm 4 , Derm1M 3 , paving the way for an increased use of such models in the domain.”
From Synthesized clinical notes enable training robust multimodal AI models from unimodal dermatology datasets (2026) · cites this paper as [4]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ A multimodal vision foundation model for clinical dermatology > Results > Risk assessment and malignant lesion screening using TBP
“Significantly, it detected malignant lesions in 79 out of 80 patients”
§ A multimodal vision foundation model for clinical dermatology > Methods > 3D TBP datasets
“80 patients for testing (30,698 images, including 28 malignant lesions).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A multimodal vision foundation model for clinical dermatology > Results > Reader studies
“the generalist group (n = 17; 7 pre-vocational trainees, 8 GPs, 1 nurse and 1 clinical trial assistant)”
§ A multimodal vision foundation model for clinical dermatology > Methods > Downstream evaluation details
“a generalist group (n = 17) including 7 GPs, 7 general medicine practitioners and 3 other healthcare professionals (nursing, clinical trial assistants)”
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×
“These advantages enabled PanDerm https://doi.org/10.1038/s41591-025-03747-y to improve upon both traditional models 42,60 and recent generalist medical models such as BiomedGPT 41 .”
InfluentialImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 5×
“In general computer vision, foundation models are pretrained on massive datasets such as ImageNet 31 or JFT-300M (ref.”
InfluentialLearning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 13×
“Furthermore, PanDerm also surpassed vision-language models such as CLIP 36 , MONET 39 and biomedical-specific CLIP (BiomedCLIP) 40 in benchmark evaluations (Supplementary Table 1), while showing emergent capabilities in dermatology similar to those of DINOv2 in natural images, with linear probing performance comparabl…”
InfluentialScaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · doi:10.48550/arxiv.2001.08361 · Cited by 9,550 · cited 9×
“2b and Supplementary Tables 5–10).”
InfluentialMasked Autoencoders Are Scalable Vision Learners
He, K., Chen, X., Xie, S., Li, Y., Dollar, P., & Girshick, R. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01553 · Cited by 8,489 · cited 4×
“Foundation models are large-scale neural networks pretrained on vast, diverse data using self-supervised learning techniques, often leveraging weakly labeled or unlabeled data 17–19 .”
InfluentialThe Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository
Clark, K., Vendt, B., Smith, K., Freymann, J., Kirby, J., Koppel, P., Moore, S., Phillips, S., Maffitt, D., Pringle, M., et al. (2013) · Journal of Digital Imaging · doi:10.1007/s10278-013-9622-7 · Cited by 4,599
Tschandl, P., Rosendahl, C., & Kittler, H. (2018) · Scientific Data · doi:10.1038/sdata.2018.161 · Cited by 3,628 · cited 1×
“Some efforts have focused on self-supervised learning specifically for dermatology using public datasets 33,34 or web-sourced skin images 35 .”
Self-citationSegment anything in medical images
Ma, J., He, Y., Li, F., Han, L., You, C., & Wang, B. (2024) · Nature Communications · doi:10.1038/s41467-024-44824-z · Cited by 2,913
Codella, N. C. F., Gutman, D., Celebi, M. E., Helba, B., Marchetti, M. A., Dusza, S. W., Kalloo, A., Liopyris, K., Mishra, N., Kittler, H., et al. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363547 · Cited by 2,620 · cited 11×
“This approach contrasts with previous efforts, such as SwAVDerm 35 , which relied on web-sourced skin data, inad-vertently incorporating images from commonly used benchmarks such as ISIC 55 and DermNet 44 , increasing the risk of data leakage and compromising evaluation validity.”
InfluentialSelf-citationRevisiting Unreasonable Effectiveness of Data in Deep Learning Era
Sun, C., Shrivastava, A., Singh, S., & Gupta, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.97 · Cited by 2,484 · cited 1×
“32 ) and most existing dermatology AI models still rely on these models for downstream adaptation.”
Research works printed but not linked: 8
- Rapini, R. P. Practical Dermatopathology (Elsevier Health Sciences, 2021).
- Dosovitskiy, A. et al. An image is worth 16×16 words: transformers for image recognition at scale. In Proc. 9th International Conference on Learning Representations https://openreview.net/forum?id=YicbFdNTTy (OpenReview.net, 2021).
- Zhang, X. et al. Cae v2: context autoencoder with clip latent alignment. Trans. Mach. Learning Res. (2023).
- Alcantarilla, P. F. & Solutions, T. Fast explicit diffusion for accelerated features in nonlinear scale spaces. IEEE Trans. Pattern Anal. Mach. Intell. 34, 1281–1298 (2011).
- Ilse, M., Tomczak, J. & Welling, M. Attention-based deep multiple instance learning. In Proc. International Conference on Machine Learning (eds Dy, J. & Krause, A.) 2127–2136 (PMLR, 2018).
- Loshchilov, I. et al. Decoupled weight decay regularization. In Proc. 7th International Conference on Learning Representations https://openreview.net/forum?id=Bkg6RiCqY7 (OpenReview.net, 2019).
- Mendonça, T. et al. in Dermoscopy Image Analysis (eds Celebi, M. E. et al.) Ch. 13 420–438 (CRC Press, 2015).
- Kahler, S. et al. Automated photodamage assessment from 3D total body photography for an objective assessment of melanoma risk. Australas. J. Dermatol. 64, 8 (2023).
Cited by
Sorted by citations
Artificial Intelligence in Dermatology: A Review of Methods, Clinical Applications, and Perspectives
Zbrzezny, A. M., & Krzywicki, T. (2025) · Applied Sciences · doi:10.3390/app15147856 · Cited by 37
New approach methodologies for drug discovery
Liu, W., Pang, P. D., Wu, C. A., Tagle, D. A., & Wu, J. C. (2026) · Cell · doi:10.1016/j.cell.2026.02.012 · Cited by 38
Data-Centric Foundation Models in Computational Healthcare: A Survey
Zhang, Y., Gao, J. G., Tan, Z., Zhou, L., Ding, K., Zhou, M., Zhang, S., & Wang, D. (2026) · ACM Computing Surveys · doi:10.1145/3800677 · Cited by 65
Tjiu, J., & Lu, C. (2025) · Medicina · doi:10.3390/medicina61122186 · Cited by 31
A Clinical Perspective on Melanoma Overdiagnosis
Sheerin, J., Collgros, H., Chamberlain, A. J., et al. (2025) · Australasian Journal of Dermatology · doi:10.1111/ajd.14581 · Cited by 12
Self-citationFoundation Models Meet Medical Image Interpretation
Jiao, L., Hao, J., Li, R., Li, L., Liu, X., Liu, F., Ma, W., Chen, P., Huang, Z., Yang, J., et al. (2026) · Research · doi:10.34133/research.1024 · Cited by 12
Multimodal artificial intelligence in medicine: a task-oriented framework for clinical translation
Zhang, R., Chen, Y., Yue, W., Zhang, Y., Li, X., Feng, S., Yuan, F., & Luo, M. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2025.1736272 · Cited by 15
Artificial Intelligence in Clinical Oncology: From Productivity Enhancement to Creative Discovery
Kuno, M., Osumi, H., Udagawa, S., Yoshikawa, K., Ooki, A., Shinozaki, E., Ishikawa, T., Oba, J., Yamaguchi, K., & Sakurada, K. (2025) · Current Oncology · doi:10.3390/curroncol32110588 · Cited by 7
“In dermatology, a foundation model such as PanDerm, trained on >2 million dermoscopic and clinical images, improved physicians’ diagnostic accuracy for skin cancer by >10%, with the greatest benefits observed for non-dermatologists [26].”
Artificial intelligence–enabled precision medicine for inflammatory skin diseases
Tang, A. S., Wei, M. L., Haemel, A., La, C., Sirota, M., & Lee, E. Y. (2026) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2025.10.596 · Cited by 10
Prompt injection attacks on vision-language models for surgical decision support
Zhang, Z., Qadir, M. I., Carstens, M., Zhang, E. H., Loiselle, M. S., Martinus, F. M., Mroczkowski, M. K., Clusmann, J., Kather, J. N., & Kolbinger, F. R. (2026) · npj Digital Surgery · doi:10.1038/s44484-026-00014-6 · Cited by 4
Aksoy, S., Demircioğlu, P., & Böğrekçi, İ. (2025) · Cosmetics · doi:10.3390/cosmetics12050194 · Cited by 3
“Yan et al.’s PanDerm foundation model, pre-trained on over 2 million images, achieved state-of-the-art performance across 28 benchmarks, outperforming clinicians by 10.2% in early-stage melanoma detection [23].”
InfluentialMijares, J., Jairath, N. K., Zhang, A., & Que, S. K. T. (2025) · Diagnostics · doi:10.3390/diagnostics15212808 · Cited by 4
“This comprehensive diagnostic reasoning mirrors how experienced dermatologists approach challenging cases and provides substantial clinical value, as appropriate management can be initiated when the correct diagnosis category is recognized within the differential [14,15,24].”
Artificial intelligence in dermatology: Clinical promise and environmental impact
Shen, C. Z., Zhao, A. T., Rotemberg, V. M., Daneshjou, R., Parker, E. R., & Rosenbach, M. A. (2026) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2026.03.039 · Cited by 3
Hu, F., Shao, Y., Liu, J., Liu, J., Xiao, X., Shi, K., Zheng, Y., Zhang, J., & Wang, X. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1667087 · Cited by 7
Lee, K., Kao, Y.-C., Jiang, A., Prokofyeva, A., Tom, L. N., Jagirdar, K., Smit, D. J., Oey, H., Tan, J. M., Ainger, S. A., et al. (2025) · British Journal of Dermatology · doi:10.1093/bjd/ljaf412 · Cited by 7
Self-citationA General Framework for Efficient Medical Image Analysis via Shared Attention Vision Transformer
Liu, Y., Wen, Y., Yang, L., He, L., & Zhou, M. (2025) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2025.3644949 · Cited by 4
Self-citationErlei, A., Cau, F. M., Georgiev, R., Kumar, S. C., Bizer, K., & Gadiraju, U. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791420 · Cited by 7
Virtual reality sports to tackle pediatric obesity
Vidal‐Almela, S., Cadenas‐Sánchez, C., & Ortega, F. B. (2025) · Nature Medicine · doi:10.1038/s41591-025-03757-w · Cited by 1
Guersenzvaig, A., & Delgado, J. (2025) · Nursing and Health Sciences · doi:10.1111/nhs.70233 · Cited by 4
Cutting-edge AI technologies in skin cancer applications
Diao, Y., Chen, X., Huang, Z., Tan, Q., Yang, M., Yu, H., Xu, Y., & Hu, X. (2026) · Cancer Letters · doi:10.1016/j.canlet.2026.218256 · Cited by 2
Early detection of metastatic risk in primary cutaneous melanoma using weakly supervised learning
Dahlén, F., Shujski, I., Yacob, F., Häggström, I., Jovanovic, J., Dudina, O., Pölönen, I., & Neittaanmäki, N. (2026) · Scientific Reports · doi:10.1038/s41598-026-45588-w · Cited by 2
“Recent work has further demonstrated the potential of large-scale multimodal foundation models in dermatology, with Yan et al. 13 introducing a vision-based foundation model trained on diverse dermatological data that achieved strong performance across multiple clinical tasks, including skin disease classification and…”
InfluentialDevelopment and validation of the Oxford Attitudes to Artificial Intelligence in Medicine Scale
Kantor, J., Morrison, M., Ko, J., Semenov, Y. R., & Fortgang, R. G. (2026) · JAAD International · doi:10.1016/j.jdin.2026.04.005 · Cited by 2
Overview of State-of-the-Art Learning-Based Classification Methods in Medical Imaging
Nia, N. G., Manwar, R., & Avanaki, K. (2026) · Annals of Biomedical Engineering · doi:10.1007/s10439-026-04241-3 · Cited by 2
MerMED-FM: Multimodal, Multi-Disease Medical Imaging Foundation Model
Zhou, Y., Quek, C. W. N., Zhou, J., Wang, Y., Bai, Y., Gutiérrez, L., Ke, Y., Yao, J., Teo, Z. L., Ting, D. S. J., et al. (2026) · The Lancet Digital Health · doi:10.1016/j.landig.2026.101007 · Cited by 2
MCR-SL: A Multimodal, Context-Rich Skin Lesion Dataset for Skin Cancer Diagnosis
Castro-Fernández, M., Schopf, T. R., Castaño-González, I., Quintana, B. R., Kirchesch, H. M., Ortega, S., Fabelo, H. A., Godtliebsen, F., Granja, C., & Callicó, G. M. (2025) · Data · doi:10.3390/data10100166 · Cited by 3
Lallas, K., Tschandl, P., Kittler, H., Amaral, T. M. S., Kyrgidis, Α., Gatsis, A., Tseriotis, V., Vakirlis, E., Flatz, L., Leiter, U., et al. (2025) · EJC Skin Cancer · doi:10.1016/j.ejcskn.2025.100766 · Cited by 2
Self-citationA Novel High-Performance Deep-Learning-Based Approach for the Detection of Arsenic Poisoning
Moenks, N., Penava, P., & Buettner, R. (2025) · IEEE Access · doi:10.1109/access.2025.3646117 · Cited by 1
AI‐Assisted Bioelectronics for Personalized Health Management
Xiong, H., Dai, C., Chen, X., Kong, J., Wei, D., Fang, X., & Weng, W. (2026) · Advanced Electronic Materials · doi:10.1002/aelm.202500744 · Cited by 1
“In the era of digital healthcare, there has been an ever-lasting attempt to construct individual-centered healthcare systems for remote health monitoring, preventive medical care, long-term medical records, and user-friendly recovery support [ 1, 7, 30– 35 ].”
InfluentialScalable Containerized Deep Learning System for Automated Skin Cancer Detection
Eshwarappa, N. M., Hsu, P.-Y., Hsu, C., Hwang, R., Lin, P.-C., Chen, M., & Le, N. (2025) · International Conference on Artificial Intelligence for Medicine, Health and Care (AIxMHC) · doi:10.1109/aixmhc65380.2025.00016 · Cited by 1
“For example, PanDerm, a state-of-the-art multimodal vision foundation model, has demonstrated superior diagnostic performance in the early detection of melanoma leveraging a large-scale dermatological image dataset [7].”
Yao, J., Li, S., Liang, P., Xu, X., Elder, D. E., & Huang, Z. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02357-3 · Cited by 4
“To address these multimodal diagnostic requirements, vision-language models (VLMs) have emerged as a powerful solution in medical AI 31 – 33 .”
Shapiro, J., Greenfield, B., Cohen, I., Dodiuk‐Gad, R. P., Valdman‐Grinshpoun, Y., Freud, T., Lyakhovitsky, A., Khamaysi, Z., & Avitan‐Hersh, E. (2026) · Diagnostics · doi:10.3390/diagnostics16030384 · Cited by 1
“Building on this trajectory, large-scale multimodal foundation models trained specifically for dermatologic applications have recently demonstrated improved performance across multiple clinical tasks, underscoring the importance of task-specific training and structured inputs [11].”
Revolutionizing dermatopathology using AI in skin diagnostics: scoping review
Rammal, R., Mohy U Din, A., & Alam, T. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1614681 · Cited by 1
Blum, C., & Neidlin, M. (2026) · Cardiovascular Engineering and Technology · doi:10.1007/s13239-026-00828-y · Cited by 1
“In parallel, machine learning has achieved substantial success across biomedical engineering, particularly in image-based applications [13, 14] and in the prediction of clinical outcomes from large-scale patient datasets [15], where the availability of extensive training data has enabled highly…”
Mijares, J., Bisch, E. J., DeGuzman, E., Garg, K., Pontes, D. S., Jairath, N. K., Ramachandran, V., Jeha, G. M., Nemcevic, A., & Que, S. K. T. (2026) · Medicina · doi:10.3390/medicina62040715 · Cited by 1
“Even recent dermatology-specific foundation models, while demonstrating improved classification performance, remain limited to diagnostic labeling without integrated history collection or management plan generation [14,15].”
Limits of Artificial Intelligence Models for Skin Cancer Diagnosis in Realistic Settings
Anriot, J., Yan, S., Coste, C., Tschandl, P., Verlingue, L., Andremasse, C., Amini‐Adlé, M., Perrot, J., Ge, Z., Kittler, H., et al. (2026) · JAMA Dermatology · doi:10.1001/jamadermatol.2026.1492 · Cited by 2
Self-citationAhmmed, F., Antik, A. R., Mehnaj, S., et al. (2026) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2026.103499 · Cited by 1
Divergent impacts of explainable AI for dermatological diagnosis on clinicians versus lay people
Xu, X., Hu, H., Zhang, H., Wang, W. K., Wang, R., Soenksen, L. R., Badri, O., Jafry, S., Burger, E., Nwandu, L., et al. (2026) · Nature Medicine · doi:10.1038/s41591-026-04553-w · Cited by 8
“A highly deferential user might require an iterative explanation 56 or explicit prompts for the user ʼ s confidence before finalizing a diagnosis 57 or automatically trigger a workflow for a second human opinion when the AI ʼ s suggestion meaningfully alters an initial assessment 58 .”
Self-citationVollmer, A. S., Nazzaro, G., Winkler, J. K., Argenziano, G., Lallas, A., Kommoss, K. S., Blum, A., Stolz, W., Maronese, C. A., Giacalone, S., et al. (2026) · JDDG Journal der Deutschen Dermatologischen Gesellschaft · doi:10.1111/ddg.70409 · Cited by 1
Multi‐Modal AI Integrating Dermoscopy, Histopathology, and Genomic Data for Precision Dermatology
Goldust, M., & Grant-Kels, J. M. (2025) · International Journal of Dermatology · doi:10.1111/ijd.70075 · Cited by 1
Reply to ‘Risk stratification of cutaneous melanoma using deep learning on whole slide images’
Magnaterra, E., Venturi, F., Scotti, B., Baraldi, C., Vaccari, S., Alessandrini, A. M., & Dika, E. (2025) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.70092 · Cited by 1
Self-citationREECAP: Contrastive learning of retinal aging reveals genetic loci linking morphology to eye diseasePreprint
Shilova, L., Sens, D., Aliyeva, A., Chaudhary, S., Xu, Q., Salin, E., Schiefelbein, J. B., Asani, B., Amarie, O. V., Schneltzer, E., et al. (2025) · medRxiv · doi:10.1101/2025.11.19.25340555 · Cited by 2
Explainable AI as a Double-Edged Sword in Dermatology: The Impact on Clinicians versus The PublicPreprint
Xu, X., Hu, H., Zhang, H., Wang, W. K., Wang, R., Soenksen, L. R., Badri, O., Jafry, S., Burger, E., Nwandu, L., et al. (2025) · medRxiv · doi:10.64898/2025.12.19.25342205 · Cited by 1
Self-citationLi, L. Y., Lebiecka-Johansen, B., Byberg, S., Thambawita, V. L., & Hulmán, Á. (2026) · medRxiv · doi:10.64898/2026.04.17.26351092 · Cited by 1
Artificial Intelligence and Skin Disease Scoring: An Opportunity to Reset the Standards
Kittler, H. (2025) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2025.07.002
Self-citationThe unmet potential of patient context in melanoma AI : Addressing design and data biases
Wen, Y., & Zeng, S. (2025) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.70061
Beyond benchmarks: the promise of multimodal artificial intelligence in real-world dermatology
Liu, Z., Zhang, Y., Wang, K., Xie, F., & Liu, J. (2025) · British Journal of Dermatology · doi:10.1093/bjd/ljaf300
Vollmer, A. S., & Haenssle, H. A. (2025) · European Journal of Cancer · doi:10.1016/j.ejca.2025.116048
García, A., Zhou, J., Piñero-Crespo, G., Beachkofsky, T. M., & Huang, X. (2025) · Cancers · doi:10.3390/cancers17213447 · Cited by 7
“More recent architectures have maintained this trend: Yan et al. showed that their Vision Transformer-based model PanDerm outperformed clinicians by 10.2% in early melanoma detection and achieved diagnostic accuracy comparable to clinicians even without human assistance [21].”
InfluentialSpecial Issue on Artificial Intelligence in Dermatology: A Call for Collaborative Innovation
Kittler, H., Tschandl, P., Barata, C., Ge, Z., Halpern, A. C., Malvehy, J., & Argenziano, G. (2025) · Dermatology Practical & Conceptual · doi:10.5826/dpc.1504a7043
“While convolutional neural networks (CNNs) and image-based skin cancer diagnosis dominated the early stages of this development [3], recent advances point toward more general and versatile foundational models that can address a wide variety of downstream tasks beyond diagnosis [4, 5].”
Self-citationReasoning-Driven Anomaly Detection for Skin Disease Diagnosis via Chain of Vision
Truong, D., Huynh, T., & Sumanasena, V. (2025) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon58223.2025.11220990
“Another notable work, PanDerm [15], is pre-trained on 2 million clinical dermoscopy images from 11 institutions and has been shown to outperform dermatologists by 10 % on early-stage melanoma detection tasks.”
Weninger, W. (2025) · hautnah · doi:10.1007/s12326-025-00738-1
Kristensson, H., Nätterdahl, C., Persson, B., Saleh, K., Kappelin, J., Helkkula, T., Johansson, F. N. J., Palmgren, J., Lapins, J., Rados, N., et al. (2026) · Archives of Dermatological Research · doi:10.1007/s00403-025-04482-7
“The multimodal foundation model Pan - Derm outperformed both established deep learning models and human raters in most of 28 tasks tested, including skin cancer screening, longitudinal monitoring, and risk strati - fication [ 39 ].”
Efficient and Privacy-Preserving Inference for Medical Images via FHE-Enhanced Split Neural Networks
Lin, J., Li, S., Jiageng, C. H. E. N., et al. (2025) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm66473.2025.11356843
3D Venous Anatomy Analysis for Pancreatic Surgery Using Large Vision-Language Model
Zeng, Y., Wang, Y., Li, M., Ren, S., Li, J., Yuan, W., Meng, C., & Yuan, C. (2025) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm66473.2025.11356698 · Cited by 1
“Yan et al. [38] developed a large vision-language model for dermatology, which have strong performance across diverse imaging modalities and a wide range of clinical tasks.”
Deep Learning–Driven Multimodal Framework for Accurate Skin Cancer Classification
Rosi, A., Suresh, T., Hari Ramakrishnan., S., et al. (2025) · International Conference on Electronics, Communication and Aerospace Technology (ICECA) · doi:10.1109/iceca66444.2025.11382576
“Foundation models incorporating multimodality predict the future [6], [7] but are computationally heavy for most applications.”
Zhang, S., Yılmaz, A., Gençoğlan, G., & Temelkuran, B. (2026) · Diagnostics · doi:10.3390/diagnostics16040603 · Cited by 1
“Previous studies have demonstrated the feasibility of domain-adapted VLMs for generating clinically relevant narratives in dermatology [13,35,36].”
EfficientSkinTrans: Enhancing Dermatological Analysis Through a Hybrid ViT Network
Hoang, M. A., Phan, H. L. M., Vo, N. N., & Nguyen, K. V. (2026) · IEEE Annual Computing and Communication Workshop and Conference (CCWC) · doi:10.1109/ccwc67433.2026.11393864 · Cited by 1
“More recent Transformer-based medical imaging models demonstrated significant advances, with Med-Former [16] achieving strong generalization across multiple modalities, and PanDerm [17] setting a new clinical benchmark in dermatology by outperforming clinicians in early melanoma detection.”
Nand, S., Amjad, U., Raza, A., & Kumari, N. A. S. (2026) · Vietnam Journal of Computer Science · doi:10.1142/s2196888826500077
Cao, R., Zhu, Y., Zhao, H., Zhu, Z., Chen, L., Hu, Y., Ouyang, F., Zhao, N., Jiang, T., Li, Y., et al. (2026) · European Radiology · doi:10.1007/s00330-026-12409-7
Schuh, S., Schmidle, P., & Welzel, J. (2026) · Deutsche Dermatologie · doi:10.1007/s15011-026-7235-y
On the purpose of artificial intelligence in critical care medicine
Drudi, C., Matta, S. C., Lee, H., O’Donoghue, S. C., D’Couto, H. T., Hamza, A., Gutiérrez, C. A., Nakasi, R., Byers, J. T., Tumukunde, M., et al. (2026) · Journal of Translational Critical Care Medicine · doi:10.1097/jtccm-d-25-00021
George, A., Sai Rishi, R., & Kumar, K. D. (2025) · doi:10.1109/acoit66109.2025.11437273
“For clinical settings, [4] introduced PanDerm, a multimodal foundation model trained via self-supervised learning.”
Suresh, P., Keerthika, P., & Kumar, A. R. N. (2026) · Scientific Reports · doi:10.1038/s41598-026-47271-6 · Cited by 1
“However, the integration of clinical text into dermatological vision models, particularly through dynamic visual encoding mechanisms, has not been studied 8 .”
Vision–Language Models in Medical Imaging for Cancer Diagnosis: A Bibliometric Review
Wakili, M. A., Suleiman, A. B., Majikumna, K. U., Shehu, H. A., Kusetoğulları, H., & Sharif, M. H. (2026) · Bioengineering · doi:10.3390/bioengineering13040466 · Cited by 1
SKIN-PAS: Skin Lesion Segmentation Through Parameter-Efficient Adaptation of SAMv2
Moradi, M., Moradi, M., Palazzo, S., et al. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464586
Wang, Z., Fang, Y., & Li, Q. (2026) · Journal of Translational Medicine · doi:10.1186/s12967-026-08211-0 · Cited by 3
Self-citationMarini, N., Liang, Z., Rajaraman, S., Xue, Z., & Antani, S. (2026) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2026.105055 · Cited by 1
A model combining deep learning and ensemble learning for melanoma recognition via dermoscopy
Jiang, J., & Yang, S. (2026) · Frontiers in Oncology · doi:10.3389/fonc.2026.1782150
Zhang, R., Zhang, D., Xiong, C., & Chen, B. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6793372
Ovalle, V. M. S. M., Machore, M. A. A., Estudillo, V. L., & Hernandez, N. C. T. (2026) · Estudios y Perspectivas Revista Científica y Académica · doi:10.61384/r.c.a..v6i1.1881
Wang, Q., Wang, H., Yin, Z., Liu, C. Y., Yuan, X., & Li, Z. (2026) · Alexandria Engineering Journal · doi:10.1016/j.aej.2026.05.031
van, A. L. R., Song, A., Tang, A., & Verspoor, K. M. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-1462-4_38
Cheng, Y., Zhou, C., Wang, P., Liu, H., & Han, Y. (2026) · Global Health & Medicine · doi:10.35772/ghm.2026.01058
Şen, O. (2026) · Cutaneous and Ocular Toxicology · doi:10.1080/15569527.2026.2692370
“The general expectation in the literature is that adding visual data to clinical text will enhance diagnostic accuracy [9].”
Maciulevičius, M., Ragaišė, D., Raišutis, R., Šatkauskas, S., & Valiukevičienė, S. (2026) · Measurement · doi:10.1016/j.measurement.2026.122363
唐, 颖. (2026) · Advances in Clinical Medicine · doi:10.12677/acm.2026.1662467
Wang, X., Cao, X., Zeng, L., & Zhao, Y. (2026) · ACS Materials Letters · doi:10.1021/acsmaterialslett.6c00488
Developing a Dermatology-Specific Electronic Medical Record
Prodanovich, S. (2026) · Dermatologic Clinics · doi:10.1016/j.det.2026.05.002
Artificial intelligence in three-dimensional total-body photography for skin cancer surveillance
Lew, K. L., Sim, K. S., & Chan, W. T. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1882075
“However, these models still require validation on clinical workflow (14).”
InfluentialTowards a unified foundation model for medical imaging
Jin, K., & Grzybowski, A. E. (2026) · The Lancet Digital Health · doi:10.1016/j.landig.2026.101013
Vallée, A. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001610 · Cited by 1
“Recent empirical efforts in foundation models for healthcare further highlight both the promise and fragility of large-scale pretrained systems when deployed across institutions [2–4].”
Mijares, J., Gan, E., Jairath, N. K., Hamad, J., Alomari, A. K., Ramachandran, V., & Que, S. K. T. (2026) · Cancers · doi:10.3390/cancers18152524
“Despite these advances, many previous studies have only evaluated multimodal LLMs in the broad classification of the type of lesion [15–17].”
Use of Computer Vision with Conventional Video Recordings of Gait in Older Adults: A Scoping Review
Banarjee, C., Bilic, A., Kwon, Y. J., et al. (2026) · Healthcare · doi:10.3390/healthcare14162487
“It has been used to evaluate medical images, ranging from magnetic resonance imaging and computed tomography scans to images of retinas and skin lesions [2–5].”
Maghiar, L., Iftode, A., Maghiar, T.-A., Chioibaş, R., Grecu, T., Neamţu, C., Ioan, S. M., Dehelean, C.-A., Dumitrescu, C., & Neamțu, A.-A. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15166353
“…and exposure information that no clinician can synthesise unaided, supporting tasks that range from lesion classification to outcome prediction [123,124]; and for a field that must serve a diverse global workforce, the demonstration that such models can be engineered to perform more equitably…”
Nahm, W. J., Yin, E. S., Milam, E. C., & Weed, J. G. (2026) · JMIR Dermatology · doi:10.2196/94764
“…and longitudinal monitoring, PanDerm achieved state-of-the-art performance, often outperforming existing models with as little as 10% of labeled data, and improved nondermatologist health care professionals’ differential diagnosis by 16.5% across 128 skin conditions on clinical photographs [25].”
InfluentialPerez, D., Mohseni, Y., & Hartman, R. I. (2026) · Current Dermatology Reports · doi:10.1007/s13671-026-00498-y
“Some studies evalu - ated AI in settings that resembled real clinical use, such as longitudinal follow-up, clinician decision-support, or multimodal imaging workflows [27 , 31, 36, 47 ].”
InfluentialA Framework for Skin Cancer Classification using Ensemble Transfer Learning and Data Fusion
Aftab, S., Mubarik, T., & Saeed, M. A. (2026) · International Journal of Innovations in Science and Technology · doi:10.33411/ijist/1991
Yang, Z., Liu, Y., & Yang, H. (2026) · Chinese Medical Journal · doi:10.1097/cm9.0000000000004201
Ivanovic, N., Popa, M. F., Toma, A.-O., Pilut, C. N., Fericean, R. M., Crainic, D., Twakor, A. N., Serban, D.-V., Csiki, K. L., & Dumache, R. (2026) · Diagnostics · doi:10.3390/diagnostics16172797 · Cited by 1
“Looking forward, multimodal foundation models such as PanDerm (Yan et al. [73], trained across diverse dermatological image types, represent the next generation of broadly applicable AI in dermatology, while SkinGPT-4 (Zhou et al. [74]) demonstrates that pre-trained multimodal large language models…”
Shao, J., Liu, X., Zhang, Z., Liao, S., Wu, J., Yang, H., Zhao, Z., Wang, L., Liang, S.-F., Wang, X., et al. (2026) · Cell Reports Medicine · doi:10.1016/j.xcrm.2026.102926
MedCure: Medical Data Curation for Efficient Vision–Language Pretraining
Wang, C., Liu, F., Liu, Y., Chen, Y., Tian, Y., & Fang, L. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3730839
MENEGHELLO, L. P., Rosso, J., Naujorks, S., Ferreira, C. L. D. L., Soccol, K. L. S., Boza, J. C., Troncoso, M. P., & Zamberlan, C. (2026) · Dermato · doi:10.3390/dermato6030034
Song, E. G., Tang, E., Song, J., & de la Fuente‐Núñez, C. (2026) · doi:10.2196/preprints.112590
Wang, G., Bi, H., Zhang, Y., Wang, W., Zhu, Y., Wang, C., & Yang, X. (2026) · Diagnostics · doi:10.3390/diagnostics16193100
A Reproducible and Explainable Deep Learning Framework for Dermoscopic Image Analysis in Skin Cancer
Pınar, A., Yağın, F. H., Çolak, C., Yagin, B., Alzakari, S. A., Alkhalifa, A. K., & Tabnjh, A. K. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15197422
DermAgent: A Multi-tool Agentic System for Evidence-Grounded and Traceable Reasoning in Dermatology
Liu, Y., Yan, S., Hu, M., Ju, L., Li, X., Tang, F., Feng, W., & Ge, Z. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38062-3_16
Self-citationAdvanced optical microscopy for skin imaging: from confocal to novel techniques
Troyanova-Slavkova, S., Slavkov, D., Василев, П., & Troyanova, P. P. (2026) · Acta Dermatovenerologica Alpina Pannonica et Adriatica · doi:10.15570/actaapa.2026.34
Blüthgen, S., & Greis, C. (2026) · Dermatology Practical & Conceptual · doi:10.5826/dpc.160s1a7727
Multiclass Diagnosis of Facial Pigmented Lesions Using Dermatology Pretrained Foundation Models
Sicbaldi, M. (2026) · World Congress on Medical Physics and Biomedical Engineering, September 7 - 12, 2009, Munich, Germany · doi:10.1007/978-3-032-39674-7_28
An Inspectable Vision-Language and Convolutional Ensemble for Facial Pigmented Lesion Diagnosis
Zafeiriou, A., Kallipolitis, A., Τζιομάκα, Μ., & Maglogiannis, I. G. (2026) · World Congress on Medical Physics and Biomedical Engineering, September 7 - 12, 2009, Munich, Germany · doi:10.1007/978-3-032-39674-7_20
Metadata
- Authors
- Yan, S., Yu, Z., Primiero, C., Vico-Alonso, C., Wang, Z., Yang, L., Tschandl, P., Hu, M., Ju, L., Tan, G., Tang, V., Ng, A. B., Powell, D., Bonnington, P., See, S., Magnaterra, E., Ferguson, P., Nguyen, J., Guitera, P., Banuls, J., Janda, M., Mar, V., Kittler, H., Soyer, H. P., & Ge, Z.
- Affiliations
- Monash University (AU)
- The University of Queensland (AU)
- Medical University of Vienna (AT)
- Nvidia (United States) (US)
- University of Florence (IT)
- Royal Prince Alfred Hospital (AU)
- The Alfred Hospital (AU)
- Corresponding author
- Ge, Zongyuan
- ORCID
- Venue
- Nature Medicine
- Published
- 2025-06-06
- Volume
- 31
- Issue
- 8
- Pages
- 2691-2702
- ISSN
- 1078-8956 (ISSN-L)
- 1546-170X
- PMC
- PMC12353815
- OpenAlex
- W4411099958
- Semantic Scholar
- 38c437ccb98cda6fe3b7aa8a6351df8c87ea5472
- Cited by
- 117
- References
- 85
- Citations by year
- 2026: 85 · 2025: 32
- FWCI
- 48.05
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Nature Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Topics
- Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- multimodal foundation models, skin diseases, skin cancer diagnosis, melanoma detection, dermoscopy, self-supervised pre-training, differential diagnosis, lesion segmentation, long-term monitoring, metastasis prediction, clinical photographs, reader study, clinical implementation of AI
- MeSH terms
- Deep Learning, Dermatology, Diagnosis, Differential, Humans, Melanoma, Skin Diseases, Skin Neoplasms, Dermoscopy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review