CoChat

Human-computer collaboration for skin cancer recognition

Open access

The DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.

Abstract

The rapid increase in telemedicine coupled with recent advances in diagnostic artificial intelligence (AI) create the imperative to consider the opportunities and risks of inserting AI-based support into new paradigms of care. Here we build on recent achievements in the accuracy of image-based AI for skin cancer diagnosis to address the effects of varied representations of AI-based support across different levels of clinical expertise and multiple clinical workflows. We find that good quality AI-based support of clinical decision-making improves diagnostic accuracy over that of either AI or physicians alone, and that the least experienced clinicians gain the most from AI-based support. We further find that AI-based multiclass probabilities outperformed content-based image retrieval (CBIR) representations of AI in the mobile technology environment, and AI-based support had utility in simulations of second opinions and of telemedicine triage. In addition to demonstrating the potential benefits associated with good quality AI in the hands of non-expert clinicians, we find that faulty AI can mislead the entire spectrum of clinicians, including experts. Lastly, we show that insights derived from AI class-activation maps can inform improvements in human diagnosis. Together, our approach and findings offer a framework for future studies across the spectrum of image-based diagnostics to improve human-computer collaboration in clinical practice.

Overview

Integrity signals

Registry

Crossref · 10.1038/s41591-020-0942-0

Cites

44 of 44 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

The text we found for this paper looks like another document, so its claims and self-check weren’t run. The registry and citation checks still apply.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The text we found for this paper looks like another document, so the self-check wasn’t run.

Citations

Cites

Show all 44 references

Cited by

See all 1,024

Metadata

Authors
Tschandl, P., Rinner, C., Apalla, Z., Argenziano, G., Codella, N., Halpern, A., Janda, M., Lallas, A., Longo, C., Malvehy, J., Paoli, J., Puig, S., Rosendahl, C., Soyer, H. P., Zalaudek, I., & Kittler, H.
Affiliations
  • Medical University of Vienna (AT)
  • University of Campania "Luigi Vanvitelli" (IT)
  • IBM Research - Thomas J. Watson Research Center (US)
  • Memorial Sloan Kettering Cancer Center (US)
  • The University of Queensland (AU)
  • Aristotle University of Thessaloniki (GR)
  • University of Modena and Reggio Emilia (IT)
  • Instituto de Salud Carlos III (ES)
  • Sahlgrenska University Hospital (SE)
  • University of Trieste (IT)
Corresponding author
Kittler, Harald
Venue
Nature Medicine
Published
2020-06-22
Volume
26
Issue
8
Pages
1229-1234
ISSN
  • 1078-8956 (ISSN-L)
  • 1546-170X
OpenAlex
W3036298167
Cited by
1,024
References
45
Citations by year
2026: 220 · 2025: 245 · 2024: 171 · 2023: 141 · 2022: 110 · 2021: 121 · 2020: 15
FWCI
34.94
Type
journal article
Language
en
Open access
Licence
Locations
  • Nature Medicine (publishedVersion)
  • PubMed (publishedVersion)
  • ArTS Archivio della ricerca di Trieste (University of Trieste https://www.units.it/) (submittedVersion, other-oa)
  • Archivio Istituzionale della Ricerca - Università degli Studi della Campania "Luigi Vanvitelli" (submittedVersion)
  • IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion, cc-by)
Topics
  • Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
Keywords
skin cancer diagnosis, artificial intelligence in healthcare, human-computer collaboration, telemedicine, clinical decision support, diagnostic accuracy, clinician expertise, content-based image retrieval, second opinion, class activation maps, mobile health
MeSH terms
Clinical Decision-Making, Artificial Intelligence, Humans, Physicians, Skin Neoplasms, User-Computer Interface, Neural Networks, Computer, Telemedicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Human-computer collaboration for skin cancer recognition. https://app.cochat.ai/papers/10.1038/s41591-020-0942-0
The paper
Tschandl, P., Rinner, C., Apalla, Z., Argenziano, G., Codella, N., Halpern, A., Janda, M., Lallas, A., Longo, C., Malvehy, J., Paoli, J., Puig, S., Rosendahl, C., Soyer, H. P., Zalaudek, I., & Kittler, H. (2020). Human-computer collaboration for skin cancer recognition. Nature Medicine. https://doi.org/10.1038/s41591-020-0942-0

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.