The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Clinical-grade computational pathology using weakly supervised deep learning on whole slide images
Open accessAbstract
The development of decision support systems for pathology and their deployment in clinical practice have been hindered by the need for large manually annotated datasets. To overcome this problem, we present a multiple instance learning-based deep learning system that uses only the reported diagnoses as labels for training, thereby avoiding expensive and time-consuming pixel-wise manual annotations. We evaluated this framework at scale on a dataset of 44,732 whole slide images from 15,187 patients without any form of data curation. Tests on prostate cancer, basal cell carcinoma and breast cancer metastases to axillary lymph nodes resulted in areas under the curve above 0.98 for all cancer types. Its clinical application would allow pathologists to exclude 65-75% of slides while retaining 100% sensitivity. Our results show that this system has the ability to train accurate classification models at unprecedented scale, laying the foundation for the deployment of computational decision support systems in clinical practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prognostic and risk stratification systems estimate outcomes such as mortality, deterioration, readmission, or complications, supporting early intervention and clinical prioritisation [15,33].”
From Artificial Intelligence in Clinical Decision-Making: A Comprehensive Review of Diagnostic, Prognostic, and Therapeutic Applications, Validation Gaps, Bias, and Deployment Challenges (2026) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Large-scale experiments have shown that, although dependent on the tissue type and specific task, at least 10,000 WSIs are necessary for clinical-grade classification performance (Campanella et al, 2019), which is very difficult to achieve for rare diseases, such as MF.”
From Deep Learning–Based Classification of Early-Stage Mycosis Fungoides and Benign Inflammatory Dermatoses on H&E-Stained Whole-Slide Images: A Retrospective, Proof-of-Concept Study (2025) · cites this paper as Campanella et al, 2019
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, most importantly, the performance of DL-based models significantly improves with increasing numbers of patients included in the training dataset.”
From Deep Learning–Based Classification of Early-Stage Mycosis Fungoides and Benign Inflammatory Dermatoses on H&E-Stained Whole-Slide Images: A Retrospective, Proof-of-Concept Study (2025) · cites this paper as Campanella et al, 2019
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AI and machine learning techniques are indispensable for handling the high-dimensional data generated by digital pathology, multi-omics analyses, and clinical information [23].”
From A perspective on integrating digital pathology, proteomics, clinical data and AI analytics in cancer research (2025) · cites this paper as [23]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Digital pathology systems analyse whole-slide images to detect tumours and grade malignancies with reported high sensitivity in selected study settings [33,16].”
From Artificial Intelligence in Clinical Decision-Making: A Comprehensive Review of Diagnostic, Prognostic, and Therapeutic Applications, Validation Gaps, Bias, and Deployment Challenges (2026) · cites this paper as [33]
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Paige.ai has received breakthrough status from FDA for an AI-based algorithm that is capable of diagnose cancer in computational histopathology with great accuracy, allowing pathologist to gain time to focus on important slides (44).”
From Artificial Intelligence in Medicine: Today and Tomorrow (2020) · cites this paper as [44]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Advances in artificial intelligence (AI) are driving a revolution across science, enabling exciting new results across chemistry,80–82 biology,83,84 and medicine.85–88”
From Artificial Intelligence and Early Detection of Pancreatic Cancer: 2020 Summative Review (2021) · cites this paper as [86]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Forecasting capabilities enable planning for seasonal demand, public health emergencies, and fluctuations in elective procedures [33].”
From Artificial Intelligence in Clinical Decision-Making: A Comprehensive Review of Diagnostic, Prognostic, and Therapeutic Applications, Validation Gaps, Bias, and Deployment Challenges (2026) · cites this paper as [33]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“AI is also used to automate radiotherapy contouring and optimise dose distribution, improving consistency in treatment delivery [33,36].”
From Artificial Intelligence in Clinical Decision-Making: A Comprehensive Review of Diagnostic, Prognostic, and Therapeutic Applications, Validation Gaps, Bias, and Deployment Challenges (2026) · cites this paper as [33]
Experimental — accuracy not yet measuredIn the citing paper
“However, training robust AI systems requires large datasets for which data collection faces practical, ethical and legal obstacles.”
From Swarm learning for decentralized artificial intelligence in cancer histopathology (2022) · cites this paper as [19]
In the citing paper
“Previous work has shown that when the sample size is increased to approximately 10,000 patients, classifier performance will increase 19,20 .”
From Swarm learning for decentralized artificial intelligence in cancer histopathology (2022) · cites this paper as [19]
In the citing paper
“Using multiple-instance learning14,49,55 with labels at the level of groups of slides has enabled clinically relevant diagnostics by scaling to training datasets on the order of 10,000 WSIs10–14.”
From A foundation model for clinical-grade computational pathology and rare cancers detection (2024) · cites this paper as [14]
In the citing paper
“Campanella et al. (2019) train a weakly supervised segmentation model for whole slide histopathology images using only slide-level labels.”
From Embracing imperfect datasets: A review of deep learning solutions for medical image segmentation (2020) · cites this paper as Campanella et al. (2019)
In the citing paper
“They achieve a 1% increase in AUC when using the RNN classifier over just using the MIL approach directly.”
From Embracing imperfect datasets: A review of deep learning solutions for medical image segmentation (2020) · cites this paper as Campanella et al. (2019)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Wickham, H. (2016) · Use R! · doi:10.1007/978-3-319-24277-4 · Cited by 34,218
(2008) · Journal of Machine Learning Research · Cited by 33,051
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Siegel, R. L., Miller, K. D., & Jemal, A. (2016) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21332 · Cited by 16,003
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
pROC: an open-source package for R and S+ to analyze and compare ROC curves
Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J.-C., & Müller, M. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-77 · Cited by 13,697
(2017) · Cited by 11,625
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Ehteshami Bejnordi, B., Veta, M., Johannes van Diest, P., van Ginneken, B., Karssemeijer, N., Litjens, G., van der Laak, J. A. W. M., and the CAMELYON16 Consortium, Hermsen, M., Manson, Q. F., et al. (2017) · JAMA · doi:10.1001/jama.2017.14585 · Cited by 3,293
Coudray, N., Ocampo, P. S., Sakellaropoulos, T., Narula, N., Snuderl, M., Fenyö, D., Moreira, A. L., Razavian, N., & Tsirigos, A. (2018) · Nature Medicine · doi:10.1038/s41591-018-0177-5 · Cited by 2,930
Solving the multiple instance problem with axis-parallel rectangles
Dietterich, T. G., Lathrop, R. H., & Lozano-Pérez, T. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(96)00034-3 · Cited by 2,866
Clinically applicable deep learning for diagnosis and referral in retinal disease
De Fauw, J., Ledsam, J. R., Romera-Paredes, B., Nikolov, S., Tomasev, N., Blackwell, S., Askham, H., Glorot, X., O’Donoghue, B., Visentin, D., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0107-6 · Cited by 2,639
Incidence Estimate of Nonmelanoma Skin Cancer (Keratinocyte Carcinomas) in the US Population, 2012
Rogers, H. W., Weinstock, M. A., Feldman, S. R., & Coldiron, B. M. (2015) · JAMA Dermatology · doi:10.1001/jamadermatol.2015.1187 · Cited by 1,815
Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases
Janowczyk, A. R., & Madabhushi, A. (2016) · Journal of Pathology Informatics · doi:10.4103/2153-3539.186902 · Cited by 1,387
Predicting cancer outcomes from histology and genomics using convolutional networks
Mobadersany, P., Yousefi, S., Amgad, M., Gutman, D. A., Barnholtz-Sloan, J. S., Velázquez Vega, J. E., Brat, D. J., & Cooper, L. A. D. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1717139115 · Cited by 1,084
Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis
Litjens, G., Sánchez, C. I., Timofeeva, N., Hermsen, M., Nagtegaal, I., Kovacs, I., Hulsbergen - van de Kaa, C., Bult, P., van Ginneken, B., & van der Laak, J. (2016) · Scientific Reports · doi:10.1038/srep26286 · Cited by 1,069
Histologic grading of prostate cancer: A perspective
Gleason, D. F. (1992) · Human Pathology · doi:10.1016/0046-8177(92)90108-f · Cited by 1,050
Deep Learning for Identifying Metastatic Breast CancerPreprint
Wang, D., Khosla, A., Gargeya, R., Irshad, H., & Beck, A. H. (2016) · arXiv.org · doi:10.48550/arxiv.1606.05718 · Cited by 1,028
Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification
Hou, L., Samaras, D., Kurç, T., Gao, Y., Davis, J., & Saltz, J. H. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.266 · Cited by 921
Multiple Instance Boosting for Object Detection
Zhang, C., Platt, J. C., & Viola, P. A. (2005) · neural information processing systems · Cited by 687
Deep learning based tissue analysis predicts outcome in colorectal cancer
Bychkov, D., Linder, N., Turkki, R., Nordling, S., Kovanen, P. E., Verrill, C., Walliander, M., Lundin, M., Haglund, C., & Lundin, J. (2018) · Scientific Reports · doi:10.1038/s41598-018-21758-3 · Cited by 644
EM-DD: An Improved Multiple-Instance Learning Technique
Zhang, Q., & Goldman, S. A. (2001) · Cited by 626
OpenSlide: A vendor-neutral software foundation for digital pathology
Goode, A., Gilbert, B., Harkes, J., Jukic, D., & Satyanarayanan, M. (2013) · Journal of Pathology Informatics · doi:10.4103/2153-3539.119005 · Cited by 546
Detecting Cancer Metastases on Gigapixel Pathology Images
Liu, Y., Gadepalli, K., Norouzi, M., Dahl, G. E., Kohlberger, T., Boyko, A., Venugopalan, S., Timofeev, A., Nelson, P. Q., Corrado, G. S., et al. (2017) · arXiv · doi:10.48550/arxiv.1703.02442 · Cited by 506
Classifying and segmenting microscopy images with deep multiple instance learning
Kraus, O. Z., Ba, J. L., & Frey, B. J. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw252 · Cited by 418
Computational pathology: Challenges and promises for tissue analysis
Fuchs, T. J., & Buhmann, J. M. (2011) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2011.02.006 · Cited by 267
Self-citationBejnordi, B. E., Mullooly, M., Pfeiffer, R. M., Fan, S., Vacek, P. M., Weaver, D. L., Herschorn, S. D., Brinton, L. A., van Ginneken, B., Karssemeijer, N., et al. (2018) · Modern Pathology · doi:10.1038/s41379-018-0073-z · Cited by 219
Computational Pathology: A Path Ahead
Louis, D. N., Feldman, M. D., Carter, A. B., Dighe, A. S., Pfeifer, J. D., Bry, L., Almeida, J. S., Saltz, J., Braun, J., Tomaszewski, J. E., et al. (2015) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2015-0093-sa · Cited by 135
Olsen, T. G., Jackson, B. H., Feeser, T. A., Kent, M. N., Moad, J. C., Krishnamurthy, S., Lunsford, D. D., & Soans, R. E. (2018) · Journal of Pathology Informatics · doi:10.4103/jpi.jpi_31_18 · Cited by 119
Multiple instance learning with generalized support vector machines
Andrews, S. J., Hofmann, T. F., & Tsochantaridis, I. (2002) · National Conference on Artificial Intelligence · doi:10.5555/777092.777234 · Cited by 88
Fuchs, T. J., Wild, P. J., Moch, H., & Buhmann, J. M. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85990-1_1 · Cited by 64
Self-citationÖzdamar, S., Sarıkaya, S., Yıldız, L., Ati̇lla, M. K., Kandemır, B., & Yildiz, S. (1996) · International Urology and Nephrology · doi:10.1007/bf02550141 · Cited by 63
Das, K., Karri, S. P. K., Roy, A. G., Chatterjee, J., & Sheet, D. (2017) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2017.7950690 · Cited by 56
Metastasis detection from whole slide images using local features and random forests
Valkonen, M., Kartasalo, K., Liimatainen, K., Nykter, M., Latonen, L., & Ruusuvuori, P. (2017) · Cytometry Part A · doi:10.1002/cyto.a.23089 · Cited by 51
PROSTATIC CARCINOMA REPRODUCIBILITY OF HISTOLOGIC GRADING
Svanholm, H., & Mygind, H. (1985) · Acta Pathologica Microbiologica Scandinavica Series A Pathology · doi:10.1111/j.1699-0463.1985.tb03921.x · Cited by 41
Yu, Y., Cui, N., Li, H., et al. (2016) · BMC Cancer · doi:10.1186/s12885-016-2829-5 · Cited by 23
A note from history: microscopic contributions of pioneer pathologists.
Hajdu, S. I. (2011) · PubMed · Cited by 10
A note on invariant finitely additive measures
Dani, S. G. (1985) · Proceedings of the American Mathematical Society · doi:10.1090/s0002-9939-1985-0766529-3 · Cited by 6
Research works printed but not linked: 3
- Ball, C. S. The early history of the compound microscope. Bios 37, 51–60 (1966).
- Hajdu, S. I. Microscopic contributions of pioneer pathologists. Ann. Clin. Lab. Sci. 41, 201–206 (2011).
- LeBoit, P. E. et al. Pathology and Genetics of Skin Tumours (IARC Press, 2006).
Cited by
Sorted by citations
Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212
Data-efficient and weakly supervised computational pathology on whole-slide images
Lu, M. Y., Williamson, D. F. K., Chen, T. Y., Chen, R. J., Barbieri, M., & Mahmood, F. (2021) · Nature Biomedical Engineering · doi:10.1038/s41551-020-00682-w · Cited by 2,282
Towards a general-purpose foundation model for computational pathology
Chen, R. J., Ding, T., Lu, M. Y., Williamson, D. F. K., Jaume, G., Song, A. H., Chen, B., Zhang, A., Shao, D., Shaban, M., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-02857-3 · Cited by 1,560
Deep learning-enabled medical computer vision
Esteva, A., Chou, K., Yeung, S., Naik, N., Madani, A., Mottaghi, A., Liu, Y., Topol, E., Dean, J., & Socher, R. (2021) · npj Digital Medicine · doi:10.1038/s41746-020-00376-2 · Cited by 1,406
Embracing imperfect datasets: A review of deep learning solutions for medical image segmentation
Tajbakhsh, N., Jeyaseelan, L., Li, Q., Chiang, J. N., Wu, Z., & Ding, X. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101693 · Cited by 1,095
“Campanella et al. (2019) train a weakly supervised segmentation model for whole slide histopathology images”
Background
Metadata
- Authors
- Campanella, G., Hanna, M. G., Geneslaw, L., Miraflor, A., Werneck Krauss Silva, V., Busam, K. J., Brogi, E., Reuter, V. E., Klimstra, D. S., & Fuchs, T. J.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- Corresponding author
- Fuchs, Thomas J.
- ORCID
- Venue
- Nature Medicine
- Published
- 2019-07-15
- Volume
- 25
- Issue
- 8
- Pages
- 1301-1309
- ISSN
- 1078-8956 (ISSN-L)
- 1546-170X
- PMC
- PMC7418463
- OpenAlex
- W2956228567
- Cited by
- 2,799
- References
- 44
- Citations by year
- 2026: 585 · 2025: 457 · 2024: 435 · 2023: 400 · 2022: 366 · 2021: 304 · 2020: 216 · 2019: 29
- FWCI
- 104.81
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Nature Medicine (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Cancer Institute (P30CA008748)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- computational pathology, weakly supervised learning, multiple instance learning, whole slide images, cancer diagnosis, prostate cancer, basal cell carcinoma, breast cancer metastasis, axillary lymph nodes, decision support system, annotation-free training, clinical implementation
- MeSH terms
- Deep Learning, Breast Neoplasms, Carcinoma, Basal Cell, Basal Cell Carcinoma, Female, Humans, Male, Prostatic Neoplasms, Decision Support Systems, Clinical, Neoplasm Grading
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
