Deep learned tissue “fingerprints” classify breast cancers by ER/PR/Her2 status from H&E images
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Because histologic types are subjective and difficult to reproduce between pathologists, tissue morphology often takes a back seat to molecular testing for the selection of breast cancer treatments. This work explores whether a deep-learning algorithm can learn objective histologic H&E features that predict the clinical subtypes of breast cancer, as assessed by immunostaining for estrogen, progesterone, and Her2 receptors (ER/PR/Her2). Translating deep learning to this and related problems in histopathology presents a challenge due to the lack of large, well-annotated data sets, which are typically required for the algorithms to learn statistically significant discriminatory patterns. To overcome this limitation, we introduce the concept of “tissue fingerprints,” which leverages large, unannotated datasets in a label-free manner to learn H&E features that can distinguish one patient from another. The hypothesis is that training the algorithm to learn the morphological differences between patients will implicitly teach it about the biologic variation between them. Following this training internship, we used the features the network learned, which we call “fingerprints,” to predict ER, PR, and Her2 status in two datasets. Despite the discovery dataset being relatively small by the standards of the machine learning community (n = 939), fingerprints enabled the determination of ER, PR, and Her2 status from whole slide H&E images with 0.89 AUC (ER), 0.81 AUC (PR), and 0.79 AUC (Her2) on a large, independent test set (n = 2531). Tissue fingerprints are concise but meaningful histopathologic image representations that capture biological information and may enable machine learning algorithms that go beyond the traditional ER/PR/Her2 clinical groupings by directly predicting theragnosis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Studies have even shown that morphological features captured by a hematoxylin and eosin (H&E) stain are predictive of molecular biomarkers utilized in theragnosis 85,89 .”
From Deep learning-enabled medical computer vision (2021) · cites this paper as [89]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
(2008) · Journal of Machine Learning Research · Cited by 33,051
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602 · cited 7×
“In experiments 3 and 4, we used the same datasets as before, but included a color normalization procedure based on neural style transfer 17,20 .”
MethodInfluentialAdvances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Comprehensive molecular portraits of human breast tumours
The Cancer Genome Atlas Network (2012) · Nature · doi:10.1038/nature11412 · Cited by 12,129 · cited 2×
“Once this training internship was accomplished, the features (fingerprints) were extracted from the pre-wired fingerprint network and used to classify between groups of tumors with biologically relevant molecular pathway annotations 12,13 .”
MethodHammond, M. E. H., Hayes, D. F., Dowsett, M., Allred, D. C., Hagerty, K. L., Badve, S., Fitzgibbons, P. L., Francis, G., Goldstein, N. S., Hayes, M., et al. (2010) · Journal of Clinical Oncology · doi:10.1200/jco.2009.25.6529 · Cited by 4,213
Ehteshami Bejnordi, B., Veta, M., Johannes van Diest, P., van Ginneken, B., Karssemeijer, N., Litjens, G., van der Laak, J. A. W. M., and the CAMELYON16 Consortium, Hermsen, M., Manson, Q. F., et al. (2017) · JAMA · doi:10.1001/jama.2017.14585 · Cited by 3,293
Coudray, N., Ocampo, P. S., Sakellaropoulos, T., Narula, N., Snuderl, M., Fenyö, D., Moreira, A. L., Razavian, N., & Tsirigos, A. (2018) · Nature Medicine · doi:10.1038/s41591-018-0177-5 · Cited by 2,930 · cited 1×
“…clinical workflows, our goal is to use DL to learn how morphology from hematoxylin and eosin (H&E) images can be used to predict biomarkers 7 , prognosis 8 and theragnosis—tasks which are not currently possible for a pathologist to do by eye, but if possible, could improve our…”
Method
Cited by
Deep learning-enabled medical computer vision
Esteva, A., Chou, K., Yeung, S., Naik, N., Madani, A., Mottaghi, A., Liu, Y., Topol, E., Dean, J., & Socher, R. (2021) · npj Digital Medicine · doi:10.1038/s41746-020-00376-2 · Cited by 1,406
Deep learning in histopathology: the path to the clinic
van der Laak, J., Litjens, G., & Ciompi, F. (2021) · Nature Medicine · doi:10.1038/s41591-021-01343-4 · Cited by 902
Breast cancer detection using artificial intelligence techniques: A systematic literature review
Nassif, A. B., Talib, M. A., Nasir, Q., Afadar, Y., & Elgendy, O. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2022.102276 · Cited by 334
Deep Learning Based Methods for Breast Cancer Diagnosis: A Systematic Review and Future Direction
Nasser, M., & Yusof, U. K. (2023) · Diagnostics · doi:10.3390/diagnostics13010161 · Cited by 222
Shamai, G., Livne, A., Polónia, A., Sabo, E., Cretu, A., Bar-Sela, G., & Kimmel, R. (2022) · Nature Communications · doi:10.1038/s41467-022-34275-9 · Cited by 193
Metadata
- Authors
- Rawat, R. R., Ortega, I., Roy, P., Sha, F., Shibata, D., Ruderman, D., & Agus, D. B.
- Affiliations
- University of Southern California (US)
- Corresponding author
- Ruderman, Daniel
- Venue
- Scientific Reports
- Published
- 2020-04-29
- Volume
- 10
- Issue
- 1
- Pages
- 7275-7275
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC7190637
- OpenAlex
- W3021500318
- Cited by
- 100
- References
- 35
- Citations by year
- 2026: 13 · 2025: 15 · 2024: 20 · 2023: 18 · 2022: 18 · 2021: 15 · 2020: 1
- FWCI
- 5.11
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Breast Cancer Research Foundation
- Oracle
- National Breast Cancer Foundation
- Cancer Institute NSW
- Medical Research Council
- National Health and Medical Research Council
- National Cancer Institute (U54CA217376)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Imaging for Blood Diseases
- Keywords
- breast cancer, H&E histopathology, deep learning, whole slide images, label-free learning, histologic features, molecular subtyping, theragnosis
- MeSH terms
- Deep Learning, Adult, Aged, Breast Neoplasms, Female, Humans, Image Processing, Computer-Assisted, Middle Aged, Progesterone, Receptors, Estrogen, Biomarkers, Tumor, Receptor, ErbB-2, Erb-b2 Receptor Tyrosine Kinases, Tissue Array Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Deep learned tissue “fingerprints” classify breast cancers by ER/PR/Her2 status from H&E images. https://app.cochat.ai/papers/10.1038/s41598-020-64156-4
- The paper
- Rawat, R. R., Ortega, I., Roy, P., Sha, F., Shibata, D., Ruderman, D., & Agus, D. B. (2020). Deep learned tissue “fingerprints” classify breast cancers by ER/PR/Her2 status from H&E images. Scientific Reports. https://doi.org/10.1038/s41598-020-64156-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.