Genetic mutation and biological pathway prediction based on whole slide images in breast carcinoma using deep learning
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Breast carcinoma is the most common cancer among women worldwide that consists of a heterogeneous group of subtype diseases. The whole-slide images (WSIs) can capture the cell-level heterogeneity, and are routinely used for cancer diagnosis by pathologists. However, key driver genetic mutations related to targeted therapies are identified by genomic analysis like high-throughput molecular profiling. In this study, we develop a deep-learning model to predict the genetic mutations and biological pathway activities directly from WSIs. Our study offers unique insights into WSI visual interactions between mutation and its related pathway, enabling a head-to-head comparison to reinforce our major findings. Using the histopathology images from the Genomic Data Commons Database, our model can predict the point mutations of six important genes (AUC 0.68–0.85) and copy number alteration of another six genes (AUC 0.69–0.79). Additionally, the trained models can predict the activities of three out of ten canonical pathways (AUC 0.65–0.79). Next, we visualized the weight maps of tumor tiles in WSI to understand the decision-making process of deep-learning models via a self-attention mechanism. We further validated our models on liver and lung cancers that are related to metastatic breast cancer. Our results provide insights into the association between pathological image features, molecular outcomes, and targeted therapies for breast cancer patients.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Self-Attention Generative Adversarial Networks
Zhang, H., Goodfellow, I., Metaxas, D., & Odena, A. (2018) · arXiv · doi:10.48550/arxiv.1805.08318 · Cited by 3,353
Self-citationOncogenic Signaling Pathways in The Cancer Genome Atlas
Sanchez-Vega, F., Mina, M., Armenia, J., Chatila, W. K., Luna, A., La, K. C., Dimitriadoy, S., Liu, D. L., Kantheti, H. S., Saghafinia, S., et al. (2018) · Cell · doi:10.1016/j.cell.2018.03.035 · Cited by 3,201 · cited 2×
“Several important signaling pathways have been identi fi ed as frequently and genetically altered in cancer 18 .”
BackgroundA Survey on Deep Transfer Learning
Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., & Liu, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01424-7_27 · Cited by 3,165
Coudray, N., Ocampo, P. S., Sakellaropoulos, T., Narula, N., Snuderl, M., Fenyö, D., Moreira, A. L., Razavian, N., & Tsirigos, A. (2018) · Nature Medicine · doi:10.1038/s41591-018-0177-5 · Cited by 2,930
Hoadley, K. A., Yau, C., Hinoue, T., Wolf, D. M., Lazar, A. J., Drill, E., Shen, R., Taylor, A. M., Cherniack, A. D., Thorsson, V., et al. (2018) · Cell · doi:10.1016/j.cell.2018.03.022 · Cited by 2,546 · cited 9×
“We did not fi ne-tune models for all possible gene pro fi les from TCGA, because the point mutation and CNA percentage of some genes are extremely low in lung or liver cancers.”
MethodInfluentialBreast cancer metastasis: markers and models
Weigelt, B., Peterse, J. L., & van't Veer, L. J. (2005) · Nature Reviews Cancer · doi:10.1038/nrc1670 · Cited by 2,232 · cited 1×
“We hypothesize that the models trained using breast cancer data can also predict important gene mutations and pathway activities in lung and liver cancers since they are two common sites for the breast cancer metastatic spread 34 .”
MethodSchulze, K., Imbeaud, S., Letouzé, E., Alexandrov, L. B., Calderaro, J., Rebouissou, S., Couchy, G., Meiller, C., Shinde, J., Soysouvanh, F., et al. (2015) · Nature Genetics · doi:10.1038/ng.3252 · Cited by 1,803
A Structured Self-attentive Sentence Embedding
Lin, Z., Feng, M., Santos, C. N. D., Yu, M., Xiang, B., Zhou, B., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.03130 · Cited by 1,743 · cited 1×
“Self-attention has been used successfully in a variety of tasks in natural language processing 46 – 48 and computer vision 49 to model relationships between widely separated spatial regions.”
MethodLong Short-Term Memory-Networks for Machine Reading
Cheng, J., Dong, L., & Lapata, M. (2016) · arXiv · doi:10.48550/arxiv.1601.06733 · Cited by 1,198
Cited by
Hoang, D.-T., Dinstag, G., Shulman, E. D., Hermida, L. C., Ben-Zvi, D. S., Elis, E., Caley, K., Sammut, S.-J., Sinha, S., Sinha, N., et al. (2024) · Nature Cancer · doi:10.1038/s43018-024-00793-2 · Cited by 157
Multi-modality artificial intelligence in digital pathology
Qiao, Y., Zhao, L., Luo, C., Luo, Y., Wu, Y., Li, S., Bu, D., & Zhao, Y. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac367 · Cited by 44
Giga-SSL: Self-Supervised Learning for Gigapixel Images
Lazard, T., Lerousseau, M., Decencière, E., & Walter, T. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00453 · Cited by 30
One label is all you need: Interpretable AI-enhanced histopathology for oncology
Tavolara, T. E., Su, Z., Gurcan, M. N., & Niazi, M. K. K. (2023) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2023.09.006 · Cited by 28
Beyond Medical Imaging - A Review of Multimodal Deep Learning in Radiology
Heiliger, L., Sekuboyina, A., Menze, B., Egger, J., & Kleesiek, J. (2022) · doi:10.36227/techrxiv.19103432 · Cited by 13
Metadata
- Authors
- Qu, H., Zhou, M., Yan, Z., Wang, H., Rustgi, V. K., Zhang, S., Gevaert, O., & Metaxas, D. N.
- Venue
- npj Precision Oncology
- Published
- 2021-09-23
- Volume
- 5
- Issue
- 1
- Pages
- 87-87
- ISSN
- 2397-768X (ISSN-L)
- OpenAlex
- W3201382058
- Cited by
- 117
- References
- 16
- FWCI
- 6.35
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Genetic mutation and biological pathway prediction based on whole slide images in breast carcinoma using deep learning. https://app.cochat.ai/papers/10.1038/s41698-021-00225-9
- The paper
- Qu, H., Zhou, M., Yan, Z., Wang, H., Rustgi, V. K., Zhang, S., Gevaert, O., & Metaxas, D. N. (2021). Genetic mutation and biological pathway prediction based on whole slide images in breast carcinoma using deep learning. npj Precision Oncology. https://doi.org/10.1038/s41698-021-00225-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.