Discovery of molecular features underlying the morphological landscape by integrating spatial transcriptomic data with deep features of tissue images
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Profiling molecular features associated with the morphological landscape of tissue is crucial for investigating the structural and spatial patterns that underlie the biological function of tissues. In this study, we present a new method, spatial gene expression patterns by deep learning of tissue images (SPADE), to identify important genes associated with morphological contexts by combining spatial transcriptomic data with coregistered images. SPADE incorporates deep learning-derived image patterns with spatially resolved gene expression data to extract morphological context markers. Morphological features that correspond to spatial maps of the transcriptome were extracted by image patches surrounding each spot and were subsequently represented by image latent features. The molecular profiles correlated with the image latent features were identified. The extracted genes could be further analyzed to discover functional terms and exploited to extract clusters maintaining morphological contexts. We apply our approach to spatial transcriptomic data from different tissues, platforms and types of images to demonstrate an unbiased method that is capable of obtaining image-integrated gene expression trends.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
The Gene Ontology Resource: 20 years and still GOing strong
The Gene Ontology Consortium (2019) · Nucleic Acids Research · doi:10.1093/nar/gky1055 · Cited by 4,747
Hafemeister, C., & Satija, R. (2019) · Genome Biology · doi:10.1186/s13059-019-1874-1 · Cited by 4,479 · cited 1×
“5) was applied to normalize feature counts in each spot (19).”
MethodVisualization and analysis of gene expression in tissue sections by spatial transcriptomics
Ståhl, P. L., Salmén, F., Vickovic, S., Lundmark, A., Navarro, J. F., Magnusson, J., Giacomello, S., Asp, M., Westholm, J. O., Huss, M., et al. (2016) · Science · doi:10.1126/science.aaf2403 · Cited by 3,834
Performance of neural network basecalling tools for Oxford Nanopore sequencing
Wick, R. R., Judd, L. M., & Holt, K. E. (2019) · Genome Biology · doi:10.1186/s13059-019-1727-y · Cited by 3,221
Spatially resolved, highly multiplexed RNA profiling in single cells
Chen, K. H., Boettiger, A. N., Moffitt, J. R., Wang, S., & Zhuang, X. (2015) · Science · doi:10.1126/science.aaa6090 · Cited by 2,969
Slide-seq: A scalable technology for measuring genome-wide expression at high spatial resolution
Rodriques, S. G., Stickels, R. R., Goeva, A., Martin, C. A., Murray, E., Vanderburg, C. R., Welch, J., Chen, L. M., Chen, F., & Macosko, E. Z. (2019) · Science · doi:10.1126/science.aaw1219 · Cited by 2,424
Data-Driven Phenotypic Dissection of AML Reveals Progenitor-like Cells that Correlate with Prognosis
Levine, J. H., Simonds, E. F., Bendall, S. C., Davis, K. L., Amir, E.-A. D., Tadmor, M. D., Litvin, O., Fienberg, H. G., Jager, A., Zunder, E. R., et al. (2015) · Cell · doi:10.1016/j.cell.2015.05.047 · Cited by 2,303
The role of hypoxia in cancer progression, angiogenesis, metastasis, and resistance to therapy
Muz, B., de la Puente, P., Azab, F., & Azab, A. K. (2015) · Hypoxia · doi:10.2147/hp.s93413 · Cited by 2,066
No evidence that carotenoid pigments boost either immune or antioxidant defenses in a songbird
Koch, R. E., Kavazis, A. N., Hasselquist, D., Hood, W. R., Zhang, Y., Toomey, M. B., & Hill, G. E. (2018) · Nature Communications · doi:10.1038/s41467-018-02974-x · Cited by 1,924
Adult mouse cortical cell taxonomy revealed by single cell transcriptomics
Tasic, B., Menon, V., Nguyen, T. N., Kim, T. K., Jarsky, T., Yao, Z., Levi, B., Gray, L. T., Sorensen, S. A., Dolbeare, T., et al. (2016) · Nature Neuroscience · doi:10.1038/nn.4216 · Cited by 1,714
Three-dimensional intact-tissue sequencing of single-cell transcriptional states
Wang, X., Allen, W. E., Wright, M. A., Sylwestrak, E. L., Samusik, N., Vesuna, S., Evans, K., Liu, C., Ramakrishnan, C., Liu, J., et al. (2018) · Science · doi:10.1126/science.aat5691 · Cited by 1,620
Kang, H. M., Ahn, S. H., Choi, P., Ko, Y.-A., Han, S. H., Chinga, F., Park, A. S. D., Tao, J., Sharma, K., Pullman, J., et al. (2015) · Nature Medicine · doi:10.1038/nm.3762 · Cited by 1,555
Molecular, spatial, and functional single-cell profiling of the hypothalamic preoptic region
Moffitt, J. R., Bambah-Mukku, D., Eichhorn, S. W., Vaughn, E., Shekhar, K., Perez, J. D., Rubinstein, N. D., Hao, J., Regev, A., Dulac, C., et al. (2018) · Science · doi:10.1126/science.aau5324 · Cited by 1,365
Extracellular Matrix in the Tumor Microenvironment and Its Impact on Cancer Therapy
Henke, E., Nandigama, R., & Ergün, S. (2020) · Frontiers in Molecular Biosciences · doi:10.3389/fmolb.2019.00160 · Cited by 1,142
Single-cell in situ RNA profiling by sequential hybridization
Lubeck, E., Coskun, A. F., Zhiyentayev, T., Ahmad, M., & Cai, L. (2014) · Nature Methods · doi:10.1038/nmeth.2892 · Cited by 985
Spatial Transcriptomics and In Situ Sequencing to Study Alzheimer’s Disease
Chen, W.-T., Lu, A., Craessaerts, K., Pavie, B., Sala Frigerio, C., Corthout, N., Qian, X., Laláková, J., Kühnemund, M., Voytyuk, I., et al. (2020) · Cell · doi:10.1016/j.cell.2020.06.038 · Cited by 949
In situ sequencing for RNA analysis in preserved tissue and cells
Ke, R., Mignardi, M., Pacureanu, A., Svedlund, J., Botling, J., Wählby, C., & Nilsson, M. (2013) · Nature Methods · doi:10.1038/nmeth.2563 · Cited by 934
SpatialDE: identification of spatially variable genes
Svensson, V., Teichmann, S. A., & Stegle, O. (2018) · Nature Methods · doi:10.1038/nmeth.4636 · Cited by 695
Identification of cell types from single-cell transcriptomes using a novel clustering method
Xu, C., & Su, Z. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv088 · Cited by 559
Integrating spatial gene expression and breast tumour morphology via deep learning
He, B., Bergenstråhle, L., Stenbeck, L., Abid, A., Andersson, A., Borg, Å., Maaskola, J., Lundeberg, J., & Zou, J. (2020) · Nature Biomedical Engineering · doi:10.1038/s41551-020-0578-x · Cited by 507 · cited 1×
“Recently, a study extracted deep learningbased image features to predict spatial gene expression patterns (42).”
BackgroundStatistical analysis of spatial expression patterns for spatially resolved transcriptomic studies
Sun, S., Zhu, J., & Zhou, X. (2020) · Nature Methods · doi:10.1038/s41592-019-0701-7 · Cited by 502
Spatiotemporal single-cell analysis of gene expression in the mouse suprachiasmatic nucleus
Wen, S., Ma, D., Zhao, M., Xie, L., Wu, Q., Gou, L., Zhu, C., Fan, Y., Wang, H., & Yan, J. (2020) · Nature Neuroscience · doi:10.1038/s41593-020-0586-x · Cited by 328
Cited by
Novel research and future prospects of artificial intelligence in cancer diagnosis and treatment
Zhang, C., Xu, J., Tang, R., Yang, J., Wang, W., Yu, X., & Shi, S. (2023) · Journal of Hematology & Oncology · doi:10.1186/s13045-023-01514-5 · Cited by 148
Androvic, P., Schifferer, M., Perez Anderson, K., Cantuti-Castelvetri, L., Jiang, H., Ji, H., Liu, L., Gouna, G., Berghoff, S. A., Besson-Girard, S., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-39447-9 · Cited by 67
“While some studies have linked paired histological staining with lower-resolution ST methods 48,49 , these approaches are unable to detect single cells or their subcellular organization.”
BackgroundExplainable artificial intelligence for multi-modal cancer analysis: from genomics to immunology
Zhang, M., & Yin, L. (2026) · Critical Reviews in Oncology/Hematology · doi:10.1016/j.critrevonc.2025.105040 · Cited by 5
Metadata
- Authors
- Bae, S., Choi, H., & Lee, D. S.
- Venue
- Nucleic Acids Research
- Publisher
- Oxford University Press (OUP)
- Published
- 2021-02-22
- Volume
- 49
- Issue
- 10
- Pages
- e55-e55
- ISSN
- 0305-1048 (ISSN-L)
- 1362-4962
- OpenAlex
- W3131026189
- Cited by
- 48
- References
- 23
- FWCI
- 2.15
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.