conST: an interpretable multi-modal contrastive learning framework for spatial transcriptomics
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Motivation: Spatially resolved transcriptomics (SRT) shows its impressive power in yielding biological insights into neuroscience, disease study, and even plant biology. However, current methods do not sufficiently explore the expressiveness of the multi-modal SRT data, leaving a large room for improvement of performance. Moreover, the current deep learning based methods lack interpretability due to the “black box” nature, impeding its further applications in the areas that require explanation. Results: We propose conST, a powerful and flexible SRT data analysis framework utilizing contrastive learning techniques. conST can learn low-dimensional embeddings by effectively integrating multi-modal SRT data, i . e . gene expression, spatial information, and morphology (if applicable). The learned embeddings can be then used for various downstream tasks, including clustering, trajectory and pseudotime inference, cell-to-cell interaction, etc . Extensive experiments in various datasets have been conducted to demonstrate the effectiveness and robustness of the proposed conST, achieving up to 10% improvement in clustering ARI in the commonly used benchmark dataset. We also show that the learned embedding can be used in complicated scenarios, such as predicting cancer progression by analyzing the tumour microenvironment and cell-to-cell interaction (CCI) of breast cancer. Our framework is interpretable in that it is able to find the correlated spots that support the clustering, which matches the CCI interaction pairs as well, providing more confidence to clinicians when making clinical decisions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Integrated analysis of multimodal single-cell data
Hao, Y., Hao, S., Andersen-Nissen, E., Mauck, W. M., Zheng, S., Butler, A., Lee, M. J., Wilk, A. J., Darby, C., Zagar, M., et al. (2020) · doi:10.1101/2020.10.12.335331 · Cited by 15,508
From Louvain to Leiden: guaranteeing well-connected communities
Traag, V. A., Waltman, L., & van Eck, N. J. (2019) · Scientific Reports · doi:10.1038/s41598-019-41695-z · Cited by 5,635 · cited 1×
“For downstream tasks, Leiden algorithm (40) is used for clustering; Monocle3 (41) and PAGA (42) is utilized for trajectory inference and pseudo-time inference; we adopt a similar SVGs detection method as SpaGCN (18) with our own embedding; Cell-to-cell interaction is performed with TraSig (43) and Seurat (13) for labe…”
MethodThe single-cell transcriptional landscape of mammalian organogenesis
Cao, J., Spielmann, M., Qiu, X., Huang, X., Ibrahim, D. M., Hill, A. J., Zhang, F., Mundlos, S., Christiansen, L., Steemers, F. J., et al. (2019) · Nature · doi:10.1038/s41586-019-0969-x · Cited by 4,490 · cited 4×
“For downstream tasks, Leiden algorithm (40) is used for clustering; Monocle3 (41) and PAGA (42) is utilized for trajectory inference and pseudo-time inference; we adopt a similar SVGs detection method as SpaGCN (18) with our own embedding; Cell-to-cell interaction is performed with TraSig (43) and Seurat (13) for labe…”
MethodInfluentialVisualization and analysis of gene expression in tissue sections by spatial transcriptomics
Ståhl, P. L., Salmén, F., Vickovic, S., Lundmark, A., Navarro, J. F., Magnusson, J., Giacomello, S., Asp, M., Westholm, J. O., Huss, M., et al. (2016) · Science · doi:10.1126/science.aaf2403 · Cited by 3,834 · cited 1×
“Typical methods include ST (6), slide-seq (7), Slide-seqV2 (8), and 10x Genomics.”
MethodPerformance of neural network basecalling tools for Oxford Nanopore sequencing
Wick, R. R., Judd, L. M., & Holt, K. E. (2019) · Genome Biology · doi:10.1186/s13059-019-1727-y · Cited by 3,221
Spatially resolved, highly multiplexed RNA profiling in single cells
Chen, K. H., Boettiger, A. N., Moffitt, J. R., Wang, S., & Zhuang, X. (2015) · Science · doi:10.1126/science.aaa6090 · Cited by 2,969 · cited 10×
“In Figure ??, we compare the clustering performance of mouse hypothalamus MERFISH data with SpaGCN and SEDR.”
BackgroundMethodInfluentialCoudray, N., Ocampo, P. S., Sakellaropoulos, T., Narula, N., Snuderl, M., Fenyö, D., Moreira, A. L., Razavian, N., & Tsirigos, A. (2018) · Nature Medicine · doi:10.1038/s41591-018-0177-5 · Cited by 2,930 · cited 1×
“Besides, the rich information contained in histology images has been proven to be successful in revealing other important characterizations (24; 25).”
BackgroundSlide-seq: A scalable technology for measuring genome-wide expression at high spatial resolution
Rodriques, S. G., Stickels, R. R., Goeva, A., Martin, C. A., Murray, E., Vanderburg, C. R., Welch, J., Chen, L. M., Chen, F., & Macosko, E. Z. (2019) · Science · doi:10.1126/science.aaw1219 · Cited by 2,424
Cited by
Long, Y., Ang, K. S., Li, M., Chong, K. L. K., Sethi, R., Zhong, C., Xu, H., Ong, Z., Sachaphibulkij, K., Chen, A., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-36796-3 · Cited by 700
Zeng, Y., Wei, Z., Yu, W., Yin, R., Yuan, Y., Li, B., Tang, Z., Lu, Y., & Yang, Y. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac297 · Cited by 211
Graph neural networks for single-cell omics data: a review of approaches and applications
Li, S., Hua, H., & Chen, S. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf109 · Cited by 43
MCGAE: unraveling tumor invasion through integrated multimodal spatial transcriptomics
Yang, Y., Zhang, C., Liu, Z., Aihara, K., Zhang, C., Chen, L., & Wei, W. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae608 · Cited by 5
Metadata
- Authors
- Zong, Y., Yu, T., Wang, X., Wang, Y., Hu, Z., & Li, Y.
- Venue
- bioRxiv (Cold Spring Harbor Laboratory)
- Publisher
- openRxiv
- Published
- 2022-01-17
- OpenAlex
- W4206826076
- Cited by
- 108
- References
- 19
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: conST: an interpretable multi-modal contrastive learning framework for spatial transcriptomics. https://app.cochat.ai/papers/10.1101/2022.01.14.476408
- The paper
- Zong, Y., Yu, T., Wang, X., Wang, Y., Hu, Z., & Li, Y. (2022). conST: an interpretable multi-modal contrastive learning framework for spatial transcriptomics. bioRxiv (Cold Spring Harbor Laboratory). https://doi.org/10.1101/2022.01.14.476408
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.