Innovative super-resolution in spatial transcriptomics: a transformer model exploiting histology images and spatial gene expression
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Spatial transcriptomics technologies have shed light on the complexities of tissue structures by accurately mapping spatial microenvironments. Nonetheless, a myriad of methods, especially those utilized in platforms like Visium, often relinquish spatial details owing to intrinsic resolution limitations. In response, we introduce TransformerST, an innovative, unsupervised model anchored in the Transformer architecture, which operates independently of references, thereby ensuring cost-efficiency by circumventing the need for single-cell RNA sequencing. TransformerST not only elevates Visium data from a multicellular level to a single-cell granularity but also showcases adaptability across diverse spatial transcriptomics platforms. By employing a vision transformer-based encoder, it discerns latent image-gene expression co-representations and is further enhanced by spatial correlations, derived from an adaptive graph Transformer module. The sophisticated cross-scale graph network, utilized in super-resolution, significantly boosts the model’s accuracy, unveiling complex structure–functional relationships within histology images. Empirical evaluations validate its adeptness in revealing tissue subtleties at the single-cell scale. Crucially, TransformerST adeptly navigates through image-gene co-representation, maximizing the synergistic utility of gene expression and histology images, thereby emerging as a pioneering tool in spatial transcriptomics. It not only enhances resolution to a single-cell level but also introduces a novel approach that optimally utilizes histology images alongside gene expression, providing a refined lens for investigating spatial transcriptomics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Visualization and analysis of gene expression in tissue sections by spatial transcriptomics
Ståhl, P. L., Salmén, F., Vickovic, S., Lundmark, A., Navarro, J. F., Magnusson, J., Giacomello, S., Asp, M., Westholm, J. O., Huss, M., et al. (2016) · Science · doi:10.1126/science.aaf2403 · Cited by 3,834 · cited 1×
“The in situ capturing-based approach forms the second category, comprising methods such as ST [10], SLIDE-seq [11], SLIDE-seqV2 [12], HDST [13] and 10x Visium.”
MethodSpatially resolved, highly multiplexed RNA profiling in single cells
Chen, K. H., Boettiger, A. N., Moffitt, J. R., Wang, S., & Zhuang, X. (2015) · Science · doi:10.1126/science.aaa6090 · Cited by 2,969 · cited 1×
“ST methods can be generally grouped into two main categories: methods based on fluorescence in situ hybridization or sequencing, such as seqFISH [3, 4], seqFISH + [5], MERFISH [6, 7], STARmap [8] and FISSEQ [9], have the capability to attain single-cell resolution.”
MethodSelf-citationSlide-seq: A scalable technology for measuring genome-wide expression at high spatial resolution
Rodriques, S. G., Stickels, R. R., Goeva, A., Martin, C. A., Murray, E., Vanderburg, C. R., Welch, J., Chen, L. M., Chen, F., & Macosko, E. Z. (2019) · Science · doi:10.1126/science.aaw1219 · Cited by 2,424
Spatiotemporal transcriptomic atlas of mouse organogenesis using DNA nanoball-patterned arrays
Chen, A., Liao, S., Cheng, M., Ma, K., Wu, L., Lai, Y., Qiu, X., Yang, J., Xu, J., Hao, S., et al. (2022) · Cell · doi:10.1016/j.cell.2022.04.003 · Cited by 1,784
Self-citationTranscriptome-scale super-resolved imaging in tissues by RNA seqFISH
Eng, C.-H. L., Lawson, M., Zhu, Q., Dries, R., Koulena, N., Takei, Y., Yun, J., Cronin, C., Karp, C., Yuan, G.-C., et al. (2019) · Nature · doi:10.1038/s41586-019-1049-y · Cited by 1,754 · cited 1×
“ST methods can be generally grouped into two main categories: methods based on fluorescence in situ hybridization or sequencing, such as seqFISH [3, 4], seqFISH + [5], MERFISH [6, 7], STARmap [8] and FISSEQ [9], have the capability to attain single-cell resolution.”
MethodThree-dimensional intact-tissue sequencing of single-cell transcriptional states
Wang, X., Allen, W. E., Wright, M. A., Sylwestrak, E. L., Samusik, N., Vesuna, S., Evans, K., Liu, C., Ramakrishnan, C., Liu, J., et al. (2018) · Science · doi:10.1126/science.aat5691 · Cited by 1,620
Self-citationRobust decomposition of cell type mixtures in spatial transcriptomics
Cable, D. M., Murray, E., Zou, L. S., Goeva, A., Macosko, E. Z., Chen, F., & Irizarry, R. A. (2022) · Nature Biotechnology · doi:10.1038/s41587-021-00830-w · Cited by 1,487 · cited 2×
“While the incorporation of scRNA-seq data is prevalent in deconvolution studies [ 17, 19, 43], it may introduce bias when single-cell measurements are not available for real-world applications.”
MethodMolecular, spatial, and functional single-cell profiling of the hypothalamic preoptic region
Moffitt, J. R., Bambah-Mukku, D., Eichhorn, S. W., Vaughn, E., Shekhar, K., Perez, J. D., Rubinstein, N. D., Hao, J., Regev, A., Dulac, C., et al. (2018) · Science · doi:10.1126/science.aau5324 · Cited by 1,365 · cited 1×
“ST methods can be generally grouped into two main categories: methods based on fluorescence in situ hybridization or sequencing, such as seqFISH [3, 4], seqFISH + [5], MERFISH [6, 7], STARmap [8] and FISSEQ [9], have the capability to attain single-cell resolution.”
MethodHighly sensitive spatial transcriptomics at near-cellular resolution with Slide-seqV2
Stickels, R. R., Murray, E., Kumar, P., Li, J., Marshall, J. L., Di Bella, D. J., Arlotta, P., Macosko, E. Z., & Chen, F. (2021) · Nature Biotechnology · doi:10.1038/s41587-020-0739-1 · Cited by 1,295
Cell2location maps fine-grained cell types in spatial transcriptomics
Kleshchevnikov, V., Shmatko, A., Dann, E., Aivazidis, A., King, H. W., Li, T., Elmentaite, R., Lomakin, A., Kedlian, V., Gayoso, A., et al. (2022) · Nature Biotechnology · doi:10.1038/s41587-021-01139-4 · Cited by 1,279
Transcriptome-scale spatial gene expression in the human dorsolateral prefrontal cortex
Maynard, K. R., Collado-Torres, L., Weber, L. M., Uytingco, C., Barry, B. K., Williams, S. R., Catallini, J. L., Tran, M. N., Besich, Z., Tippani, M., et al. (2021) · Nature Neuroscience · doi:10.1038/s41593-020-00787-0 · Cited by 1,222
High-definition spatial transcriptomics for in situ tissue profiling
Vickovic, S., Eraslan, G., Salmén, F., Klughammer, J., Stenbeck, L., Schapiro, D., Äijö, T., Bonneau, R., Bergenstråhle, L., Navarro, J. F., et al. (2019) · Nature Methods · doi:10.1038/s41592-019-0548-y · Cited by 1,150
Hu, J., Li, X., Coleman, K., Schroeder, A., Ma, N., Irwin, D. J., Lee, E. B., Shinohara, R. T., & Li, M. (2021) · Nature Methods · doi:10.1038/s41592-021-01255-8 · Cited by 1,113
A practical guide to single-cell RNA-sequencing for biomedical research and clinical applications
Haque, A., Engel, J., Teichmann, S. A., & Lönnberg, T. (2017) · Genome Medicine · doi:10.1186/s13073-017-0467-4 · Cited by 1,071
Moncada, R., Barkley, D., Wagner, F., Chiodin, M., Devlin, J. C., Baron, M., Hajdu, C. H., Simeone, D. M., & Yanai, I. (2020) · Nature Biotechnology · doi:10.1038/s41587-019-0392-8 · Cited by 1,045
Single-cell in situ RNA profiling by sequential hybridization
Lubeck, E., Coskun, A. F., Zhiyentayev, T., Ahmad, M., & Cai, L. (2014) · Nature Methods · doi:10.1038/nmeth.2892 · Cited by 985
Highly Multiplexed Subcellular RNA Sequencing in Situ
Lee, J. H., Daugharthy, E. R., Scheiman, J., Kalhor, R., Yang, J. L., Ferrante, T. C., Terry, R., Jeanty, S. S. F., Li, C., Amamoto, R., et al. (2014) · Science · doi:10.1126/science.1250212 · Cited by 973
Spatial Transcriptomics and In Situ Sequencing to Study Alzheimer’s Disease
Chen, W.-T., Lu, A., Craessaerts, K., Pavie, B., Sala Frigerio, C., Corthout, N., Qian, X., Laláková, J., Kühnemund, M., Voytyuk, I., et al. (2020) · Cell · doi:10.1016/j.cell.2020.06.038 · Cited by 949
Self-citationDong, K., & Zhang, S. (2022) · Nature Communications · doi:10.1038/s41467-022-29439-6 · Cited by 761
Shah, S., Lubeck, E., Zhou, W., & Cai, L. (2016) · Neuron · doi:10.1016/j.neuron.2016.10.001 · Cited by 671
The Human Cell Atlas: from vision to reality
Rozenblatt-Rosen, O., Stubbington, M. J. T., Regev, A., & Teichmann, S. A. (2017) · Nature · doi:10.1038/550451a · Cited by 638
The human body at cellular resolution: the NIH Human Biomolecular Atlas Program
HuBMAP Consortium, Writing Group, Snyder, M. P., Lin, S., Posgai, A., Atkinson, M., Regev, A., Rood, J., Rozenblatt-Rosen, O., Gaffney, L., et al. (2019) · Nature · doi:10.1038/s41586-019-1629-x · Cited by 595 · cited 1×
“Some deconvolution methods use public scRNAseq references such as Human Cell Atlas [24], BRAIN Initiative Cell Census Network (BICCN) [25] and Human BioMolecular Atlas [26] to solve the problem, but the batch effects and tissue heterogeneity in samples may result in incomplete cell types.”
MethodIntegrating spatial gene expression and breast tumour morphology via deep learning
He, B., Bergenstråhle, L., Stenbeck, L., Abid, A., Andersson, A., Borg, Å., Maaskola, J., Lundeberg, J., & Zou, J. (2020) · Nature Biomedical Engineering · doi:10.1038/s41551-020-0578-x · Cited by 507
CODA: quantitative 3D reconstruction of large tissues at cellular resolution
Kiemen, A. L., Braxton, A. M., Grahn, M. P., Han, K. S., Babu, J. M., Reichel, R., Jiang, A. C., Kim, B., Hsu, J., Amoa, F., et al. (2022) · Nature Methods · doi:10.1038/s41592-022-01650-9 · Cited by 218
Experimental Considerations for Single-Cell RNA Sequencing Approaches
Nguyen, Q. H., Pervolarakis, N., Nee, K., & Kessenbrock, K. (2018) · Frontiers in Cell and Developmental Biology · doi:10.3389/fcell.2018.00108 · Cited by 170
Cited by
Multimodal contrastive learning for spatial gene expression prediction using histology images
Min, W., Shi, Z., Zhang, J., Wan, J., & Wang, C. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae551 · Cited by 90
Generative Artificial Intelligence in Anatomic Pathology
Brodsky, V., Ullah, E., Bychkov, A., Song, A. H., Walk, E. E., Louis, P., Rasool, G., Singh, R. S., Mahmood, F., Bui, M. M., et al. (2025) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2024-0215-ra · Cited by 48
From tissue architecture to clinical insights: Spatial transcriptomics in solid tumor studies
Sharma, A., Raut, S. S., Shukla, A., Gupta, S., Mishra, A., & Singh, A. (2025) · Seminars in Oncology · doi:10.1016/j.seminoncol.2025.152389 · Cited by 29
Metadata
- Authors
- Zhao, C., Xu, Z., Wang, X., Tao, S., MacDonald, W. A., He, K., Poholek, A. C., Chen, K., Huang, H., & Chen, W.
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2024-01-22
- Volume
- 25
- Issue
- 2
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- OpenAlex
- W4392393203
- Cited by
- 43
- References
- 25
- FWCI
- 5.00
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.