Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 220Single-cell and spatial transcriptomicsGene expression and cancer classificationGenomics and Phylogenetic Studies

The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.

Systematic comparison of sequencing-based spatial transcriptomic methods

Open access

Published version of a preprint

Abstract

Recent developments of sequencing-based spatial transcriptomics (sST) have catalyzed important advancements by facilitating transcriptome-scale spatial gene expression measurement. Despite this progress, efforts to comprehensively benchmark different platforms are currently lacking. The extant variability across technologies and datasets poses challenges in formulating standardized evaluation metrics. In this study, we established a collection of reference tissues and regions characterized by well-defined histological architectures, and used them to generate data to compare 11 sST methods. We highlighted molecular diffusion as a variable parameter across different methods and tissues, significantly affecting the effective resolutions. Furthermore, we observed that spatial transcriptomic data demonstrate unique attributes beyond merely adding a spatial axis to single-cell data, including an enhanced ability to capture patterned rare cell states along with specific markers, albeit being influenced by multiple factors including sequencing depth and resolution. Our study assists biologists in sST platform selection, and helps foster a consensus on evaluation standards and establish a framework for future benchmarking efforts that can be used as a gold standard for the development and benchmarking of computational tools for spatial transcriptomic analysis.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41592-024-02325-3

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Overview of experimental design and data processing pipeline. a, The experimental design involved the use of reference tissues, with technologies categorized by the distinct spatial indexing strategies. b, The visualization of total counts across the spatial dimension for datasets generated using each platform for reference tissues is shown. The distances from center to center, used in creating the plot, are presented alongside the name of each sST method. Scale bars, 500 μm.
Fig. 1 Overview of experimental design and data processing pipeline. a, The experimental design involved the use of reference tissues, with technologies categorized by the distinct spatial indexing strategies. b, The visualization of total counts across the spatial dimension for datasets generated using each platform for reference tissues is shown. The distances from center to center, used in creating the plot, are presented alongside the name of each sST method. Scale bars, 500 μm.CC BY · PubMed Central
Fig. 2 Comparison of the sensitivity of data generated by different platforms. a, Schematic plot illustrating the extraction of regions with known morphology from fully processed samples of the adult mouse hippocampus and E12.5 mouse eye. Total UMI counts are presented as a function of stepwise downsampled sequencing depths for each platform. b,c, The data originate from mouse hippocampus (b) and E12.5 mouse eye (c) regions. A vertical dashed black line marks the read count used for generating the subsequent downsampled data. d, Total UMI counts were computed for selected regions using all reads and downsampled data for the mouse hippocampus. e, Total UMI counts for selected regions using all reads and downsampled data for the E12.5 mouse eye. f, The summed UMI counts for marker genes across individual 50 × 50 μm regions (n = 4) in the mouse hippocampus, along with mean and standard deviation. g, The summed UMI counts for marker genes across individual 50 × 50 μm regions (n = 4) in the E12.5 mouse eye, along with mean and standard deviation. h, Total UMI counts of detected genes are compared between Visium(polyA) (x axis) and Stereo-seq (y axis). Each dot represents a gene, shown in black. Genes that display expression at the 90th percentile with Stereo-seq but are at the tenth percentile in Visium(polyA) are highlighted in red and labeled with their gene symbols. i, A heatmap displays the log10-transformed expression of genes that are specifically not captured by Visium(polyA) but are captured by Stereo-seq for E12.5 mouse eyes.
Fig. 2 Comparison of the sensitivity of data generated by different platforms. a, Schematic plot illustrating the extraction of regions with known morphology from fully processed samples of the adult mouse hippocampus and E12.5 mouse eye. Total UMI counts are presented as a function of stepwise downsampled sequencing depths for each platform. b,c, The data originate from mouse hippocampus (b) and E12.5 mouse eye (c) regions. A vertical dashed black line marks the read count used for generating the subsequent downsampled data. d, Total UMI counts were computed for selected regions using all reads and downsampled data for the mouse hippocampus. e, Total UMI counts for selected regions using all reads and downsampled data for the E12.5 mouse eye. f, The summed UMI counts for marker genes across individual 50 × 50 μm regions (n = 4) in the mouse hippocampus, along with mean and standard deviation. g, The summed UMI counts for marker genes across individual 50 × 50 μm regions (n = 4) in the E12.5 mouse eye, along with mean and standard deviation. h, Total UMI counts of detected genes are compared between Visium(polyA) (x axis) and Stereo-seq (y axis). Each dot represents a gene, shown in black. Genes that display expression at the 90th percentile with Stereo-seq but are at the tenth percentile in Visium(polyA) are highlighted in red and labeled with their gene symbols. i, A heatmap displays the log10-transformed expression of genes that are specifically not captured by Visium(polyA) but are captured by Stereo-seq for E12.5 mouse eyes.CC BY · PubMed Central
Fig. 3 Comparison of diffusion of data generated by different platforms. a, Expression markers include Slc17a7 in the mouse olfactory bulb (left), Ptgds in the mouse brain (middle) and Pmel in the E12.5 eye (right). The plots are based on raw count values. Black boxes indicate the selected regions used for diffusion calculation. b, Expression levels of the aforementioned marker genes (from a) are aggregated for every 10 μm along 50 μm in the olfactory bulb, 500 μm in the brain and 300 μm in the eyes, as shown in a. UMI counts are averaged across modalities, normalized for each platform and presented in a density plot with the area under the curve set to 1 (details in Methods). c, Expression level of the marker genes as mentioned above (from a) within selected modalities are provided, with black dashed lines delineating the boundaries used for diffusion calculations. d, The left-width at half-maximum (LWHM) of the profile was then calculated for each gene (from a) in each modality and displayed in boxplots. Each dot represents the LWHM for a given modality (n = 6 for olfactory bulb and brain, n = 3 for eye). Modalities for which LWHM could not be calculated were removed. The box denotes the interquartile range, the range between the 25th and 75th percentile, with the median value; whiskers indicate the maximum and minimum value within 1.5 times the interquartile range.
Fig. 3 Comparison of diffusion of data generated by different platforms. a, Expression markers include Slc17a7 in the mouse olfactory bulb (left), Ptgds in the mouse brain (middle) and Pmel in the E12.5 eye (right). The plots are based on raw count values. Black boxes indicate the selected regions used for diffusion calculation. b, Expression levels of the aforementioned marker genes (from a) are aggregated for every 10 μm along 50 μm in the olfactory bulb, 500 μm in the brain and 300 μm in the eyes, as shown in a. UMI counts are averaged across modalities, normalized for each platform and presented in a density plot with the area under the curve set to 1 (details in Methods). c, Expression level of the marker genes as mentioned above (from a) within selected modalities are provided, with black dashed lines delineating the boundaries used for diffusion calculations. d, The left-width at half-maximum (LWHM) of the profile was then calculated for each gene (from a) in each modality and displayed in boxplots. Each dot represents the LWHM for a given modality (n = 6 for olfactory bulb and brain, n = 3 for eye). Modalities for which LWHM could not be calculated were removed. The box denotes the interquartile range, the range between the 25th and 75th percentile, with the median value; whiskers indicate the maximum and minimum value within 1.5 times the interquartile range.CC BY · PubMed Central
Fig. 4 Comparison on downstream performance. a, Expression profiles generated by each platform were processed to obtain clustering results. Known cell types and states are colored in the left-most panel. Additionally, a schematic plot represents the expected cell states, arranged from the outer space to inner space and from top to bottom. On the right-hand side, clustering results are presented, with spots color-coded by annotated cell states depicting the identifiable cell states. b, Clustering was conducted on downsampled eye data from each platform, with an equal total read count across platforms in the eye area. The correspondence between annotations obtained from clustering based on all reads and clustering based on downsampled data is visualized in a heatmap. The number of spots in this correspondence is presented after log10 transformation without scaling. c, An overview of cell states compared in the marker gene detection analysis, with pNR4 and pNR1 highlighted. d, Number of marker genes detected with different numbers of reads used for each sST method in the comparison between pNR4 and pNR1. e, An upset plot displays the intersection of marker genes obtained by different sST methods using all reads for the pNR4 and pNR1 comparison. Genes shared among all three platforms are denoted in blue, those shared between two platforms are in purple and uniquely obtained genes are represented in pink. f, The sST methods have been ranked based on their performance in the specified categories, with the highest-performing methods positioned at the top. Methods that offer resolution levels below 20 μm have been given higher preference. In the right panel, essential characteristics of the sST methods examined are outlined. Lower affordability indicates a higher price associated with the method. CM, corneal mesenchyme; pNR, presumptive neural retina; LV, lens vesicle; OB, olfactory bulb.
Fig. 4 Comparison on downstream performance. a, Expression profiles generated by each platform were processed to obtain clustering results. Known cell types and states are colored in the left-most panel. Additionally, a schematic plot represents the expected cell states, arranged from the outer space to inner space and from top to bottom. On the right-hand side, clustering results are presented, with spots color-coded by annotated cell states depicting the identifiable cell states. b, Clustering was conducted on downsampled eye data from each platform, with an equal total read count across platforms in the eye area. The correspondence between annotations obtained from clustering based on all reads and clustering based on downsampled data is visualized in a heatmap. The number of spots in this correspondence is presented after log10 transformation without scaling. c, An overview of cell states compared in the marker gene detection analysis, with pNR4 and pNR1 highlighted. d, Number of marker genes detected with different numbers of reads used for each sST method in the comparison between pNR4 and pNR1. e, An upset plot displays the intersection of marker genes obtained by different sST methods using all reads for the pNR4 and pNR1 comparison. Genes shared among all three platforms are denoted in blue, those shared between two platforms are in purple and uniquely obtained genes are represented in pink. f, The sST methods have been ranked based on their performance in the specified categories, with the highest-performing methods positioned at the top. Methods that offer resolution levels below 20 μm have been given higher preference. In the right panel, essential characteristics of the sST methods examined are outlined. Lower affordability indicates a higher price associated with the method. CM, corneal mesenchyme; pNR, presumptive neural retina; LV, lens vesicle; OB, olfactory bulb.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 46 references

Cited by

See all 220

Metadata

Authors
You, Y., Fu, Y., Li, L., Zhang, Z., Jia, S., Lu, S., Ren, W., Liu, Y., Xu, Y., Liu, X., Jiang, F., Peng, G., Sampath Kumar, A., Ritchie, M. E., Liu, X., & Tian, L.
Affiliations
  • Guangzhou Laboratory (CN)
  • Westlake University (CN)
  • The University of Melbourne (AU)
  • Chinese Academy of Sciences (CN)
Corresponding author
  • Liu, Xiaodong
  • Tian, Luyi
Venue
Nature Methods
Published
2024-07-04
Volume
21
Issue
9
Pages
1743-1754
ISSN
  • 1548-7091 (ISSN-L)
  • 1548-7105
OpenAlex
W4400324827
Cited by
220
References
46
Citations by year
2026: 102 · 2025: 96 · 2024: 22
FWCI
29.86
Type
journal article
Language
en
Open access
Licence
Locations
  • Nature Methods (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Minerva Access (University of Melbourne) (submittedVersion, cc-by)
Funders
National Natural Science Foundation of China (22DAA01467, 32370784)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
Keywords
spatial transcriptomics, benchmarking, platform comparison, molecular diffusion, spatial resolution, reference tissue, evaluation metrics, sequencing depth, platform selection
MeSH terms
Animals, Humans, Sequence Analysis, RNA, Computational Biology, Gene Expression Profiling, Mice, Single-Cell Analysis, High-Throughput Nucleotide Sequencing, Transcriptome

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Systematic comparison of sequencing-based spatial transcriptomic methods. https://app.cochat.ai/papers/10.1038/s41592-024-02325-3
The paper
You, Y., Fu, Y., Li, L., Zhang, Z., Jia, S., Lu, S., Ren, W., Liu, Y., Xu, Y., Liu, X., Jiang, F., Peng, G., Sampath Kumar, A., Ritchie, M. E., Liu, X., & Tian, L. (2024). Systematic comparison of sequencing-based spatial transcriptomic methods. Nature Methods. https://doi.org/10.1038/s41592-024-02325-3

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.