Benchmarking spatial clustering methods with spatially resolved transcriptomics data
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Matplotlib: a 2D graphics environment
Hunter, J. D. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.55 · Cited by 39,249
SciPy 1.0: fundamental algorithms for scientific computing in Python
Virtanen, P., Gommers, R., Oliphant, T. E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., et al. (2020) · Nature Methods · doi:10.1038/s41592-019-0686-2 · Cited by 38,430
Harris, C. R., Millman, K. J., van der Walt, S. J., Gommers, R., Virtanen, P., Cournapeau, D., Wieser, E., Taylor, J., Berg, S., Smith, N. J., et al. (2020) · Nature · doi:10.1038/s41586-020-2649-2 · Cited by 23,826
Fast, sensitive and accurate integration of single-cell data with Harmony
Korsunsky, I., Millard, N., Fan, J., Slowikowski, K., Zhang, F., Wei, K., Baglaenko, Y., Brenner, M., Loh, P.-R., & Raychaudhuri, S. (2019) · Nature Methods · doi:10.1038/s41592-019-0619-0 · Cited by 10,488
SciPy 1.0: fundamental algorithms for scientific computing in Python
Virtanen, P., Gommers, R., Oliphant, T. E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., et al. (2019) · Apollo - University of Cambridge Repository · doi:10.17863/cam.64134 · Cited by 10,460
SCANPY: large-scale single-cell gene expression data analysis
Wolf, F. A., Angerer, P., & Theis, F. J. (2018) · Genome Biology · doi:10.1186/s13059-017-1382-0 · Cited by 8,881 · cited 13×
“Leiden 33,34 is another nonspatial clustering algorithm that is similar to Louvain but can also merge similar communities to enhance clustering results further.”
Influentialseaborn: statistical data visualization
Waskom, M. (2021) · Journal of Open Source Software · doi:10.21105/joss.03021 · Cited by 7,310
From Louvain to Leiden: guaranteeing well-connected communities
Traag, V. A., Waltman, L., & van Eck, N. J. (2019) · Scientific Reports · doi:10.1038/s41598-019-41695-z · Cited by 5,635 · cited 13×
“Leiden 33,34 is another nonspatial clustering algorithm that is similar to Louvain but can also merge similar communities to enhance clustering results further.”
InfluentialSpatially resolved, highly multiplexed RNA profiling in single cells
Chen, K. H., Boettiger, A. N., Moffitt, J. R., Wang, S., & Zhuang, X. (2015) · Science · doi:10.1126/science.aaa6090 · Cited by 2,969 · cited 1×
“MERFISH is a highly utilized imaging-based spatially resolved transcrip-tomics (SRT) 7,29,49 technology, and its potential future applications may become more widespread due to commercialization.”
Spatiotemporal transcriptomic atlas of mouse organogenesis using DNA nanoball-patterned arrays
Chen, A., Liao, S., Cheng, M., Ma, K., Wu, L., Lai, Y., Qiu, X., Yang, J., Xu, J., Hao, S., et al. (2022) · Cell · doi:10.1016/j.cell.2022.04.003 · Cited by 1,784
Self-citationExploring tissue architecture using spatial transcriptomics
Rao, A., Barkley, D., França, G. S., & Yanai, I. (2021) · Nature · doi:10.1038/s41586-021-03634-9 · Cited by 1,700
A comparison of single-cell trajectory inference methods
Saelens, W., Cannoodt, R., Todorov, H., & Saeys, Y. (2019) · Nature Biotechnology · doi:10.1038/s41587-019-0071-9 · Cited by 1,670
Three-dimensional intact-tissue sequencing of single-cell transcriptional states
Wang, X., Allen, W. E., Wright, M. A., Sylwestrak, E. L., Samusik, N., Vesuna, S., Evans, K., Liu, C., Ramakrishnan, C., Liu, J., et al. (2018) · Science · doi:10.1126/science.aat5691 · Cited by 1,620
SC3: consensus clustering of single-cell RNA-seq data
Kiselev, V. Y., Kirschner, K., Schaub, M. T., Andrews, T., Yiu, A., Chandra, T., Natarajan, K. N., Reik, W., Barahona, M., Green, A. R., et al. (2017) · Nature Methods · doi:10.1038/nmeth.4236 · Cited by 1,500
Benchmarking atlas-level data integration in single-cell genomics
Luecken, M. D., Büttner, M., Chaichoompu, K., Danese, A., Interlandi, M., Mueller, M. F., Strobl, D. C., Zappia, L., Dugas, M., Colomé-Tatché, M., et al. (2022) · Nature Methods · doi:10.1038/s41592-021-01336-8 · Cited by 1,438 · cited 1×
“These metrics are frequently used in benchmark studies across various computational tasks, including single-cell data integration 57 , spatial transcriptomics data imputation or deconvolution 42 , and trajectory inference 58 .”
Molecular, spatial, and functional single-cell profiling of the hypothalamic preoptic region
Moffitt, J. R., Bambah-Mukku, D., Eichhorn, S. W., Vaughn, E., Shekhar, K., Perez, J. D., Rubinstein, N. D., Hao, J., Regev, A., Dulac, C., et al. (2018) · Science · doi:10.1126/science.aau5324 · Cited by 1,365 · cited 2×
“We analyzed a MERFISH dataset of the mouse hypothalamic preoptic region 50 , which contains five annotated slices with a median of 5,557 cells (Fig.”
Museum of spatial transcriptomics
Moses, L., & Pachter, L. (2022) · Nature Methods · doi:10.1038/s41592-022-01409-2 · Cited by 1,255 · cited 2×
“Of the existing spatial technologies, 10x Visium and MERFISH, which were both involved in this study, occupy a substantial portions of published datasets and will probably be more popular due to their commercialization 43 .”
Museum of Spatial Transcriptomics
Moses, L., & Pachter, L. (2021) · doi:10.1101/2021.05.11.443152 · Cited by 1,255
Transcriptome-scale spatial gene expression in the human dorsolateral prefrontal cortex
Maynard, K. R., Collado-Torres, L., Weber, L. M., Uytingco, C., Barry, B. K., Williams, S. R., Catallini, J. L., Tran, M. N., Besich, Z., Tippani, M., et al. (2021) · Nature Neuroscience · doi:10.1038/s41593-020-00787-0 · Cited by 1,222
Hu, J., Li, X., Coleman, K., Schroeder, A., Ma, N., Irwin, D. J., Lee, E. B., Shinohara, R. T., & Li, M. (2021) · Nature Methods · doi:10.1038/s41592-021-01255-8 · Cited by 1,113
Moncada, R., Barkley, D., Wagner, F., Chiodin, M., Devlin, J. C., Baron, M., Hajdu, C. H., Simeone, D. M., & Yanai, I. (2020) · Nature Biotechnology · doi:10.1038/s41587-019-0392-8 · Cited by 1,045 · cited 1×
“To cover this, we collected an additional 22 data from nonbrain tissues with smaller, noncontinuous tissue domains, including breast cancer 51 , liver 52 and pancreatic ductal adenocarcinoma 53 (Methods and Supplementary Table 1).”
Spatial proteogenomics reveals distinct and evolutionarily conserved hepatic macrophage niches
Guilliams, M., Bonnardel, J., Haest, B., Vanderborght, B., Wagner, C., Remmerie, A., Bujko, A., Martens, L., Thoné, T., Browaeys, R., et al. (2022) · Cell · doi:10.1016/j.cell.2021.12.018 · Cited by 985 · cited 1×
“To cover this, we collected an additional 22 data from nonbrain tissues with smaller, noncontinuous tissue domains, including breast cancer 51 , liver 52 and pancreatic ductal adenocarcinoma 53 (Methods and Supplementary Table 1).”
Dong, K., & Zhang, S. (2022) · Nature Communications · doi:10.1038/s41467-022-29439-6 · Cited by 761
Long, Y., Ang, K. S., Li, M., Chong, K. L. K., Sethi, R., Zhong, C., Xu, H., Ong, Z., Sachaphibulkij, K., Chen, A., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-36796-3 · Cited by 700 · cited 9×
“GraphST 41 is a method that utilizes a graph self-supervised comparative learning model for spatial clustering.”
InfluentialStatistical analysis of spatial expression patterns for spatially resolved transcriptomic studies
Sun, S., Zhu, J., & Zhou, X. (2020) · Nature Methods · doi:10.1038/s41592-019-0701-7 · Cited by 502
Spatially resolved cell atlas of the mouse primary motor cortex by MERFISH
Zhang, M., Eichhorn, S. W., Zingg, B., Yao, Z., Cotter, K., Zeng, H., Dong, H., & Zhuang, X. (2021) · Nature · doi:10.1038/s41586-021-03705-x · Cited by 498
Li, B., Zhang, W., Guo, C., Xu, H., Li, L., Fang, M., Hu, Y., Zhang, X., Yao, X., Tang, M., et al. (2022) · Nature Methods · doi:10.1038/s41592-022-01480-9 · Cited by 459 · cited 5×
“As suggested by previous benchmark studies 42 , the diversities of spatial technologies and computational methods are both necessary to achieve the primary goal of this work, which is to guide biologists in choosing optimal methods and developers in improving current state-of-the-art.”
InfluentialSelf-citationMolecular and spatial signatures of mouse brain aging at single-cell resolution
Allen, W. E., Blosser, T. R., Sullivan, Z. A., Dulac, C., & Zhuang, X. (2023) · Cell · doi:10.1016/j.cell.2022.12.010 · Cited by 423
The emerging landscape of spatial profiling technologies
Moffitt, J. R., Lundberg, E., & Heyn, H. (2022) · Nature Reviews Genetics · doi:10.1038/s41576-022-00515-3 · Cited by 419
Andersson, A., Larsson, L., Stenbeck, L., Salmén, F., Ehinger, A., Wu, S. Z., Al-Eryani, G., Roden, D., Swarbrick, A., Borg, Å., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-26271-2 · Cited by 404 · cited 2×
“42–51).”
Conservation and divergence of cortical cell organization in human and mouse revealed by MERFISH
Fang, R., Xia, C., Close, J. L., Zhang, M., He, J., Huang, Z., Halpern, A. R., Long, B., Miller, J. A., Lein, E. S., et al. (2022) · Science · doi:10.1126/science.abm1741 · Cited by 277 · cited 2×
“MERFISH is a highly utilized imaging-based spatially resolved transcrip-tomics (SRT) 7,29,49 technology, and its potential future applications may become more widespread due to commercialization.”
Zeng, H., Huang, J., Zhou, H., Meilandt, W. J., Dejanovic, B., Zhou, Y., Bohlen, C. J., Lee, S.-H., Ren, J., Liu, A., et al. (2023) · Nature Neuroscience · doi:10.1038/s41593-022-01251-x · Cited by 233
Single-cell spatial transcriptome reveals cell-type organization in the macaque cortex
Chen, A., Sun, Y., Lei, Y., Li, C., Liao, S., Meng, J., Bai, Y., Liu, Z., Liang, Z., Zhu, Z., et al. (2023) · Cell · doi:10.1016/j.cell.2023.06.009 · Cited by 232
Self-citationZhang, M., Eichhorn, S. W., Zingg, B., Yao, Z., Zeng, H., Dong, H., & Zhuang, X. (2020) · doi:10.1101/2020.06.04.105700 · Cited by 44
Fast and accurate metagenotyping of the human gut microbiome with GT-Pro
Shi, Z. J., Dimitrov, B., Zhao, C., Nayfach, S., & Pollard, K. S. (2022) · Nature Biotechnology · doi:10.1038/s41587-021-01102-3 · Cited by 42
Cited by
Benchmarking algorithms for generalizable single-cell perturbation response prediction
Wei, Z., Wang, Y., Gao, Y., Wang, S., Li, P., Si, D., Gao, Y., Wu, S., Li, D., Dong, K., et al. (2026) · Nature Methods · doi:10.1038/s41592-025-02980-0 · Cited by 42
Metadata
- Authors
- Yuan, Z., Zhao, F., Lin, S., Zhao, Y., Yao, J., Cui, Y., Zhang, X.-Y., & Zhao, Y.
- Venue
- Nature Methods
- Published
- 2024-03-15
- Volume
- 21
- Issue
- 4
- Pages
- 712-722
- ISSN
- 1548-7091 (ISSN-L)
- 1548-7105
- OpenAlex
- W4392868645
- Cited by
- 194
- References
- 35
- FWCI
- 22.54
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.