Multi-domain translation between single-cell imaging and sequencing data using autoencoders
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
The development of single-cell methods for capturing different data modalities including imaging and sequencing has revolutionized our ability to identify heterogeneous cell states. Different data modalities provide different perspectives on a population of cells, and their integration is critical for studying cellular heterogeneity and its function. While various methods have been proposed to integrate different sequencing data modalities, coupling imaging and sequencing has been an open challenge. We here present an approach for integrating vastly different modalities by learning a probabilistic coupling between the different data modalities using autoencoders to map to a shared latent space. We validate this approach by integrating single-cell RNA-seq and chromatin images to identify distinct subpopulations of human naive CD4+ T-cells that are poised for activation. Collectively, our approach provides a framework to integrate and translate between data modalities that cannot yet be measured within the same cell for diverse applications in biomedical discovery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Comprehensive Integration of Single-Cell Data
Stuart, T., Butler, A., Hoffman, P., Hafemeister, C., Papalexi, E., Mauck, W. M., Hao, Y., Stoeckius, M., Smibert, P., & Satija, R. (2019) · Cell · doi:10.1016/j.cell.2019.05.031 · Cited by 15,453
Integrating single-cell transcriptomic data across different conditions, technologies, and species
Butler, A., Hoffman, P., Smibert, P., Papalexi, E., & Satija, R. (2018) · Nature Biotechnology · doi:10.1038/nbt.4096 · Cited by 13,174
Enrichr: interactive and collaborative HTML5 gene list enrichment analysis tool
Chen, E. Y., Tan, C. M., Kou, Y., Duan, Q., Wang, Z., Meirelles, G. V., Clark, N. R., & Ma’ayan, A. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-128 · Cited by 7,814
Massively parallel digital transcriptional profiling of single cells
Zheng, G. X. Y., Terry, J. M., Belgrader, P., Ryvkin, P., Bent, Z. W., Wilson, R., Ziraldo, S. B., Wheeler, T. D., McDermott, G. P., Zhu, J., et al. (2017) · Nature Communications · doi:10.1038/ncomms14049 · Cited by 7,353
Highly parallel genome-wide expression profiling of individual cells using nanoliter droplets.
Macosko, E. Z., Basu, A., Satija, R., Nemesh, J., Shekhar, K., Goldman, M., Tirosh, I., Bialas, A. R., Kamitaki, N., Martersteck, E. M., et al. (2015) · Cell · doi:10.1016/j.cell.2015.05.002 · Cited by 7,110
Visualization and analysis of gene expression in tissue sections by spatial transcriptomics
Ståhl, P. L., Salmén, F., Vickovic, S., Lundmark, A., Navarro, J. F., Magnusson, J., Giacomello, S., Asp, M., Westholm, J. O., Huss, M., et al. (2016) · Science · doi:10.1126/science.aaf2403 · Cited by 3,834
Droplet barcoding for single-cell transcriptomics applied to embryonic stem cells
Klein, A. M., Mazutis, L., Akartuna, I., Tallapragada, N., Veres, A., Li, V., Peshkin, L., Weitz, D. A., & Kirschner, M. W. (2015) · Cell · doi:10.1016/j.cell.2015.04.044 · Cited by 3,356
Deep generative modeling for single-cell transcriptomics
Lopez, R., Regier, J., Cole, M. B., Jordan, M. I., & Yosef, N. (2018) · Nature Methods · doi:10.1038/s41592-018-0229-2 · Cited by 2,530
Cited by
Methods and applications for single-cell and spatial multi-omics
Vandereyken, K., Sifrim, A., Thienpont, B., & Voet, T. (2023) · Nature Reviews Genetics · doi:10.1038/s41576-023-00580-2 · Cited by 1,244
Artificial intelligence for multimodal data integration in oncology
Lipkova, J., Chen, R. J., Chen, B., Lu, M. Y., Barbieri, M., Shao, D., Vaidya, A. J., Chen, C., Zhuang, L., Williamson, D. F. K., et al. (2022) · Cancer Cell · doi:10.1016/j.ccell.2022.09.012 · Cited by 777
Multi-omics single-cell data integration and regulatory inference with graph-linked embedding
Cao, Z.-J., & Gao, G. (2022) · Nature Biotechnology · doi:10.1038/s41587-022-01284-4 · Cited by 616
Spatial components of molecular tissue biology
Palla, G., Fischer, D. S., Regev, A., & Theis, F. J. (2022) · Nature Biotechnology · doi:10.1038/s41587-021-01182-1 · Cited by 327
scJoint integrates atlas-scale single-cell RNA-seq and ATAC-seq data with transfer learning
Lin, Y., Wu, T.-Y., Wan, S., Yang, J. Y. H., Wong, W. H., & Wang, Y. X. R. (2022) · Nature Biotechnology · doi:10.1038/s41587-021-01161-6 · Cited by 166
Multimodal data integration for oncology in the era of deep neural networks: a review
Waqas, A., Tripathi, A., Ramachandran, R. P., Stewart, P. A., & Rasool, G. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1408843 · Cited by 165
Prediction of single-cell RNA expression profiles in live cells by Raman microscopy with Raman2RNA
Kobayashi-Kirschvink, K. J., Comiter, C. S., Gaddam, S., Joren, T., Grody, E. I., Ounadjela, J. R., Zhang, K., Ge, B., Kang, J. W., Xavier, R. J., et al. (2024) · Nature Biotechnology · doi:10.1038/s41587-023-02082-2 · Cited by 93
Evaluating batch correction methods for image-based cell profiling
Arevalo, J., Su, E., van Dijk, R., Carpenter, A. E., & Singh, S. (2023) · doi:10.1101/2023.09.15.558001 · Cited by 89
ContIG: Self-supervised Multimodal Contrastive Learning for Medical Imaging with Genetics
Taleb, A., Kirchler, M., Monti, R., & Lippert, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.02024 · Cited by 83
Cross-modal autoencoder framework learns holistic representations of cardiovascular state
Radhakrishnan, A., Friedman, S. F., Khurshid, S., Ng, K., Batra, P., Lubitz, S. A., Philippakis, A. A., & Uhler, C. (2023) · Nature Communications · doi:10.1038/s41467-023-38125-0 · Cited by 82
“A line of recent works utilize autoencoders to learn joint representations of multi-modal data including natural images and captions in computer vision 14,22 – 27 , nuclear images and gene expression in biology 20 , and paired clinical measurements 28 – 31 .”
Self-citationOptimal transport for single-cell and spatial omics
Bunne, C., Schiebinger, G., Krause, A., Regev, A., & Cuturi, M. (2024) · Nature Reviews Methods Primers · doi:10.1038/s43586-024-00334-2 · Cited by 71
“Many approaches now utilize autoencoder to learn a common representation across dis - tinct data modalities, making it possible to compare and integrate data from different sources 151–153 .”
Doncevic, D., & Herrmann, C. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad387 · Cited by 51
A deep generative model of 3D single-cell organization
Donovan-Maiye, R. M., Brown, J. M., Chan, C. K., Ding, L., Yan, C., Gaudreault, N., Theriot, J. A., Maleckar, M. M., Knijnenburg, T. A., & Johnson, G. R. (2022) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1009155 · Cited by 44
Spatiotemporal multi-omics: exploring molecular landscapes in aging and regenerative medicine
Chu, L.-X., Wang, W.-J., Gu, X.-P., Wu, P., Gao, C., Zhang, Q., Wu, J., Jiang, D.-W., Huang, J.-Q., Ying, X.-W., et al. (2024) · Military Medical Research · doi:10.1186/s40779-024-00537-4 · Cited by 29
“…methods for multimodal analysis, tackling tasks such as joint group identification, cross-modal prediction, and cross-modal correlation discovery, these methodologies are typically tailored with a singular objective, posing challenges for their integration into a unified framework [284–287].”
MethodPrediction of protein subcellular localization in single cells
(2025) · doi:10.1038/s41592-025-02696-1 · Cited by 25
Metadata
- Authors
- Yang, K. D., Belyaeva, A., Venkatachalapathy, S., Damodaran, K., Katcoff, A., Radhakrishnan, A., Shivashankar, G. V., & Uhler, C.
- Venue
- Nature Communications
- Published
- 2021-01-04
- Volume
- 12
- Issue
- 1
- Pages
- 31-31
- ISSN
- 2041-1723 (ISSN-L)
- OpenAlex
- W3120224790
- Cited by
- 156
- References
- 18
- FWCI
- 7.31
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.