Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
PreprintCited by 162

The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.

Universal Cell Embeddings: A Foundation Model for Cell Biology

Open access
Rosen, Yanay, Roohani, Yusuf, Agrawal, Ayush, Samotorcan, Leon, Consortium, Tabula Sapiens, Quake, Stephen R., Leskovec, Jure · 2023 · bioRxiv (Cold Spring Harbor Laboratory)

Abstract

Developing a universal representation of cells which encompasses the tremendous molecular diversity of cell types within the human body and more generally, across species, would be transformative for cell biology. Recent work using single-cell transcriptomic approaches to create molecular definitions of cell types in the form of cell atlases has provided the necessary data for such an endeavor. Here, we present the Universal Cell Embedding (UCE) foundation model. UCE was trained on a corpus of cell atlas data from human and other species in a completely self-supervised way without any data annotations. UCE offers a unified biological latent space that can represent any cell, regardless of tissue or species. This universal cell embedding captures important biological variation despite the presence of experimental noise across diverse datasets. An important aspect of UCE's universality is that any new cell from any organism can be mapped to this embedding space with no additional data labeling, model training or fine-tuning. We applied UCE to create the Integrated Mega-scale Atlas, embedding 36 million cells, with more than 1,000 uniquely named cell types, from hundreds of experiments, dozens of tissues and eight species. We uncovered new insights about the organization of cell types and tissues within this universal cell embedding space, and leveraged it to infer function of newly discovered cell types. UCE's embedding space exhibits emergent behavior, uncovering new biology that it was never explicitly trained for, such as identifying developmental lineages and embedding data from novel species not included in the training set. Overall, by enabling a universal representation for every cell state and type, UCE provides a valuable tool for analysis, annotation and hypothesis generation as the scale and diversity of single cell datasets continues to grow.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1101/2023.11.28.568918

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 10 references

Research works printed but not linked: 42

  1. 10.1038/s41586-022-04506-6 · DOI · Paper page
  2. 10.1146/annurev.physchem.48.1.545 · DOI · Paper page
  3. 10.1038/nrg.2016.98 · DOI · Paper page
  4. 10.1038/nature13173 · DOI · Paper page
  5. Waddington, C. H . The strategy of the genes (Routledge, 1957).
  6. 10.1038/nature21350 · DOI · Paper page
  7. 10.1126/science.aaq1723 · DOI · Paper page
  8. 10.1126/SCIENCE.ABL4896/SUPPL_FILE/SCIENCE.ABL4896_MDAR_REPRODUCIBILITY_CHECKLIST.PDF · doi:10.1126/science.abl4896/suppl_file/science.abl4896_mdar_reproducibility_checklist.pdf
  9. 2023, Transcriptomic diversity of cell types across the adult human brain, Science, 382, eadd7046, 10.1126/science.add7046 · DOI · Paper page
  10. 10.1126/science.abk2432 · DOI · Paper page
  11. 2021, Computational principles and challenges in single-cell data integration, Nature biotechnology, 39, 1202, 10.1038/s41587-021-00895-7 · DOI · Paper page
  12. 10.7554/elife.66747 · DOI · Paper page
  13. 2020, Language models are few-shot learners, Advances in neural information processing systems, 33, 1877
  14. Anil, R. , et al. Palm 2 technical report. arXiv preprint arXiv:2305.10403 (2023). · arXiv
  15. Touvron, H. et al. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023). · arXiv
  16. Kirillov, A. , et al. Segment anything. arXiv preprint arXiv:2304.02643 (2023). · arXiv
  17. Bommasani, R. , et al. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258 (2021). · arXiv
  18. 2021, Effective gene expression prediction from sequence by integrating long-range interactions, Nature methods, 18, 1196, 10.1038/s41592-021-01252-x · DOI · Paper page
  19. 10.1038/nrg3833 · DOI · Paper page
  20. 2021, The cell as a bag of rna, Trends in Genetics, 37, 1064, 10.1016/j.tig.2021.08.003 · DOI
  21. Vaswani, A. et al. Attention is all you need. Advances in neural information processing systems 30 (2017).
  22. 10.1126/science.ade2574 · doi:10.1126/science.ade2574 · Paper page
  23. Rosen, Y. , et al. Towards universal cell embeddings: Integrating single-cell rna-seq datasets across species with saturn. bioRxiv (2023). · doi:10.1101/2023.02.03.526939
  24. Devlin, J. , Chang, M.-W. , Lee, K. & Toutanova, K . Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018). · arXiv
  25. Biology, C. S.-C. et al. Cz cellxgene discover: A single-cell data platform for scalable exploration, analysis and modeling of aggregated data. bioRxiv 2023–10 (2023).
  26. 10.1111/imr.12223 · DOI · Paper page
  27. 10.1126/science.abl5197 · DOI · Paper page
  28. 10.1126/scitranslmed.abe8146 · DOI · Paper page
  29. 10.1371/journal.pbio.3000528 · DOI
  30. 10.7554/eLife.63907 · DOI
  31. 2021, Spatiotemporal single-cell rna sequencing of developing chicken hearts identifies interplay between cellular differentiation and morphogenesis, Nature communications, 12, 1771, 10.1038/s41467-021-21892-z · DOI · Paper page
  32. 10.1186/gb-2005-6-8-229 · DOI
  33. 2021, Cytoprotective effects of erythropoietin: What about the lung?, Biomedicine & Pharmacotherapy, 139, 111547, 10.1016/j.biopha.2021.111547 · DOI
  34. 10.1126/sciadv.aba1983 · DOI · Paper page
  35. 10.1053/rmed.2001.1070 · doi:10.1053/rmed.2001.1070
  36. 2020, Erythropoietin: role in idiopathic pulmonary fibrosis revisited, The Egyptian Journal of Chest Diseases and Tuberculosis, 69, 716, 10.4103/ejcdt.ejcdt_29_20 · doi:10.4103/ejcdt.ejcdt_29_20
  37. 10.1016/j.rmed.2004.04.002 · doi:10.1016/j.rmed.2004.04.002
  38. Safran, M. et al. The GeneCards suite. In Abugessaisa, I . & Kasukawa, T. (eds.) Practical guide to life science databases, 27–56 (Springer Singapore, Singapore, 2021). · DOI · Paper page
  39. 2016, The genecards suite: from gene data mining to disease genome sequence analyses, Current Protocols in Bioinformatics, 54, 1.30.1
  40. 2023, The status of the human gene catalogue, Nature, 622, 41, 10.1038/s41586-023-06490-x · DOI · Paper page
  41. 10.1002/cbic.200300625 · DOI
  42. 10.1186/s13059-017-1382-0 · DOI · Paper page

Cited by

See all 162

Metadata

Authors
Rosen, Y., Roohani, Y., Agrawal, A., Samotorcan, L., Consortium, T. S., Quake, S. R., & Leskovec, J.
Venue
bioRxiv (Cold Spring Harbor Laboratory)
Publisher
openRxiv
Published
2023-11-29
OpenAlex
W4389132297
Cited by
162
References
10
Type
posted content
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Universal Cell Embeddings: A Foundation Model for Cell Biology. https://app.cochat.ai/papers/10.1101/2023.11.28.568918
The paper
Rosen, Y., Roohani, Y., Agrawal, A., Samotorcan, L., Consortium, T. S., Quake, S. R., & Leskovec, J. (2023). Universal Cell Embeddings: A Foundation Model for Cell Biology. bioRxiv (Cold Spring Harbor Laboratory). https://doi.org/10.1101/2023.11.28.568918

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.