Biologically informed variational autoencoders allow predictive modeling of genetic and drug-induced perturbations
Open accessPublished version of a preprint
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Motivation: Variational autoencoders (VAEs) have rapidly increased in popularity in biological applications and have already successfully been used on many omic datasets. Their latent space provides a low-dimensional representation of input data, and VAEs have been applied, e.g. for clustering of single-cell transcriptomic data. However, due to their non-linear nature, the patterns that VAEs learn in the latent space remain obscure. Hence, the lower-dimensional data embedding cannot directly be related to input features. Results: To shed light on the inner workings of VAE and enable direct interpretability of the model through its structure, we designed a novel VAE, OntoVAE (Ontology guided VAE) that can incorporate any ontology in its latent space and decoder part and, thus, provide pathway or phenotype activities for the ontology terms. In this work, we demonstrate that OntoVAE can be applied in the context of predictive modeling and show its ability to predict the effects of genetic or drug-induced perturbations using different ontologies and both, bulk and single-cell transcriptomic datasets. Finally, we provide a flexible framework, which can be easily adapted to any ontology and dataset. Availability and implementation: OntoVAE is available as a python package under https://github.com/hdsu-bioquant/onto-vae.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



![Figure 4. OntoVAE can predict IFN treatment response. (a) UMAP plot shows the PBMC dataset colored by cell type (right panel) and treatment (left panel). (b–e) Prediction of IFN treatment response by in silico stimulation of genes. All in silico stimulated genes were ranked according to the P-value of the paired Wilcoxon test, and GSEA (b) was performed with the genes that were upregulated in IFN-ß treated CD4T cells versus control CD4T cells in the original dataset (CD4T_IFN-ß_stim_up). Based on GSEA, genes from the leading edge (termed “predicted genes”) were selected. (c and d) Projection of in silico stimulated cells (green) on the UMAP computed using GO pathway activities for control CD4T cells (purple) and IFN-stimulated CD4T cells (red). UMAP and density plots are shown for the 717 leading edge genes (c) and the 717 bottom GSEA genes used as control (d), with stimulation strength increasing from top to bottom. Venn diagram € displaying the overlap between the predicted genes (green circle) and CD4T_IFN-ß_stim_up (red circle). € Hockey stick plot displaying the predicted genes sorted by significance, the 44 genes overlapping with CD4T_IFN-ß_stim_up are labeled. Darker label color indicates higher significance of this gene in CD4T_IFN-ß_stim_up, a black triangle next to the label indicates that the gene is directly annotated to the term type I IFN signaling pathway or to one of its descendant terms. (f and g) Further investigation of predicted genes that do not overlap with CD4T_IFN-ß_stim_up [green circle in Venn diagram € without intersection]. Venn diagrams are showing the overlap of these genes (orange circles) with the genes that are upregulated upon IFN-ß treatment in the other cell types of the PBMC dataset (gray circles) (f). Dotplot is showing results from a gene set ORA using IFN-related terms from MsigDBs C7 immunologic signature gene sets (g).](https://figures.cochat.ai/paper-figures/c9fbd09d38754675b06a6c672cdf0f37/biologically-informed-variational-autoencoders-allow-predictive-modeling-of-figure-4.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Additionally, OntoVAE performs perturbation modelling while observing subsequent alterations in the activation of hidden nodes representing biological processes or phenotypes through the Gene Ontology schema.”
From A mini-review on perturbation modelling across single-cell omic modalities (2024) · cites this paper as [65]
The cited source says what the claim attributes to it.
In the citing paper
“OntoVAE shows comparable performance to VEGA and expiMap in terms of ARI metric [65]”
From A mini-review on perturbation modelling across single-cell omic modalities (2024) · cites this paper as [65]
In the citing paper
“It confers direct interpretability in its latent space and decoder, allowing thousands of terms to be efficiently monitored without needing to preselect specific processes.”
From A mini-review on perturbation modelling across single-cell omic modalities (2024) · cites this paper as [65]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gene Ontology: tool for the unification of biology
Ashburner, M., Ball, C. A., Blake, J. A., Botstein, D., Butler, H., Cherry, J. M., Davis, A. P., Dolinski, K., Dwight, S. S., Eppig, J. T., et al. (2000) · Nature Genetics · doi:10.1038/75556 · Cited by 43,206
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
The Gene Ontology (GO) database and informatics resource
Gene Ontology Consortium (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh036 · Cited by 4,579
An Introduction to Variational Autoencoders
Kingma, D. P., & Welling, M. (2019) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000056 · Cited by 2,609 · cited 1×
“The decoder part, or generative model, yields a likelihood distribution p/ðx=zÞ, with / being the learnable parameters of a neural network (Kingma and Welling 2019).”
BackgroundDeep generative modeling for single-cell transcriptomics
Lopez, R., Regier, J., Cole, M. B., Jordan, M. I., & Yosef, N. (2018) · Nature Methods · doi:10.1038/s41592-018-0229-2 · Cited by 2,530 · cited 1×
“For example, in the scVI model, a linear decoder has been implemented to allow assignment of feature weights to the different latent vectors 1,11 .”
MethodFast Kd-Trees for the Kullback-Leibler Divergence and Other Decomposable Bregman Divergences
Pham, T., & Wagner, H. (2025) · Leibniz international proceedings in informatics · doi:10.4230/lipics.wads.2025.45 · Cited by 2,354
A new method to measure the semantic similarity of GO terms
Wang, J. Z., Du, Z., Payattakool, R., Yu, P. S., & Chen, C.-F. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm087 · Cited by 1,377
Multiplexed droplet single-cell RNA-sequencing using natural genetic variation
Kang, H. M., Subramaniam, M., Targ, S., Nguyen, M., Maliskova, L., McCarthy, E., Wan, E., Wong, S., Byrnes, L., Lanata, C. M., et al. (2018) · Nature Biotechnology · doi:10.1038/nbt.4042 · Cited by 1,101
Single-cell RNA-seq denoising using a deep count autoencoder
Eraslan, G., Simon, L. M., Mircea, M., Mueller, N. S., & Theis, F. J. (2019) · Nature Communications · doi:10.1038/s41467-018-07931-2 · Cited by 1,084 · cited 1×
“2019), data denoising (Eraslan et al. 2019) and batch correction (Wang et al.”
BackgroundThe human phenotype ontology: a tool for annotating and analyzing human hereditary disease
Robinson, P. N., Köhler, S., Bauer, S., Seelow, D., Horn, D., & Mundlos, S. (2008) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2008.09.017 · Cited by 1,034
A Novel Approach to High-Quality Postmortem Tissue Procurement: The GTEx Project
Carithers, L. J., Ardlie, K., Barcus, M., Branton, P. A., Britton, A., Buia, S. A., Compton, C. C., DeLuca, D. S., Peter-Demchok, J., Gelfand, E. T., et al. (2015) · Biopreservation and Biobanking · doi:10.1089/bio.2015.0032 · Cited by 833 · cited 1×
“To demonstrate that, we incorporated the Gene Ontology (GO) into our model and trained it on the Genotype Tissue Expression (GTEx) bulk RNA-sequencing (RNA-seq) data 19–21 .”
MethodscGen predicts single-cell perturbation responses
Lotfollahi, M., Wolf, F. A., & Theis, F. J. (2019) · Nature Methods · doi:10.1038/s41592-019-0494-8 · Cited by 661
An Introduction to Variational Autoencoders
Kingma, D. P., & Welling, M. (2019) · doi:10.1561/9781680836233 · Cited by 643
Using deep learning to model the hierarchical structure and function of a cell
Ma, J., Yu, M. K., Fong, S., Ono, K., Sage, E., Demchak, B., Sharan, R., & Ideker, T. (2018) · Nature Methods · doi:10.1038/nmeth.4627 · Cited by 435
Nowak, K. J., & Davies, K. E. (2004) · EMBO reports · doi:10.1038/sj.embor.7400221 · Cited by 357
recount3: summaries and queries for large-scale RNA-seq expression and splicing
Wilks, C., Zheng, S. C., Chen, F. Y., Charles, R., Solomon, B., Ling, J. P., Imada, E. L., Zhang, D., Joseph, L., Leek, J. T., et al. (2021) · Genome Biology · doi:10.1186/s13059-021-02533-6 · Cited by 256
Way, G. P., & Greene, C. S. (2018) · Biocomputing 2018 · doi:10.1142/9789813235533_0008 · Cited by 247
Data denoising with transfer learning in single-cell transcriptomics
Wang, J., Agarwal, D., Huang, M., Hu, G., Zhou, Z., Ye, C., & Zhang, N. R. (2019) · Nature Methods · doi:10.1038/s41592-019-0537-1 · Cited by 190
Interpretable factor models of single-cell RNA-seq via variational autoencoders
Svensson, V., Gayoso, A., Yosef, N., & Pachter, L. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btaa169 · Cited by 190
Predicting Cellular Responses to Novel Drug Perturbations at a Single-Cell Resolution
Hetzel, L., Boehm, S., Kilbertus, N., Günnemann, S., Lotfollahi, M., & Theis, F. (2022) · neural information processing systems · doi:10.52202/068431-1937 · Cited by 161
Multi-domain translation between single-cell imaging and sequencing data using autoencoders
Yang, K. D., Belyaeva, A., Venkatachalapathy, S., Damodaran, K., Katcoff, A., Radhakrishnan, A., Shivashankar, G. V., & Uhler, C. (2021) · Nature Communications · doi:10.1038/s41467-020-20249-2 · Cited by 156
Fast and precise single-cell data analysis using a hierarchical autoencoder
Tran, D., Nguyen, H., Tran, B., La Vecchia, C., Luu, H. N., & Nguyen, T. (2021) · Nature Communications · doi:10.1038/s41467-021-21312-2 · Cited by 145 · cited 1×
“2019), cell clustering (Tran et al. 2021), multi-domain translation (Yang et al.”
BackgroundFortelny, N., & Bock, C. (2020) · Genome Biology · doi:10.1186/s13059-020-02100-5 · Cited by 135 · cited 1×
“Knowledge-primed neural networks, in which every node represents a protein or gene, and every edge a regulatory interaction, have been used to model T cell receptor stimulation (Fortelny and Bock 2020).”
MethodSeninge, L., Anastopoulos, I., Ding, H., & Stuart, J. (2021) · Nature Communications · doi:10.1038/s41467-021-26017-0 · Cited by 107 · cited 2×
“As computation of the posterior is intractable, the optimization objective of the VAE, like of other variational inference methods, is the evidence lower bound (ELBO) 12,32 :”
MethodWay, G. P., & Greene, C. S. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/174474 · Cited by 103
Biologically informed deep learning to query gene programs in single-cell atlases
Lotfollahi, M., Rybakov, S., Hrovatin, K., Hediyeh-zadeh, S., Talavera-López, C., Misharin, A. V., & Theis, F. J. (2023) · Nature Cell Biology · doi:10.1038/s41556-022-01072-x · Cited by 100
Zhang, X., Zhang, J., Sun, K., Yang, X., Dai, C., & Guo, Y. (2019) · 2019 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm47256.2019.8983228 · Cited by 93 · cited 2×
“AE-based methods have successfully been applied in the context of cancer classification (Zhang et al. 2019), data integration (Zhang et al.”
BackgroundMethodBourgeais, V., Zehraoui, F., Hamdoune, M. B., & Hanczar, B. (2021) · BMC Bioinformatics · doi:10.1186/s12859-021-04370-7 · Cited by 57
Peng, J., Wang, X., & Shang, X. (2019) · BMC Bioinformatics · doi:10.1186/s12859-019-2769-6 · Cited by 56
Deriving disease modules from the compressed transcriptional space embedded in a deep autoencoder
Dwivedi, S. K., Tjärnberg, A., Tegner, J. N., & Gustafsson, M. (2020) · Nature Communications · doi:10.1038/s41467-020-14666-6 · Cited by 49
Learning interpretable cellular responses to complex perturbations in high-throughput screens
Lotfollahi, M., Susmelj, A. K., De Donno, C., Ji, Y., Ibarra, I. L., Wolf, F. A., Yakubova, N., Theis, F. J., & Lopez-Paz, D. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.04.14.439903 · Cited by 48
Bourgeais, V., Zehraoui, F., & Hanczar, B. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac147 · Cited by 32
Deep neural network prediction of genome-wide transcriptome signatures – beyond the Black-box
Magnusson, R., Tegner, J. N., & Gustafsson, M. (2022) · npj Systems Biology and Applications · doi:10.1038/s41540-022-00218-9 · Cited by 31
Are Message Passing Neural Networks Really Helpful for Knowledge Graph Completion?
Li, J., Shomer, H., Ding, J., Wang, Y., Ma, Y., Shah, N., Tang, J., & Yin, D. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.597 · Cited by 31
Learning interpretable latent autoencoder representations with annotations of feature sets
Rybakov, S., Lotfollahi, M., Theis, F. J., & Wolf, F. A. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.12.02.401182 · Cited by 21
Depuydt, C., Goosens, V., Janky, R., D’Hondt, A., Bleecker, J. D., Noppe, N., Derveaux, S., Thal, D. R., & Claeys, K. G. (2022) · Cells · doi:10.3390/cells11091508 · Cited by 12
Are Message Passing Neural Networks Really Helpful for Knowledge Graph Completion?Preprint
Li, J., Shomer, H., Ding, J., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.10652 · Cited by 2
Cited by
Artificial Intelligence Virtual Organoids (AIVOs)
Bai, L., & Su, J. (2025) · Bioactive Materials · doi:10.1016/j.bioactmat.2025.12.030 · Cited by 66
A mini-review on perturbation modelling across single-cell omic modalities
Gavriilidis, G. I., Vasileiou, V., Orfanou, A., Ishaque, N., & Psomopoulos, F. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.04.058 · Cited by 54
Rockel, J. S., Sharma, D., Espin‐Garcia, O., Hueniken, K., Sandhu, A., Pastrello, C., Sundararajan, K., Potla, P., Fine, N. A., Lively, S. S., et al. (2025) · Annals of the Rheumatic Diseases · doi:10.1016/j.ard.2025.01.012 · Cited by 41
Mumuni, F., & Mumuni, A. (2023) · Cognitive Systems Research · doi:10.1016/j.cogsys.2023.101188 · Cited by 40
Reliable interpretability of biology-inspired deep neural networks
(2023) · doi:10.1038/s41540-023-00310-8 · Cited by 37
Metadata
- Authors
- Doncevic, D., & Herrmann, C.
- Affiliations
- Heidelberg University (DE)
- Corresponding author
- Doncevic, Daria
- Herrmann, Carl
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2023-06-01
- Volume
- 39
- Issue
- 6
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- PMC
- PMC10301695
- OpenAlex
- W4380869622
- Cited by
- 51
- References
- 35
- Citations by year
- 2026: 12 · 2025: 30 · 2024: 5 · 2023: 4
- FWCI
- 4.54
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Bioinformatics (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- IPMB, University Heidelberg
- Deutsche Forschungsgemeinschaft
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Keywords
- variational autoencoder, interpretability, pathway activity, single-cell transcriptomics, bulk transcriptomics, predictive modeling
- MeSH terms
- Cluster Analysis, Gene Expression Profiling, Transcriptome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.