Enhancing scientific discoveries in molecular biology with deep generative models
Open accessAbstract
Generative models provide a well‐established statistical framework for evaluating uncertainty and deriving conclusions from large data sets especially in the presence of noise, sparsity, and bias. Initially developed for computer vision and natural language processing, these models have been shown to effectively summarize the complexity that underlies many types of data and enable a range of applications including supervised learning tasks, such as assigning labels to images; unsupervised learning tasks, such as dimensionality reduction; and out‐of‐sample generation, such as de novo image synthesis. With this early success, the power of generative models is now being increasingly leveraged in molecular biology, with applications ranging from designing new molecules with properties of interest to identifying deleterious mutations in our genomes and to dissecting transcriptional variability between single cells. In this review, we provide a brief overview of the technical notions behind generative models and their implementation with deep learning techniques. We then describe several different ways in which these models can be utilized in practice, using several recent applications in molecular biology as examples.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Early approaches could not be generalized to unseen perturbations.
“However, these methods could not be generalized to unseen perturbations.”
From A systematic comparison of single-cell perturbation response prediction models (2026) · cites this paper as [12]
The 'In silico generation of biomedical data' section describes scGen predicting a perturbation’s effect in a cell type lacking perturbation data. The 'Disentangling factors of variation' section questions whether its assumptions hold for cell-type-specific responses. Neither passage says that early methods could not generalize to unseen perturbations; searches for unseen and novel perturbations found no such statement. Page numbers were not provided in our copy. (LLM, conf=0.70)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
<i>Stan</i> : A Probabilistic Programming Language
Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., & Riddell, A. (2017) · Journal of Statistical Software · doi:10.18637/jss.v076.i01 · Cited by 7,754 · cited 2× · see citing works
“…research, an important development paired neural networks with statistical inference via the popularization of probabilistic languages such as Stan (Carpenter et al , 2017 ), Pyro (Bing-ham et al , 2019 ), Edward (Tran et al , 2017 a), and TensorFlow Probability (preprint: Dillon et al , 2017 ).”
MethodA Next Generation Connectivity Map: L1000 Platform and the First 1,000,000 Profiles
Subramanian, A., Narayan, R., Corsello, S. M., Peck, D. D., Natoli, T. E., Lu, X., Gould, J., Davis, J. F., Tubelli, A. A., Asiedu, J. K., et al. (2017) · Cell · doi:10.1016/j.cell.2017.10.049 · Cited by 3,515 · see citing works
Scalable and accurate deep learning with electronic health records
Rajkomar, A., Oren, E., Chen, K., Dai, A. M., Hajaj, N., Hardt, M., Liu, P. J., Liu, X., Marcus, J., Sun, M., et al. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0029-1 · Cited by 2,648 · cited 1× · see citing works
“Consider as an example the case of a clinical study where one is interested to predict the outcome (discrete or quantitative) of treatments based on input covariates of environmental, genetic, or other molecular origins (Dincer et al , 2018; Rajkomar et al , 2018).”
BackgroundDeep generative modeling for single-cell transcriptomics
Lopez, R., Regier, J., Cole, M. B., Jordan, M. I., & Yosef, N. (2018) · Nature Methods · doi:10.1038/s41592-018-0229-2 · Cited by 2,530 · see citing works
Self-citationAn introduction to MCMC for machine learning.
Andrieu, C., de Freitas, N., Doucet, A., & Jordan, M. I. (2003) · Machine Learning · doi:10.1023/a:1020281327116 · Cited by 2,451 · see citing works
Regev, A., Teichmann, S. A., Lander, E. S., Amit, I., Benoist, C., Birney, E., Bodenmiller, B., Campbell, P., Carninci, P., Clatworthy, M., et al. (2017) · eLife · doi:10.7554/elife.27041 · Cited by 2,232 · see citing works
Self-citationDixit, A., Parnas, O., Li, B., Chen, J., Fulco, C. P., Jerby-Arnon, L., Marjanovic, N. D., Dionne, D., Burks, T., Raychowdhury, R., et al. (2016) · Cell · doi:10.1016/j.cell.2016.11.038 · Cited by 1,863 · see citing works
Mutation effects predicted from sequence co-variation
Hopf, T. A., Ingraham, J. B., Poelwijk, F. J., Schärfe, C. P. I., Springer, M., Sander, C., & Marks, D. S. (2017) · Nature Biotechnology · doi:10.1038/nbt.3769 · Cited by 775 · see citing works
Evaluating Protein Transfer Learning with TAPE
Rao, R., Bhattacharya, N., Thomas, N., Duan, Y., Chen, X., Canny, J., Abbeel, P., & Song, Y. S. (2019) · doi:10.1101/676825 · Cited by 719 · see citing works
Xu, C., Lopez, R., Mehlman, E., Regier, J., Jordan, M. I., & Yosef, N. (2021) · Molecular Systems Biology · doi:10.15252/msb.20209620 · Cited by 691 · cited 4× · see citing works
“In a certain number of real-world instances, using a linear model might result in an important loss of performance and the input data might not have spatial structure such as molecular information.”
BackgroundMethodInfluentialSelf-citationInterpretable dimensionality reduction of single cell transcriptome data with deep generative models
Ding, J., Condon, A., & Shah, S. P. (2018) · Nature Communications · doi:10.1038/s41467-018-04368-5 · Cited by 337 · see citing works
Computational methods for single-cell omics across modalities
Efremova, M., & Teichmann, S. A. (2020) · Nature Methods · doi:10.1038/s41592-019-0692-4 · Cited by 201 · see citing works
False signals induced by single-cell imputation
Andrews, T. S., & Hemberg, M. (2018) · F1000Research · doi:10.12688/f1000research.16613.1 · Cited by 142 · see citing works
Lotfollahi, M., Wolf, F. A., & Theis, F. J. (2018) · doi:10.1101/478503 · Cited by 21 · see citing works
Flagged first, then by citations
Research works printed but not linked: 121
- Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, Corrado GS, Davis A, Dean J, Devin M et al (2016) TensorFlow: large‐scale machine learning on heterogeneous distributed systems. arXiv https://arxiv.org/abs/1603.04467 [PREPRINT] · arXiv
- Abid A, Zhang MJ, Bagaria VK, Zou J (2018) Exploring patterns enriched in a dataset with contrastive principal component analysis. Nat Commun 9: 1– 7 29849030 PMC5976774
- Abid A, Zou J (2019) Contrastive variational autoencoder enhances salient features. arXiv https://arxiv.org/abs/1902.04601 [PREPRINT] · arXiv
- Amini A, Schwarting W, Rosman G, Araki B, Karaman S, Rus D (2018) Variational autoencoder for end‐to-end control of autonomous driving with novelty detection and training de‐biasing. In IEEE/RSJ Int Conf Intelligent Robots and Systems, pp 568– 575
- Amodio M, Krishnaswamy S (2018) MAGAN: Aligning biological manifolds. In Proc Int Conf Mach Learn, pp 215– 223
- Amodio M, van Dijk D, Srinivasan K, Chen WS, Mohsen H, Moon KR, Campbell A, Zhao Y, Wang X, Venkataswamy M et al (2019) Exploring single cell data with deep multitasking neural networks. Nat Methods 16: 1139 31591579 PMC10164410
- Arjovsky M, Chintala S, Bottou L (2017) Wasserstein generative adversarial networks. In Proc Int Conf Mach Learn, pp 214– 223
- Balın MF, Abid A, Zou J (2019) Concrete autoencoders: Differentiable feature selection and reconstruction. In Proc Int Conf Mach Learn, pp 444– 453
- Battaglia PW, Hamrick JB, Bapst V, Sanchez‐Gonzalez A, Zambaldi V, Malinowski M, Tacchetti A, Raposo D, Santoro A, Faulkner R et al (2018) Relational inductive biases, deep learning, and graph networks. arXiv https://arxiv.org/abs/1806.01261 [PREPRINT] · arXiv
- Beaulieu‐Jones BK, Wu ZS, Williams C, Lee R, Bhavnani SP, Byrd JB, Greene CS (2019) Privacy‐preserving generative deep neural networks support clinical data sharing. Circ Cardiovasc Qual Outcomes 12: 005122 PMC7041894 31284738
- Bellman R (1966) Dynamic programming. Science 153: 34– 37 17730601
- Bengio Y, Yao L, Alain G, Vincent P (2013) Generalized denoising auto‐encoders as generative models. In Adv Neural Inf Process Syst, pp 899– 907
- Bento AP, Gaulton A, Hersey A, Bellis LJ, Chambers J, Davies M, Krüger FA, Light Y, Mak L, McGlinchey S et al (2014) The ChEMBL bioactivity database: an update. Nucleic Acids Res 42: D1083– D1090 24214965 PMC3965067
- Berger JO (2013) Statistical decision theory and Bayesian analysis. Berlin: Springer Science & Business Media
- Blei DM, Kucukelbir A, McAuliffe JD (2017) Variational inference: a review for statisticians. J Am Stat Assoc 112: 859– 877
- Brookes DH, Park H, Listgarten J (2019) Conditioning by adaptive sampling for robust design. In Proc Int Conf Mach Learn, pp 773– 782
- Burda Y, Grosse R, Salakhutdinov R (2016) Importance weighted autoencoders. In Proc Int Conf Learning Representations
- Casale FP, Dalca A, Saglietti L, Listgarten J, Fusi N (2018) Gaussian process prior variational autoencoders. In Adv Neural Inf Process Syst, pp 10369– 10380
- Chen Y, Sun W, Wang H (2018) Heterogeneous Hi‐C data super resolution with a conditional generative adversarial network. In IEEE Int Conf Bioinformatics and Biomedicine, pp 2213– 2220
- Ching T, Himmelstein DS, Beaulieu‐Jones BK, Kalinin AA, Do BT, Way GP, Ferrero E, Agapow P‐M, Zietz M, Hoffman MM et al (2018) Opportunities and obstacles for deep learning in biology and medicine. J R Soc Interface 15: 20170387 29618526 PMC5938574
- Codeluppi S, Borm LE, Zeisel A, La Manno G, van Lunteren JA, Svensson CI, Linnarsson S (2018) Spatial organization of the somatosensory cortex revealed by osmFISH. Nat Methods 15: 932– 935 30377364
- Cole MB, Risso D, Wagner A, DeTomaso D, Ngai J, Purdom E, Dudoit S, Yosef N (2019) Performance assessment and selection of normalization procedures for single‐cell RNA‐seq. Cell Syst 8: 315– 328 31022373 PMC6544759
- Davis CA, Hitz BC, Sloan CA, Chan ET, Davidson JM, Gabdank I, Hilton JA, Jain K, Baymuradov UK, Narayanan AK et al (2018) The encyclopedia of DNA elements (ENCODE): data portal update. Nucleic Acids Res 41: 1– 7 PMC5753278 29126249
- Deng Y, Bao F, Dai Q, Wu LF, Altschuler SJ (2019) Scalable analysis of cell‐type composition from single‐cell transcriptomics using deep recurrent learning. Nat Methods 16: 311– 314 30886411 PMC6774994
- DeTomaso D, Jones M, Subramaniam M, Ashuach T, Ye CJ, Yosef N (2019) Functional interpretation of single‐cell similarity maps. Nat Commun 10: 1– 11 31558714 PMC6763499
- Dillon JV, Langmore I, Tran D, Brevdo E, Vasudevan S, Moore D, Patton B, Alemi A, Hoffman M, Saurous RA (2017) TensorFlow distributions. arXiv https://arxiv.org/abs/1711.10604 [PREPRINT] · arXiv
- Dincer AB, Celik S, Hiranuma N, Lee S‐I (2018) DeepProfile: Deep learning of cancer molecular profiles for precision medicine. In ICML Workshop Comp Biol
- Ding J, Regev A (2019) Deep generative model embedding of single‐cell RNA‐Seq profiles on hyperspheres and hyperbolic spaces. bioRxiv 10.1101/853457 [PREPRINT] PMC8099904 33953202 · DOI
- Dizaji KG, Wang X, Huang H (2018) Semi‐supervised generative adversarial network for gene expression inference. In KDD, pp 1435– 1444 PMC6129263 30423066
- Donahue J, Krähenbühl P, Darrell T (2017) Adversarial feature learning. In Proc Int Conf Learning Representations
- Economou T, Stephenson DB, Rougier JC, Neal R, Mylne KR (2016) On the use of Bayesian decision theory for issuing natural hazard warnings. Proc Math Phys Eng Sci 472: 20160295 27843399 PMC5095440
- Eraslan G, Avsec Ž, Gagneur J, Theis FJ (2019a) Deep learning: new computational modelling techniques for genomics. Nat Rev Genet 20: 389– 403 30971806
- Eraslan G, Simon LM, Mircea M, Mueller NS, Theis FJ (2019b) Single‐cell RNA‐seq denoising using a deep count autoencoder. Nat Comm 10: 1– 14 PMC6344535 30674886
- Gaublomme JT, Yosef N, Lee Y, Gertner RS, Yang LV, Wu C, Pandolfi PP, Mak T, Satija R, Shalek AK et al (2015) Single‐cell genomics unveils critical regulators of Th17 cell pathogenicity. Cell 163: 1400– 1412 26607794 PMC4671824
- Ghahramani A, Watt FM, Luscombe NM (2018) Generative adversarial networks simulate gene expression and predict perturbations in single cells. bioRxiv 10.1101/262501 [PREPRINT] · DOI
- Gilpin LH, Bau D, Yuan BZ, Bajwa A, Specter M, Kagal L (2018) Explaining explanations: An overview of interpretability of machine learning. In IEEE Int Conf Data Science and Advanced Analytics, pp 80– 89
- Goldsborough P, Pawlowski N, Caicedo JC, Singh S, Carpenter AE (2017) CytoGAN: Generative modeling of cell images. In NeurIPS Workshop in Comp Biol
- Goodfellow IJ, Pouget‐Abadie J, Mirza M, Xu B, Warde‐Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In Adv Neural Inf Process Syst, pp 2672– 2680
- Gregor K, Danihelka I, Graves A, Rezende D, Wierstra D (2015) DRAW: A recurrent neural network for image generation. In Proc Int Conf Mach Learn, pp 1462– 1471
- Grønbech CH, Vording MF, Timshel PN, Sønderby CK, Pers TH, Winther O (2020) scVAE: variational auto‐encoders for single‐cell gene expression data. Bioinformatics. 10.1093/bioinformatics/btaa293 32415966 · DOI
- Grover A, Song J, Kapoor A, Tran K, Agarwal A, Horvitz EJ, Ermon S (2019) Bias correction of learned generative models using likelihood‐free importance weighting. In Adv Neural Inf Process Syst, pp 11058– 11070
- Grün D, Kester L, van Oudenaarden A (2014) Validation of noise models for single‐cell transcriptomics. Nat Methods 11: 637– 640 24747814
- Guimaraes G, Sanchez‐Lengeling B, Outeiral C, Luis P, Farias C, Aspuru‐Guzik A (2018) Objective‐reinforced generative adversarial networks (ORGAN) for sequence generation models. arXiv https://arxiv.org/abs/1705.10843 [PREPRINT] · arXiv
- Han C, Hayashi H, Rundo L, Araki R, Shimoda W, Muramatsu S, Furukawa Y, Mauri G, Nakayama H (2018a) GAN‐based synthetic brain MR image generation. In IEEE Int Symp Biomedical Imaging, pp 734– 738
- Han L, Murphy RF, Ramanan D (2018b) Learning generative models of tissue organization with supervised GANs. In IEEE Winter Conf on Applications of Computer Vision, pp 682– 690 PMC6119234 30177974
- Hu Z, Yang Z, Salakhutdinov R, Xing E (2018) On unifying deep generative models. In Proc Int Conf Learning Representations
- Hu Q, Greene CS (2019) Parameter tuning is a key part of dimensionality reduction via deep variational autoencoders for single cell RNA transcriptomics. In Pacific Symp on Biocomp, pp 362 PMC6417816 30963075
- Hyvärinen A, Oja E (2000) Independent component analysis: algorithms and applications. Neural networks, 13: 411– 430 10946390
- Ioffe S, Szegedy C (2015) Batch normalization: Accelerating deep network training by reducing internal covariate shift. In Proc Int Conf Mach Learn, pp 448– 456
- Janizek JD, Celik S, Lee S‐I (2019) Explainable machine learning prediction of synergistic drug combinations for precision cancer medicine. ICML Workshop in Comp Biol
- Johnson M, Duvenaud DK, Wiltschko A, Adams RP, Datta SR (2016) Composing graphical models with neural networks for structured representations and fast inference. In Adv Neural Inf Process Syst, pp 2946– 2954
- Jolliffe IT (1986) Principal component analysis. New York, NY: Springer
- Kadurin A, Aliper A, Kazennov A, Mamoshina P, Vanhaelen Q, Khrabrov K, Zhavoronkov A (2017a) The cornucopia of meaningful leads: applying deep adversarial autoencoders for new molecule development in oncology. Oncotarget 8: 10883 28029644 PMC5355231
- Kadurin A, Nikolenko S, Khrabrov K, Aliper A, Zhavoronkov A (2017b) druGAN: an advanced generative adversarial autoencoder model for de novo generation of new molecules with desired molecular properties in silico. Mol Pharm 14: 3098– 3104 28703000
- Kandasamy K, Neiswanger W, Schneider J, Póczos B, Xing EP (2018) Neural architecture search with Bayesian optimisation and optimal transport. In Adv Neural Inf Process Syst, pp 2016– 2025
- Kingma DP, Mohamed S, Rezende DJ, Welling M (2014) Semi‐supervised learning with deep generative models. In Adv Neural Inf Process Syst, pp 3581– 3589
- Kingma DP, Welling M (2014) Auto‐encoding variational Bayes. In Proc Int Conf Learning Representations
- Kingma DP, Salimans T, Jozefowicz R, Chen X, Sutskever I, Welling M (2016) Improved variational inference with inverse autoregressive flow. In Adv Neural Inf Process Syst, pp 4743– 4751
- Köhler ND, Büttner M, Theis FJ (2019) Deep learning does not outperform classical machine learning for cell‐type annotation. bioRxiv 10.1101/653907 [PREPRINT] · DOI
- Kurutach T, Tamar A, Yang G, Russell SJ, Abbeel P (2018) Learning plannable representations with causal InfoGAN. In Adv Neural Inf Process Syst, pp 8733– 8744
- Lafarge MW, Caicedo JC, Carpenter AE, Pluim JP, Singh S, Veta M (2019) Capturing single‐cell phenotypic variation via unsupervised representation learning. In Int Conf Medical Imaging with Deep Learning, pp 315– 325 PMC9307238 35874600
- Levitin HM, Yuan J, Cheng YL, Ruiz FJ, Bush EC, Bruce JN, Canoll P, Iavarone A, Lasorella A, Blei DM et al (2019) De novo gene signature identification from single‐cell RNA‐seq with hierarchical Poisson factorization. Mol Syst Biol 15: 8557 PMC6386217 30796088
- Li Y, Turner RE (2016) Rényi divergence variational inference. In Adv Neural Inf Process Syst, pp 1073– 1081
- Lopez R, Regier J, Jordan MI, Yosef N (2018b) Information constraints on auto‐encoding variational Bayes. In Adv Neural Inf Process Syst, pp 6114– 6125
- Lopez R, Nazaret A, Langevin M, Samaran J, Regier J, Jordan MI, Yosef N (2019) A joint model of unpaired data from scRNA‐seq and spatial transcriptomics for imputing missing gene expression measurements. In ICML Workshop in Comp Biol
- Lopez R, Boyeau P, Yosef N, Jordan MI, Regier J (2020) Decision‐making with auto‐encoding variational Bayes. arXiv https://arxiv.org/abs/2002.07217 [PREPRINT] · arXiv
- Louizos C, Swersky K, Li Y, Welling M, Zemel R (2016) The variational fair autoencoder. In Proc Int Conf Learning Representations
- Louizos C, Shalit U, Mooij J, Sontag D, Zemel R, Welling M (2017) Causal effect inference with deep latent‐variable models. In Adv Neural Inf Process Syst, pp 6446– 6456
- Love MI, Huber W, Anders S (2014) Moderated estimation of fold change and dispersion for RNA‐seq data with DESeq2. Genome Biol 15: 550 25516281 PMC4302049
- Lundberg SM, Lee S‐I (2017) A unified approach to interpreting model predictions. In Adv Neural Inf Process Syst, pp 4765– 4774
- Mairal J, Bach F, Ponce J, Sapiro G (2009) Online dictionary learning for sparse coding. In Proc Int Conf Mach Learn, pp 689– 696
- Makhzani A, Shlens J, Jaitly N, Goodfellow I (2016) Adversarial autoencoders. In Proc Int Conf Learning Representations
- Manica M, Oskooei A, Born J, Subramanian V, Sáez‐Rodríguez J, Rodríguez Martínez M (2019) Toward explainable anticancer compound sensitivity prediction via multimodal attention‐based convolutional encoders. Mol Pharm 16: 4797– 4806 31618586
- Marouf M, Machart P, Magruder DS, Bansal V, Kilian C, Krebs CF, Bonn S (2020) Realistic in silico generation and augmentation of single cell RNA‐seq data using generative adversarial neural networks. Nat Commun 11: 1– 12 31919373 PMC6952370
- Mattei P‐A, Frellsen J (2019) MIWAE: Deep generative modelling and imputation of incomplete data sets. In Proc Int Conf Mach Learn, pp 4413– 4423
- McKenna A, Gagnon JA (2019) Recording development with single cell dynamic lineage tracing. Development. 10.1242/dev.169730 PMC6602349 31249005 · DOI
- Mescheder L, Nowozin S, Geiger A (2017) Adversarial variational Bayes: Unifying variational autoencoders and generative adversarial networks. In Proc Int Conf Mach Learn, pp 2391– 2400
- Mirza M, Osindero S (2014) Conditional generative adversarial nets. arXiv https://arxiv.org/abs/1411.1784 [PREPRINT] · arXiv
- Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A, Riedmiller M, Fidjeland AK, Ostrovski G et al (2015) Human‐level control through deep reinforcement learning. Nature 518: 529– 533 25719670
- Ng AY, Jordan MI (2002) On discriminative vs. generative classifiers: A comparison of logistic regression and naive Bayes. In Adv Neural Inf Process Syst, pp 841– 848
- Novembre J, Johnson T, Bryc K, Kutalik Z, Boyko AR, Auton A, Indap A, King KS, Bergmann S, Nelson MR et al (2008) Genes mirror geography within Europe. Nature 456: 98– 101 18758442 PMC2735096
- Osband I, Aslanides J, Cassirer A (2018) Randomized prior functions for deep reinforcement learning. In Adv Neural Inf Process Syst, pp 8617– 8629
- Osokin A, Chessel A, Salas RE, Vaggi F (2017) GANs for biological image synthesis. In IEEE Int Conf Computer Vision, pp 2233– 2242
- Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Killeen T, Lin Z, Gimelshein N, Antiga L et al (2019) Pytorch: an imperative style, high‐performance deep learning library. In Adv Neural Inf Process Syst, pp 8026– 8037
- Pearl J (2009) Causality. Cambridge: Cambridge University Press
- Peters J, Schaal S (2007) Reinforcement learning by reward weighted regression for operational space control. In Proc Int Conf Mach Learn, pp 745– 750
- Popova M, Isayev O, Tropsha A (2018) Deep reinforcement learning for de novo drug design. Sci Adv 4: 7885 PMC6059760 30050984
- Qiu YL, Zheng H, Gavaert O (2018) A deep learning framework for imputing missing values in genomic data. bioRxiv 10.1101/406066 [PREPRINT] · DOI
- Radford A, Metz L, Chintala S (2016) Unsupervised representation learning with deep convolutional generative adversarial networks. In Proc Int Conf Learning Representations
- Rampášek L, Hidru D, Smirnov P, Haibe‐Kains B, Goldenberg A (2019) Dr.VAE: improving drug response prediction via modeling of drug perturbation effects. Bioinformatics 35: 3743– 3751 30850846 PMC6761940
- Rashid S, Shah S, Bar‐Joseph Z, Pandya R (2019) Dhaka: variational autoencoder for unmasking tumor heterogeneity from single cell genomic data. Bioinformatics. 10.1093/bioinformatics/btz095 PMC11025345 30768159 · DOI
- Ravanbakhsh S, Lanusse F, Mandelbaum R, Schneider J, Poczos B (2017) Enabling dark energy science with deep generative models of galaxy images. In Proc Conf AAAI Artif Intell, pp 1488– 1494
- Rezende DJ, Mohamed S, Wierstra D (2014) Stochastic back propagation and approximate inference in deep generative models. In Proc Int Conf Mach Learn, pp 1278– 1286
- Riesselman AJ, Ingraham JB, Marks DS (2018) Deep generative models of genetic variation capture the effects of mutations. Nat Methods 15: 816– 822 30250057 PMC6693876
- Risso D, Ngai J, Speed TP, Dudoit S (2014) Normalization of RNA‐seq data using factor analysis of control genes or samples. Nat Biotechnol 32: 896– 902 25150836 PMC4404308
- Risso D, Perraudeau F, Gribkova S, Dudoit S, Vert JP (2018) A general and flexible method for signal extraction from single‐cell RNA‐seq data. Nat Commun 9: 1– 17 29348443 PMC5773593
- Ruiz FJR, Titsias MK, Blei DM (2016) The generalized reparameterization gradient. In Adv Neural Inf Process Syst, pp 460– 468
- Sanchez‐Lengeling B, Outeiral C, Guimaraes GL, Aspuru‐Guzik A (2017) Optimizing distributions over molecular space: an objective reinforced generative adversarial network for inverse‐design chemistry (ORGANIC). Chem‐Rxiv 10.26434/chemrxiv.5309668 [PREPRINT] · DOI
- Sanchez‐Lengeling B, Aspuru‐Guzik A (2018) Inverse molecular design using machine learning: generative models for matter engineering. Science 361: 360– 365 30049875
- Schneider P, Walters WP, Plowright AT, Sieroka N, Listgarten J, Goodnow RA, Fisher J, Jansen JM, Duca JS, Rush TS et al (2020) Rethinking drug design in the artificial intelligence era. Nat Rev Drug Discov 19: 353– 364 31801986
- Simon LM, Yan F, Zhao Z (2019) DrivAER: identification of driving transcriptional programs in single‐cell RNA sequencing data. bioRxiv 10.1101/864165 [PREPRINT] PMC7727875 33301553 · DOI
- Sohn K, Lee H, Yan X (2015) Learning structured output representation using deep conditional generative models. In Adv Neural Inf Process Syst, pp 3483– 3491
- Svensson V, Gayoso A, Yosef N, Pachter L (2020) Interpretable factor models of single‐cell RNA‐seq via variational autoencoders. Bioinformatics 36: 3418– 3421 32176273 PMC7267837
- The Theano Development Team (2016) Theano: a Python framework for fast computation of mathematical expressions. arXiv https://arxiv.org/abs/1605.02688 [PREPRINT] · arXiv
- Theis L, van den Oord A, Bethge M (2016) A note on the evaluation of generative models. In Proc Int Conf Learning Representations
- Tran D, Hoffman MD, Saurous RA, Brevdo E, Murphy K, Blei DM (2017a) Deep probabilistic programming. In Proc Int Conf Learning Representations
- Tran D, Ranganath R, Blei DM (2017b) Hierarchical implicit models and likelihood‐free variational inference. In Adv Neural Inf Process Syst, pp 5523– 5533
- Vallejos CA, Risso D, Scialdone A, Dudoit S, Marioni JC (2017) Normalizing single‐cell RNA sequencing data: challenges and opportunities. Nat Methods 14: 565 28504683 PMC5549838
- Wagner A, Regev A, Yosef N (2016) Revealing the vectors of cellular identity with single‐cell genomics. Nat Biotechnol 34: 1145– 1160 27824854 PMC5465644
- Wainberg M, Merico D, Delong A, Frey BJ (2018) Deep learning in biomedicine. Nat Biotechnol 36: 829– 838 30188539
- Wallach HM, Murray I, Salakhutdinov R, Mimno D (2009) Evaluation methods for topic models. In Proc Int Conf Mach Learn, pp 1105– 1112
- Wang D, Gu J (2018) VASC: dimension reduction and visualization of single‐cell RNA‐seq data by deep variational autoencoder. Genom Proteom Bioinform 16: 320– 331 PMC6364131 30576740
- Wang X, Ghasedi Dizaji K, Huang H (2018) Conditional generative adversarial network for gene expression inference. Bioinformatics 34: 603– 611 PMC6129263 30423066
- Wu B, Zhao S, Chen C, Xu H, Wang L, Zhang X, Sun G, Zhou J (2019) Generalization in generative adversarial networks: A novel perspective from privacy protection. In Adv Neural Inf Process Syst, pp 307– 317
- Yao Y, Vehtari A, Simpson D, Gelman A (2018) Yes, but did it work?: Evaluating variational inference. In Proc Int Conf Mach Learn, pp 5581– 5590
- Yau C, Campbell K (2019) Bayesian statistical learning for big data biology. Biophys Rev 11: 95– 102 30729409 PMC6381359
- Yoon J, Jordon J, van der Schaar M (2018) GANITE: Estimation of individualized treatment effects using generative adversarial nets. In Proc Int Conf Learning Representations
- Zhang X, Xu C, Yosef N (2019) Simulating multiple faceted variability in single cell RNA sequencing. Nat Commun 10: 1– 16 31197158 PMC6565723
- Zhao S, Ren H, Yuan A, Song J, Goodman N, Ermon S (2018) Bias and generalization in deep generative models: An empirical study. In Adv Neural Inf Process Syst, pp 11058– 11070
- Zhu J‐Y, Park T, Isola P, Efros AA (2017) Unpaired image‐to-image translation using cycle‐consistent adversarial networks. In Proc IEEE Int Conf Comp Vision, pp 2223– 2232
- Zou J, Huss M, Abid A, Mohammadi P, Torkamani A, Telenti A (2019) A primer on deep learning in genomics. Nat Genet 51: 12– 18 30478442 PMC11180539
Cited by
Sorted by citations
A Python library for probabilistic analysis of single-cell omics data
Gayoso, A., Lopez, R., Xing, G., Boyeau, P., Valiollah Pour Amiri, V., Hong, J., Wu, K., Jayasuriya, M., Mehlman, E., Langevin, M., et al. (2022) · Nature Biotechnology · doi:10.1038/s41587-021-01206-w · Cited by 789 · see citing works
Self-citationPredicting cellular responses to complex perturbations in high‐throughput screens
Lotfollahi, M., Klimovskaia Susmelj, A., De Donno, C., Hetzel, L., Ji, Y., Ibarra, I. L., Srivatsan, S. R., Naghipourfar, M., Daza, R. M., Martin, B., et al. (2023) · Molecular Systems Biology · doi:10.15252/msb.202211517 · Cited by 307 · see citing works
DestVI identifies continuums of cell types in spatial transcriptomics data
Lopez, R., Li, B., Keren-Shaul, H., Boyeau, P., Kedmi, M., Pilzer, D., Jelinski, A., Yofe, I., David, E., Wagner, A., et al. (2022) · Nature Biotechnology · doi:10.1038/s41587-022-01272-8 · Cited by 276 · see citing works
“Unlike other methods, DestVI learns both discrete cell-type-specific profiles and continuous sub-cell-type latent variations using a conditional deep generative model 18 .”
BackgroundMethodSelf-citationMosaic integration and knowledge transfer of single-cell multimodal data with MIDAS
He, Z., Hu, S., Chen, Y., An, S., Zhou, J., Liu, R., Shi, J., Wang, J., Dong, G., Shi, J., et al. (2024) · Nature Biotechnology · doi:10.1038/s41587-023-02040-y · Cited by 84 · see citing works
“The MIDAS model MIDAS is a deep generative model 35,36 that represents the joint distribution of incomplete single-cell multimodal data with assay for transposase-accessible chromatin (ATAC), RNA and antibody-derived tags (ADT) measurements.”
Design of synthetic promoters for cyanobacteria with generative deep-learning model
Seo, E., Choi, Y.-N., Shin, Y. R., Kim, D., & Lee, J. W. (2023) · Nucleic Acids Research · doi:10.1093/nar/gkad451 · Cited by 61 · see citing works
Plattner, C., Lamberti, G., Blattmann, P., Kirchmair, A., Rieder, D., Loncova, Z., Sturm, G., Scheidl, S., Ijsselsteijn, M., Fotakis, G., et al. (2023) · iScience · doi:10.1016/j.isci.2023.108399 · Cited by 27 · see citing works
A Systematic Comparison of Single-Cell Perturbation Response Prediction Models
Li, L., You, Y., Fu, Y., Liao, W., Fan, X., Lu, S., Cao, Y., Li, B., Ren, W., Kong, J., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.12.23.630036 · Cited by 25 · see citing works
A systematic comparison of single-cell perturbation response prediction models
Li, L., You, Y., Fu, Y., Liao, W., Fan, X., Lu, S., Cao, Y., Li, B., Ren, W., Kong, J., et al. (2026) · Science Advances · doi:10.1126/sciadv.aed3414 · Cited by 1 · see citing works
- Authors
- Lopez, R., Gayoso, A., & Yosef, N.
- Affiliations
- University of California, Berkeley (US)
- Ragon Institute of MGH, MIT and Harvard (US)
- Corresponding author
- Yosef, Nir
- Venue
- Molecular Systems Biology
- Published
- 2020-09-01
- Volume
- 16
- Issue
- 9
- Pages
- e9198-e9198
- ISSN
- 1744-4292 (ISSN-L)
- PMC
- PMC7517326
- OpenAlex
- W3088354555
- Cited by
- 82
- References
- 14
- Citations by year
- 2026: 14 · 2025: 14 · 2024: 15 · 2023: 12 · 2022: 14 · 2021: 10 · 2020: 3
- FWCI
- 0.93
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Molecular Systems Biology (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- HHS | NIH | National Institute of Allergy and Infectious Diseases (U19 AI090023)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Computational Drug Discovery Methods
- Keywords
- deep generative models, molecular biology, generative adversarial networks, variational autoencoder, molecular design, de novo molecule generation, deleterious mutation prediction, deep learning
- MeSH terms
- Deep Learning, Decision Making, Molecular Biology, Models, Statistical, Neural Networks, Computer, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review