Predicting cell morphological responses to perturbations using generative modeling
Open accessPublished version of a preprint
The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Advancements in high-throughput screenings enable the exploration of rich phenotypic readouts through high-content microscopy, expediting the development of phenotype-based drug discovery. However, analyzing large and complex high-content imaging screenings remains challenging due to incomplete sampling of perturbations and the presence of technical variations between experiments. To tackle these shortcomings, we present IMage Perturbation Autoencoder (IMPA), a generative style-transfer model predicting morphological changes of perturbations across genetic and chemical interventions. We show that IMPA accurately captures morphological and population-level changes of both seen and unseen perturbations on breast cancer and osteosarcoma cells. Additionally, IMPA accounts for batch effects and can model perturbations across various sources of technical variation, further enhancing its robustness in diverse experimental conditions. With the increasing availability of large-scale high-content imaging screens generated by academic and industrial consortia, we envision that IMPA will facilitate the analysis of microscopy data and enable efficient experimental design via in-silico perturbation prediction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712
Image Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
From Louvain to Leiden: guaranteeing well-connected communities
Traag, V. A., Waltman, L., & van Eck, N. J. (2019) · Scientific Reports · doi:10.1038/s41598-019-41695-z · Cited by 5,635 · cited 2×
“Clusters were computed using the Leiden algorithm 56 implementation in the Scanpy 68 package with default parameters.”
Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization
Huang, X., & Belongie, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.167 · Cited by 5,076
StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation
Choi, Y., Choi, M., Kim, M., Ha, J.-W., Kim, S., & Choo, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00916 · Cited by 4,163
Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules
Gómez-Bombarelli, R., Wei, J. N., Duvenaud, D., Hernández-Lobato, J. M., Sánchez-Lengeling, B., Sheberla, D., Aguilera-Iparraguirre, J., Hirzel, T. D., Adams, R. P., & Aspuru-Guzik, A. (2018) · ACS Central Science · doi:10.1021/acscentsci.7b00572 · Cited by 3,106
StarGAN v2: Diverse Image Synthesis for Multiple Domains
Choi, Y., Uh, Y., Yoo, J., & Ha, J.-W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00821 · Cited by 1,663
Molecular graph convolutions: moving beyond fingerprints
Kearnes, S., McCloskey, K., Berndl, M., Pande, V., & Riley, P. (2016) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-016-9938-8 · Cited by 1,631
Research works printed but not linked: 52
- Bickle, M. The beautiful cell: high-content screening in drug discovery. Anal. Bioanal. Chem. 398, 219–226 (2010). · DOI · Paper page
- Boutros, M., Heigwer, F. & Laufer, C. Microscopy-based high-content screening. Cell 163, 1314–1325 (2015). · DOI · Paper page
- Lin, S., Schorpp, K., Rothenaigner, I. & Hadian, K. Image-based high-content screening in drug discovery. Drug Discov. Today 25, 1348–1361 (2020). · DOI
- Chandrasekaran, S. N., Ceulemans, H., Boyd, J. D. & Carpenter, A. E. Image-based profiling for drug discovery: due for a machine-learning upgrade? Nat. Rev. Drug Discov. 20, 145–159 (2021). · DOI · Paper page
- Ji, Y. et al. Scalable and universal prediction of cellular phenotypes. bioRxiv https://doi.org/10.1101/2024.08.12.607533 (2024). · DOI
- Chandrasekaran, S. N. et al. JUMP Cell Painting dataset: morphological impact of 136,000 chemical and genetic perturbations. bioRxiv https://doi.org/10.1101/2023.03.23.534023 (2023). · DOI · Paper page
- Ljosa, V. et al. Comparison of methods for image-based profiling of cellular morphological responses to small-molecule treatment. J. Biomol. Screen. 18, 1321–1329 (2013). · DOI · Paper page
- Perakis, A. et al. Contrastive learning of single-cell phenotypic representations for treatment classification. In Machine Learning in Medical Imaging 565–575 (Springer International Publishing, Cham, 2021). https://doi.org/10.1007/978-3-030-87589-3_58. · DOI
- Kensert, A., Harrison, P. J. & Spjuth, O. Transfer learning with deep convolutional neural networks for classifying cellular morphological changes. SLAS Discov. 24, 466–475 (2019). · DOI · Paper page
- Hofmarcher, M., Rumetshofer, E., Clevert, D.-A., Hochreiter, S. & Klambauer, G. Accurate prediction of biological assays with high-throughput microscopy images and convolutional networks. J. Chem. Inf. Model. 59, 1163–1171 (2019). · DOI · Paper page
- Lafarge, M. W. et al. Capturing single-cell phenotypic variation via unsupervised representation learning. Proc. Mach. Learn. Res. 103, 315–325 (2019).
- Chow, Y. L., Singh, S., Carpenter, A. E. & Way, G. P. Predicting drug polypharmacology from cell morphology readouts using variational autoencoder latent space arithmetic. PLoS Comput. Biol. 18, e1009888 (2022). · DOI
- Goodfellow, I. J. et al. Generative Adversarial Nets. Advances in Neural Information Processing Systems https://papers.nips.cc/paper/5423-generative-adversarial-nets (2014).
- Lamiable, A. et al. Revealing invisible cell phenotypes with conditional generative modeling. Nat. Commun. 14, 6386 (2023). · DOI
- Yang, K. et al. Mol2Image: Improved conditional flow models for molecule to image synthesis. in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2021). https://doi.org/10.1109/cvpr46437.2021.00662. · DOI
- Bourou, A. et al. PhenDiff: Revealing subtle phenotypes with diffusion models in real images. in Lecture Notes in Computer Science 358–367 (Springer Nature Switzerland, Cham, 2024). https://doi.org/10.1007/978-3-031-72384-1_34. · DOI
- Wagner, S. J. et al. Structure-preserving multi-domain stain color augmentation using style-transfer with disentangled representations. in Medical Image Computing and Computer Assisted Intervention – MICCAI 2021 257–266 (Springer International Publishing, Cham, 2021). https://doi.org/10.1007/978-3-030-87237-3_25. · DOI
- Qian, W. W. et al. Batch equalization with a generative adversarial network. Bioinformatics 36, i875–i883 (2020). · DOI
- Pernice, W. M. et al. Out of distribution generalization via Interventional Style Transfer in single-cell microscopy. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) 4326–4335 (2023) https://doi.org/10.1109/CVPRW59228.2023.00455. · DOI
- Jing, Y. et al. Neural Style Transfer: A review. IEEE Trans. Vis. Comput. Graph. 26, 3365–3385 (2020). · DOI · Paper page
- Li, Y., Wang, N., Liu, J. & Hou, X. Demystifying Neural Style Transfer. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence (International Joint Conferences on Artificial Intelligence Organization, California, 2017). https://doi.org/10.24963/ijcai.2017/310. · DOI · Paper page
- Pang, Y., Lin, J., Qin, T. & Chen, Z. Image-to-Image Translation: Methods and Applications. IEEE Trans. Multimed. 24, 3859–3881 (2022). · DOI · Paper page
- Morgan, H. L. The generation of a unique machine description for chemical structures-A technique developed at chemical abstracts service. J. Chem. Doc. 5, 107–113 (1965). · DOI · Paper page
- Du, J. et al. Gene2vec: distributed representation of genes based on co-expression. BMC Genomics 20, 82 (2019). · doi:10.1186/s12864-018-5370-x · Paper page
- Zhu, J.-Y., Park, T., Isola, P. & Efros, A. A. Unpaired image-to-image translation using cycle-consistent adversarial networks. in 2017 IEEE International Conference on Computer Vision (ICCV) (IEEE, 2017). https://doi.org/10.1109/iccv.2017.244. · DOI · Paper page
- Caie, P. D. et al. High-content phenotypic profiling of drug response signatures across distinct cancer cells. Mol. Cancer Ther. 9, 1913–1926 (2010). · DOI · Paper page
- McQuin, C. et al. CellProfiler 3.0: Next-generation image processing for biology. PLoS Biol. 16, e2005970 (2018). · DOI · Paper page
- Lee, H.-Y., Tseng, H.-Y., Huang, J.-B., Singh, M. & Yang, M. Diverse image-to-image translation via disentangled representations. ECCV 36–52 (2018) https://doi.org/10.1007/978-3-030-01246-5_3. · DOI · Paper page
- Yu, X., Chen, Y., Li, T. H., Liu, S. & Li, G. Multi-mapping image-to-image translation via learning disentanglement. Neural Inf. Process Syst. 32, 2990–2999 (2019).
- Deng, Y. et al. StyTr2: Image style transfer with transformers. in 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2022). https://doi.org/10.1109/cvpr52688.2022.01104. · DOI · Paper page
- Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B. & Hochreiter, S. GANs trained by a two time-scale update rule converge to a local Nash equilibrium. Neural Inf. Process Syst. 30, 6626–6637 (2017).
- Naeem, M. F., Oh, S. J., Uh, Y., Choi, Y. & Yoo, J. Reliable Fidelity and Diversity Metrics for Generative Models. in Proceedings of the 37th International Conference on Machine Learning (eds. Iii, H. D. & Singh, A.) vol. 119 7176–7185 (PMLR, 13--18 Jul 2020).
- Schimunek, J. et al. Context-enriched molecule representations improve few-shot drug discovery. arXiv [q-bio.BM] (2023).
- Maragakis, P., Nisonoff, H., Cole, B. & Shaw, D. E. A deep-learning view of chemical space designed to facilitate drug discovery. J. Chem. Inf. Model. 60, 4487–4496 (2020). · DOI
- Li, X., Xu, Y., Yao, H. & Lin, K. Chemical space exploration based on recurrent neural networks: applications in discovering kinase inhibitors. J. Cheminform. 12, 42 (2020). · DOI
- Vukicevic, S. Current challenges and hurdles in new drug development. Clin. Ther. 38, e3 (2016). · doi:10.1016/j.clinthera.2016.07.019
- Simm, J. et al. Splitting chemical structure data sets for federated privacy-preserving machine learning. J. Cheminform. 13, 96 (2021). · DOI
- Fridland, A. & Brent, T. P. DNA replication in methotrexate-treated human lymphoblasts. Eur. J. Biochem. 57, 379–385 (1975). · doi:10.1111/j.1432-1033.1975.tb02311.x
- Carragher, N. O. Calpain inhibition: a therapeutic strategy targeting multiple disease states. Curr. Pharm. Des. 12, 615–638 (2006). · doi:10.2174/138161206775474314
- Sypetkowski, M. et al. RxRx1: A dataset for evaluating experimental batch correction methods. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) 4285–4294 (2023) https://doi.org/10.1109/CVPRW59228.2023.00451. · DOI
- Doron, M. et al. Unbiased single-cell morphology with self-supervised vision transformers. bioRxivorg (2023) https://doi.org/10.1101/2023.06.16.545359. · DOI
- Chandrasekaran, S. N. et al. Three million images and morphological profiles of cells treated with matched chemical and genetic perturbations. Nat. Methods 21, 1114–1121 (2024). · DOI · Paper page
- Ulyanov, D., Vedaldi, A. & Lempitsky, V. Instance normalization: The missing ingredient for fast stylization. arXiv [cs.CV] (2016).
- Ioffe, S. & Szegedy, C. Batch Normalization: Accelerating deep network training by reducing internal covariate shift. arXiv [cs.LG] (2015).
- He, K., Zhang, X., Ren, S. & Sun, J. Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification. in 2015 IEEE International Conference on Computer Vision (ICCV) (IEEE, 2015). https://doi.org/10.1109/iccv.2015.123. · DOI · Paper page
- Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J. & Wojna, Z. Rethinking the inception architecture for computer vision. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2016). https://doi.org/10.1109/cvpr.2016.308. · DOI · Paper page
- Otsu, N. A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9, 62–66 (1979). · DOI · Paper page
- Roerdink, J. B. T. M. & Meijster, A. The watershed transform: Definitions, algorithms and parallelization strategies. Fundam. Inform. 41, 187–228 (2000). · DOI · Paper page
- Wolf, F. A., Angerer, P. & Theis, F. J. SCANPY: large-scale single-cell gene expression data analysis. Genome Biol. 19, (2018). · DOI · Paper page
- Singh, S., Bray, M.-A., Jones, T. R. & Carpenter, A. E. Pipeline for illumination correction of images for high-throughput microscopy. J. Microsc. 256, 231–236 (2014). · DOI · Paper page
- Crete, F., Dolmiere, T., Ladret, P. & Nicolas, M. The blur effect: perception and estimation with a new no-reference perceptual blur metric. In Human Vision and Electronic Imaging XII (eds. Rogowitz, B. E., Pappas, T. N. & Daly, S. J.) (SPIE, 2007). https://doi.org/10.1117/12.702790. · DOI · Paper page
- Ihlenfeldt, W. D., Bolton, E. E. & Bryant, S. H. The PubChem chemical structure sketcher. J. Cheminform. 1, 20 (2009). · DOI
Cited by
A mini-review on perturbation modelling across single-cell omic modalities
Gavriilidis, G. I., Vasileiou, V., Orfanou, A., Ishaque, N., & Psomopoulos, F. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.04.058 · Cited by 54
Unleashing the potential of cell painting assays for compound activities and hazards prediction
Odje, F., Meijer, D., von Coburg, E., van der Hooft, J. J. J., Dunst, S., Medema, M. H., & Volkamer, A. (2024) · Frontiers in Toxicology · doi:10.3389/ftox.2024.1401036 · Cited by 11
“Zapata et al. (Zapata et al., 2023) and Palma et al. (Palma et al., 2023) both observed that the application of CP data together with small molecules primarily revolved around clustering and classi fi cation tasks on either extracted features or images.”
BackgroundHarnessing induced pluripotent stem cells and organoids for disease modeling and precision medicine
Lee, C.-J., Nam, Y., Rim, Y. A., & Ju, J. H. (2026) · Stem Cell Research & Therapy · doi:10.1186/s13287-026-04906-9 · Cited by 8
Metadata
- Authors
- Palma, A., Theis, F. J., & Lotfollahi, M.
- Venue
- Nature Communications
- Published
- 2025-01-08
- Volume
- 16
- Issue
- 1
- Pages
- 505-505
- ISSN
- 2041-1723 (ISSN-L)
- OpenAlex
- W4406170632
- Cited by
- 41
- References
- 25
- FWCI
- 11.27
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Predicting cell morphological responses to perturbations using generative modeling. https://app.cochat.ai/papers/10.1038/s41467-024-55707-8
- The paper
- Palma, A., Theis, F. J., & Lotfollahi, M. (2025). Predicting cell morphological responses to perturbations using generative modeling. Nature Communications. https://doi.org/10.1038/s41467-024-55707-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.