CoChat

Predicting cell morphological responses to perturbations using generative modeling

Open access
Palma, Alessandro, Theis, Fabian J., Lotfollahi, Mohammad · 2025 · Nature Communications

Published version of a preprint

Cited by 41

The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.

Abstract

Advancements in high-throughput screenings enable the exploration of rich phenotypic readouts through high-content microscopy, expediting the development of phenotype-based drug discovery. However, analyzing large and complex high-content imaging screenings remains challenging due to incomplete sampling of perturbations and the presence of technical variations between experiments. To tackle these shortcomings, we present IMage Perturbation Autoencoder (IMPA), a generative style-transfer model predicting morphological changes of perturbations across genetic and chemical interventions. We show that IMPA accurately captures morphological and population-level changes of both seen and unseen perturbations on breast cancer and osteosarcoma cells. Additionally, IMPA accounts for batch effects and can model perturbations across various sources of technical variation, further enhancing its robustness in diverse experimental conditions. With the increasing availability of large-scale high-content imaging screens generated by academic and industrial consortia, we envision that IMPA will facilitate the analysis of microscopy data and enable efficient experimental design via in-silico perturbation prediction.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41467-024-55707-8

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 25 references

Research works printed but not linked: 52

  1. Bickle, M. The beautiful cell: high-content screening in drug discovery. Anal. Bioanal. Chem. 398, 219–226 (2010). · DOI · Paper page
  2. Boutros, M., Heigwer, F. & Laufer, C. Microscopy-based high-content screening. Cell 163, 1314–1325 (2015). · DOI · Paper page
  3. Lin, S., Schorpp, K., Rothenaigner, I. & Hadian, K. Image-based high-content screening in drug discovery. Drug Discov. Today 25, 1348–1361 (2020). · DOI
  4. Chandrasekaran, S. N., Ceulemans, H., Boyd, J. D. & Carpenter, A. E. Image-based profiling for drug discovery: due for a machine-learning upgrade? Nat. Rev. Drug Discov. 20, 145–159 (2021). · DOI · Paper page
  5. Ji, Y. et al. Scalable and universal prediction of cellular phenotypes. bioRxiv https://doi.org/10.1101/2024.08.12.607533 (2024). · DOI
  6. Chandrasekaran, S. N. et al. JUMP Cell Painting dataset: morphological impact of 136,000 chemical and genetic perturbations. bioRxiv https://doi.org/10.1101/2023.03.23.534023 (2023). · DOI · Paper page
  7. Ljosa, V. et al. Comparison of methods for image-based profiling of cellular morphological responses to small-molecule treatment. J. Biomol. Screen. 18, 1321–1329 (2013). · DOI · Paper page
  8. Perakis, A. et al. Contrastive learning of single-cell phenotypic representations for treatment classification. In Machine Learning in Medical Imaging 565–575 (Springer International Publishing, Cham, 2021). https://doi.org/10.1007/978-3-030-87589-3_58. · DOI
  9. Kensert, A., Harrison, P. J. & Spjuth, O. Transfer learning with deep convolutional neural networks for classifying cellular morphological changes. SLAS Discov. 24, 466–475 (2019). · DOI · Paper page
  10. Hofmarcher, M., Rumetshofer, E., Clevert, D.-A., Hochreiter, S. & Klambauer, G. Accurate prediction of biological assays with high-throughput microscopy images and convolutional networks. J. Chem. Inf. Model. 59, 1163–1171 (2019). · DOI · Paper page
  11. Lafarge, M. W. et al. Capturing single-cell phenotypic variation via unsupervised representation learning. Proc. Mach. Learn. Res. 103, 315–325 (2019).
  12. Chow, Y. L., Singh, S., Carpenter, A. E. & Way, G. P. Predicting drug polypharmacology from cell morphology readouts using variational autoencoder latent space arithmetic. PLoS Comput. Biol. 18, e1009888 (2022). · DOI
  13. Goodfellow, I. J. et al. Generative Adversarial Nets. Advances in Neural Information Processing Systems https://papers.nips.cc/paper/5423-generative-adversarial-nets (2014).
  14. Lamiable, A. et al. Revealing invisible cell phenotypes with conditional generative modeling. Nat. Commun. 14, 6386 (2023). · DOI
  15. Yang, K. et al. Mol2Image: Improved conditional flow models for molecule to image synthesis. in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2021). https://doi.org/10.1109/cvpr46437.2021.00662. · DOI
  16. Bourou, A. et al. PhenDiff: Revealing subtle phenotypes with diffusion models in real images. in Lecture Notes in Computer Science 358–367 (Springer Nature Switzerland, Cham, 2024). https://doi.org/10.1007/978-3-031-72384-1_34. · DOI
  17. Wagner, S. J. et al. Structure-preserving multi-domain stain color augmentation using style-transfer with disentangled representations. in Medical Image Computing and Computer Assisted Intervention – MICCAI 2021 257–266 (Springer International Publishing, Cham, 2021). https://doi.org/10.1007/978-3-030-87237-3_25. · DOI
  18. Qian, W. W. et al. Batch equalization with a generative adversarial network. Bioinformatics 36, i875–i883 (2020). · DOI
  19. Pernice, W. M. et al. Out of distribution generalization via Interventional Style Transfer in single-cell microscopy. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) 4326–4335 (2023) https://doi.org/10.1109/CVPRW59228.2023.00455. · DOI
  20. Jing, Y. et al. Neural Style Transfer: A review. IEEE Trans. Vis. Comput. Graph. 26, 3365–3385 (2020). · DOI · Paper page
  21. Li, Y., Wang, N., Liu, J. & Hou, X. Demystifying Neural Style Transfer. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence (International Joint Conferences on Artificial Intelligence Organization, California, 2017). https://doi.org/10.24963/ijcai.2017/310. · DOI · Paper page
  22. Pang, Y., Lin, J., Qin, T. & Chen, Z. Image-to-Image Translation: Methods and Applications. IEEE Trans. Multimed. 24, 3859–3881 (2022). · DOI · Paper page
  23. Morgan, H. L. The generation of a unique machine description for chemical structures-A technique developed at chemical abstracts service. J. Chem. Doc. 5, 107–113 (1965). · DOI · Paper page
  24. Du, J. et al. Gene2vec: distributed representation of genes based on co-expression. BMC Genomics 20, 82 (2019). · doi:10.1186/s12864-018-5370-x · Paper page
  25. Zhu, J.-Y., Park, T., Isola, P. & Efros, A. A. Unpaired image-to-image translation using cycle-consistent adversarial networks. in 2017 IEEE International Conference on Computer Vision (ICCV) (IEEE, 2017). https://doi.org/10.1109/iccv.2017.244. · DOI · Paper page
  26. Caie, P. D. et al. High-content phenotypic profiling of drug response signatures across distinct cancer cells. Mol. Cancer Ther. 9, 1913–1926 (2010). · DOI · Paper page
  27. McQuin, C. et al. CellProfiler 3.0: Next-generation image processing for biology. PLoS Biol. 16, e2005970 (2018). · DOI · Paper page
  28. Lee, H.-Y., Tseng, H.-Y., Huang, J.-B., Singh, M. & Yang, M. Diverse image-to-image translation via disentangled representations. ECCV 36–52 (2018) https://doi.org/10.1007/978-3-030-01246-5_3. · DOI · Paper page
  29. Yu, X., Chen, Y., Li, T. H., Liu, S. & Li, G. Multi-mapping image-to-image translation via learning disentanglement. Neural Inf. Process Syst. 32, 2990–2999 (2019).
  30. Deng, Y. et al. StyTr2: Image style transfer with transformers. in 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2022). https://doi.org/10.1109/cvpr52688.2022.01104. · DOI · Paper page
  31. Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B. & Hochreiter, S. GANs trained by a two time-scale update rule converge to a local Nash equilibrium. Neural Inf. Process Syst. 30, 6626–6637 (2017).
  32. Naeem, M. F., Oh, S. J., Uh, Y., Choi, Y. & Yoo, J. Reliable Fidelity and Diversity Metrics for Generative Models. in Proceedings of the 37th International Conference on Machine Learning (eds. Iii, H. D. & Singh, A.) vol. 119 7176–7185 (PMLR, 13--18 Jul 2020).
  33. Schimunek, J. et al. Context-enriched molecule representations improve few-shot drug discovery. arXiv [q-bio.BM] (2023).
  34. Maragakis, P., Nisonoff, H., Cole, B. & Shaw, D. E. A deep-learning view of chemical space designed to facilitate drug discovery. J. Chem. Inf. Model. 60, 4487–4496 (2020). · DOI
  35. Li, X., Xu, Y., Yao, H. & Lin, K. Chemical space exploration based on recurrent neural networks: applications in discovering kinase inhibitors. J. Cheminform. 12, 42 (2020). · DOI
  36. Vukicevic, S. Current challenges and hurdles in new drug development. Clin. Ther. 38, e3 (2016). · doi:10.1016/j.clinthera.2016.07.019
  37. Simm, J. et al. Splitting chemical structure data sets for federated privacy-preserving machine learning. J. Cheminform. 13, 96 (2021). · DOI
  38. Fridland, A. & Brent, T. P. DNA replication in methotrexate-treated human lymphoblasts. Eur. J. Biochem. 57, 379–385 (1975). · doi:10.1111/j.1432-1033.1975.tb02311.x
  39. Carragher, N. O. Calpain inhibition: a therapeutic strategy targeting multiple disease states. Curr. Pharm. Des. 12, 615–638 (2006). · doi:10.2174/138161206775474314
  40. Sypetkowski, M. et al. RxRx1: A dataset for evaluating experimental batch correction methods. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) 4285–4294 (2023) https://doi.org/10.1109/CVPRW59228.2023.00451. · DOI
  41. Doron, M. et al. Unbiased single-cell morphology with self-supervised vision transformers. bioRxivorg (2023) https://doi.org/10.1101/2023.06.16.545359. · DOI
  42. Chandrasekaran, S. N. et al. Three million images and morphological profiles of cells treated with matched chemical and genetic perturbations. Nat. Methods 21, 1114–1121 (2024). · DOI · Paper page
  43. Ulyanov, D., Vedaldi, A. & Lempitsky, V. Instance normalization: The missing ingredient for fast stylization. arXiv [cs.CV] (2016).
  44. Ioffe, S. & Szegedy, C. Batch Normalization: Accelerating deep network training by reducing internal covariate shift. arXiv [cs.LG] (2015).
  45. He, K., Zhang, X., Ren, S. & Sun, J. Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification. in 2015 IEEE International Conference on Computer Vision (ICCV) (IEEE, 2015). https://doi.org/10.1109/iccv.2015.123. · DOI · Paper page
  46. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J. & Wojna, Z. Rethinking the inception architecture for computer vision. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2016). https://doi.org/10.1109/cvpr.2016.308. · DOI · Paper page
  47. Otsu, N. A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9, 62–66 (1979). · DOI · Paper page
  48. Roerdink, J. B. T. M. & Meijster, A. The watershed transform: Definitions, algorithms and parallelization strategies. Fundam. Inform. 41, 187–228 (2000). · DOI · Paper page
  49. Wolf, F. A., Angerer, P. & Theis, F. J. SCANPY: large-scale single-cell gene expression data analysis. Genome Biol. 19, (2018). · DOI · Paper page
  50. Singh, S., Bray, M.-A., Jones, T. R. & Carpenter, A. E. Pipeline for illumination correction of images for high-throughput microscopy. J. Microsc. 256, 231–236 (2014). · DOI · Paper page
  51. Crete, F., Dolmiere, T., Ladret, P. & Nicolas, M. The blur effect: perception and estimation with a new no-reference perceptual blur metric. In Human Vision and Electronic Imaging XII (eds. Rogowitz, B. E., Pappas, T. N. & Daly, S. J.) (SPIE, 2007). https://doi.org/10.1117/12.702790. · DOI · Paper page
  52. Ihlenfeldt, W. D., Bolton, E. E. & Bryant, S. H. The PubChem chemical structure sketcher. J. Cheminform. 1, 20 (2009). · DOI

Cited by

See all 41

Metadata

Authors
Palma, A., Theis, F. J., & Lotfollahi, M.
Venue
Nature Communications
Published
2025-01-08
Volume
16
Issue
1
Pages
505-505
ISSN
2041-1723 (ISSN-L)
OpenAlex
W4406170632
Cited by
41
References
25
FWCI
11.27
Type
journal article
Language
en
Open access
gold
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Predicting cell morphological responses to perturbations using generative modeling. https://app.cochat.ai/papers/10.1038/s41467-024-55707-8
The paper
Palma, A., Theis, F. J., & Lotfollahi, M. (2025). Predicting cell morphological responses to perturbations using generative modeling. Nature Communications. https://doi.org/10.1038/s41467-024-55707-8

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.