The DOI matches its Crossref record; 88 of the 88 references it cites were found in a registry or an index.
A visual-language foundation model for computational pathology
Open accessAbstract
The accelerated adoption of digital pathology and advances in deep learning have enabled the development of robust models for various pathology tasks across a diverse array of diseases and patient cohorts. However, model training is often difficult due to label scarcity in the medical domain, and a model’s usage is limited by the specific task and disease for which it is trained. Additionally, most models in histopathology leverage only image data, a stark contrast to how humans teach each other and reason about histopathologic entities. We introduce CONtrastive learning from Captions for Histopathology (CONCH), a visual-language foundation model developed using diverse sources of histopathology images, biomedical text and, notably, over 1.17 million image–caption pairs through task-agnostic pretraining. Evaluated on a suite of 14 diverse benchmarks, CONCH can be transferred to a wide range of downstream tasks involving histopathology images and/or text, achieving state-of-the-art performance on histology image classification, segmentation, captioning, and text-to-image and image-to-text retrieval. CONCH represents a substantial leap over concurrent visual-language pretrained systems for histopathology, with the potential to directly facilitate a wide array of machine learning-based workflows requiring minimal or no further supervised fine-tuning. Developed using diverse sources of histopathology images, biomedical text and over 1.17 million image–caption pairs, evaluated on a suite of 14 diverse benchmarks, a visual-language foundation model achieves state-of-the-art performance on a wide array of clinically relevant pathology tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Similarly, given a diagnostically challenging WSI, retrieving a similar WSI via slide search5,46–53 or pathology reports through cross-modal report search10,54–56 typically requires specialized algorithms to bridge the gap between fine-grained patch embeddings and slide-level information, introducing hurdles to clinical adoption.”
From A multimodal whole-slide foundation model for pathology (2025) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The choice of CONCHv1.5 for feature extraction was due to the fact that the model was pretrained on histology regions with diverse stains and tissue types, including FFPE, frozen tissue and IHC, thereby yielding region features that are robust against diverse tissue processing protocols.”
From A multimodal whole-slide foundation model for pathology (2025) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“By increasing the patch size from the widely used 256 × 256 pixels, we effectively reduce the sequence length by four without impacting the representation quality due to higher resolution patch input, leveraging the robustness of the patch-level foundation models in generalizing to higher resolutions9,10,87.”
From A multimodal whole-slide foundation model for pathology (2025) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“enabling it to create effective representations for non–H&E (hematoxylin and eosin)-stained images, such as immunohistochemistry and special stains, without relying on large public histology slide collections such as The Cancer Genome Atlas, Pancreatic Cancer AI Platform, and Genotype-Tissue Expression.”
From Multimodal Large Language Models in Health Care: Applications, Challenges, and Future Outlook. (2024) · cites this paper as [141]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“CONCH is a vision-language M-LLM specifically designed for computational histopathology.”
From Multimodal Large Language Models in Health Care: Applications, Challenges, and Future Outlook. (2024) · cites this paper as [141]
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To overcome these limitations, several research groups have alternatively proposed the use of weakly-supervised deep learning models, which can be trained to perform various downstream computational pathology tasks such as tumor subtyping and prognosis32–37 without any region or pixel-level annotations.”
From Predicting the tumor microenvironment composition and immunotherapy response in non-small cell lung cancer from digital histopathology images (2024) · cites this paper as [34]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Following the success of previous studies10, we use CoCa95, a state-of-the-art visual-language foundation model pretraining method, for both stages of vision-language alignment.”
From A multimodal whole-slide foundation model for pathology (2025) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“Contrastive vision language models in pathology, such as PLIP12 and CONCH13, align text and images at the patch-level.”
From Generating dermatopathology reports from gigapixel whole slide images with HistoGPT (2025) · cites this paper as [13]
The cited source says what the claim attributes to it.
In the citing paper
“They are zero-shot learners, i.e., they can solve downstream tasks for which they have not been trained (e.g., cancer subtyping).”
From Generating dermatopathology reports from gigapixel whole slide images with HistoGPT (2025) · cites this paper as [13]
The cited source says what the claim attributes to it.
In the citing paper
“It is pretrained on the largest histopathology-specific vision-language data set”
From Multimodal Large Language Models in Health Care: Applications, Challenges, and Future Outlook. (2024) · cites this paper as [141]
The cited source says what the claim attributes to it.
In the citing paper
“PLIP [194] and CONCH [195] were pretrained on paired pathology images and text descriptions using contrastive learning methods.”
From Challenges in AI-driven Biomedical Multimodal Data Fusion and Analysis (2025) · cites this paper as [195]
In the citing paper
“Several studies have developed visual–language foundation models using paired histopathology images and captions11,12.”
From A visual–omics foundation model to bridge histopathology with spatial transcriptomics (2025) · cites this paper as [11]
In the citing paper
“Existing dual-modality foundation models in computational biology11,12 primarily combine images with textual descriptions, proving their utility in histopathology annotation and analysis.”
From A visual–omics foundation model to bridge histopathology with spatial transcriptomics (2025) · cites this paper as [11]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Measures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 12,187
Learning to Prompt for Vision-Language Models
Zhou, K., Yang, J., Loy, C. C., & Liu, Z. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01653-1 · Cited by 3,304
Ehteshami Bejnordi, B., Veta, M., Johannes van Diest, P., van Ginneken, B., Karssemeijer, N., Litjens, G., van der Laak, J. A. W. M., and the CAMELYON16 Consortium, Hermsen, M., Manson, Q. F., et al. (2017) · JAMA · doi:10.1001/jama.2017.14585 · Cited by 3,293
Coudray, N., Ocampo, P. S., Sakellaropoulos, T., Narula, N., Snuderl, M., Fenyö, D., Moreira, A. L., Razavian, N., & Tsirigos, A. (2018) · Nature Medicine · doi:10.1038/s41591-018-0177-5 · Cited by 2,930
Clinical-grade computational pathology using weakly supervised deep learning on whole slide images
Campanella, G., Hanna, M. G., Geneslaw, L., Miraflor, A., Werneck Krauss Silva, V., Busam, K. J., Brogi, E., Reuter, V. E., Klimstra, D. S., & Fuchs, T. J. (2019) · Nature Medicine · doi:10.1038/s41591-019-0508-1 · Cited by 2,799
Data-efficient and weakly supervised computational pathology on whole-slide images
Lu, M. Y., Williamson, D. F. K., Chen, T. Y., Chen, R. J., Barbieri, M., & Mahmood, F. (2021) · Nature Biomedical Engineering · doi:10.1038/s41551-020-00682-w · Cited by 2,282
Self-citation
Research works printed but not linked: 13
- Li, J., Li, D., Xiong, C. & Hoi, S. BLIP: bootstrapping language–image pre-training for unified vision-language understanding and generation. In International Conference on Machine Learning (eds Chaudhur, K. et al.) 12888–12900 (PMLR, 2022).
- Maleki, D. & Tizhoosh, H. R. LILE: look in-depth before looking elsewhere—a dual attention network using transformers for cross-modal information retrieval in histopathology archives. In International Conference on Medical Imaging with Deep Learning (eds Konukoglu, E. et al.) 879–894 (PMLR, 2022).
- Zhang, Y., Jiang, H., Miura, Y., Manning, C. D. & Langlotz, C. P. Contrastive learning of medical visual representations from paired images and text. In Machine Learning for Healthcare Conference (eds Lipton, Z. et al.) 2–25 (PMLR, 2022).
- Tsuneki, M. & Kanavati, F. Inference of captions from histopathological patches. In International Conference on Medical Imaging with Deep Learning (eds Konukoglu, E. et al.) 1235–1250 (PMLR, 2022).
- Zhang, R., Weber, C., Grossman, R. & Khan, A. A. Evaluating and interpreting caption prediction for histopathology images. In Machine Learning for Healthcare Conference (eds Doshi-Velez, F. et al.) 418–435 (PMLR, 2020).
- Ilse, M., Tomczak, J. & Welling, M. Attention-based deep multiple instance learning. In International Conference on Machine Learning (eds Dy, J. & Krause, A.) 2127–2136 (PMLR, 2018).
- Perez, E., Kiela, D. & Cho, K. True few-shot learning with language models. Adv. Neural Inf. Process. Syst. 34, 11054–11070 (2021).
- Dosovitskiy, A. et al. An image is worth 16×16 words: transformers for image recognition at scale. In 9th International Conference on Learning Representations https://openreview.net/forum?id=YicbFdNTTy (OpenReview.net, 2021).
- Zhou, J. et al. Image BERT pre-training with online tokenizer. In 10th International Conference on Learning Representations https://openreview.net/forum?id=ydopy-e6Dg (OpenReview.net, 2022).
- Li, J., Li, D., Savarese, S. & Hoi, S. BLIP-2: bootstrapping language–image pre-training with frozen image encoders and large language models. In Proc. 40th International Conference on Machine Learning (eds Krause, A. et al.) 19730–19742 (PMLR, 2023).
- Banerjee, S. & Lavie, A. METEOR: an automatic metric for MT evaluation with improved correlation with human judgments. In Proc. ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization 65–72 (Association for Computational Linguistics, 2005).
- Lin, C.-Y. ROUGE: a package for automatic evaluation of summaries. In Text Summarization Branches Out 74–81 (Association for Computational Linguistics, 2004).
- Lewis, M., Dauphin, Y. & Fan, A. Hierarchical neural story generation. In Proc. 56th Annual Meeting of the Association for Computational Linguistics (eds Gurevych, I. & Miyao, Y.) 889–898 (Association for Computational Linguistics, 2018).
Cited by
Sorted by citations
Items 901–968 of 968
Joint Biomarker and Survival Prediction via Concept-Conditioned Multimodal Slot Factorization
黄祖奇, Mao, L., Li, W., Dong, T., Tian, M., Tang, Z., & Li, Z. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38172-9_33
PALETTE: Pathology-Aware Latent Embedding for Targeted Tissue Expression
Ma, R., Lu, M., Fu, Y., Ma, X., & Xia, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38470-6_53
Self-citationNamgung, H., Kim, S., & Park, S. H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38224-5_16
Learnable Gaussian Prototype Guided Ordinal Learning for Fine-Grained WSI Grading
Deng, Y., Zhang, Q., Tang, H., Zhou, C., Gao, L., Wang, J., Sun, L., Wang, Y., Zou, D., Xiong, H., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38224-5_24
Spectral-Semantic Consensus for Few-Shot Whole Slide Image Classification
Du, H., Zhou, P., Shi, W., Wei, Z., Chen, Y., Du, B., & Xu, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38224-5_48
Cai, M., Zhao, J., Yue, W., Zhao, L., Zeng, Y., Zhang, L., & Qiang, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38224-5_13
Confusion-Aware Evidence Calibration for Few-Shot Whole Slide Image Classification
Li, P., Yan, X., Ma, G., Tang, H., Wei, M., & Qin, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38224-5_7
Qi, M., Li, H., Lu, Y., & Wei, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38224-5_17
Cancer-Type-Agnostic Pan-Cancer Gene Expression Prediction from Histopathological Images
Shen, Y., Li, B., Wang, H., Chen, Z., Li, Z., & Li, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38470-6_39
GeneRAG: A Retrieval-Augmented Framework for Spatially Resolved Gene Expression Prediction
Kim, H., Kim, S., Cho, M., Jo, S., Lee, M., & Kim, K. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38470-6_48
Aligning Prototypes and Updating Null Spaces for Continual WSI Learning
Li, X., Xiao, K., & Chan, A. B. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38224-5_3
Kim, J., Ssemakula, P., Song, C., & Yi, M. Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38224-5_45
Addressing Tissue and Appearance Heterogeneity in Text-Guided Few-Shot WSI Classification
Li, Y., Xu, Z., Shi, X., Huang, Z., Ye, X., Zhang, M., Wang, Z., Xu, R., Chen, Y.-W., & Xing, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38224-5_1
Xiong, L., Zhang, Y., Song, H., Peng, Q., & Cui, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38062-3_55
HistoDiffusion++: A generative visual foundation model for histopathology
Jin, P., Ye, J., Ni, H., Zeng, Y., Huang, S., & Xue, Y. (2026) · Medical Image Analysis · doi:10.1016/j.media.2026.104328
AI-Enabled Digital Health Tool Implementation in Clinical Practice Settings: Umbrella Review
Gilbert, A. S., Gacad, A., Parrish, L. J., Nguyen, O. T., Turner, K. L., Tarver, W. L., Jonnalagadda, P., Tsagli, D. D., Wu, B., Lu, C., et al. (2026) · JMIR AI · doi:10.2196/101509
Biologically grounded cell profiling across microscopy modalitiesPreprint
Ye, E., Wu, X., Peng, R., Hu, W., Li, X., Zhang, X., Niu, M., Guo, Y., Sheng, X., Wang, J., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.09.23.753678
Wu, D., Zhang, J., Shi, M., Xu, B., Fan, S., Zhang, W., & Wang, F. (2026) · Frontiers in Oncology · doi:10.3389/fonc.2026.1849274
“These features highlight its signi fi cant potential and extensive applicability in the fi eld of computational pathology (15).”
InfluentialXu, N., Chen, A., Ruan, H., Yang, D.-L., Liao, R.-J., Qi, X., Fong, S., Cao, D.-D., Yu, L., Huang, Y.-H., et al. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001744
“Many widely used histopathology foundation models have been developed and extensively benchmarked in cancer-heavy settings [20–22].”
Xu, G., Zhang, L., & Zhang, K. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114975
Foundation Model Representations for Scalable Content-Based Retrieval in Whole-Slide Histopathology
Matveeva, S., Krylov, A. S., & Khvostikov, A. V. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39382-1_15
Chiu, Y. (2026) · IEEE Access · doi:10.1109/access.2026.3739102
“5, Virchow2, Prov-GigaPath, CTransPath, Phikon, and H-optimus [18], [19], [20], [21], [22], [23], [24], whose slide embeddings have incompatible dimensionality.”
TMAC-GAN: Topology and Marker-Aware Chromatic Learning for Virtual Stain
Pi, S., Ye, Z., Hu, X., Xiao, C., & Mei, L. (2026) · Cybernetics & Systems · doi:10.1080/01969722.2026.2736031
“Large-scale pathology foundation models, such as UNI (Chen, Zhang, et al. 2024), CONCH (Lu et al. 2024), and Prov-GigaPath (Xu et al. 2024), further demonstrate the value of transferable histopathology representations and multimodal vision-language alignment.”
Virtual Staining for Nonlinear Imaging of Cancers
Deng, Z., Wu, Y., & Zhang, A. (2026) · Microscopy Research and Technique · doi:10.1002/jemt.70188
Self-citationBridging the Spatial Blind Spot in Pathology Foundation Models for Tumor Localization
Xu, G., & Zhang, K. (2026) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3776574.3831210
“These descriptions are encoded by the frozen text encoder of CONCH [18] to produce pro-totypes { p 𝑐 } 𝐶𝑐 = 1 .”
InfluentialA survey of LLM reasoning in healthcare and medicine: Individual modeling and collaborative agents
Lin, Q., Xiao, L., Pu, B., Shi, K., Du, Y., Xu, J., He, K., Zhao, S., Zhang, J., Cambria, E., et al. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104827 · Cited by 1
Üstüner, E., & Öz, M. (2026) · Veterinary Research Communications · doi:10.1007/s11259-026-11567-9
AI‐Assisted Micronucleus Detection: A Critical Systematic Review With Quantitative Synthesis
Paul, S. (2026) · Cell Biology International · doi:10.1002/cbin.70225
“Moderate due to scoring criteria codified (HUMN/BMCyt), but joint automated detection not yet benchmarked. prediction (Chen et al. 2024; Ding et al. 2025; Lu et al. 2024; Vorontsov et al. 2024; Xu et al. 2024).”
Lesion-Aware Multiple-Instance Learning for Grapevine Disease Recognition from Field RGB Images
Öztürk, Ö., Canbula, B., Özacar, T., & Ozacar, V. (2026) · Sensors · doi:10.3390/s26196318
“More recent pathology foundation models, including UNI and CONCH, demonstrate how strong pre-trained visual or vision-language encoders can support patch-based aggregation [31,32].”
Wang, Y., Chen, W., Rajab, A., Liu, W., Jin, Y., Srisuwananukorn, A., & Zhang, P. (2026) · doi:10.1109/cvprf71909.2026.00535 · Cited by 2
“CONCH [29] scales their pretraining to 1.17M image-caption pairs and outperforms across 14 benchmarks (classification, segmentation, retrieval, captioning).”
AceMIL: Ordinal-Aware Multiple Instance Learning for Pathological Progression Analysis
Li, S., Chen, Y., Gong, Y., Zhou, H., Chen, F.-J., Gao, X., & Chen, Z. (2026) · doi:10.1109/cvprf71909.2026.00513
“Furthermore, large-scale pathological foundation models [6, 11, 34, 54, 56, 57] have further enhanced the generalization capability of MIL through multi-modal integration and cross-center pretraining.”
Guo, P., Wang, J., Chen, Z., Cao, C. C., Wang, L., Jiang, T., & Chen, L. (2026) · doi:10.1109/cvprf71909.2026.00510
TICON: A Slide-Level Tile Contextualizer for Histopathology Representation Learning
Belagali, V., Kapse, S., Marza, P., Das, S., Li, Z., Boutaj, S., Pati, P., Yellapragada, S., Nandi, T., Madduri, R., et al. (2026) · doi:10.1109/cvprf71909.2026.00523
“We can divide them into two main categories: (i) vision-only models trained with an iBOT [68] or DINOv2 [41]-style ob-jective [6, 11, 12, 27, 38, 48, 55, 58, 60, 65, 70] and (ii) vision-language models trained with a CLIP-[45]-style pre-training [9, 19, 20, 32, 51, 63, 69].”
Mitigating Batch Effects in Histopathology via Language-Mediated Robust Embedding Generation
Zhang, Y., Wu, S., Zhang, Z., Li, D., Yao, H., Li, Y., Carmichael, I. D., Hoadley, K. A., Zhu, H., Wu, D., et al. (2026) · doi:10.1109/cvprf71909.2026.00500
“Recent work learns semantically invariant features by aligning histology images with paired pathology texts [35, 36, 47].”
Vardar, D. Ö., & Vardar, N. (2026) · Diagnostics · doi:10.3390/diagnostics16203271
“Pathology foundation models provide a modular alternative by learning trans-ferable representations from large and heterogeneous histopathology collections [12–14].”
Yoo, S., & Goh, W. W. B. (2026) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2026.111979
Explaining Visual-Language Foundation Models for Histopathology: A Patch-Level Approach
Coelho, B., & Cardoso, J. S. (2026) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms69103.2026.00237
“…Resilience Mechanism (MRR) of the European Union (EU), framed in the Next Generation EU, for the period 2021 - 2026, within project NewSpacePortugal, with reference 11. models based on CLIP-like architectures such as CONCH [5], PathGen [7], and MUSK [10] have gained popularity within the community.”
A unified and domain-robust framework enables controllable multimodal brain MRI synthesis
Zheng, H., Xing, Z., Zhu, L., Bao, J., He, Y., Wu, Z., Yang, J., Li, H., Zhu, X., Zhou, Y., et al. (2026) · Medical Image Analysis · doi:10.1016/j.media.2026.104348
Innani, S., Pitarch, C., Majeed, M. M., Harmsen, H. J., Bell, W. R., Makris, D., & Bakas, S. (2026) · Cancers · doi:10.3390/cancers18203259
Zhang, W., Zhang, S., Wei, Y., Zhao, Y., Yuan, W., Wu, X., Lu, X., Yin, T., Yang, L., Yi, Y., et al. (2026) · Laboratory Investigation · doi:10.1016/j.labinv.2026.106169
Towards scalable cancer prognosis by aligning semi-supervised learning with survival modeling
Huang, Y., Cai, L., Feng, Z., Zhao, M., Tu, X., Yuan, Z., & Wang, Z. (2026) · Medical Image Analysis · doi:10.1016/j.media.2026.104347
Foundation Models and Vision-Language Models in Medical Imaging: A Review
Mohsen, S., Lulu, L. M., Eassa, M., Raafat, R., Tawdrous, M. I., & Ibrahim, A. F. (2026) · Computers · doi:10.3390/computers15100707
Lee, S., Hong, J., Kim, S., Hwang, Y., Song, J., & Shin, M. (2026) · Applied Sciences · doi:10.3390/app162010067
Foundation Models and Multimodal Learning for Medical Data with Applications in Oncology
Waqas, A., Tripathi, A., Sivaram, S., Ali, F., Kuanar, S., Singh, Y., Ajami, H., Ünal, O., Huo, Y., Elhanashi, A., et al. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02319-x
Kutlu, H. (2026) · Adıyaman Üniversitesi Mühendislik Bilimleri Dergisi · doi:10.54365/adyumbd.2002976
Mitigating Domain Shift and Dataset Bias in Deep Learning Models for Cancer Diagnostics
Ameyaw, S. A., & Ameyaw, J. A. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02353-9
DeepLNM: A Multimodal Model for Predicting Lymph Node Metastasis in Colorectal Cancer
Zhang, Z., Lu, C., Wang, Z., Cen, Z., Zhou, Y., Li, D., Xie, Q., Li, B., Guo, S., 甘志军, et al. (2026) · Advanced Science · doi:10.1002/advs.77860
Samarin, A., Nazarenko, A., Nazarenko, D., Afonina, J., Kotenko, E., Dozortseva, A., Mamaeva, A., Savelev, A., Narova, G., Mikhailova, E., et al. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8100330
Alpha Spatial: Language-guided prediction of single-cell spatial gene expression from histologyPreprint
YANG, X., Guo, Z., GUO, X., Wang, W., Bai, B., Liu, X., Zhang, C., He, Y., & LIU, Y. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.10.08.756444
ExpertTwins: Auditable Long Horizon Scientific Panels through Grounded ExpertisePreprint
pour, A. F., & Shirinifard, A. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.10.06.757114
Huang, Z., Liu, Y., Jin, S., Wang, Y., Fu, M., Ouyang, J., Yu, D., Zhu, T., Zeng, F., Pan, X., et al. (2026) · iScience · doi:10.1016/j.isci.2026.117744
“…four prominent computational pathology foundation models: universal foundations (UNI 14 and Virchow2 15 ), a state-of-the-art vision-language model (CONCH 19 ), and a specialized pathol-ogy-specific baseline (CTransPath 20 ), which is built upon a hierarchical shifted-window Transformer backbone.”
Artificial intelligence in spatial transcriptomics: a review of methods, datasets, and directions
Sharma, N., Şen, R., & Erdem, C. (2026) · Briefings in Bioinformatics · doi:10.1093/bib/bbag569
“For example, pre-trained models like PLIP [ 236], BiomedCLIP [ 237], OpenAICLIP [ 238], and CONCH [ 239] effectively align ST with imaging and omics data [ 240].”
Clinical Concept Sensitivity and Visual Attention Analysis for Breast Cancer Detection
Kumari, A., & Rani, S. (2026) · International Conference on Computational Intelligence Systems and Devices (ICCISD) · doi:10.1109/iccisd69924.2026.11731961
“Using contrastive learning on large-scale image-text pairs, models such as CONCH [4], PLIP [2], PathGen-CLIP [10], QuiltNet [3], and KEEP [15] are enabling zero-shot classification through natural language prompts.”
InfluentialBeyond Segmentation Accuracy: Evaluating Biological Fidelity in Spatial PathologyPreprint
Dimitrova, N., Stoimchev, M., Filliol, A., Flowers, S., Cipriano, A., Suresh, P., Romesser, P., & Lowe, S. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.10.17.759841
“…14, 15] give strong frozen features for dense prediction, and pathology foundation models continue their pretraining on histology at scale [20, 21, 22], but whether that helps instance-level tasks over the foundation they start from is largely untested; our comparison varies only the encoder…”
Haugg, F., Lee, G., He, J., Nürnberg, L., Bontempi, D., Bitterman, D. S., Catalano, P., Prudente, V., Glubokov, D., Warrington, A., et al. (2026) · The Lancet Digital Health · doi:10.1016/j.landig.2026.101056 · Cited by 2
Li, S., Zhu, Y., He, R., Qu, X., Ni, Y., & Liu, J. (2026) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2026.109506
Beyond generalist AI: purpose-built foundation models for transplantation
Jbara, L., Kanal, V., Ghosh, S., Manickavel, P., Muhundan, M., Mallavarapu, S., Bhat, V., Sharma, D., & Bhat, M. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1988867
Bertolaccini, L., Chiari, M., Degiovanni, S., Mazzella, A., Iacono, G. L., Guarize, J., Casiraghi, M., & Spaggiari, L. (2026) · Cancers · doi:10.3390/cancers18213415
Fernandez‐Martín, C., Kiraz, U., Janssen, E. A. M., Naranjo, V., Silva-Rodríguez, J., & Morales, S. (2026) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2026.109696
Cui, Z., Yang, X., Liu, Q., Wang, X., Bai, J., Yue, M., & Liu, Y. (2026) · Pathology - Research and Practice · doi:10.1016/j.prp.2026.156718
Multi-scale histology reveals localized ageing signatures in normal human colonPreprint
Altshuler, G., Teper, C., Barak, Y., Aviel‐Ronen, S., Loebel, A., & Barshack, I. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.10.20.760359
Reinforcement Learning-guided Discriminative Region Sampling in Histopathology
Song, J., Wang, X. S., Xie, S., Pang, S., & Chen, H. (2026) · ACM Transactions on Computing for Healthcare · doi:10.1145/3859243
“These include CONCH, a vision-language model pretrained on over 1.17 million histopathology image-caption pairs [26]; UNI, a self-supervised model pretrained on more than 100 million pathology images [8]; PLIP, a CLIP-based vision-language model fine-tuned on pathology image-text pairs from medical…”
InfluentialDunenova, G., Sarsembayev, A., Oshibayeva, A., Kyrykbayeva, S., Abdrakhmanova, Z., Omarova, B., Ivankov, A., Ualiyeva, A. Y., Zhakypova, B., Zhagiparova, Z., et al. (2026) · Frontiers in Oncology · doi:10.3389/fonc.2026.1908349
“Similarly, transformer and foundation-model approaches appeared rarely in this TIL-speci fi c literature, even though recent computational pathology research has rapidly advanced toward large-scale self-supervised, whole-slide, and vision-language foundation models (87 – 89).”
InfluentialKırca, Ö., Çakır, M. O., Kaya, M. S., Kurt, B., Yilmaz, B., Bilge, U., & Ozdogan, M. (2026) · Biomedicines · doi:10.20944/preprints202609.0010.v1
Su, H., Zhang, S., & Wang, X. (2026) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.22642457
Zhu, M., Aschenaki, Y., Zhang, X., Sali, R., Lin, Z., Dixon, C. M., & Zhang, D. Y. (2026) · BMJ Oncology · doi:10.1136/bmjonc-2026-001208
Song, B., Maurya, H., Khalighi, S., Aqeel, A., Corredor, G., Hammouda, K., Ozyoruk, K. B., Pathak, T. B., Toro, P., Chen, C., et al. (2026) · European Journal of Cancer · doi:10.1016/j.ejca.2026.117810
Interpreting interpretable AI in digital pathology
Wang, Z., Popel, A. S., & Sulam, J. (2026) · Patterns · doi:10.1016/j.patter.2026.101664
Metadata
- Authors
- Lu, M. Y., Chen, B., Williamson, D. F. K., Chen, R. J., Liang, I., Ding, T., Jaume, G., Odintsov, I., Le, L. P., Gerber, G., Parwani, A. V., Zhang, A., & Mahmood, F.
- Affiliations
- Broad Institute (US)
- Brigham and Women's Hospital (US)
- Harvard University (US)
- The Ohio State University Wexner Medical Center (US)
- Corresponding author
- Mahmood, Faisal
- ORCID
- Venue
- Nature Medicine
- Published
- 2024-03
- Volume
- 30
- Issue
- 3
- Pages
- 863-874
- ISSN
- 1078-8956 (ISSN-L)
- 1546-170X
- PMC
- PMC11384335
- OpenAlex
- W4392947532
- Semantic Scholar
- 0746410e1250576cc1b9621ef602e4bceb1c07ca
- Cited by
- 966
- References
- 79
- Citations by year
- 2026: 491 · 2025: 388 · 2024: 87
- FWCI
- 135.39
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- Locations
- Nature Medicine (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Human Genome Research Institute (T32HG002295)
- National Cancer Institute (T32CA251062)
- National Institute of General Medical Sciences (R35GM149270, R35GM138216)
- National Institute of Diabetes and Digestive and Kidney Diseases (P30DK034854)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- histopathology, digital pathology, contrastive learning, image-caption pairs, biomedical text, histology image classification, image captioning, text-to-image retrieval, image-to-text retrieval, transfer learning, limited labeled data
- MeSH terms
- Machine Learning, Humans, Language, Workflow
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
