Toward Explainable Artificial Intelligence for Precision Pathology
Open accessThe DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Abstract
The rapid development of precision medicine in recent years has started to challenge diagnostic pathology with respect to its ability to analyze histological images and increasingly large molecular profiling data in a quantitative, integrative, and standardized way. Artificial intelligence (AI) and, more precisely, deep learning technologies have recently demonstrated the potential to facilitate complex data analysis tasks, including clinical, histological, and molecular data for disease classification; tissue biomarker quantification; and clinical outcome prediction. This review provides a general introduction to AI and describes recent developments with a focus on applications in diagnostic pathology and beyond. We explain limitations including the black-box character of conventional AI and describe solutions to make machine learning decisions more transparent with so-called explainable AI. The purpose of the review is to foster a mutual understanding of both the biomedical and the AI side. To that end, in addition to providing an overview of the relevant foundations in pathology and machine learning, we present worked-through examples for a better practical understanding of what AI can achieve and how it should be done.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Subramanian, A., Tamayo, P., Mootha, V. K., Mukherjee, S., Ebert, B. L., Gillette, M. A., Paulovich, A., Pomeroy, S. L., Golub, T. R., Lander, E. S., et al. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0506580102 · Cited by 53,625
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Research works printed but not linked: 105
- Krizhevsky A, 2012, Advances in Neural Information Processing Systems 25, 1106
- Brown TB, 2020, Advances in Neural Information Processing Systems 33, 1877
- 10.1038/nbt1371 · DOI · Paper page
- Kingma DP, Ba J. 2015. Adam: a method for stochastic optimization. arXiv:1412.6980 [cs.LG] · arXiv
- Chen T, 2020, Proceedings of the 37th International Conference on Machine Learning, 1597
- 10.1007/978-1-4614-7138-7 · DOI · Paper page
- 10.1109/72.914517 · DOI · Paper page
- 10.1093/bioinformatics/16.9.799 · DOI · Paper page
- 10.1162/089976698300017467 · DOI · Paper page
- 10.1016/j.neunet.2014.09.003 · DOI · Paper page
- Goodfellow I, 2016, Deep Learning
- 10.1098/rspa.2021.0068 · DOI · Paper page
- Vaswani A, 2017, Proceedings of the 31st International Conference on Neural Information Processing Systems (NeurIPS'17), 6000
- 10.1007/978-3-642-35289-8_3 · DOI · Paper page
- 10.1016/j.isci.2020.100882 · DOI · Paper page
- 10.1007/978-0-387-84858-7 · DOI · Paper page
- Ilse M, 2018, Proc. Mach. Learn. Res., 80, 2127
- 10.1109/TPAMI.2013.50 · DOI · Paper page
- Ciga O, 2022, Mach. Learn. Appl., 7, 100198
- 10.1186/1471-2105-8-60 · DOI · Paper page
- 10.1126/scitranslmed.aaw8513 · DOI
- 10.1038/nature26000 · DOI · Paper page
- 10.1038/s41467-022-31666-w · DOI
- 10.1016/j.esmoop.2022.100555 · DOI
- 10.3389/fgene.2020.585029 · DOI
- 10.1186/s12967-022-03369-9 · DOI
- 10.1038/s41598-021-86327-7 · DOI · Paper page
- 10.1038/s41698-022-00278-4 · DOI
- 10.1093/nar/gkac1212 · DOI
- 10.1186/s12920-020-0677-2 · DOI · Paper page
- 10.1371/journal.pone.0178751 · DOI · Paper page
- 10.1038/s41467-019-10168-2 · DOI · Paper page
- 10.3390/app11136194 · DOI
- 10.1093/nar/gkaa506 · DOI · Paper page
- 10.1172/JCI93801 · DOI · Paper page
- 10.1038/s42256-021-00325-y · DOI · Paper page
- 10.1038/s41598-022-21417-8 · DOI
- 10.1186/s13073-021-00845-7 · DOI
- 10.1186/s12859-021-04370-7 · DOI
- Baehrens D, 2010, J. Mach. Learn. Res., 11, 1803
- Zeiler MD, 2014, Computer Vision: 13th European Conference (ECCV 2014), 818
- Arras L, Arjona-Medina JA, Widrich M, Montavon G, Gillhofer M, et al. 2019. Explaining and interpreting LSTMs. See Ref. 100, pp. 231–38 · DOI
- Preuer K, Klambauer G, Rippmann F, Hochreiter S, Unterthiner T. 2019. Interpretable deep learning in drug discovery. See Ref. 100, pp. 331–45 · DOI
- 10.1109/TPAMI.2021.3115452 · DOI · Paper page
- Kim B, 2018, Proc. Mach. Learn. Res., 80, 2673
- Chormai P, Herrmann J, Müller KR, Montavon G. 2022. Disentangled explanations of neural network predictions by finding relevant subspaces. arXiv:2212.14855 [cs.LG] · arXiv
- Wachter S, 2018, Harvard J. Law Technol., 31, 841
- Verma S, Dickerson JP, Hines K. 2020. Counterfactual explanations for machine learning: a review. arXiv:2010.10596 [cs.LG] · arXiv
- 10.1109/CVPR.2016.319 · DOI · Paper page
- Covert I, 2021, J. Mach. Learn. Res., 22, 209
- Lundberg SM, 2017, Proceedings of the 31st International Conference on Neural Information Processing Systems (NeurIPS'17), 4765
- Sundararajan M, 2017, Proc. Mach. Learn. Res., 70, 3319
- 10.1145/2939672.2939778 · DOI · Paper page
- 10.1186/s12859-020-3443-8 · DOI
- 10.3390/genes10100778 · DOI
- 10.3390/cancers13153768 · DOI
- 10.1038/s41598-021-89789-x · DOI
- 10.1186/s12859-020-3465-2 · DOI · Paper page
- 10.1109/CVPR52688.2022.01008 · DOI
- 10.1016/j.inffus.2021.07.015 · DOI · Paper page
- 10.1038/s41598-020-62724-2 · DOI · Paper page
- 10.1145/3568294.3580147 · DOI
- Srivastava N, 2014, J. Mach. Learn. Res., 15, 1929
- 10.1038/s41467-022-34815-3 · DOI
- Gunning D, 2019, AI Mag., 40, 44
- 10.1007/978-3-031-04083-2 · DOI
- Montavon G, Binder A, Lapuschkin S, Samek W, Müller KR. 2019. Layer-wise relevance propagation: an overview. See Ref. 100, pp. 193–209 · DOI · Paper page
- 10.1145/3233231 · doi:10.1145/3233231 · Paper page
- Ali A, 2022, Proc. Mach. Learn. Res., 162, 435
- Hosseini MS, Bejnordi BE, Trinh VQH, Hasan D, Li X, et al. 2023. Computational pathology: a survey review and the way forward. arXiv:2304.05482 [eess.IV] · DOI
- 10.1038/s43856-022-00186-5 · DOI · Paper page
- 10.1146/annurev-cancerbio-061521-092038 · DOI
- Leiter C, Zhang R, Chen Y, Belouadi J, Larionov D, et al. 2023. ChatGPT: a meta-analysis after 2.5 months. arXiv:2302.13795 [cs] · DOI · Paper page
- 10.1109/JPROC.2021.3052449 · DOI · Paper page
- 10.1016/j.jpi.2022.100102 · DOI
- 10.1016/j.ebiom.2019.10.033 · DOI · Paper page
- 10.1093/nar/gki372 · DOI · Paper page
- 10.1186/s40246-022-00396-x · DOI · Paper page
- 10.1007/s00401-013-1126-5 · DOI · Paper page
- 10.1016/j.ccell.2015.04.002 · DOI · Paper page
- 10.1016/j.cell.2016.01.015 · DOI · Paper page
- 10.1093/neuonc/noac088 · DOI
- 10.1038/s41467-020-20603-4 · DOI · Paper page
- 10.1111/bpa.12832 · DOI · Paper page
- 10.1136/gutjnl-2017-314711 · DOI
- 10.1093/neuonc/noz061 · DOI · Paper page
- 10.1172/JCI91095 · DOI
- 10.1080/2162402X.2021.1932365 · DOI
- 10.1002/path.5845 · DOI
- 10.1016/S1470-2045(21)00288-6 · DOI · Paper page
- 10.1056/NEJMoa2201445 · DOI · Paper page
- 10.1002/jcsm.13158 · DOI
- 10.1016/j.artmed.2018.10.006 · DOI · Paper page
- 10.1155/2014/147648 · DOI · Paper page
- 10.1371/journal.pcbi.1008702 · DOI
- 10.1016/j.ccell.2020.03.007 · DOI · Paper page
- 10.1186/s12859-020-03879-7 · DOI · Paper page
- 10.1016/j.artmed.2022.102260 · DOI
- 10.1016/j.ccell.2022.09.012 · DOI · Paper page
- Kather JN, 2018, Zenodo
- Anders CJ, Neumann D, Samek W, Müller KR, Lapuschkin S. 2021. Software for dataset-wide XAI: from local explanations to global insights with Zennit, CoRelAy, and ViRelAy. arXiv:2106.13200v2 [cs.LG] · arXiv
- Jassal B, 2020, Nucleic Acids Res, 48, D498
- 10.1016/j.media.2014.11.010 · DOI · Paper page
- Goodman B, 2017, AI Mag., 38, 50
- 10.1007/978-1-4939-3578-9_5 · DOI · Paper page
Cited by
Ardic, N., & Dinc, R. (2025) · Health Informatics Journal · doi:10.1177/14604582251366141 · Cited by 32
Education and training assessment and artificial intelligence. a pragmatic guide for educators
Newton, P. M., & Jones, S. (2025) · British Journal of Biomedical Science · doi:10.3389/bjbs.2024.14049 · Cited by 19
Kulkarni Kale, U., & Vemulapalli, G. (2025) · The Cancer Journal · doi:10.1097/ppo.0000000000000799 · Cited by 1
Metadata
- Authors
- Klauschen, F., Dippel, J., Keyl, P., Jurmeister, P., Bockmayr, M., Mock, A., Buchstab, O., Alber, M., Ruff, L., Montavon, G., & Müller, K.-R.
- Venue
- Annual Review of Pathology: Mechanisms of Disease
- Publisher
- Annual Reviews
- Published
- 2024-01-24
- Volume
- 19
- Issue
- 1
- Pages
- 541-570
- ISSN
- 1553-4006 (ISSN-L)
- 1553-4014
- OpenAlex
- W4387873179
- Cited by
- 139
- References
- 65
- FWCI
- 3.83
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Toward Explainable Artificial Intelligence for Precision Pathology. https://app.cochat.ai/papers/10.1146/annurev-pathmechdis-051222-113147
- The paper
- Klauschen, F., Dippel, J., Keyl, P., Jurmeister, P., Bockmayr, M., Mock, A., Buchstab, O., Alber, M., Ruff, L., Montavon, G., & Müller, K.-R. (2024). Toward Explainable Artificial Intelligence for Precision Pathology. Annual Review of Pathology: Mechanisms of Disease. https://doi.org/10.1146/annurev-pathmechdis-051222-113147
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.