The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Artificial intelligence assistance significantly improves Gleason grading of prostate biopsies by pathologists
Open accessAbstract
The Gleason score is the most important prognostic marker for prostate cancer patients, but it suffers from significant observer variability. Artificial intelligence (AI) systems based on deep learning can achieve pathologist-level performance at Gleason grading. However, the performance of such systems can degrade in the presence of artifacts, foreign tissue, or other anomalies. Pathologists integrating their expertise with feedback from an AI system could result in a synergy that outperforms both the individual pathologist and the system. Despite the hype around AI assistance, existing literature on this topic within the pathology domain is limited. We investigated the value of AI assistance for grading prostate biopsies. A panel of 14 observers graded 160 biopsies with and without AI assistance. Using AI, the agreement of the panel with an expert reference standard increased significantly (quadratically weighted Cohen's kappa, 0.799 vs. 0.872; p = 0.019). On an external validation set of 87 cases, the panel showed a significant increase in agreement with a panel of international experts in prostate pathology (quadratically weighted Cohen's kappa, 0.733 vs. 0.786; p = 0.003). In both experiments, on a group-level, AI-assisted pathologists outperformed the unassisted pathologists and the standalone AI system. Our results show the potential of AI systems for Gleason grading, but more importantly, show the benefits of pathologist-AI synergy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
Self-citationClinical-grade computational pathology using weakly supervised deep learning on whole slide images
Campanella, G., Hanna, M. G., Geneslaw, L., Miraflor, A., Werneck Krauss Silva, V., Busam, K. J., Brogi, E., Reuter, V. E., Klimstra, D. S., & Fuchs, T. J. (2019) · Nature Medicine · doi:10.1038/s41591-019-0508-1 · Cited by 2,799
Digital pathology and artificial intelligence
Niazi, M. K. K., Parwani, A. V., & Gurcan, M. N. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30154-8 · Cited by 1,232
Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis
Litjens, G., Sánchez, C. I., Timofeeva, N., Hermsen, M., Nagtegaal, I., Kovacs, I., Hulsbergen - van de Kaa, C., Bult, P., van Ginneken, B., & van der Laak, J. (2016) · Scientific Reports · doi:10.1038/srep26286 · Cited by 1,069
Self-citationBulten, W., Pinckaers, H., van Boven, H., Vink, R., de Bel, T., van Ginneken, B., van der Laak, J., Hulsbergen-van de Kaa, C., & Litjens, G. (2020) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30739-9 · Cited by 705
Self-citationStröm, P., Kartasalo, K., Olsson, H., Solorzano, L., Delahunt, B., Berney, D. M., Bostwick, D. G., Evans, A. J., Grignon, D. J., Humphrey, P. A., et al. (2020) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30738-7 · Cited by 620
Self-citationCai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359206 · Cited by 594
Raciti, P., Sue, J., Ceballos, R., Godrich, R., Kunz, J. D., Kapur, S., Reuter, V., Grady, L., Kanan, C., Klimstra, D. S., et al. (2020) · Modern Pathology · doi:10.1038/s41379-020-0551-y · Cited by 186 · cited 1×
“increasing sensitivity for detecting cancer in biopsies [16].”
Background
Cited by
Artificial intelligence for diagnosis and Gleason grading of prostate cancer: the PANDA challenge
Bulten, W., Kartasalo, K., Chen, P.-H. C., Ström, P., Pinckaers, H., Nagpal, K., Cai, Y., Steiner, D. F., van Boven, H., Vink, R., et al. (2022) · Nature Medicine · doi:10.1038/s41591-021-01620-2 · Cited by 543
Self-citationNetto, G. J., Amin, M. B., Berney, D. M., Compérat, E. M., Gill, A. J., Hartmann, A., Menon, S., Raspollini, M. R., Rubin, M. A., Srigley, J. R., et al. (2022) · European Urology · doi:10.1016/j.eururo.2022.07.002 · Cited by 316
Self-citationArtificial intelligence assists precision medicine in cancer treatment
Liao, J., Li, X., Gan, Y., Han, S., Rong, P., Wang, W., Li, W., & Zhou, L. (2023) · Frontiers in Oncology · doi:10.3389/fonc.2022.998222 · Cited by 256
Independent real‐world application of a clinical‐grade automated prostate cancer detection system
da Silva, L. M., Pereira, E. M., Salles, P. G., Godrich, R., Ceballos, R., Kunz, J. D., Casson, A., Viret, J., Chandarlapaty, S., Ferreira, C. G., et al. (2021) · The Journal of Pathology · doi:10.1002/path.5662 · Cited by 175
Self-citationGonzález-Gonzalo, C., Thee, E. F., Klaver, C. C. W., Lee, A. Y., Schlingemann, R. O., Tufail, A., Verbraak, F., & Sánchez, C. I. (2022) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2021.101034 · Cited by 103
Metadata
- Authors
- Bulten, W., Balkenhol, M., Belinga, J.-J. A., Brilhante, A., Çakır, A., Egevad, L., Eklund, M., Farré, X., Geronatsiou, K., Molinié, V., Pereira, G., Roy, P., Saile, G., Salles, P., Schaafsma, E., Tschui, J., Vos, A.-M., Panel, I. P. I. E., van Boven, H., Vink, R., van der Laak, J., Hulsbergen-van der Kaa, C., Litjens, G., Delahunt, B., Samaratunga, H., Grignon, D. J., Evans, A. J., M.Berney, D., Pan, C.-C., Kristiansen, G., Kench, J. G., Oxley, J., Leite, K. R. M., McKenney, J. K., Humphrey, P. A., Fine, S. W., Tsuzuki, T., Varma, M., Zhou, M., Comperat, E., Bostwick, D. G., Iczkowski, K. A., Magi-Galluzzi, C., Srigley, J. R., Takahashi, H., & van der Kwast, T.
- Venue
- Modern Pathology
- Publisher
- Elsevier BV
- Published
- 2021-03
- Volume
- 34
- Issue
- 3
- Pages
- 660-671
- ISSN
- 0893-3952 (ISSN-L)
- OpenAlex
- W3047561574
- Cited by
- 174
- References
- 8
- FWCI
- 7.67
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Artificial intelligence assistance significantly improves Gleason grading of prostate biopsies by pathologists. https://app.cochat.ai/papers/10.1038/s41379-020-0640-y
- The paper
- Bulten, W., Balkenhol, M., Belinga, J.-J. A., Brilhante, A., Çakır, A., Egevad, L., Eklund, M., Farré, X., Geronatsiou, K., Molinié, V., Pereira, G., Roy, P., Saile, G., Salles, P., Schaafsma, E., Tschui, J., Vos, A.-M., Panel, I. P. I. E., van Boven, H., . . . van der Kwast, T. (2021). Artificial intelligence assistance significantly improves Gleason grading of prostate biopsies by pathologists. Modern Pathology. https://doi.org/10.1038/s41379-020-0640-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.