The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Predicting breast tumor proliferation from whole-slide images: The TUPAC16 challenge
Open accessAbstract
&NA; Tumor proliferation is an important biomarker indicative of the prognosis of breast cancer patients. Assessment of tumor proliferation in a clinical setting is a highly subjective and labor‐intensive task. Previous efforts to automate tumor proliferation assessment by image analysis only focused on mitosis detection in predefined tumor regions. However, in a real‐world scenario, automatic mitosis detection should be performed in whole‐slide images (WSIs) and an automatic method should be able to produce a tumor proliferation score given a WSI as input. To address this, we organized the TUmor Proliferation Assessment Challenge 2016 (TUPAC16) on prediction of tumor proliferation scores from WSIs. The challenge dataset consisted of 500 training and 321 testing breast cancer histopathology WSIs. In order to ensure fair and independent evaluation, only the ground truth for the training dataset was provided to the challenge participants. The first task of the challenge was to predict mitotic scores, i.e., to reproduce the manual method of assessing tumor proliferation by a pathologist. The second task was to predict the gene expression based PAM50 proliferation scores from the WSI. The best performing automatic method for the first task achieved a quadratic‐weighted Cohen's kappa score of &kgr; = 0.567, 95% CI [0.464, 0.671] between the predicted scores and the ground truth. For the second task, the predictions of the top method had a Spearman's correlation coefficient of r = 0.617, 95% CI [0.581 0.651] with the ground truth. This was the first comparison study that investigated tumor proliferation assessment from WSIs. The achieved results are promising given the difficulty of the tasks and weakly‐labeled nature of the ground truth. However, further research is needed to improve the practical utility of image analysis methods for this task.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
A Threshold Selection Method from Gray-Level Histograms
Otsu, N. (1979) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1979.4310076 · Cited by 43,398
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Comprehensive molecular portraits of human breast tumours
The Cancer Genome Atlas Network (2012) · Nature · doi:10.1038/nature11412 · Cited by 12,129 · cited 2×
“Specifically, the TCGA breast cancer team utilized genomic, transcriptomic and proteomic profiling technologies to characterize over 1200 invasive breast cancer cases (The Cancer Genome Atlas Network, 2012).”
Zagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244
Optimizing search engines using clickthrough data
Joachims, T. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775067 · Cited by 3,873
(2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24553-9 · Cited by 2,285
Ki67 Index, HER2 Status, and Prognosis of Patients With Luminal B Breast Cancer
Cheang, M. C. U., Chia, S. K., Voduc, D., Gao, D., Leung, S., Snider, J., Watson, M., Davies, S., Bernard, P. S., Parker, J. S., et al. (2009) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djp082 · Cited by 2,249
Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks
Cireşan, D. C., Giusti, A., Gambardella, L. M., & Schmidhuber, J. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_51 · Cited by 1,536
A method for normalizing histology slides for quantitative analysis
Macenko, M., Niethammer, M., Marron, J. S., Borland, D., Woosley, J. T., Guan, X., Schmitt, C., & Thomas, N. E. (2009) · 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro · doi:10.1109/isbi.2009.5193250 · Cited by 1,482
Going Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461
Prognostic Factors in Breast Cancer: College of American Pathologists Consensus Statement 1999
Fitzgibbons, P. L., Page, D. L., Weaver, D., Thor, A. D., Allred, D. C., Clark, G. M., Ruby, S. G., O'Malley, F., Simpson, J. F., Connolly, J. L., et al. (2000) · Archives of Pathology & Laboratory Medicine · doi:10.5858/2000-124-0966-pfibc · Cited by 1,016
Kamentsky, L., Jones, T. R., Fraser, A., Bray, M.-A., Logan, D. J., Madden, K. L., Ljosa, V., Rueden, C., Eliceiri, K. W., & Carpenter, A. E. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr095 · Cited by 1,000
Nielsen, T. O., Parker, J. S., Leung, S., Voduc, D., Ebbert, M., Vickery, T., Davies, S. R., Snider, J., Stijleman, I. J., Reed, J., et al. (2010) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-10-1282 · Cited by 801
AggNet: Deep Learning From Crowds for Mitosis Detection in Breast Cancer Histology Images
Albarqouni, S., Baur, C., Achilles, F., Belagiannis, V., Demirci, S., & Navab, N. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528120 · Cited by 606
Assessment of algorithms for mitosis detection in breast cancer histopathology images
Veta, M., van Diest, P. J., Willems, S. M., Wang, H., Madabhushi, A., Cruz-Roa, A., Gonzalez, F., Larsen, A. B. L., Vestergaard, J. S., Dahl, A. B., et al. (2015) · Medical Image Analysis · doi:10.1016/j.media.2014.11.010 · Cited by 480
Self-citationAdvances in Neural Information Processing Systems 26 (NIPS 2013)
Cseke, B., Opper, M., & Sanguinetti, G. (2013) · Cited by 424
Histological grading of breast carcinomas: A study of interobserver agreement
Robbins, P., Pinder, S., de Klerk, N., Dawkins, H., Harvey, J., Sterrett, G., Ellis, I., & Elston, C. (1995) · Human Pathology · doi:10.1016/0046-8177(95)90010-1 · Cited by 416
Prognostic value of proliferation in invasive breast cancer: a review: Table 1
van Diest, P. J., van der Wall, E., & Baak, J. P. A. (2004) · Journal of Clinical Pathology · doi:10.1136/jcp.2003.010777 · Cited by 385
Self-citation2006 International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2006)
(2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.849938 · Cited by 313
Protocol for the Examination of Specimens From Patients With Invasive Carcinoma of the Breast
Lester, S. C., Bose, S., Chen, Y.-Y., Connolly, J. L., de Baca, M. E., Fitzgibbons, P. L., Hayes, D. F., Kleer, C., O'Malley, F. P., Page, D. L., et al. (2009) · Archives of Pathology & Laboratory Medicine · doi:10.5858/133.10.1515 · Cited by 302
Mitosis detection in breast cancer histological images An ICPR 2012 contest
Ludovic, R., Daniel, R., Nicolas, L., Maria, K., Humayun, I., Jacques, K., Frédérique, C., Catherine, G., Gilles, L. N., & Metin N, G. (2013) · Journal of Pathology Informatics · doi:10.4103/2153-3539.112693 · Cited by 302
Stain Specific Standardization of Whole-Slide Histopathological Images
Ehteshami Bejnordi, B., Litjens, G., Timofeeva, N., Otte-Holler, I., Homeyer, A., Karssemeijer, N., & van der Laak, J. A. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2476509 · Cited by 290
Tellez, D., Balkenhol, M., Otte-Höller, I., van de Loo, R., Vogels, R., Bult, P., Wauters, C., Vreuls, W., Mol, S., Karssemeijer, N., et al. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2820199 · Cited by 288
Self-citationMitosis Detection in Breast Cancer Histology Images via Deep Cascaded Networks
Chen, H., Dou, Q., Wang, X., Qin, J., & Heng, P. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10140 · Cited by 255
Ki67 assessment in breast cancer: an update
Penault-Llorca, F., & Radosevic-Robin, N. (2017) · Pathology · doi:10.1016/j.pathol.2016.11.006 · Cited by 216
Gutman, D. A., Cobb, J., Somanna, D., Park, Y., Wang, F., Kurc, T., Saltz, J. H., Brat, D. J., Cooper, L. A. D., & Kong, J. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001469 · Cited by 190
DeepMitosis: Mitosis detection via deep detection, verification and segmentation networks
Li, C., Wang, X., Liu, W., & Latecki, L. J. (2018) · Medical Image Analysis · doi:10.1016/j.media.2017.12.002 · Cited by 190
Xu, Y., Jia, Z., Ai, Y., Zhang, F., Lai, M., & Chang, E. I.-C. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178109 · Cited by 187
Self-citationThree-dimensional texture analysis of MRI brain datasets
Kovalev, V. A., Kruggel, F., Gertz, H.-J., & von Cramon, D. Y. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.925295 · Cited by 186
Self-citationMedical Image Computing and Computer-Assisted Intervention – MICCAI 2012
Ayache, N., Delingette, H., Golland, P., & Mori, K. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33454-2 · Cited by 128
Veta, M., van Diest, P. J., Jiwa, M., Al-Janabi, S., & Pluim, J. P. W. (2016) · PLOS ONE · doi:10.1371/journal.pone.0161286 · Cited by 127
Self-citationThe molecular basis of breast cancer pathological phenotypes
Heng, Y. J., Lester, S. C., Tse, G. M.-K., Factor, R. E., Allison, K. H., Collins, L. C., Chen, Y., Jensen, K. C., Johnson, N. B., Jeong, J. C., et al. (2016) · The Journal of Pathology · doi:10.1002/path.4847 · Cited by 122
Self-citationInternational Symposium on Biomedical Imaging (ISBI) 2010
(2010) · IEEE Engineering in Medicine and Biology Magazine · doi:10.1109/memb.2010.935992 · Cited by 78
Balkenhol, M. C. A., Karssemeijer, N., Litjens, G. J. S., van der Laak, J. A. W. M., Ciompi, F., & Tellez, D. (2018) · SPIE Medical Imaging: Digital and Computational Pathology · doi:10.1117/12.2293048 · Cited by 71
Self-citationAutomated mitosis detection with deep regression networks
Chen, H., Wang, X., & Heng, P. (2016) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2016.7493482 · Cited by 58
Evaluation of Mitotic Activity Index in Breast Cancer Using Whole Slide Digital Images
Al‐Janabi, S., van Slooten, H.-J., Visser, M., van der Ploeg, T., van Diest, P. J., & Jiwa, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0082576 · Cited by 53
Lee, L. H., Yang, H., & Bigras, G. (2014) · Scientific Reports · doi:10.1038/srep05122 · Cited by 43
Deep residual Hough voting for mitotic cell detection in histopathology images
Wollmann, T., & Rohr, K. (2017) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2017.7950533 · Cited by 20
Self-citation
Cited by
Deep learning in histopathology: the path to the clinic
van der Laak, J., Litjens, G., & Ciompi, F. (2021) · Nature Medicine · doi:10.1038/s41591-021-01343-4 · Cited by 902
Self-citationDeep neural network models for computational histopathology: A survey
Srinidhi, C. L., Ciga, O., & Martel, A. L. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101813 · Cited by 749
Tellez, D., Litjens, G., Bándi, P., Bulten, W., Bokhorst, J.-M., Ciompi, F., & van der Laak, J. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101544 · Cited by 649
Self-citationEmerging role of deep learning‐based artificial intelligence in tumor pathology
Jiang, Y., Yang, M., Wang, S., Li, X., & Sun, Y. (2020) · Cancer Communications · doi:10.1002/cac2.12012 · Cited by 438
Artificial intelligence for digital and computational pathology
Song, A. H., Jaume, G., Williamson, D. F. K., Lu, M. Y., Vaidya, A., Miller, T. R., & Mahmood, F. (2023) · Nature Reviews Bioengineering · doi:10.1038/s44222-023-00096-8 · Cited by 356
Metadata
- Authors
- Veta, M., Heng, Y. J., Stathonikos, N., Bejnordi, B. E., Beca, F., Wollmann, T., Rohr, K., Shah, M. A., Wang, D., Rousson, M., Hedlund, M., Tellez, D., Ciompi, F., Zerhouni, E., Lanyi, D., Viana, M., Kovalev, V., Liauchuk, V., Phoulady, H. A., Qaiser, T., Graham, S., Rajpoot, N., Sjöblom, E., Molin, J., Paeng, K., Hwang, S., Park, S., Jia, Z., Chang, E. I.-C., Xu, Y., Beck, A. H., van Diest, P. J., & Pluim, J. P. W.
- Venue
- Medical Image Analysis
- Publisher
- Elsevier BV
- Published
- 2019-05
- Volume
- 54
- Pages
- 111-121
- ISSN
- 1361-8415 (ISSN-L)
- OpenAlex
- W2884988214
- Cited by
- 315
- References
- 43
- FWCI
- 19.11
- Type
- journal article
- Language
- en
- Update notices
- erratum (2019-08-01)
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.