HER 2 challenge contest: a detailed assessment of automated HER 2 scoring algorithms in whole slide images of breast cancer tissues
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Aims: Evaluating expression of the human epidermal growth factor receptor 2 (HER 2) by visual examination of immunohistochemistry (IHC) on invasive breast cancer (BC a) is a key part of the diagnostic assessment of BC a due to its recognized importance as a predictive and prognostic marker in clinical practice. However, visual scoring of HER 2 is subjective, and consequently prone to interobserver variability. Given the prognostic and therapeutic implications of HER 2 scoring, a more objective method is required. In this paper, we report on a recent automated HER 2 scoring contest, held in conjunction with the annual PathSoc meeting held in Nottingham in June 2016, aimed at systematically comparing and advancing the state‐of‐the‐art artificial intelligence (AI)‐based automated methods for HER 2 scoring. Methods and results: The contest data set comprised digitized whole slide images (WSI) of sections from 86 cases of invasive breast carcinoma stained with both haematoxylin and eosin (H&E) and IHC for HER 2. The contesting algorithms predicted scores of the IHC slides automatically for an unseen subset of the data set and the predicted scores were compared with the ‘ground truth’ (a consensus score from at least two experts). We also report on a simple ‘Man versus Machine’ contest for the scoring of HER 2 and show that the automated methods could beat the pathology experts on this contest data set. Conclusions: This paper presents a benchmark for comparing the performance of automated algorithms for scoring of HER 2. It also demonstrates the enormous potential of automated algorithms in assisting the pathologist with objective IHC scoring.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histopathological Image Analysis: A Review
Gurcan, M. N., Boucheron, L. E., Can, A., Madabhushi, A., Rajpoot, N. M., & Yener, B. (2009) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2009.2034865 · Cited by 2,052
Self-citationMolecular pathways and therapeutic targets in lung cancer
Shtivelman, E., Hensing, T., Simon, G. R., Dennis, P. A., Otterson, G. A., Bueno, R., & Salgia, R. (2014) · Oncotarget · doi:10.18632/oncotarget.1891 · Cited by 220 · cited 1×
“Other possible extensions of digital pathology could be to automate the overexpression of the programmed death 1 (PD-1) receptor and its ligand (PD-L1) to evaluate anaplastic lymphoma kinase (ALK) protein and proto-oncogene tyrosine-protein kinase ROS1 in lung cancers.(17) The AIbased algorithms would be more effectiv…”
Method
Cited by
Deep neural network models for computational histopathology: A survey
Srinidhi, C. L., Ciga, O., & Martel, A. L. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101813 · Cited by 749
A review of the application of deep learning in medical image classification and segmentation
Cai, L., Gao, J., & Zhao, D. (2020) · Annals of Translational Medicine · doi:10.21037/atm.2020.02.44 · Cited by 587
Abels, E., Pantanowitz, L., Aeffner, F., Zarella, M. D., van der Laak, J., Bui, M. M., Vemuri, V. N., Parwani, A. V., Gibbs, J., Agosto‐Arroyo, E., et al. (2019) · The Journal of Pathology · doi:10.1002/path.5331 · Cited by 459
Graham, S., Chen, H., Gamper, J., Dou, Q., Heng, P.-A., Snead, D., Tsang, Y. W., & Rajpoot, N. (2019) · Medical Image Analysis · doi:10.1016/j.media.2018.12.001 · Cited by 338
Self-citationDeep Learning for Whole Slide Image Analysis: An Overview
Dimitriou, N., Arandjelović, O., & Caie, P. D. (2019) · Frontiers in Medicine · doi:10.3389/fmed.2019.00264 · Cited by 332
Metadata
- Authors
- Qaiser, T., Mukherjee, A., Reddy PB, C., Munugoti, S. D., Tallam, V., Pitkäaho, T., Lehtimäki, T., Naughton, T., Berseth, M., Pedraza, A., Mukundan, R., Smith, M., Bhalerao, A., Rodner, E., Simon, M., Denzler, J., Huang, C., Bueno, G., Snead, D., Ellis, I. O., Ilyas, M., & Rajpoot, N.
- Venue
- Histopathology
- Publisher
- Wiley
- Published
- 2017-10-27
- Volume
- 72
- Issue
- 2
- Pages
- 227-238
- ISSN
- 0309-0167 (ISSN-L)
- 1365-2559
- OpenAlex
- W2616930387
- Cited by
- 157
- References
- 2
- FWCI
- 6.72
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: HER 2 challenge contest: a detailed assessment of automated HER 2 scoring algorithms in whole slide images of breast cancer tissues. https://app.cochat.ai/papers/10.1111/his.13333
- The paper
- Qaiser, T., Mukherjee, A., Reddy PB, C., Munugoti, S. D., Tallam, V., Pitkäaho, T., Lehtimäki, T., Naughton, T., Berseth, M., Pedraza, A., Mukundan, R., Smith, M., Bhalerao, A., Rodner, E., Simon, M., Denzler, J., Huang, C., Bueno, G., Snead, D., . . . Rajpoot, N. (2018). HER 2 challenge contest: a detailed assessment of automated HER 2 scoring algorithms in whole slide images of breast cancer tissues. Histopathology. https://doi.org/10.1111/his.13333
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.