CoChat

HER 2 challenge contest: a detailed assessment of automated HER 2 scoring algorithms in whole slide images of breast cancer tissues

Open access
Qaiser, Talha, Mukherjee, Abhik, Reddy PB, Chaitanya, Munugoti, Sai D, Tallam, Vamsi, Pitkäaho, Tomi, Lehtimäki, Taina, Naughton, Thomas, Berseth, Matt, Pedraza, Aníbal, Mukundan, Ramakrishnan, Smith, Matthew, Bhalerao, Abhir, Rodner, Erik, Simon, Marcel, Denzler, Joachim, Huang, Chao‐Hui, Bueno, Gloria, Snead, David, Ellis, Ian O, Ilyas, Mohammad, Rajpoot, Nasir · 2018 · Histopathology
Cited by 157

The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.

Abstract

Aims: Evaluating expression of the human epidermal growth factor receptor 2 (HER 2) by visual examination of immunohistochemistry (IHC) on invasive breast cancer (BC a) is a key part of the diagnostic assessment of BC a due to its recognized importance as a predictive and prognostic marker in clinical practice. However, visual scoring of HER 2 is subjective, and consequently prone to interobserver variability. Given the prognostic and therapeutic implications of HER 2 scoring, a more objective method is required. In this paper, we report on a recent automated HER 2 scoring contest, held in conjunction with the annual PathSoc meeting held in Nottingham in June 2016, aimed at systematically comparing and advancing the state‐of‐the‐art artificial intelligence (AI)‐based automated methods for HER 2 scoring. Methods and results: The contest data set comprised digitized whole slide images (WSI) of sections from 86 cases of invasive breast carcinoma stained with both haematoxylin and eosin (H&E) and IHC for HER 2. The contesting algorithms predicted scores of the IHC slides automatically for an unseen subset of the data set and the predicted scores were compared with the ‘ground truth’ (a consensus score from at least two experts). We also report on a simple ‘Man versus Machine’ contest for the scoring of HER 2 and show that the automated methods could beat the pathology experts on this contest data set. Conclusions: This paper presents a benchmark for comparing the performance of automated algorithms for scoring of HER 2. It also demonstrates the enormous potential of automated algorithms in assisting the pathologist with objective IHC scoring.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/his.13333

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

  • Histopathological Image Analysis: A Review

    Gurcan, M. N., Boucheron, L. E., Can, A., Madabhushi, A., Rajpoot, N. M., & Yener, B. (2009) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2009.2034865 · Cited by 2,052

    Self-citation
  • Molecular pathways and therapeutic targets in lung cancer

    Shtivelman, E., Hensing, T., Simon, G. R., Dennis, P. A., Otterson, G. A., Bueno, R., & Salgia, R. (2014) · Oncotarget · doi:10.18632/oncotarget.1891 · Cited by 220 · cited 1×

    “Other possible extensions of digital pathology could be to automate the overexpression of the programmed death 1 (PD-1) receptor and its ligand (PD-L1) to evaluate anaplastic lymphoma kinase (ALK) protein and proto-oncogene tyrosine-protein kinase ROS1 in lung cancers.(17) The AIbased algorithms would be more effectiv…”
    Method

Show all 2 references

Cited by

Metadata

Authors
Qaiser, T., Mukherjee, A., Reddy PB, C., Munugoti, S. D., Tallam, V., Pitkäaho, T., Lehtimäki, T., Naughton, T., Berseth, M., Pedraza, A., Mukundan, R., Smith, M., Bhalerao, A., Rodner, E., Simon, M., Denzler, J., Huang, C., Bueno, G., Snead, D., Ellis, I. O., Ilyas, M., & Rajpoot, N.
Venue
Histopathology
Publisher
Wiley
Published
2017-10-27
Volume
72
Issue
2
Pages
227-238
ISSN
  • 0309-0167 (ISSN-L)
  • 1365-2559
OpenAlex
W2616930387
Cited by
157
References
2
FWCI
6.72
Type
journal article
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.