The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
BACH: Grand challenge on breast cancer histology images
Open accessAbstract
Breast cancer is the most common invasive cancer in women, affecting more than 10% of women worldwide. Microscopic analysis of a biopsy remains one of the most important methods to diagnose the type of breast cancer. This requires specialized analysis by pathologists, in a task that i) is highly time- and cost-consuming and ii) often leads to nonconsensual results. The relevance and potential of automatic classification algorithms using hematoxylin-eosin stained histopathological images has already been demonstrated, but the reported results are still sub-optimal for clinical use. With the goal of advancing the state-of-the-art in automatic classification, the Grand Challenge on BreAst Cancer Histology images (BACH) was organized in conjunction with the 15th International Conference on Image Analysis and Recognition (ICIAR 2018). BACH aimed at the classification and localization of clinically relevant histopathological classes in microscopy and whole-slide images from a large annotated dataset, specifically compiled and made publicly available for the challenge. Following a positive response from the scientific community, a total of 64 submissions, out of 677 registrations, effectively entered the competition. The submitted algorithms improved the state-of-the-art in automatic classification of breast cancer with microscopy images to an accuracy of 87%. Convolutional neuronal networks were the most successful methodology in the BACH challenge. Detailed analysis of the collective results allowed the identification of remaining challenges in the field and recommendations for future developments. The BACH dataset remains publicly available as to promote further improvements to the field of automatic classification in digital pathology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
Siegel, R. L., Miller, K. D., & Jemal, A. (2017) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21387 · Cited by 14,712
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157 · cited 1×
“ttention mechanism for dynamic channel selection following the design trends of DenseNet, Squeeze-Excitation Network (SENet) and ResNext (Huang et al., 2017; J´egou et al., 2016; Yu and Koltun, 2015; Hu et al., 2017; Xie et al., 2017). For classifying the microscopy images, the model has a head composed of a global av…”
MethodMulti-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738 · cited 1×
“ResNext (Huang et al., 2017; Jégou et al., 2016; Yu and Koltun, 2015; Hu et al., 2017; Xie et al., 2017).”
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
2008 IEEE Conference on Computer Vision and Pattern Recognition
(2008) · doi:10.1109/cvpr12618.2008 · Cited by 4,212
Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms
Dietterich, T. G. (1998) · Neural Computation · doi:10.1162/089976698300017197 · Cited by 3,840 · cited 1×
“The top-10 methods of Part A and the annotations of the medical experts are statistically compared via an adaption of McNemar’s test (Edwards, 1948; Dietterich, 1993).”
2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2015) · doi:10.1109/cvpr31182.2015 · Cited by 3,737
Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?
Tajbakhsh, N., Shin, J. Y., Gurudu, S. R., Hurst, R. T., Kendall, C. B., Gotway, M. B., & Liang, J. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2535302 · Cited by 3,277 · cited 2×
“As a consequence, it is a common practice to initialize the models with filters trained on large datasets of natural images, such as ImageNet, and fine-tune them to the specific problem [44].”
BackgroundMethodReinhard, E., Adhikhmin, M., Gooch, B., & Shirley, P. (2001) · IEEE Computer Graphics and Applications · doi:10.1109/38.946629 · Cited by 2,937
ImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
(2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24553-9 · Cited by 2,285
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G. Z., & Wu, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.01507 · Cited by 1,908
A Dataset for Breast Cancer Histopathological Image Classification
Spanhol, F. A., Oliveira, L. S., Petitjean, C., & Heutte, L. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2496264 · Cited by 1,832
The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation
Jegou, S., Drozdzal, M., Vazquez, D., Romero, A., & Bengio, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.156 · Cited by 1,736
International Conference on Learning Representations (ICLR)
Abbas, M. Z. A., Kivinen, J., & Raiko, T. (2016) · Cited by 1,694
2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2016) · doi:10.1109/cvpr33180.2016 · Cited by 1,534
A method for normalizing histology slides for quantitative analysis
Macenko, M., Niethammer, M., Marron, J. S., Borland, D., Woosley, J. T., Guan, X., Schmitt, C., & Thomas, N. E. (2009) · 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro · doi:10.1109/isbi.2009.5193250 · Cited by 1,482
Abràmoff, M. D., Lou, Y., Erginay, A., Clarida, W., Amelon, R., Folk, J. C., & Niemeijer, M. (2016) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.16-19964 · Cited by 1,101
Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis
Litjens, G., Sánchez, C. I., Timofeeva, N., Hermsen, M., Nagtegaal, I., Kovacs, I., Hulsbergen - van de Kaa, C., Bult, P., van Ginneken, B., & van der Laak, J. (2016) · Scientific Reports · doi:10.1038/srep26286 · Cited by 1,069
Classification of breast cancer histology images using Convolutional Neural Networks
Araújo, T., Aresta, G., Castro, E., Rouco, J., Aguiar, P., Eloy, C., Polónia, A., & Campilho, A. (2017) · PLOS ONE · doi:10.1371/journal.pone.0177544 · Cited by 1,013
Self-citationBreast cancer histopathological image classification using Convolutional Neural Networks
Spanhol, F. A., Oliveira, L. S., Petitjean, C., & Heutte, L. (2016) · 2016 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727519 · Cited by 942
Diagnostic Concordance Among Pathologists Interpreting Breast Biopsy Specimens
Elmore, J. G., Longton, G. M., Carney, P. A., Geller, B. M., Onega, T., Tosteson, A. N. A., Nelson, H. D., Pepe, M. S., Allison, K. H., Schnitt, S. J., et al. (2015) · JAMA · doi:10.1001/jama.2015.1405 · Cited by 751 · cited 1×
“The analysis of breast cancer WSIs is non-trivial due to the large amount of data to visualize and the complexity of the task [4].”
BackgroundBreast Cancer Multi-classification from Histopathological Images with Structured Deep Learning Model
Han, Z., Wei, B., Zheng, Y., Yin, Y., Li, K., & Li, S. (2017) · Scientific Reports · doi:10.1038/s41598-017-04075-z · Cited by 683
American Cancer Society Guidelines for the Early Detection of Cancer, 2006
Smith, R. A., Cokkinides, V., & Eyre, H. J. (2006) · CA: A Cancer Journal for Clinicians · doi:10.3322/canjclin.56.1.11 · Cited by 639
Cruz-Roa, A., Basavanhally, A., González, F., Gilmore, H., Feldman, M., Ganesan, S., Shih, N., Tomaszewski, J., & Madabhushi, A. (2014) · SPIE Proceedings · doi:10.1117/12.2043872 · Cited by 573
Cruz-Roa, A., Gilmore, H., Basavanhally, A., Feldman, M., Ganesan, S., Shih, N. N. C., Tomaszewski, J., González, F. A., & Madabhushi, A. (2017) · Scientific Reports · doi:10.1038/srep46450 · Cited by 532
American Cancer Society Guidelines for the Early Detection of Cancer, 2003
Smith, R. A., Cokkinides, V., & Eyre, H. J. (2003) · CA: A Cancer Journal for Clinicians · doi:10.3322/canjclin.53.1.27 · Cited by 529
2015 International Joint Conference on Neural Networks (IJCNN)
(2015) · doi:10.1109/ijcnn34689.2015 · Cited by 397
Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315128 · Cited by 374
Tian, H., Lu, C., Yang, J., Banger, K., Huntzinger, D. N., Schwalm, C. R., Michalak, A. M., Cook, R., Ciais, P., Hayes, D., et al. (2015) · Global Biogeochemical Cycles · doi:10.1002/2014gb005021 · Cited by 352
Data Augmentation by Pairing Samples for Images Classification
Inoue, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.02929 · Cited by 319
Stain Specific Standardization of Whole-Slide Histopathological Images
Ehteshami Bejnordi, B., Litjens, G., Timofeeva, N., Otte-Holler, I., Homeyer, A., Karssemeijer, N., & van der Laak, J. A. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2476509 · Cited by 290
Computer-aided diagnosis of breast cancer based on fine needle biopsy microscopic images
Kowal, M., Filipczuk, P., Obuchowicz, A., Korbicz, J., & Monczak, R. (2013) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2013.08.003 · Cited by 274
(2001) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition CVPR 2001 CVPR-01 · doi:10.1109/cvpr.2001.990448 · Cited by 250
Filipczuk, P., Fevens, T., Krzyzak, A., & Monczak, R. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2275151 · Cited by 228
Proceedings of The Thirty-First AAAI Conference on Artificial Intelligence (AAAI-17)
Belle, V. (2017) · National Conference on Artificial Intelligence · Cited by 200
Remote Computer-Aided Breast Cancer Detection and Diagnosis System Based on Cytological Images
George, Y. M., Zayed, H. H., Roushdy, M. I., & Elbagoury, B. M. (2014) · IEEE Systems Journal · doi:10.1109/jsyst.2013.2279415 · Cited by 198
Edwards, A. L. (1948) · Psychometrika · doi:10.1007/bf02289261 · Cited by 197
Bejnordi, B. E., Zuidhof, G., Balkenhol, M., Hermsen, M., Bult, P., van Ginneken, B., Karssemeijer, N., Litjens, G., & van der Laak, J. (2017) · Journal of Medical Imaging · doi:10.1117/1.jmi.4.4.044504 · Cited by 185
Gecer, B., Aksoy, S., Mercan, E., Shapiro, L. G., Weaver, D. L., & Elmore, J. G. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.07.022 · Cited by 176
Roa, Á. A. C., Gilmore, H. L., Basavanhally, A. N., Feldman, M. D., Ganesan, S., Shih, N. N. C., Tomaszewski, J., Madabhushi, A., & Gonzalez, F. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0196828 · Cited by 162
Ferreira, C. A., Melo, T., de Sousa, P., Meyer, M. I., Shakibapour, E., Costa, P., & Campilho, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_86 · Cited by 149
Self-citationTENCON 2014 - 2014 IEEE Region 10 Conference
(2014) · doi:10.1109/tencon33527.2014 · Cited by 113
Convolutional Capsule Network for Classification of Breast Cancer Histology Images
Iešmantas, T., & Alzbutas, R. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_97 · Cited by 94
Classification of breast cancer histopathology images using texture feature analysis
Belsare, A. D., Mushrif, M. M., Pangarkar, M. A., & Meshram, N. H. (2015) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon.2015.7372809 · Cited by 90
Automatic classification of tissue malignancy for breast carcinoma diagnosis
Fondón, I., Sarmiento, A., García, A. I., Silvestre, M., Eloy, C., Polónia, A., & Aguiar, P. (2018) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2018.03.003 · Cited by 84
Self-citationMulticlass Classification of Breast Cancer in Whole-Slide Images
Kwok, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_106 · Cited by 81
Self-citationCao, H., Bernard, S., Heutte, L., & Sabourin, R. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_88 · Cited by 68
Awan, R., Koohbanani, N. A., Shaban, M., Lisowska, A., & Rajpoot, N. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_89 · Cited by 67
Breast Cancer Histology Image Classification Based on Deep Neural Networks
Guo, Y., Dong, H., Song, F., Zhu, C., & Liu, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_94 · Cited by 56
Assessment of Breast Cancer Histology Using Densely Connected Convolutional Networks
Kohl, M., Walz, C., Ludwig, F., Braunewell, S., & Baust, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_103 · Cited by 55
Self-citationClassification of Breast Cancer Histology Image using Ensemble of Pre-trained Neural Networks
Chennamsetty, S. S., Safwan, M., & Alex, V. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_91 · Cited by 50
Self-citationBreast Cancer Histological Image Classification Using Fine-Tuned Deep Network Fusion
Mahbod, A., Ellinger, I., Ecker, R., Smedby, Ö., & Wang, C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_85 · Cited by 48
Wang, Z., Dong, N., Dai, W., Rosario, S. D., & Xing, E. P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_84 · Cited by 45
Hierarchical ResNeXt Models for Breast Cancer Histology Image Classification
Koné, I., & Boulmane, L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_90 · Cited by 45
Self-citationMulti-classification of Breast Cancer Histology Images by Using a Fine-Tuning Strategy
Brancati, N., Frucci, M., & Riccio, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_87 · Cited by 40
Self-citationBreast cancer diagnosis from biopsy images by serial fusion of Random Subspace ensembles
Zhang, B. (2011) · International Conference on Biomedical Engineering and Informatics (BMEI) · doi:10.1109/bmei.2011.6098229 · Cited by 39
Ensemble Network for Region Identification in Breast Histopathology Slides
Marami, B., Prastawa, M. W., Chan, M. S. M., Donovan, M., Fernandez, G., & Zeineh, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_98 · Cited by 29
Self-citationEnsembling Neural Networks for Digital Pathology Images Classification and Segmentation
Pimkin, A., Makarchuk, G., Кондратенко, В., Pisov, M., Krivov, E., & Belyaev, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_100 · Cited by 29
Towards Interactive Breast Tumor Classification Using Transfer Learning
Weiss, N., Höfener, H., & Homeyer, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_82 · Cited by 15
Micro and Macro Breast Histology Image Analysis by Partial Network Re-use
Vu, Q. D., To, M. N. N., Kim, E., & Kwak, J. T. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_102 · Cited by 10
Self-citation
Cited by
Towards a general-purpose foundation model for computational pathology
Chen, R. J., Ding, T., Lu, M. Y., Williamson, D. F. K., Jaume, G., Song, A. H., Chen, B., Zhang, A., Shao, D., Shaban, M., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-02857-3 · Cited by 1,560
Deep neural network models for computational histopathology: A survey
Srinidhi, C. L., Ciga, O., & Martel, A. L. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101813 · Cited by 749
Salahuddin, Z., Woodruff, H. C., Chatterjee, A., & Lambin, P. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.105111 · Cited by 508
Parrot optimizer: Algorithm and applications to medical problems
Lian, J., Hui, G., Ma, L., Zhu, T., Wu, X., Heidari, A. A., Chen, Y., & Chen, H. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108064 · Cited by 479
Salvi, M., Acharya, U. R., Molinari, F., & Meiburger, K. M. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104129 · Cited by 386
Metadata
- Authors
- Aresta, G., Araújo, T., Kwok, S., Chennamsetty, S. S., Safwan, M., Alex, V., Marami, B., Prastawa, M., Chan, M., Donovan, M., Fernandez, G., Zeineh, J., Kohl, M., Walz, C., Ludwig, F., Braunewell, S., Baust, M., Vu, Q. D., To, M. N. N., Kim, E., Kwak, J. T., Galal, S., Sanchez-Freire, V., Brancati, N., Frucci, M., Riccio, D., Wang, Y., Sun, L., Ma, K., Fang, J., Kone, I., Boulmane, L., Campilho, A., Eloy, C., Polónia, A., & Aguiar, P.
- Venue
- Medical Image Analysis
- Publisher
- Elsevier BV
- Published
- 2019-08
- Volume
- 56
- Pages
- 122-139
- ISSN
- 1361-8415 (ISSN-L)
- OpenAlex
- W2885824038
- Cited by
- 703
- References
- 79
- FWCI
- 34.07
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.