Multi-class texture analysis in colorectal cancer histology
Open accessThe DOI matches its Crossref record; 49 of the 50 references it cites were found in a registry or an index.
Abstract
Automatic recognition of different tissue types in histological images is an essential part in the digital pathology toolbox. Texture analysis is commonly used to address this problem; mainly in the context of estimating the tumour/stroma ratio on histological samples. However, although histological images typically contain more than two tissue types, only few studies have addressed the multi-class problem. For colorectal cancer, one of the most prevalent tumour types, there are in fact no published results on multiclass texture separation. In this paper we present a new dataset of 5,000 histological images of human colorectal cancer including eight different types of tissue. We used this set to assess the classification performance of a wide range of texture descriptors and classifiers. As a result, we found an optimal classification strategy that markedly outperformed traditional methods, improving the state of the art for tumour-stroma separation from 96.9% to 98.6% accuracy and setting a new standard for multiclass tissue separation (87.4% accuracy for eight classes). We make our dataset of histological images publicly available under a Creative Commons license and encourage other researchers to use it as a benchmark for their studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Textural Features for Image Classification
Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.4309314 · Cited by 22,886
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398 · cited 11×
“The third feature set was based on local binary patterns (LBP) 25 .”
BackgroundInfluentialSUN database: Large-scale scene recognition from abbey to zoo
Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539970 · Cited by 3,283 · cited 1×
“Whereas publicly available benchmarking datasets exist for image classification problems such as face recognition 17 , handwriting recognition 18 , universal computer vision problems 19 and texture classification 20,21 , no such data are available for histopathological tissue classification.”
BackgroundThe FERET database and evaluation procedure for face-recognition algorithms
Phillips, P. J., Wechsler, H., Huang, J., & Rauss, P. J. (1998) · Image and Vision Computing · doi:10.1016/s0262-8856(97)00070-x · Cited by 2,431 · cited 1×
“Whereas publicly available benchmarking datasets exist for image classification problems such as face recognition 17 , handwriting recognition 18 , universal computer vision problems 19 and texture classification 20,21 , no such data are available for histopathological tissue classification.”
BackgroundTextural Features Corresponding to Visual Perception
Tamura, H., Mori, S., & Yamawaki, T. (1978) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1978.4309999 · Cited by 2,155 · cited 3×
“Tamura et al. 7 showed that the human visual system discriminates texture through several specific attributes that were later on refined and tested by Bianconi et al. 8 .”
BackgroundMethodTüceryan, M., & Jain, A. K. (1993) · Cited by 1,837
Textons, the elements of texture perception, and their interactions
Julesz, B. (1981) · Nature · doi:10.1038/290091a0 · Cited by 1,703 · cited 1×
“Lower-order statistics can be used to describe texture 23,24 .”
MethodThe IAM-database: an English sentence database for offline handwriting recognition
Marti, U.-V., & Bunke, H. (2002) · International Journal on Document Analysis and Recognition · doi:10.1007/s100320200071 · Cited by 1,478
Tumors as Organs: Complex Tissues that Interface with the Entire Organism
Egeblad, M., Nakasone, E. S., & Werb, Z. (2010) · Developmental Cell · doi:10.1016/j.devcel.2010.05.012 · Cited by 1,234
Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images
Xu, J., Xiang, L., Liu, Q., Gilmore, H., Wu, J., Tang, J., & Madabhushi, A. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2458702 · Cited by 854 · cited 1×
“This approach has been successfully used by various groups (see Xu et al. 3 for an overview) and has led to new candidate biomarkers 4–6 .”
Method
Research works printed but not linked: 1
- Allwein, E. L., Schapire, R. E. & Singer, Y. Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers. J Mach Learn Res 1, 113–141 (2000).
Cited by
Kather, J. N., Pearson, A. T., Halama, N., Jäger, D., Krause, J., Loosen, S. H., Marx, A., Boor, P., Tacke, F., Neumann, U. P., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0462-y · Cited by 1,458
Self-citationKather, J. N., Krisam, J., Charoentong, P., Luedde, T., Herpel, E., Weis, C.-A., Gaiser, T., Marx, A., Valous, N. A., Ferber, D., et al. (2019) · PLOS Medicine · doi:10.1371/journal.pmed.1002730 · Cited by 1,082
“Basedon thesedata,weconcludethatCNNsdevelopinternal representationsof different tissueclassesandthat theyarecapableof solvingmulticlasstissueclassificationproblemsbetter than thepreviousstateof theart [7].”
BackgroundInfluentialSelf-citationFLTrust: Byzantine-robust Federated Learning via Trust Bootstrapping
Cao, X., Fang, M., Liu, J., & Gong, N. Z. (2021) · Proceedings 2021 Network and Distributed System Security Symposium · doi:10.14722/ndss.2021.24434 · Cited by 999
Machine Learning Methods for Histopathological Image Analysis
Komura, D., & Ishikawa, S. (2018) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2018.01.001 · Cited by 937
“[61] Kather JN, Weis C-A, Bianconi F, Melchers SM, Schad LR, Gaiser T, et al.”
BackgroundDeep learning in histopathology: the path to the clinic
van der Laak, J., Litjens, G., & Ciompi, F. (2021) · Nature Medicine · doi:10.1038/s41591-021-01343-4 · Cited by 902
“For example, Kather et al. showed that combining five different types of texture descriptors resulted in a classifier that could recognize tumor and stroma in colorectal tissue sections with 98.6% accuracy 12 .”
BackgroundInfluentialLocal Model Poisoning Attacks to Byzantine-Robust Federated Learning
Fang, M., Cao, X., Jia, J., & Gong, N. Z. (2019) · arXiv · doi:10.48550/arxiv.1911.11815 · Cited by 828
Transformer-based unsupervised contrastive learning for histopathological image classification
Wang, X., Yang, S., Zhang, J., Wang, M., Zhang, J., Yang, W., Huang, J., & Han, X. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102559 · Cited by 751
Tellez, D., Litjens, G., Bándi, P., Bulten, W., Bokhorst, J.-M., Ciompi, F., & van der Laak, J. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101544 · Cited by 649
Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning
Chen, R. J., Chen, C., Li, Y., Chen, T. Y., Trister, A. D., Krishnan, R. G., & Mahmood, F. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01567 · Cited by 621
“Tissue phenotyping is a fundamental problem in computational pathology (CPATH) that aims at characterizing objective, histopathologic features within gigapixel wholeslide images (WSIs) for cancer diagnosis, prognosis, and the estimation of response-to-treatment in patients [39, 41, 54].”
BackgroundMembership Inference Attacks on Machine Learning: A Survey
Hu, H., Salcic, Z., Sun, L., Dobbie, G., Yu, P. S., & Zhang, X. (2022) · ACM Computing Surveys · doi:10.1145/3523273 · Cited by 564
“Image Data Classification Colored-MNIST [3] 70,000 28 × 28 × 1 2 [196] CH-MNIST [92] 5,000 150 × 150 × 1 8 [76, 86, 161] SVHN [149] 99,289 32 × 32 × 3 10 [85, 165, 186] Yale Face [106] 2,414 168 × 192 × 1 38 [187] RCV1X [108] 800,000 N.”
Salvi, M., Acharya, U. R., Molinari, F., & Meiburger, K. M. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104129 · Cited by 386
Topography of cancer-associated immune cells in human solid tumors
Kather, J. N., Suarez-Carmona, M., Charoentong, P., Weis, C.-A., Hirsch, D., Bankhead, P., Horning, M., Ferber, D., Kel, I., Herpel, E., et al. (2018) · eLife · doi:10.7554/elife.36967 · Cited by 280
Self-citationCLIP in medical imaging: A survey
Zhao, Z., Liu, Y., Wu, H., Wang, M., Li, Y., Wang, S., Teng, L., Liu, D., Cui, Z., Wang, Q., et al. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103551 · Cited by 281
Deep learning for colon cancer histopathological images analysis
Ben Hamida, A., Devanne, M., Weber, J., Truntzer, C., Derangère, V., Ghiringhelli, F., Forestier, G., & Wemmert, C. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104730 · Cited by 251
Jabbour, S., Fouhey, D., Shepard, S., Valley, T. S., Kazerooni, E. A., Banovic, N., Wiens, J., & Sjoding, M. W. (2023) · JAMA · doi:10.1001/jama.2023.22295 · Cited by 236
Riasatian, A., Babaie, M., Maleki, D., Kalra, S., Valipour, M., Hemati, S., Zaveri, M., Safarpoor, A., Shafiei, S., Afshari, M., et al. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102032 · Cited by 221
“Accuracy Combined features (Kather et al., 2016) 87.40% Fine-tuned VGG-19 on 74 classes (Faust et al., 2019) 93.58% DenseNet 94.90% KN-I 96.38% KN-IV 96.80% Ensemble of CNNs Here1 (Nanni et al., 2018) 97.60% network input default size ( 224 × 224 pixels for DenseNet, 1000 × 1000 pixels for…”
BackgroundInfluentialQaiser, T., Tsang, Y.-W., Taniyama, D., Sakamoto, N., Nakane, K., Epstein, D., & Rajpoot, N. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.03.014 · Cited by 221
A fuzzy rank-based ensemble of CNN models for classification of cervical cytology
Manna, A., Kundu, R., Kaplun, D., Sinitca, A., & Sarkar, R. (2021) · Scientific Reports · doi:10.1038/s41598-021-93783-8 · Cited by 203
Graham, S., Vu, Q. D., Jahanifar, M., Raza, S. E. A., Minhas, F., Snead, D., & Rajpoot, N. (2023) · Medical Image Analysis · doi:10.1016/j.media.2022.102685 · Cited by 149
Ciompi, F., Geessink, O., Bejnordi, B. E., de Souza, G. S., Baidoshvili, A., Litjens, G., van Ginneken, B., Nagtegaal, I., & van der Laak, J. (2017) · 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017) · doi:10.1109/isbi.2017.7950492 · Cited by 184
Müller, D., Soto‐Rey, I., & Krämer, F. (2022) · IEEE Access · doi:10.1109/access.2022.3182399 · Cited by 183
“The slides were generated via an Aperio ScanScope microscope with a 20x magnification from the pathology archive of University Medical Center Mannheim and Heidelberg University [28].”
BackgroundInfluentialComputational pathology: A survey review and the way forward
Hosseini, M. S., Bejnordi, B. E., Trinh, V. Q., Chan, L., Hasan, D., Li, X., Yang, S. C., Kim, T., Zhang, H., Wu, T., et al. (2024) · Journal of Pathology Informatics · doi:10.1016/j.jpi.2023.100357 · Cited by 176
Genomics and emerging biomarkers for immunotherapy of colorectal cancer
Kather, J. N., Halama, N., & Jaeger, D. (2018) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2018.02.010 · Cited by 150
Self-citationCellular community detection for tissue phenotyping in colorectal cancer histology images
Javed, S., Mahmood, A., Fraz, M. M., Koohbanani, N. A., Benes, K., Tsang, Y.-W., Hewitt, K., Epstein, D., Snead, D., & Rajpoot, N. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101696 · Cited by 170
Plex: Towards Reliability using Pretrained Large Model Extensions
Tran, D., Liu, J., Dusenberry, M. W., Phan, D., Collier, M. A., Ren, J., Han, K., Wang, Z., Mariet, Z., Hu, H., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.07411 · Cited by 35
“• We use 7 datasets with a range from 1,880 to 8,144 training examples: Describable Textures Dataset (Cimpoi et al., 2014), UC Merced (Yang & Newsam, 2010), Caltech 101 (Fei-Fei et al., 2004), Oxford-IIIT Pets (Parkhi et al., 2012), Colorectal Histology (Kather et al., 2016), Caltech-UCSD Birds 200 (Welinder et al., 2…”
BackgroundPractical Blind Membership Inference Attack via Differential Comparisons
Hui, B., Yang, Y., Yuan, H., Burlina, P., Gong, N. Z., & Cao, Y. (2021) · Proceedings 2021 Network and Distributed System Security Symposium · doi:10.14722/ndss.2021.24293 · Cited by 90
“Note that due to the small size of CH-MNIST, the training sets of shadow and target models have overlap.”
BackgroundInfluentialRecent progress in transformer-based medical image analysis
Liu, Z., Lv, Q., Yang, Z., Li, Y., Lee, C. H., & Shen, L. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107268 · Cited by 153
Chen, H., Li, C., Li, X., Rahaman, M. M., Hu, W., Li, Y., Liu, W., Sun, C., Sun, H., Huang, X., et al. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105265 · Cited by 153
Rączkowska, A., Możejko, M., Zambonelli, J., & Szczurek, E. (2019) · Scientific Reports · doi:10.1038/s41598-019-50587-1 · Cited by 123
“29 in the difficult task of decisively describing all classes in a multiclass image classification problem.”
InfluentialHow Do Machines Learn? Artificial Intelligence as a New Era in Medicine
Koteluk, O., Wartecki, A., Mazurek, S., Kołodziejczak, I., & Mackiewicz, A. A. (2021) · Journal of Personalized Medicine · doi:10.3390/jpm11010032 · Cited by 148
“…Tumor microenvironment components classification in colorectal cancer histological images 1-nearest neighbor, support vector machine, decision tree [110] Cancer development preventing Gut microbiota analysis in search of biomarkers of neoplasms Convolutional neural network, support vector machine,…”
MethodDeTrac: Transfer Learning of Class Decomposed Medical Images in Convolutional Neural Networks
Abbas, A., Abdelsamea, M. M., & Gaber, M. M. (2020) · IEEE Access · doi:10.1109/access.2020.2989273 · Cited by 123
“Histological images of human colorectal cancer [67] of 5000 histological images (with 150 × 150 pixels), divided into three classes (see Table 8 for the number of samples in each class): tumour epithelium, stroma and mucosal glands.”
BackgroundMethodFeng, R., Liu, X., Chen, J., Chen, D. Z., Gao, H., & Wu, J. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3040269 · Cited by 137
Ensemble of convolutional neural networks for bioimage classification
Nanni, L., Ghidoni, S., & Brahnam, S. (2021) · Applied Computing and Informatics · doi:10.1016/j.aci.2018.06.002 · Cited by 118
Kumar, A., Vishwakarma, A., & Bajaj, V. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.104172 · Cited by 131
A Comprehensive Analysis of Weakly-Supervised Semantic Segmentation in Different Image Domains
Chan, L., Hosseini, M. S., & Plataniotis, K. N. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01373-4 · Cited by 128
“…effort, most histopathology datasets are annotated at the patch level rather than the slide level and often each patch is annotated with only one label (Kather et al., 2016, 2019) or with binary classes (Roux et al., 2013; Veta and et.al., 2014; Kumar et al., 2017; Aresta and et.al., 2018).”
BackgroundAn Efficient Deep Learning Approach for Colon Cancer Detection
Sakr, A., Soliman, N. F., Al-Gaashani, M. S. A. M., Pławiak, P., Ateya, A. A., & Hammad, M. A. (2022) · Applied Sciences · doi:10.3390/app12178450 · Cited by 128
Rączkowski, Ł., Możejko, M., Zambonelli, J., & Szczurek, E. (2019) · doi:10.1101/658138 · Cited by 124
FLARE: Defending Federated Learning against Model Poisoning Attacks via Latent Space Representations
Wang, N., Xiao, Y., Chen, Y., Yang, H., Lou, W., & Hou, Y. T. (2022) · ACM Asia Conference on Computer and Communications Security (ASIA CCS) · doi:10.1145/3488932.3517395 · Cited by 124
Artificial intelligence-based pathology for gastrointestinal and hepatobiliary cancers
Calderaro, J., & Kather, J. N. (2021) · Gut · doi:10.1136/gutjnl-2020-322880 · Cited by 101
“10 These hand-crafted image analysis methods are designed and built for a particular purpose, and require an a priori definition of the features of interest to be extracted.”
MethodSelf-citationBi-Directional Weakly Supervised Knowledge Distillation for Whole Slide Image Classification
Qu, L., Luo, X., Wang, M., & Song, Z. (2022) · neural information processing systems · doi:10.52202/068431-1118 · Cited by 118
Kumari, S., & Singh, P. P. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107912 · Cited by 118
Histopathological image classification with bilinear convolutional neural networks
Wang, C., Shi, J., Zhang, Q., & Ying, S. (2017) · 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2017.8037745 · Cited by 98
“Experiments To evaluate the proposed BCNN-based method, the H&E stained colorectal cancer histopathological image dataset from the University Medical Center Mannheim (Heidelberg University, Mannheim, Germany) is used in this work [12].”
BackgroundMethodInfluentialQu, L., Liu, S., Liu, X., Wang, M., & Song, Z. (2022) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ac910a · Cited by 114
Scaling vision transformers to 22 billion parameters
Dehghani, M., Djolonga, J., Mustafa, B., Padlewski, P., Heek, J., Gilmer, J., Steiner, A., Caron, M., Geirhos, R., Alabdulmohsin, I., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.05442 · Cited by 112
“* Datasets Used: Birds (Wah et al., 2011), Caltech101 (Li et al., 2022), Cars (Krause et al., 2013), CelebA (Liu et al., 2015), Cifar-10 (Krizhevsky et al., 2009), Cifar-100 (Krizhevsky et al., 2009), CLEVR/count (Johnson et al., 2017), CLEVR/distance (Johnson et al., 2017), ColHist (Kather et al., 2016), DMLab (Beatt…”
Getting ViT in Shape: Scaling Laws for Compute-Optimal Model Design
Alabdulmohsin, I., Zhai, X., Kolesnikov, A., & Beyer, L. (2023) · neural information processing systems · doi:10.52202/075280-0722 · Cited by 112
Universal in vivo Textural Model for Human Skin based on Optical Coherence Tomograms
Adabi, S., Hosseinzadeh, M., Noei, S., Conforto, S., Daveluy, S., Clayton, A., Mehregan, D. R., & Avanaki, K. (2017) · Scientific Reports · doi:10.1038/s41598-017-17398-8 · Cited by 106
Sabol, P., Sinčák, P., Hartono, P., Kočan, P., Benetinová, Z., Blichárová, A., Verbóová, Ľ., Štammová, E., Sabolová-Fabianová, A., & Jašková, A. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103523 · Cited by 85
Ohata, E. F., das Chagas, J. V. S., Bezerra, G. M., Hassan, M. M., de Albuquerque, V. H. C., & Filho, P. P. R. (2021) · The Journal of Supercomputing · doi:10.1007/s11227-020-03575-6 · Cited by 102
A systematic review of generalization research in medical image classification
Matta, S. C., Lamard, M., Zhang, P., Guilcher, A. L., Borderie, L., Cochener, B., & Quellec, G. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109256 · Cited by 104
Ensemble of convolutional neural networks trained with different activation functions
Maguolo, G., Nanni, L., & Ghidoni, S. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114048 · Cited by 102
Medela, A., Picón, A., Saratxaga, C. L., Belar, O., Cabezón, V., Cicchi, R., Bilbao, R., & Glover, B. M. (2019) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2019.8759182 · Cited by 100
“1 : Sample images from dataset D s [9].”
BackgroundMethodA Multidimensional Choledoch Database and Benchmarks for Cholangiocarcinoma Diagnosis
Zhang, Q., Li, Q., Yu, G., Li, S., Zhou, M., & Chu, J. (2019) · IEEE Access · doi:10.1109/access.2019.2947470 · Cited by 96
“In addition, contiguous tissue areas were manually annotated and tessellated [32].”
BackgroundMethodDeep Learning Techniques for the Classification of Colorectal Cancer Tissue
Tsai, M.-J., & Tao, Y.-H. (2021) · Electronics · doi:10.3390/electronics10141662 · Cited by 97
“Kather [2] used a range of textual descriptors to analyze a multi-class problem of tumor epithelium and simple stroma in 5000 histological images.”
BackgroundMethodResultInfluentialSchrammen, P. L., Ghaffari Laleh, N., Echle, A., Truhn, D., Schulz, V., Brinker, T. J., Brenner, H., Chang‐Claude, J., Alwers, E., Brobeil, A., et al. (2022) · The Journal of Pathology · doi:10.1002/path.5800 · Cited by 80
“A number of technical approaches to this problem were proposed even before the advent of deep learning methods [37].”
BackgroundSelf-citationLoeffler, C. M. L., Ortiz Bruechle, N., Jung, M., Seillier, L., Rose, M., Laleh, N. G., Knuechel, R., Brinker, T. J., Trautwein, C., Gaisa, N. T., et al. (2022) · European Urology Focus · doi:10.1016/j.euf.2021.04.007 · Cited by 85
“Until a few years ago, computer-based analysis of digitized histological slides was confined to simple tasks such as tumor detection [4], but recently deep learning has enabled significant progress in this field [5].”
BackgroundSelf-citationFadafen, M. K., & Rezaee, K. (2023) · Scientific Reports · doi:10.1038/s41598-023-35431-x · Cited by 86
“As well as the train, test, and validation images, Table 2 shows the details of the first dataset (Kather texture 2016).”
BackgroundMethodInfluentialDabass, M., Vashisth, S., & Vig, R. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105680 · Cited by 82
A Consistent and Differentiable Lp Canonical Calibration Error Estimator
Popordanoska, T., Sayer, R., & Blaschko, M. B. (2022) · neural information processing systems · doi:10.52202/068431-0576 · Cited by 82
Lozano, A., Sun, M., Burgess, J., Chen, L., Nirschl, J., Gu, J., López, I., Aklilu, J. G., Rau, A., Katzer, A. W., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01837 · Cited by 81
A survey on membership inference attacks and defenses in machine learning
Niu, J., Liu, P., Zhu, X., Shen, K., Wang, Y., Chi, H., Shen, Y., Jiang, X., Ma, J., & Zhang, Y. (2024) · Journal of Information and Intelligence · doi:10.1016/j.jiixd.2024.02.001 · Cited by 81
BiomedCoOp: Learning to Prompt for Biomedical Vision-Language Models
Koleilat, T., Asgariandehkordi, H., Rivaz, H. J., & Xiao, Y. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01376 · Cited by 77
“…our [20]), Dermatoscopy (DermaMNIST [10, 40]), Endoscopy (Kvasir [35]), Fundus Photography (RETINA [31, 36]), Histopathology (LC25000 [5], CHMNIST [22]), Magnetic Resonance Imaging (BTMRI [34]), Optical Coher-ence Tomography (OCTMNIST [23]), Ultrasound (BUSI [2]), and X-Ray (COVID-QU-Ex [39],…”
Double Transfer Learning for Breast Cancer Histopathologic Image Classification
de Matos, J., Britto, A. D. S., Oliveira, L. S., & Koerich, A. L. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852092 · Cited by 77
“[9] presented a study involving tissue recognition for colorectal cancer.”
BackgroundMultiple Instance Captioning: Learning Representations from Histopathology Textbooks and Articles
Gamper, J., & Rajpoot, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01628 · Cited by 75
Two Ensemble-CNN Approaches for Colorectal Cancer Tissue Type Classification
Paladini, E., Vantaggiato, E., Bougourzi, F., Distante, C., Hadid, A., & Ahmed, A. T. (2021) · Journal of Imaging · doi:10.3390/jimaging7030051 · Cited by 75
“Five samples for each class from the Kather-CRC-2016 database [12].”
BackgroundMethodInfluentialBokhorst, J., Nagtegaal, I. D., Fraggetta, F., Vatrano, S., Mesker, W. E., Vieth, M., van der Laak, J. A. W. M., & Ciompi, F. (2023) · Scientific Reports · doi:10.1038/s41598-023-35491-z · Cited by 76
“Kather et al. 9 was one of the first who used patch classification to segment nine different tissue types.”
BackgroundRelaxLoss: Defending Membership Inference Attacks without Losing UtilityPreprint
Chen, D., Yu, N., & Fritz, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.05801 · Cited by 74
Burgermeister, E., Battaglin, F., Eladly, F., Wu, W., Herweck, F., Schulte, N., Betge, J., Härtel, N., Kather, J. N., Weis, C., et al. (2019) · EBioMedicine · doi:10.1016/j.ebiom.2019.07.004 · Cited by 73
“Automatised calculation of CD31+ microvessel density (MVD) and vessel size followed an established protocol [36].”
MethodSelf-citationImproved convolutional neural network based histopathological image classification
Rachapudi, V., & Devi, G. L. (2020) · Evolutionary Intelligence · doi:10.1007/s12065-020-00367-y · Cited by 72
“1 Representative histopathological images taken from colorectal cancer histology dataset [7] classification with small dataset.”
BackgroundMulti-Task Pre-Training of Deep Neural Networks for Digital Pathology
Mormont, R., Geurts, P., & Maree, R. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2992878 · Cited by 56
“H&E 277524 2 Janowczyk7 [3] CLF Identification of lymphoma subtypes breast, lymphoma H&E 2244 3 Stroma LBP [4] CLF Identification of epithelium and stroma colorectal cancer IHC 2313 2 TUPAC2016 Mitosis [5] DET Detection of mitosis breast cancer H&E 77853 2 BACH18 Micro [6] CLF Predominant cancer type classification br…”
BackgroundMokoatle, M., Marivate, V. N., Mapiye, D. S., Bornman, R. M. S., & Hayes, V. M. (2023) · BMC Bioinformatics · doi:10.1186/s12859-023-05235-x · Cited by 72
“[87] 2021 VGG16 Whole slide images [102] MLP 99”
BackgroundSharkas, M., & Attallah, O. (2024) · Scientific Reports · doi:10.1038/s41598-024-56820-w · Cited by 71
“The University Medical Centre Mannhem in Germany provides a publicly accessible dataset known as Kather texture 2016 8,51 .”
BackgroundDimensionality Reduction Strategies for CNN-Based Classification of Histopathological Images
Cascianelli, S., Bello-Cerezo, R., Bianconi, F., Fravolini, M. L., Belal, M., Palumbo, B., & Kather, J. N. (2017) · Smart innovation, systems and technologies · doi:10.1007/978-3-319-59480-4_3 · Cited by 71
Self-citationDeep learning in selected cancers’ image analysis—a survey
Debelee, T. G., Kebede, S. R., Schwenker, F., & Shewarega, Z. M. (2020) · Journal of Imaging · doi:10.3390/jimaging6110121 · Cited by 70
“zip CT Consortium for Open Medical Image Computing [119], 2016”
BackgroundRobust Magnification Independent Colon Biopsy Grading System over Multiple Data Sources
Babu, T., Gupta, D., Singh, T., Hameed, S., Zakariah, M., & Alotaibi, Y. A. (2021) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2021.016341 · Cited by 70
Paçal, İ., & Attallah, O. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113625 · Cited by 73
Alinsaif, S., & Lang, J. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104879 · Cited by 70
“Thus, four GLCMs are obtained, but we calculate the mean of the four GLCMs from which rotation invariant statistics [46] are computed.”
Deep Learning Approaches to Colorectal Cancer Diagnosis: A Review
Tamang, L. D., & Kim, B. W. (2021) · Applied Sciences · doi:10.3390/app112210982 · Cited by 69
“In CRC, the architecture of a tumor is varied, along with its development, and is the major factor in patient prognosis [25].”
Gastric Pathology Image Classification Using Stepwise Fine-Tuning for Deep Neural Networks
Qu, J., Hiruta, N., Terai, K., Nosato, H., Murakawa, M., & Sakanashi, H. (2018) · Journal of Healthcare Engineering · doi:10.1155/2018/8961781 · Cited by 68
“A recent report by Kather et al. [12] gave a relatively comprehensive investigation of texture analysis for colorectal cancer histology image.”
BackgroundVan Eycke, Y.-R., Balsat, C., Verset, L., Debeir, O., Salmon, I., & Decaestecker, C. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.07.004 · Cited by 65
Foundation Models in Computational Pathology: A Review of Challenges, Opportunities, and ImpactPreprint
Bilal, M., Aadam, Raza, M., Altherwy, Y. N., Alsuhaibani, A., Abduljabbar, A., Almarshad, F. A., Golding, P., & Rajpoot, N. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.08333 · Cited by 66
Li, X., Li, L., Li, M., Yan, P., Feng, T., Luo, H., Zhao, Y. L., & Shen, Y. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103819 · Cited by 69
AFLGuard: Byzantine-robust Asynchronous Federated Learning
Fang, M., Liu, J., Gong, N. Z., & Bentley, E. S. (2022) · Annual Computer Security Applications Conference · doi:10.1145/3564625.3567991 · Cited by 64
Improved Trainable Calibration Method for Neural Networks on Medical Imaging ClassificationPreprint
Liang, G., Zhang, Y., Wang, X., & Jacobs, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.04057 · Cited by 62
“Four medical imaging datasets (RSNA [27], DDSM [6], Mendeley V2 [13], and Kather 5000 [12]) were used in this study for both binary and multi-class classification tasks.”
MethodKumari, P., Chauhan, J., Bozorgpour, A., Huang, B., Azad, R., & Merhof, D. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103730 · Cited by 63
Alam, M. N., Thapa, D., Lim, J. I., Cao, D., & Yao, X. (2017) · Biomedical Optics Express · doi:10.1364/boe.8.004206 · Cited by 61
Membership Inference Attacks and Defenses in Neural Network PruningPreprint
Yuan, X., & Zhang, L. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.03335 · Cited by 61
Automatic Gemstone Classification Using Computer Vision
Chow, B., & Reyes‐Aldasoro, C. C. (2021) · Minerals · doi:10.3390/min12010060 · Cited by 60
“Textural features extracted from images have been widely employed in the past [57–61] in areas such as crystallography [62], stratigraphy [63], the natural stone industry [64] and medical imaging [65–67].”
Multiclass Colorectal Cancer Histology Images Classification Using Vision Transformers
Zeid, M. A.-E., El-Bahnasy, K., & Abo-Youssef, S. E. (2021) · International Conference on Intelligent Computing and Information Systems (ICICIS) · doi:10.1109/icicis52592.2021.9694125 · Cited by 58
Hu, W., Li, C., Rahaman, M. M., Chen, H., Liu, W., Yao, Y., Sun, H., Grzegorzek, M., & Li, X. (2023) · Physica Medica · doi:10.1016/j.ejmp.2023.102534 · Cited by 57
Schaumberg, A. J., Juarez-Nicanor, W. C., Choudhury, S. J., Pastrián, L. G., Pritt, B. S., Prieto Pozuelo, M., Sotillo Sánchez, R., Ho, K., Zahra, N., Sener, B. D., et al. (2020) · Modern Pathology · doi:10.1038/s41379-020-0540-1 · Cited by 54
“Kather et 1594 al [48] go further, using Local Binary Patterns and other texture features to distinguish 1595 stroma, epithelium, immune cells, normal tissue, etc in colorectal cancer.”
MethodZhang, F., Yao, S., Li, Z., Liang, C., Zhao, K., Huang, Y., Gao, Y., Qu, J., Li, Z., & Liu, Z. (2020) · Clinical and Translational Medicine · doi:10.1002/ctm2.110 · Cited by 53
Javed, S., Mahmood, A., Werghi, N., Benes, K., & Rajpoot, N. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3023795 · Cited by 57
“In the literature, there has been a growing number of research initiatives towards automatic tissue phenotyping [7], [17], [27], [35], [36], [44], [52], [58], [65].”
BackgroundMethodInfluentialDeep Learning for Histopathological Image Analysis: Towards Computerized Diagnosis on Cancers
Xu, J., Zhou, C., Lang, B., & Liu, Q. (2017) · Advances in computer vision and pattern recognition · doi:10.1007/978-3-319-42999-1_6 · Cited by 56
Continuous Indexing of Fibrosis (CIF): improving the assessment and classification of MPN patients
Ryou, H., Sirinukunwattana, K., Aberdeen, A., Grindstaff, G., Stolz, B. J., Byrne, H. M., Harrington, H. A., Sousos, N., Godfrey, A. L., Harrison, C. N., et al. (2022) · Leukemia · doi:10.1038/s41375-022-01773-0 · Cited by 55
“Digitized reticulin images were, therefore, converted into grayscale to prevent any color variation from adversely influencing our model’s performance [28, 29].”
BackgroundColon Tissues Classification and Localization in Whole Slide Images Using Deep Learning
Gupta, P., Huang, Y., Sahoo, P. K., You, J., Chiang, S.-F., Onthoni, D. D., Chern, Y., Chao, K., Chiang, J., Yeh, C.-Y., et al. (2021) · Diagnostics · doi:10.3390/diagnostics11081398 · Cited by 55
Alqudah, A. M., & Alqudah, A. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-11946-9 · Cited by 55
“Aside from clonal tumor cells, traditionally the histopathologists comprise tumor stroma, immune cell infiltration, necrotic areas, and islets of remaining non-malignant tissue [12, 26].”
BackgroundInfluentialBianconi, F., Bello-Cerezo, R., & Napoletano, P. (2017) · Journal of Electronic Imaging · doi:10.1117/1.jei.27.1.011002 · Cited by 54
Self-citationCLIP the Bias: How Useful is Balancing Data in Multimodal Learning?
Alabdulmohsin, I., Wang, X., Steiner, A., Goyal, P., D’Amour, A., & Zhai, X. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2403.04547 · Cited by 54
“Datasets are ILSRCV2012 (Deng et al., 2009), Colorectal (Kather et al., 2016), Cars (Krause et al., 2013), Birds (Welinder et al., 2010), UC (Yang & Newsam, 2010), CIFAR100 (Krizhevsky, 2009), DTD (Cimpoi et al., 2014), Caltech (Fei-Fei et al., 2004) and Pets (Parkhi et al., 2012).”
MethodDomain-Controlled Prompt Learning
Cao, Q., Xu, Z., Chen, Y., Ma, C., & Yang, X. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i2.27853 · Cited by 53
Bioimage Classification with Handcrafted and Learned Features
Nanni, L., Brahnam, S., Ghidoni, S., & Lumini, A. (2018) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2018.2821127 · Cited by 53
“4 — — [93] — — — — — — — — — — 87.”
Background
Metadata
- Authors
- Kather, J. N., Weis, C.-A., Bianconi, F., Melchers, S. M., Schad, L. R., Gaiser, T., Marx, A., & Zöllner, F. G.
- Affiliations
- Heidelberg University (DE)
- University of Perugia (IT)
- Corresponding author
- Kather, Jakob Nikolas
- ORCID
- Venue
- Scientific Reports
- Published
- 2016-06-16
- Volume
- 6
- Issue
- 1
- Pages
- 27988-27988
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC4910082
- OpenAlex
- W2435090885
- Cited by
- 578
- References
- 50
- Citations by year
- 2026: 66 · 2025: 79 · 2024: 86 · 2023: 68 · 2022: 67 · 2021: 72 · 2020: 63 · 2019: 37 · 2018: 21 · 2017: 18
- FWCI
- 20.82
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Oulun Yliopisto
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- colorectal cancer, histopathology, tissue classification, texture features, digital pathology, public datasets
- MeSH terms
- Histocytochemistry, Humans, Image Processing, Computer-Assisted, Colorectal Neoplasms, Automation, Laboratory
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.