The DOI matches its Crossref record; 49 of the 50 references it cites were found in a registry or an index.
Multi-class texture analysis in colorectal cancer histology
Open accessAbstract
Automatic recognition of different tissue types in histological images is an essential part in the digital pathology toolbox. Texture analysis is commonly used to address this problem; mainly in the context of estimating the tumour/stroma ratio on histological samples. However, although histological images typically contain more than two tissue types, only few studies have addressed the multi-class problem. For colorectal cancer, one of the most prevalent tumour types, there are in fact no published results on multiclass texture separation. In this paper we present a new dataset of 5,000 histological images of human colorectal cancer including eight different types of tissue. We used this set to assess the classification performance of a wide range of texture descriptors and classifiers. As a result, we found an optimal classification strategy that markedly outperformed traditional methods, improving the state of the art for tumour-stroma separation from 96.9% to 98.6% accuracy and setting a new standard for multiclass tissue separation (87.4% accuracy for eight classes). We make our dataset of histological images publicly available under a Creative Commons license and encourage other researchers to use it as a benchmark for their studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Textural Features for Image Classification
Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.4309314 · Cited by 22,886
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
SUN database: Large-scale scene recognition from abbey to zoo
Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539970 · Cited by 3,283
The FERET database and evaluation procedure for face-recognition algorithms
Phillips, P. J., Wechsler, H., Huang, J., & Rauss, P. J. (1998) · Image and Vision Computing · doi:10.1016/s0262-8856(97)00070-x · Cited by 2,431
Textural Features Corresponding to Visual Perception
Tamura, H., Mori, S., & Yamawaki, T. (1978) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1978.4309999 · Cited by 2,155
Tüceryan, M., & Jain, A. K. (1993) · Cited by 1,837
Textons, the elements of texture perception, and their interactions
Julesz, B. (1981) · Nature · doi:10.1038/290091a0 · Cited by 1,703 · cited 1×
“Lower-order statistics can be used to describe texture 23,24 .”
MethodThe IAM-database: an English sentence database for offline handwriting recognition
Marti, U.-V., & Bunke, H. (2002) · International Journal on Document Analysis and Recognition · doi:10.1007/s100320200071 · Cited by 1,478
Tumors as Organs: Complex Tissues that Interface with the Entire Organism
Egeblad, M., Nakasone, E. S., & Werb, Z. (2010) · Developmental Cell · doi:10.1016/j.devcel.2010.05.012 · Cited by 1,234
Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images
Xu, J., Xiang, L., Liu, Q., Gilmore, H., Wu, J., Tang, J., & Madabhushi, A. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2458702 · Cited by 854
Prototype Selection for Nearest Neighbor Classification: Taxonomy and Empirical Study
Garcia, S., Derrac, J., Cano, J. R., & Herrera, F. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.142 · Cited by 695
Texture discrimination by Gabor functions
Turner, M. R. (1986) · Biological Cybernetics · doi:10.1007/bf00341922 · Cited by 582
Computer Vision Using Local Binary Patterns
Pietikäinen, M., Hadid, A., Zhao, G., & Ahonen, T. (2011) · Computational Imaging and Vision · doi:10.1007/978-0-85729-748-8 · Cited by 576
An Update of the Gleason Grading System
Epstein, J. I. (2010) · Journal of Urology · doi:10.1016/j.juro.2009.10.046 · Cited by 533
Computer Vision Using Local Binary Patterns
Pietikäinen, M., Hadid, A., Zhao, G., & Ahonen, T. (2011) · Computational Imaging and Vision · doi:10.1007/978-0-85729-748-8_14 · Cited by 441
Quantitative Image Analysis of Cellular Heterogeneity in Breast Tumors Complements Genomic Profiling
Yuan, Y., Failmezger, H., Rueda, O. M., Ali, H. R., Gräf, S., Chin, S.-F., Schwarz, R. F., Curtis, C., Dunning, M. J., Bardwell, H., et al. (2012) · Science Translational Medicine · doi:10.1126/scitranslmed.3004330 · Cited by 426
Rotation Invariant Image Description with Local Binary Pattern Histogram Fourier Features
Ahonen, T., Matas, J., He, C., & Pietikäinen, M. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-02230-2_7 · Cited by 410
Huijbers, A., Tollenaar, R. A. E. M., v Pelt, G. W., Zeestraten, E. C. M., Dutton, S., McConkey, C. C., Domingo, E., Smit, V. T. H. B. M., Midgley, R., Warren, B. F., et al. (2013) · Annals of Oncology · doi:10.1093/annonc/mds246 · Cited by 337
RUSBoost: Improving classification performance when training data is skewed
Seiffert, C., Khoshgoftaar, T. M., Van Hulse, J., & Napolitano, A. (2008) · 2008 19th International Conference on Pattern Recognition · doi:10.1109/icpr.2008.4761297 · Cited by 297
On the Decoding Process in Ternary Error-Correcting Output Codes
Escalera, S., Pujol, O., & Radeva, P. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.266 · Cited by 276
Barker, J., Hoogi, A., Depeursinge, A., & Rubin, D. L. (2016) · Medical Image Analysis · doi:10.1016/j.media.2015.12.002 · Cited by 216
Automatic Classification for Pathological Prostate Images Based on Fractal Analysis
Huang, P.-W., & Lee, C.-H. (2009) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2012704 · Cited by 212
Identification of tumor epithelium and stroma in tissue microarrays using texture analysis
Linder, N., Konsti, J., Turkki, R., Rahtu, E., Lundin, M., Nordling, S., Haglund, C. H., Ahonen, T., Pietikäinen, M., & Lundin, J. E. (2012) · Diagnostic Pathology · doi:10.1186/1746-1596-7-22 · Cited by 163
Tumor-Stroma Ratio Is an Independent Predictor for Survival in Esophageal Squamous Cell Carcinoma
Wang, K., Ma, W., Wang, J., Yu, L., Zhang, X., Wang, Z., Tan, B., Wang, N., Bai, B., Yang, S., et al. (2012) · Journal of Thoracic Oncology · doi:10.1097/jto.0b013e318260dfe8 · Cited by 159
Dekker, T. J. A., van de Velde, C. J. �., van Pelt, G. W., Kroep, J. R., Julien, J. P., Smit, V. T. H. B. M., Tollenaar, R. A. �. �., & Mesker, W. E. (2013) · Breast Cancer Research and Treatment · doi:10.1007/s10549-013-2571-5 · Cited by 150
Local Binary Patterns: New Variants and Applications
Brahnam, S., Jain, L. C., Nanni, L., & Lumini, A. (2013) · Studies in computational intelligence · doi:10.1007/978-3-642-39289-4 · Cited by 142
Doyle, S. T., Feldman, M. D., Shih, N. N. C., Tomaszewski, J., & Madabhushi, A. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-282 · Cited by 105
The prognostic significance of tumour–stroma ratio in oestrogen receptor-positive breast cancer
Downey, C. L., Simpkins, S. A., White, J., Holliday, D. L., Jones, J. L., Jordan, L. B., Kulka, J., Pollock, S., Rajan, S. S., Thygesen, H. H., et al. (2014) · British Journal of Cancer · doi:10.1038/bjc.2014.69 · Cited by 105
Tumor–stroma ratio is an independent predictor for survival in early cervical carcinoma
Liu, J., Liu, J., Li, J., Chen, Y., Guan, X., Wu, X., Hao, C., Sun, Y., Wang, Y., & Wang, X. (2013) · Gynecologic Oncology · doi:10.1016/j.ygyno.2013.11.003 · Cited by 88
Xie, X., & Mirmehdi, M. (2008) · IMPERIAL COLLEGE PRESS eBooks · doi:10.1142/9781848161160_0013 · Cited by 74
Kather, J. N., Marx, A., Reyes‐Aldasoro, C. C., Schad, L. R., Zöllner, F. G., & Weis, C. (2015) · Oncotarget · doi:10.18632/oncotarget.4383 · Cited by 72
Self-citationTexture databases – A comprehensive survey
Hossain, S., & Serikawa, S. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2013.02.009 · Cited by 68
SVM-based glioma grading: Optimization by feature reduction analysis
Zöllner, F. G., Emblem, K. E., & Schad, L. R. (2012) · Zeitschrift für Medizinische Physik · doi:10.1016/j.zemedi.2012.03.007 · Cited by 68
Self-citationDiscrimination between tumour epithelium and stroma via perception-based features
Bianconi, F., Álvarez‐Larrán, A., & Fernández, A. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.12.012 · Cited by 65
Self-citationOptimal Gabor filter design for texture segmentation using stochastic optimization
Tsai, D., Wu, S.-K., & Chen, M. (2001) · Image and Vision Computing · doi:10.1016/s0262-8856(00)00078-0 · Cited by 57
Caie, P. D., Turnbull, A., Farrington, S. M., Oniscu, A., & Harrison, D. J. (2014) · Journal of Translational Medicine · doi:10.1186/1479-5876-12-156 · Cited by 53
Quantitative histology analysis of the ovarian tumour microenvironment
Lan, C., Heindl, A., Huang, X., Xi, S., Banerjee, S. N., Liu, J., & Yuan, Y. (2015) · Scientific Reports · doi:10.1038/srep16317 · Cited by 39
Yang, L., Chen, W., Meer, P., Salaru, G., Goodell, L. A., Berstis, V., & Foran, D. J. (2009) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2020159 · Cited by 38
Feature Importance in Nonlinear Embeddings (FINE): Applications in Digital Pathology
Ginsburg, S. B., Lee, G., Ali, S., & Madabhushi, A. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2456188 · Cited by 33
An appendix to “Texture databases – A comprehensive survey”
Bianconi, F., & Fernández, A. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.02.017 · Cited by 33
Self-citationRotation invariant co-occurrence features based on digital circles and discrete Fourier transform
Bianconi, F., & Fernández, A. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.04.006 · Cited by 32
Self-citationSupport vector machines in DSC‐based glioma imaging: Suggestions for optimal characterization
Zöllner, F. G., Emblem, K. E., & Schad, L. R. (2010) · Magnetic Resonance in Medicine · doi:10.1002/mrm.22495 · Cited by 32
Self-citationSignolle, N., Revenu, M., Plancoulaine, B., & Herlin, P. (2009) · Signal Processing · doi:10.1016/j.sigpro.2009.11.008 · Cited by 29
The use of reticulated foam in texture test objects for magnetic resonance imaging
Lerski, R. A., & Schad, L. R. (1998) · Magnetic Resonance Imaging · doi:10.1016/s0730-725x(98)00096-4 · Cited by 29
Self-citationAssessment of tumour viability in human lung cancer xenografts with texture-based image analysis
Turkki, R., Linder, N., Holopainen, T., Wang, Y., Grote, A., Lundin, M., Alitalo, K. K., & Lundin, J. E. (2015) · Journal of Clinical Pathology · doi:10.1136/jclinpath-2015-202888 · Cited by 19
Kather, J. N., Weis, C., Marx, A., Schuster, A. K.-G., Schad, L. R., & Zöllner, F. G. (2015) · PLoS ONE · doi:10.1371/journal.pone.0145572 · Cited by 18
Self-citationMattfeldt, T., Grahovac, P., & Lück, S. (2013) · Image Analysis & Stereology · doi:10.5566/ias.v32.p155-165 · Cited by 11
Schad, L. R., Härle, W., ZUNA, I., & Lorenz, W. J. (1992) · Zeitschrift für Medizinische Physik · doi:10.1016/s0939-3889(15)70622-7 · Cited by 7
Self-citationBeyerer, J., León, F. P., & Frese, C. (2015) · Springer eBooks · doi:10.1007/978-3-662-47794-6_13 · Cited by 3
Research works printed but not linked: 1
- Allwein, E. L., Schapire, R. E. & Singer, Y. Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers. J Mach Learn Res 1, 113–141 (2000).
Cited by
Kather, J. N., Pearson, A. T., Halama, N., Jäger, D., Krause, J., Loosen, S. H., Marx, A., Boor, P., Tacke, F., Neumann, U. P., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0462-y · Cited by 1,458
Self-citationKather, J. N., Krisam, J., Charoentong, P., Luedde, T., Herpel, E., Weis, C.-A., Gaiser, T., Marx, A., Valous, N. A., Ferber, D., et al. (2019) · PLOS Medicine · doi:10.1371/journal.pmed.1002730 · Cited by 1,082
“Basedon thesedata,weconcludethatCNNsdevelopinternal representationsof different tissueclassesandthat theyarecapableof solvingmulticlasstissueclassificationproblemsbetter than thepreviousstateof theart [7].”
BackgroundInfluentialSelf-citationFLTrust: Byzantine-robust Federated Learning via Trust Bootstrapping
Cao, X., Fang, M., Liu, J., & Gong, N. Z. (2021) · Proceedings 2021 Network and Distributed System Security Symposium · doi:10.14722/ndss.2021.24434 · Cited by 999
Machine Learning Methods for Histopathological Image Analysis
Komura, D., & Ishikawa, S. (2018) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2018.01.001 · Cited by 937
Deep learning in histopathology: the path to the clinic
van der Laak, J., Litjens, G., & Ciompi, F. (2021) · Nature Medicine · doi:10.1038/s41591-021-01343-4 · Cited by 902
Metadata
- Authors
- Kather, J. N., Weis, C.-A., Bianconi, F., Melchers, S. M., Schad, L. R., Gaiser, T., Marx, A., & Zöllner, F. G.
- Affiliations
- Heidelberg University (DE)
- University of Perugia (IT)
- Corresponding author
- Kather, Jakob Nikolas
- ORCID
- Venue
- Scientific Reports
- Published
- 2016-06-16
- Volume
- 6
- Issue
- 1
- Pages
- 27988-27988
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC4910082
- OpenAlex
- W2435090885
- Cited by
- 578
- References
- 50
- Citations by year
- 2026: 66 · 2025: 79 · 2024: 86 · 2023: 68 · 2022: 67 · 2021: 72 · 2020: 63 · 2019: 37 · 2018: 21 · 2017: 18
- FWCI
- 20.82
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Oulun Yliopisto
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- colorectal cancer, histopathology, tissue classification, texture features, digital pathology, public datasets
- MeSH terms
- Histocytochemistry, Humans, Image Processing, Computer-Assisted, Colorectal Neoplasms, Automation, Laboratory
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.