AggNet: Deep Learning From Crowds for Mitosis Detection in Breast Cancer Histology Images
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
The lack of publicly available ground-truth data has been identified as the major challenge for transferring recent developments in deep learning to the biomedical imaging domain. Though crowdsourcing has enabled annotation of large scale databases for real world images, its application for biomedical purposes requires a deeper understanding and hence, more precise definition of the actual annotation task. The fact that expert tasks are being outsourced to non-expert users may lead to noisy annotations introducing disagreement between users. Despite being a valuable resource for learning annotation models from crowdsourcing, conventional machine-learning methods may have difficulties dealing with noisy annotations during training. In this manuscript, we present a new concept for learning from crowds that handle data aggregation directly as part of the learning process of the convolutional neural network (CNN) via additional crowdsourcing layer (AggNet). Besides, we present an experimental study on learning from crowds designed to answer the following questions. 1) Can deep CNN be trained with data collected from crowdsourcing? 2) How to adapt the CNN to train on multiple types of annotation datasets (ground truth and crowd-based)? 3) How does the choice of annotation and aggregation affect the accuracy? Our experimental setup involved Annot8, a self-implemented web-platform based on Crowdflower API realizing image annotation tasks for a publicly available biomedical image database. Our results give valuable insights into the functionality of deep CNN learning from crowd annotations and prove the necessity of data aggregation integration.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Solving the recurrent issue of inadequate labeling during the analysis of medical images can be achieved by feeding the crowd-sourced input labels into the CNN.”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [294]
In the citing paper
“Albarquoni et al. [294] investigated the problem of insufficient labeling. They crowd-sourced the actual mitoses labeling in the histology images of breast cancer (from amateurs online).”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [294]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 2×
“Indeed, deep learning has advanced the field of computer vision the last few years [19] leading to powerful methods for various applications such as object classification [5], detection [20], segmentation [21], robust regression [22] and depth prediction [23].”
BackgroundMethodFully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
(2010) · International Conference on Machine Learning · Cited by 13,995
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
Eigen, D., Puhrsch, C., & Fergus, R. (2014) · arXiv · doi:10.48550/arxiv.1406.2283 · Cited by 3,442 · cited 1×
“Indeed, deep learning has advanced the field of computer vision the last few years [19] leading to powerful methods for various applications such as object classification [5], detection [20], segmentation [21], robust regression [22] and depth prediction [23].”
MethodMatConvNet: Convolutional Neural Networks for MATLAB
Vedaldi, A., & Lenc, K. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2807412 · Cited by 2,444 · cited 1×
“vNet [34] and conducted on an Intel i7 machine with a GeForce”
MethodTowards an integrated crowdsourcing definition
Estellés-Arolas, E., & González-Ladrón-de-Guevara, F. (2012) · Journal of Information Science · doi:10.1177/0165551512437638 · Cited by 1,858 · cited 1×
“C ROWDSOURCING is a type of participative online activity in which an individual, an institution, a non-profit organization or a company proposes to a group of individuals of varying knowledge, heterogeneity, and number, via flexible open call, the voluntary undertaking of a task [1].”
BackgroundMitosis Detection in Breast Cancer Histology Images with Deep Neural Networks
Cireşan, D. C., Giusti, A., Gambardella, L. M., & Schmidhuber, J. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_51 · Cited by 1,536 · cited 1×
“Being inspired by prominent previous work in this field [18], [26], we define the specific contribution of our own work as: i) Learning of a multi-scale CNN model for mitosis detection, ii) Incorporation of aggregation schemes into CNN layers, and iii) Augmentation and retraining of the CNN model with crowd's annotati…”
Method
Research works printed but not linked: 1
- howe, 2006, The rise of crowdsourcing, Wired Mag, 14, 1
Cited by
Items 501–600 of 613
Detecting Oncoming Vehicles at Night in Urban Scenarios - An Annotation Proof-Of-Concept
Ewecker, L., Wagner, N., Brühl, T., Schwager, R., Sohn, T. S., Engelsberger, A., Ravichandran, J., Stage, H., Langner, J., & Saralajew, S. (2024) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55156.2024.10588522 · Cited by 2
“Annotations can be either experts in their domain (e. g., medical experts) [11], non-experts [12], [13], or a combination of both [14].”
BackgroundAdversarially robust generalization from network crowd noisy labels
Ma, C., Chen, P., Li, W., Zhang, X., & Zhang, Y. (2024) · Alexandria Engineering Journal · doi:10.1016/j.aej.2024.11.070 · Cited by 1
Derin Öğrenme Algoritmalarıyla Meme Kanserinin Histopatolojik Görüntü Sınıflandırması
Ertürkmen, E., & Öter, A. (2025) · Black Sea Journal of Engineering and Science · doi:10.34248/bsengineering.1644212 · Cited by 1
Buravsky, N. S., & Kostyuchenko, E. Y. (2025) · Computer Optics · doi:10.18287/2412-6179-co-1523 · Cited by 1
Multimodal Imaging: Combining Molecular and Optical Approaches
Byeon, H., AlGhamdi, A. A., Keshta, I. M., Soni, M., Shabaz, M., & Bhatt, M. W. (2025) · Wiley eBooks · doi:10.1002/9781394348084.ch5 · Cited by 1
Tan, X. J., Cheor, W. L., Muhamad, W. Z. A. W., Goh, W. Y., Rahman, K. S. A., & Yip, S. Y. (2025) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-025-10473-8 · Cited by 1
Learning From Crowds With Multiple Feature Dynamic Fusion-Based Annotation Generation
Zhang, J., Zheng, Z., Jiang, X., & Sheng, V. S. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3696385 · Cited by 1
Introduction of Artificial Intelligence in Pathology
Song, S. (2017) · Hanyang Medical Reviews · doi:10.7599/hmr.2017.37.2.77 · Cited by 1
Imitation Learning on Atari using Non-Expert Human Annotations.
Panse, A., Madhesia, T., Sriraman, A., & Karande, S. S. (2018) · Cited by 1
CNN-Based Mitosis Detection for Assisting Doctors to Diagnosis
Bai, Y., Liu, J., Liu, J., Zhao, Z., & Mao, R. (2018) · International Conference on Modelling, Identification and Control · doi:10.1109/icmic.2018.8529881 · Cited by 1
“In recent years, the automatic detection algorithm for mitosis has become a hot topic in the field of microscopic cell image recognition [5-10].”
BackgroundCorrelation-filter enhanced meta-learning for classification of biomedical images
Wen, Q., Wang, S., Li, D., & Chen, F. (2019) · International Conference on Graphics and Image Processing (ICGIP) · doi:10.1117/12.2524271 · Cited by 1
Revisiting Machine Learning from Crowds a Mixture Model for Grouping Annotations
Mena, F., & Ñanculef, R. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-33904-3_46 · Cited by 1
Case Study: Deep Convolutional Networks in Healthcare
Avcı, M., Sarıgül, M., & Özyıldırım, B. M. (2019) · Studies in computational intelligence · doi:10.1007/978-3-030-31764-5_3 · Cited by 1
Implementation of Machine Learning-Aided Imaging Analytics for Histopathological Image Diagnosis
Yu, Y., Wang, J., Chun, H. E., Xu, Y., Fong, E. L. S., Wee, A., & Yu, H. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-801238-3.11388-1 · Cited by 1
The Impact of Neural Network Techniques in the Optimization of the Image Processing
Anwer, D. A. (2020) · Journal of Southwest Jiaotong University · doi:10.35741/issn.0258-2724.55.2.20 · Cited by 1
Auxiliary diagnosis of small tumor in mammography based on deep learning
Liu, Y., Li, J., Xu, D., Meng, H., Dong, J., Zhao, T., Tang, L., & Zou, H. (2021) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-021-03358-8 · Cited by 1
Bayesian Crowdsourcing with Constraints
Traganitis, P. A., & Giannakis, G. B. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86523-8_33 · Cited by 1
Flower growth status recognition method based on feature fusion convolutional neural network
Liu, H., Guan, S., Lu, W., Li, H.-O., & Wu, H. (2021) · Journal of Computational Methods in Sciences and Engineering · doi:10.3233/jcm-215230 · Cited by 1
“In order to update the weights, according to the forward propagation of the neural network [24,25], the sum of the weights of the neural network of the first layer can be calculated by Eq.”
Manavalan, M. (2020) · Engineering International · doi:10.18034/ei.v8i2.574 · Cited by 1
“Recent attempts to train Convolutional neural networks on histopathologic pictures usually bypass the ultra-high resolution problem by sampling random image patches from the complete image (Albarqouni et al., 2016; Janowczyk and Madabhushi, 2016), which leaves the weak labeling problem unsolved.”
BackgroundTransfer Learning based Noise Classification in Chest X-Ray Images
Tripathy, A., Das, A., Patel, M., Singhai, E., & Tripathy, S. (2021) · International Conference on Smart Technologies, Communication and Robotics (STCR) · doi:10.1109/stcr51658.2021.9588878 · Cited by 1
Hu, Q., & Ye, M. (2021) · International Conference on Intelligent Technology and Embedded Systems (ICITES) · doi:10.1109/icites53477.2021.9637082 · Cited by 1
CrowdDeep: deep-learning from the crowd for nuclei segmentation
Ghahremani, P., & Kaufman, A. E. (2022) · SPIE Medical Imaging: Digital and Computational Pathology · doi:10.1117/12.2622862 · Cited by 1
“Albarqouni et al. 19 detect mitosis in histopathological slides by passing crowd votes on detected mitosis candidates to an existing CNN to refine the trained models on different image scales.”
MethodWeakly Supervised Crowdsourcing Learning Based on Adversarial Consensus
Wei, M.-L., Li, S.-Y., & Huang, S.-J. (2021) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci54926.2021.00052 · Cited by 1
“[3][4][5] are dedicated to mitigating the noisy effects inherent in the heterogeneous sources.”
BackgroundInfluentialAn Automatic Ultrasonic Segmentation Method by Two-stage Semi-supervised Learning Strategy
Dai, F., Li, Y., Zhang, G., Shi, Q., Xing, W., Liu, X., & Ta, D. (2022) · IEEE International Ultrasonics Symposium · doi:10.1109/ius54386.2022.9958326 · Cited by 1
“However, the annotation of medical images is different from natural images and requires professional clinical experience [2] [3].”
BackgroundA Crowdsourcing Truth Inference Algorithm Based on Hypergraph Neural Networks
Dong, Z., Li, Y., Gao, L., & Zhou, Z. (2022) · IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech) · doi:10.1109/dasc/picom/cbdcom/cy55231.2022.9927903 · Cited by 1
“Learning from crowdsourcing workers [15,17,18,19] is a typical framework for using instance features for truth inference.”
BackgroundLearning from Crowds with Mutual Correction-Based Co-Training
Tian, N., Wu, M., Jiang, J., & Zhang, J. (2022) · IEEE International Conference on Knowledge Graph (ICKG) · doi:10.1109/ickg55886.2022.00040 · Cited by 1
“[24] extended this method to AggNet, which combines with the deep learning model and adds an additional crowdsourcing layer to handle data aggregation directly.”
MethodInfluentialComputational Tools for Drug Discovery of Anticancer Therapy
Saikia, S., Padma, V. V., Prajapati, B. G., Prajapati, J. B., Parihar, A., & Malviya, R. (2023) · Biological and medical physics, biomedical engineering · doi:10.1007/978-981-19-9786-0_25 · Cited by 1
TDG4Crowd:Test Data Generation for Evaluation of Aggregation Algorithms in Crowdsourcing
Fang, Y., Shen, C., Gu, H., Han, T., & Ding, X. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/333 · Cited by 1
“extended on the work of DS, replacing the logistic classifier with a deep neural network [Albarqouni et al., 2016].”
MethodA New Approach for Aneurysm Detection Based on CNNs
Hlavata, R., Kamencay, P., Sýkora, P., Benčo, M., & Hudec, R. (2023) · International Symposium ELMAR (ELMAR) · doi:10.1109/elmar59410.2023.10253915 · Cited by 1
Label Selection Approach to Learning from Crowds
Yoshimura, K., & Kashima, H. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-8132-8_16 · Cited by 1
Characterizing the Features of Mitotic Figures Using a Conditional Diffusion Probabilistic Model
Bahadir, C. D., Liechty, B., Pisapia, D. J., & Sabuncu, M. R. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-53767-7_12 · Cited by 1
ERNet : Enhanced ResNet for classification of breast histopathological images
Kamalakannan, J., & K, C. M. R. (2024) · ELCVIA Electronic Letters on Computer Vision and Image Analysis · doi:10.5565/rev/elcvia.1614 · Cited by 1
“For our experiment, we choose to use the Macenko et al. technique because of its stellar reputation from previous studies [38,39].”
MethodE-model for Early Detection of Breast Cancer and Patient Monitoring
Ejiofor, V. E., Ngozi, C. F., Daniel, U., & Amulu, H. U. (2024) · International Journal of Innovative Science and Research Technology (IJISRT) · doi:10.38124/ijisrt/ijisrt24jun1039 · Cited by 1
Research on the Application of Deep Learning in Biomedical Image Processing
Zhao, Z., & Liu, R. (2024) · International Conference on Interactive Intelligent Systems and Techniques (IIST) · doi:10.1109/iist62526.2024.00140 · Cited by 1
Firth, N. C., Harding, E., Sullivan, M. P., Crutch, S. J., & Alexander, D. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.06176 · Cited by 1
“Crowdsourcing reduces the time taken by an individual, but is not a free service and it has been shown to introduce errors into data labels (Albarqouni et al. 2016).”
BackgroundDeep Learning in Opthalmology: Iris Melanocytic Tumors Intelligent DiagnosisPreprint
Helwan, A. (2021) · medRxiv · doi:10.1101/2021.09.14.21263573 · Cited by 2
“Recently, deep neural networks have been significantly useful in solving different types of medical conditions [5,6].”
BackgroundA Survey of Crowdsourcing in Medical Image Analysis
�rting, S. N., Doyle, A., Hirth, M., Madan, C. R., Mavridis, D. P., Spiers, H., Cheplygina, V., van Hilten, A., & Inel, O. (2020) · Human Computation · doi:10.15346/hc.v7i1 · Cited by 1
Classification and Segmentation of Galactic Structuresin Large Multi-spectral Images
Richards, F. (2023) · Cronfa (Swansea University) · doi:10.23889/suthesis.62601 · Cited by 1
Deep Learning Based Pain Treatment
Jaiswal, T., & Jaiswal, S. (2019) · International Journal of Trend in Scientific Research and Development · doi:10.31142/ijtsrd23639
Ning, Z., Pan, W., Xiao, Q., Chen, Y., Zhang, X., Luo, J., Wang, J., & Zhang, Y. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/746818
“6 Convolutional neural networks (CNNs), as an integration of automatic encoding and decoding deep learning technology, have been successfully applied to various fields, especially medical image analysis (27-33).”
MethodMéneroux, Y. (2019) · theses.fr (ABES) · doi:10.70675/6d2770a9z4551z4dbfzbed4zb3f1fda53896 · Cited by 1
Artificial intelligence for management of patients with intracranial neoplasms
Mammi, M., Boaro, A., Kavouridis, V. K., Hulsbergen, A. F. C., Senders, J. T., Gormley, W. B., Smith, T. R., & Arnaout, O. M. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-817133-2.00009-4
Multi-task Learning with Crowdsourced Features Improves Skin Lesion DiagnosisPreprint
Raumanns, R., Contar, E. K., Schouten, G., & Cheplygina, V. (2020) · arXiv (Cornell University)
Separating Particulate Matter From a Single Microscopic Image
Sandhan, T., & Choi, J. Y. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00464
“…such as nuclei, cells or neurons, so availability of just few hundreds of microscopic images produces thousands of data points, which is enough to train the learning based algorithms such as deep neural networks (DNN) for detection, segmentation or classification tasks [2, 23, 52, 61, 62, 63].”
BackgroundSotoodeh, M., Xiong, L., & Ho, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-75765-6_15
“Since S-EM and Dr. Net constantly performed poorly compared to the other baselines, we omitted them from the plots for better readability.”
MethodInfluentialConvolutional Neural Network Approach in Covid-19 Screening in Asymptomatic Individuals
Zyad, M.-A., Bouikhalene, B., & Zyad, A. (2021) · International Conference on Optimization and Applications (ICOA) · doi:10.1109/icoa51614.2021.9442641
“It was used in brain MRI [15] [16], detection and segmentation of lesions [17] [18] [19] [20] [21] [22] and of tumors [23] [24] [25], whole tissue [26] [27] [28] and sub-cortical structures [29] [30] and automatical detection of lung nodules [31].”
MethodContributions to low-cost imaging and machine learning for plant phenotyping
Samiei, S. (2020) · theses.fr (ABES) · doi:10.70675/7e8959f0z3689z4663z9eefz9be09c7b1521
Morales-Álvarez, P. (2020) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Zhao, L. (2021) · Mobile Information Systems · doi:10.1155/2021/9663389
Leveraging Expert Knowledge for Label Noise Mitigation in Machine Learning
Nguyen, Q., Shikina, T., Teruya, D., Hotta, S., Han, H.-D., & Nakajo, H. (2021) · Applied Sciences · doi:10.3390/app112211040
Xue, R., Jiang, L., Wang, P., Feng, R., & Shan, F. (2021) · IEEE/ACIS International Conference on Computer and Information Science (ICIS) · doi:10.1109/icisfall51598.2021.9627375
Şengöz, N., Yiğit, T., Özmen, Ö., Işık, A. H., & Hemanth, J. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4027238
Takase, T. (2022) · SN Computer Science · doi:10.1007/s42979-022-01076-2
“For example, Albarqouni et al. [1] presented a new concept for learning from crowdsourcing that directly handles data aggregation as part of the learning process of the CNN via an additional crowdsourcing layer to deal with noisy annotations from crowdsourcing.”
BackgroundZhang, Q., Zhong, K., Zhang, X., Hua, C., Kong, T., Li, J., Peng, Y., Wu, J., & Chen, Y. (2022) · Research Square · doi:10.21203/rs.3.rs-1598923/v1
Lu, D. (2022) · Publication Server of Goethe University Frankfurt am Main (Goethe University Frankfurt) · doi:10.21248/gups.67966
Deep Convolution Neural Network Based Breast Cancer Bigdata Analysis for Crowd Cloud Sourcing
(2020) · International Journal of Innovative Technology and Exploring Engineering · doi:10.35940/ijitee.c1081.0193s20
“…works, some of the researchers have focused on detecting breast cancer using image analysis for analysing the cancers have spread beyond the breast, other organs and nearby lymph nodes [3-5], and cell biology [6-8] using selective but small datasets from algorithm evaluation challenges [9-12].”
BackgroundObject-Centric Quality Control and Aggregation of Image Segmentations in Crowdsourcing SetupsPreprint
Bafti, S. M., Ang, C. S., Marcelli, G., & Siriaraya, P. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4181372
"Impact of Deep Learning and Applications in Biomedicine"
Hwang, J.-J. (2022) · Biomedical Journal of Scientific & Technical Research · doi:10.26717/bjstr.2022.42.006718
Adrenal Lesion Classification on T1-Weighted Abdomen Images with Convolutional Neural Networks
Solak, A., Ceylan, R., Bozkurt, M. A., Cebeci, H., & Koplay, M. (2022) · Uluslararası mühendislik araştırma ve geliştirme dergisi · doi:10.29137/umagd.1215882
Speech MOS Multi-Task Learning and Rater Bias Correction
Akrami, H., & Gamper, H. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096572
“Albarqouni et al. estimate each annotator’s sensitivity and specificity using the expectation maximization (EM) algorithm for a neural network [20].”
MethodDeep neural architecture for breast cancer detection from medical CT image modalities
Rani, S., Ahmad, T., & Masood, S. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-96129-5.00006-8
Natural robustness of machine learning in the open world
Wei, H. (2023) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/166625 · Cited by 1
Breast cancer classification using hybrid deep neural networks: staging and grading of cancer
Geetha, M. S., & Selvarani, A. G. (2023) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-231345
“Intheprocessofdiagnosingcan-cer,therearemanyphasesthat,together,establish whetherornotaparticularimageincludescancer [18].”
Convolutional Neural Network-Based Cancer Detection Using Histopathologic Images
Soni, J., Prabakar, N., & Upadhyay, H. (2023) · Studies in big data · doi:10.1007/978-3-031-40688-1_13
Gamification in Open and Distance Learning: A Systematic Review
Sümer, M., & Aydın, C. H. (2023) · Springer eBooks · doi:10.1007/978-3-319-17461-7_115
Gamry, K., & Omarov, B. S. (2022) · INTERNATIONAL JOURNAL OF INFORMATION AND COMMUNICATION TECHNOLOGIES · doi:10.54309/ijict.2022.12.4.006
Deep Learning Approaches for Small Data Sets in Medical Imaging
Shekhawat, S. S., & Kumar, S. (2019) · International Journal of Psychosocial Rehabilitation · doi:10.61841/v23i6/400332
Lung Disease Classification Using Convolutional Neural Network (CNNs)
Jayanthi, J. G., Kumar, A., Phieri, D., Patil, M., Purohit, P. Y., & Metha, V. (2023) · International Conference on Futuristic Technologies (INCOFT) · doi:10.1109/incoft60753.2023.10425236
“Convolutional networks [24, 25] play a crucial role in achieving state-of-the-art results for various computer vision tasks.”
BackgroundToward complex data structure aggregation and truth discovery
Sabetpour, N. (2022) · doi:10.31274/td-20240329-813
Zhang, Q., Zhang, X., Hua, C., Kong, T., Li, J., Peng, Y., Wu, J., & Chen, Y. (2024) · Research Square · doi:10.21203/rs.3.rs-4126940/v1
Machine Learning in Medical Imaging: Ethico-Legal and Privacy Issues
Sıngh, V., & Rani, S. (2024) · Advances in medical technologies and clinical practice book series · doi:10.4018/979-8-3693-5261-8.ch003
Unlocking Biologica Insights: Harnessing Machine Learning for Analysis in Complex Biological Data
Nancy, P., Padmapriya, G., Anand, M. S., Vinod, D. F., & Rosaline, R. A. A. (2024) · Advances in information security, privacy, and ethics book series · doi:10.4018/979-8-3693-4159-9.ch016
Ewecker, L., Ohnemus, L., Schwager, R., Roos, S., Brühl, T., & Saralajew, S. (2024) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55156.2024.10588455
“Objective annotations are thereby approached by optimizing the annotation process via crowd annotations by non-experts [33], [34], expert annotations [29], or a combination of both [35].”
MethodSaif, A. F. M. S., & Duong, T. (2023) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci62032.2023.00201
“Recently, substantial convolutional systems have accomplished magnificent execution in many pictorial division assignments [23] [24] [25] and are excitedly applied in the field of clinical picture appraisal [26] [27] [28].”
BackgroundLearning from Multiple Noisy Annotations via Trustable Data Mixture
Wang, R., Chen, F., Guan, C., Xue, C., Ji, X., & Li, W. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-5666-7_36
Label Selection Approach to Learning from Crowds
Yoshimura, K., & Kashima, H. (2024) · Transactions of the Japanese Society for Artificial Intelligence · doi:10.1527/tjsai.39-5_f-o23 · Cited by 1
Multiple Cancer Types Classification Based on Gene Data Expression via Partial Binary Tree HTWSVM
Hou, Y., Ma, W., & Zhang, K. (2024) · International Conference on Communications, Information System and Computer Engineering (CISCE) · doi:10.1109/cisce62493.2024.10653412
“Up to now, different machine learning methods such as Support Vector Machine, Naive Bayes, Random Forest [1] and Deep Learning [2] . have been studied, which offered unprecedented opportunities to explore the occurrence and development of cancer by gene expression data [3,4] .”
MethodInteligencia artificial en el diagnóstico histopatológico de microorganismos
Coba, A. G., Victoria, M., Romero-Fandiño, I. A., Quintero, L. M., Mosquera‐Zamudio, A., Nieto, J. F. P., Díaz, J. J. S., López, A. G., & Parra-Medina, R. S. (2024) · Revista Repertorio de Medicina y Cirugía · doi:10.31260/repertmedcir.01217372.1585 · Cited by 1
Artificial intelligence methods for predictive image-based grading of human cancers
Fernández, G., Madduri, A. S., Marami, B., Prastawa, M. W., Scott, R., Zeineh, J., & Donovan, M. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-95359-7.00014-5
Machine Learning Methods for Early Detection of Breast Cancer: A Short Review
Rathi, M., Soomro, T. A., Baro, E. N., & Chowdhry, B. S. (2024) · Global Conference on Wireless and Optical Technologies (GCWOT) · doi:10.1109/gcwot63882.2024.10805596
“A deep CNN model was used by Albarqouni et al [18], using the experts’ crowd annotations in a biomedical context.”
Singh, A. P., Singh, A., Kumar, A., Sharan, H. O., & Raghuvanshi, C. S. (2025) · AIP conference proceedings · doi:10.1063/5.0247266
Banerjee, S., & Panigrahi, S. (2024) · International Conference on Intelligent Systems and Embedded Design (ISED) · doi:10.1109/ised63599.2024.10956302
“Low-grade tumors frequently recur later, but high-grade carcinomas cause treatment failures early [1], [4].”
Artificial Intelligence in Radiological Diagnosis of Lung Diseases
Pisarenco, N. (2024) · Bulletin of the Academy of Sciences of Moldova Medical Sciences · doi:10.52692/1857-0011.2024.2-79.35
Multi-rater Prism: learning self-calibrated medical image segmentation from multiple raters
Liu, Y., Xu, Y., Yang, W., Li, X., Wu, J., & Fang, H. (2025) · Chinese Science Bulletin (Chinese Version) · doi:10.1360/csb-2025-0501
RRAC: Reciprocal Robustness Via Asymmetric Co-Training for Label Noise Resistance in Deep Learning
Althunyan, R., & Artoli, A. M. (2025) · IEEE Access · doi:10.1109/access.2025.3610572
“The associate editor coordinating the review of this manuscript and approving it for publication was Li Zhang . to less reliable and costly labeling resources such as crowd-sourcing [14], web-crawled incidental annotations [15], or imperfect machine annotations [16].”
Developing a CNN Model (Rebbica) for Effective Lung Cancer Classification on Histopathology Images
Adithya, N. N. S. S. S., Sah, P., Jyothirmai, B., Mishra, N., & Indira, D. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-032-06677-0_13
Bafti, S. M. (2023) · Kent Academic Repository (University of Kent) · doi:10.22024/unikent/01.02.99575
Unger, M., & Kather, J. N. (2024) · Figshare · doi:10.6084/m9.figshare.26677325
Improving cell localization with attention-guided diffusion models
Liu, W. T., Xu, C., Yuan, Y., Ye, W., Xiong, H., Qiu, W., Guo, L., Li, X., Li, X., & 徐如祥 (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.113507
Vakilimofrad, H., Movlaie, R., Zarghani, M., & Ghamgosar, A. (2026) · Health Care For Women International · doi:10.1080/07399332.2025.2597244
“The next highly cited articles were in the field of BC classification, cancer cell detection, and the use of emerging imaging methods (Albarqouni et al., 2016; Araújo et al., 2017; Berger et al., 2018; Keren et al., 2018; Khan et al., 2019; Shen et al., 2019; Spanhol et al., 2016; Xu et al., 2016).”
Meta-learning representations for learning from multiple annotators
Kumagai, A., Iwata, T., Nishiyama, T., Ida, Y., & Fujiwara, Y. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.132744
Transfer Learning with Limited Data for Mice Lung Segmentation in Synchrotron X-Ray Tomography
Blagojević, A., Obradović, O., Geroski, T., Pavić, O., Kim, M. W., & Filipović, N. (2026) · Annals of Biomedical Engineering · doi:10.1007/s10439-026-04036-6
“In recent years, advancements in computer vision and machine learning have significantly contributed to the progress in the field of medical image segmentation [1–4].”
Badugu, S., Kumar, V. D. A., & Jothikumar, R. (2025) · International Conference on Computational Innovations and Sustainable Technologies (ICCIST) · doi:10.1109/iccist67338.2025.11438834
Context aware deep learning techniques for analysis of breast cancer histopathology: a review
Dutta, R. M., Sekh, A. A., Dogra, D. P., & Dan, P. K. (2026) · Discover Computing · doi:10.1007/s10791-026-10071-7
Brain Morphology Quantification for Large MRI Cohorts using Convolutional Neural Networks
Thyreau, B. (2023) · Institutional Repositories DataBase (IRDB)
Metadata
- Authors
- Albarqouni, S., Baur, C., Achilles, F., Belagiannis, V., Demirci, S., & Navab, N.
- Affiliations
- German Center for Neurodegenerative Diseases (DE)
- Technical University of Munich (DE)
- University of Oxford (GB)
- Johns Hopkins University (US)
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2016-05
- Volume
- 35
- Issue
- 5
- Pages
- 1313-1321
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2339885376
- Cited by
- 606
- References
- 38
- Citations by year
- 2026: 14 · 2025: 24 · 2024: 59 · 2023: 59 · 2022: 60 · 2021: 92 · 2020: 89 · 2019: 80 · 2018: 73 · 2017: 46 · 2016: 10
- FWCI
- 57.40
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- DZNE Pub (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Biophysics › Cell Image Analysis Techniques
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Keywords
- mitosis detection, breast cancer histopathology, crowdsourced annotation, noisy annotations, data aggregation, convolutional neural networks, CrowdFlower
- MeSH terms
- Machine Learning, Breast Neoplasms, Female, Histocytochemistry, Humans, Image Interpretation, Computer-Assisted, Mitosis, Neural Networks, Computer, Video Games, Internet, Crowdsourcing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.