The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
A Comparison of Pooling Methods for Convolutional Neural Networks
Open accessAbstract
One of the most promising techniques used in various sciences is deep neural networks (DNNs). A special type of DNN called a convolutional neural network (CNN) consists of several convolutional layers, each preceded by an activation function and a pooling layer. The feature map of the previous layer is sampled by the pooling layer (that seems to be an important layer) to create a new feature map with condensed resolution. This layer significantly reduces the spatial dimension of the input. It always accomplished two main goals. As a first step, it reduces the number of parameters or weights to minimize computational costs. The second step is to prevent the overfitting of the network. In addition, pooling techniques can significantly reduce model training time and computational costs. This paper provides a critical understanding of traditional and modern pooling techniques and highlights the strengths and weaknesses for readers. Moreover, the performance of pooling techniques on different datasets is qualitatively evaluated and reviewed. This study is expected to contribute to a comprehensive understanding of the importance of CNNs and pooling techniques in computer vision challenges.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
EMNIST: Extending MNIST to handwritten letters
Cohen, G., Afshar, S., Tapson, J., & van Schaik, A. (2017) · 2017 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966217 · Cited by 1,651
The pyramid match kernel: discriminative classification with sets of image features
Grauman, K., & Darrell, T. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.239 · Cited by 1,481
Medical image analysis using convolutional neural networks: a review
Anwar, S. M., Majid, M., Qayyum, A., Awais, M., Alnowami, M., & Khan, M. K. (2018) · Journal of Medical Systems · doi:10.1007/s10916-018-1088-1 · Cited by 1,431
Zhang, W., Li, C., Peng, G., Chen, Y., & Zhang, Z. (2018) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2017.06.022 · Cited by 1,421
A Theoretical Analysis of Feature Pooling in Visual Recognition
Boureau, Y.-L., Ponce, J., & LeCun, Y. (2010) · Cited by 1,196
Principal components, minor components, and linear neural networks
Oja, E. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80089-9 · Cited by 814
An Analysis Of Convolutional Neural Networks For Image Classification
Sharma, N., Jain, V., & Mishra, A. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.05.198 · Cited by 701
Bengio, Y., Lecun, Y., & Hinton, G. (2021) · Communications of the ACM · doi:10.1145/3448250 · Cited by 661
Chen, G., Li, S., Knibbs, L. D., Hamm, N. A. S., Cao, W., Li, T., Guo, J., Ren, H., Abramson, M. J., & Guo, Y. (2018) · Science of The Total Environment · doi:10.1016/j.scitotenv.2018.04.251 · Cited by 591
Accelerating Binarized Convolutional Neural Networks with Software-Programmable FPGAs
Zhao, R., Song, W., Zhang, W., Xing, T., Lin, J.-H., Srivastava, M., Gupta, R., & Zhang, Z. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021741 · Cited by 429
Deep convolution neural network for image recognition
Traore, B. B., Kamsu-Foguem, B., & Tangara, F. (2018) · Ecological Informatics · doi:10.1016/j.ecoinf.2018.10.002 · Cited by 417
Avoiding Overfitting: A Survey on Regularization Methods for Convolutional Neural Networks
Santos, C. F. G. D., & Papa, J. P. (2022) · ACM Computing Surveys · doi:10.1145/3510413 · Cited by 415
Mixed Pooling for Convolutional Neural Networks
Yu, D., Wang, H., Chen, P., & Wei, Z. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-11740-9_34 · Cited by 409
Generalizing Pooling Functions in Convolutional Neural Networks: Mixed, Gated, and TreePreprint
Lee, C., Gallagher, P. W., & Zhuowen Tu, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.08985 · Cited by 386
A new approach for arrhythmia classification using deep coded features and LSTM networks
Yildirim, O., Baloglu, U. B., Tan, R.-S., Ciaccio, E. J., & Acharya, U. R. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.05.004 · Cited by 386
Towards dropout training for convolutional neural networks
Wu, H., & Gu, X. (2015) · Neural Networks · doi:10.1016/j.neunet.2015.07.007 · Cited by 314
Multi-class brain tumor classification using residual network and global average pooling
Kumar, R. L., Kakarla, J., Isunuri, B. V., & Singh, M. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10335-4 · Cited by 273
Refining activation downsampling with SoftPool
Stergiou, A., Poppe, R., & Kalliatakis, G. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01019 · Cited by 271
He, Z., Shao, H., Zhong, X., & Zhao, X. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106396 · Cited by 250
Murray, N., & Perronnin, F. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.317 · Cited by 238
Interpretation of intelligence in CNN-pooling processes: a methodological survey
Akhtar, N., & Ragavendran, U. (2020) · Neural Computing and Applications · doi:10.1007/s00521-019-04296-5 · Cited by 184
Wavelet Pooling for Convolutional Neural Networks
Williams, T., & Li, R. (2018) · International Conference on Learning Representations · Cited by 182
Overfitting remedy by sparsifying regularization on fully-connected layers of CNNs
Xu, Q., Zhang, M., Gu, Z., & Pan, G. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.03.080 · Cited by 174
Singh, P., Chaudhury, S., & Panigrahi, B. K. (2021) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2021.100863 · Cited by 170
Spectral Representations for Convolutional Neural Networks
Rippel, O., Snoek, J., & Adams, R. P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03767 · Cited by 168
Learning pattern classification-a survey
Kulkarni, S. R., Lugosi, G., & Venkatesh, S. S. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.720536 · Cited by 161
Detail-Preserving Pooling in Deep Networks
Saeedan, F., Weber, N., Goesele, M., & Roth, S. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00949 · Cited by 155
LIP: Local Importance-Based Pooling
Gao, Z., Wang, L., & Wu, G. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00345 · Cited by 141
Li, Z., Li, Y., Yang, Y., Guo, R., Yang, J., Yue, J., & Wang, Y. (2021) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2021.106054 · Cited by 114
Data-Driven Based Tiny-YOLOv3 Method for Front Vehicle Detection Inducing SPP-Net
Wang, X., Wang, S., Cao, J., & Wang, Y. (2020) · IEEE Access · doi:10.1109/access.2020.3001279 · Cited by 96
Rank-based pooling for deep convolutional neural networks
Shi, Z., Ye, Y., & Wu, Y. (2016) · Neural Networks · doi:10.1016/j.neunet.2016.07.003 · Cited by 88
Mixed pooling and richer attention feature fusion for crack detection
Zhou, Q., Qu, Z., & Cao, C. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.02.005 · Cited by 87
Siddique, F., Sakib, S., & Siddique, M. A. B. (2019) · International Conference on Advances in Electrical Engineering · doi:10.1109/icaee48663.2019.8975496 · Cited by 86
S3Pool: Pooling with Stochastic Spatial Sampling
Zhai, S., Wu, H., Kumar, A., Cheng, Y., Lu, Y., Zhang, Z. M., & Feris, R. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.426 · Cited by 83
Chen, Y., Ming, D., & Lv, X. (2019) · Earth Science Informatics · doi:10.1007/s12145-019-00383-2 · Cited by 83
Rapid Detection of Blind Roads and Crosswalks by Using a Lightweight Semantic Segmentation Network
Cao, Z., Xu, X., Hu, B., & Zhou, M. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2989129 · Cited by 82
Nayak, D. R., Dash, R., & Majhi, B. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2020.04.018 · Cited by 74
Mumuni, A., & Mumuni, F. (2021) · SN Computer Science · doi:10.1007/s42979-021-00735-0 · Cited by 74
Abouelaziz, I., Chetouani, A., Hassouni, M. E., Latecki, L. J., & Cherifi, H. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.107174 · Cited by 68
Improved Audio Scene Classification Based on Label-Tree Embeddings and Convolutional Neural Networks
Phan, H., Hertel, L., Maaß, M., et al. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2690564 · Cited by 62
Multi-Bias Non-linear Activation in Deep Neural NetworksPreprint
Li, H., Ouyang, W., & Wang, X. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.00676 · Cited by 54
A novel stochastic resonance model based on bistable stochastic pooling network and its application
Zhang, W., Shi, P., Li, M., & Han, D. (2021) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2021.110800 · Cited by 50
Zhang, D., Song, K., Xu, J., Dong, H., & Yan, Y. (2021) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2021.108334 · Cited by 50
Deep neural network to extract high-level features and labels in multi-label classification problems
Bello, M., Nápoles, G., Sánchez, R., Bello, R., & Vanhoof, K. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.06.117 · Cited by 49
Combining max-pooling and wavelet pooling strategies for semantic image segmentation
Brito, A. D. S., Vieira, M. B., de Andrade, M. L. S. C., Feitosa, R. Q., & Giraldi, G. A. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115403 · Cited by 48
CNN Based Features Extraction for Age Estimation and Gender Classification
Benkaddour, M. K. (2021) · Informatica · doi:10.31449/inf.v45i5.3262 · Cited by 44
RNNPool: Efficient Non-linear Pooling for RAM Constrained InferencePreprint
Saha, O., Kusupati, A., Simhadri, H. V., Varma, M., & Jain, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.11921 · Cited by 40
Computer vision-based approach for smart traffic condition assessment at the railroad grade crossing
Guo, F., Wang, Y., & Qian, Y. (2021) · Advanced Engineering Informatics · doi:10.1016/j.aei.2021.101456 · Cited by 37
A comparative analysis of pooling strategies for convolutional neural network based Hindi ASR
Passricha, V., & Aggarwal, R. K. (2019) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-019-01325-y · Cited by 34
Linking functional traits to multiscale statistics of leaf venation networks
Blonder, B. W., Both, S., Jodra, M., et al. (2020) · New Phytologist · doi:10.1111/nph.16830 · Cited by 33
Learnable Dynamic Temporal Pooling for Time Series Classification
Lee, D., Lee, S., & Yu, H. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.17008 · Cited by 33
Prediction of ball milling performance by a convolutional neural network model and transfer learning
Li, Y., Bao, J., Chen, T., Yu, A., & Yang, R. (2022) · Powder Technology · doi:10.1016/j.powtec.2022.117409 · Cited by 27
Mixed fuzzy pooling in convolutional neural networks for image classification
Sharma, T., Verma, N. K., & Masood, S. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13553-0 · Cited by 23
PUMP: Pyramidal and Uniqueness Matching Priors for Unsupervised Learning of Local Descriptors
Revaud, J., Leroy, V., Weinzaepfel, P., & Chidlovskii, B. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00390 · Cited by 16
Fast and Compact Bilinear Pooling by Shifted Random Maclaurin
Yu, T., Li, X., & Li, P. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i4.16435 · Cited by 15
RP-Unet: a Unet-based network with RNNPool enables computation-efficient polyp segmentation
Chen, Y., Liu, Z., & Shi, Y. (2021) · International Workshop on Pattern Recognition (IWPR) · doi:10.1117/12.2604803 · Cited by 1
Cited by
Artificial intelligence-based smart quality inspection for manufacturing
Sundaram, S., & Zeid, A. (2023) · Micromachines · doi:10.3390/mi14030570 · Cited by 260
Metadata
- Authors
- Zafar, A., Aamir, M., Mohd Nawi, N., Arshad, A., Riaz, S., Alruban, A., Dutta, A. K., & Almotairi, S.
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2022-08-29
- Volume
- 12
- Issue
- 17
- Pages
- 8643
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W4293527381
- Cited by
- 367
- References
- 63
- FWCI
- 23.80
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.