The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Basic Tenets of Classification Algorithms K-Nearest-Neighbor, Support Vector Machine, Random Forest and Neural Network: A Review
Open accessAbstract
In this paper, sixty-eight research articles published between 2000 and 2017 as well as textbooks which employed four classification algorithms: K-Nearest-Neighbor (KNN), Support Vector Machines (SVM), Random Forest (RF) and Neural Network (NN) as the main statistical tools were reviewed. The aim was to examine and compare these nonparametric classification methods on the following attributes: robustness to training data, sensitivity to changes, data fitting, stability, ability to handle large data sizes, sensitivity to noise, time invested in parameter tuning, and accuracy. The performances, strengths and shortcomings of each of the algorithms were examined, and finally, a conclusion was arrived at on which one has higher performance. It was evident from the literature reviewed that RF is too sensitive to small changes in the training dataset and is occasionally unstable and tends to overfit in the model. KNN is easy to implement and understand but has a major drawback of becoming significantly slow as the size of the data in use grows, while the ideal value of K for the KNN classifier is difficult to set. SVM and RF are insensitive to noise or overtraining, which shows their ability in dealing with unbalanced data. Larger input datasets will lengthen classification times for NN and KNN more than for SVM and RF. Among these nonparametric classification methods, NN has the potential to become a more widely used classification algorithm, but because of their time-consuming parameter tuning procedure, high level of complexity in computational processing, the numerous types of NN architectures to choose from and the high number of algorithms used for training, most researchers recommend SVM and RF as easier and wieldy used methods which repeatedly achieve results with high accuracies and are often faster to implement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
Least Squares Support Vector Machine Classifiers
Suykens, J. A. K., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,362
Statistical pattern recognition: a review
Jain, A. K., Duin, P. W., & Mao, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824819 · Cited by 6,767
Classification of hyperspectral remote sensing images with support vector machines
Melgani, F., & Bruzzone, L. (2004) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2004.831865 · Cited by 4,411
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770
An assessment of the effectiveness of a random forest classifier for land-cover classification
Rodriguez-Galiano, V. F., Ghimire, B., Rogan, J., Chica-Olmo, M., & Rigol-Sanchez, J. P. (2012) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2011.11.002 · Cited by 2,907
BoosTexter: A Boosting-based System for Text Categorization
Schapire, R. E., & Singer, Y. (2000) · Machine Learning · doi:10.1023/a:1007649029923 · Cited by 2,188
An assessment of support vector machines for land cover classification
Huang, C., Davis, L. S., & Townshend, J. R. G. (2002) · International Journal of Remote Sensing · doi:10.1080/01431160110040323 · Cited by 1,795
Financial time series forecasting using support vector machines
Kim, K.-J. (2003) · Neurocomputing · doi:10.1016/s0925-2312(03)00372-2 · Cited by 1,734
Image Classification using Random Forests and Ferns
Bosch, A., Zisserman, A., & Munoz, X. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409066 · Cited by 1,244
Introduction Neural networks in remote sensing
Atkinson, P. M., & Tatnall, A. R. L. (1997) · International Journal of Remote Sensing · doi:10.1080/014311697218700 · Cited by 1,018
Intrusion detection by machine learning: A review
Tsai, C.-F., Hsu, Y.-F., Lin, C.-Y., & Lin, W.-Y. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.05.029 · Cited by 969
Classification using intersection kernel support vector machines is efficient
Maji, S., Berg, A. C., & Malik, J. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587630 · Cited by 940
Chen, W., Xie, X., Wang, J., Pradhan, B., Hong, H., Bui, D. T., Duan, Z., & Ma, J. (2017) · CATENA · doi:10.1016/j.catena.2016.11.032 · Cited by 930
Chan, J. C.-W., & Paelinckx, D. (2008) · Remote Sensing of Environment · doi:10.1016/j.rse.2008.02.011 · Cited by 858
Flood hazard risk assessment model based on random forest
Wang, Z., Lai, C., Chen, X., Yang, B., Zhao, S., & Bai, X. (2015) · Journal of Hydrology · doi:10.1016/j.jhydrol.2015.06.008 · Cited by 822
Intrusion detection using neural networks and support vector machines
Mukkamala, S., Janoski, G., & Sung, A. (2003) · Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290) · doi:10.1109/ijcnn.2002.1007774 · Cited by 814
An application of support vector machines in bankruptcy prediction model
Shin, K.-S., Lee, T. S., & Kim, H.-J. (2005) · Expert Systems with Applications · doi:10.1016/j.eswa.2004.08.009 · Cited by 808
Statnikov, A., Wang, L., & Aliferis, C. F. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-319 · Cited by 686
Support vector machine: A tool for mapping mineral prospectivity
Zuo, R., & Carranza, E. J. M. (2010) · Computers & Geosciences · doi:10.1016/j.cageo.2010.09.014 · Cited by 550
Raczko, E., & Zagajewski, B. (2017) · European Journal of Remote Sensing · doi:10.1080/22797254.2017.1299557 · Cited by 405
Applications of Support Vector Machines in Chemistry
Ivanciuc, O. (2007) · Reviews in Computational Chemistry · doi:10.1002/9780470116449.ch6 · Cited by 384
Artificial neural networks: A new method for mineral prospectivity mapping
Brown, W. M., Gedeon, T. D., Groves, D. I., & Barnes, R. G. (2000) · Australian Journal of Earth Sciences · doi:10.1046/j.1440-0952.2000.00807.x · Cited by 331
Classifier ensembles for land cover mapping using multitemporal SAR imagery
Waske, B., & Braun, M. (2009) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2009.01.003 · Cited by 319
Support vector machine for multi-classification of mineral prospectivity areas
Abedi, M., Norouzi, G.-H., & Bahroudi, A. (2012) · Computers & Geosciences · doi:10.1016/j.cageo.2011.12.014 · Cited by 307
Chen, H.-L., Huang, C.-C., Yu, X.-G., Xu, X., Sun, X., Wang, G., & Wang, S.-J. (2013) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.07.014 · Cited by 303
Foody, G. M., & Arora, M. K. (1997) · International Journal of Remote Sensing · doi:10.1080/014311697218764 · Cited by 300
Applications of Support Vector Machines to Speech Recognition
Ganapathiraju, A., Hamaker, J., & Picone, J. (2004) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2004.831018 · Cited by 280
MSVM-RFE: extensions of SVM-RFE for multiclass gene selection on DNA microarray data
Zhou, X., & Tuck, D. P. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm036 · Cited by 256
Al-Anazi, A., & Gates, I. D. (2010) · Engineering Geology · doi:10.1016/j.enggeo.2010.05.005 · Cited by 249
Ghimire, B., Rogan, J., Galiano, V. R., Panday, P., & Neeti, N. (2012) · GIScience & Remote Sensing · doi:10.2747/1548-1603.49.5.623 · Cited by 246
Vincenzi, S., Zucchetta, M., Franzoi, P., Pellizzato, M., Pranovi, F., De Leo, G. A., & Torricelli, P. (2011) · Ecological Modelling · doi:10.1016/j.ecolmodel.2011.02.007 · Cited by 241
Face Recognition Using Total Margin-Based Adaptive Fuzzy Support Vector Machines
Liu, Y.-H., & Chen, Y.-T. (2007) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.883013 · Cited by 203
Palaniappan, R., Sundaraj, K., & Sundaraj, S. (2014) · BMC Bioinformatics · doi:10.1186/1471-2105-15-223 · Cited by 178
Rodriguez-Galiano, V. F., & Chica-Rivas, M. (2012) · International Journal of Digital Earth · doi:10.1080/17538947.2012.748848 · Cited by 170
DEEP CONVOLUTIONAL NEURAL NETWORK FOR AUTOMATIC DETECTION OF DAMAGED PHOTOVOLTAIC CELLS
Pierdicca, R., Malinverni, E. S., Piccinini, F., Paolanti, M., Felicetti, A., & Zingaretti, P. (2018) · The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprs-archives-xlii-2-893-2018 · Cited by 166
Performance of KNN and SVM classifiers on full word Arabic articles
Hmeidi, I., Hawashin, B., & El‐Qawasmeh, E. (2008) · Advanced Engineering Informatics · doi:10.1016/j.aei.2007.12.001 · Cited by 149
Statistical Mechanics of Support Vector Networks
Dietrich, R., Opper, M., & Sompolinsky, H. (1999) · Physical Review Letters · doi:10.1103/physrevlett.82.2975 · Cited by 135
Retinal vision applied to facial features detection and face authentication
Smeraldi, F., & Bigün, J. (2002) · Pattern Recognition Letters · doi:10.1016/s0167-8655(01)00178-7 · Cited by 113
Artificial neural networks as a tool for mineral potential mapping with GIS
Rigol-Sánchez, J. P., Chica‐Olmo, M., & Abarca-Hernández, F. (2003) · International Journal of Remote Sensing · doi:10.1080/0143116021000031791 · Cited by 89
The Improvement of Land Cover Classification by Thermal Remote Sensing
Sun, L., & Schulz, K. (2015) · Remote Sensing · doi:10.3390/rs70708368 · Cited by 88
Shrivastava, R., Mahalingam, H., & Dutta, N. N. (2017) · Chemical Engineering Communications · doi:10.1080/00986445.2017.1292259 · Cited by 40
Decision trees for the analysis of genes involved in Alzheimer׳s disease pathology
Mestizo-Gutiérrez, S. L., Herrera-Rivero, M., Ramírez, N. C., Hernández, E., & Aranda-Abreu, G. E. (2014) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2014.05.002 · Cited by 23
Active volume models for 3D medical image segmentation
Shen, T., Li, H., Qian, Z. Y., & Huang, X. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206563 · Cited by 22
An asymptotic statistical analysis of support vector machines with soft margins
Ikeda, K., & Aoishi, T. (2005) · Neural Networks · doi:10.1016/j.neunet.2004.11.008 · Cited by 20
Beluco, A., Engel, P. M., & Beluco, A. (2015) · International journal of energy and environment · doi:10.5935/2076-2909.20150001 · Cited by 6
Cited by
Artificial intelligence in environmental monitoring: Advancements, challenges, and future directions
Olawade, D. B., Wada, O. Z., Ige, A. O., Egbewole, B. I., Olojo, A., & Oladapo, B. I. (2024) · Hygiene and Environmental Health Advances · doi:10.1016/j.heha.2024.100114 · Cited by 326
Metadata
- Authors
- Boateng, E. Y., Otoo, J., & Abaye, D. A.
- Venue
- Journal of Data Analysis and Information Processing
- Publisher
- Scientific Research Publishing, Inc.
- Published
- 2020
- Volume
- 08
- Issue
- 04
- Pages
- 341-357
- ISSN
- 2327-7203 (ISSN-L)
- 2327-7211
- OpenAlex
- W3109126425
- Cited by
- 462
- References
- 51
- FWCI
- 21.15
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.