The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Hyperparameter Tuning for Machine Learning Algorithms Used for Arabic Sentiment Analysis
Open accessAbstract
Machine learning models are used today to solve problems within a broad span of disciplines. If the proper hyperparameter tuning of a machine learning classifier is performed, significantly higher accuracy can be obtained. In this paper, a comprehensive comparative analysis of various hyperparameter tuning techniques is performed; these are Grid Search, Random Search, Bayesian Optimization, Particle Swarm Optimization (PSO), and Genetic Algorithm (GA). They are used to optimize the accuracy of six machine learning algorithms, namely, Logistic Regression (LR), Ridge Classifier (RC), Support Vector Machine Classifier (SVC), Decision Tree (DT), Random Forest (RF), and Naive Bayes (NB) classifiers. To test the performance of each hyperparameter tuning technique, the machine learning models are used to solve an Arabic sentiment classification problem. Sentiment analysis is the process of detecting whether a text carries a positive, negative, or neutral sentiment. However, extracting such sentiment from a complex derivational morphology language such as Arabic has been always very challenging. The performance of all classifiers is tested using our constructed dataset both before and after the hyperparameter tuning process. A detailed analysis is described, along with the strengths and limitations of each hyperparameter tuning technique. The results show that the highest accuracy was given by SVC both before and after the hyperparameter tuning process, with a score of 95.6208 obtained when using Bayesian Optimization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2012) · Cited by 8,009
On hyperparameter optimization of machine learning algorithms: Theory and practice
Yang, L., & Shami, A. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.07.061 · Cited by 3,232
Adaptive probabilities of crossover and mutation in genetic algorithms
Srinivas, M., & Patnaik, L. M. (1994) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.286385 · Cited by 2,512
Logistic regression and Artificial Neural Network Classification models: A methodology review
Dreiseitl, S., & Ohno-Machado, L. (2002) · Journal of Biomedical Informatics · doi:10.1016/s1532-0464(03)00034-0 · Cited by 2,177
Genetic algorithms: concepts and applications [in engineering design]
Man, K. F., Tang, K. S., & Kwong, S. (1996) · IEEE Transactions on Industrial Electronics · doi:10.1109/41.538609 · Cited by 1,120
Tunability: Importance of Hyperparameters of Machine Learning Algorithms
Probst, P., Bischl, B., & Boulesteix, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.09596 · Cited by 565
Syarif, I., Prugel-Bennett, A., & Wills, G. (2016) · TELKOMNIKA (Telecommunication Computing Electronics and Control) · doi:10.12928/telkomnika.v14i4.3956 · Cited by 524
Porto, V. W., Eiben, A. E., Waagen, D., & Saravanan, N. (1998) · Lecture notes in computer science · doi:10.1007/bfb0040753 · Cited by 430
Comparing and combining sentiment analysis methods
Gonçalves, P., Araújo, M., Benevenuto, F., & Cha, M. (2013) · Proceedings of the first ACM conference on Online social networks · doi:10.1145/2512938.2512951 · Cited by 371
Sentiment analysis in Arabic: A review of the literature
Boudad, N., Faizi, R., Oulad Haj Thami, R., & Chiheb, R. (2018) · Ain Shams Engineering Journal · doi:10.1016/j.asej.2017.04.007 · Cited by 277
Particle swarm optimization for hyper-parameter selection in deep neural networks
Lorenzo, P. R., Nalepa, J., Kawulok, M., Ramos, L. S., & Pastor, J. R. (2017) · Proceedings of the Genetic and Evolutionary Computation Conference · doi:10.1145/3071178.3071208 · Cited by 260
A study of the effects of preprocessing strategies on sentiment analysis for Arabic text
Duwairi, R., & El-Orfali, M. (2014) · Journal of Information Science · doi:10.1177/0165551514534143 · Cited by 178
Bayesian Optimization for Accelerating Hyper-Parameter Tuning
Nguyen, V. (2019) · 2019 IEEE Second International Conference on Artificial Intelligence and Knowledge Engineering (AIKE) · doi:10.1109/aike.2019.00060 · Cited by 163
Arabic Sentiment Analysis Using Supervised Classification
Duwairi, R., & Qarqaz, I. (2014) · International Conference on Future Internet of Things and Cloud (FiCloud) · doi:10.1109/ficloud.2014.100 · Cited by 132
de la Torre, R., Corlu, C. G., Faulín, J., Onggo, B. S., & Juan, A. A. (2021) · Sustainability · doi:10.3390/su13031551 · Cited by 130
Comparing Twitter and Facebook user behavior: Privacy and other aspects
Buccafurri, F., Lax, G., Nicolazzo, S., & Nocera, A. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.05.045 · Cited by 102
Extending MLP ANN hyper-parameters Optimization by using Genetic Algorithm
Itano, F., de Sousa, M. A. D. A., & Del-Moral-Hernandez, E. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489520 · Cited by 87
Surface and Deep Features Ensemble for Sentiment Analysis of Arabic Tweets
Al-Twairesh, N., & Al-Negheimish, H. (2019) · IEEE Access · doi:10.1109/access.2019.2924314 · Cited by 83
Weighted Random Search for CNN Hyperparameter Optimization
Andonie, R., & Florea, A.-C. (2020) · International Journal of Computers Communications & Control · doi:10.15837/ijccc.2020.2.3868 · Cited by 77
Improving Sentiment Analysis in Arabic Using Word Representation
Alayba, A. M., Palade, V., England, M., & Iqbal, R. (2018) · IEEE International Workshop on Arabic and Derived Script Analysis and Recognition (ASAR) · doi:10.1109/asar.2018.8480191 · Cited by 76
Yan, X., He, F., & Chen, Y. (2017) · Journal of Computer Science and Technology · doi:10.1007/s11390-017-1714-2 · Cited by 68
Particle Swarm Optimization With Probability Sequence for Global Optimization
Rauf, H. T., Shoaib, U., Lali, M. I. U., Alhaisoni, M. M., Irfan, M. N., & Khan, M. A. (2020) · IEEE Access · doi:10.1109/access.2020.3002725 · Cited by 68
Wicaksono, A. S., & Afif, A. (2018) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2018.091238 · Cited by 67
Villalobos-Arias, L., Quesada–López, C., Guevara-Coto, J. A., Martínez, A., & Jenkins, M. (2020) · doi:10.1145/3416508.3417121 · Cited by 66
Center Particle Swarm Optimization Algorithm
Xiaojing, Y., Qingju, J., & Xinke, L. (2019) · IEEE Information Technology, Networking, Electronic and Automation Control Conference (ITNEC) · doi:10.1109/itnec.2019.8729510 · Cited by 43
Financial Context News Sentiment Analysis for the Lithuanian Language
Štrimaitis, R., Stefanovič, P., Ramanauskaitė, S., & Slotkienė, A. (2021) · Applied Sciences · doi:10.3390/app11104443 · Cited by 37
Genetic algorithm with self-adaptive mutation controlled by chromosome similarity
Smullen, D., Gillett, J., Heron, J., & Rahnamayan, S. (2014) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2014.6900591 · Cited by 20
Martínez‐Cámara, E., Rodríguez-Barroso, N., Moya, A. R., Fernández, J. A., Romero, E., & Herrera, F. (2019) · Annals of Computer Science and Information Systems · doi:10.15439/2019f183 · Cited by 18
Girgis, M. R., Elgeldawi, E., & Gamal, R. M. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-58669-0_45 · Cited by 2
Self-citation
Metadata
- Authors
- Elgeldawi, E., Sayed, A., Galal, A. R., & Zaki, A. M.
- Venue
- Informatics
- Publisher
- MDPI AG
- Published
- 2021-11-17
- Volume
- 8
- Issue
- 4
- Pages
- 79
- ISSN
- 2227-9709 (ISSN-L)
- OpenAlex
- W3212135906
- Cited by
- 399
- References
- 29
- FWCI
- 23.29
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.