The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Arabic text classification using deep learning models
Abstract
Abstract Text classification or categorization is the process of automatically tagging a textual document with most relevant labels or categories. When the number of labels is restricted to one, the task becomes single-label text categorization. However, the multi-label version is challenging. For Arabic language, both tasks (especially the latter one) become more challenging in the absence of large and free Arabic rich and rational datasets. Therefore, we introduce new rich and unbiased datasets for both the single-label (SANAD) as well as the multi-label (NADiA) Arabic text categorization tasks. Both corpora are made freely available to the research community on Arabic computational linguistics. Further, we present an extensive comparison of several deep learning (DL) models for Arabic text categorization in order to evaluate the effectiveness of such models on SANAD and NADiA. A unique characteristic of our proposed work, when compared to existing ones, is that it does not require a pre-processing phase and fully based on deep learning models. Besides, we studied the impact of utilizing word2vec embedding models to improve the performance of the classification tasks. Our experimental results showed solid performance of all models on SANAD corpus with a minimum accuracy of 91.18%, achieved by convolutional-GRU, and top performance of 96.94%, achieved by attention-GRU. As for NADiA, attention-GRU achieved the highest overall accuracy of 88.68% for a maximum subsets of 10 categories on “Masrawy” dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
Machine learning in automated text categorization
Sebastiani, F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505283 · Cited by 7,926
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., & Hovy, E. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1174 · Cited by 4,712
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2840738 · Cited by 2,921
Multi-Label Classification: An Overview
Tsoumakas, G., & Katakis, I. (2007) · International Journal of Data Warehousing and Mining · doi:10.4018/jdwm.2007070101 · Cited by 2,508
Recurrent Convolutional Neural Networks for Text Classification
Lai, S., Xu, L., Liu, K., & Zhao, J. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9513 · Cited by 2,280
Document Modeling with Gated Recurrent Neural Network for Sentiment Classification
Tang, D., Qin, B., & Liu, T. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1167 · Cited by 1,519
Baroni, M., Dinu, G., & Kruszewski, G. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1023 · Cited by 1,364
Gradient Flow in Recurrent Nets: The Difficulty of Learning LongTerm Dependencies
(2009) · A Field Guide to Dynamical Recurrent Networks · doi:10.1109/9780470544037.ch14 · Cited by 1,246
Recent Trends in Deep Learning Based Natural Language Processing
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.02709 · Cited by 1,192
Recurrent Neural Network for Text Classification with Multi-Task Learning
Liu, P., Qiu, X., & Huang, X. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.05101 · Cited by 972
Learning to Classify Text Using Support Vector Machines: Methods, Theory and Algorithms
Joachims, T. (2002) · Cited by 932
Ambati, B. R., Deoskar, T., Johnson, M., & Steedman, M. J. (2015) · The Association for Computational Linguistics · Cited by 860
Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence
Chen, Y., Diethe, T., & Flach, P. A. (2016) · National Conference on Artificial Intelligence · Cited by 680
The impact of preprocessing on text classification
Uysal, A. K., & Gunal, S. (2014) · Information Processing & Management · doi:10.1016/j.ipm.2013.08.006 · Cited by 657
Aggarwal, C. C. (2015) · Data Mining · doi:10.1007/978-3-319-14142-8_13 · Cited by 606
(2016) · doi:10.18653/v1/2026.acl-long · Cited by 524
Proceedings of The 12th International Workshop on Semantic Evaluation
(2018) · doi:10.18653/v1/2026.semeval-1 · Cited by 452
EmoNet: Fine-Grained Emotion Detection with Gated Recurrent Neural Networks
Abdul-Mageed, M., & Ungar, L. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1067 · Cited by 378
Al-Smadi, M., Qawasmeh, O., Al-Ayyoub, M., Jararweh, Y., & Gupta, B. (2018) · Journal of Computational Science · doi:10.1016/j.jocs.2017.11.006 · Cited by 339
A Field Guide to Dynamical Recurrent Networks
Kolen, J. F., & Kremer, S. C. (2009) · Institute of Electrical and Electronics Engineers eBooks · doi:10.1109/9780470544037 · Cited by 335
Onan, A. (2018) · Journal of Information Science · doi:10.1177/0165551516677911 · Cited by 283
Feed-Forward Networks with Attention Can Solve Some Long-Term Memory Problems
Raffel, C., & Ellis, D. P. W. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.08756 · Cited by 258
Al-Smadi, M., Talafha, B., Al-Ayyoub, M., & Jararweh, Y. (2019) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-018-0799-4 · Cited by 251
Text Classification and Classifiers:A Survey
Korde, V. (2012) · International Journal of Artificial Intelligence & Applications · doi:10.5121/ijaia.2012.3208 · Cited by 249
Chi Square Feature Extraction Based Svms Arabic Language Text Categorization System
MESLEH, A. M. A. (2007) · Journal of Computer Science · doi:10.3844/jcssp.2007.430.435 · Cited by 242
Deep learning for sentiment analysis: successful approaches and future challenges
Tang, D., Qin, B., & Liu, T. (2015) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1171 · Cited by 207
A comprehensive survey of arabic sentiment analysis
Al-Ayyoub, M., Khamaiseh, A. A., Jararweh, Y., & Al-Kabi, M. N. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2018.07.006 · Cited by 200
Automatic Arabic document categorization based on the Naïve Bayes algorithm
Kourdi, M. E., Bensaid, A. M., & Rachidi, T. (2004) · doi:10.3115/1621804.1621819 · Cited by 199
Deep learning for Arabic NLP: A survey
Al-Ayyoub, M., Nuseir, A., Alsmearat, K., Jararweh, Y., & Gupta, B. (2018) · Journal of Computational Science · doi:10.1016/j.jocs.2017.11.011 · Cited by 167
Hotel Arabic-Reviews Dataset Construction for Sentiment Analysis Applications
Elnagar, A., Khalifa, Y. S., & Einea, A. (2018) · Studies in Computational Intelligence · doi:10.1007/978-3-319-67056-0_3 · Cited by 162
Self-citationFuzzy deep belief networks for semi-supervised sentiment classification
Zhou, S., Chen, Q., & Wang, X. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.10.011 · Cited by 161
A Deep Learning-Based Approach for Multi-Label Emotion Classification in Tweets
Jabreel, M., & Moreno, A. (2019) · Applied Sciences · doi:10.3390/app9061123 · Cited by 159
Baziotis, C., Nikolaos, A., Chronopoulou, A., Kolovou, A., Paraskevopoulos, G., Ellinas, N., Narayanan, S., & Potamianos, A. (2018) · Proceedings of The 12th International Workshop on Semantic Evaluation · doi:10.18653/v1/s18-1037 · Cited by 142
Deep Learning Models for Sentiment Analysis in Arabic
Sallab, A. A. A., Hajj, H. M., Badaro, G., Baly, R., Hajj, W. E., & Shaban, K. B. (2015) · Arabic Natural Language Processing Workshop (WANLP) · doi:10.18653/v1/w15-3202 · Cited by 139
A deep network model for paraphrase detection in short text messages
Agarwal, B., Ramampiaro, H., Helge Langseth, A., & Ruocco, M. (2018) · Information Processing & Management · doi:10.1016/j.ipm.2018.06.005 · Cited by 129
Automatic Arabic Dialect Classification Using Deep Learning Models
Lulu, L., & Elnagar, A. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.10.489 · Cited by 125
Self-citationImproving arabic text categorization using decision trees
Harrag, F., El‐Qawasmeh, E., & Pichappan, P. (2009) · doi:10.1109/ndt.2009.5272214 · Cited by 105
SANAD: Single-label Arabic News Articles Dataset for automatic text categorization
Einea, O., Elnagar, A., & Debsi, R. A. (2019) · Data in Brief · doi:10.1016/j.dib.2019.104076 · Cited by 104
Self-citationAL-Smadi, M., Jaradat, Z., Al‐Ayyoub, M., & Jararweh, Y. (2017) · Information Processing & Management · doi:10.1016/j.ipm.2017.01.002 · Cited by 100
Multilingual Hierarchical Attention Networks for Document ClassificationPreprint
Pappas, N., & Popescu-Belis, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.00896 · Cited by 96
Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2018
(2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-99010-1 · Cited by 96
AROMA: A Recursive Deep Learning Model for Opinion Mining in Arabic as a Low Resource Language
Sallab, A. A. A., Baly, R., Hajj, H. M., Shaban, K. B., El-Hajj, W., & Badaro, G. (2017) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3086575 · Cited by 90
Al-Salemi, B., Ayob, M. B., Kendall, G., & Noah, S. A. M. (2018) · Information Processing & Management · doi:10.1016/j.ipm.2018.09.008 · Cited by 79
Hybrid Deep Learning for Sentiment Polarity Determination of Arabic Microblogs
Al-Azani, S., & El-Alfy, E.-S. M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70096-0_51 · Cited by 78
Feature sub-set selection metrics for Arabic text classification
Mesleh, A. (2011) · Pattern Recognition Letters · doi:10.1016/j.patrec.2011.07.010 · Cited by 70
Web spam classification method based on deep belief networks
Li, Y., Nie, X., & Huang, R. H. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.12.016 · Cited by 63
Applying multi-label techniques in emotion identification of short texts
de Almeida, A. M. G., Cerri, R., Paraíso, E. C., Mantovani, R. G., & Barbon, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.08.053 · Cited by 59
Elnagar, A., Lulu, L., & Einea, O. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.10.474 · Cited by 58
Self-citationTeamUNCC at SemEval-2018 Task 1: Emotion Detection in English and Arabic Tweets using Deep Learning
Abdullah, M., & Shaikh, S. (2018) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s18-1053 · Cited by 57
Stemming as a feature reduction technique for Arabic Text Categorization
Harrag, F., El-Qawasmah, E., & Al‐Salman, A. S. (2011) · International Symposium on Programming and Systems (ISPS) · doi:10.1109/isps.2011.5898874 · Cited by 55
A Context Integrated Model for Multi-label Emotion Detection
Samy, A. E., El-Beltagy, S. R., & Hassanien, E. E. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.10.461 · Cited by 50
RFBoost: An improved multi-label boosting algorithm and its application to text categorisation
Al-Salemi, B., Noah, S. A. M., & Aziz, M. J. A. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.03.029 · Cited by 49
Feature ranking for enhancing boosting-based multi-label text categorization
Al-Salemi, B., Ayob, M. B., & Noah, S. A. M. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.07.024 · Cited by 46
Beyond vector space model for hierarchical Arabic text classification: A Markov chain approach
Al–Anzi, F. S., & AbuZeina, D. (2017) · Information Processing & Management · doi:10.1016/j.ipm.2017.10.003 · Cited by 43
Scalable multi-label Arabic text classification
Ahmed, N. A., Shehab, M. A., Al‐Ayyoub, M., & Hmeidi, I. (2015) · International Conference on Information and Communication Systems (ICICS) · doi:10.1109/iacs.2015.7103229 · Cited by 39
Improving Arabic sentiment analysis with sentiment-specific embeddings
Altowayan, A. A., & Elnagar, A. (2017) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2017.8258460 · Cited by 38
Self-citationA supervised approach for multi-label classification of Arabic news articles
Shehab, M. A., Badarneh, O., Al‐Ayyoub, M., & Jararweh, Y. (2016) · doi:10.1109/csit.2016.7549465 · Cited by 36
Classification of Textual Documents Using Learning Vector Quantization
Umer, M. F., & Khiyal, M. S. H. (2006) · Information Technology Journal · doi:10.3923/itj.2007.154.159 · Cited by 31
Khalil, T., & El-Beltagy, S. R. (2016) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s16-1043 · Cited by 29
Shall deep learning be the mandatory future of document analysis problems?
Vincent, N., & Ogier, J.-M. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.09.010 · Cited by 25
A lexicon based approach for classifying Arabic multi-labeled text
Hmeidi, I., Al‐Ayyoub, M., Mahyoub, N. A., & Shehab, M. A. (2016) · International Journal of Web Information Systems · doi:10.1108/ijwis-01-2016-0002 · Cited by 20
Cited by
A comprehensive review on ensemble deep learning: Opportunities and challenges
Mohammed, A., & Kora, R. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.01.014 · Cited by 1,127
Onan, A., & Tocoglu, M. A. (2021) · IEEE Access · doi:10.1109/access.2021.3049734 · Cited by 347
Impact of word embedding models on text analytics in deep learning environment: a review
Asudani, D. S., Nagwani, N. K., & Singh, P. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10419-1 · Cited by 274
Metadata
- Authors
- Elnagar, A., Al-Debsi, R., & Einea, O.
- Venue
- Information Processing & Management
- Publisher
- Elsevier BV
- Published
- 2020-01
- Volume
- 57
- Issue
- 1
- Pages
- 102121
- ISSN
- 0020-0271 (ISSN-L)
- 0306-4573
- OpenAlex
- W2974335209
- Cited by
- 274
- References
- 70
- FWCI
- 15.08
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.