Instagram-Based Benchmark Dataset for Cyberbullying Detection in Arabic Text
Open accessAbstract
(1) Background: the ability to use social media to communicate without revealing one’s real identity has created an attractive setting for cyberbullying. Several studies targeted social media to collect their datasets with the aim of automatically detecting offensive language. However, the majority of the datasets were in English, not in Arabic. Even the few Arabic datasets that were collected, none focused on Instagram despite being a major social media platform in the Arab world. (2) Methods: we use the official Instagram APIs to collect our dataset. To consider the dataset as a benchmark, we use SPSS (Kappa statistic) to evaluate the inter-annotator agreement (IAA), as well as examine and evaluate the performance of various learning models (LR, SVM, RFC, and MNB). (3) Results: in this research, we present the first Instagram Arabic corpus (sub-class categorization (multi-class)) focusing on cyberbullying. The dataset is primarily designed for the purpose of detecting offensive language in texts. We end up with 200,000 comments, of which 46,898 comments were annotated by three human annotators. The results show that the SVM classifier outperforms the other classifiers, with an F1 score of 69% for bullying comments and 85 percent for positive comments.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The review found that existing studies on cyberbullying text detection used sparse data representation to efficiently store and process datasets, especially those with many missing values.
“The review found that existing studies on cyberbullying text detection used sparse data representation to efficiently store and process datasets, especially those with many missing values [120].”
From Cyberbullying detection: Exploring datasets, technologies, and approaches on social media platforms (2026) · cites this paper as [120]
Datasets may be limited due to factors such as incomplete data percentages, inadequate details for comprehensive analytical evaluations, and the utilization of a small dataset for training learning models.
“The dataset might be viewed as limited due to factors such as incomplete data percentages, inadequate details for comprehensive analytical evaluations, and the utilization of a small dataset for training learning models [120].”
From Cyberbullying detection: Exploring datasets, technologies, and approaches on social media platforms (2026) · cites this paper as [120]
Small datasets impede the direct comparison of progress and the assessment of applicability, as they do not adequately capture the necessary complex social dynamics.
“Small datasets impede the direct comparison of progress and the assessment of applicability, as they do not adequately capture the necessary complex social dynamics [120].”
From Cyberbullying detection: Exploring datasets, technologies, and approaches on social media platforms (2026) · cites this paper as [120]
The utilization of cutting-edge methods is constrained by restricted access to top-tier data, leading to the creation of small, varied datasets that impede straightforward comparisons of advancements.
“The utilization of cutting-edge methods is constrained by restricted access to top-tier data, leading to the creation of small, varied datasets that impede straightforward comparisons of advancements [120].”
From Cyberbullying detection: Exploring datasets, technologies, and approaches on social media platforms (2026) · cites this paper as [120]
Using crowdsourcing techniques to replicate actual bullying instances in a controlled laboratory environment can produce credible data that augment existing datasets and boost classifier accuracy.
“Using crowdsourcing techniques to replicate actual instances of bullying within a controlled laboratory environment can produce credible data, augmenting existing datasets and boosting the accuracy of classifiers [120].”
From Cyberbullying detection: Exploring datasets, technologies, and approaches on social media platforms (2026) · cites this paper as [120]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Bullies Move Beyond the Schoolyard: A Preliminary Look at Cyberbullying
Patchin, J. W., & Hinduja, S. (2006) · Youth Violence and Juvenile Justice · doi:10.1177/1541204006286288 · Cited by 1,701 · see citing works
Echo Chambers: Emotional Contagion and Group Polarization on Facebook
Del Vicario, M., Vivaldo, G., Bessi, A., Zollo, F., Scala, A., Caldarelli, G., & Quattrociocchi, W. (2016) · Scientific Reports · doi:10.1038/srep37825 · Cited by 576 · see citing works
Public Response to Racist Speech: Considering the Victim's Story
Matsuda, M. (1989) · Michigan Law Review · doi:10.2307/1289306 · Cited by 468 · see citing works
Jay, T. B., & Janschewitz, K. (2008) · Journal of Politeness Research · doi:10.1515/jplr.2008.013 · Cited by 427 · see citing works
Abusive Language Detection on Arabic Social Media
Mubarak, H., Darwish, K. M., & Magdy, W. (2017) · doi:10.18653/v1/w17-3008 · Cited by 301 · see citing works
Detecting Hate Speech in Social Media
Malmasi, S., & Zampieri, M. (2017) · doi:10.26615/978-954-452-049-6_062 · Cited by 289 · see citing works
Offensive Language Detection Using Multi-level Classification
Razavi, A. H., Inkpen, D. Z., Uritsky, S., & Matwin, S. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13059-5_5 · Cited by 272 · see citing works
Analyzing Labeled Cyberbullying Incidents on the Instagram Social Network
Hosseinmardi, H., Mattson, S. A., Rafiq, R. I., Han, R. Y., Lv, Q., & Mishra, S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-27433-1_4 · Cited by 257 · see citing works
L-HSAB: A Levantine Twitter Dataset for Hate Speech and Abusive Language
Mulki, H., Haddad, H., Ali, C. B., & Alshabani, H. (2019) · Workshop on Abusive Language Online (ALW) · doi:10.18653/v1/w19-3512 · Cited by 194 · see citing works
Social Media Cyberbullying Detection using Machine Learning
Hani, J., Nashaat, M., Ahmed, M., Emad, Z., Amer, E., & Mohammed, A. (2019) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2019.0100587 · Cited by 160 · see citing works
Content-driven detection of cyberbullying on the instagram social network
Zhong, H., Li, H., Squicciarini, A., Rajtmajer, S. M., Griffin, C. H., Miller, D. J., & Caragea, C. (2016) · International Joint Conference on Artificial Intelligence · Cited by 133 · see citing works
Unsupervised cyber bullying detection in social networks
Capua, M. D., Nardo, E. D., & Petrosino, A. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899672 · Cited by 117 · see citing works
Dataset Construction for the Detection of Anti-Social Behaviour in Online Communication in Arabic
Alakrot, A., Murray, L., & Nikolov, N. S. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.10.473 · Cited by 95 · see citing works
Marzouki, Y., Aldossari, F. S., & Veltri, G. (2021) · Humanities and Social Sciences Communications · doi:10.1057/s41599-021-00724-x · Cited by 94 · see citing works
Optimized Twitter Cyberbullying Detection based on Deep Learning
Al-Ajlan, M., & Ykhlef, M. (2018) · Saudi Computer Society National Computer Conference (NCC) · doi:10.1109/ncg.2018.8593146 · Cited by 93 · see citing works
Detection of cyberbullying on social media messages in Turkish
Özel, S. A., Eşsiz, E. S., Akdemir, S., & Aksu, H. (2017) · doi:10.1109/ubmk.2017.8093411 · Cited by 87 · see citing works
Supervised Machine Learning Bot Detection Techniques to Identify Social Twitter Bots
Efthimion, P. G., Payne, S., & Proferes, N. (2018) · SMU Scholar (Southern Methodist University) · Cited by 81 · see citing works
Rethinking Sentiment Analysis in the News: from Theory to Practice and back
Balahur, A., & Steinberger, R. (2009) · Cited by 68 · see citing works
Socioeconomic Effects in Cyberbullying: Global Research Trends in the Educational Context
Menéses, E. L., Cano, E. V., González-Zamar, M.-D., & Abad‐Segura, E. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17124369 · Cited by 65 · see citing works
Arabic text classification: the need for multi-labeling systems
Rifai, H. E., Qadi, L. A., & Elnagar, A. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06390-z · Cited by 63 · see citing works
Sentiment Analysis in English Texts
Shamsi, A. A. A., Bayari, R., & Salloum, S. A. (2020) · Advances in Science Technology and Engineering Systems Journal · doi:10.25046/aj0506200 · Cited by 61 · see citing works
Arabic Cyberbullying Detection: Using Deep Learning
Haidar, B., Chamoun, M., & Serhrouchni, A. (2018) · 2018 7th International Conference on Computer and Communication Engineering (ICCCE) · doi:10.1109/iccce.2018.8539303 · Cited by 58 · see citing works
Classification of instagram fake users using supervised machine learning algorithms
Purba, K. R., Asirvatham, D. A. L., & Murugesan, R. K. (2020) · International Journal of Electrical and Computer Engineering (IJECE) · doi:10.11591/ijece.v10i3.pp2763-2772 · Cited by 56 · see citing works
Cognitive Network Science for Understanding Online Social Cognitions: A Brief Review
Stella, M. (2021) · Topics in Cognitive Science · doi:10.1111/tops.12551 · Cited by 53 · see citing works
ASAD: A Twitter-based Benchmark Arabic Sentiment Analysis DatasetPreprint
Alharbi, B., Alamro, H., Alshehri, M. A., Khayyat, Z., Kalkatawi, M., Jaber, I. I., & Zhang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.00578 · Cited by 44 · see citing works
A supervised approach for multi-label classification of Arabic news articles
Shehab, M. A., Badarneh, O., Al‐Ayyoub, M., & Jararweh, Y. (2016) · doi:10.1109/csit.2016.7549465 · Cited by 35 · see citing works
Arabic Cyberbullying Detection: Enhancing Performance by Using Ensemble Machine Learning
Haidar, B. R., Chamoun, M., & Serhrouchni, A. (2019) · doi:10.1109/ithings/greencom/cpscom/smartdata.2019.00074 · Cited by 35 · see citing works
Text Mining Techniques for Cyberbullying Detection: State of the Art
Bayari, R., & Benséfia, A. (2021) · Advances in Science Technology and Engineering Systems Journal · doi:10.25046/aj060187 · Cited by 31 · see citing works
Batanović, V., Cvetanović, M., & Nikolić, B. (2020) · PLoS ONE · doi:10.1371/journal.pone.0242050 · Cited by 23 · see citing works
Assessing agreement with multiple raters on correlated kappa statistics
Cao, H., Sen, P. K., Peery, A. F., et al. (2016) · Biometrical Journal · doi:10.1002/bimj.201500029 · Cited by 22 · see citing works
Sentiment Analysis of Emirati Dialect
Shamsi, A. A. A., & Abdallah, S. (2022) · Big Data and Cognitive Computing · doi:10.3390/bdcc6020057 · Cited by 22 · see citing works
Self-citationText Mining Techniques for Sentiment Analysis of Arabic Dialects: Literature Review
Shamsi, A. A. A., & Abdallah, S. (2021) · Advances in Science Technology and Engineering Systems Journal · doi:10.25046/aj0601112 · Cited by 21 · see citing works
Self-citationCyberbullying Classification Methods for Arabic: A Systematic Review
Bayari, R., Abdullah, S., & Salloum, S. A. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-76346-6_35 · Cited by 16 · see citing works
WOLI at SemEval-2020 Task 12: Arabic Offensive Language Identification on Different Twitter Datasets
Otiefy, Y., Abdelmalek, A., & Hosary, I. E. (2020) · doi:10.18653/v1/2020.semeval-1.298 · Cited by 13 · see citing works
A Systematic Review for Sentiment Analysis of Arabic Dialect Texts Researches
Shamsi, A. A. A., & Abdallah, S. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-85990-9_25 · Cited by 10 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 3
- Sanchez, H. Twitter Bullying Detection. Homo 2011, 12, 15.
- Hosam, O. Toxic comments identification in arabic social media. Int. J. Comput. Inf. Syst. Ind. Manag. Appl. 2019, 11, 219-226.
- Al-Harbi, S.; Almuhareb, A.; Al-Thubaity, A.; Khorsheed, M.S.; Al-Rajeh, A. Automatic Arabic Text Classification. In Proceedings of The 9th International Conference on the Statistical Analysis of Textual Data. Available online: https://www.researchgate.net/ publication/313363859_Automatic_Arabic_Text_Classification (accessed on 20 May 2022).
Cited by
Sorted by citations
Cyberbullying detection: Exploring datasets, technologies, and approaches on social media platforms
Philipo, A. G., Sarwatt, D. S., Ding, J., Daneshmand, M., & Ning, H. (2026) · ACM Computing Surveys · doi:10.1145/3785654 · Cited by 14 · see citing works
Gamal, D., Alfonse, M., Jiménez-Zafra, S. M., & Aref, M. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7020058 · Cited by 9 · see citing works
- Authors
- ALBayari, R., & Abdallah, S.
- Affiliations
- Higher College of Technology, Abu Dhabi P.O. Box 25026, United Arab Emirates
- British University in Dubai (AE)
- Venue
- Data
- Publisher
- MDPI AG
- Published
- 2022-06-22
- Volume
- 7
- Issue
- 7
- Pages
- 83
- ISSN
- 2306-5729 (ISSN-L)
- OpenAlex
- W4283321753
- Cited by
- 30
- References
- 35
- Citations by year
- 2026: 2 · 2025: 8 · 2024: 10 · 2023: 9 · 2022: 1
- FWCI
- 2.30
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Data (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- British University in Dubai
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Computer Science › Artificial Intelligence › Text and Document Classification Technologies
- Keywords
- cyberbullying detection, Arabic text, Instagram, offensive language detection, social media comments, annotated corpus, benchmark dataset, inter-annotator agreement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review