Cyberbullying Detection Using Deep Learning and Word Embeddings: An Empirical Study
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Cyberbullying detection has become a pressing need in Internet usage governance due to its harmful consequences. Different approaches have been proposed to tackle this problem, including deep learning. In this paper, an empirical study is conducted to evaluate the effectiveness and efficiency of deep learning algorithms, coupled with word embeddings in detecting cyberbullying texts. Three deep learning algorithms were experimented, namely GRU, LSTM and BLSTM. Data pre-processing steps, including oversampling were performed on the selected social media datasets. For feature representations, four different word embeddings models were explored, including word2vec, GloVe, Reddit and ELMO models. Elmo cares of word context by capturing information from the word surroundings which eliminates some of the shortcomings of pre-trained word embeddings models. For more accurate results, 10-fold cross-validation technique was implemented. The experimental results show that BLSTM performs best with ELMO in detecting cyberbullying texts. The efficiency of each model is also measured by calculating the average time taken for training each model. GRU outperforms in terms of time efficiency. Based on the analysis done on false negative cases, three observations were made, which highlight the limitations of word embeddings models on top of GRU algorithm in cyberbullying detection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.1078 · Cited by 3,317
Bullies Move Beyond the Schoolyard: A Preliminary Look at Cyberbullying
Patchin, J. W., & Hinduja, S. (2006) · Youth Violence and Juvenile Justice · doi:10.1177/1541204006286288 · Cited by 1,701 · cited 1×
“Cyber-bullying Research Centre defined Cyberbullying as "willful and repeated harm inflicted through the use of computers, cell phones, and other electronic devices" [1].”
BackgroundDeep Learning for Detecting Cyberbullying Across Multiple Social Media Platforms
Agrawal, S., & Awekar, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-76941-7_11 · Cited by 387 · cited 1×
“Another similar work was done by Agrawal et al. [11] and reproduced by Dadvar et al. [12].”
MethodAutomatic cyberbullying detection: A systematic review
Rosa, H., Pereira, N., Ribeiro, R., Ferreira, P. C., Carvalho, J. P., Oliveira, S., Coheur, L., Paulino, P., Veiga Simão, A. M., & Trancoso, I. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.021 · Cited by 307 · cited 2×
“In [10], Rosa et al. used two datasets for their experiments, which are bullying traces and Formspring datasets.”
BackgroundMethodCyberbullying Detection in Social Networks Using Deep Learning Based Models; A Reproducibility Study
Dadvar, M., & Eckert, K. (2018) · arXiv · doi:10.48550/arxiv.1812.08046 · Cited by 71
Research works printed but not linked: 17
- Justin W. Patchin , Torrie Pennington , Torrie Pennington , Julie Otto , Julie Otto , Sameer Hinduja , and Sameer Hinduja . 2016 cyberbullying data , Jul 2019 . Justin W. Patchin, Torrie Pennington, Torrie Pennington, Julie Otto, Julie Otto, Sameer Hinduja, and Sameer Hinduja. 2016 cyberbullying data, Jul 2019.
- June F Chisholm . Review of the status of cyberbullying and cyberbullying prevention . Journal of Information Systems Education , 25 ( 1 ): 77 , 2014 . June F Chisholm. Review of the status of cyberbullying and cyberbullying prevention. Journal of Information Systems Education, 25(1):77, 2014.
- 10.3115/v1/D14-1162 · DOI · Paper page
- 10.1007/978-3-319-75417-8_17 · DOI
- 10.1109/ICACCI.2015.7275970 · DOI · Paper page
- 10.1109/ICMLA.2011.152 · DOI · Paper page
- 10.5120/ijca2016910408 · DOI
- Haibo He , Yang Bai , Edwardo A Garcia , and Shutao Li. Adasyn : Adaptive synthetic sampling approach for imbalanced learning . In 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) , pages 1322 -- 1328 . IEEE, 2008 . Haibo He, Yang Bai, Edwardo A Garcia, and Shutao Li. Adasyn: Adaptive synthetic sampling approach for imbalanced learning. In 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), pages 1322--1328. IEEE, 2008. · DOI · Paper page
- Amit Mandelbaum and Adi Shalev . Word embeddings and their use in sentence classification tasks. arXiv preprint arXiv:1610.08229 , 2016 . Amit Mandelbaum and Adi Shalev. Word embeddings and their use in sentence classification tasks. arXiv preprint arXiv:1610.08229, 2016. · arXiv
- Tomas Mikolov , Ilya Sutskever , Kai Chen , Greg S Corrado , and Jeff Dean . Distributed representations of words and phrases and their compositionality . In Advances in neural information processing systems , pages 3111 -- 3119 , 2013 . Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems, pages 3111--3119, 2013.
- Yoon Kim . Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882 , 2014 . Yoon Kim. Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882, 2014. · arXiv
- Tomas Mikolov , Kai Chen , Greg Corrado , and Jeffrey Dean . Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 , 2013 . Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781, 2013. · arXiv
- Pengfei Liu , Xipeng Qiu , and Xuanjing Huang . Recurrent neural network for text classification with multi-task learning. arXiv preprint arXiv:1605.05101 , 2016 . Pengfei Liu, Xipeng Qiu, and Xuanjing Huang. Recurrent neural network for text classification with multi-task learning. arXiv preprint arXiv:1605.05101, 2016. · arXiv
- Peng Zhou , Zhenyu Qi , Suncong Zheng , Jiaming Xu , Hongyun Bao , and Bo Xu . Text classification improved by integrating bidirectional lstm with two-dimensional max pooling. arXiv preprint arXiv:1611.06639 , 2016 . Peng Zhou, Zhenyu Qi, Suncong Zheng, Jiaming Xu, Hongyun Bao, and Bo Xu. Text classification improved by integrating bidirectional lstm with two-dimensional max pooling. arXiv preprint arXiv:1611.06639, 2016. · arXiv
- Nitish Srivastava , Geoffrey Hinton , Alex Krizhevsky , Ilya Sutskever , and Ruslan Salakhutdinov . Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research, 15(1):1929--1958 , 2014 . Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research, 15(1):1929--1958, 2014.
- Yarin Gal and Zoubin Ghahramani . A theoretically grounded application of dropout in recurrent neural networks . In Advances in neural information processing systems , pages 1019 -- 1027 , 2016 . Yarin Gal and Zoubin Ghahramani. A theoretically grounded application of dropout in recurrent neural networks. In Advances in neural information processing systems, pages 1019--1027, 2016.
- Stanislau Semeniuta , Aliaksei Severyn , and Erhardt Barth . Recurrent dropout without memory loss. arXiv preprint arXiv:1603.05118 , 2016 . Stanislau Semeniuta, Aliaksei Severyn, and Erhardt Barth. Recurrent dropout without memory loss. arXiv preprint arXiv:1603.05118, 2016. · arXiv
Cited by
Cyberbullying detection solutions based on deep learning architectures
Iwendi, C., Srivastava, G., Khan, S., & Maddikunta, P. K. R. (2023) · Multimedia Systems · doi:10.1007/s00530-020-00701-5 · Cited by 205
A Review on Deep-Learning-Based Cyberbullying Detection
Hasan, M. T., Hossain, M. A. E., Mukta, M. S. H., Akter, A., Ahmed, M., & Islam, S. (2023) · Future Internet · doi:10.3390/fi15050179 · Cited by 103
Kumar, A., & Sachdeva, N. (2022) · Multimedia Systems · doi:10.1007/s00530-020-00747-5 · Cited by 97
“Works have been done where pictures are utilized for the discovery of cyberbullying utilizing deep learning models like CNN, RNN or where semantic image features are utilized for identifying bullying [32-35].”
BackgroundCyberbullying Identification System Based Deep Learning Algorithms
Aldhyani, T. H. H., Al-Adhaileh, M. H., & Alsubari, S. N. (2022) · Electronics · doi:10.3390/electronics11203273 · Cited by 55
Cyberbullying Detection Based on Emotion
Al-Hashedi, M., Soon, L.-K., Goh, H.-N., Lim, A. H. L., & Siew, E.-G. (2023) · IEEE Access · doi:10.1109/access.2023.3280556 · Cited by 45
“However, datasets that cover all forms of cyberbullying are rare [13], [17].”
BackgroundInfluentialSelf-citation
Metadata
- Authors
- Al-Hashedi, M., Soon, L.-K., & Goh, H.-N.
- Venue
- Proceedings of the 2019 2nd International Conference on Computational Intelligence and Intelligent Systems
- Publisher
- ACM
- Published
- 2019-11-23
- Pages
- 17-21
- OpenAlex
- W3005484809
- Cited by
- 34
- References
- 7
- FWCI
- 1.30
- Type
- conference paper
- Language
- en
- Open access
- closed
- Funders
- Fundamental Research GrantScheme (FRGS/1/2017/ICT02/MMU/02/)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Cyberbullying Detection Using Deep Learning and Word Embeddings: An Empirical Study. https://app.cochat.ai/papers/10.1145/3372422.3373592
- The paper
- Al-Hashedi, M., Soon, L.-K., & Goh, H.-N. (2019). Cyberbullying Detection Using Deep Learning and Word Embeddings: An Empirical Study. Proceedings of the 2019 2nd International Conference on Computational Intelligence and Intelligent Systems. https://doi.org/10.1145/3372422.3373592
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.