A Multitask Multimodal Framework for Sentiment and Emotion-Aided Cyberbullying Detection
Abstract
Cyberbullying has become more widespread, especially among teens with the growth of the digital sphere and advancement of technology. This article is the first attempt in investigating the role of sentiment and emotion information for identifying cyberbullying in the Indian scenario. From Twitter, a benchmark Hind–English code-mixed corpus called BullySentEmo has been developed as there was no dataset available labeled with bully, sentiment, and emotion. The developed dataset consists of both the modalities, tweet- text and emoji. In India, the majority of communication on different social media platforms is based on Hindi and English, and language switching is a common practice in digital communication. A multitask multimodal framework called MT-MM-Bert+VecMap based on BERT and VecMap embedding schemes with emoji modality, has been developed. Our proposed multitask-multimodal framework outperforms all the single task and unimodal baselines with the highest accuracy values of 82.05(+/- 1.36)%, 77.87(+/- 1.93)%, and 58.05(+/-2.78)% for the cyberbully detection task, sentiment analysis task, and emotion recognition task, respectively.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The gated Recurrent Units with Attention (GRU-Att) model has demonstrated exciting results in detecting bullying behavior in social media text.
“The gated Recurrent Units with Attention (GRU-Att) model has also demonstrated exciting results in detecting bullying behavior in a social media text.”
From A Review on Deep-Learning-Based Cyberbullying Detection (2023) · cites this paper as [124]
GRU-Att can more accurately interpret and categorize the behavior of cyberbullying on social media platforms.
“This makes it possible for the model to more accurately interpret and categorize the behavior of cyberbullying on social media platforms [71,123,124].”
From A Review on Deep-Learning-Based Cyberbullying Detection (2023) · cites this paper as [124]
GRU-Att can capture long-term dependencies in sequential data faster than the LSTM model while capturing the important part of the input text.
“The model can capture long-term dependencies in sequential data faster than the LSTM model while capturing the important part of the input text by combining Gated Recurrent Units (GRUs) with attention mechanisms.”
From A Review on Deep-Learning-Based Cyberbullying Detection (2023) · cites this paper as [124]
Cites
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · see citing works
Distributed Representations of Sentences and DocumentsPreprint
Le, Q. V., & Mikolov, T. (2014) · International Conference on Machine Learning · doi:10.48550/arxiv.1405.4053 · Cited by 10,307 · see citing works
On the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K., van Merriënboer, B., Bahdanau, D., & Bengio, Y. (2014) · SSST@EMNLP · doi:10.3115/v1/w14-4012 · Cited by 7,251 · see citing works
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · see citing works
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A. J., & Hovy, E. H. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1174 · Cited by 4,874 · see citing works
Cyberbullying: Its nature and impact in secondary school pupils
Smith, P. K., Mahdavi, J., Carvalho, M., Fisher, S., Russell, S., & Tippett, N. (2008) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01846.x · Cited by 3,639 · see citing works
Unsupervised Learning by Probabilistic Latent Semantic Analysis
Hofmann, T. (2001) · Machine Learning · doi:10.1023/a:1007617005950 · Cited by 2,455 · see citing works
Pang, B., & Lee, L. (2005) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1219840.1219855 · Cited by 2,153 · see citing works
Ekman, P. (1999) · Handbook of Cognition and Emotion · doi:10.1002/0470013494.ch3 · Cited by 2,125 · see citing works
Comparative Study of CNN and RNN for Natural Language ProcessingPreprint
Yin, W., Kann, K., Yu, M., & Schütze, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.01923 · Cited by 903 · see citing works
Felbo, B., Mislove, A., Søgaard, A., Rahwan, I., & Lehmann, S. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1169 · Cited by 815 · see citing works
Felbo, B., Mislove, A. E., Søgaard, A., Rahwan, I., & Lehmann, S. (2017) · Research at the University of Copenhagen (University of Copenhagen) · Cited by 712 · see citing works
Modeling the Detection of Textual Cyberbullying
Dinakar, K., Reichart, R., & Lieberman, H. A. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i3.14209 · Cited by 517 · see citing works
Using Machine Learning to Detect Cyberbullying
Reynolds, K., Kontostathis, A., & Edwards, L. (2011) · doi:10.1109/icmla.2011.152 · Cited by 462 · see citing works
Learning bilingual word embeddings with (almost) no bilingual data
Artetxe, M., Labaka, G., & Agirre, E. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1042 · Cited by 457 · see citing works
Duelling Languages: Grammatical Structure in Codeswitching
Poulisse, N. (1998) · International Journal of Bilingualism · doi:10.1177/136700699800200308 · Cited by 371 · see citing works
Automatic cyberbullying detection: A systematic review
Rosa, H., Pereira, N., Ribeiro, R., Ferreira, P. C., Carvalho, J. P., Oliveira, S., Coheur, L., Paulino, P., Veiga Simão, A. M., & Trancoso, I. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.021 · Cited by 307 · see citing works
emoji2vec: Learning Emoji Representations from their Description
Eisner, B., Rocktäschel, T., Augenstein, I., Bošnjak, M., & Riedel, S. (2016) · International Workshop on Natural Language Processing for Social Media (SocialNLP) · doi:10.18653/v1/w16-6208 · Cited by 291 · see citing works
A Dataset of Hindi-English Code-Mixed Social Media Text for Hate Speech Detection
Bohra, A., Vijay, D., Singh, V. K., Akhtar, S. S., & Shrivastava, M. (2018) · doi:10.18653/v1/w18-1105 · Cited by 272 · see citing works
Chauhan, D. S., R, D. S., Ekbal, A., & Bhattacharyya, P. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.401 · Cited by 154 · see citing works
A multitask framework to detect depression, sentiment and multi-label emotion from suicide notes
Ghosh, S., Ekbal, A., & Bhattacharyya, P. (2022) · Cognitive Computation · doi:10.1007/s12559-021-09828-7 · Cited by 102 · see citing works
Hierarchical Attention Networks for Cyberbullying Detection on the Instagram Social Network
Cheng, L., Guo, R., Silva, Y., Hall, D., & Liu, H. (2019) · Proceedings of the 2019 SIAM International Conference on Data Mining · doi:10.1137/1.9781611975673.27 · Cited by 95 · see citing works
Sentiment Analysis for Effective Detection of Cyber Bullying
Nahar, V., Unankard, S., Li, X., & Pang, C. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-29253-8_75 · Cited by 85 · see citing works
Multilingual Cyberbullying Detection System
Pawar, R., & Raje, R. R. (2019) · IEEE International Conference on Electro Information Technology · doi:10.1109/eit.2019.8833846 · Cited by 74 · see citing works
Multilingual cyberbullying detection system: Detecting cyberbullying in Arabic content
Haidar, B. R., Chamoun, M., & Serhrouchni, A. (2017) · Cyber Security in Networking Conference (CSNet) · doi:10.1109/csnet.2017.8242005 · Cited by 69 · see citing works
A Multitask Multimodal Ensemble Model for Sentiment- and Emotion-Aided Tweet Act Classification
Saha, T., Upadhyaya, A., Saha, S., & Bhattacharyya, P. (2021) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2021.3088714 · Cited by 40 · see citing works
Self-citationTowards Sentiment and Emotion aided Multi-modal Speech Act Classification in Twitter
Saha, T., Upadhyaya, A., Saha, S., & Bhattacharyya, P. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.456 · Cited by 31 · see citing works
Self-citationBERT-Capsule Model for Cyberbullying Detection in Code-Mixed Indian Languages
Maity, K., & Saha, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-80599-9_13 · Cited by 21 · see citing works
Self-citationKhapra, M. M., Ramanathan, A., Kunchukuttan, A., et al. (2014) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3fpmanh4rrq9 · Cited by 18 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805
Flagged first, then by citations
Cited by
Sorted by citations
A Review on Deep-Learning-Based Cyberbullying Detection
Hasan, M. T., Hossain, M. A. E., Mukta, M. S. H., Akter, A., Ahmed, M., & Islam, S. (2023) · Future Internet · doi:10.3390/fi15050179 · Cited by 103 · see citing works
“This makes it possible for the model to more accurately interpret and categorize the behavior of cyberbullying on social media platforms [71,123,124].”
BackgroundCyberbullying Detection Based on Emotion
Al-Hashedi, M., Soon, L.-K., Goh, H.-N., Lim, A. H. L., & Siew, E.-G. (2023) · IEEE Access · doi:10.1109/access.2023.3280556 · Cited by 45 · see citing works
A Novel Multimodal Hybrid Classifier Based Cyberbullying Detection for Social Media Platform
Suhas Bharadwaj, R., Kuzhalvaimozhi, S., & Vedavathi, N. (2023) · Lecture Notes in Networks and Systems · doi:10.1007/978-3-031-21438-7_57 · Cited by 8 · see citing works
- Authors
- Maity, K., Kumar, A., & Saha, S.
- Affiliations
- Indian Institute of Technology Patna (IN)
- Venue
- IEEE Internet Computing
- Published
- 2022-07-01
- Volume
- 26
- Issue
- 4
- Pages
- 68-78
- ISSN
- 1089-7801 (ISSN-L)
- 1941-0131
- OpenAlex
- W4226429277
- Cited by
- 30
- References
- 32
- Citations by year
- 2026: 3 · 2025: 11 · 2024: 3 · 2023: 10 · 2022: 3
- FWCI
- 2.22
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Internet Computing (publishedVersion)
- Funders
- Electronics and IT, Ministry of Electronics and Information Technology
- Department of Home Affairs
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Keywords
- cyberbullying detection, sentiment analysis, emotion recognition, multimodal learning, multi-task learning, Hindi-English code-mixing, Twitter, BERT
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review