The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
RoBERTa-LSTM: A Hybrid Model for Sentiment Analysis With Transformer and Recurrent Neural Network
Open accessAbstract
Due to the rapid development of technology, social media has become more and more common in human daily life. Social media is a platform for people to express their feelings, feedback, and opinions. To understand the sentiment context of the text, sentiment analysis plays the role to determine whether the sentiment of the text is positive, negative, neutral or any other personal feeling. Sentiment analysis is prominent from the perspective of business or politics where it highly impacts the strategic decision making. The challenges of sentiment analysis are attributable to the lexical diversity, imbalanced dataset and long-distance dependencies of the texts. In view of this, a data augmentation technique with GloVe word embedding is leveraged to synthesize more lexically diverse samples by similar word vector replacements. The data augmentation also focuses on the oversampling of the minority classes to mitigate the imbalanced dataset problems. Apart from that, the existing sentiment analysis mostly leverages sequence models to encode the long-distance dependencies. Nevertheless, the sequence models require a longer execution time as the processing is done sequentially. On the other hand, the Transformer models require less computation time with parallelized processing. To that end, this paper proposes a hybrid deep learning method that combines the strengths of sequence model and Transformer model while suppressing the limitations of sequence model. Specifically, the proposed model integrates Robustly optimized BERT approach and Long Short-Term Memory for sentiment analysis. The Robustly optimized BERT approach maps the words into a compact meaningful word embedding space while the Long Short-Term Memory model captures the long-distance contextual semantics effectively. The experimental results demonstrate that the proposed hybrid model outshines the state-of-the-art methods by achieving F1-scores of 93%, 91%, and 90% on IMDb dataset, Twitter US Airline Sentiment dataset, and Sentiment140 dataset, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Zhu, Y., Kiros, R., Zemel, R., Salakhutdinov, R., Urtasun, R., Torralba, A., & Fidler, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.11 · Cited by 2,264
Wang, W. Y., & Yang, D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1306 · Cited by 312
A CNN-BiLSTM Model for Document-Level Sentiment Analysis
Rhanoui, M., Mikram, M., Yousfi, S., & Barzali, S. (2019) · Machine Learning and Knowledge Extraction · doi:10.3390/make1030048 · Cited by 300
Sentiment Analysis Using Naive Bayes Algorithm Of The Data Crawler: Twitter
Wongkar, M., & Angdresey, A. (2019) · 2019 Fourth International Conference on Informatics and Computing (ICIC) · doi:10.1109/icic47613.2019.8985884 · Cited by 228
Jain, P. K., Saravanan, V., & Pamula, R. (2021) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3457206 · Cited by 190
A ConvBiLSTM Deep Learning Model-Based Approach for Twitter Sentiment Classification
Sakirin, T., Said, R. B., & Tanrıöver, Ö. Ö. (2021) · IEEE Access · doi:10.1109/access.2021.3064830 · Cited by 163
Comparison of Naive Bayes and SVM Algorithm based on Sentiment Analysis Using Review Dataset
Rahat, A. M., Kahir, A., & Masum, A. K. M. (2019) · 2019 8th International Conference System Modeling and Advancement in Research Trends (SMART) · doi:10.1109/smart46866.2019.9117512 · Cited by 158
Data Augmentation for Visual Question Answering
Kafle, K., Yousefhussien, M., & Kanan, C. (2017) · International Conference on Natural Language Generation · doi:10.18653/v1/w17-3529 · Cited by 117
Dhola, K., & Saradva, M. (2021) · International Conference on Cloud Computing, Data Science & Engineering (Confluence) · doi:10.1109/confluence51648.2021.9377070 · Cited by 66
Sentiment Analysis of Saudi Dialect Using Deep Learning Techniques
Alahmary, R., Al-Dossari, H. Z., & Emam, A. Z. (2019) · International Conference on Electronics, Information, and Communication (ICEIC) · doi:10.23919/elinfocom.2019.8706408 · Cited by 61
Opinion Mining on US Airline Twitter Data Using Machine Learning Techniques
Saad, A. I. (2020) · International Computer Engineering Conference · doi:10.1109/icenco49778.2020.9357390 · Cited by 49
Sentiment Analysis of US Airline Twitter Data using New Adaboost Approach
Prabhakar, E., Santhosh, M., Krishnan, A., et al. (2019) · Cited by 40
Sentiment Analysis of Code-Mixed Roman Urdu-English Social Media Text using Deep Learning Approaches
Younas, A., Nasim, R., Ali, S., Wang, G., & Qi, F. (2020) · IEEE International Conference on Computational Science and Engineering (CSE) · doi:10.1109/cse50738.2020.00017 · Cited by 33
Sentiment and Emotion in Social Media COVID-19 Conversations: SAB-LSTM Approach
Kumar, D. A., & Chinnalagu, A. (2020) · International Conference on System Modeling & Advancement in Research Trends (SMART) · doi:10.1109/smart50582.2020.9337098 · Cited by 32
A Sentiment analysis approach through deep learning for a movie review
Dholpuria, T., Rana, Y. K. D., & Agrawal, C. (2018) · International Conference on Communication Systems and Network Technologies · doi:10.1109/csnt.2018.8820260 · Cited by 31
Analyzing Sentiment in Tamil Tweets using Deep Neural Network
Anbukkarasi, S., & Varadhaganapathy, S. (2020) · International Conference on Computing Methodologies and Communication (ICCMC) · doi:10.1109/iccmc48092.2020.iccmc-00084 · Cited by 27
Sentiment Analysis Using Residual Learning with Simplified CNN Extractor
Thinh, N. K., Nga, C. H., Lee, Y.-S., Wu, M.-L., Chang, P., & Wang, J. (2019) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism46123.2019.00075 · Cited by 15
Cited by
Natural language processing: state of the art, current trends and challenges
Khurana, D., Koli, A., Khatter, K., & Singh, S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13428-4 · Cited by 1,823
A Survey of Sentiment Analysis: Approaches, Datasets, and Future Research
Tan, K. L., Lee, C. P., & Lim, K. M. (2023) · Applied Sciences · doi:10.3390/app13074550 · Cited by 303
Self-citationImproving sentiment classification using a RoBERTa-based hybrid model
Semary, N. A., Ahmed, W., Amin, K., Pławiak, P., & Hammad, M. (2023) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2023.1292010 · Cited by 71
Wang, G., Gao, K., Liu, Q., Wu, Y., Zhang, K., Zhou, W., & Guo, C. (2023) · Journal of Medical Internet Research · doi:10.2196/49771 · Cited by 48
Metadata
- Authors
- Tan, K. L., Lee, C. P., Anbananthen, K. S. M., & Lim, K. M.
- Venue
- IEEE Access
- Published
- 2022
- Volume
- 10
- Pages
- 21517-21525
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4213072767
- Cited by
- 354
- References
- 19
- FWCI
- 23.75
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.