Enhancing deep learning sentiment analysis with ensemble techniques in social applications
Open accessThe DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
Abstract
Deep learning techniques for Sentiment Analysis have become very popular. They provide automatic feature extraction and both richer representation capabilities and better performance than traditional feature based techniques (i.e., surface methods). Traditional surface approaches are based on complex manually extracted features, and this extraction process is a fundamental question in feature driven methods. These long-established approaches can yield strong baselines, and their predictive capabilities can be used in conjunction with the arising deep learning methods. In this paper we seek to improve the performance of deep learning techniques integrating them with traditional surface approaches based on manually extracted features. The contributions of this paper are sixfold. First, we develop a deep learning based sentiment classifier using a word embeddings model and a linear machine learning algorithm. This classifier serves as a baseline to compare to subsequent results. Second, we propose two ensemble techniques which aggregate our baseline classifier with other surface classifiers widely used in Sentiment Analysis. Third, we also propose two models for combining both surface and deep features to merge information from several sources. Fourth, we introduce a taxonomy for classifying the different models found in the literature, as well as the ones we propose. Fifth, we conduct several experiments to compare the performance of these models with the deep learning baseline. For this, we use seven public datasets that were extracted from the microblogging and movie reviews domain. Finally, as a result, a statistical study confirms that the performance of these proposed models surpasses that of our original baseline on F1-Score.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S., & McClosky, D. (2014) · Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.3115/v1/p14-5010 · Cited by 7,037
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Learning Word Vectors for Sentiment Analysis
Maas, A. L., Daly, R. E., Pham, P. T., Huang, D., Ng, A. Y., & Potts, C. (2011) · Cited by 6,960
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878
Natural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Cited by
State-of-the-art in artificial neural network applications: A survey
Abiodun, O. I., Jantan, A., Omolara, A. E., Dada, K. V., Mohamed, N. A., & Arshad, H. (2018) · Heliyon · doi:10.1016/j.heliyon.2018.e00938 · Cited by 3,054
A Survey of Deep Learning and Its Applications: A New Paradigm to Machine Learning
Dargan, S., Kumar, M., Ayyagari, M. R., & Kumar, G. (2020) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-019-09344-w · Cited by 1,198
A comprehensive review on ensemble deep learning: Opportunities and challenges
Mohammed, A., & Kora, R. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.01.014 · Cited by 1,127
A comprehensive survey on sentiment analysis: Approaches, challenges and trends
Birjali, M., Kasri, M., & Beni-Hssane, A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107134 · Cited by 921
Sharma, R., Kamble, S. S., Gunasekaran, A., Kumar, V., & Kumar, A. (2020) · Computers & Operations Research · doi:10.1016/j.cor.2020.104926 · Cited by 766
A Survey of Deep Learning: Platforms, Applications and Emerging Research Trends
Hatcher, W. G., & Yu, W. (2018) · IEEE Access · doi:10.1109/access.2018.2830661 · Cited by 654
Deep Learning for Aspect-Based Sentiment Analysis: A Comparative Review
Do, H. H., Prasad, P., Maag, A., & Alsadoon, A. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.10.003 · Cited by 614
Sentiment Analysis Based on Deep Learning: A Comparative Study
Dang, N. C., Moreno-García, M. N., & De la Prieta, F. (2020) · Electronics · doi:10.3390/electronics9030483 · Cited by 593
A survey of sentiment analysis in social media
Yue, L., Chen, W., Li, X., Zuo, W., & Yin, M. (2019) · Knowledge and Information Systems · doi:10.1007/s10115-018-1236-4 · Cited by 577
FNDNet – A deep convolutional neural network for fake news detection
Kaliyar, R. K., Goswami, A., Narang, P., & Sinha, S. (2020) · Cognitive Systems Research · doi:10.1016/j.cogsys.2019.12.005 · Cited by 453
Bhandary, A., Prabhu, G. A., Rajinikanth, V., Thanaraj, K. P., Satapathy, S. C., Robbins, D. E., Shasky, C., Zhang, Y.-D., Tavares, J. M. R. S., & Raja, N. S. M. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.11.013 · Cited by 449
A Survey on ensemble learning under the era of deep learning
Yang, Y., Lv, H., & Chen, N. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10283-5 · Cited by 369
Sentiment analysis of Twitter data during critical events through Bayesian networks classifiers
Ruz, G. A., Henríquez, P. A., & Mascareño, A. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.01.005 · Cited by 332
Sentiment analysis based on improved pre-trained word embeddings
Rezaeinia, S. M., Rahmani, R., Ghodsi, A., & Veisi, H. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.08.044 · Cited by 325
Co-LSTM: Convolutional LSTM model for sentiment analysis in social big data
Behera, R. K., Jena, M., Rath, S. K., & Misra, S. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2020.102435 · Cited by 320
A recent overview of the state-of-the-art elements of text classification
Mirończuk, M. M., & Protasiewicz, J. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.03.058 · Cited by 317
Miglani, A., & Kumar, N. (2019) · Vehicular Communications · doi:10.1016/j.vehcom.2019.100184 · Cited by 295
Sharma, A., Mukhopadhyay, T., Rangappa, S. M., Siengchin, S., & Kushvaha, V. (2022) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-021-09700-9 · Cited by 285
Deep learning-based sentiment classification of evaluative text based on Multi-feature fusion
Abdi, A., Shamsuddin, S. M., Hasan, S., & Piran, J. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.02.018 · Cited by 256
Sentiment analysis of Chinese micro-blog text based on extended sentiment dictionary
Zhang, S., Wei, Z., Wang, Y., & Liao, T. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2017.09.048 · Cited by 255
FinBERT: Financial Sentiment Analysis with Pre-trained Language Models
Araci, D. (2019) · arXiv · Cited by 602
Cyberbullying Detection Based on Emotion
Al-Hashedi, M., Soon, L.-K., Goh, H.-N., Lim, A. H. L., & Siew, E.-G. (2023) · IEEE Access · doi:10.1109/access.2023.3280556 · Cited by 45
Why pay more? A simple and efficient named entity recognition system for tweets
Suman, C., Reddy, S. M., Saha, S., & Bhattacharyya, P. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114101 · Cited by 27
(2019) · International Journal of Engineering and Advanced Technology · doi:10.35940/ijeat.f8492.088619 · Cited by 3
Metadata
- Authors
- Araque, O., Corcuera-Platas, I., Sánchez-Rada, J. F., & Iglesias, C. A.
- Venue
- Expert Systems with Applications
- Publisher
- Elsevier BV
- Published
- 2017-07
- Volume
- 77
- Pages
- 236-246
- ISSN
- 0957-4174 (ISSN-L)
- OpenAlex
- W2584429674
- Cited by
- 563
- References
- 76
- FWCI
- 36.90
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.