The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
Enhancing deep learning sentiment analysis with ensemble techniques in social applications
Open accessAbstract
Deep learning techniques for Sentiment Analysis have become very popular. They provide automatic feature extraction and both richer representation capabilities and better performance than traditional feature based techniques (i.e., surface methods). Traditional surface approaches are based on complex manually extracted features, and this extraction process is a fundamental question in feature driven methods. These long-established approaches can yield strong baselines, and their predictive capabilities can be used in conjunction with the arising deep learning methods. In this paper we seek to improve the performance of deep learning techniques integrating them with traditional surface approaches based on manually extracted features. The contributions of this paper are sixfold. First, we develop a deep learning based sentiment classifier using a word embeddings model and a linear machine learning algorithm. This classifier serves as a baseline to compare to subsequent results. Second, we propose two ensemble techniques which aggregate our baseline classifier with other surface classifiers widely used in Sentiment Analysis. Third, we also propose two models for combining both surface and deep features to merge information from several sources. Fourth, we introduce a taxonomy for classifying the different models found in the literature, as well as the ones we propose. Fifth, we conduct several experiments to compare the performance of these models with the deep learning baseline. For this, we use seven public datasets that were extracted from the microblogging and movie reviews domain. Finally, as a result, a statistical study confirms that the performance of these proposed models surpasses that of our original baseline on F1-Score.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S., & McClosky, D. (2014) · Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.3115/v1/p14-5010 · Cited by 7,037
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Learning Word Vectors for Sentiment Analysis
Maas, A. L., Daly, R. E., Pham, P. T., Huang, D., Ng, A. Y., & Potts, C. (2011) · Cited by 6,961
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878
Natural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
Peter, P., & Turney (2002) · Cited by 3,650
Software Framework for Topic Modelling with Large Corpora
Rek, R. R. U., & Sojka, P. (2010) · doi:10.13140/2.1.2393.1847 · Cited by 3,647
Lexicon-based methods for sentiment analysis
Taboada, M., Brooke, J., Tofiloski, M., Voll, K., & Stede, M. (2011) · Computational Linguistics · doi:10.1162/coli_a_00049 · Cited by 3,301
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · North American Chapter of the Association for Computational Linguistics · Cited by 2,912
Twitter as a Corpus for Sentiment Analysis and Opinion Mining
Pak, A., & Paroubek, P. (2010) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/47akcj8foo4d · Cited by 2,704
SENTIWORDNET: A Publicly Available Lexical Resource for Opinion Mining
Esuli, A., & Sebastiani, F. (2006) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/54vo5wjya4cw · Cited by 2,480
Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews
Turney, P. D. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073153 · Cited by 2,352
Introduction to Machine Learning
(2019) · Series in Machine Perception and Artificial Intelligence · doi:10.1142/9789811201967_0001 · Cited by 1,639
Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Isabelle, P. (2002) · Cited by 1,635
Sentiment Analysis of Twitter Data
Agarwal, A., Xie, B., Vovsha, I., Rambow, O., & Passonneau, R. J. (2011) · Cited by 1,565
Data Mining and Knowledge Discovery Handbook
(2005) · Springer eBooks · doi:10.1007/b107408 · Cited by 1,548
A holistic lexicon-based approach to opinion mining
Ding, X., Liu, B., & Yu, P. S. (2008) · Proceedings of the international conference on Web search and web data mining - WSDM '08 · doi:10.1145/1341531.1341561 · Cited by 1,386
Twitter Sentiment Analysis: The Good the Bad and the OMG!
Kouloumpis, E., Wilson, T., & Moore, J. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14185 · Cited by 1,225
Affective Computing and Sentiment Analysis
Cambria, E. (2016) · IEEE Intelligent Systems · doi:10.1109/mis.2016.31 · Cited by 1,204
Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification
Tang, D., Wei, F., Yang, N., Zhou, M., Liu, T., & Qin, B. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1146 · Cited by 1,181
Sentiment analysis: capturing favorability using natural language processing
Nasukawa, T., & Yi, J. (2003) · Proceedings of the 2nd international conference on Knowledge capture · doi:10.1145/945645.945658 · Cited by 1,165
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Baselines and Bigrams: Simple, Good Sentiment and Topic Classification
Wang, S. I., & Manning, C. D. (2012) · Cited by 1,006
Sentiment Analysis of Short Informal Texts
Kiritchenko, S., Zhu, X., & Mohammad, S. M. (2014) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4272 · Cited by 880
Part-of-Speech Tagging for Twitter: Annotation, Features, and Experiments
Gimpel, K., Schneider, N., O'Connor, B., Das, D., Mills, D. P., Eisenstein, J., Heilman, M., Yogatama, D., Flanigan, J., & Smith, N. A. (2018) · Figshare · doi:10.1184/r1/6473609.v1 · Cited by 800
Recognizing Contextual Polarity: An Exploration of Features for Phrase-Level Sentiment Analysis
Wilson, T., Wiebe, J., & Hoffmann, P. (2009) · Computational Linguistics · doi:10.1162/coli.08-012-r1-06-90 · Cited by 722
Twitter Sentiment Analysis with Deep Convolutional Neural Networks
Severyn, A., & Moschitti, A. (2015) · Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/2766462.2767830 · Cited by 659
Sentiment Analysis: Mining Opinions, Sentiments, and Emotions
Liu, B. (2015) · Cited by 656
Introduction to Machine Learning
Suykens, J. A. K. (2014) · Academic Press Library in Signal Processing · doi:10.1016/b978-0-12-396502-8.00013-9 · Cited by 641
Ensemble of feature sets and classification algorithms for sentiment classification
Xia, R., Zong, C., & Li, S. (2011) · Information Sciences · doi:10.1016/j.ins.2010.11.023 · Cited by 583
Sentiment Analysis: Mining Opinions, Sentiments, and Emotions
Zhao, J., Liu, K., & Xu, L. (2016) · Computational Linguistics · doi:10.1162/coli_r_00259 · Cited by 552
Sentiment analysis of blogs by combining lexical knowledge with text classification
Melville, P., Gryc, W., & Lawrence, R. D. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557156 · Cited by 503
Expanding domain sentiment lexicon through double propagation
Qiu, G., Liu, B., Bu, J., & Chen, C. (2009) · International Joint Conference on Artificial Intelligence · Cited by 483
NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweets
Mohammad, S. M., Kiritchenko, S., & Zhu, X. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1308.6242 · Cited by 451
Target-dependent twitter sentiment classification with rich automatic features
Vo, D.-T., & Zhang, Y. (2015) · International Conference on Artificial Intelligence · Cited by 439
Customizing Sentiment Classifiers to New Domains: a Case Study
Aue, A., & Gamon, M. (2005) · International conference Recent advances in natural language processing · Cited by 437
Tweet sentiment analysis with classifier ensembles
da Silva, N. F. F., Hruschka, E. R., & Hruschka, E. R. (2014) · Decision Support Systems · doi:10.1016/j.dss.2014.07.003 · Cited by 431
Chinese comments sentiment classification based on word2vec and SVMperf
Zhang, D., Xu, H., Su, Z., & Xu, Y. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.09.011 · Cited by 395
Sentiment classification: The contribution of ensemble learning
Wang, G., Sun, J., Ma, J., Xu, K., & Gu, J. (2014) · Decision Support Systems · doi:10.1016/j.dss.2013.08.002 · Cited by 379
Using Emoticons to reduce Dependency in Machine Learning Techniques for Sentiment Classification
Jonathon, & Read (2005) · Cited by 373
Using emoticons to reduce dependency in machine learning techniques for sentiment classification
Read, J. (2005) · Proceedings of the ACL Student Research Workshop on - ACL '05 · doi:10.3115/1628960.1628969 · Cited by 367
Libkin, L. O. (2015) · National Conference on Artificial Intelligence · Cited by 286
Computing Attitude and Affect in Text: Theory and Applications
(2006) · The Information Retrieval Series · doi:10.1007/1-4020-4102-0 · Cited by 270
An empirical evaluation of bagging and boosting
Maclin, R., & Opitz, D. W. (1997) · Cited by 265
Coooolll: A Deep Learning System for Twitter Sentiment Classification
Tang, D., Wei, F., Qin, B., Liu, T., & Zhou, M. (2014) · Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) · doi:10.3115/v1/s14-2033 · Cited by 243
Smedt, T. D., & Daelemans, W. M. P. (2012) · Journal of Machine Learning Research · doi:10.5555/2188385.2343710 · Cited by 235
Evaluation Datasets for Twitter Sentiment Analysis: A survey and a new dataset, the STS-Gold.
Saif, H., Fernández, M., He, Y., & Alani, H. (2013) · Open Research Online - ORO (The Open University) · Cited by 206
A comparative study of feature selection and machine learning techniques for sentiment analysis
Sharma, A., & Dey, S. (2012) · Research in Applied Computation Symposium · doi:10.1145/2401603.2401605 · Cited by 183
Sentiment analysis: Bayesian Ensemble Learning
Fersini, E., Messina, E., & Pozzi, F. A. (2014) · Decision Support Systems · doi:10.1016/j.dss.2014.10.004 · Cited by 182
Ensemble of Generative and Discriminative Techniques for Sentiment Analysis of Movie ReviewsPreprint
Mesnil, G., Mikolov, T., Ranzato, M., & Bengio, Y. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.5335 · Cited by 156
Marginalized Denoising Auto-encoders for Nonlinear Representations
Chen, M., Weinberger, K. Q., Sha, F., & Bengio, Y. (2014) · International Conference on Machine Learning · Cited by 154
Learning Sentiment Lexicons in Spanish
Pérez‐Rosas, V., Banea, C., & Mihalcea, R. F. (2012) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/35pjywopbhxf · Cited by 151
Ensemble Methods for Classifiers
Rokach, L. (2006) · Springer eBooks · doi:10.1007/0-387-25465-x_45 · Cited by 145
Proceedings of the Workshop on Languages in Social Media
Nagarajan, M., & Gamon, M. (2011) · Cited by 141
Exploring the Use of Word Relation Features for Sentiment Classification
Xia, R., & Zong, C. (2010) · International Conference on Computational Linguistics · Cited by 111
Experiments on Ensembles with Missing and Noisy Data
Melville, P., Shah, N., Mihalkova, L. S., & Mooney, R. J. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-25966-4_29 · Cited by 105
Li, H., Lin, C.-Y., & Osborne, M. (2012) · Cited by 83
Sentiment Mining Using Ensemble Classification Models
Whitehead, M. T., & Yaeger, L. (2009) · Springer eBooks · doi:10.1007/978-90-481-3658-2_89 · Cited by 80
A POS-based ensemble model for crossdomain sentiment classification
Xia, R., & Zong, C. (2010) · Cited by 77
Expressive signals in social media languages to improve polarity detection
Fersini, E., Messina, E., & Pozzi, F. A. (2015) · Information Processing & Management · doi:10.1016/j.ipm.2015.04.004 · Cited by 69
Innovations and Advances in Computer Sciences and Engineering
Nabende, P., Tiedemann, J., Nerbonne, J., & Sobh, T. (2010) · Springer eBooks · doi:10.1007/978-90-481-3658-2 · Cited by 65
SES: Sentiment Elicitation System for Social Media Data
Zhang, K., Cheng, Y., Xie, Y., Honbo, D., Agrawal, A., Palsetia, D., Lee, K., Liao, W., & Choudhary, A. (2011) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2011.153 · Cited by 61
Proceedings of the 2nd international conference on Knowledge capture
(2003) · doi:10.1145/945645 · Cited by 50
Proceedings of the ACL 2004 on Student research workshop -
(2004) · doi:10.3115/1219079 · Cited by 47
Zhang, P., & He, Z. (2015) · Journal of Information Science · doi:10.1177/0165551515585264 · Cited by 32
Proceedings of the 2012 ACM Research in Applied Computation Symposium
Cho, Y., Texas, R. '. R. I. A. C. S. 2. S. A., Association for Computing Machinery-Digital Library, ACM Special Interest Group on Applied Computing, & SIGs, A. (2012) · doi:10.1145/2401603 · Cited by 26
A Comparison of Domain-based Word Polarity Estimation using different Word Embeddings
Pablos, A. G., Cuadros, M., & Rigau, G. (2016) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/24rnrjsuraet · Cited by 11
Cited by
State-of-the-art in artificial neural network applications: A survey
Abiodun, O. I., Jantan, A., Omolara, A. E., Dada, K. V., Mohamed, N. A., & Arshad, H. (2018) · Heliyon · doi:10.1016/j.heliyon.2018.e00938 · Cited by 3,054
A Survey of Deep Learning and Its Applications: A New Paradigm to Machine Learning
Dargan, S., Kumar, M., Ayyagari, M. R., & Kumar, G. (2020) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-019-09344-w · Cited by 1,198
A comprehensive review on ensemble deep learning: Opportunities and challenges
Mohammed, A., & Kora, R. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.01.014 · Cited by 1,127
A comprehensive survey on sentiment analysis: Approaches, challenges and trends
Birjali, M., Kasri, M., & Beni-Hssane, A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107134 · Cited by 921
Sharma, R., Kamble, S. S., Gunasekaran, A., Kumar, V., & Kumar, A. (2020) · Computers & Operations Research · doi:10.1016/j.cor.2020.104926 · Cited by 766
Metadata
- Authors
- Araque, O., Corcuera-Platas, I., Sánchez-Rada, J. F., & Iglesias, C. A.
- Venue
- Expert Systems with Applications
- Publisher
- Elsevier BV
- Published
- 2017-07
- Volume
- 77
- Pages
- 236-246
- ISSN
- 0957-4174 (ISSN-L)
- OpenAlex
- W2584429674
- Cited by
- 563
- References
- 76
- FWCI
- 36.90
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.