The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Sentiment analysis based on improved pre-trained word embeddings
Abstract
Abstract Sentiment analysis is a fast growing area of research in natural language processing (NLP) and text classifications. This technique has become an essential part of a wide range of applications including politics, business, advertising and marketing. There are various techniques for sentiment analysis, but recently word embeddings methods have been widely used in sentiment classification tasks. Word2Vec and GloVe are currently among the most accurate and usable word embedding methods which can convert words into meaningful vectors. However, these methods ignore sentiment information of texts and need a large corpus of texts for training and generating exact vectors. As a result, because of the small size of some corpora, researcher often have to use pre-trained word embeddings which were trained on other large text corpora such as Google News with about 100 billion words. The increasing accuracy of pre-trained word embeddings has a great impact on sentiment analysis research. In this paper, we propose a novel method, Improved Word Vectors (IWV), which increases the accuracy of pre-trained word embeddings in sentiment analysis. Our method is based on Part-of-Speech (POS) tagging techniques, lexicon-based approaches, word position algorithm and Word2Vec/GloVe methods. We tested the accuracy of our method via different deep learning models and benchmark sentiment datasets. Our experiment results show that Improved Word Vectors (IWV) are very effective for sentiment analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878
Lexicon-based methods for sentiment analysis
Taboada, M., Brooke, J., Tofiloski, M., Voll, K., & Stede, M. (2011) · Computational Linguistics · doi:10.1162/coli_a_00049 · Cited by 3,301
Sentiment analysis algorithms and applications: A survey
Medhat, W., Hassan, A., & Korashy, H. (2014) · Ain Shams Engineering Journal · doi:10.1016/j.asej.2014.04.011 · Cited by 3,248
Semantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887
Attention-based LSTM for Aspect-level Sentiment Classification
Wang, Y., Huang, M., zhu, X., & Zhao, L. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1058 · Cited by 2,450
A holistic lexicon-based approach to opinion mining
Ding, X., Liu, B., & Yu, P. S. (2008) · Proceedings of the international conference on Web search and web data mining - WSDM '08 · doi:10.1145/1341531.1341561 · Cited by 1,386
Proceedings of the 26th International Conference on Neural Information Processing Systems
Burges, C. J. C., Bottou, L., Welling, M., Zoubin Ghahramani, A., & Weinberger, K. Q. (2013) · Cited by 1,323
A survey on opinion mining and sentiment analysis: Tasks, approaches and applications
Ravi, K., & Ravi, V. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.06.015 · Cited by 1,306
Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification
Tang, D., Wei, F., Yang, N., Zhou, M., Liu, T., & Qin, B. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1146 · Cited by 1,181
Sentiment Analysis of Short Informal Texts
Kiritchenko, S., Zhu, X., & Mohammad, S. M. (2014) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4272 · Cited by 880
Deep Unordered Composition Rivals Syntactic Methods for Text Classification
Iyyer, M., Manjunatha, V., Boyd-Graber, J., & Daumé III, H. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1162 · Cited by 714
NRC-Canada-2014: Detecting Aspects and Sentiment in Customer Reviews
Kiritchenko, S., Zhu, X., Cherry, C., & Mohammad, S. (2014) · Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) · doi:10.3115/v1/s14-2076 · Cited by 697
Pang, B., & Lee, L. (2005) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0506075 · Cited by 678
Twitter Sentiment Analysis with Deep Convolutional Neural Networks
Severyn, A., & Moschitti, A. (2015) · Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/2766462.2767830 · Cited by 659
Enhancing deep learning sentiment analysis with ensemble techniques in social applications
Araque, O., Corcuera-Platas, I., Sánchez-Rada, J. F., & Iglesias, C. A. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.02.002 · Cited by 563
NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweets
Mohammad, S. M., Kiritchenko, S., & Zhu, X. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1308.6242 · Cited by 451
Combining lexicon-based and learning-based methods for twitter sentiment analysis
Zhang, L., Ghosh, R., Dekhil, M., Hsu, M., & Liu, B. (2011) · Cited by 439
Sentiment analysis leveraging emotions and word embeddings
Giatsoglou, M., Vozalis, M. G., Diamantaras, K., Vakali, A., Sarigiannidis, G., & Chatzisavvas, K. C. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.10.043 · Cited by 374
SemEval-2015 Task 10: Sentiment Analysis in Twitter
Rosenthal, S., Nakov, P., Kiritchenko, S., Mohammad, S., Ritter, A., & Stoyanov, V. (2015) · Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015) · doi:10.18653/v1/s15-2078 · Cited by 367
Zhao, Z., Du, L., Börschinger, B., Pate, J. K., Ciaramita, M., Steedman, M. J., & Johnson, M. (2015) · The Association for Computational Linguistics · Cited by 275
Proceedings of the 2008 International Conference on Web Search and Data Mining
Najork, M., Broder, A., & Chakrabarti, S. (2008) · Cited by 252
Basari, A. S. H., Hussin, B., Ananta, I. G. P., & Zeniarja, J. (2013) · Procedia Engineering · doi:10.1016/j.proeng.2013.02.059 · Cited by 244
Combining lexicon and learning based approaches for concept-level sentiment analysis
Mudinas, A., Zhang, D., & Levene, M. (2012) · Proceedings of the First International Workshop on Issues of Sentiment Discovery and Opinion Mining · doi:10.1145/2346676.2346681 · Cited by 220
Machine Learning and Lexicon Based Methods for Sentiment Classification: A Survey
Zhang, H., Gan, W., & Jiang, B. (2014) · Web Information System and Application Conference · doi:10.1109/wisa.2014.55 · Cited by 199
Camacho-Collados, J., Pilehvar, M. T., & Navigli, R. (2016) · Artificial Intelligence · doi:10.1016/j.artint.2016.07.005 · Cited by 188
Leveraging Large Amounts of Weakly Supervised Data for Multi-Language Sentiment Classification
Deriu, J., Lucchi, A., Luca, V. D., Severyn, A., Müller, S., Cieliebak, M., Hofmann, T., & Jaggi, M. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3038912.3052611 · Cited by 148
A topic-enhanced word embedding for Twitter sentiment classification
Ren, Y., Wang, R., & Ji, D. (2016) · Information Sciences · doi:10.1016/j.ins.2016.06.040 · Cited by 128
Combine HowNet lexicon to train phrase recursive autoencoder for sentence-level sentiment analysis
Fu, X., Liu, W., Xu, Y., & Cui, L. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.01.079 · Cited by 120
An empirical convolutional neural network approach for semantic relation classification
Qin, P., Xu, W., & Guo, J. H. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.12.091 · Cited by 91
Charagram: Embedding Words and Sentences via Character n-gramsPreprint
Wieting, J., Bansal, M., Gimpel, K., & Livescu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.02789 · Cited by 72
Content Tree Word Embedding for document representation
Kamkarhaghighi, M., & Makrehchi, M. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.08.021 · Cited by 44
Lauren, P., Qu, G., Zhang, F., & Lendasse, A. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.01.117 · Cited by 38
Modelling context with neural networks for recommending idioms in essay writing
Liu, Y., Liu, B., Shan, L., & Wang, X. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.11.005 · Cited by 23
Cited by
ABCDM: An Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis
Basiri, M. E., Nemati, S., Abdar, M., Cambria, E., & Acharya, U. R. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2020.08.005 · Cited by 745
Sentiment analysis on product reviews based on weighted word embeddings and deep neural networks
Onan, A. (2021) · Concurrency and Computation: Practice and Experience · doi:10.1002/cpe.5909 · Cited by 396
ONAN, A. (2021) · Computer Applications in Engineering Education · doi:10.1002/cae.22253 · Cited by 382
Evaluation of Sentiment Analysis in Finance: From Lexicons to Transformers
Mishev, K., Gjorgjevikj, A., Vodenska, I., Chitkushev, L. T., & Trajanov, D. (2020) · IEEE Access · doi:10.1109/access.2020.3009626 · Cited by 345
Onan, A. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2022.02.025 · Cited by 289
Metadata
- Authors
- Rezaeinia, S. M., Rahmani, R., Ghodsi, A., & Veisi, H.
- Venue
- Expert Systems with Applications
- Publisher
- Elsevier BV
- Published
- 2019-03
- Volume
- 117
- Pages
- 139-147
- ISSN
- 0957-4174 (ISSN-L)
- OpenAlex
- W2892137778
- Cited by
- 325
- References
- 44
- FWCI
- 17.82
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.