The DOI matches its Crossref record; 80 of the 80 references it cites were found in a registry or an index.
ABCDM: An Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis
Open accessAbstract
Abstract Sentiment analysis has been a hot research topic in natural language processing and data mining fields in the last decade. Recently, deep neural network (DNN) models are being applied to sentiment analysis tasks to obtain promising results. Among various neural architectures applied for sentiment analysis, long short-term memory (LSTM) models and its variants such as gated recurrent unit (GRU) have attracted increasing attention. Although these models are capable of processing sequences of arbitrary length, using them in the feature extraction layer of a DNN makes the feature space high dimensional. Another drawback of such models is that they consider different features equally important. To address these problems, we propose an Attention-based Bidirectional CNN-RNN Deep Model (ABCDM). By utilizing two independent bidirectional LSTM and GRU layers, ABCDM will extract both past and future contexts by considering temporal information flow in both directions. Also, the attention mechanism is applied on the outputs of bidirectional layers of ABCDM to put more or less emphasis on different words. To reduce the dimensionality of features and extract position-invariant local features, ABCDM utilizes convolution and pooling mechanisms. The effectiveness of ABCDM is evaluated on sentiment polarity detection which is the most common and essential task of sentiment analysis. Experiments were conducted on five review and three Twitter datasets. The results of comparing ABCDM with six recently proposed DNNs for sentiment analysis show that ABCDM achieves state-of-the-art results on both long review and short tweet polarity classification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., & Hovy, E. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1174 · Cited by 4,712
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019) · arXiv · doi:10.48550/arxiv.1909.11942 · Cited by 4,308
A Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1062 · Cited by 3,601
Deep learning for computer vision: A brief review
Voulodimos, A., Doulamis, N., Doulamis, A., & Protopapadakis, E. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/7068349 · Cited by 3,403
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
Tai, K. S., Socher, R., & Manning, C. D. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1150 · Cited by 3,081
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2840738 · Cited by 2,921
Self-citationImage-Based Recommendations on Styles and Substitutes
McAuley, J., Targett, C., Shi, Q., & van den Hengel, A. (2015) · Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/2766462.2767755 · Cited by 2,280
Deep learning for sentiment analysis: A survey
Zhang, L., Wang, S., & Liu, B. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1253 · Cited by 1,928
Neural Word Embedding as Implicit Matrix Factorization
Levy, O., & Goldberg, Y. (2014) · neural information processing systems · Cited by 1,582
Recent Trends in Deep Learning Based Natural Language Processing
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.02709 · Cited by 1,192
Self-citationLearning Sentiment-Specific Word Embedding for Twitter Sentiment Classification
Tang, D., Wei, F., Yang, N., Zhou, M., Liu, T., & Qin, B. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1146 · Cited by 1,181
Bidirectional LSTM with attention mechanism and convolutional layer for text classification
Liu, G., & Guo, J. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.01.078 · Cited by 1,127
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Proceedings of the 24th International Conference on World Wide Web
(2015) · doi:10.1145/2740908 · Cited by 1,052
Effective Use of Word Order for Text Categorization with Convolutional Neural Networks
Johnson, R., & Zhang, T. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1011 · Cited by 864
Effective LSTMs for Target-Dependent Sentiment ClassificationPreprint
Tang, D., Qin, B., Feng, X., & Liu, T. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.01100 · Cited by 802
DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language Understanding
Shen, T., Zhou, T., Long, G., Jiang, J., Pan, S., & Zhang, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11941 · Cited by 779
Document-level sentiment classification: An empirical comparison between SVM and ANN
Moraes, R., Valiati, J. F., & Gavião Neto, W. P. (2013) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.07.059 · Cited by 733
Sentiment Analysis: Mining Opinions, Sentiments, and Emotions
Liu, B. (2015) · Cited by 624
Dimensional Sentiment Analysis Using a Regional CNN-LSTM Model
Wang, J., Yu, L.-C., Lai, K. R., & Zhang, X. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p16-2037 · Cited by 584
Sentiment Analysis: Mining Opinions, Sentiments, and Emotions
Zhao, J., Liu, K., & Xu, L. (2016) · Computational Linguistics · doi:10.1162/coli_r_00259 · Cited by 552
Combining lexicon-based and learning-based methods for twitter sentiment analysis
Zhang, L., Ghosh, R., Dekhil, M., Hsu, M., & Liu, B. (2011) · Cited by 439
SenticNet 6: Ensemble Application of Symbolic and Subsymbolic AI for Sentiment Analysis
Cambria, E., Li, Y., Xing, F. Z., Poria, S., & Kwok, K. (2020) · Proceedings of the 29th ACM International Conference on Information & Knowledge Management · doi:10.1145/3340531.3412003 · Cited by 437
Self-citationA Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1404.2188 · Cited by 407
Understanding Emotions in Text Using Deep Learning and Big Data
Chatterjee, A., Gupta, U., Chinnakotla, M. K., Srikanth, R., Galley, M., & Agrawal, P. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.029 · Cited by 384
Deep Learning Based Text Classification: A Comprehensive Review
Minaee, S., Kalchbrenner, N., Cambria, E., Nikzad, N., Asgari-Chenaghlu, M., & Gao, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.03705 · Cited by 381
Self-citationSentiment Embeddings with Applications to Sentiment Analysis
Tang, D., Wei, F., Qin, B., Yang, N., Liu, T., & Zhou, M. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2015.2489653 · Cited by 335
Recent trends in deep learning based personality detection
Mehta, Y., Majumder, N., Gelbukh, A., & Cambria, E. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09770-z · Cited by 329
Self-citationSentiment analysis based on improved pre-trained word embeddings
Rezaeinia, S. M., Rahmani, R., Ghodsi, A., & Veisi, H. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.08.044 · Cited by 325
How to Generate a Good Word Embedding
Lai, S., Liu, K., He, S., & Zhao, J. (2016) · IEEE Intelligent Systems · doi:10.1109/mis.2016.45 · Cited by 312
Sentic LSTM: a Hybrid Network for Targeted Aspect-Based Sentiment Analysis
Ma, Y., Peng, H., Khan, T., Cambria, E., & Hussain, A. (2018) · Cognitive Computation · doi:10.1007/s12559-018-9549-x · Cited by 309
Self-citation2016 International Joint Conference on Neural Networks (IJCNN)
(2016) · doi:10.1109/ijcnn38550.2016 · Cited by 303
Attention-based LSTM Network for Cross-Lingual Sentiment Classification
Zhou, X., Wan, X., & Xiao, J. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1024 · Cited by 297
Chen, G., Ye, D., Xing, Z., Chen, J., & Cambria, E. (2017) · 2017 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966144 · Cited by 255
Self-citationCombining lexicon and learning based approaches for concept-level sentiment analysis
Mudinas, A., Zhang, D., & Levene, M. (2012) · Proceedings of the First International Workshop on Issues of Sentiment Discovery and Opinion Mining · doi:10.1145/2346676.2346681 · Cited by 220
Exploiting Document Knowledge for Aspect-level Sentiment Classification
He, R., Lee, W. S., Ng, H. T., & Dahlmeier, D. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2092 · Cited by 215
Semi-supervised learning for big social data analysis
Hussain, A., & Cambria, E. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.10.010 · Cited by 205
Self-citationGenerating ensembles of heterogeneous classifiers using Stacked Generalization
Sesmero, M. P., Ledezma, A. I., & Sanchis, A. (2015) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1143 · Cited by 193
He, R., & McAuley, J. (2016) · arXiv · doi:10.48550/arxiv.1602.01585 · Cited by 186
Cached Long Short-Term Memory Neural Networks for Document-Level Sentiment Classification
Xu, J., Chen, D., Qiu, X., & Huang, X. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1172 · Cited by 185
Selecting Attributes for Sentiment Classification Using Feature Relation Networks
Abbasi, A., France, S., Zhang, Z., & Chen, H. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.110 · Cited by 182
Fuzzy commonsense reasoning for multimodal sentiment analysis
Chaturvedi, I., Satapathy, R., Cavallari, S., & Cambria, E. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.04.024 · Cited by 170
Self-citationSentic LDA: Improving on LDA with semantic similarity for aspect-based sentiment analysis
Poria, S., Chaturvedi, I., Cambria, E., & Bisio, F. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727784 · Cited by 163
Self-citationTowards Scalable and Reliable Capsule Networks for Challenging NLP Applications
Zhao, W., Peng, H., Eger, S., Cambria, E., & Yang, M. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1150 · Cited by 163
Self-citationBayesian network based extreme learning machine for subjectivity detection
Chaturvedi, I., Ragusa, E., Gastaldo, P., Zunino, R., & Cambria, E. (2017) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2017.06.007 · Cited by 159
Self-citationDeep-Sentiment: Sentiment Analysis Using Ensemble of CNN and Bi-LSTM ModelsPreprint
Minaee, S., Azimi, E., & Abdolrashidi, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.04206 · Cited by 158
Song, M., Park, H., & Shin, K.-S. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2018.12.005 · Cited by 154
Word Polarity Disambiguation Using Bayesian Model and Opinion-Level Features
Xia, Y., Cambria, E., Hussain, A., & Zhao, H. (2014) · Cognitive Computation · doi:10.1007/s12559-014-9298-4 · Cited by 153
Self-citationBasiri, M. E., Abdar, M., Çifçi, M. A., Nemati, S., & Acharya, U. R. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105949 · Cited by 151
Self-citationA tale of two epidemics: Contextual Word2Vec for classifying twitter streams during outbreaks
Khatua, A., Khatua, A., & Cambria, E. (2018) · Information Processing & Management · doi:10.1016/j.ipm.2018.10.010 · Cited by 149
Self-citationCross-Media Learning for Image Sentiment Analysis in the Wild
Vadicamo, L., Carrara, F., Cimino, A., Cresci, S., Dell’Orletta⋄, F., Falchi, F., & Tesconi, M. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.45 · Cited by 148
Ghiassi, M., & Lee, S. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.04.006 · Cited by 148
Ma, Z., Wang, P., Gao, Z., Wang, R., & Khalighi, K. (2018) · PLoS ONE · doi:10.1371/journal.pone.0205872 · Cited by 142
Intelligent Asset Allocation via Market Sentiment Views
Xing, F., Cambria, E., & Welsch, R. E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2866727 · Cited by 131
Self-citationGuest Editorial: Big Social Data Analysis
Cambria, E., Wang, H., & White, B. (2014) · Knowledge-Based Systems · doi:10.1016/j.knosys.2014.07.002 · Cited by 125
Self-citationLearning User and Product Distributed Representations Using a Sequence Model for Sentiment Analysis
Chen, T., Xu, R., He, Y., Xia, Y., & Wang, X. (2016) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2016.2572539 · Cited by 122
Learning word dependencies in text by means of a deep recurrent belief network
Chaturvedi, I., Ong, Y.-S., Tsang, I. W.-H., Welsch, R. E., & Cambria, E. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.07.019 · Cited by 120
Self-citationA Neural Word Embeddings Approach for Multi-Domain Sentiment Analysis
Dragoni, M., & Petrucci, G. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2717879 · Cited by 114
Mousa, A. E.-D., & Schuller, B. W. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1096 · Cited by 99
Towards Twitter sentiment classification by multi-level sentiment-enriched word embeddings
Xiong, S., Hai-lian, L., Zhao, W., & Ji, D. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.11.023 · Cited by 95
Modelling Public Sentiment in Twitter: Using Linguistic Patterns to Enhance Supervised Learning
Chikersal, P., Poria, S., Cambria, E., Gelbukh, A. F., & Siong, C. E. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-18117-2_4 · Cited by 87
Self-citationEnergy choices in Alaska: Mining people's perception and attitudes from geotagged tweets
Abdar, M., Basiri, M. E., Yin, J., Habibnezhad, M., Chi, G., Nemati, S., & Asadi, S. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.109781 · Cited by 74
Self-citationInferring Affective Meanings of Words from Word Embedding
Li, M., Lu, Q., Long, Y., & Gui, L. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2723012 · Cited by 68
A comprehensive analysis of adverb types for mining user sentiments on amazon product reviews
Chauhan, U. A., Afzal, M. T., Shahid, A., Abdar, M., Basiri, M. E., & Zhou, X. (2020) · World Wide Web · doi:10.1007/s11280-020-00785-z · Cited by 50
Self-citationAn ensemble method with sentiment features and clustering support
Nguyen, H. T., & Nguyen, L.-M. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.08.071 · Cited by 45
Sentiment Intensity Ranking among Adjectives Using Sentiment Bearing Word Embeddings
Sharma, R., Somani, A., Kumar, L., & Bhattacharyya, P. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1058 · Cited by 41
Basiri, M. E., & Kabiri, A. (2018) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3195633 · Cited by 41
Self-citationMultimodal deep learning for short-term stock volatility predictionPreprint
Nascimento, M. S., & Manandhar, S. (2018) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1812.10479 · Cited by 37
HOMPer: A new hybrid system for opinion mining in the Persian language
Basiri, M. E., & Kabiri, A. (2019) · Journal of Information Science · doi:10.1177/0165551519827886 · Cited by 37
Self-citationAn improved evidence-based aggregation method for sentiment analysis
Khiabani, P. J., Basiri, M. E., & Rastegari, H. (2019) · Journal of Information Science · doi:10.1177/0165551519837187 · Cited by 26
Self-citationUnsupervised Learning of Distributional Relation Vectors
Bouraoui, Z., Jameel, S., & Schockaert, S. (2018) · ORCA Online Research @Cardiff (Cardiff University) · doi:10.18653/v1/p18-1003 · Cited by 21
Recurrent Convolutional Neural Network with Attention for Twitter and Yelp Sentiment Classification
Wen, S., & Li, J. (2018) · International Conference on Algorithms, Computing and Artificial Intelligence (ACAI) · doi:10.1145/3302425.3302468 · Cited by 20
Cited by
Deep Learning--based Text Classification: A Comprehensive Review
Minaee, S., Kalchbrenner, N., Cambria, E., Nikzad, N., Chenaghlu, M., & Gao, J. (2022) · ACM Computing Surveys · doi:10.1145/3439726 · Cited by 1,538
Self-citationA survey on sentiment analysis methods, applications, and challenges
Wankhade, M., Rao, A. C. S., & Kulkarni, C. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10144-1 · Cited by 1,528
Deep learning modelling techniques: Current progress, applications, advantages, and challenges
Ahmed, S. F., Alam, M. S. B., Hassan, M., Rozbu, M. R., Ishtiak, T., Rafa, N., Mofijur, M., Shawkat Ali, A. B. M., & Gandomi, A. H. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10466-8 · Cited by 1,079
Babu, N. V., & Kanaga, E. G. M. (2022) · SN Computer Science · doi:10.1007/s42979-021-00958-1 · Cited by 303
Fuzzy logic applied to opinion mining: A review
Serrano-Guerrero, J., Romero, F. P., & Olivas, J. A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107018 · Cited by 141
Metadata
- Authors
- Basiri, M. E., Nemati, S., Abdar, M., Cambria, E., & Acharya, U. R.
- Venue
- Future Generation Computer Systems
- Publisher
- Elsevier BV
- Published
- 2021-02
- Volume
- 115
- Pages
- 279-294
- ISSN
- 0167-739X (ISSN-L)
- OpenAlex
- W3081987387
- Cited by
- 745
- References
- 80
- FWCI
- 44.04
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
