Attention-based LSTM for Aspect-level Sentiment Classification
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Aspect-level sentiment classification is a finegrained task in sentiment analysis.Since it provides more complete and in-depth results, aspect-level sentiment analysis has received much attention these years.In this paper, we reveal that the sentiment polarity of a sentence is not only determined by the content but is also highly related to the concerned aspect.For instance, "The appetizers are ok, but the service is slow.",for aspect taste, the polarity is positive while for service, the polarity is negative.Therefore, it is worthwhile to explore the connection between an aspect and the content of a sentence.To this end, we propose an Attention-based Long Short-Term Memory Network for aspect-level sentiment classification.The attention mechanism can concentrate on different parts of a sentence when different aspects are taken as input.We experiment on the SemEval 2014 dataset and results show that our model achieves state-ofthe-art performance on aspect-level sentiment classification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“While these methods are widely adopted [24, 43, 49, 75], alternative approaches may provide more benefit to team performance.”
From Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance (2021) · cites this paper as [75]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 3×
“…et al., 2011; Dong et al., 2014; Qian et al., 2015), Recursive Neural Tensor Network (Socher et al., 2013), Recurrent Neural Network (Mikolov et al., 2010; Tang et al., 2015b), LSTM (Hochreiter and Schmidhuber, 1997) and Tree-LSTMs (Tai et al., 2015) were applied into sentiment analysis currently.”
BackgroundMethodGlove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · cited 1×
“In our experiments, all word vectors are initialized by Glove1 (Pennington et al., 2014).”
MethodDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213 · cited 2×
“Attention has become an effective mechanism to obtain superior results, as demonstrated in image recognition (Mnih et al., 2014), machine translation (Bahdanau et al., 2014), reasoning about entailment (Rockt¨aschel et al., 2015) and sentence summarization (Rush et al., 2015).”
Background(2010) · Cited by 8,261
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · cited 3×
“, 2015), Recursive Neural Tensor Network (Socher et al., 2013), Recurrent Neural Network (Mikolov et al.”
BackgroundMethodRecurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · neural information processing systems · Cited by 4,489
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401 · cited 2×
“Neural networks have achieved state-of-the-art performance in a variety of NLP tasks such as machine translation (Lample et al., 2016), paraphrase identification (Yin et al., 2015), question answering (Golub and He, 2016) and text summarization (Rush et al., 2015).”
BackgroundSentiment Analysis and Opinion Mining
Liu, B. (2012) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02145-9 · Cited by 3,281 · cited 1×
“Sentiment analysis (Nasukawa and Yi, 2003), also known as opinion mining (Liu, 2012), is a key NLP task that receives much attention these years.”
Background
Research works printed but not linked: 1
- Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Cor- rado, and Jeff Dean. 2013. Distributed representa- tions of words and phrases and their compositional- ity. In Advances in Neural Information Processing Systems, pages 3111-3119.
Cited by
Items 201–300 of 1,003
Transferable End-to-End Aspect-based Sentiment Analysis with Selective Adversarial Learning
Li, Z., Li, X., Wei, Y., Bing, L., Zhang, Y., & Yang, Q. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1466 · Cited by 128
Context-Guided BERT for Targeted Aspect-Based Sentiment Analysis
Wu, Z., & Ong, D. C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17659 · Cited by 116
Zhang, D., Song, K., Wang, Q., He, Y., Wen, X., & Yan, Y. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3045196 · Cited by 103
Incorporating Dynamic Semantics into Pre-Trained Language Model for Aspect-based Sentiment Analysis
Zhang, K., Zhang, K., Zhang, M., Zhao, H., Liu, Q., Wu, W., & Chen, E. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.285 · Cited by 117
“• Attention-based Models: MemNet (Tang et al., 2016), ATAE-LSTM (Wang et al., 2016), IAN (Ma et al., 2017), AOA (Huang et al., 2018), MGNet (Fan et al., 2018), TNet (Li et al., 2018).”
BackgroundInfluentialImproving aspect-based sentiment analysis with Knowledge-aware Dependency Graph Network
Wu, H., Huang, C., & Deng, S. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.12.004 · Cited by 106
“Low-Resource” Text Classification: A Parameter-Free Classification Method with Compressors
Jiang, Z., Yang, M., Tsirlin, M., Tang, R., Dai, Y., & Lin, J. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.426 · Cited by 157
“To better capture the important information regardless of position, Wang et al. (2016) incorporate the attention mechanism into the relation classification.”
BackgroundMethodCharge-Based Prison Term Prediction with Deep Gating Network
Chen, H., Cai, D., Dai, W., Dai, Z., & Ding, Y. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1667 · Cited by 125
“1 To show the effectiveness of the proposed approach, we compare it with several strong baselines adapted from aspect-based sentiment classification (Wang et al., 2016; Tang et al., 2016; Chen et al., 2017; Li et al., 2018).”
MethodSelf-Attention-Based BiLSTM Model for Short Text Fine-Grained Sentiment Classification
Xie, J., Chen, B., Gu, X., Liang, F., & Xu, X. (2019) · IEEE Access · doi:10.1109/access.2019.2957510 · Cited by 110
“proposed attention-based LSTM and attention-based LSTM with aspect embedding [17].”
BackgroundSentiment Analysis and Opinion Mining
Zong, C., Xia, R., & Zhang, J. (2021) · Springer eBooks · doi:10.1007/978-981-16-0100-2_8 · Cited by 104
Attention-based aspect sentiment classification using enhanced learning through cnn-Bilstm networks
Ayetiran, E. F. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109409 · Cited by 98
CAN: Constrained Attention Networks for Multi-Aspect Sentiment Analysis
Hu, M., Zhao, S., Zhang, L., Cai, K., Su, Z., Cheng, R., & Shen, X. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1467 · Cited by 112
“To name a few, (Wang et al., 2016) proposes attention-based LSTMs for aspect level sentiment classifi-cation.”
BackgroundMethodInfluentialLiang, Y., Meng, F., Zhang, J., Chen, Y., Xu, J., & Zhou, J. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.05.028 · Cited by 104
Aspect sentiment analysis with heterogeneous graph neural networks
Lu, G., Li, J., & Wei, J. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.102953 · Cited by 96
Explaining Explanations: Axiomatic Feature Interactions for Deep Networks
Janizek, J. D., Sturmfels, P., & Lee, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.04138 · Cited by 37
“Some previous work has suggested looking at the internal weights of the attention mechanisms in attention-based models [21, 40, 42, 79].”
BackgroundAspect Based Sentiment Analysis With Feature Enhanced Attention CNN-BiLSTM
Meng, W., Wei, Y., Liu, P., Zhu, Z., & Yin, H. (2019) · IEEE Access · doi:10.1109/access.2019.2952888 · Cited by 98
“[33] proposed two attentionbased LSTM networks, namely AE-LSTM and ATAE-LSTM neural networks.”
BackgroundLatent Opinions Transfer Network for Target-Oriented Opinion Words Extraction
Wu, Z., Zhao, F., Dai, X., Huang, S., & Chen, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6469 · Cited by 107
Lan, Y.-T., Liu, W., & Lu, B. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207625 · Cited by 106
“in aspect-based sentiment analysis for reasoning [21].”
Chen, C., Hou, J., Shi, X., Yang, H. Q., Birchler, J. A., & Cheng, J. (2021) · BMC Bioinformatics · doi:10.1186/s12859-020-03952-1 · Cited by 105
“Recently, the concept of attention mechanism has achieved great success in neural machine translation [18] and sentiment analysis [19].”
BackgroundAspect-Level Drug Reviews Sentiment Analysis Based on Double BiGRU and Knowledge Transfer
Han, Y., Liu, M., & Jing, W. (2020) · IEEE Access · doi:10.1109/access.2020.2969473 · Cited by 99
“ATAE-LSTM [18]: It first models the sentence via a LSTM and appends the target embeddings with into each word embedding vector to represent the sentences.”
BackgroundMethodResultInfluentialTextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing
Wang, X., Liu, Q., Gui, T., Zhang, Q., Zou, Y., Zhou, X., Ye, J., Zhang, Y., Zheng, R., Pang, Z., et al. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: System Demonstrations · doi:10.18653/v1/2021.acl-demo.41 · Cited by 79
Aspect-level sentiment analysis with aspect-specific context position information
Huang, B., Guo, R., Zhu, Y., Fang, Z., Zeng, G., Liu, J., Wang, Y., Fujita, H., & Shi, Z. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108473 · Cited by 102
Self-citationMvP: Multi-view Prompting Improves Aspect Sentiment Tuple Prediction
Gou, Z., Guo, Q., & Yang, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.240 · Cited by 94
Dynamic Embedding Projection-Gated Convolutional Neural Networks for Text Classification
Tan, Z., Chen, J., Kang, Q., Zhou, M., Abusorrah, A. M., & Sedraoui, K. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3036192 · Cited by 100
ASAP: A Chinese Review Dataset Towards Aspect Category Sentiment Analysis and Rating Prediction
Bu, J., Ren, L., Zheng, S., Yang, Y., Wang, J., Zhang, F., & Wu, W. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.167 · Cited by 112
Gan, C., Wang, L., Zhang, Z., & Wang, Z. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.06.035 · Cited by 95
Target-attentional CNN for Radar Automatic Target Recognition with HRRP
Chen, J., Du, L., Guo, G., Yin, L., & Wei, D. (2022) · Signal Processing · doi:10.1016/j.sigpro.2022.108497 · Cited by 90
Deep learning for aspect-based sentiment analysis: a review
Zhu, L., Xu, M., Bao, Y., Xu, Y., & Kong, X. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.1044 · Cited by 102
“Wang et al. (2016a) obtained high-level features with dependency-tree based on RecNN and CRF, where information double propagated between aspect and opinion terms.”
Pham, D.-H., & Le, A.-C. (2018) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2018.08.003 · Cited by 92
Capsule Network with Interactive Attention for Aspect-Level Sentiment Classification
Du, C., Sun, H., Wang, J., Qi, Q., Liao, J., Xu, T., & Liu, M. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1551 · Cited by 97
“The attention mechanism is further introduced to model the target-context association (Wang et al., 2016b; Li et al., 2017; Ma et al., 2017).”
BackgroundMethodInfluentialDeepCropNet: a deep spatial-temporal learning framework for county-level corn yield estimation
Lin, T., Zhong, R., Wang, Y., Xu, J., Jiang, H., Xu, J., Ying, Y. B., Rodríguez, L. F., Ting, K. C., & Li, H. (2020) · Environmental Research Letters · doi:10.1088/1748-9326/ab66cb · Cited by 96
“Attention mechanism has shown its state-of-the-art performance in concentration on different parts of a sequence data both in natural language processing (Luong et al 2015, Wang et al 2016) and in image processing (Ba et al 2014, Mnih et al 2014).”
BackgroundSelf-citationKnowledge Guided Capsule Attention Network for Aspect-Based Sentiment Analysis
Zhang, B., Li, X., Xu, X., Leung, K.-C., Chen, Z., & Ye, Y. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.3017093 · Cited by 98
“Recently, several studies attempt to deal with ATSA problem based on deep learning methods [7], [8].”
BackgroundOn the Robustness of Aspect-based Sentiment Analysis: Rethinking Model, Data, and Training
Fei, H., Chua, T., Li, C., Ji, D., Zhang, M., & Ren, Y. (2022) · ACM Transactions on Information Systems · doi:10.1145/3564281 · Cited by 114
“(LSTM) models [30], Convolutional Neural Networks (CNN) [37], Attention mechanisms [72, 73], Graph Convolutional Networks (GCN) [75, 81] are the most notable deep learning methods that have been extensively adopted for sentiment analysis.”
BackgroundMethodInfluentialImproving the Accuracy of Pre-trained Word Embeddings for Sentiment AnalysisPreprint
Rezaeinia, S. M., Ghodsi, A., & Rahmani, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.08609 · Cited by 100
“Wang et al. [13] applied pre-trained GloVe vectors as inputs of attention-based LSTMs model for aspect-level sentiment analysis.”
MethodEnhancing Arabic aspect-based sentiment analysis using deep learning models
Al-Dabet, S., Tedmori, S., & AL-Smadi, M. (2021) · Computer Speech & Language · doi:10.1016/j.csl.2021.101224 · Cited by 92
SentiPrompt: Sentiment Knowledge Enhanced Prompt-Tuning for Aspect-Based Sentiment AnalysisPreprint
Li, C., Gao, F., Bu, J., Xu, L., Chen, X., Gu, Y., Shao, Z., Zheng, Q., Zhang, N., Wang, Y., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.08306 · Cited by 106
Self-citationSentiment-aware multimodal pre-training for multimodal sentiment analysis
Ye, J., Zhou, J., Tian, J., Wang, R., Zhou, J., Gui, T., Zhang, Q., & Huang, X. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110021 · Cited by 98
Extractive Summarization Using Multi-Task Learning with Document Classification
Isonuma, M., Fujino, T., Mori, J., Matsuo, Y., & Sakata, I. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1223 · Cited by 86
LSTM, VADER and TF-IDF based Hybrid Sentiment Analysis Model
Chiny, M., Chihab, M., Bencharef, O., & Chihab, Y. (2021) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2021.0120730 · Cited by 105
Examining Attention Mechanisms in Deep Learning Models for Sentiment Analysis
Kardakis, S., Perikos, I., Grivokostopoulou, F., & Hatzilygeroudis, I. (2021) · Applied Sciences · doi:10.3390/app11093883 · Cited by 100
“,24].”
MethodMughal, N., Mujtaba, G., Shaikh, S., Kumar, A., & Daudpota, S. M. (2024) · IEEE Access · doi:10.1109/access.2024.3386969 · Cited by 100
“Inthisstudy, we used three variations of LSTM-based models to establish the baseline results for all the datasets namely, LSTM with aspect embedding (AE-LSTM) [68], Attention-based LSTM (AT-LSTM) [69], Attention-based LSTM with Aspect embedding(ATAE-LSTM) [69].”
MethodInfluentialSyntax-Aware Graph Attention Network for Aspect-Level Sentiment Classification
Huang, L., Sun, X., Li, S., Zhang, L., & Wang, H. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.69 · Cited by 104
“Semantic-based models (Wang et al., 2016; Ma et al., 2017; He et al., 2018; Song et al., 2019) usually use the attention mechanism to capture and amplify the key semantic information of sentences and aspects.”
BackgroundSolving Aspect Category Sentiment Analysis as a Text Generation Task
Liu, J., Teng, Z., Cui, L., Liu, H., & Zhang, Y. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.361 · Cited by 103
Deep Learning Approach for Aspect-Based Sentiment Classification: A Comparative Review
Trisna, K. W., & Jie, H. J. (2022) · Applied Artificial Intelligence · doi:10.1080/08839514.2021.2014186 · Cited by 90
Quantum-Inspired Interactive Networks for Conversational Sentiment Analysis
Zhang, Y., Li, Q., Song, D., Zhang, P., & Wang, P. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/755 · Cited by 84
Learning interaction dynamics with an interactive LSTM for conversational sentiment analysis
Zhang, Y., Tiwari, P., Song, D., Mao, X., Wang, P., Li, X., & Pandey, H. M. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.10.001 · Cited by 88
Zhu, X., Zhu, L., Guo, J., Liang, S., & Dietze, S. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115712 · Cited by 88
Self-citationJin, W., Zhao, B., Zhang, L., Liu, C., & Yu, H. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2022.103260 · Cited by 84
Sentiment classification using bidirectional LSTM-SNP model and attention mechanism
Huang, Y., Liu, Q., Peng, H. J., Wang, J., Yang, Q., & Orellana-Martín, D. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.119730 · Cited by 91
Time series prediction of sea surface temperature based on BiLSTM model with attention mechanism
Zrira, N., Kamal-Idrissi, A., Farssi, R., & Khan, H. A. (2024) · Journal of Sea Research · doi:10.1016/j.seares.2024.102472 · Cited by 91
Emo2Vec: Learning Generalized Emotion Representation by Multi-task Training
Xu, P., Madotto, A., Wu, C.-S., Park, J. H., & Fung, P. (2018) · Proceedings of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis · doi:10.18653/v1/w18-6243 · Cited by 83
“Aspect-based sentiment (Chen et al., 2017; Wang et al., 2016) is also a hot topic where researchers care more about the sentiment towards a certain target.”
BackgroundThe state-of-the-art in expert recommendation systems
Nikzad-Khasmakhi, N., Balafar, M. A., & Feizi‐Derakhshi, M. (2019) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2019.03.020 · Cited by 90
Realtime mobile bandwidth and handoff predictions in 4G/5G networks
Mei, L., Gou, J., Cai, Y., Cao, H., & Liu, Y. (2022) · Computer Networks · doi:10.1016/j.comnet.2021.108736 · Cited by 102
Human-Level Interpretable Learning for Aspect-Based Sentiment Analysis
Yadav, R. K., Jiao, L., Granmo, O., & Goodwin, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17671 · Cited by 110
“• ATAE-BiLSTM is an attention-based LSTM with Aspect Embedding model (Wang et al. 2016).”
MethodDeep Attention Diffusion Graph Neural Networks for Text Classification
Liu, Y., Guan, R., Giunchiglia, F., Liang, Y., & Feng, X. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.642 · Cited by 121
“, 2016) and attention-based long short-term memory (LSTM) networks (Wang et al., 2016).”
BackgroundMethodImproving the prediction of continuous integration build failures using deep learning
Saidani, I., Ouni, A., & Mkaouer, M. W. (2022) · Automated Software Engineering · doi:10.1007/s10515-021-00319-5 · Cited by 96
“2013), classification (Athiwaratkun and Stokes 2017; Wang et al. 2016; Graves and Schmidhuber 2005) and many other real-world problems (Bouktif et al.”
BackgroundSadr, H., Pedram, M. M., & Teshnehlab, M. (2019) · Neural Processing Letters · doi:10.1007/s11063-019-10049-1 · Cited by 82
Modeling Inter-Aspect Dependencies for Aspect-Based Sentiment Analysis
Hazarika, D., Poria, S., Vij, P., Krishnamurthy, G., Cambria, E., & Zimmermann, R. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-2043 · Cited by 82
“To further guide the attention process the model incorporates aspect information at the word-level by concatenating aspect representations with each word (Wang et al., 2016).”
BackgroundMethodResultInfluentialAspect-level Sentiment Analysis using AS-Capsules
Wang, Y., Sun, A., Huang, M., & Zhu, X. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313750 · Cited by 87
“Attention mechanism has shown to be effective in many applications including machine translation [2, 43], sentiment analysis [40, 44], summarization [33], and more.”
BackgroundMethodInfluentialSelf-citationLu, Y., & Li, H. (2019) · Applied Sciences · doi:10.3390/app9081599 · Cited by 90
“Therefore, we proposed a hybrid neural network architecture combining CNN and attention-based LSTM to learn the hidden correlation in spatiotemporal information [15] and used the weights of attention to express the importance of keyframes.”
MethodTarget-adaptive Graph for Cross-target Stance Detection
Liang, B., Fu, Y., Gui, L., Yang, M., Du, J., He, Y., & Xu, R. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3449790 · Cited by 119
“Comparatively, models that considering target information (ATT-LSTM and ASGCN) perform slightly better, since they explicitly incorporate the target information into the sentence representation.”
BackgroundInfluentialPhan, H. T., Nguyên, N. T., & Hwang, D. (2022) · Information Sciences · doi:10.1016/j.ins.2021.12.127 · Cited by 82
Novel architecture for long short-term memory used in question classification
Xia, W., Zhu, W. Q., Liao, B., Chen, M., Cai, L., & Huang, L. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.03.020 · Cited by 86
Liu, G., Tian, L., & Zhou, W. (2021) · International Journal of Neural Systems · doi:10.1142/s0129065721500519 · Cited by 89
Aspect based sentiment analysis using deep learning approaches: A survey
Chauhan, G. S., Nahta, R., Meena, Y. K., & Gopalani, D. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100576 · Cited by 96
User personality prediction based on topic preference and sentiment analysis using LSTM model
Zhao, J., Zeng, D., Xiao, Y., Che, L., & Wang, M. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2020.07.035 · Cited by 80
Aspect-level sentiment classification based on attention-BiLSTM model and transfer learning
Xu, G., Zhang, Z., Zhang, T., Yu, S., Meng, Y., & Chen, S. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108586 · Cited by 85
Aspect-based Sentiment Classification with Aspect-specific Graph Convolutional NetworksPreprint
Zhang, C., Li, Q., & Song, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.03477 · Cited by 92
“…attention mechanism coupled with Recurrent Neural Networks (RNNs) (Bahdanau et al., 2014; Luong et al., 2015; Xu et al., 2015) starts to play a critical role in more recent models (Wang et al., 2016; Tang et al., 2016b; Yang et al., 2017; Liu and Zhang, 2017; Ma et al., 2017; Huang et al., 2018).”
BackgroundMa, X., Zeng, J., Peng, L., Fortino, G., & Zhang⋆, Y. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2018.10.041 · Cited by 84
Power Load Forecasting Using BiLSTM-Attention
Du, J., Cheng, Y., Zhou, Q., Zhang, J., Zhang, X., & Li, G. (2020) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/440/3/032115 · Cited by 79
“Graves [24] proposed a Bi-LSTM based on LSTM.”
BackgroundAspect-Based Sentiment Analysis With Heterogeneous Graph Neural Network
An, W., Tian, F., Chen, P., & Zheng, Q. (2022) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2022.3148866 · Cited by 83
“2) ABSA Models: AT-LSTM [5] is an attention-based LSTM model for the ACSA task, which can capture relationships between sentences and given aspect categories.”
MethodInfluentialAggregated graph convolutional networks for aspect-based sentiment classification
Zhao, M., Yang, J., Zhang, J., & Wang, S. (2022) · Information Sciences · doi:10.1016/j.ins.2022.03.082 · Cited by 83
Deep learning in hospitality and tourism: a research framework agenda for future research
Essien, A. E., & Chukwukelu, G. (2022) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-09-2021-1176 · Cited by 84
Multi-level Attention Map Network for Multimodal Sentiment Analysis
Xue, X., Zhang, C., Niu, Z., & Wu, X. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3155290 · Cited by 106
Sentiment Analysis: Comprehensive Reviews, Recent Advances, and Open Challenges
Lu, Q., Sun, X., Long, Y., Gao, Z., Feng, J. H., & Sun, T. S. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3294810 · Cited by 89
“Therefore, Wang et al. [41] first introduced the attention mechanism into aspect-based sentiment classification.”
BackgroundPolyNC: a natural and chemical language model for the prediction of unified polymer properties
Qiu, H., Liu, L., Qiu, X., Dai, X., Ji, X., & Sun, Z. (2023) · Chemical Science · doi:10.1039/d3sc05079c · Cited by 77
Generalizing sentiment analysis: a review of progress, challenges, and emerging directions
Alahmadi, K., Alharbi, S., Chen, J., & Wang, X. (2025) · Social Network Analysis and Mining · doi:10.1007/s13278-025-01461-8 · Cited by 97
“Hybrid models, such as CNN-LSTM (Chen et al. 2018) and attention-based LSTMs like ATAE-LSTM (Wang et al. 2016), further enhanced classification accuracy by combining local feature extraction with sequential and context-aware processing.”
Automated essay scoring using efficient transformer-based language modelsPreprint
Ormerod, C. M., Malhotra, A., & Jafari, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.13136 · Cited by 89
Attention and Lexicon Regularized LSTM for Aspect-based Sentiment Analysis
Bao, L., Lambert, P., & Badía, T. (2019) · Annual Meeting of the Association for Computational Linguistics: Student Research Workshop (ACL SRW) · doi:10.18653/v1/p19-2035 · Cited by 76
“In our experiments, we replicate AT-LSTM proposed by Wang et al. (2016) as our baseline sys-tem.”
BackgroundMethodInfluentialConvLSTMConv network: a deep learning approach for sentiment analysis in cloud computing
Ghorbani, M., Bahaghighat, M., Xin, Q., & Özen, F. (2020) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-020-00162-1 · Cited by 87
“Some problems, such as gradient vanishing and exploding problems in the standard RNN was a reason to develop the LSTM model as a good solution [46].”
BackgroundCompound–protein interaction prediction by deep learning: Databases, descriptors and models
Du, B.-X., Qin, Y., Jiang, Y.-F., Xu, Y., Yiu, S.-M., Yu, H., & Shi, J.-Y. (2022) · Drug Discovery Today · doi:10.1016/j.drudis.2022.02.023 · Cited by 73
Yang, H., Zhao, Y., & Qin, B. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.219 · Cited by 114
“Early works on aspect-based sentiment analysis only focused on the text (Wang et al., 2016; Xue and Li, 2018; Hu et al., 2019; Zhu et al., 2019; Li et al., 2020).”
BackgroundLi, X., Cui, M., Li, J., Bai, R., Lu, Z., & Aickelin, U. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.02.069 · Cited by 83
“Wang et al. [35] proposed an attention-based LSTM method with target embedding, which was proven to be an e ff ective way to enforce the neural model to attend to the related part of a sentence.”
MethodHe, Y., Chen, L., Gao, Y., Ma, J., Xu, Y., & Zhu, Q. (2021) · ISA Transactions · doi:10.1016/j.isatra.2021.08.030 · Cited by 77
Seq2Path: Generating Sentiment Tuples as Paths of a Tree
Mao, Y., Shen, Y., Yang, J., Zhu, X., & Cai, L. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.174 · Cited by 75
“…is to extract aspect terms (Liu et al., 2015; Yin et al., 2016; Li et al., 2018; Ma et al., 2019) and categorize the sentiment of a given aspect (Wang et al., 2016; Chen et al., 2017; Jiang et al., 2019; Zhang and Qian, 2020), and to jointly predict multiple elements simultaneously at the same…”
BackgroundSelf-citationAttention-based CNN–LSTM for high-frequency multiple cryptocurrency trend prediction
Peng, P., Chen, Y., Lin, W., & Wang, J. Z. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121520 · Cited by 75
Semi-supervised Aspect-level Sentiment Classification Model based on Variational Autoencoder
Fu, X., Wei, Y., Xu, F., Wang, T., Lu, Y., Li, J., & Huang, J. Z. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.02.008 · Cited by 77
A data-centric review of deep transfer learning with applications to text data
Bashath, S., Perera, N., Tripathi, S., Manjang, K., Dehmer, M., & Emmert‐Streib, F. (2021) · Information Sciences · doi:10.1016/j.ins.2021.11.061 · Cited by 86
“Attention mechanisms have been effectively applied in various applications such as relation classification and sentiment classification [126].”
MethodResearch on sentiment classification for netizens based on the BERT-BiLSTM-TextCNN model
Jiang, X., Song, C., Xu, Y., Li, Y., & Peng, Y. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.1005 · Cited by 74
“To improve the training speed and reduce the cost, Wang et al. (2016) proposed a memory network classi fi cation based on attention for long-term and short-term aspect-oriented sentiments and classi fi ed sentiments based on long short-term memory (LSTM) networks.”
BackgroundChallenges and Issues in Sentiment Analysis: A Comprehensive Survey
Raghunathan, N., & Kandasamy, S. (2023) · IEEE Access · doi:10.1109/access.2023.3293041 · Cited by 84
“Attention mechanisms are used among various neural networks to extract specific contexts in some studies [124], [126], [127].”
BackgroundA novel network with multiple attention mechanisms for aspect-level sentiment analysis
Wang, X., Tang, M., Yang, T., & Wang, Z. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107196 · Cited by 80
Detecting ethnicity-targeted hate speech in Russian social media texts
Pronoza, E., Panicheva, P., Koltsova, O. Y., & Rosso, P. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102674 · Cited by 84
LiSHT: Non-parametric Linearly Scaled Hyperbolic Tangent Activation Function for Neural Networks
Roy, S. K., Manna, S., Dubey, S. R., & Chaudhuri, B. B. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-31407-0_35 · Cited by 84
García-Díaz, J. A., Cánovas-García, M., & Valencia‐García, R. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.06.019 · Cited by 80
“[49] performed aspect-based sentiment classification by applying LSTM in order to connect different parts of the texts when different aspects are taken as input.”
Spatiotemporal Attention for Multivariate Time Series Prediction and Interpretation
Gangopadhyay, T., Tan, S. Y., Jiang, Z., Meng, R., & Sarkar, S. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413914 · Cited by 86
“Various attention mechanisms have been proposed and popularly applied to different deep sequence models, such as RNN, GRU, and LSTM [28, 29].”
MethodA hierarchical contextual attention-based network for sequential recommendation
Cui, Q., Wu, S., Huang, Y., & Wang, L. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.04.073 · Cited by 74
“This is inspired by some works in NLP tasks, like recognizing textual entailment [35] and aspect-level sentiment classification [36] . where E ∈ R d × d and F ∈ R d × d are embedding matrices. h t o is the user’s current overall interest.”
MethodPersonalized Review Generation By Expanding Phrases and Attending on Aspect-Aware Representations
Ni, J., & McAuley, J. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-2112 · Cited by 93
“, 2014), and aspectaware sentiment analysis (Wang et al., 2016; McAuley et al., 2012).”
BackgroundMAN: Mutual Attention Neural Networks Model for Aspect-Level Sentiment Classification in SIoT
Jiang, N., Tian, F., Li, J., Yuan, X., & Zheng, J. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2963927 · Cited by 74
“3) AE-LSTM and ATAE-LSTM [20]: They use the embed-”
MethodHate Speech Detection in Twitter using Transformer Methods
Mutanga, R. T., Naicker, N., & O, O. (2020) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2020.0110972 · Cited by 68
“Attention-based models have been investigated with success in text-related tasks [19-21].”
BackgroundAspect Sentiment Classification with Aspect-Specific Opinion Spans
Xu, L. T., Bing, L., Lu, W., & Huang, F. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.288 · Cited by 82
Text Graph Transformer for Document Classification
Zhang, H., & Zhang, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.668 · Cited by 94
“…researchers applied CNN (Kim, 2014; Zhang et al., 2015), LSTM (Tai et al., 2015; Liu et al., 2016), word embedding techniques (Joulin et al., 2016; Pennington et al., 2014), attention mechanism (Yang et al., 2016; Wang et al., 2016) in text classification models and kept improving accuracy.”
Method
Metadata
- Authors
- Wang, Y., Huang, M., zhu, X., & Zhao, L.
- Affiliations
- State Key Laboratory of Intelligent Technology and Systems (CN)
- Venue
- Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing
- Published
- 2016
- Pages
- 606-615
- OpenAlex
- W2562607067
- Cited by
- 2,450
- References
- 33
- Citations by year
- 2026: 108 · 2025: 179 · 2024: 272 · 2023: 332 · 2022: 356 · 2021: 401 · 2020: 343 · 2019: 285 · 2018: 134 · 2017: 28
- FWCI
- 80.28
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- Funders
- National Natural Science Foundation of China (2012CB316301, 973 Program, 2013CB329403, 61272227, 61332007)
- Tsinghua University
- Samsung
- Beijing Higher Education Young Elite Teacher Project
- National Key Research and Development Program of China (2012CB316301, 61332007, 2013CB329403)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
- Keywords
- aspect-based sentiment analysis, attention mechanism, long short-term memory, sentiment polarity, SemEval-2014, fine-grained sentiment analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.