Attention-based LSTM for Aspect-level Sentiment Classification
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Aspect-level sentiment classification is a finegrained task in sentiment analysis.Since it provides more complete and in-depth results, aspect-level sentiment analysis has received much attention these years.In this paper, we reveal that the sentiment polarity of a sentence is not only determined by the content but is also highly related to the concerned aspect.For instance, "The appetizers are ok, but the service is slow.",for aspect taste, the polarity is positive while for service, the polarity is negative.Therefore, it is worthwhile to explore the connection between an aspect and the content of a sentence.To this end, we propose an Attention-based Long Short-Term Memory Network for aspect-level sentiment classification.The attention mechanism can concentrate on different parts of a sentence when different aspects are taken as input.We experiment on the SemEval 2014 dataset and results show that our model achieves state-ofthe-art performance on aspect-level sentiment classification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“While these methods are widely adopted [24, 43, 49, 75], alternative approaches may provide more benefit to team performance.”
From Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance (2021) · cites this paper as [75]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 3×
“…et al., 2011; Dong et al., 2014; Qian et al., 2015), Recursive Neural Tensor Network (Socher et al., 2013), Recurrent Neural Network (Mikolov et al., 2010; Tang et al., 2015b), LSTM (Hochreiter and Schmidhuber, 1997) and Tree-LSTMs (Tai et al., 2015) were applied into sentiment analysis currently.”
BackgroundMethodGlove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · cited 1×
“In our experiments, all word vectors are initialized by Glove1 (Pennington et al., 2014).”
MethodDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213 · cited 2×
“Attention has become an effective mechanism to obtain superior results, as demonstrated in image recognition (Mnih et al., 2014), machine translation (Bahdanau et al., 2014), reasoning about entailment (Rockt¨aschel et al., 2015) and sentence summarization (Rush et al., 2015).”
Background(2010) · Cited by 8,261
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · cited 3×
“, 2015), Recursive Neural Tensor Network (Socher et al., 2013), Recurrent Neural Network (Mikolov et al.”
BackgroundMethodRecurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · neural information processing systems · Cited by 4,489
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401 · cited 2×
“Neural networks have achieved state-of-the-art performance in a variety of NLP tasks such as machine translation (Lample et al., 2016), paraphrase identification (Yin et al., 2015), question answering (Golub and He, 2016) and text summarization (Rush et al., 2015).”
BackgroundSentiment Analysis and Opinion Mining
Liu, B. (2012) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02145-9 · Cited by 3,281 · cited 1×
“Sentiment analysis (Nasukawa and Yi, 2003), also known as opinion mining (Liu, 2012), is a key NLP task that receives much attention these years.”
Background
Research works printed but not linked: 1
- Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Cor- rado, and Jeff Dean. 2013. Distributed representa- tions of words and phrases and their compositional- ity. In Advances in Neural Information Processing Systems, pages 3111-3119.
Cited by
Sarker, I. H. (2021) · SN Computer Science · doi:10.1007/s42979-021-00815-1 · Cited by 2,678
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2840738 · Cited by 2,921
Graph Convolutional Networks for Text Classification
Yao, L., Mao, C., & Luo, Y. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017370 · Cited by 1,983
Deep learning for sentiment analysis: A survey
Zhang, L., Wang, S., & Liu, B. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1253 · Cited by 1,928
“Wang et al. 73 proposed an attention-based LSTM method with target embedding, which was proven to be an effective way to enforce the neural model to attend to the related part of a sentence.”
MethodDeep learning for smart manufacturing: Methods and applications
Wang, J., Ma, Y., Zhang, L., Gao, R. X., & Wu, D. (2018) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2018.01.003 · Cited by 1,740
Interactive Attention Networks for Aspect-Level Sentiment Classification
Ma, D., Li, S., Zhang, X., & Wang, H. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/568 · Cited by 1,069
“After that, the average value of all the hidden states is regarded as final representation and fed to a softmax function to estimate the probability of each sentiment label [ Wang et al. , 2016 ] .”
BackgroundMethodInfluentialRecurrent Attention Network on Memory for Aspect Sentiment Analysis
Chen, P., Sun, Z., Bing, L., & Yang, W. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1047 · Cited by 995
“Single attention based methods (e.g. (Wang et al., 2016)) are also not capable to overcome such difficulty, because attending multiple words with one attention may hide the characteristic of each attended word.”
BackgroundMethodInfluentialQuantifying Attention Flow in Transformers
Abnar, S., & Zuidema, W. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.385 · Cited by 995
An Attentive Survey of Attention Models
Chaudhari, S., Mithal, V., Polatkan, G., & Ramanath, R. (2021) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3465055 · Cited by 689
Sentiment analysis using deep learning architectures: a review
Yadav, A., & Vishwakarma, D. K. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09794-5 · Cited by 841
“Applications CNN Wang et al. (2016b), Tang et al. (2015b) and Do et al. (2019) Learn the generalizable features across speakers for multimodal data (Wang et al. 2016) Capture the local semantics of n-grams of various granularities, which are proven powerful for sentiment classification (Tang et al.…”
BackgroundThe Risk of Racial Bias in Hate Speech Detection
Sap, M., Card, D., Gabriel, S., Choi, Y., & Smith, N. A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1163 · Cited by 817
“Using a basic neural attention architecture (Wang et al., 2016; Yang et al., 2016), we train a classifier initialized with GloVe vectors (Penning-ton et al., 2014) to minimize the cross-entropy of the annotated class conditional on text, x : with h = f ( x ) , where f is a BiLSTM with attention,…”
MethodAspect-based Sentiment Classification with Aspect-specific Graph Convolutional Networks
Zhang, C., Li, Q., & Song, D. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1464 · Cited by 712
“…attention mechanism coupled with Recurrent Neural Networks (RNNs) (Bahdanau et al., 2014; Luong et al., 2015; Xu et al., 2015) starts to play a critical role in more recent models (Wang et al., 2016; Tang et al., 2016b; Yang et al., 2017; Liu and Zhang, 2017; Ma et al., 2017; Huang et al., 2018).”
BackgroundA Survey on Text Classification: From Traditional to Deep Learning
Li, Q., Peng, H., Li, J., Xia, C., Yang, R., Sun, L., Yu, P. S., & He, L. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3495162 · Cited by 494
“ATAE-LSTM [194] can concentrate on different parts of each sentence according to the input through the attention mechanisms.”
BackgroundRelational Graph Attention Network for Aspect-based Sentiment Analysis
Wang, K., Shen, W., Yang, Y., Quan, X., & Wang, R. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.295 · Cited by 665
A General Survey on Attention Mechanisms in Deep Learning
Brauwers, G., & Frasincar, F. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3126456 · Cited by 695
“After Bahdanau et al. [3] emphasized the advantages of attention, the attention techniques were refined [4] and quickly became popular for a variety of tasks, such as text classification [5], [6], image captioning [7], [8], sentiment analysis [6], [9], and speech recognition [10], [11], [12].”
BackgroundDoes the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445717 · Cited by 757
“ghlights, where the interface highlights spans of text that are most salient to the model’s prediction directly in the input text, so the user need not go back and forth between input and explanation [18, 36, 42, 62]. Figure2shows one example beer review used in our study. We also experimented with a more challenging…”
BackgroundMethodInfluentialDoes the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. S. (2020) · arXiv · doi:10.48550/arxiv.2006.14779 · Cited by 754
“ghlights, where the interface highlights spans of text that are most salient to the model’s prediction directly in the input text, so the user need not go back and forth between input and explanation [18, 36, 42, 62]. Figure2shows one example beer review used in our study. We also experimented with a more challenging…”
BackgroundMethodInfluentialSun, C., Huang, L., & Qiu, X. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-1035 · Cited by 235
“The earliest work on (T)ABSA relied heavily on feature engineering (Wagner et al., 2014; Kiritchenko et al., 2014), and subsequent neural network-based methods (Nguyen and Shirai, 2015; Wang et al., 2016; Tang et al., 2015, 2016; Wang et al., 2017) achieved higher accuracy.”
BackgroundMethodAttention in Natural Language Processing
Galassi, A., Lippi, M., & Torroni, P. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3019893 · Cited by 635
A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challenges
Zhang, W., Li, X., Deng, Y., Bing, L., & Lam, W. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3230975 · Cited by 567
Serrano, S., & Smith, N. A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1282 · Cited by 690
“Since attention calculates a distribution over inputs, prior work has used attention as a tool for interpretation of model decisions (Wang et al., 2016; Lee et al., 2017; Lin et al., 2017; Ghaeini et al., 2018).”
MethodAn Introductory Review of Deep Learning for Prediction Models With Big Data
Emmert-Streib, F., Yang, Z., Feng, H., Tripathi, S., & Dehmer, M. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00004 · Cited by 604
“LSTM Network Structure With Forget Gate Figure 13 shows an unrolled structure of a LSTM network model (Wang et al., 2016).”
BackgroundDeep Learning for Aspect-Based Sentiment Analysis: A Comparative Review
Do, H. H., Prasad, P., Maag, A., & Alsadoon, A. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.10.003 · Cited by 614
Aspect Based Sentiment Analysis with Gated Convolutional Networks
Xue, W., & Li, T. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1234 · Cited by 755
Sentiment Analysis: Mining Opinions, Sentiments, and Emotions
Liu, B. (2015) · Cited by 656
Targeted Aspect-Based Sentiment Analysis via Embedding Commonsense Knowledge into an Attentive LSTM
Ma, Y., Peng, H., & Cambria, E. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12048 · Cited by 592
“…of deep learning in representation learning, many recent works (Dong et al. 2014; Lakkaraju, Socher, and Manning 2014; Nguyen and Shirai 2015; Wang et al. 2016) utilize deep neural networks to generate sentence embeddings (dense vector representation of sentences) which are then fed to a…”
BackgroundMethodAspect-based sentiment analysis via affective knowledge enhanced graph convolutional networks
Liang, B., Su, H., Gui, L., Cambria, E., & Xu, R. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107643 · Cited by 535
Multi-grained Attention Network for Aspect-Level Sentiment Classification
Fan, F., Feng, Y., & Zhao, D. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1380 · Cited by 520
“ATAE-LSTM (Wang et al., 2016) learns attention embeddings and combine them with the LSTM hidden states to predict the polarity.”
BackgroundMethodInfluentialExplainable Deep Learning: A Field Guide for the Uninitiated
Ras, G., Xie, N., Van Gerven, M., & Doran, D. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13200 · Cited by 446
Sentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2023) · Encyclopedia of Machine Learning and Data Science · doi:10.1007/978-1-4899-7502-7_907-2 · Cited by 518
Fault diagnosis of wind turbine based on Long Short-term memory networks
Lei, J., Liu, C., & Jiang, D. (2019) · Renewable Energy · doi:10.1016/j.renene.2018.10.031 · Cited by 507
Transformation Networks for Target-Oriented Sentiment Classification
Li, X., Bing, L., Lam, W., & Shi, B. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1087 · Cited by 603
“One method could be concatenating the target representation with each word representation, but the effect as shown in (Wang et al., 2016) is limited.”
BackgroundMethodInfluentialMulti-Modality Cross Attention Network for Image and Sentence Matching
Wei, X., Zhang, T., Li, Y., Zhang, Y., & Wu, F. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01095 · Cited by 451
“It has been widely applied to various visual and textual tasks, including image classification [53], object detection [47], image captioning [49], sentiment classification [45], neural machine translation [24, 39], sentence summarization [33], etc.”
MethodBaziotis, C., Pelekis, N., & Doulkeridis, C. (2017) · Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017) · doi:10.18653/v1/s17-2126 · Cited by 485
“Our model is comparable to the work of (Wang et al., 2016; Tang et al., 2015).”
ResultAspect-Level Sentiment Analysis Via Convolution over Dependency Tree
Sun, K., Zhang, R., Mensah, S., Mao, Y., & Liu, X. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1569 · Cited by 430
“Majority of recent works such as (Dong et al., 2014; Tang et al., 2015; Wang et al., 2016; Chen et al., 2017; Cheng et al., 2017) have exploited neural networks due to its ability to model representations for sentences automatically.”
BackgroundKnowing What, How and Why: A Near Complete Solution for Aspect-Based Sentiment Analysis
Peng, H., Xu, L., Bing, L., Huang, F., Lu, W., & Si, L. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6383 · Cited by 439
FNDNet – A deep convolutional neural network for fake news detection
Kaliyar, R. K., Goswami, A., Narang, P., & Sinha, S. (2020) · Cognitive Systems Research · doi:10.1016/j.cogsys.2019.12.005 · Cited by 453
Targeted Sentiment Classification with Attentional Encoder Network
Song, Y., Wang, J., Jiang, T., Liu, Z., & Rao, Y. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-30490-4_9 · Cited by 235
“There are already some studies use attention to generate targetspecific sentence representations (Wang et al., 2016; Ma et al., 2017; Chen et al., 2017) or to transform sentence representations according to target words (Li et al.”
BackgroundInfluentialTarget-Dependent Sentiment Classification With BERT
Gao, Z., Feng, A., Song, X., & Wu, X. (2019) · IEEE Access · doi:10.1109/access.2019.2946594 · Cited by 425
“[44] adopt attention mechanism to concentrate on corresponding parts of a sentence when different aspects are taken as input.”
BackgroundMethodInfluentialDual Graph Convolutional Networks for Aspect-based Sentiment Analysis
Li, R., Chen, H., Feng, F., Ma, Z., Wang, X., & Hovy, E. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.494 · Cited by 374
“To judge the sentiment of a particular aspect, previous studies (Wang et al., 2016; Tang et al., 2016a; Ma et al., 2017; Chen et al., 2017; Fan et al., 2018; Huang et al., 2018; Gu et al., 2018) have proposed various recurrent neural networks (RNNs) with attention mechanisms to generate aspect-specific sentence repres…”
BackgroundMethodInfluentialMultimodal Sentiment Analysis: A Survey of Methods, Trends, and Challenges
Das, R., & Singh, T. D. (2023) · ACM Computing Surveys · doi:10.1145/3586075 · Cited by 363
“[46] for aspect-based sentiment analysis to focus on the different aspects of the sentence.”
BackgroundSentiment Analysis: Mining Opinions, Sentiments, and Emotions
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286 · Cited by 362
Exploiting BERT for End-to-End Aspect-based Sentiment Analysis
Li, X., Bing, L., Zhang, W., & Lam, W. (2019) · Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019) · doi:10.18653/v1/d19-5505 · Cited by 348
“…sentiment analysis (ABSA) is to discover the users’ sentiment or opinion towards an aspect, usually in the form of explicitly mentioned aspect terms (Mitchell et al., 2013; Zhang et al., 2015) or implicit aspect categories (Wang et al., 2016), from user-generated natural language texts (Liu, 2012).”
BackgroundMethodIssues and Challenges of Aspect-based Sentiment Analysis: A Comprehensive Survey
Nazir, A., Rao, Y., Wu, L., & Sun, L. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.2970399 · Cited by 370
Aspect Level Sentiment Classification with Attention-over-Attention Neural Networks
Huang, B., Ou, Y., & Carley, K. M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93372-6_22 · Cited by 353
Dependency Graph Enhanced Dual-transformer Structure for Aspect-based Sentiment Classification
Tang, H., Ji, D., Li, C., & Zhou, Q. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.588 · Cited by 344
“…RNN augmented by attention mechanism (Bahdanau et al., 2015; Luong et al., 2015; Xu et al., 2015) is widely utilized in recent methods for exploring the potentially relevant words with respect to the given aspect (Yang et al., 2017; Zhang and Liu, 2017; Zeng et al., 2019; Wang et al., 2016).”
BackgroundMethodA Unified Generative Framework for Aspect-based Sentiment Analysis
Yan, H., Dai, J., Ji, T., Qiu, X., & Zhang, Z. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.188 · Cited by 298
An Efficient LSTM Network for Emotion Recognition From Multichannel EEG Signals
Du, X., Ma, C., Zhang, G., Li, J., Lai, Y.-K., Zhao, G., Deng, X., Liu, Y.-J., & Wang, H. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3013711 · Cited by 357
“, [42], [43], [44], [45], [46]), since it can for example locate the correct regions for image captioning or concentrate on the key part of a sentence given the aspect.”
BackgroundMethodSystematic reviews in sentiment analysis: a tertiary study
Ligthart, A., Catal, C., & Tekinerdogan, B. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-09973-3 · Cited by 303
Attention, please! A survey of neural attention models in deep learning
de Santana Correia, A., & Colombini, E. L. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10148-x · Cited by 298
Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Research
Poria, S., Hazarika, D., Majumder, N., & Mihalcea, R. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3038167 · Cited by 321
A Challenge Dataset and Effective Models for Aspect-Based Sentiment Analysis
Jiang, Q., Chen, L., Xu, R., Ao, X., & Yang, M. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1654 · Cited by 306
“(1) LSTM based models: TD LSTM (Tang et al., 2016a), AT LSTM (Wang et al., 2016), ATAE LSTM (Wang et al., 2016), BiLSTM enhanced with attention mechanism, IAN (Ma et al., 2017) and AOA LSTM (Huang et al., 2018); (2) CNN based model: GCAE (Xue and Li, 2018); (3) Attention based models: MemNet (Tang…”
BackgroundMethodInfluentialA Unified Model for Opinion Target Extraction and Target Sentiment Prediction
Li, X., Bing, L., Li, P., & Lam, W. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016714 · Cited by 338
Syntax-Aware Aspect Level Sentiment Classification with Graph Attention Networks
Huang, B., & Carley, K. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1549 · Cited by 299
“Wang et al. (2016) introduce the attention mechanism into this task (Bahdanau et al., 2014).”
BackgroundMethodInfluentialCo-LSTM: Convolutional LSTM model for sentiment analysis in social big data
Behera, R. K., Jena, M., Rath, S. K., & Misra, S. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2020.102435 · Cited by 320
Sentiment analysis based on improved pre-trained word embeddings
Rezaeinia, S. M., Rahmani, R., Ghodsi, A., & Veisi, H. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.08.044 · Cited by 325
Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentence
Sun, C. C., Huang, L., & Qiu, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.09588 · Cited by 340
“The earliest work on (T)ABSA relied heavily on feature engineering (Wagner et al., 2014; Kiritchenko et al., 2014), and subsequent neural network-based methods (Nguyen and Shirai, 2015; Wang et al., 2016; Tang et al., 2015, 2016; Wang et al., 2017) achieved higher accuracy.”
BackgroundMethodMultimodal sentiment analysis with word-level fusion and reinforcement learning
Chen, M., Wang, S., Liang, P. P., Baltrušaitis, T., Zadeh, A., & Morency, L.-P. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3136801 · Cited by 334
“We use an attention model similar to [37] to selectively combine temporal information from the input modalities by adaptively predicting the most important time steps towards sentiment of a video clip.”
MethodLi, W., Qi, F., Tang, M., & Yu, Z. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.01.006 · Cited by 318
A CNN-BiLSTM Model for Document-Level Sentiment Analysis
Rhanoui, M., Mikram, M., Yousfi, S., & Barzali, S. (2019) · Machine Learning and Knowledge Extraction · doi:10.3390/make1030048 · Cited by 300
“In future work, the proposed model can be adapted for Arabic documents [46], include attention mechanism for document-level sentiment analysis [47,48] and investigate other word embeddings such as Glove [49] and Fasttext [50].”
MethodAn Interactive Multi-Task Learning Network for End-to-End Aspect-Based Sentiment Analysis
He, R., Lee, W. S., Ng, H. T., & Dahlmeier, D. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1048 · Cited by 277
“For AS, we use ATAE-LSTM (denoted as ALSTM for short) (Wang et al., 2016b) and the model from (He et al., 2018b) which we denote as dTrans.”
MethodInfluentialSentic LSTM: a Hybrid Network for Targeted Aspect-Based Sentiment Analysis
Ma, Y., Peng, H., Khan, T., Cambria, E., & Hussain, A. (2018) · Cognitive Computation · doi:10.1007/s12559-018-9549-x · Cited by 309
“Moreover, the representation can be enhanced by using the attention mechanism [17], taking as input the word sequence and aspects.”
Attention-based Recurrent Convolutional Neural Network for Automatic Essay Scoring
Dong, F., Zhang, Y., & Yang, J. (2017) · Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017) · doi:10.18653/v1/k17-1017 · Cited by 277
“…calculate weights for convolution features of CNNs and hidden state values of LSTMs, which has been used for obtaining the most pertinent information for machine translation (Luong et al., 2015), sentiment analysis (Shin et al., 2016; Wang et al., 2016; Liu and Zhang, 2017) and other tasks.”
BackgroundMethodImage–text sentiment analysis via deep multimodal attentive fusion
Huang, F., Zhang, X., Zhao, Z., Xu, J., & Li, Z. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.01.019 · Cited by 296
Adapting BERT for Target-Oriented Multimodal Sentiment Classification
Yu, J., & Jiang, J. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/751 · Cited by 274
“AE-LSTM [Wang et al., 2016], incorporating aspect embeddings and target-specific attention mechanism; 3).”
Be More with Less: Hypergraph Attention Networks for Inductive Text Classification
Ding, K., Wang, J., Li, J., Li, D., & Liu, H. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.399 · Cited by 243
Textual Analysis in Accounting: What's Next?*
Bochkay, K., Brown, S. V., Leone, A. J., & Tucker, J. W. (2023) · Contemporary Accounting Research · doi:10.1111/1911-3846.12825 · Cited by 242
“Among deep learning models, CNN, LSTM, and transformers (e.g., BERT) can all perform various text classi fi cation tasks, including sentiment analysis (Zhang et al. 2015; Wang et al. 2016; Col (cid:1) on-Ruiz and Segura-Bedmar 2020).”
Sentiment Classification Using a Single-Layered BiLSTM Model
Hameed, Z., & Garcia-Zapirain, B. (2020) · IEEE Access · doi:10.1109/access.2020.2988550 · Cited by 269
“[24] utilized pre-trained GloVe vectors as inputs to the attentionbased LSTM network and achieved state-of-the-art results for aspect-level sentiment categorization.”
MethodGated Dual Attention Unit Neural Networks for Remaining Useful Life Prediction of Rolling Bearings
Qin, Y., Chen, D., Xiang, S., & Zhu, C. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2999442 · Cited by 271
“Attention mechanism has been applied to image identification [28], natural language processing [29], etc.”
Multimodal Sentiment Analysis With Image-Text Interaction Network
Zhu, T., Li, L., Yang, J., Zhao, S., Liu, H., & Qian, J. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3160060 · Cited by 247
“Considering that the concerned aspect is closely related to the sentiment polarity of a sentence, Wang et al. [29] introduced a LSTM network based on the attention mechanism to improve aspect-level sentiment classification.”
BackgroundMulti-Interactive Memory Network for Aspect Based Multimodal Sentiment Analysis
Xu, N., Mao, W., & Chen, G. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301371 · Cited by 252
“Existing work on aspect-level sentiment analysis is based on text modality (Wang et al. 2016; Tang, Qin, and Liu 2016; Ma et al. 2017; Chen et al. 2017).”
BackgroundMethodInfluentialAspect Sentiment Quad Prediction as Paraphrase Generation
Zhang, W., Deng, Y., Li, X., Yuan, Y., Bing, L., & Lam, W. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.726 · Cited by 212
“…2018; Ma et al., 2019), detecting the mentioned aspect category (Zhou et al., 2015; Bu et al., 2021), and predicting the sentiment polarity, given either an aspect term (Wang et al., 2016; Huang and Carley, 2018; Zhang and Qian, 2020) or an aspect category (Ruder et al., 2016; Hu et al., 2019a).”
BackgroundAl-Smadi, M., Talafha, B., Al-Ayyoub, M., & Jararweh, Y. (2019) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-018-0799-4 · Cited by 251
“Similar idea was presented in literature in the attention-based LSTM with aspect embedding (ATAE-LSTM) [80], the target-dependent LSTM, and target-connection LSTM [73].”
MethodOpen-Domain Targeted Sentiment Analysis via Span-Based Extraction and Classification
Hu, M., Peng, Y., Huang, Z., Li, D., & Lv, Y. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1051 · Cited by 223
Liao, L., Li, H., Shang, W., & Ma, L. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3506695 · Cited by 222
“1 INTRODUCTION In recent years, deep neural network (DNN) has achieved extraordinary performance1 over traditional machine learning models in solving many complex problems in various application domains, especially in natural language processing [85], computer vision [51], and gaming [63].”
BackgroundAspect-Based Sentiment Analysis: A Survey of Deep Learning Methods
Liu, H., Chatterjee, I., Zhou, M., Lu, X. S., & Abusorrah, A. (2020) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2020.3033302 · Cited by 231
“Wang et al. [43] proposed an ATAE-LSTM model to explore the connection between an aspect and the content of a sentence.”
BackgroundInfluentialTowards Generative Aspect-Based Sentiment Analysis
Zhang, W., Li, X., Deng, Y., Bing, L., & Lam, W. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · doi:10.18653/v1/2021.acl-short.64 · Cited by 209
“…on the identification of those sentiment elements such as extracting the aspect term (Liu et al., 2015; Yin et al., 2016; Li et al., 2018; Ma et al., 2019) or classifying the sentiment polarity for a given aspect (Wang et al., 2016; Chen et al., 2017; Jiang et al., 2019; Zhang and Qian, 2020).”
BackgroundA Review on Speech Emotion Recognition Using Deep Learning and Attention Mechanism
Lieskovská, E., Jakubec, M., Jarina, R., & Chmulík, M. (2021) · Electronics · doi:10.3390/electronics10101163 · Cited by 230
Entity-Sensitive Attention and Fusion Network for Entity-Level Multimodal Sentiment Classification
Yu, J., Jiang, J., & Xia, R. (2020) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2019.2957872 · Cited by 232
“1) Performance of ESTR (RQ1): To better show the effectiveness of our entity-sensitive textual representation model, we re-implemented the following pure text-oriented systems with the same parameter settings for comparison: Majority, a simple baseline method, which uses the majority sentiment label in the training se…”
MethodA Joint Training Dual-MRC Framework for Aspect Based Sentiment Analysis
Mao, Y., Shen, Y., Yu, C., & Cai, L. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i15.17597 · Cited by 218
Attention Modeling for Targeted Sentiment
Liu, J., & Zhang, Y. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers · doi:10.18653/v1/e17-2091 · Cited by 231
“For sentiment analysis, the attention mechanism has been applied to cross-lingual sentiment (Zhou et al., 2016), aspect-level sentiment (Wang et al., 2016) and user-oriented sentiment (Chen et al., 2016).”
MethodExploiting Document Knowledge for Aspect-level Sentiment Classification
He, R., Lee, W. S., Ng, H. T., & Dahlmeier, D. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2092 · Cited by 215
“Following previous work (Tang et al., 2016b; Wang et al., 2016), we remove samples with conflicting polarities in all datasets1.”
BackgroundMethodInfluentialTransfer Capsule Network for Aspect Level Sentiment Classification
Chen, Z., & Qian, T. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1052 · Cited by 218
“Settings We use Glove vectors with 840B to-kens (Pennington et al., 2014) Compared Methods To demonstrate the superiority of our TransCap for ASC tasks, we compare it with followings baselines: ATAE-LSTM (Wang et al., 2016b), IAN (Ma et al., 2017), AF-LSTM(CONV) (Tay et al., 2018), AF-LSTM(CORR) (Tay et al., 2018), PB…”
BackgroundMethodInfluentialSentiment Analysis by Capsules
Wang, Y., Sun, A., Han, J., Liu, Y., & Zhu, X. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186015 · Cited by 210
“We use an attention mechanism inspired by [1, 5, 40, 44] with a single parameter in capsule:”
BackgroundMethodSelf-citationLCF: A Local Context Focus Mechanism for Aspect-Based Sentiment Classification
Zeng, B., Yang, H., Xu, R., Zhou, W., & Han, X. (2019) · Applied Sciences · doi:10.3390/app9163389 · Cited by 211
“ATAE-LSTM [12] applies an attention mechanism and assembles the representations of aspect and context by concatenating them.”
MethodInfluentialCausal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond
Feder, A., Keith, K. A., Manzoor, E., Pryzant, R., Sridhar, D., Wood-Doughty, Z., Eisenstein, J., Grimmer, J., Reichart, R., Roberts, M. E., et al. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00511 · Cited by 220
“, 2014), which are computed on the path to generating a prediction (e.g., Xu et al., 2015; Wang et al., 2016).”
MethodA Combined CNN and LSTM Model for Arabic Sentiment Analysis
Alayba, A. M., Palade, V., England, M., & Iqbal, R. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-99740-7_12 · Cited by 205
“[17] applied an attention-based LSTMs model for aspect-level sentiment analysis.”
MethodModelling Context and Syntactical Features for Aspect-based Sentiment Analysis
Phan, M. H., & Ogunbona, P. O. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.293 · Cited by 194
“Attention-based LSTM with Aspect Embedding (ATAE-LSTM) (Wang et al., 2016) utilized attention mechanism in addition to LSTM layers.”
MethodZhou, J., Huang, J. X., Hu, Q. V., & He, L. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106292 · Cited by 210
Driver stress detection via multimodal fusion using attention-based CNN-LSTM
Mou, L., Zhou, C., Zhao, P., Nakisa, B., Rastgoo, M. N., Jain, R., & Gao, W. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114693 · Cited by 198
Aspect-based Sentiment Analysis with Type-aware Graph Convolutional Networks and Layer Ensemble
Tian, Y., Chen, G., & Song, Y. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.231 · Cited by 187
“Conventionally, this task is formulated as to classify a sentence-aspect pair and most of studies try to explore the contextual information between aspect and the entire sentence to facilitate the analysis of sentiment (Dong et al., 2014; Wang et al., 2016; Tang et al., 2016a; Ma et al., 2017; Chen et al., 2017; Xue a…”
BackgroundMethodInfluentialThe Fusion of Deep Learning and Fuzzy Systems: A State-of-the-Art Survey
Zheng, Y., Xu, Z., & Wang, X. (2022) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2021.3062899 · Cited by 196
Motor Imagery Classification via Temporal Attention Cues of Graph Embedded EEG Signals
Zhang, D., Chen, K., Jian, D., & Yao, L. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2967128 · Cited by 199
“exploring temporal features [48].”
Content Attention Model for Aspect Based Sentiment Analysis
Liu, Q., Zhang, H., Zeng, Y., Huang, Z., & Wu, Z. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186001 · Cited by 191
“Previous works have taken into consideration this problem with prevalent solutions including the hidden state based model [41] and the memory based model [4, 37].”
BackgroundMethodInfluentialAspect-Category-Opinion-Sentiment Quadruple Extraction with Implicit Aspects and Opinions
Cai, H., Xia, R., & Yu, J. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.29 · Cited by 163
“As a core task of ABSA, aspect-based sentiment classification (ABSC) which aims to detect the sentiment of a given aspect has been extensively studied in the literature (Jiang et al., 2011; Vo and Zhang, 2015; Tang et al., 2015; Wang et al., 2016b; Tang et al., 2016; Zhang et al., 2016; Yang et al., 2017b; Ma et al.,…”
BackgroundInfluentialTowards interpreting multi-temporal deep learning models in crop mapping
Xu, J., Yang, J., Xiong, X., Li, H., Huang, J., Ting, K. C., Ying, Y., & Lin, T. (2021) · Remote Sensing of Environment · doi:10.1016/j.rse.2021.112599 · Cited by 196
Classification of Hand Movements From EEG Using a Deep Attention-Based LSTM Network
Zhang, G., Davoodnia, V., Sepas-Moghaddam, A., Zhang, Y., & Etemad, A. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2956998 · Cited by 201
“Furthermore, attention-based LSTM has been used in other tasks requiring remembering and aggregation of feature embeddings, notably natural language processing (NLP) [26], [27].”
MethodAttention Interpretability Across NLP Tasks
Vashishth, S., Upadhyay, S., Tomar, G. S., & Faruqui, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11218 · Cited by 63
“Apart from substantial performance benefit (Vaswani et al., 2017), attention also provides interpretability to neural models (Wang et al., 2016; Lin et al., 2017; Ghaeini et al., 2018) which are usually criticized for being black-box function approximators (Chakraborty et al., 2017).”
BackgroundZhao, P., Hou, L., & Wu, O. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.105443 · Cited by 192
Parameterized Convolutional Neural Networks for Aspect Level Sentiment Classification
Huang, B., & Carley, K. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1136 · Cited by 184
“Wang et al. (2016) use an attention vector generated from aspect embedding to better capture the important parts in sentences.”
BackgroundMethodInfluential
Metadata
- Authors
- Wang, Y., Huang, M., zhu, X., & Zhao, L.
- Affiliations
- State Key Laboratory of Intelligent Technology and Systems (CN)
- Venue
- Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing
- Published
- 2016
- Pages
- 606-615
- OpenAlex
- W2562607067
- Cited by
- 2,450
- References
- 33
- Citations by year
- 2026: 108 · 2025: 179 · 2024: 272 · 2023: 332 · 2022: 356 · 2021: 401 · 2020: 343 · 2019: 285 · 2018: 134 · 2017: 28
- FWCI
- 80.28
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- Funders
- National Natural Science Foundation of China (2012CB316301, 973 Program, 2013CB329403, 61272227, 61332007)
- Tsinghua University
- Samsung
- Beijing Higher Education Young Elite Teacher Project
- National Key Research and Development Program of China (2012CB316301, 61332007, 2013CB329403)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
- Keywords
- aspect-based sentiment analysis, attention mechanism, long short-term memory, sentiment polarity, SemEval-2014, fine-grained sentiment analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.