The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Target-Dependent Sentiment Classification With BERT
Open accessAbstract
Research on machine assisted text analysis follows the rapid development of digital media, and sentiment analysis is among the prevalent applications. Traditional sentiment analysis methods require complex feature engineering, and embedding representations have dominated leaderboards for a long time. However, the context-independent nature limits their representative power in rich context, hurting performance in Natural Language Processing (NLP) tasks. Bidirectional Encoder Representations from Transformers (BERT), among other pre-trained language models, beats existing best results in eleven NLP tasks (including sentence-level sentiment classification) by a large margin, which makes it the new baseline of text representation. As a more challenging task, fewer applications of BERT have been observed for sentiment classification at the aspect level. We implement three target-dependent variations of the BERTbasemodel, with positioned output at the target terms and an optional sentence with the target built in. Experiments on three data collections show that our TD-BERT model achieves new state-of-the-art performance, in comparison to traditional feature engineering methods, embedding-based models and earlier applications of BERT. With the successful application of BERT in many NLP tasks, our experiments try to verify if its context-aware representation can achieve similar performance improvement in aspect-based sentiment analysis. Surprisingly, coupling it with complex neural networks that used to work well with embedding representations does not show much value, sometimes with performance below the vanilla BERT-FC implementation. On the other hand, incorporation of target information shows stable accuracy improvement, and the most effective way of utilizing that information is displayed through the experiment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
(2017) · Cited by 11,625
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
Opinion mining and sentiment analysis
Pang, B., & Lee, L. (2008) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000011 · Cited by 6,372
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
Universal Language Model Fine-tuning for Text Classification
Howard, J., & Ruder, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1031 · Cited by 4,100
A Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1062 · Cited by 3,601
Lexicon-based methods for sentiment analysis
Taboada, M., Brooke, J., Tofiloski, M., Voll, K., & Stede, M. (2011) · Computational Linguistics · doi:10.1162/coli_a_00049 · Cited by 3,301
Sentiment Analysis and Opinion Mining
Liu, B. (2012) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02145-9 · Cited by 3,281
A neural probabilistic language model
BengioYoshua, DucharmeRéjean, VincentPascal, & JanvinChristian (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944966 · Cited by 2,644
Attention-based LSTM for Aspect-level Sentiment Classification
Wang, Y., Huang, M., zhu, X., & Zhao, L. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1058 · Cited by 2,450
Probabilistic Latent Semantic Analysis
Hofmann, T. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.6705 · Cited by 2,047
Deep learning for sentiment analysis: A survey
Zhang, L., Wang, S., & Liu, B. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1253 · Cited by 1,928
SemEval-2014 Task 4: Aspect Based Sentiment Analysis
Pontiki, M., Galanis, D., Pavlopoulos, J., Papageorgiou, H., Androutsopoulos, I., & Manandhar, S. (2014) · Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) · doi:10.3115/v1/s14-2004 · Cited by 1,862
Adaptive Recursive Neural Network for Target-dependent Twitter Sentiment Classification
Dong, L., Wei, F., Tan, C., Tang, D., Zhou, M., & Xu, K. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.3115/v1/p14-2009 · Cited by 1,074
Interactive Attention Networks for Aspect-Level Sentiment Classification
Ma, D., Li, S., Zhang, X., & Wang, H. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/568 · Cited by 1,069
Graves, A., Wayne, G., & Danihelka, I. (2014) · arXiv · doi:10.48550/arxiv.1410.5401 · Cited by 1,058
Aspect Level Sentiment Classification with Deep Memory Network
Tang, D., Qin, B., & Liu, T. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1021 · Cited by 1,041
Recurrent Attention Network on Memory for Aspect Sentiment Analysis
Chen, P., Sun, Z., Bing, L., & Yang, W. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1047 · Cited by 995
Target-dependent Twitter Sentiment Classification
Jiang, L., Yu, M., Zhou, M., Liu, X., & Zhao, T. (2011) · Cited by 897
Effective LSTMs for Target-Dependent Sentiment ClassificationPreprint
Tang, D., Qin, B., Feng, X., & Liu, T. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.01100 · Cited by 802
NRC-Canada-2014: Detecting Aspects and Sentiment in Customer Reviews
Kiritchenko, S., Zhu, X., Cherry, C., & Mohammad, S. (2014) · Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) · doi:10.3115/v1/s14-2076 · Cited by 697
A C-LSTM Neural Network for Text Classification
Zhou, C., Sun, C., Liu, Z., & Lau, F. C. M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.08630 · Cited by 641
Aspect Based Sentiment Analysis with Gated Convolutional Networks
Xue, W., & Li, T. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1234 · Cited by 634
Expanding domain sentiment lexicon through double propagation
Qiu, G., Liu, B., Bu, J., & Chen, C. (2009) · International Joint Conference on Artificial Intelligence · Cited by 414
BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis
Xu, H., Liu, B., Shu, L., & Yu, P. S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.02232 · Cited by 354
Aspect Level Sentiment Classification with Attention-over-Attention Neural Networks
Huang, B., Ou, Y., & Carley, K. M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93372-6_22 · Cited by 353
Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentence
Sun, C. C., Huang, L., & Qiu, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.09588 · Cited by 340
Target-dependent twitter sentiment classification with rich automatic features
Vo, D.-T., & Zhang, Y. (2015) · International Conference on Artificial Intelligence · Cited by 329
Gated Neural Networks for Targeted Sentiment Analysis
Zhang, M., Zhang, Y., & Vo, D.-T. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10380 · Cited by 304
When and Why Are Pre-Trained Word Embeddings Useful for Neural Machine Translation?
Qi, Y., Sachan, D., Felix, M., Padmanabhan, S., & Neubig, G. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2084 · Cited by 292
PhraseRNN: Phrase Recursive Neural Network for Aspect-based Sentiment Analysis
Nguyen, T. H., & Shirai, K. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1298 · Cited by 257
Targeted Sentiment Classification with Attentional Encoder Network
Song, Y., Wang, J., Jiang, T., Liu, Z., & Rao, Y. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-30490-4_9 · Cited by 235
DCU: Aspect-based Polarity Classification for SemEval Task 4
Wagner, J., Arora, P., Cortes, S., Barman, U., Bogdanova, D., Foster, J., & Tounsi, L. (2014) · Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) · doi:10.3115/v1/s14-2036 · Cited by 222
Parameterized Convolutional Neural Networks for Aspect Level Sentiment Classification
Huang, B., & Carley, K. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1136 · Cited by 184
Modeling Inter-Aspect Dependencies for Aspect-Based Sentiment Analysis
Hazarika, D., Poria, S., Vij, P., Krishnamurthy, G., Cambria, E., & Zimmermann, R. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-2043 · Cited by 82
SentiFul: Generating a reliable lexicon for sentiment analysis
Neviarouskaya, A., Prendinger, H., & Ishizuka, M. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349575 · Cited by 74
TDParse: Multi-target-specific sentiment recognition on Twitter
Wang, B., Liakata, M., Zubiaga, A., & Procter, R. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1046 · Cited by 53
Enhanced Aspect Level Sentiment Classification with Auxiliary Memory.
Zhu, P., & Qian, T. (2018) · International Conference on Computational Linguistics · Cited by 44
Cited by
A survey on sentiment analysis methods, applications, and challenges
Wankhade, M., Rao, A. C. S., & Kulkarni, C. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10144-1 · Cited by 1,528
Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional networks
Liang, B., Su, H., Gui, L., Cambria, E., & Xu, R. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107643 · Cited by 535
Dependency Graph Enhanced Dual-transformer Structure for Aspect-based Sentiment Classification
Tang, H., Ji, D., Li, C., & Zhou, Q. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.588 · Cited by 344
A survey on aspect-based sentiment classification
Brauwers, G., & Frasincar, F. (2023) · ACM Computing Surveys · doi:10.1145/3503044 · Cited by 165
Fan, H., Zhang, X., Xu, Y., Fang, J., Zhang, S., Zhao, X., & Yu, J. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102161 · Cited by 137
Metadata
- Authors
- Gao, Z., Feng, A., Song, X., & Wu, X.
- Venue
- IEEE Access
- Published
- 2019
- Volume
- 7
- Pages
- 154290-154299
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2979860911
- Cited by
- 425
- References
- 48
- FWCI
- 22.10
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.