CoChat
Sign Up
PreprintCited by 3Sentiment Analysis and Opinion MiningTopic ModelingDomain Adaptation and Few-Shot Learning

Heuristic-enhanced Candidates Selection strategy for GPTs tackle Few-Shot Aspect-Based Sentiment Analysis

Open access
Jiang, Baoxing, Wan, Yujie, Ju, Shenggen·2024·arXiv
DOI 10.48550/arxiv.2404.06063arXiv 2404.06063
Open this paper in CoChat — free accountOpen PDF

Abstract

Few-Shot Aspect-Based Sentiment Analysis (FSABSA) is an indispensable and highly challenging task in natural language processing. However, methods based on Pre-trained Language Models (PLMs) struggle to accommodate multiple sub-tasks, and methods based on Generative Pre-trained Transformers (GPTs) perform poorly. To address the above issues, the paper designs a Heuristic-enhanced Candidates Selection (HCS) strategy and further proposes All in One (AiO) model based on it. The model works in a two-stage, which simultaneously accommodates the accuracy of PLMs and the generalization capability of GPTs. Specifically, in the first stage, a backbone model based on PLMs generates rough heuristic candidates for the input sentence. In the second stage, AiO leverages LLMs' contextual learning capabilities to generate precise predictions. The study conducted comprehensive comparative and ablation experiments on five benchmark datasets. The experimental results demonstrate that the proposed model can better adapt to multiple sub-tasks, and also outperforms the methods that directly utilize GPTs.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2404.06063

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • These models face issues with catastrophic forgetting when incorporating data from new domains.

    “Moreover, these models face issues with catastrophic forgetting when incorporating data from new domains [12].”

    From GPT-based lifelong learning and ANFIS-driven reply memory ratio prediction for aspect-based sentiment analysis (2025) · cites this paper as [12]

    Section 5.3 describes transfer tests across datasets, but does not report whether adding data from a new domain causes previously learned knowledge to be forgotten. Searches for “catastrophic forgetting” and forgetting after training on new domains found no passage addressing that issue in our copy. (LLM, conf=0.70)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 47

  1. Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D., Wu, J., Winter, C., Hesse, C., Chen, M., Sigler, E., Litwin, M., Gray, S., Chess, B., Clark, J., Berner, C., McCandlish, S., Radford, A., Sutskever, I., & Amodei, D.(2020). Language models are few-shot learners. In Advances in Neural Information Processing Systems 33, NeurIPS, December 6-12, 2020 (pp. 1877-1901).
  2. Vancouver, BC, Canada: Curran Associates Inc. volume 33. URL: https://proceedings.neurips.cc/paper_files/paper/2020/file/1457c0d6bfcb4967418bfb8ac
  3. Das, S. R., & Chen, M. Y.(2001). Yahoo! for amazon: Sentiment parsing from small talk on the web. In EFA 2001 Barcelona Meetings, Available at SSRN, EFA, August 5, 2001 (p. 45). Bangkok, Thailand: Elsevier. 10.2139/ssrn.276189. · DOI
  4. Devlin, J., Chang, M., Lee, K., & Toutanova, K.(2019). BERT: pre- training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT (pp. 4171-4186). Minneapolis, MN, USA: ACL. 10.18653/V1/N19-1423. · DOI · Paper page
  5. Dong, K., Xu, F., Jiang, B., Li, H., & Liu, P.(2023). Multitask-based cluster transmission for few-shot text classification. In Knowledge Science, Engineering and Management -16th International Conference, KSEM (pp. 66-77). Guangzhou, China: Springer volume 14117. 10.1007/978-3-031-40283-8_7. · DOI
  6. Fan, Z., Wu, Z., Dai, X., Huang, S., & Chen, J.(2019a). Target-oriented opinion words extraction with target-fused neural sequence labeling. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational NAACL-HLT (pp. 2509-2518). Minneapolis, MN, USA: ACL. 10.18653/V1/N19-1259. · DOI
  7. Fan, Z., Wu, Z., Dai, X., Huang, S., & Chen, J.(2019b). Target-oriented opinion words extraction with target-fused neural sequence labeling. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL) (pp. 2509- 2518). Minneapolis, MN, USA: ACL. 10.18653/v1/n19-1259. · DOI
  8. Fei, J., Zeng, W., Zhao, X., Li, X., & Xiao, W.(2022). Few-shot relational triple extraction with perspective transfer network. In Proceedings of the 31st ACM International Conference on Information & Knowl- edge Management, CIKM (pp. 488-498). Atlanta, GA, USA: ACM. 10.1145/3511808.3557323. · DOI
  9. Ganu, G., Elhadad, N., & Marian, A.(2009). Beyond the stars: Im- proving rating predictions using review text content. In 12th In- ternational Workshop on the Web and Databases, WebDB, June 28 (pp. 1-6). Providence, Rhode Island, USA: ACM. URL: http://webdb09.cse.buffalo.edu/papers/Paper9/WebDB.pdf .
  10. He, R., Lee, W. S., Ng, H. T., & Dahlmeier, D.(2018). Effective attention modeling for aspect-level sentiment classification. In Proceedings of the 27th International Conference on Computational Linguistics, COLING, August 20-26, 2018 (pp. 1121-1131). Santa Fe, New Mexico, USA: ACL.
  11. Huang, Y., Peng, H., Liu, Q., Yang, Q., Wang, J., Orellana-Martín, D., & Pérez-Jiménez, M. J.(2023). Attention-enabled gated spiking neural p model for aspect-level sentiment classification. Neural Networks, 157, 437-443. 10.1016/j.neunet.2022.11.006. · DOI
  12. Jiang, B., Liang, S., Liu, P., Dong, K., & Li, H.(2023a). A semantically enhanced dual encoder for aspect sentiment triplet extraction. Neuro- computing, 562, 126917. 10.1016/J.NEUCOM.2023.126917. · DOI
  13. Jiang, B., Xu, G., & Liu, P.(2023b). Aspect-level sentiment classification via location enhanced aspect-merged graph convolu- tional networks. The Journal of Supercomputing, 79, 9666-9691. 10.1007/S11227-022-05002-4. · DOI
  14. Jiang, Q., Chen, L., Xu, R., Ao, X., & Yang, M.(2019). A challenge dataset and effective models for aspect-based sentiment analysis. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP, November 3-7, 2019 (pp. 6279-6284). Hong Kong, China: ACL. 10.18653/V1/D19-1654. · DOI
  15. Kang, T., Kim, S., Yun, H., Lee, H., & Jung, K.(2022). Gated relational encoder-decoder model for target-oriented opinion word extraction. IEEE Access, 10, 130507-130517. 10.1109/ACCESS.2022.3228835. · DOI
  16. Li, R., Chen, H., Feng, F., Ma, Z., Wang, X., & Hovy, E. H.(2021). Dual graph convolutional networks for aspect-based sentiment analysis. In Proceedings of the 59th Annual Meeting of the Association for Com- putational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP (pp. 6319-6329). Virtual Event: Association for Computational Linguistics.
  17. Liang, S., Wei, W., Mao, X., Fu, Y., Fang, R., & Chen, D.(2023). Stage: Span tagging and greedy inference scheme for aspect sentiment triplet extraction. In Thirty-Seventh AAAI Conference on Artificial Intelligence, AAAI, Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence, IAAI, Thirteenth Symposium on Educational Advances in Artificial Intelligence, EAAI, February 7-14, 2023 (pp. 13174-13182). Washington, DC, USA: AAAI Press. 10.1609/aaai.v37i11.26547. · DOI
  18. Liu, P., Joty, S. R., & Meng, H. M.(2015). Fine-grained opinion mining with recurrent neural networks and word embeddings. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, EMNLP, September 17-21, 2015 (pp. 1433-1443). Lisbon, Portugal: ACL. 10.18653/V1/D15-1168. · DOI
  19. Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G.(2023). Pre- train, prompt, and predict: A systematic survey of prompting methods in natural language processing. ACM Comput. Surv., 55, 195:1-195:35. 10.1145/3560815. · DOI · Paper page
  20. Liu, Y., Li, F., Fei, H., & Ji, D.(2022). Pair-wise aspect and opinion terms extraction as graph parsing via a novel mutually- aware interaction mechanism. Neurocomputing, 493, 268-280. 10.1016/j.neucom.2022.04.064. · DOI
  21. Morinaga, S., Yamanishi, K., Tateishi, K., & Fukushima, T.(2002). Mining product reputations on the web. In Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD, July 23-26, 2002 (pp. 341-349). Edmonton, Alberta, Canada: ACM. 10.1145/775047.775098. · DOI
  22. OpenAI(2023). Gpt-4 technical report. arXiv:2303.08774. · arXiv
  23. Pang, B., & Lee, L.(2008). Opinion mining and sentiment analy- sis. Foundations and Trends in Information Retrieval, 2, 1-135. 10.1561/1500000011. · DOI · Paper page
  24. Peng, H., Xu, L., Bing, L., Huang, F., Lu, W., & Si, L.(2020). Knowing what, how and why: A near complete solution for aspect-based sentiment analysis. In The Thirty-Fourth AAAI Conference on Artificial Intelli- gence (AAAI) (pp. 8600-8607). New York, NY, USA: AAAI Press. 10.1609/aaai.v34i05.6383. · DOI
  25. Pontiki, M., Galanis, D., Papageorgiou, H., Androutsopoulos, I., Manand- har, S., Al-Smadi, M., Al-Ayyoub, M., Zhao, Y., Qin, B., Clercq, O. D., Hoste, V., Apidianaki, M., Tannier, X., Loukachevitch, N. V., Kotel- nikov, E. V., Bel, N., Zafra, S. M. J., & Eryigit, G.(2016). Semeval-2016 task 5: Aspect based sentiment analysis. In Proceedings of the 10th Inter- national Workshop on Semantic Evaluation (SemEval@NAACL-HLT) (pp. 19-30). San Diego, CA, USA: ACL. 10.18653/v1/s16-1002. · DOI
  26. Pontiki, M., Galanis, D., Papageorgiou, H., Manandhar, S., & Androut- sopoulos, I.(2015). Semeval-2015 task 12: Aspect based sentiment analysis. In Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval@NAACL-HLT) (pp. 486-495). Denver, Colorado, USA: ACL. 10.18653/v1/s15-2082. · DOI
  27. Pontiki, M., Galanis, D., Pavlopoulos, J., Papageorgiou, H., Androutsopou- los, I., & Manandhar, S.(2014). Semeval-2014 task 4: Aspect based sentiment analysis. In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval@COLING) (pp. 27-35). Dublin, Ireland: ACL. 10.3115/v1/s14-2004. · DOI
  28. Shao, Z., Yu, Z., Wang, M., & Yu, J.(2023). Prompting large language models with answer heuristics for knowledge-based visual question answering. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR, June 17-24, 2023 (pp. 14974-14983). Vancouver, BC, Canada: IEEE. 10.1109/CVPR52729.2023.01438. · DOI
  29. Sun, Y., Wang, S., Feng, S., Ding, S., Pang, C., Shang, J., Liu, J., Chen, X., Zhao, Y., Lu, Y., Liu, W., Wu, Z., Gong, W., Liang, J., Shang, Z., Sun, P., Liu, W., Ouyang, X., Yu, D., Tian, H., Wu, H., & Wang, H.(2021). Ernie 3.0: Large-scale knowledge enhanced pre-training for language understanding and generation. arXiv:2107.02137. · arXiv
  30. Tang, D., Qin, B., & Liu, T.(2016). Aspect level sentiment classi- fication with deep memory network. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP, November 1-4, 2016 (pp. 214-224). Austin, Texas, USA: ACL. 10.18653/V1/D16-1021. · DOI
  31. Vacareanu, R., Varia, S., Halder, K., Wang, S., Paolini, G., John, N. A., Ballesteros, M., & Muresan, S.(2024). A weak supervision approach for few-shot aspect based sentiment analysis. In Proceedings of the 18th Conference of the European Chapter of the Association for Computa- tional Linguistics, EACL (pp. 2734-2752). St. Julian's, Malta: ACL.
  32. Varia, S., Wang, S., Halder, K., Vacareanu, R., Ballesteros, M., Benajiba, Y., John, N. A., Anubhai, R., Muresan, S., & Roth, D.(2023). Instruction tuning for few-shot aspect-based sentiment analysis. In Proceedings of the 13th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis, WASSA@ACL, July 14, 2023 (pp. 19-27). Toronto, Canada: ACL. 10.18653/V1/2023.WASSA-1. · DOI
  33. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I.(2017). Attention is all you need. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems, NIPS, December 4-9, 2017 (pp. 5998-6008). · DOI
  34. Wang, Q., Xu, H., Ding, K., Liang, B., & Xu, R.(2024). In-context example retrieval from multi-perspectives for few-shot aspect-based sentiment analysis. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, LREC/COLING (pp. 8975-8985). Torino, Italy: ELRA and ICCL.
  35. Wu, Z., Ying, C., Zhao, F., Fan, Z., Dai, X., & Xia, R.(2020a). Grid tagging scheme for aspect-oriented fine-grained opinion extrac- tion. In Findings of the Association for Computational Linguis- tics, EMNLP, November, 2020 (pp. 2576-2585). Online: ACL. 10.18653/v1/2020.findings-emnlp.234. · DOI
  36. Wu, Z., Zhao, F., Dai, X., Huang, S., & Chen, J.(2020b). Latent opinions transfer network for target-oriented opinion words extraction. In The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI, The Thirty-Second Innovative Applications of Artificial Intelligence Con- ference, IAAI, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI, February 7-12, 2020 (pp. 9298-9305).
  37. New York, NY, USA: AAAI Press. 10.1609/AAAI.V34I05.6469. · DOI
  38. Xu, L., Chia, Y. K., & Bing, L.(2021). Learning span-level inter- actions for aspect sentiment triplet extraction. In Proceedings of the 59th Annual Meeting of the Association for Computational Lin- guistics (ACL), The 11th International Joint Conference on Natural Language Processing (IJCNLP) (pp. 4755-4766). Online: ACL. 10.18653/v1/2021.acl-long.367. · DOI
  39. Xu, L., Li, H., Lu, W., & Bing, L.(2020). Position-aware tagging for aspect sentiment triplet extraction. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP, November 16-20, 2020 (pp. 2339-2349). Online: ACL. 10.18653/v1/2020.emnlp-main.183. · DOI
  40. Yang, Z., Gan, Z., Wang, J., Hu, X., Lu, Y., Liu, Z., & Wang, L.(2022). An empirical study of GPT-3 for few-shot knowledge-based VQA. In Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intel- ligence, IAAI 2022, The Twelveth Symposium on Educational Advances in Artificial Intelligence, EAAI 2022, February 22 -March 1, 2022 (pp. 3081-3089). Online: AAAI Press. 10.1609/AAAI.V36I3.20215. · DOI
  41. Yin, Y., Wei, F., Dong, L., Xu, K., Zhang, M., & Zhou, M.(2016). Unsuper- vised word and dependency path embeddings for aspect term extraction. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI, 9-15 July 2016 (pp. 2979-2985). New York, NY, USA: IJCAI/AAAI Press.
  42. Zhang, C., Li, Q., & Song, D.(2019). Aspect-based sentiment classification with aspect-specific graph convolutional networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing, EMNLP, The 9th International Joint Conference on Natural Language Processing, IJCNLP, November 3-7, 2019 (pp. 4567-4577). Hong Kong, China: ACL. 10.18653/V1/D19-1464. · DOI
  43. Zhang, W., Li, X., Deng, Y., Bing, L., & Lam, W.(2023a). A survey on aspect-based sentiment analysis: Tasks, methods, and challenges. IEEE Transactions on Knowledge and Data Engineering, 35, 11019-11038. 10.1109/TKDE.2022.3230975. · DOI
  44. Zhang, X., Xu, J., Cai, Y., Tan, X., & Zhu, C.(2023b). Detecting dependency-related sentiment features for aspect-level sentiment clas- sification. IEEE Transactions on Affective Computing, 14, 196-210. 10.1109/TAFFC.2021.3063259. · DOI
  45. Zhang, Y., Peng, T., Han, R., Han, J., Yue, L., & Liu, L.(2022). Syn- chronously tracking entities and relations in a syntax-aware parallel architecture for aspect-opinion pair extraction. Applied Intelligence, 52, 15210-15225. 10.1007/s10489-022-03286-w. · DOI
  46. Zhao, B., Jin, W., Ser, J. D., & Yang, G.(2023). Chatagri: Exploring potentials of chatgpt on cross-linguistic agricultural text classification. Neurocomputing, 557, 126708. 10.1016/J.NEUCOM.2023.126708. · DOI
  47. Zhou, C., Li, Q., Li, C., Yu, J., Liu, Y., Wang, G., Zhang, K., Ji, C., Yan, Q., He, L., Peng, H., Li, J., Wu, J., Liu, Z., Xie, P., Xiong, C., Pei, J., Yu, P. S., & Sun, L.(2023). A comprehensive survey on pretrained foundation models: A history from bert to chatgpt. arXiv:2302.09419. · arXiv

Cited by

Sorted by citations

Authors
Jiang, B., Wan, Y., & Ju, S.
Affiliations
Sichuan University (CN)
Corresponding author
Jiang, Baoxing
ORCID
Jiang, Baoxing
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2404.06063
arXiv
2404.06063
OpenAlex
W4394709350
Cited by
3
References
0
Citations by year
2025: 3
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
National Natural Science Foundation of China (62137001)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords
generative pre-trained transformer, pre-trained language models, two-stage model, multi-task learning, contextual learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review