The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Annotating Expressions of Opinions and Emotions in Language
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,312
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334
Content Analysis: An Introduction to Its Methodology
Krippendorff, K. (2019) · doi:10.4135/9781071878781 · Cited by 15,448
Introduction to Functional Grammar
Matthiessen, C., & Halliday, M. A. K. (1989) · Language · doi:10.2307/414947 · Cited by 9,880
An Introduction to Functional Grammar
Halliday, M. A. K., Matthiessen, C. M. I. M., Halliday, M., & Matthiessen, C. (2014) · doi:10.4324/9780203783771 · Cited by 9,662
Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957) · Cited by 9,433
A Comprehensive Grammar of the English Language
Huddleston, R., Quirk, R., Greenbaum, S., Leech, G., & Svartvik, J. (1988) · Language · doi:10.2307/415437 · Cited by 7,587
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
A Comprehensive Grammar of the English Language
Beauvais, P. J., Quirk, R., Greenbaum, S., Leech, G., & Svartvik, J. (1987) · College Composition and Communication · doi:10.2307/357731 · Cited by 5,488
Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
Peter, P., & Turney (2002) · Cited by 3,650
Research works printed but not linked: 15
- N. Asher, 1986, Journal of Philosophical Logic, 15, 127, 10.1007/BF00305490 · doi:10.1007/bf00305490
- A. Banfield, 1982, Unspeakable Sentences
- Bergler S. (1992) Evidential Analysis of Reported Speech. Ph.D. thesis, Brandeis University.
- Breck E., Cardie C. (2004) Playing the Telephone Game: Determining the Hierarchical Structure of Perspective and Speech Expressions. In Proceedings of the Twentieth International Conference on Computational Linguistics (COLING 2004). Geneva, Switzerland, pp. 120–126. · doi:10.3115/1220355.1220373
- Cunningham H., Maynard D., Bontcheva K., Tablan V. (2002) GATE: A Framework and Graphical Development Environment for Robust NLP Tools and Applications. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (A CL-02). Philadelphia, Pennsylvania, pp. 168–175.
- R.P. Hart, 1984, Political Communication Yearbook: 1984, 97
- Heise D. (2001) Project Magellan: Collecting Cross-Cultural Affective Meanings via The Internet. Electronic Journal of Sociology 5(3). Available at http://www.sociology.org.
- A. Ortony, 1987, Cognitive Science, 11, 341, 10.1207/s15516709cog1103_4 · doi:10.1207/s15516709cog1103_4 · Paper page
- W.V. Quine, 1956/1976, The Ways of Paradox and Other Essays, Revised and Enlarged Edition
- W. Rapaport, 1986, Cognitive Science, 10, 371, 10.1207/s15516709cog1004_1 · doi:10.1207/s15516709cog1004_1
- Tong R. (2001) An Operational System for Detecting and Tracking Opinions in Online Discussions. In Working Notes of the SIGIR Workshop on Operational Text Classification. New Orleans, Louisianna, pp. 1–6.
- B. Uspensky, 1973, A Poetics of Composition
- D. Watson, 1985, Psychological Bulletin, 98, 219, 10.1037/0033-2909.98.2.219 · DOI · Paper page
- White P. (2002) Appraisal: The Language of Attitudinal Evaluation and Intersubjective Stance. In Verschueren, Ostman, blommaert, Bulcaen (eds.), The Handbook of Pragmatics. Amsterdam/Philadelphia, John Benjamins Publishing Company, pp. 1–27.
- Y. Wilks, 1983, Cognitive Science, 7, 95, 10.1207/s15516709cog0702_1 · doi:10.1207/s15516709cog0702_1
Cited by
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
“For the classification tasks we used the following datasets: movie review sentiment (MR) [43], customer product reviews (CR) [44], subjectivity/objectivity [45], opinion polarity (MPQA) [46] and question-type classification (TREC) [47].”
MethodRecognizing contextual polarity in phrase-level sentiment analysis
Wilson, T., Wiebe, J., & Hoffmann, P. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220619 · Cited by 3,345
Self-citationLexicon-based methods for sentiment analysis
Taboada, M., Brooke, J., Tofiloski, M., Voll, K., & Stede, M. (2011) · Computational Linguistics · doi:10.1162/coli_a_00049 · Cited by 3,301
Sentiment Analysis and Opinion Mining
Liu, B. (2012) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02145-9 · Cited by 3,281
Sentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2017) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7687-1_907 · Cited by 3,260
SimCSE: Simple Contrastive Learning of Sentence Embeddings
Gao, T., Yao, X., & Chen, D. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.552 · Cited by 2,851
Advances in natural language processing
Hirschberg, J., & Manning, C. D. (2015) · Science · doi:10.1126/science.aaa8685 · Cited by 1,712
Sentiment strength detection in short informal text
Thelwall, M., Buckley, K., Paltoglou, G., Cai, D., & Kappas, A. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21416 · Cited by 1,449
Making Pre-trained Language Models Better Few-shot Learners
Gao, T., Fisch, A., & Chen, D. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.295 · Cited by 1,380
Cer, D., Yang, Y., Kong, S.-Y., Hua, N., Limtiaco, N., John, R. S., Constant, N., Guajardo-Cespedes, M., Yuan, S., Tar, C., et al. (2018) · arXiv · doi:10.48550/arxiv.1803.11175 · Cited by 1,267
Affective Computing and Sentiment Analysis
Cambria, E. (2016) · IEEE Intelligent Systems · doi:10.1109/mis.2016.31 · Cited by 1,204
The Penn Discourse TreeBank 2.0.
Prasad, R., Dinesh, N., Lee, A., Miltsakaki, E., Robaldo, L., Joshi, A., & Webber, B. (2008) · Proceedings of the Language Resources and Evaluation Conference · doi:10.63317/55sr8v9kexr7 · Cited by 1,115
A comprehensive review on ensemble deep learning: Opportunities and challenges
Mohammed, A., & Kora, R. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.01.014 · Cited by 1,127
Sentiment analysis in multiple languages: Feature selection for opinion classification in Web forums
Abbasi, A., Chen, H., & Salem, A. (2008) · ACM Transactions on Information Systems · doi:10.1145/1361684.1361685 · Cited by 891
Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal Messages
Zadeh, A., Zellers, R., Pincus, E., & Morency, L.-P. (2016) · IEEE Intelligent Systems · doi:10.1109/mis.2016.94 · Cited by 852
Survey on Aspect-Level Sentiment Analysis
Schouten, K., & Frasincar, F. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2015.2485209 · Cited by 832
Language-agnostic BERT Sentence Embedding
Feng, F., Yang, Y., Cer, D., Arivazhagan, N., & Wang, W. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.62 · Cited by 758
DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language Understanding
Shen, T., Zhou, T., Long, G., Jiang, J., Pan, S., & Zhang, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11941 · Cited by 779
Recognizing Contextual Polarity: An Exploration of Features for Phrase-Level Sentiment Analysis
Wilson, T., Wiebe, J., & Hoffmann, P. (2009) · Computational Linguistics · doi:10.1162/coli.08-012-r1-06-90 · Cited by 722
Self-citationUnsupervised Learning of Sentence Embeddings Using Compositional n-Gram Features
Pagliardini, M., Gupta, P., & Jaggi, M. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1049 · Cited by 678
Learning to identify emotions in text
Strapparava, C., & Mihalcea, R. (2008) · Proceedings of the 2008 ACM symposium on Applied computing · doi:10.1145/1363686.1364052 · Cited by 666
Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity
Lu, Y., Bartolo, M., Moore, A., Riedel, S., & Stenetorp, P. (2021) · arXiv · doi:10.48550/arxiv.2104.08786 · Cited by 615
A survey of multimodal sentiment analysis
Soleymani, M., Garcia, D., Jou, B., Schuller, B., Chang, S.-F., & Pantic, M. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.08.003 · Cited by 601
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. R. (2018) · arXiv · doi:10.48550/arxiv.1804.07461 · Cited by 562
A Machine Learning Approach to Twitter User Classification
Pennacchiotti, M., & Popescu, A.-M. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14139 · Cited by 548
Good debt or bad debt: Detecting semantic orientations in economic texts
Malo, P., Sinha, A., Korhonen, P., Wallenius, J., & Takala, P. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23062 · Cited by 513
“In our paper, the definition of these entities builds on the lexicon derived from the Multi-perspective Question Answering (MPQA) corpus of opinion annotations (Wiebe et al., 2005; Wilson, 2008; Wilson et al., 2009).”
BackgroundMethodA Survey on Text Classification: From Traditional to Deep Learning
Li, Q., Peng, H., Li, J., Xia, C., Yang, R., Sun, L., Yu, P. S., & He, L. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3495162 · Cited by 494
Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity
Lu, Y., Bartolo, M., Moore, A., Riedel, S., & Stenetorp, P. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.556 · Cited by 610
BAE: BERT-based Adversarial Examples for Text Classification
Garg, S., & Ramakrishnan, G. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.498 · Cited by 478
SentEval: An Evaluation Toolkit for Universal Sentence Representations
Conneau, A., & Kiela, D. (2018) · arXiv · doi:10.48550/arxiv.1803.05449 · Cited by 477
Towards multimodal sentiment analysis: harvesting opinions from the web
Morency, L.-P., Mihalcea, R., & Doshi, P. (2011) · Proceedings of the 13th international conference on multimodal interfaces · doi:10.1145/2070481.2070509 · Cited by 470
SentiBench - a benchmark comparison of state-of-the-practice sentiment analysis methods
Ribeiro, F. N., Araújo, M., Gonçalves, P., André Gonçalves, M., & Benevenuto, F. (2016) · EPJ Data Science · doi:10.1140/epjds/s13688-016-0085-1 · Cited by 468
Identifying Expressions of Emotion in Text
Aman, S., & Szpakowicz, S. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74628-7_27 · Cited by 447
SenticNet 3: A Common and Common-Sense Knowledge Base for Cognition-Driven Sentiment Analysis
Cambria, E., Olsher, D., & Rajagopal, D. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8928 · Cited by 438
Sentiment Analysis: An Overview from Linguistics
Taboada, M. (2016) · Annual Review of Linguistics · doi:10.1146/annurev-linguistics-011415-040518 · Cited by 411
Exploiting social relations for sentiment analysis in microblogging
Hu, X., Tang, L., Tang, J., & Liu, H. (2013) · Proceedings of the sixth ACM international conference on Web search and data mining · doi:10.1145/2433396.2433465 · Cited by 384
Opinion Mining with Deep Recurrent Neural Networks
Irsoy, O., & Cardie, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1080 · Cited by 384
“Since SEMI CRF relaxes the Markovian assumption and operates at the segment-level instead of the token-level, it also has access to parse trees of sentences to generate candidate segments (Yang and Cardie, 2012).”
BackgroundMethodInfluentialSelf-citationSemEval-2015 Task 10: Sentiment Analysis in Twitter
Rosenthal, S., Nakov, P., Kiritchenko, S., Mohammad, S., Ritter, A., & Stoyanov, V. (2015) · Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015) · doi:10.18653/v1/s15-2078 · Cited by 367
Multimodal Sentiment Analysis: A Survey of Methods, Trends, and Challenges
Das, R., & Singh, T. D. (2023) · ACM Computing Surveys · doi:10.1145/3586075 · Cited by 363
MOSI: Multimodal Corpus of Sentiment Intensity and Subjectivity Analysis in Online Opinion Videos
Zadeh, A., Zellers, R., Pincus, E., & Morency, L.-P. (2016) · arXiv · doi:10.48550/arxiv.1606.06259 · Cited by 350
Al-Smadi, M., Qawasmeh, O., Al-Ayyoub, M., Jararweh, Y., & Gupta, B. (2018) · Journal of Computational Science · doi:10.1016/j.jocs.2017.11.006 · Cited by 339
Conditional BERT Contextual Augmentation
Wu, X., Lv, S., Zang, L., Han, J., & Hu, S. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-22747-0_7 · Cited by 336
Learning to Generate Reviews and Discovering Sentiment
Radford, A., Jozefowicz, R., & Sutskever, I. (2017) · arXiv · doi:10.48550/arxiv.1704.01444 · Cited by 330
Gated Neural Networks for Targeted Sentiment Analysis
Zhang, M., Zhang, Y., & Vo, D.-T. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10380 · Cited by 304
Lexicon-based sentiment analysis: Comparative evaluation of six sentiment lexicons
Khoo, C. S., & Johnkhan, S. B. (2018) · Journal of Information Science · doi:10.1177/0165551517703514 · Cited by 267
Dynabench: Rethinking Benchmarking in NLP
Kiela, D., Bartolo, M., Nie, Y., Kaushik, D., Geiger, A., Wu, Z., Vidgen, B., Prasad, G., Singh, A., Ringshia, P., et al. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.324 · Cited by 254
(2013) · Cited by 236
GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation
Yoo, K. M., Park, D., Kang, J., Lee, S.-W., & Park, W. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.192 · Cited by 151
What Determines Inter-Coder Agreement in Manual Annotations? A Meta-Analytic Investigation
Bayerl, P. S., & Paul, K. I. (2011) · Computational Linguistics · doi:10.1162/coli_a_00074 · Cited by 126
Making Pre-trained Language Models Better Few-shot Learners
Gao, T., Fisch, A., & Chen, D. (2020) · arXiv · doi:10.48550/arxiv.2012.15723 · Cited by 124
Lingiardi, V., Carone, N., Semeraro, G., Musto, C., D’Amico, M., & Brena, S. (2020) · Behaviour & Information Technology · doi:10.1080/0144929x.2019.1607903 · Cited by 113
A La Carte Embedding: Cheap but Effective Induction of Semantic Feature Vectors
Khodak, M., Saunshi, N., Liang, Y., Ma, T., Stewart, B., & Arora, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1002 · Cited by 111
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · arXiv · doi:10.48550/arxiv.1908.10084 · Cited by 343
Using Opinion Mining Techniques in Tourism
Bucur, C. (2015) · Procedia Economics and Finance · doi:10.1016/s2212-5671(15)00471-2 · Cited by 84
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
Wang, Y., Agarwal, S., Mukherjee, S., Liu, X., Gao, J., Awadallah, A. H., & Gao, J. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.388 · Cited by 77
Sentence-level Emotion Classification with Label and Context Dependence
Li, S., Huang, L., Wang, R., & Zhou, G. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1101 · Cited by 66
DynaSent: A Dynamic Benchmark for Sentiment Analysis
Potts, C., Wu, Z., Geiger, A., & Kiela, D. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.186 · Cited by 56
On Being Told How We Feel: How Algorithmic Sensor Feedback Influences Emotion Perception
Hollis, V., Pekurovsky, A., Wu, E., & Whittaker, S. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3264924 · Cited by 52
Contrastive Learning Models for Sentence Representations
Xu, L., Xie, H., Li, Z., Wang, F. L., Wang, W., & Li, Q. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3593590 · Cited by 50
Small decisions with big impact on data analytics
Diesner, J. (2015) · Big Data & Society · doi:10.1177/2053951715617185 · Cited by 32
Srba, I., Razuvayevskaya, O., Leite, J. A., Moro, R., Schlicht, I. B., Tonelli, S., García, F. M., Lottmann, S. B., Teyssou, D., Porcellini, V., et al. (2026) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3770077 · Cited by 19
The Role of Expertise in Effectively Moderating Harmful Social Media Content
Abdelkadir, N. A., Yang, T., Kapania, S., Estefanos, M., Gebrekidan, F. B., Zelalem, Z., Ali, M., Berhe, R., Baker, D., Talat, Z., et al. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714010 · Cited by 5
ConGen: Unsupervised control and generalization distillation for sentence representation
Limkonchotiwat, P., Ponwitayarat, W., Lowphansirikul, L., Udomcharoenchaikit, C., Chuangsuwanich, E., & Nutanong, S. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.483 · Cited by 3
Metadata
- Authors
- Wiebe, J., Wilson, T., & Cardie, C.
- Venue
- Language Resources and Evaluation
- Published
- 2005-05
- Volume
- 39
- Issue
- 2-3
- Pages
- 165-210
- ISSN
- 0010-4817 (ISSN-L)
- 1574-020X
- 1572-8412
- OpenAlex
- W2014902591
- Cited by
- 1,755
- References
- 61
- FWCI
- 39.16
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.