The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Towards answering opinion questions: separating facts from opinions and identifying the polarity of opinion sentences
Open accessAbstract
Opinion question answering is a challenging task for natural language processing. In this paper, we discuss a necessary component for an opinion question answering system: separating opinions from fact, at both the document and sentence level. We present a Bayesian classifier for discriminating between documents with a preponderance of opinions such as editorials from regular news stories, and describe three unsupervised, statistical techniques for the significantly harder task of detecting opinions at the sentence level. We also present a first model for classifying opinion sentences as positive or negative in terms of the main perspective being expressed in the opinion. Results from a large collection of news stories and a human evaluation of 400 sentences are reported, indicating that we achieve very high performance in document classification (upwards of 97% precision and recall), and respectable performance in detecting opinions and classifying them at the sentence level as positive, negative, or neutral (up to 91% accuracy).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
Peter, P., & Turney (2002) · Cited by 3,650
Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews
Turney, P. D. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073153 · Cited by 2,352
(1999) · Cited by 1,521
Brill, E. (1995) · Cited by 1,520
Predicting the semantic orientation of adjectives
Hatzivassiloglou, V., & McKeown, K. R. (1997) · Proceedings of the 35th annual meeting on Association for Computational Linguistics - · doi:10.3115/976909.979640 · Cited by 1,439
Self-citationWiebe, J., Wilson, T., Bruce, R., Bell, M., & Martin, M. (2004) · Computational Linguistics · doi:10.1162/0891201041850885 · Cited by 748
Effects of adjective orientation and gradability on sentence subjectivity
Hatzivassiloglou, V., & Wiebe, J. M. (2000) · Proceedings of the 18th conference on Computational linguistics - · doi:10.3115/990820.990864 · Cited by 671
Self-citationLearning Subjective Adjectives from Corpora
Wiebe, J. (2000) · Cited by 551
Development and use of a gold-standard data set for subjectivity classifications
Wiebe, J. M., Bruce, R. F., & O'Hara, T. P. (1999) · Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics - · doi:10.3115/1034678.1034721 · Cited by 503
Cited by
Opinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,720
Recognizing contextual polarity in phrase-level sentiment analysis
Wilson, T., Wiebe, J., & Hoffmann, P. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220619 · Cited by 3,345
A sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts
Pang, B., & Lee, L. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1218990 · Cited by 3,301
Sentiment Analysis and Opinion Mining
Liu, B. (2012) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02145-9 · Cited by 3,281
Sentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2017) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7687-1_907 · Cited by 3,260
SENTIWORDNET: A Publicly Available Lexical Resource for Opinion Mining
Esuli, A., & Sebastiani, F. (2006) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/54vo5wjya4cw · Cited by 2,480
Pang, B., & Lee, L. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219855 · Cited by 2,129
Annotating Expressions of Opinions and Emotions in Language
Wiebe, J., Wilson, T., & Cardie, C. (2005) · Language Resources and Evaluation · doi:10.1007/s10579-005-7880-9 · Cited by 1,755
A review of affective computing: From unimodal analysis to multimodal fusion
Poria, S., Cambria, E., Bajpai, R., & Hussain, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.003 · Cited by 1,644
Opinion observer: analyzing and comparing opinions on the Web
Liu, B., Hu, M., & Cheng, J. (2005) · Proceedings of the 14th international conference on World Wide Web - WWW '05 · doi:10.1145/1060745.1060797 · Cited by 1,597
Techniques and applications for sentiment analysis
Feldman, R. (2013) · Communications of the ACM · doi:10.1145/2436256.2436274 · Cited by 1,489
Determining the sentiment of opinions
Kim, S.-M., & Hovy, E. (2004) · Proceedings of the 20th international conference on Computational Linguistics - COLING '04 · doi:10.3115/1220355.1220555 · Cited by 1,482
A holistic lexicon-based approach to opinion mining
Ding, X., Liu, B., & Yu, P. S. (2008) · Proceedings of the international conference on Web search and web data mining - WSDM '08 · doi:10.1145/1341531.1341561 · Cited by 1,386
A Survey of Opinion Mining and Sentiment Analysis
Liu, B., & Zhang, L. (2012) · Mining Text Data · doi:10.1007/978-1-4614-3223-4_13 · Cited by 1,323
Twitter Sentiment Analysis: The Good the Bad and the OMG!
Kouloumpis, E., Wilson, T., & Moore, J. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14185 · Cited by 1,225
Opinion Word Expansion and Target Extraction through Double Propagation
Qiu, G., Liu, B., Bu, J., & Chen, C. (2011) · Computational Linguistics · doi:10.1162/coli_a_00034 · Cited by 1,074
Movie review mining and summarization
Zhuang, L., Jing, F., & Zhu, X.-Y. (2006) · Proceedings of the 15th ACM international conference on Information and knowledge management - CIKM '06 · doi:10.1145/1183614.1183625 · Cited by 894
Sentiment analysis in multiple languages: Feature selection for opinion classification in Web forums
Abbasi, A., Chen, H., & Salem, A. (2008) · ACM Transactions on Information Systems · doi:10.1145/1361684.1361685 · Cited by 891
Sentiment analysis using product review data
Fang, X., & Zhan, J. (2015) · Journal of Big Data · doi:10.1186/s40537-015-0015-2 · Cited by 788
SENTIMENT CLASSIFICATION of MOVIE REVIEWS USING CONTEXTUAL VALENCE SHIFTERS
Kennedy, A., & Inkpen, D. (2006) · Computational Intelligence · doi:10.1111/j.1467-8640.2006.00277.x · Cited by 751
Wiebe, J., Wilson, T., Bruce, R., Bell, M., & Martin, M. (2004) · Computational Linguistics · doi:10.1162/0891201041850885 · Cited by 748
Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN
Chen, T., Xu, R., He, Y., & Wang, X. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.10.065 · Cited by 730
Recognizing Contextual Polarity: An Exploration of Features for Phrase-Level Sentiment Analysis
Wilson, T., Wiebe, J., & Hoffmann, P. (2009) · Computational Linguistics · doi:10.1162/coli.08-012-r1-06-90 · Cited by 722
Pang, B., & Lee, L. (2005) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0506075 · Cited by 678
A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts
Pang, B., & Lee, L. (2004) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0409058 · Cited by 652
The Role of Text Pre-processing in Sentiment Analysis
Haddi, E., Liu, X., & Shi, Y. (2013) · Procedia Computer Science · doi:10.1016/j.procs.2013.05.005 · Cited by 619
A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challenges
Zhang, W., Li, X., Deng, Y., Bing, L., & Lam, W. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3230975 · Cited by 567
Creating Subjective and Objective Sentence Classifiers from Unannotated Texts
Wiebe, J., & Riloff, E. (2005) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30586-6_53 · Cited by 545
A review of natural language processing techniques for opinion mining systems
Sun, S., Luo, C., & Chen, J. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.10.004 · Cited by 542
Automatically assessing review helpfulness
Kim, S.-M., Pantel, P., Chklovski, T., & Pennacchiotti, M. (2006) · Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing - EMNLP '06 · doi:10.3115/1610075.1610135 · Cited by 518
Sentiment analysis of blogs by combining lexical knowledge with text classification
Melville, P., Gryc, W., & Lawrence, R. D. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557156 · Cited by 503
Evidence on the Information Content of Text in Analyst Reports
Huang, A. H., Zang, A. Y., & Zheng, R. (2014) · The Accounting Review · doi:10.2308/accr-50833 · Cited by 499
Current State of Text Sentiment Analysis from Opinion to Emotion Mining
Yadollahi, A., Shahraki, A. G., & Zaiane, O. R. (2018) · ACM Computing Surveys · doi:10.1145/3057270 · Cited by 489
Opinion Mining and Sentiment Analysis
Liu, B. (2011) · Web Data Mining · doi:10.1007/978-3-642-19460-3_11 · Cited by 482
A survey on sentiment detection of reviews
Tang, H., Tan, S., & Cheng, X. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.02.063 · Cited by 476
Towards multimodal sentiment analysis: harvesting opinions from the web
Morency, L.-P., Mihalcea, R., & Doshi, P. (2011) · Proceedings of the 13th international conference on multimodal interfaces · doi:10.1145/2070481.2070509 · Cited by 470
Sentiment Analysis and Opinion Mining: A Survey
Alhojely, S. (2016) · International Journal of Computer Applications · doi:10.5120/ijca2016911545 · Cited by 457
Identifying comparative sentences in text documents
Jindal, N., & Liu, B. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148215 · Cited by 446
Survey on mining subjective data on the web
Tsytsarau, M., & Palpanas, T. (2012) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-011-0238-6 · Cited by 443
Gamon, M. (2004) · Proceedings of the 20th international conference on Computational Linguistics - COLING '04 · doi:10.3115/1220355.1220476 · Cited by 435
SenticNet 5: Discovering Conceptual Primitives for Sentiment Analysis by Means of Context Embeddings
Cambria, E., Poria, S., Hazarika, D., & Kwok, K. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11559 · Cited by 411
Fully automatic lexicon expansion for domain-oriented sentiment analysis
Kanayama, H., & Nasukawa, T. (2006) · Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing - EMNLP '06 · doi:10.3115/1610075.1610125 · Cited by 408
Topic sentiment analysis in twitter: a graph-based hashtag sentiment classification approach
Wang, X., Wei, F., Liu, X., Zhou, M., & Zhang, M. (2011) · Proceedings of the 20th ACM international conference on Information and knowledge management · doi:10.1145/2063576.2063726 · Cited by 393
Determining the semantic orientation of terms through gloss classification
Esuli, A., & Sebastiani, F. (2005) · Proceedings of the 14th ACM international conference on Information and knowledge management · doi:10.1145/1099554.1099713 · Cited by 388
Identifying sources of opinions with conditional random fields and extraction patterns
Choi, Y., Cardie, C., Riloff, E., & Patwardhan, S. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220620 · Cited by 366
Sentiment Analysis: Mining Opinions, Sentiments, and Emotions
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286 · Cited by 362
Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Research
Poria, S., Hazarika, D., Majumder, N., & Mihalcea, R. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3038167 · Cited by 321
Text Mining in Big Data Analytics
Hassani, H., Beneki, C., Unger, S., Mazinani, M. T., & Yeganegi, M. R. (2020) · Big Data and Cognitive Computing · doi:10.3390/bdcc4010001 · Cited by 317
Mining comparative opinions from customer reviews for Competitive Intelligence
Xu, K., Liao, S. S., Li, J., & Song, Y. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.08.021 · Cited by 307
Toward Automated Fact-Checking: Detecting Check-worthy Factual Claims by ClaimBuster
Hassan, N., Arslan, F., Li, C., & Tremayne, M. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098131 · Cited by 302
Wiebe, J., & Mihalcea, R. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220309 · Cited by 296
Sentiment Classification of Reviews Using SentiWordNet
Ohana, B. (2009) · Arrow@dit (Dublin Institute of Technology) · doi:10.21427/d77s56 · Cited by 269
Which side are you on?: identifying perspectives at the document and sentence levels
Lin, W.-H., Wilson, T., Wiebe, J., & Hauptmann, A. (2006) · Proceedings of the Tenth Conference on Computational Natural Language Learning - CoNLL-X '06 · doi:10.3115/1596276.1596297 · Cited by 269
Automatic construction of a context-aware sentiment lexicon: an optimization approach
Lu, Y., Castellanos, M., Dayal, U., & Zhai, C. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963456 · Cited by 267
Offensive Language Detection Using Multi-level Classification
Razavi, A. H., Inkpen, D., Uritsky, S., & Matwin, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-13059-5_5 · Cited by 266
Feature subsumption for opinion analysis
Riloff, E., Patwardhan, S., & Wiebe, J. (2006) · Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing - EMNLP '06 · doi:10.3115/1610075.1610137 · Cited by 261
SAMAR: Subjectivity and sentiment analysis for Arabic social media
Abdul-Mageed, M., Diab, M., & Kübler, S. (2014) · Computer Speech & Language · doi:10.1016/j.csl.2013.03.001 · Cited by 260
Opinion Mining and Information Fusion: A survey
Balazs, J. A., & Velásquez, J. D. (2016) · Information Fusion · doi:10.1016/j.inffus.2015.06.002 · Cited by 253
Cross-Domain Sentiment Classification Using a Sentiment Sensitive Thesaurus
Bollegala, D., Weir, D., & Carroll, J. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.103 · Cited by 252
Addressing Complex and Subjective Product-Related Queries with Customer Reviews
McAuley, J., & Yang, A. (2016) · Proceedings of the 25th International Conference on World Wide Web · doi:10.1145/2872427.2883044 · Cited by 190
Modeling Ambiguity, Subjectivity, and Diverging Viewpoints in Opinion Question Answering Systems
Wan, M., & McAuley, J. (2016) · 2016 IEEE 16th International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2016.0060 · Cited by 92
Sentiment analysis of scientific citations
Athar, A. (2014) · Computer Laboratory, University of Cambridge · doi:10.48456/tr-856
Metadata
- Authors
- Yu, H., & Hatzivassiloglou, V.
- Venue
- Proceedings of the 2003 conference on Empirical methods in natural language processing -
- Published
- 2003
- Volume
- 10
- Pages
- 129-136
- OpenAlex
- W2080558111
- Cited by
- 1,053
- References
- 11
- FWCI
- 18.90
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.