Opinion observer: analyzing and comparing opinions on the Web
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
The Web has become an excellent source for gathering consumer opinions. There are now numerous Web sites containing such opinions, e.g., customer reviews of products, forums, discussion groups, and blogs. This paper focuses on online customer reviews of products. It makes two contributions. First, it proposes a novel framework for analyzing and comparing consumer opinions of competing products. A prototype system called Opinion Observer is also implemented. The system is such that with a single glance of its visualization, the user is able to clearly see the strengths and weaknesses of each product in the minds of consumers in terms of various product features. This comparison is useful to both potential customers and product manufacturers. For a potential customer, he/she can see a visual side-by-side and feature-by-feature comparison of consumer opinions on these products, which helps him/her to decide which product to buy. For a product manufacturer, the comparison enables it to easily gather marketing intelligence and product benchmarking information. Second, a new technique based on language pattern mining is proposed to extract product features from Pros and Cons in a particular type of reviews. Such features form the basis for the above comparison. Experimental results show that the technique is highly effective and outperform existing methods significantly.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
WordNet: An Electronic Lexical Database
Kilgarriff, A., & Fellbaum, C. (2000) · Language · doi:10.2307/417141 · Cited by 11,464
Fast Algorithms for Mining Association Rules in Large Databases
Agrawal, R., & Srikant, R. (1994) · Very Large Data Bases · Cited by 9,419
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
Self-citationThumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Fast algorithm for mining association rules
Agrawal, R. K. (1994) · Very Large Data Bases · Cited by 4,543
Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
Peter, P., & Turney (2002) · Cited by 3,650
Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews
Turney, P. D. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073153 · Cited by 2,352
Integrating classification and association rule mining
Liu, B., Hsu, W., & Ma, Y. (1998) · Cited by 2,247
Self-citationMining the peanut gallery: opinion extraction and semantic classification of product reviews
Dave, K., Lawrence, S., & Pennock, D. M. (2003) · Proceedings of the twelfth international conference on World Wide Web - WWW '03 · doi:10.1145/775152.775226 · Cited by 1,916
Cited by
Opinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,720
VADER: a parsimonious rule-based model for sentiment analysis of social media text
Hutto, C., & Gilbert, E. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14550 · Cited by 6,087
Sentiment Analysis and Opinion Mining
Liu, B. (2012) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02145-9 · Cited by 3,281
Self-citationSentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2017) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7687-1_907 · Cited by 3,260
Self-citationTwitter power: Tweets as electronic word of mouth
Jansen, B. J., Zhang, M., Sobel, K., & Chowdury, A. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21149 · Cited by 1,642
A holistic lexicon-based approach to opinion mining
Ding, X., Liu, B., & Yu, P. S. (2008) · Proceedings of the international conference on Web search and web data mining - WSDM '08 · doi:10.1145/1341531.1341561 · Cited by 1,386
Self-citationA Survey of Opinion Mining and Sentiment Analysis
Liu, B., & Zhang, L. (2012) · Mining Text Data · doi:10.1007/978-1-4614-3223-4_13 · Cited by 1,323
Self-citationDeriving the Pricing Power of Product Features by Mining Consumer Reviews
Archak, N., Ghose, A., & Ipeirotis, P. G. (2011) · Management Science · doi:10.1287/mnsc.1110.1370 · Cited by 1,007
Movie review mining and summarization
Zhuang, L., Jing, F., & Zhu, X.-Y. (2006) · Proceedings of the 15th ACM international conference on Information and knowledge management - CIKM '06 · doi:10.1145/1183614.1183625 · Cited by 894
Sentiment analysis in multiple languages: Feature selection for opinion classification in Web forums
Abbasi, A., Chen, H., & Salem, A. (2008) · ACM Transactions on Information Systems · doi:10.1145/1361684.1361685 · Cited by 891
Survey on Aspect-Level Sentiment Analysis
Schouten, K., & Frasincar, F. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2015.2485209 · Cited by 832
Topic sentiment mixture: modeling facets and opinions in weblogs
Mei, Q., Ling, X., Wondra, M., Su, H., & Zhai, C. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242596 · Cited by 801
Explicit factor models for explainable recommendation based on phrase-level sentiment analysis
Zhang, Y., Lai, G., Zhang, M., Zhang, Y., Liu, Y., & Ma, S. (2014) · Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval · doi:10.1145/2600428.2609579 · Cited by 791
Sentiment analysis using product review data
Fang, X., & Zhan, J. (2015) · Journal of Big Data · doi:10.1186/s40537-015-0015-2 · Cited by 788
Mine Your Own Business: Market-Structure Surveillance Through Text Mining
Netzer, O., Feldman, R., Goldenberg, J., & Fresko, M. (2012) · Marketing Science · doi:10.1287/mksc.1120.0713 · Cited by 750
Sarawagi, S. (2008) · Foundations and Trends in Databases · doi:10.1561/1900000003 · Cited by 707
Latent aspect rating analysis on review text data: a rating regression approach
Wang, H., Lu, Y., & Zhai, C. (2010) · Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1835804.1835903 · Cited by 650
Ghose, A., Ipeirotis, P. G., & Li, B. (2012) · Marketing Science · doi:10.1287/mksc.1110.0700 · Cited by 649
Ye, Q., Zhang, Z., & Law, R. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.07.035 · Cited by 636
Sarcasm as Contrast between a Positive Sentiment and Negative Situation
Riloff, E., Qadir, A., Surve, P., De Silva, L., Gilbert, N., & Huang, R. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1066 · Cited by 587
A survey of sentiment analysis in social media
Yue, L., Chen, W., Li, X., Zuo, W., & Yin, M. (2019) · Knowledge and Information Systems · doi:10.1007/s10115-018-1236-4 · Cited by 577
Manipulation of online reviews: An analysis of ratings, readability, and sentiments
Hu, N., Bose, I., Koh, N. S., & Liu, L. (2012) · Decision Support Systems · doi:10.1016/j.dss.2011.11.002 · Cited by 530
Piezunka, H., & Dahlander, L. (2015) · Academy of Management Journal · doi:10.5465/amj.2012.0458 · Cited by 497
Current State of Text Sentiment Analysis from Opinion to Emotion Mining
Yadollahi, A., Shahraki, A. G., & Zaiane, O. R. (2018) · ACM Computing Surveys · doi:10.1145/3057270 · Cited by 489
Co-training for cross-lingual sentiment classification
Wan, X. (2009) · Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - ACL-IJCNLP '09 · doi:10.3115/1687878.1687913 · Cited by 487
Opinion Mining and Sentiment Analysis
Liu, B. (2011) · Web Data Mining · doi:10.1007/978-3-642-19460-3_11 · Cited by 482
Self-citationA survey on sentiment detection of reviews
Tang, H., Tan, S., & Cheng, X. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.02.063 · Cited by 476
Automated Marketing Research Using Online Customer Reviews
Lee, T. Y., & Bradlow, E. T. (2011) · Journal of Marketing Research · doi:10.1509/jmkr.48.5.881 · Cited by 460
Machine Learning-Based Sentiment Analysis for Twitter Accounts
Hasan, A., Moin, S., Karim, A., & Shamshirband, S. (2018) · Mathematical and Computational Applications · doi:10.3390/mca23010011 · Cited by 447
Identifying comparative sentences in text documents
Jindal, N., & Liu, B. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148215 · Cited by 446
Self-citationSurvey on mining subjective data on the web
Tsytsarau, M., & Palpanas, T. (2012) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-011-0238-6 · Cited by 443
“The problem of mining product reviews has attracted particular attention in the research community (Morinaga et al. 2002; Dave et al. 2003; Liu et al. 2005; Carenini et al. 2005).”
Backgroundvan Atteveldt, W., van der Velden, M. A. C. G., & Boukes, M. (2021) · Communication Methods and Measures · doi:10.1080/19312458.2020.1869198 · Cited by 409
Recommender systems based on user reviews: the state of the art
Chen, L., Chen, G., & Wang, F. (2015) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-015-9155-5 · Cited by 403
Volkova, S., Shaffer, K., Jang, J. Y., & Hodas, N. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p17-2102 · Cited by 381
“Subjectivity cues We rely on external publicly available subjectivity, and positive and negative opinion lexicons to extract strongly and weakly subjective words (Riloff and Wiebe, 2003), positive and negative opinion words (Liu et al., 2005).”
BackgroundArtificial intelligence in E-Commerce: a bibliometric study and literature review
Bawack, R. E., Wamba, S. F., Carillo, K. D. A., & Akter, S. (2022) · Electronic Markets · doi:10.1007/s12525-022-00537-z · Cited by 372
Sentiment Analysis: Mining Opinions, Sentiments, and Emotions
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286 · Cited by 362
Self-citationGeetha, M., Singha, P., & Sinha, S. (2017) · Tourism Management · doi:10.1016/j.tourman.2016.12.022 · Cited by 356
Business Intelligence in BLOGS: Understanding Consumer Interactions and Communities1
Chau, M., & Xu, J. (2012) · MIS Quarterly · doi:10.2307/41703504 · Cited by 347
Estimating aggregate consumer preferences from online product reviews
Decker, R., & Trusov, M. (2010) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2010.09.001 · Cited by 341
Mining customer requirements from online reviews: A product improvement perspective
Qi, J., Zhang, Z., Jeon, S., & Zhou, Y. (2016) · Information & Management · doi:10.1016/j.im.2016.06.002 · Cited by 334
Designing novel review ranking systems: predicting the usefulness and impact of reviews
Ghose, A., & Ipeirotis, P. G. (2007) · Proceedings of the ninth international conference on Electronic commerce · doi:10.1145/1282100.1282158 · Cited by 322
Mining comparative opinions from customer reviews for Competitive Intelligence
Xu, K., Liao, S. S., Li, J., & Song, Y. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.08.021 · Cited by 307
ARSA: a sentiment-aware model for predicting sales performance using blogs
Liu, Y., Huang, X., An, A., & Yu, X. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277845 · Cited by 306
Twitter sentiment analysis using hybrid cuckoo search method
Chandra Pandey, A., Singh Rajpoot, D., & Saraswat, M. (2017) · Information Processing & Management · doi:10.1016/j.ipm.2017.02.004 · Cited by 299
Mining opinions in comparative sentences
Ganapathibhotla, M., & Liu, B. (2008) · Proceedings of the 22nd International Conference on Computational Linguistics - COLING '08 · doi:10.3115/1599081.1599112 · Cited by 295
Self-citationQuality evaluation of product reviews using an information quality framework
Chen, C. C., & Tseng, Y.-D. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.08.023 · Cited by 281
Kang, D., & Park, Y. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.07.101 · Cited by 268
Clustering product features for opinion mining
Zhai, Z., Liu, B., Xu, H., & Jia, P. (2011) · Proceedings of the fourth ACM international conference on Web search and data mining · doi:10.1145/1935826.1935884 · Cited by 258
Self-citationGrover, P., Kar, A. K., Janssen, M., & Ilavarasan, P. V. (2019) · Enterprise Information Systems · doi:10.1080/17517575.2019.1599446 · Cited by 254
Text mining for product attribute extraction
Ghani, R., Probst, K., Liu, Y., Krema, M., & Fano, A. (2006) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1147234.1147241 · Cited by 242
“[1] describe a system that consists of two parts: the first part focuses on extracting relevant product attributes, such as ‘focus’ in the domain of digital cameras.”
BackgroundMethodSentiment classification of Internet restaurant reviews written in Cantonese
Zhang, Z., Ye, Q., Zhang, Z., & Li, Y. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.12.147 · Cited by 230
“While it is still in a pre-liminary stage, there has been much work related to various languages, such as English (Liu, Hu, & Cheng, 2005; Pang, Lee, & Vaithyanathan, 2002), Japanese (Fujii & Ishikawa, 2006), Mandarin Chinese (Ku, Liang, & Chen, 2006).”
BackgroundInfluentialGather customer concerns from online product reviews – A text summarization approach
Zhan, J., Loh, H. T., & Liu, Y. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.12.039 · Cited by 196
Aspect-based sentiment analysis using smart government review data
Alqaryouti, O., Siyam, N., Abdel Monem, A., & Shaalan, K. (2024) · Applied Computing and Informatics · doi:10.1016/j.aci.2019.11.003 · Cited by 189
“This summarization of results can be done, qualitatively through text-based aggregated opinions summary [12], or quantitatively through graphical and analytical representation [13].”
MethodSentiment Analysis: A Perspective on its Past, Present and Future
Kumar, A., & Sebastian, T. M. (2012) · International Journal of Intelligent Systems and Applications · doi:10.5815/ijisa.2012.10.01 · Cited by 187
“[27], was to aggregate the orientations of the words in the sentence to get over all polarity of the opinion sentence.”
BackgroundConversations Gone Awry: Detecting Early Signs of Conversational Failure
Zhang, J., Chang, J., Danescu-Niculescu-Mizil, C., Dixon, L., Hua, Y., Taraborelli, D., & Thain, N. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1125 · Cited by 175
“As baselines, we consider several straightforward features: word count (which performs at chance level), sentiment lexicon (Liu et al., 2005) Reference points.”
BackgroundShoumy, N. J., Ang, L.-M., Seng, K. P., Rahaman, D. M. M., & Zia, T. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2019.102447 · Cited by 171
Feature-Based Visual Sentiment Analysis of Text Document Streams
Rohrdantz, C., Hao, M. C., Dayal, U., Haug, L.-E., & Keim, D. A. (2012) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2089094.2089102 · Cited by 43
“Was it “stated” or was it “claimed”?: How linguistic bias affects generative language models
Patel, R., & Pavlick, E. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.790 · Cited by 11
“We use the lexicon of positive and negative words from Liu et al. (2005) containing 2006 and 4783 words respectively.”
MethodUse and Assessment of Sources in Conspiracy Theorists’ Communities
Schatto-Eckrodt, T., Boberg, S., Wintterlin, F., & Quandt, T. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-39627-5_3 · Cited by 8
Sentiment analysis of scientific citations
Athar, A. (2014) · Computer Laboratory, University of Cambridge · doi:10.48456/tr-856
Metadata
- Authors
- Liu, B., Hu, M., & Cheng, J.
- Venue
- Proceedings of the 14th international conference on World Wide Web - WWW '05
- Publisher
- ACM Press
- Published
- 2005
- Pages
- 342
- OpenAlex
- W2141631351
- Cited by
- 1,597
- References
- 30
- Type
- conference abstract
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.