The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Opinion spam and analysis
Abstract
Evaluative texts on the Web have become a valuable source of opinions on products, services, events, individuals, etc. Recently, many researchers have studied such opinion sources as product reviews, forum posts, and blogs. However, existing research has been focused on classification and summarization of opinions using natural language processing and data mining techniques. An important issue that has been neglected so far is opinion spam or trustworthiness of online opinions. In this paper, we study this issue in the context of product reviews, which are opinion rich and are widely used by consumers and product manufacturers. In the past two years, several startup companies also appeared which aggregate opinions from product reviews. It is thus high time to study spam in reviews. To the best of our knowledge, there is still no published study on this topic, although Web spam and email spam have been investigated extensively. We will see that opinion spam is quite different from Web spam and email spam, and thus requires different detection techniques. Based on the analysis of 5.8 million reviews and 2.14 million reviewers from amazon.com, we show that opinion spam in reviews is widespread. This paper analyzes such spam activities and presents some novel techniques to detect them
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Disinformation can take forms beyond the production of hoaxes or “fake news” (Lazer et al., 2018); and include other types of manipulation of social systems, such as Google bombs to associate a keyword to a URL by repeatedly searching for the keyword and clicking on the URL, or review spam (Jindal and Liu, 2008) to manipulate the reputation of a product/service.”
From Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries (2019) · cites this paper as Jindal and Liu, 2008
Citations
Cites
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
Self-citationThumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
Peter, P., & Turney (2002) · Cited by 3,646
Turney, P. D. (2001) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/1073083.1073153 · Cited by 2,354
Dave, K. S., Lawrence, S., & Pennock, D. M. (2003) · International World Wide Web Conference (WWW) · doi:10.1145/775152.775226 · Cited by 1,925
On the resemblance and containment of documents
Broder, A. (2002) · Compression and Complexity of Sequences (SEQUENCES) · doi:10.1109/sequen.1997.666900 · Cited by 1,818
Extracting product features and opinions from reviews
Popescu, A.-M., & Etzioni, O. (2005) · doi:10.3115/1220575.1220618 · Cited by 1,714
A Bayesian Approach to Filtering Junk E-Mail
Sahami, M., Dumais, S., Heckerman, D. E., & Horvitz, E. (1998) · Cited by 1,212
Web data mining: exploring hyperlinks, contents, and usage data
(2012) · Choice Reviews Online · doi:10.5860/choice.49-2718 · Cited by 1,181
Mining the Web: Discovering Knowledge from Hypertext Data
Chakrabarti, S. (2002) · Thammasat University Digital Collections · Cited by 696
Cited by
Sorted by citations
Opinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,957
Sentiment Analysis and Opinion Mining
Liu, B. (2012) · Synthesis lectures on human language technologies · doi:10.2200/s00416ed1v01y201204hlt016 · Cited by 3,995
Self-citationSentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2017) · Springer eBooks · doi:10.1007/978-1-4899-7687-1_907 · Cited by 3,307
Self-citationSentiment Analysis and Subjectivity
Bing, L. (2010) · Cited by 1,724
Hidden factors and hidden topics
McAuley, J., & Leskovec, J. (2013) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/2507157.2507163 · Cited by 1,565
Metadata
- Authors
- Jindal, N., & Liu, B.
- Affiliations
- University of Illinois Chicago (US)
- ORCID
- Liu, Bing
- Venue
- Proceedings of the international conference on Web search and web data mining - WSDM '08
- Publisher
- ACM Press
- Published
- 2008
- Pages
- 219
- OpenAlex
- W2047756776
- Cited by
- 1,542
- References
- 29
- Citations by year
- 2026: 36 · 2025: 64 · 2024: 71 · 2023: 78 · 2022: 91 · 2021: 112 · 2020: 124 · 2019: 118 · 2018: 128 · 2017: 137 · 2016: 99 · 2015: 137 · 2014: 103 · 2013: 77 · 2012: 77
- Type
- conference abstract
- Language
- en
- Open access
- closed
- Locations
- ACM International Conference on Web Search and Data Mining (WSDM) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Keywords
- opinion spam, spam detection, product reviews, online reviews, review aggregation, Amazon reviews
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review