The DOI matches its Crossref record; 44 of the 47 references it cites were found in a registry or an index.
Spotting opinion spammers using behavioral footprints
Abstract
Opinionated social media such as product reviews are now widely used by individuals and organizations for their decision making. However, due to the reason of profit or fame, people try to game the system by opinion spamming (e.g., writing fake reviews) to promote or to demote some target products. In recent years, fake review detection has attracted significant attention from both the business and research communities. However, due to the difficulty of human labeling needed for supervised learning and evaluation, the problem remains to be highly challenging. This work proposes a novel angle to the problem by modeling spamicity as latent. An unsupervised model, called Author Spamicity Model (ASM), is proposed. It works in the Bayesian setting, which facilitates modeling spamicity of authors as latent and allows us to exploit various observed behavioral footprints of reviewers. The intuition is that opinion spammers have different behavioral distributions than non-spammers. This creates a distributional divergence between the latent population distributions of two clusters: spammers and non-spammers. Model inference results in learning the population distributions of the two clusters. Several extensions of ASM are also considered leveraging from different priors. Experiments on a real-life Amazon review dataset demonstrate the effectiveness of the proposed models which significantly outperform the state-of-the-art competitors.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We found ASO workers who post fake reviews in rapid bursts in both our qualitative and quantitative investigations.This is consistent with assumptions made in previous fraud detection work, e.g., [26, 28, 32, 36-38, 40, 42, 43, 51, 52, 59-61, 63, 65, 92, 95, 96, 100].”
From The Art and Craft of Fraudulent App Promotion in Google Play (2019) · cites this paper as [36]
In the citing paper
“These results confirm DDA's outcome and previous work on crowdsourced review manipulation, e.g., [36].”
From Fraud De-Anonymization for Fun and Profit (2018) · cites this paper as [36]
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Text categorization with Support Vector Machines: Learning with many relevant features
Joachims, T. (1998) · Lecture notes in computer science · doi:10.1007/bfb0026683 · Cited by 8,271
(2006) · Springer eBooks · Cited by 8,123
Optimizing search engines using clickthrough data
Joachims, T. (2002) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/775047.775067 · Cited by 3,947
Zhu, C., Byrd, R. H., Lu, P., & Nocedal, J. M. (1997) · ACM Transactions on Mathematical Software · doi:10.1145/279232.279236 · Cited by 3,474
Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning
Fayyad, U. M., & Irani, K. B. (1993) · International Joint Conference on Artificial Intelligence · Cited by 2,870
Learning to rank for information retrieval
Liu, T. (2010) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1835449.1835676 · Cited by 1,929
Supervised Topic ModelsPreprint
Blei, D., & McAuliffe, J. D. (2007) · Neural Information Processing Systems · doi:10.48550/arxiv.1003.0783 · Cited by 1,860
Learning to Rank for Information Retrieval
Liu, T. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000016 · Cited by 1,715
Making Large-Scale Support Vector Machine Learning Practical
Joachims, T. (1998) · The MIT Press eBooks · doi:10.7551/mitpress/1130.003.0015 · Cited by 1,639
Jindal, N., & Liu, B. (2008) · Proceedings of the international conference on Web search and web data mining - WSDM '08 · doi:10.1145/1341531.1341560 · Cited by 1,542
Self-citationLying Words: Predicting Deception from Linguistic Styles
Newman, M. L., Pennebaker, J. W., Berry, D. S., & Richards, J. M. (2003) · Personality and Social Psychology Bulletin · doi:10.1177/0146167203029005010 · Cited by 1,489
Ramage, D., Hall, D., Nallapati, R. M., & Manning, C. D. (2009) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1699510.1699543 · Cited by 1,204
Finding Deceptive Opinion Spam by Any Stretch of the Imagination
Ott, M., Choi, Y., Cardie, C., & Hancock, J. T. (2011) · arXiv · doi:10.48550/arxiv.1107.4557 · Cited by 1,008
Spotting fake reviewer groups in consumer reviews
Mukherjee, A., Liu, B., & Glance, N. (2012) · Proceedings of the 21st international conference on World Wide Web · doi:10.1145/2187836.2187863 · Cited by 773
Self-citationDetecting product review spammers using rating behaviors
Lim, E., Nguyen, V.-A., Jindal, N., Liu, B., & Lauw, H. W. (2010) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1871437.1871557 · Cited by 720
Self-citationWhat Yelp Fake Review Filter Might Be Doing?
Mukherjee, A., Venkataraman, V., Liu, B., & Glance, N. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14389 · Cited by 570
Self-citationSyntactic Stylometry for Deception Detection
Feng, S., Banerjee, R., & Choi, Y. (2012) · Cited by 499
Review spam detection via temporal pattern discovery
Xie, S., Wang, G., Lin, S., & Yu, P. S. (2012) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2339530.2339662 · Cited by 406
N-GRAM-BASED AUTHOR PROFILES FOR AUTHORSHIP ATTRIBUTION
Ke, V., Peng, F., Cercone, N. J., & Thomas, C. (2003) · Cited by 395
Learning to identify review spam
Li, F., Huang, M., Yang, Y., & Zhu, X. (2011) · doi:10.5591/978-1-57735-516-8/ijcai11-414 · Cited by 391
Review Graph Based Online Store Review Spammer Detection
Wang, G., Xie, S., Liu, B., & Yu, P. S. (2011) · Proceedings · doi:10.1109/icdm.2011.124 · Cited by 390
Self-citationNetprobe: a fast and scalable system for fraud detection in online auction networks
Pandit, S., Chau, D. H., Wang, S., & Faloutsos, C. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242600 · Cited by 382
Exploiting Burstiness in Reviews for Review Spammer Detection
Fei, G., Mukherjee, A., Liu, B., Hsu, M., Castellanos, M., & Ghosh, R. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14400 · Cited by 356
Self-citationUnderstanding and combating link farming in the twitter social network
Ghosh, S., Viswanath, B., Kooti, F., Sharma, N. K., Korlam, G., Benevenuto, F., Ganguly, N., & Gummadi, K. P. (2012) · International World Wide Web Conference (WWW) · doi:10.1145/2187836.2187846 · Cited by 355
Finding unusual review patterns using unexpected rules
Jindal, N., Liu, B., & Lim, E. (2010) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1871437.1871669 · Cited by 345
Self-citationFusion Via a Linear Combination of Scores
Vogt, C. C., & Cottrell, G. W. (1999) · Information Retrieval · doi:10.1023/a:1009980820262 · Cited by 313
Estimating the prevalence of deception in online review communities
Ott, M., Cardie, C., & Hancock, J. T. (2012) · International World Wide Web Conference (WWW) · doi:10.1145/2187836.2187864 · Cited by 304
Pattern Recognition and Machine Learning
Bharadwaj, Prakash, K. B., & Kanagachidambaresan, G. R. (2021) · EAI/Springer Innovations in Communication and Computing · doi:10.1007/978-3-030-57077-4_11 · Cited by 269
Спирин, Н. А., & Han, J. (2012) · ACM SIGKDD Explorations Newsletter · doi:10.1145/2207243.2207252 · Cited by 250
Mukherjee, A., Liu, B., Wang, J., Glance, N., & Jindal, N. (2011) · International World Wide Web Conference (WWW) · doi:10.1145/1963192.1963240 · Cited by 235
Self-citationDistributional Footprints of Deceptive Product Reviews
Feng, S., Xing, L., Gogar, A., & Choi, Y. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v6i1.14275 · Cited by 217
A reference collection for web spam
Castillo, C., Donato, D., Becchetti, L., Boldi, P., Leonardi, S., Santini, M., & Vigna, S. (2006) · ACM SIGIR Forum · doi:10.1145/1189702.1189703 · Cited by 205
Stochastic versions of the em algorithm: an experimental study in the mixture case
Celeux, G., Chauveau, D., & Diebolt, J. (1996) · Journal of Statistical Computation and Simulation · doi:10.1080/00949659608811772 · Cited by 202
Chirita, P., Diederich, J., & Nejdl, W. (2005) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1099554.1099671 · Cited by 156
Wu, B., Goel, V., & Davison, B. D. (2006) · International World Wide Web Conference (WWW) · doi:10.1145/1135777.1135792 · Cited by 141
Detecting Spam Blogs: A Machine Learning Approach
Kolari, P., Java, A., Finin, T., Oates, T., & Joshi, A. (2006) · Maryland Shared Open Access Repository (USMAI Consortium) · doi:10.13016/m27m0444d · Cited by 127
Wang, Z.-M. (2010) · The B E Journal of Economic Analysis & Policy · doi:10.2202/1935-1682.2523 · Cited by 77
An Unsupervised Learning Algorithm for Rank Aggregation
Klementiev, A., Roth, D., & Small, K. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74958-5_60 · Cited by 75
Summarizing Review Scores of “Unequal” Reviewers
Lauw, H. W., Lim, E., & Wang, K. (2007) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972771.58 · Cited by 40
Large-scale bot detection for search engines
Kang, H., Wang, K., Soukal, D., Behr, F., & Zheng, Z. (2010) · International World Wide Web Conference (WWW) · doi:10.1145/1772690.1772742 · Cited by 34
Joint probabilistic clustering of multivariate and sequential data.
Smyth, P. (1999) · International Conference on Artificial Intelligence and Statistics · Cited by 13
Flagged first, then by citations
3 of the 47 references couldn’t be matched to a known paper.
Research works printed but not linked: 6
- Duda R. O. Hart P. E. and Stork D.J. 2001. Pattern Recognition. Wiley. Duda R. O. Hart P. E. and Stork D.J. 2001. Pattern Recognition. Wiley.
- 10.5555/2283696.2283811 · DOI
- Ramage , D. , Hall , D. , Nallapati , R. , & Manning , C.D. 2009. A supervised topic model for credit attribution in multi-labeled corpora. EMNLP ( 2009 ). Ramage, D., Hall, D., Nallapati, R., & Manning, C.D. 2009. A supervised topic model for credit attribution in multi-labeled corpora. EMNLP (2009).
- Streitfeld , D. 2012. Buy Reviews on Yelp , Get Black Mark. ( 2012 ). Streitfeld, D. 2012. Buy Reviews on Yelp, Get Black Mark. (2012).
- 10.5555/1814490.1814493 · DOI
- 10.5555/945365.964285 · DOI
Cited by
Sorted by citations
Sentiment Analysis: Mining Opinions, Sentiments, and Emotions
Liu, B. (2015) · Cited by 624
Self-citationCollective Opinion Spam Detection: Bridging Review Networks and Metadata
Rayana, S., & Akoglu, L. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783370 · Cited by 604
A review of natural language processing techniques for opinion mining systems
Sun, S., Luo, C., & Chen, J. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.10.004 · Cited by 576
Detecting opinion spams and fake news using text classification
Ahmed, H., Traoré, I., & Saad, S. (2017) · Security and Privacy · doi:10.1002/spy2.9 · Cited by 553
Survey of review spam detection using machine learning techniques
Crawford, M., Khoshgoftaar, T. M., Prusa, J. D., Richter, A. N., & Najada, H. A. (2015) · Journal Of Big Data · doi:10.1186/s40537-015-0029-9 · Cited by 530
Metadata
- Authors
- Mukherjee, A., Kumar, A., Liu, B., Wang, J., Hsu, M., Castellanos, M., & Ghosh, R.
- Affiliations
- University of Illinois Chicago (US)
- Hewlett-Packard (United States) (US)
- HP Labs, Palo Alto, CA, USA
- Venue
- Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
- Publisher
- ACM
- Published
- 2013-08-11
- Pages
- 632-640
- OpenAlex
- W2016266039
- Cited by
- 426
- References
- 47
- Citations by year
- 2026: 3 · 2025: 11 · 2024: 13 · 2023: 21 · 2022: 37 · 2021: 37 · 2020: 61 · 2019: 47 · 2018: 55 · 2017: 47 · 2016: 35 · 2015: 40 · 2014: 17 · 2013: 1
- FWCI
- 24.84
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion)
- Funders
- National Science Foundation
- Topics
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Keywords
- fake review detection, Bayesian clustering, reviewer behavior, Amazon reviews
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review