Finding Deceptive Opinion Spam by Any Stretch of the Imagination
Open accessAbstract
Consumers increasingly rate, review and research products online. Consequently, websites containing consumer reviews are becoming targets of opinion spam. While recent work has focused primarily on manually identifiable instances of opinion spam, in this work we study deceptive opinion spam---fictitious opinions that have been deliberately written to sound authentic. Integrating work from psychology and computational linguistics, we develop and compare three approaches to detecting deceptive opinion spam, and ultimately develop a classifier that is nearly 90% accurate on our gold-standard opinion spam dataset. Based on feature analysis of our learned models, we additionally make several theoretical contributions, including revealing a relationship between deceptive opinions and imaginative writing.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The deceptive reviews dataset from Ott et al. contains 800 truthful and 800 deceptive hotel reviews.
“The dataset of deceptive reviews from Ott et al. [46, 47] has 800 truthful reviews and 800 deceptive reviews for hotels in Chicago.”
From Improving Human-AI Collaboration With Descriptions of AI Behavior (2023) · cites this paper as [47]
Section 3.2 (p. 4) states that the dataset contains 400 truthful and 400 deceptive reviews, for 800 reviews total—not 800 of each. Section 3 (p. 3) confirms that the reviews concern hotels in the Chicago area. (LLM, conf=0.95)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · see citing works
Longman Grammar of Spoken and Written English
Broussard, K. M., Biber, D., Johansson, S., Leech, G., Conrad, S., & Finegan, E. (2000) · TESOL Quarterly · doi:10.2307/3587792 · Cited by 8,193 · see citing works
Text categorization with Support Vector Machines: Learning with many relevant features
Joachims, T. (1998) · Lecture notes in computer science · doi:10.1007/bfb0026683 · Cited by 8,134 · see citing works
Machine learning in automated text categorization
Sebastiani, F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505283 · Cited by 7,927 · see citing works
SRILM - an extensible language modeling toolkit
Stolcke, A. (2002) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.2002-303 · Cited by 4,385 · see citing works
Electronic word-of-mouth in hospitality and tourism management
Litvin, S. W., Goldsmith, R. E., & Pan, B. (2008) · Tourism Management · doi:10.1016/j.tourman.2007.05.011 · Cited by 3,267 · see citing works
Generalized additive models for location, scale and shape.
Rigby, R. A., & Stasinopoulos, D. M. (2005) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/j.1467-9876.2005.00510.x · Cited by 3,228 · see citing works
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/1075096.1075150 · Cited by 3,040 · see citing works
Accuracy of Deception Judgments
Bond, C. F., & DePaulo, B. M. (2006) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr1003_2 · Cited by 1,953 · see citing works
The Development and Psychometric Properties of LIWC2015
Pennebaker, J. W., Boyd, R. L., Jordan, K., & Blackburn, K. (2015) · University of Texas at Austin · doi:10.15781/t25p41 · Cited by 1,674 · see citing works
Making Large-Scale Support Vector Machine Learning Practical
Joachims, T. (1998) · The MIT Press eBooks · doi:10.7551/mitpress/1130.003.0015 · Cited by 1,623 · see citing works
Jindal, N., & Liu, B. (2008) · Proceedings of the international conference on Web search and web data mining - WSDM '08 · doi:10.1145/1341531.1341560 · Cited by 1,542 · see citing works
Support vector machines for spam categorization
Drucker, H., Wu, D., & Vapnik, V. N. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.788645 · Cited by 1,476 · see citing works
Lying Words: Predicting Deception from Linguistic Styles
Newman, M. L., Pennebaker, J. W., Berry, D. S., & Richards, J. M. (2003) · Personality and Social Psychology Bulletin · doi:10.1177/0146167203029005010 · Cited by 1,441 · see citing works
Detecting Lies and Deceit: Pitfalls and Opportunities
Vrij, A. (2008) · Cited by 1,309 · see citing works
Interpersonal Deception Theory
Buller, D. B., & Burgoon, J. K. (1996) · Communication Theory · doi:10.1111/j.1468-2885.1996.tb00127.x · Cited by 1,212 · see citing works
Combating Web Spam with TrustRank
Gyöngyi, Z., García-Molina, H., & Pedersen, J. (2004) · Elsevier eBooks · doi:10.1016/b978-012088469-8.50052-8 · Cited by 1,087 · see citing works
Using linguistic cues for the automatic recognition of personality in conversation and text
Mairesse, F., Walker, M. A., Mehl, M. R., & Moore, R. K. (2007) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2349 · Cited by 1,046 · see citing works
Detecting product review spammers using rating behaviors
Lim, E., Nguyen, V.-A., Jindal, N., Liu, B., & Lauw, H. W. (2010) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1871437.1871557 · Cited by 720 · see citing works
An Empirical Study of Smoothing Techniques for Language ModelingPreprint
Chen, S. F., & Goodman, J. (1996) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9606011 · Cited by 626 · see citing works
Detecting spam web pages through content analysis
Ntoulas, A., Najork, M., Manasse, M. S., & Fetterly, D. (2006) · International World Wide Web Conference (WWW) · doi:10.1145/1135777.1135794 · Cited by 610 · see citing works
Automatically assessing review helpfulness
Kim, S.-M., Pantel, P., Chklovski, T. A., & Marco Pennacchiotti, B. (2006) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1610075.1610135 · Cited by 527 · see citing works
On Lying and Being Lied To: A Linguistic Analysis of Deception in Computer-Mediated Communication
Hancock, J. T., Curry, L. E., Goorha, S., & Woodworth, M. (2007) · Discourse Processes · doi:10.1080/01638530701739181 · Cited by 523 · see citing works
Self-citationApples-to-apples in cross-validation studies: pitfalls in classifier performance measurement
Forman, G., & Scholz, M. (2010) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1882471.1882479 · Cited by 368 · see citing works
Mihalcea, R. F., & Strapparava, C. (2009) · doi:10.3115/1667583.1667679 · Cited by 341 · see citing works
What Lies Beneath: The Linguistic Traces of Deception in Online Dating Profiles
Toma, C. L., & Hancock, J. T. (2012) · Journal of Communication · doi:10.1111/j.1460-2466.2011.01619.x · Cited by 312 · see citing works
Self-citationOutsmarting the liars: The benefit of asking unanticipated questions.
Vrij, A., Leal, S., Granhag, P. A., Mann, S. A., Fisher, R. P., Hillman, J., & Sperry, K. (2008) · Law and Human Behavior · doi:10.1007/s10979-008-9143-y · Cited by 281 · see citing works
Cues to deception and ability to detect lies as a function of police interview styles.
Vrij, A., Mann, S. A., Kristen, S., & Fisher, R. P. (2007) · Law and Human Behavior · doi:10.1007/s10979-006-9066-4 · Cited by 277 · see citing works
A Comparison of Classification Methods for Predicting Deception in Computer-Mediated Communication
Zhou, L., Burgoon, J. K., Twitchell, D. P., Qin, T., & Nunamaker, J. F. (2004) · Journal of Management Information Systems · doi:10.1080/07421222.2004.11045779 · Cited by 249 · see citing works
How opinions are received by online communities
Danescu-Niculescu-Mizil, C., Kossinets, G., Kleinberg, J. M., & Lee, L. (2009) · International World Wide Web Conference (WWW) · doi:10.1145/1526709.1526729 · Cited by 239 · see citing works
Comparison of Deceptive and Truthful Travel Reviews
Yoo, K., & Ulrike Gretzel, B. (2009) · Springer eBooks · doi:10.1007/978-3-211-93971-0_4 · Cited by 230 · see citing works
Estimating Labels from Label Proportions
Quadrianto, N., Smola, A. J., Caetano, T. S., & Le, Q. V. (2009) · doi:10.5555/1577069.1755865 · Cited by 172 · see citing works
Combining Naive Bayes and n-Gram Language Models for Text Classification
Peng, F., & Schuurmans, D. (2003) · Lecture notes in computer science · doi:10.1007/3-540-36618-0_24 · Cited by 170 · see citing works
Distortion as a validation criterion in the identification of suspicious reviews
Wu, G., Greene, D., Smyth, B., & Cunningham, P. (2010) · doi:10.1145/1964858.1964860 · Cited by 159 · see citing works
Learning to recommend helpful hotel reviews
O’Mahony, M. P., & Smyth, B. (2009) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/1639714.1639774 · Cited by 150 · see citing works
Modeling Statistical Properties of Written Text
Serrano, M. Á., Flammini, A., & Menczer, F. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005372 · Cited by 128 · see citing works
Grammatical word class variation within the British National Corpus Sampler
Rayson, P., Wilson, A., & Leech, G. (2002) · BRILL eBooks · doi:10.1163/9789004334113_020 · Cited by 104 · see citing works
A Statistical Language Modeling Approach to Online Deception Detection
Zhou, L., Shi, Y., & Zhang, D. (2008) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2007.190624 · Cited by 98 · see citing works
Credibility improves topical blog post retrieval
Weerkamp, W., & de Rijke, M. (2008) · UvA-DARE (University of Amsterdam) · Cited by 97 · see citing works
Automatically assessing the post quality in online discussions on software
Weimer, M., Gurevych, I., & Mühlhäuser, M. (2007) · doi:10.3115/1557769.1557806 · Cited by 97 · see citing works
Amazon Mechanical Turk for Subjectivity Word Sense Disambiguation
Akkaya, C., Conrad, A. P., Wiebe, J., & Mihalcea, R. F. (2010) · University of North Texas Digital Library (University of North Texas) · Cited by 68 · see citing works
An Exploration of Off Topic Conversation
Cade, W., Lehman, B. A., & Olney, A. M. (2010) · Cited by 12 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- [6]6. the North American Chapter of the Association for Computational Linguistics , pages 669-672. Association for Computational Linguistics.
- [17]17. M.K. Johnson and C.L. Raye. 1981. Reality monitoring. Psychological Review , 88(1):67-85.
Cited by
Sorted by citations
Sentiment Analysis and Opinion Mining
Liu, B. (2012) · Synthesis lectures on human language technologies · doi:10.2200/s00416ed1v01y201204hlt016 · Cited by 3,837 · see citing works
Sentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2017) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7687-1_907 · Cited by 3,299 · see citing works
"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detection
Wang, W. Y. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-2067 · Cited by 1,822 · see citing works
Graph based anomaly detection and description: a survey
Akoglu, L., Tong, H., & Koutra, D. (2015) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-014-0365-y · Cited by 1,504 · see citing works
A survey on opinion mining and sentiment analysis: Tasks, approaches and applications
Ravi, K., & Ravi, V. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.06.015 · Cited by 1,319 · see citing works
An overview of online fake news: Characterization, detection, and discussion
Zhang, X., & Ghorbani, A. A. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2019.03.004 · Cited by 997 · see citing works
Truth of Varying Shades: Analyzing Language in Fake News and Political Fact-Checking
Rashkin, H., Choi, E., Jang, J. Y., Volkova, S., & Choi, Y. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1317 · Cited by 917 · see citing works
Self-citationPromotional Reviews: An Empirical Investigation of Online Review Manipulation
Mayzlin, D., Dover, Y., & Chevalier, J. (2014) · American Economic Review · doi:10.1257/aer.104.8.2421 · Cited by 937 · see citing works
Spotting fake reviewer groups in consumer reviews
Mukherjee, A., Liu, B., & Glance, N. (2012) · Proceedings of the 21st international conference on World Wide Web · doi:10.1145/2187836.2187863 · Cited by 773 · see citing works
Automatic Detection of Fake NewsPreprint
Pérez‐Rosas, V., Kleinberg, B., Lefevre, A., & Mihalcea, R. F. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.07104 · Cited by 709 · see citing works
A survey on sentiment analysis challenges
Hussein, D. M. E.-D. M. (2016) · Journal of King Saud University - Engineering Sciences · doi:10.1016/j.jksues.2016.04.002 · Cited by 669 · see citing works
Salehan, M., & Kim, D. J. (2015) · Decision Support Systems · doi:10.1016/j.dss.2015.10.006 · Cited by 588 · see citing works
What Yelp Fake Review Filter Might Be Doing?
Mukherjee, A., Venkataraman, V., Liu, B., & Glance, N. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14389 · Cited by 564 · see citing works
Machine learning for email spam filtering: review, approaches and open research problems
Dada, E., Bassi, J. S., Chiroma, H., Abdulhamid, S., Adetunmbi, A., & Ajibuwa, O. (2019) · Heliyon · doi:10.1016/j.heliyon.2019.e01802 · Cited by 490 · see citing works
Survey of review spam detection using machine learning techniques
Crawford, M., Khoshgoftaar, T. M., Prusa, J. D., Richter, A. N., & Najada, H. A. (2015) · Journal Of Big Data · doi:10.1186/s40537-015-0029-9 · Cited by 513 · see citing works
Syntactic Stylometry for Deception Detection
Feng, S., Banerjee, R., & Choi, Y. (2012) · Cited by 499 · see citing works
Self-citationCommon Sense Reasoning for Detection, Prevention, and Mitigation of Cyberbullying
Dinakar, K., Jones, B., Havasi, C., Lieberman, H. A., & Picard, R. W. (2012) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2362394.2362400 · Cited by 434 · see citing works
Spotting opinion spammers using behavioral footprints
Mukherjee, A., Kumar, A., Liu, B., Wang, J., Hsu, M., Castellanos, M., & Ghosh, R. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2487580 · Cited by 426 · see citing works
Sentiment Analysis: An Overview from Linguistics
Taboada, M. (2015) · Annual Review of Linguistics · doi:10.1146/annurev-linguistics-011415-040518 · Cited by 425 · see citing works
Empath: Understanding Topic Signals in Large-Scale Text
Fast, E., Chen, B., & Bernstein, M. S. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858535 · Cited by 413 · see citing works
Review spam detection via temporal pattern discovery
Xie, S., Wang, G., Lin, S., & Yu, P. S. (2012) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2339530.2339662 · Cited by 398 · see citing works
Opinion Fraud Detection in Online Reviews by Network Effects
Akoglu, L., Chandy, R., & Faloutsos, C. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14380 · Cited by 398 · see citing works
Review Graph Based Online Store Review Spammer Detection
Wang, G., Xie, S., Liu, B., & Yu, P. S. (2011) · Proceedings · doi:10.1109/icdm.2011.124 · Cited by 390 · see citing works
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286 · Cited by 390 · see citing works
Fake online reviews: Literature review, synthesis, and directions for future research
Wu, Y., Ngai, E. W. T., Wu, P., & Wu, C. (2020) · Decision Support Systems · doi:10.1016/j.dss.2020.113280 · Cited by 380 · see citing works
Lai, V., & Tan, C. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287590 · Cited by 377 · see citing works
Towards a General Rule for Identifying Deceptive Opinion Spam
Li, J., Ott, M., Cardie, C., & Hovy, E. H. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-1147 · Cited by 375 · see citing works
Self-citation(2013)
Self-citationExploiting Burstiness in Reviews for Review Spammer Detection
Fei, G., Mukherjee, A., Liu, B., Hsu, M., Castellanos, M., & Ghosh, R. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14400 · Cited by 352 · see citing works
Creating and detecting fake reviews of online products
Salminen, J. O., Kandpal, C. S., Kamel, A. M., Jung, S., & Jansen, B. J. J. (2021) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2021.102771 · Cited by 340 · see citing works
The social impact of natural language processing
Hovy, D., & Spruit, S. L. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p16-2096 · Cited by 329 · see citing works
Estimating the prevalence of deception in online review communities
Ott, M., Cardie, C., & Hancock, J. T. (2012) · International World Wide Web Conference (WWW) · doi:10.1145/2187836.2187864 · Cited by 304 · see citing works
Self-citationDetection of review spam: A survey
Heydari, A., Tavakoli, M. A., Salim, N. B., & Heydari, Z. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.12.029 · Cited by 301 · see citing works
A framework for fake review detection in online consumer electronics retailers
Barbado, R., Araque, Ó., & Iglesias, C. Á. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.03.002 · Cited by 300 · see citing works
Reviews without a Purchase: Low Ratings, Loyal Customers, and Deception
Anderson, E. T., & Simester, D. I. (2014) · Journal of Marketing Research · doi:10.1509/jmr.13.0209 · Cited by 292 · see citing works
Credibility of Anonymous Online Product Reviews: A Language Expectancy Perspective
Jensen, M. L., Averbeck, J. M., Zhang, Z., & Wright, K. B. (2013) · Journal of Management Information Systems · doi:10.2753/mis0742-1222300109 · Cited by 289 · see citing works
Spam Review Detection with Graph Convolutional Networks
Li, A., Qin, Z., Liu, R., Yang, Y., & Li, D. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3357820 · Cited by 268 · see citing works
Data Analytics for the Identification of Fake Reviews Using Supervised Learning
Alsubari, S. N. (2021) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2022.019625 · Cited by 264 · see citing works
Socially Responsible AI Algorithms: Issues, Purposes, and Challenges
Cheng, L., Varshney, K. R., & Liu, H. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12814 · Cited by 261 · see citing works
Kauffmann, E., Peral, J., Gil, D., Ferrández, A., Rubio, R. S., & Mora, H. (2019) · Industrial Marketing Management · doi:10.1016/j.indmarman.2019.08.003 · Cited by 255 · see citing works
Sentiment Analysis for Fake News Detection
Alonso, M. Á., Vilares, D., Gómez‐Rodríguez, C., & Vilares, J. (2021) · Electronics · doi:10.3390/electronics10111348 · Cited by 253 · see citing works
SDTE: A Secure Blockchain-Based Data Trading Ecosystem
Dai, W., Dai, C., Choo, K. R., Cui, C., Zou, D., & Jin, H. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2928256 · Cited by 246 · see citing works
Communication Processes in Participatory Websites
Walther, J. B., & Jang, J.-W. (2012) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2012.01592.x · Cited by 246 · see citing works
Automated Fact Checking: Task formulations, methods and future directionsPreprint
Thorne, J. P., & Vlachos, A. (2018) · arXiv (Cornell University) · doi:10.17863/cam.78745 · Cited by 245 · see citing works
Neural networks for deceptive opinion spam detection: An empirical study
Ren, Y., & Ji, D. (2017) · Information Sciences · doi:10.1016/j.ins.2017.01.015 · Cited by 240 · see citing works
Veracity Roadmap: Is Big Data Objective, Truthful and Credible?
Lukoianove, T., & Rubin, V. L. (2014) · Advances in Classification Research Online · doi:10.7152/acro.v24i1.14671 · Cited by 233 · see citing works
Fake Reviews Detection: A Survey
Mohawesh, R., Xu, S., Tran, S. N., Ollington, R., Springer, M., Jararweh, Y., & Maqsood, S. (2021) · IEEE Access · doi:10.1109/access.2021.3075573 · Cited by 231 · see citing works
A review on social spam detection: Challenges, open issues, and future directions
Rao, S., Verma, A. K., & Bhatia, T. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115742 · Cited by 225 · see citing works
Detecting and Monitoring Hate Speech in Twitter
Pereira-Kohatsu, J. C., Quijano-Sánchez, L., Liberatore, F., & Camacho‐Collados, M. (2019) · Sensors · doi:10.3390/s19214654 · Cited by 220 · see citing works
Distributional Footprints of Deceptive Product Reviews
Feng, S., Xing, L., Gogar, A., & Choi, Y. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v6i1.14275 · Cited by 217 · see citing works
Self-citationInterpretable Rumor Detection in Microblogs by Attending to User Interactions
Khoo, L. M. S., Chieu, H. L., Zhong, Q., & Jiang, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6405 · Cited by 210 · see citing works
Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanations
Schemmer, M., Kuehl, N., Benz, C., Bartos, A., & Satzger, G. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584066 · Cited by 208 · see citing works
Identify Online Store Review Spammers via Social Review Graph
Wang, G., Xie, S., Liu, B., & Yu, P. S. (2012) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2337542.2337546 · Cited by 200 · see citing works
Serf and turf: crowdturfing for fun and profit
Wang, G., Wilson, C., Zhao, X., Zhu, Y., Mohanlal, M., Zheng, H., & Zhao, B. Y. (2012) · Proceedings of the 21st international conference on World Wide Web · doi:10.1145/2187836.2187928 · Cited by 197 · see citing works
Zhao, Y., Da, J., & Yan, J. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102390 · Cited by 196 · see citing works
Hotels׳ responses to online reviews: Managing consumer dissatisfaction
Zhang, Y., & Vásquez, C. (2014) · Discourse Context & Media · doi:10.1016/j.dcm.2014.08.004 · Cited by 193 · see citing works
When good WOM hurts and bad WOM gains: The effect of untrustworthy online reviews
Reimer, T., & Benkenstein, M. (2016) · Journal of Business Research · doi:10.1016/j.jbusres.2016.05.014 · Cited by 192 · see citing works
Exploring Demographic Language Variations to Improve Multilingual Sentiment Analysis in Social Media
Volkova, S., Wilson, T., & Yarowsky, D. (2013) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d13-1187 · Cited by 191 · see citing works
Computational Argumentation Quality Assessment in Natural Language
Wachsmuth, H., Naderi, N., Hou, Y., Bilu, Y., Prabhakaran, V., Thijm, T. A., Hirst, G., & Stein, B. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1017 · Cited by 190 · see citing works
Hajek, P., Barushka, A., & Munk, M. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-04757-2 · Cited by 186 · see citing works
Battling the internet water army
Chen, C., Wu, K., Srinivasan, V., & Zhang, X. (2013) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1145/2492517.2492637 · Cited by 184 · see citing works
Taking fake online consumer reviews seriously
Malbon, J. (2013) · Journal of Consumer Policy · doi:10.1007/s10603-012-9216-7 · Cited by 183 · see citing works
Mobile phishing attacks and defence mechanisms: State of art and open research challenges
Goel, D., & Jain, A. K. (2017) · Computers & Security · doi:10.1016/j.cose.2017.12.006 · Cited by 182 · see citing works
Detecting positive and negative deceptive opinions using PU-learning
Fusilier, D. H., Montes-y-Gómez, M., Rosso, P., & Guzmán-Cabrera, R. (2014) · Information Processing & Management · doi:10.1016/j.ipm.2014.11.001 · Cited by 176 · see citing works
hPSD: A Hybrid PU-Learning-Based Spammer Detection Model for Product Reviews
Wu, Z., Cao, J., Wang, Y., Wang, Y., Zhang, L., & Wu, J. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2877161 · Cited by 166 · see citing works
Fake news detection: A survey of graph neural network methods
Phan, H. T., Nguyên, N. T., & Hwang, D. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110235 · Cited by 165 · see citing works
NetSpam: A Network-Based Spam Detection Framework for Reviews in Online Social Media
Shehnepoor, S., Salehi, M., Farahbakhsh, R., & Crespi, N. (2017) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2017.2675361 · Cited by 163 · see citing works
Uncovering collusive spammers in Chinese review websites
Xu, C., Zhang, J., Chang, K., & Long, C. (2013) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2505515.2505700 · Cited by 159 · see citing works
Munzel, A. (2016) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2016.06.002 · Cited by 159 · see citing works
Choraś, M., Demestichas, K. P., Giełczyk, A., Herrero, Á., Ksieniewicz, P., Remoundou, K., Urda, D., & Woźniak, M. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.107050 · Cited by 158 · see citing works
Weak Supervision for Fake News Detection via Reinforcement Learning
Wang, Y., Yang, W., Ma, F., Xu, J., Zhong, B., Deng, Q., & Gao, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5389 · Cited by 157 · see citing works
Multi-Source Multi-Class Fake News Detection
Karimi, H. R., Roy, P. C., Saba-Sadiya, S., & Tang, J. (2018) · International Conference on Computational Linguistics · Cited by 156 · see citing works
The promise and peril of real-time corrections to political misperceptions
Garrett, R., & Weeks, B. E. (2013) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2441776.2441895 · Cited by 155 · see citing works
Document representation and feature combination for deceptive spam review detection
Li, L., Qin, B., Ren, W., & Liu, T. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.10.080 · Cited by 154 · see citing works
Detecting deceptive reviews using lexical and syntactic features
Shojaee, S., Murad, M. A. A., Azman, A., Sharef, N. M., & Nadali, S. (2013) · International Conference on Intelligent Systems Design and Applications (ISDA) · doi:10.1109/isda.2013.6920707 · Cited by 147 · see citing works
Learning Hierarchical Discourse-level Structure for Fake News Detection
Karimi, H., & Tang, J. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1347 · Cited by 146 · see citing works
Wang, Q., Zhang, W., Li, J., Mai, F., & Ma, Z. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107272 · Cited by 146 · see citing works
Man vs. machine: practical adversarial detection of malicious crowdsourcing workers
Wang, G., Wang, T., Zhang, H., & Zhao, B. Y. (2014) · Cited by 142 · see citing works
Bimodal Distribution and Co-Bursting in Review Spam Detection
Li, H., Fei, G., Wang, S., Liu, B., Shao, W., Mukherjee, A., & Shao, J. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052582 · Cited by 141 · see citing works
Ginger Cannot Cure Cancer: Battling Fake Health News with a Comprehensive Data Repository
Dai, E., Sun, Y., & Wang, S. (2020) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v14i1.7350 · Cited by 134 · see citing works
User-Generated Content and Social Media
Luca, M. (2015) · Handbook of media economics · doi:10.1016/b978-0-444-63685-0.00012-7 · Cited by 130 · see citing works
Revisiting Semi-Supervised Learning for Online Deceptive Review Detection
Rout, J. K., Dalmia, A., Choo, K. R., Bakshi, S., & Jena, S. K. (2017) · IEEE Access · doi:10.1109/access.2017.2655032 · Cited by 130 · see citing works
Plotkina, D., Munzel, A., & Pallud, J. (2018) · Journal of Business Research · doi:10.1016/j.jbusres.2018.12.009 · Cited by 130 · see citing works
Automatic Detection of Online Recruitment Frauds: Characteristics, Methods, and a Public Dataset
Vidros, S., Kolias, C., Kambourakis, G., & Akoglu, L. (2017) · Future Internet · doi:10.3390/fi9010006 · Cited by 127 · see citing works
"Why is 'Chicago' deceptive?" Towards Building Model-Driven Tutorials for Humans
Lai, V., Liu, H., & Tan, C. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376873 · Cited by 123 · see citing works
Fake review detection on online E-commerce platforms: a systematic literature review
Paul, H., & Nikolaev, A. G. (2021) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-021-00772-6 · Cited by 123 · see citing works
An Evaluation of the Brazilian Portuguese LIWC Dictionary for Sentiment Analysis
Filho, P. P. B., Pardo, T. A. S., & Aluísio, S. M. (2013) · Cited by 122 · see citing works
Zhang, W., Du, Y., Yoshida, T., & Wang, Q. (2018) · Information Processing & Management · doi:10.1016/j.ipm.2018.03.007 · Cited by 120 · see citing works
Spam Review Detection Techniques: A Systematic Literature Review
Hussain, N., Mirza, H. T., Rasool, G., Hussain, I., & Kaleem, M. (2019) · Applied Sciences · doi:10.3390/app9050987 · Cited by 119 · see citing works
A review of feature selection methods based on meta-heuristic algorithms
Sadeghian, Z., Akbari, E., Nematzadeh, H., & Motameni, H. (2023) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/0952813x.2023.2183267 · Cited by 119 · see citing works
BIRDNEST: Bayesian Inference for Ratings-Fraud Detection
Hooi, B., Shah, N., Beutel, A., Günnemann, S., Akoglu, L., Kumar, M., Makhija, D., & Faloutsos, C. (2016) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611974348.56 · Cited by 118 · see citing works
A Review on Mobile SMS Spam Filtering Techniques
Abdulhamid, S. M., Latiff, M. S. A., Chiroma, H., Osho, O., Abdul-Salaam, G., Abubakar, A., & Herawan, T. (2017) · IEEE Access · doi:10.1109/access.2017.2666785 · Cited by 118 · see citing works
Detection of fake opinions using time series
Heydari, A., Tavakoli, M. A., & Salim, N. B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.03.020 · Cited by 117 · see citing works
Analyzing and Detecting Opinion Spam on a Large-scale Dataset via Temporal and Spatial Patterns
Li, H., Chen, Z., Mukherjee, A., Liu, B., & Shao, J. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v9i1.14652 · Cited by 116 · see citing works
Detecting Deceptive Reviews Using Generative Adversarial Networks
Aghakhani, H., Machiry, A., Nilizadeh, S., Kruegel, C., & Vigna, G. (2018) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw.2018.00022 · Cited by 114 · see citing works
Misinformation and How to Correct It
Cook, J., Ecker, U. K. H., & Lewandowsky, S. (2015) · Emerging Trends in the Social and Behavioral Sciences · doi:10.1002/9781118900772.etrds0222 · Cited by 95 · see citing works
Linguistic Obfuscation in Fraudulent Science
Markowitz, D. M., & Hancock, J. T. (2015) · Journal of Language and Social Psychology · doi:10.1177/0261927x15614605 · Cited by 113 · see citing works
Self-citationFrom conflicts and confusion to doubts: Examining review inconsistency for fake review detection
Shan, G., Zhou, L., & Zhang, D. (2021) · Decision Support Systems · doi:10.1016/j.dss.2021.113513 · Cited by 113 · see citing works
Extracting relevant knowledge for the detection of sarcasm and nastiness in the social web
Justo, R., Corcoran, T., Lukin, S. M., Walker, M., & Torres, M. I. (2014) · Knowledge-Based Systems · doi:10.1016/j.knosys.2014.05.021 · Cited by 112 · see citing works
- Authors
- Ott, M., Choi, Y., Cardie, C., & Hancock, J. T.
- Affiliations
- Cornell University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2011
- Pages
- 309-319
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1107.4557
- OpenAlex
- W2161283199
- Cited by
- 1,008
- References
- 42
- Citations by year
- 2026: 1 · 2025: 30 · 2024: 57 · 2023: 72 · 2022: 74 · 2021: 106 · 2020: 114 · 2019: 103 · 2018: 89 · 2017: 88 · 2016: 49 · 2015: 68 · 2014: 65 · 2013: 47 · 2012: 43
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (0624267, 0904822, 0968450)
- Jack Kent Cooke Foundation
- Topics
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- opinion spam, opinion spam detection, consumer reviews, fake reviews, creative writing, feature analysis, classifier comparison, psychology of deception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
