The DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index.
Finding Deceptive Opinion Spam by Any Stretch of the Imagination
Open accessAbstract
Consumers increasingly rate, review and research products online. Consequently, websites containing consumer reviews are becoming targets of opinion spam. While recent work has focused primarily on manually identifiable instances of opinion spam, in this work we study deceptive opinion spam---fictitious opinions that have been deliberately written to sound authentic. Integrating work from psychology and computational linguistics, we develop and compare three approaches to detecting deceptive opinion spam, and ultimately develop a classifier that is nearly 90% accurate on our gold-standard opinion spam dataset. Based on feature analysis of our learned models, we additionally make several theoretical contributions, including revealing a relationship between deceptive opinions and imaginative writing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“The dataset of deceptive reviews from Ott et al. [46, 47] has 800 truthful reviews and 800 deceptive reviews for hotels in Chicago.”
From Improving Human-AI Collaboration With Descriptions of AI Behavior (2023) · cites this paper as [47]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Text categorization with Support Vector Machines: Learning with many relevant features
Joachims, T. (1998) · Lecture notes in computer science · doi:10.1007/bfb0026683 · Cited by 8,271
Machine learning in automated text categorization
Sebastiani, F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505283 · Cited by 7,927
SRILM - an extensible language modeling toolkit
Stolcke, A. (2002) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.2002-303 · Cited by 4,385
Electronic word-of-mouth in hospitality and tourism management
Litvin, S. W., Goldsmith, R. E., & Pan, B. (2008) · Tourism Management · doi:10.1016/j.tourman.2007.05.011 · Cited by 3,267
Generalized additive models for location, scale and shape.
Rigby, R. A., & Stasinopoulos, D. M. (2005) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/j.1467-9876.2005.00510.x · Cited by 3,228
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1075096.1075150 · Cited by 3,055
Longman Grammar of Spoken and Written English
Biber, D., & Quirk, R. (1999) · TESOL Quarterly · doi:10.2307/3587792 · Cited by 2,766
Accuracy of Deception Judgments
Bond, C. F., & DePaulo, B. M. (2006) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr1003_2 · Cited by 1,953
The Development and Psychometric Properties of LIWC2015
Pennebaker, J. W., Boyd, R. L., Jordan, K., & Blackburn, K. (2015) · University of Texas at Austin · doi:10.15781/t25p41 · Cited by 1,674
Research works printed but not linked: 2
- [6]6. the North American Chapter of the Association for Computational Linguistics , pages 669-672. Association for Computational Linguistics.
- [17]17. M.K. Johnson and C.L. Raye. 1981. Reality monitoring. Psychological Review , 88(1):67-85.
Cited by
Sorted by citations
Items 901–1,000 of 1,002
Spam Detection using Sentiment Analysis of Text
Vignesh, N. (2019) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2019.3413 · Cited by 1
A Review of Machine Learning Techniques for Anomaly Detection in Static Graphs
Al-Ammal, H. (2020) · Advances in computational intelligence and robotics book series · doi:10.4018/978-1-7998-2418-3.ch007 · Cited by 1
Pascucci, A., Manna, R., Caterino, C., Masucci, V., & Monti, J. (2020) · ARCHIVIO ISTITUZIONALE DELLA RICERCA-UNIVERSITA DEGLI STUDI DI NAPOLI "LORIENTALE" · Cited by 1
Bhargavi, C. V., Mani, G., Jyothi, G. D., Rao, K. V., & Lydia, E. L. (2020) · Journal of Computational and Theoretical Nanoscience · doi:10.1166/jctn.2020.9440 · Cited by 1
Spam Detection on Indonesian Beauty Product Review
Athallah, M. A., & Romadhony, A. (2021) · doi:10.1109/icoict52021.2021.9527409 · Cited by 1
Social-Media-Analyse in der Forschung
Alexa, M., & Siegel, M. (2021) · Springer eBooks · doi:10.1007/978-3-658-33468-0_10 · Cited by 1
Identifying Deceptive Reviews: Using Linguistic and Spammer Behaviour
Deepika, D. S., Sowmya, A., Sravani, M., Priyanka, C. L., & Ashesh, K. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-84760-9_49 · Cited by 1
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286.008 · Cited by 1
The Impact of Applying Different Pre-Processing Techniques on Swahili Textual Data Using Doc2Vec
Masua, B., Masasi, N., Maziku, H. H., & Mbwilo, B. (2023) · Natural Language Processing Research · doi:10.55060/j.nlpre.230606.001 · Cited by 1
Krishnan, A., & MARİAFRANCİS, K. (2023) · Advances in Artificial Intelligence Research · doi:10.54569/aair.1329048 · Cited by 1
Reframing and Broadening Adversarial Stylometry for Academic Integrity
Carmichael, J. J. (2023) · Springer eBooks · doi:10.1007/978-3-031-39989-3_148 · Cited by 1
Detecting AI-enhanced Opinion Spambots: a study on LLM-generated Hotel Reviews
Liyanage, V. P., Buscaldi, D., & Forcioli, P. (2024) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2f38ozj22imf · Cited by 1
Aspect-based opinion mining of customer reviews
Hai, Z. (2014) · doi:10.32657/10356/61830 · Cited by 1
Da Navalha de Occam a um método de categorização de textos simples, eficiente e robusto
Silva, R. M. (2017) · doi:10.47749/t/unicamp.2017.980306 · Cited by 1
Ziwei, Z., Xu, C., Kesavan, S., & Staats, B. R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4584968 · Cited by 1
Mixed Spatial and Nonspatial Problems in Location Based Services
Ballesteros, J. (2013) · doi:10.25148/etd.fi13080907
A Framework for Knowledge Derivation Incorporating Trust and Quality of Data
Kuehnhausen, M. (2013) · KU ScholarWorks (University of Kansas)
Keshavarz, F. (2013) · Libraries and Cultural Resources (University of Calgary) · doi:10.11575/prism/28486
A POS Tagging Approach to Capture Security Requirements within an Agile Software Development Process
Tetmeyer, A. (2013) · KU ScholarWorks (The University of Kansas)
Framework for Opinion Spammers Detection
Opaliński, A., & Dobrowolski, G. (2014) · Communications in computer and information science · doi:10.1007/978-3-319-07569-3_17
Modeling and predicting trustworthiness of online textual information
Vydiswaran, V. V. (2013) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
A Cross-domain Deceptive Opinion Detection by Genetic Algorithm
Tang, Q.-J., Li, W., & Zhao, J. (2016) · Advances in engineering research/Advances in Engineering Research · doi:10.2991/icmmct-16.2016.123
Data Verifications for Online Social Networks
Rahman, M. (2015) · doi:10.25148/etd.fidc000196
SRC MODEL TO IDENTIFY BEGUILING REVIEWS
Gera, T., Thakur, D. S., & Singh, J. (2015) · Journal on Today s Ideas-Tomorrow s Technologies · doi:10.15415/jotitt.2015.31003
Three Essays on Social Media: the Effect of Motivation, Participation, and Sentiment on Performance
Salehan, M. (2015) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc804892
Chapter 3. Computer studies of Shakespearean authorship
(2014) · Natural language processing · doi:10.1075/nlp.12.03ch3
Chapter 2. Plagiarism and spam filtering
(2014) · Natural language processing · doi:10.1075/nlp.12.02ch2
Chapter 1. Author identification
(2014) · Natural language processing · doi:10.1075/nlp.12.01ch1
Chapter 4. Stylometric analysis of religious texts
(2014) · Natural language processing · doi:10.1075/nlp.12.04ch4
Chapter 5. Computers and decipherment
(2014) · Natural language processing · doi:10.1075/nlp.12.05ch5
Predicting Restaurant Consumption Level through Social Media Footprints
Yang, X., Wang, Y., Mao, H., & Xiao, Z. (2016) · International Conference on Computational Linguistics
A Computational Approach to Find Deceptive Opinions by Using Psycholinguistic Clues
Saini, M., & Sharan, A. (2017) · International Journal of Engineering and Technology · doi:10.21817/ijet/2017/v9i3/1709030248
but…': constructing identities in user-generated online reviews
Vásquez, C. (2014)
La movilidad de los rankings de hoteles en Europa: El caso de Tripadvisor
de Sandoval, J. L. X., Plaza, A. J. G., & Morales, A. (2017) · International Journal of World of Tourism · doi:10.12795/ijwt.2017.i07.02
Recommending Rating Values on Reviews for Designers
Jin, J., Ji, P., & Liu, Y. (2014) · IGI Global eBooks · doi:10.4018/978-1-4666-5202-6.ch180
Detecting Anomalous Reviewers and Estimating Summaries from Early Reviews Considering Heterogeneity
Asano, Y., & Kawamoto, J. (2018) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2017dap0006
Survey on Tasks and Approaches of Sentiment Analysis
Muralidharan, C., & Anitha, R. (2018) · International Conference for Phoenixes on Emerging Current Trends in Engineering and Management (PECTEAM) · doi:10.2991/pecteam-18.2018.16
Monitor of the Beholder: Identification of Personal Characteristics in Online Text
Saleh, J. K. (2013) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r3v40k724
Spammer Community Used for Spam Detection in Online Social Media Reviews
Arun., K. (2018) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2018.4313
Detection of Fake Users Account Based on Review
Dwivedi, M. N. (2018) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2018.6005
Digitale læringsressurser i høyere musikkutdanning
Tollefsen, M. M., & Blix, H. S. (2018) · Journal for Research in Arts and Sports Education · doi:10.23865/jased.v2.918
Advanced Mechanism for Finding Spammers in Social Media
Mohideen, N., Lal, A., & Raju, A. E. (2018) · International Journal of Computer Applications · doi:10.5120/ijca2018917115
Netspam: An Efficient Approach to Prevent Spam Messages using Support Vector Machine
Kiran, P. S., Chowdary, K. P., & Kumar, T. T. V. R. K. V. (2018) · International Journal of Trend in Scientific Research and Development · doi:10.31142/ijtsrd11419
Semantic Indexing-Based Data Augmentation for Filtering Undesired Short Text Messages
Lochter, J. V., Silva, R. M., Almeida, T. A., & Yamakami, A. (2018) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2018.00169
Search Rank Fraud Prevention in Online Systems
Rahman, M. M. (2018) · doi:10.25148/etd.fidc006998
Formulaic Sequences as a Potential Marker of Deception: A Preliminary Investigation
Larner, S. (2019) · Springer eBooks · doi:10.1007/978-3-319-96334-1_17
Liu, N., Dong, L., & Ji, S. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-981-13-5841-8_58
Socially-Attentive Representation Learning for Cold-Start Fraud Review Detection
Da, Q., Cheng, J., Li, Q., & Zhao, W. (2019) · Communications in computer and information science · doi:10.1007/978-981-15-0105-0_6
DBMS-KU Approach for Author Profiling and Deception Detection in Arabic.
Siagian, A. H. A. M., & Aritsugi, M. (2019) · FIRE (Working Notes)
Inquiry Spam Detection via Jointly Exploiting Temporal-Categorical Behavior and Linguistics
Zhong, Q., Tang, J., Feng, J., & Chi, J. (2019) · Proceedings · doi:10.1109/icdm.2019.00200
Identifying Deceptive Reviews: Feature Exploration, Model Transferability and Classification Attack
Lozano, M. G., & Fernquist, J. (2019) · European Intelligence and Security Informatics Conference · doi:10.1109/eisic49498.2019.9108852
Research on Online Detection Method of E-commerce False Comments Based on LBP
Kunasekaran, K. K. H., & Han, L. (2020) · Asia-pacific Journal of Convergent Research Interchange · doi:10.47116/apjcri.2020.08.14
The Impact of Key Ideas on Automatic Deception Detection in Text
Hernández-Castañeda, Á., Hernández, R. A. G., Ledeneva, Y. N., & Millán-Hernández, C. E. (2020) · Computación y Sistemas · doi:10.13053/cys-24-3-3483
Automatic Annotation of Deceptive Online Reviews Using Topic Modelling
Pramukha, R. N., & Venugopala, P. S. (2020) · Communications in computer and information science · doi:10.1007/978-981-33-6463-9_4
Peng, Y.-C., Cheng, M. S., & Hsu, P. (2020) · International Computer Symposium · doi:10.1109/ics51289.2020.00070
Evaluating Deception Detection Model Robustness To Linguistic Variation
Glenski, M., Ayton, E., Cosbey, R., Arendt, D., & Volkova, S. (2021) · International Workshop on Natural Language Processing for Social Media (SocialNLP) · doi:10.18653/v1/2021.socialnlp-1.6
A study of Media Polarization with Stylometry Methods
Hu, Y., & Rayz, J. T. (2021) · Proceedings of the ... International Florida Artificial Intelligence Research Society Conference · doi:10.32473/flairs.v34i1.128477
Peer Review #2 of "Using of n-grams from morphological tags for fake news classification (v0.1)"
(2021) · PeerJ Computer Science · doi:10.7287/peerj-cs.624v0.1/reviews/2
The Deceptive Practice of Faking the System: The Case of Rome B&Bs ReviewsPreprint
Barone, R., Side, D. D., & Vergori, A. S. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3254286
Linguistic Cues of Deception in a Multilingual April Fools’ Day Context
Papantoniou, K., Papadakos, P., Flouris, G., & Plexousakis, D. (2022) · Accademia University Press eBooks · doi:10.4000/books.aaccademia.10763
An Efficient QR Methodology for Authentication of Reviews in Hospitality Sector
Khan, M. (2021) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2021.39115
Spam analysis and detection on microblog
Sedhai, S. (2017) · doi:10.32657/10356/69594
Analysis of Debates and Comments
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286.011
Analysis of Comparative Opinions
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286.009
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286.012
Aspect Sentiment Classification
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286.006
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286.017
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286.014
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286.001
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286.015
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286.016
Opinion Summarization and Search
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286.010
Document Sentiment Classification
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286.004
Detecting Fake or Deceptive Opinions
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286.013
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286.007
Bhatia, S., Chaudhary, P., & Dey, N. (2020) · SpringerBriefs in applied sciences and technology · doi:10.1007/978-981-15-5043-0_3
An Interpretable Wide and Deep Model for Online Disinformation DetectionPreprint
Chai, Y., Li, W., Zhu, B., Liu, H., & Jiang, Y. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3879632
Peer Review #1 of "Using of n-grams from morphological tags for fake news classification (v0.1)"
(2021) · PeerJ Computer Science · doi:10.7287/peerj-cs.624v0.1/reviews/1
Boullier, D., & Lohard, A. (2012) · doi:10.4000/books.oep.217
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286.018
Peer Review #1 of "Using of n-grams from morphological tags for fake news classification (v0.2)"
(2021) · PeerJ Computer Science · doi:10.7287/peerj-cs.624v0.2/reviews/1
Computer-Cognition Interfaces: Sensing and influencing mental processes with computer interactionPreprint
Mottelson, A. (2019) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/hg378
Research Paper on Fake Online Reviews Detection using Semi-supervised and Supervised learning
Chettri, A., George, A., Rengarajan, A., & Jaison, F. (2022) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2022.41687
Lying trolls: Detecting deception and text-based disinformation using machine learning
Mbaziira, A. V., Sabir, M. F. S., & Harrack, M. A. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-90570-1.00009-7
Measuring the misinformation ecosystem
Jiang, S. (2021) · doi:10.17760/d20412317
Detecting Deception, Partisan, and Social Biases
Junquera, J. J. S. (2022) · RiuNet (Universitat Politècnica de València) · doi:10.4995/thesis/10251/185784
IDENTIFY THE FAKE REVIEWS IN ONLINE SOCIAL NETWORKS USING MACHINE LEARNING APPROACH
(2022) · International Research Journal of Modernization in Engineering Technology and Science · doi:10.56726/irjmets30359
Brzić, B., Botički, I., & Babac, M. B. (2022) · Research Square · doi:10.21203/rs.3.rs-2199410/v1
Fraud and Deception Detection: Text-Based Data Analytics
Zhang, Q. T., Li, B., & Xie, D. (2022) · Palgrave studies in risk and insurance · doi:10.1007/978-3-031-11612-4_10
Machine learning-based Fake reviews detection with amalgamated features extraction method
Alvi, M. B., Alvi, M., Shah, R. A., Munir, M. S., & Akhtar, A. (2023) · Sukkur IBA Journal of Emerging Technologies · doi:10.30537/sjet.v5i2.1091
Deep learning for classifying thai deceptive messages
Songram, P., Khummanee, S., Chomphuwiset, P., Jareanpon, C., Boongasame, L., & Kawattikul, K. (2023) · Indonesian Journal of Electrical Engineering and Computer Science · doi:10.11591/ijeecs.v30.i2.pp1232-1241
Wang, B., & Shen, X. (2022) · International Conference on Machine Learning, Big Data and Business Intelligence (MLBDBI) · doi:10.1109/mlbdbi58171.2022.00052
Gopal, L. (2019) · INFORMATION TECHNOLOGY IN INDUSTRY · doi:10.17762/itii.v7i2.802
Majeed, T., Farooq, H., Jan, T., & Nazir, A. (2023) · International Conference ICT for Digital, Smart and Sustainable Development · doi:10.4108/eai.24-3-2022.2318561
Metadata
- Authors
- Ott, M., Choi, Y., Cardie, C., & Hancock, J. T.
- Affiliations
- Cornell University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2011
- Pages
- 309-319
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1107.4557
- OpenAlex
- W2161283199
- Cited by
- 1,008
- References
- 42
- Citations by year
- 2026: 1 · 2025: 30 · 2024: 57 · 2023: 72 · 2022: 74 · 2021: 106 · 2020: 114 · 2019: 103 · 2018: 89 · 2017: 88 · 2016: 49 · 2015: 68 · 2014: 65 · 2013: 47 · 2012: 43
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (0624267, 0904822, 0968450)
- Jack Kent Cooke Foundation
- Topics
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- opinion spam, opinion spam detection, consumer reviews, fake reviews, creative writing, feature analysis, classifier comparison, psychology of deception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review