The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Automatically assessing review helpfulness
Open accessAbstract
User-supplied reviews are widely and increasingly used to enhance e-commerce and other websites. Because reviews can be numerous and varying in quality, it is important to assess how helpful each review is. While review helpfulness is currently assessed manually, in this paper we consider the task of automatically assessing it. Experiments using SVM regression on a variety of features over Amazon.com product reviews show promising results, with rank correlations of up to 0.66. We found that the most useful features include the length of the review, its unigrams, and its product rating.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Nonparametric Statistics for the Behavioral Sciences
Guitton, H., & Siegel, S. (1958) · Revue économique · doi:10.2307/3498751 · Cited by 35,245
Introduction to Modern Information Retrieval
Salton, G., & McGill, M. J. (1983) · Virtual Defense Library (Ministerio de Defensa) · Cited by 11,392
The proof and measurement of association between two things
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412159 · Cited by 8,039
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
Nonparametric statistics for the behavioral sciences
McGinn, L. C. (1957) · Journal of the Franklin Institute · doi:10.1016/0016-0032(57)90766-4 · Cited by 7,204
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Introduction to modern information retrieval
Dillon, M. (1983) · Information Processing & Management · doi:10.1016/0306-4573(83)90062-6 · Cited by 5,909
Advances in kernel methods: support vector learning
Schölkopf, B., Burges, C. J. C., & Smola, A. J. (1999) · doi:10.5555/299094 · Cited by 5,789
Making Large-Scale SVM Learning Practical
Joachims, T. (1998) · RePEc: Research Papers in Economics · doi:10.17877/de290r-14262 · Cited by 4,411
Cited by
Opinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,720
Sentiment Analysis and Opinion Mining
Liu, B. (2012) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02145-9 · Cited by 3,281
Sentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2017) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7687-1_907 · Cited by 3,260
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,866
Self-citationGhose, A., & Ipeirotis, P. G. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.188 · Cited by 1,400
A Survey of Opinion Mining and Sentiment Analysis
Liu, B., & Zhang, L. (2012) · Mining Text Data · doi:10.1007/978-1-4614-3223-4_13 · Cited by 1,323
Finding Deceptive Opinion Spam by Any Stretch of the Imagination
Ott, M., Choi, Y., Cardie, C., & Hancock, J. T. (2011) · arXiv · doi:10.48550/arxiv.1107.4557 · Cited by 1,008
Spotting fake reviewer groups in consumer reviews
Mukherjee, A., Liu, B., & Glance, N. (2012) · Proceedings of the 21st international conference on World Wide Web · doi:10.1145/2187836.2187863 · Cited by 773
“Lastly, [18, 25, 37] studied the usefulness or quality of reviews.”
BackgroundDetecting product review spammers using rating behaviors
Lim, E.-P., Nguyen, V.-A., Jindal, N., Liu, B., & Lauw, H. W. (2010) · Proceedings of the 19th ACM international conference on Information and knowledge management · doi:10.1145/1871437.1871557 · Cited by 715
Hsu, C.-L., & Lin, J. C.-C. (2015) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2014.11.003 · Cited by 662
“The results showed that absolute skew and kurtosis values for all variables are less than 2 (see Table 5), which indicated that the data in our study are close to the univariate normal distribution (Kline 2005).”
ResultCao, Q., Duan, W., & Gan, Q. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.11.009 · Cited by 640
Neural Attentional Rating Regression with Review-level Explanations
Chen, C., Zhang, M., Liu, Y., & Ma, S. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186070 · Cited by 622
Fang, B., Ye, Q., Kucukusta, D., & Law, R. (2016) · Tourism Management · doi:10.1016/j.tourman.2015.07.018 · Cited by 609
Helpfulness of Online Consumer Reviews: Readers' Objectives and Review Cues
Baek, H., Ahn, J., & Choi, Y. (2012) · International Journal of Electronic Commerce · doi:10.2753/jec1086-4415170204 · Cited by 593
Salehan, M., & Kim, D. J. (2016) · Decision Support Systems · doi:10.1016/j.dss.2015.10.006 · Cited by 577
What Yelp Fake Review Filter Might Be Doing?
Mukherjee, A., Venkataraman, V., Liu, B., & Glance, N. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14389 · Cited by 557
A review of natural language processing techniques for opinion mining systems
Sun, S., Luo, C., & Chen, J. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.10.004 · Cited by 542
Opinion Mining and Sentiment Analysis
Liu, B. (2011) · Web Data Mining · doi:10.1007/978-3-642-19460-3_11 · Cited by 482
Understanding the determinants of online review helpfulness: A meta-analytic investigation
Hong, H., Xu, D., Wang, G. A., & Fan, W. (2017) · Decision Support Systems · doi:10.1016/j.dss.2017.06.007 · Cited by 470
Predicting the “helpfulness” of online consumer reviews
Singh, J. P., Irani, S., Rana, N. P., Dwivedi, Y. K., Saumya, S., & Kumar Roy, P. (2017) · Journal of Business Research · doi:10.1016/j.jbusres.2016.08.008 · Cited by 431
Sentiment Analysis: Mining Opinions, Sentiments, and Emotions
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286 · Cited by 362
A systematic literature review: Opinion mining studies from mobile app store user reviews
Genc-Nayebi, N., & Abran, A. (2017) · Journal of Systems and Software · doi:10.1016/j.jss.2016.11.027 · Cited by 358
Mining customer requirements from online reviews: A product improvement perspective
Qi, J., Zhang, Z., Jeon, S., & Zhou, Y. (2016) · Information & Management · doi:10.1016/j.im.2016.06.002 · Cited by 334
Learning to identify review spam
Li, F., Huang, M., Yang, Y., & Zhu, X. (2011) · doi:10.5591/978-1-57735-516-8/ijcai11-414 · Cited by 328
Exploiting social context for review quality prediction
Lu, Y., Tsaparas, P., Ntoulas, A., & Polanyi, L. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772761 · Cited by 306
Siering, M., Muntermann, J., & Rajagopalan, B. (2018) · Decision Support Systems · doi:10.1016/j.dss.2018.01.004 · Cited by 301
How useful are your comments?: analyzing and predicting youtube comments and comment ratings
Siersdorfer, S., Chelaru, S., Nejdl, W., & San Pedro, J. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772781 · Cited by 298
Quality evaluation of product reviews using an information quality framework
Chen, C. C., & Tseng, Y.-D. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.08.023 · Cited by 281
Delta TFIDF: An Improved Feature Space for Sentiment Analysis
Martineau, J., & Finin, T. (2009) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.13016/m2wd3q54v · Cited by 262
PeerStudio: Rapid Peer Feedback Emphasizes Revision and Improves Performance
Kulkarni, C. E., Bernstein, M. S., & Klemmer, S. R. (2015) · Proceedings of the Second (2015) ACM Conference on Learning @ Scale · doi:10.1145/2724660.2724670 · Cited by 192
Reputation Transferability in Online Labor Markets
Kokkodis, M., & Ipeirotis, P. G. (2016) · Management Science · doi:10.1287/mnsc.2015.2217 · Cited by 166
“For example, Kim et al. (2006) use review length, unigrams, and product rating ; O'Mahony and Smyth (2010) use readability tests; Otterbacher and Arbor (2009) use the topical relevancy , the believability, and the objectivity of the review; Danescu-Niculescu-Mizil et al. (2009) use the difference…”
MethodIdentifying helpful reviews based on customer’s mentions about experiences
Min, H.-J., & Park, J. C. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.01.116 · Cited by 66
Extracting and Ranking Travel Tips from User-Generated Reviews
Guy, I., Mejer, A., Nus, A., & Raiber, F. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052632 · Cited by 32
Unsupervised tip-mining from customer reviews
Zhu, D., Lappas, T., & Zhang, J. (2018) · Decision Support Systems · doi:10.1016/j.dss.2018.01.011 · Cited by 32
MRR: an unsupervised algorithm to rank reviews by relevance
Woloszyn, V., dos Santos, H. D. P., Wives, L. K., & Becker, K. (2017) · Proceedings of the International Conference on Web Intelligence · doi:10.1145/3106426.3106444 · Cited by 9
Metadata
- Authors
- Kim, S.-M., Pantel, P., Chklovski, T., & Pennacchiotti, M.
- Venue
- Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing - EMNLP '06
- Published
- 2006
- Pages
- 423
- OpenAlex
- W2087294982
- Cited by
- 518
- References
- 30
- FWCI
- 9.12
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.