The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
What Makes an Online Review More Helpful: An Interpretation Framework Using XGBoost and SHAP Values
Open accessAbstract
Online product reviews play important roles in the word-of-mouth marketing of e-commerce enterprises, but only helpful reviews actually influence customers’ purchase decisions. Current research focuses on how to predict the helpfulness of a review but lacks a thorough analysis of why it is helpful. In this paper, feature sets covering review text and context cues are firstly proposed to represent review helpfulness. Then, a set of gradient boosted trees (GBT) models is introduced, and the optimal one, which as implemented in eXtreme Gradient Boosting (XGBoost), is chosen to predict and explain review helpfulness. Specially, by including the SHAP (Shapley) values method to quantify feature contribution, this paper presents an integrated framework to better interpret why a review is helpful at both the macro and micro levels. Based on real data from Amazon.cn, this paper reveals that the number of words contributes the most to the helpfulness of reviews on headsets and is interactively influenced by features like the number of sentences or feature frequency, while feature frequency contributes the most to the helpfulness of facial cleanser reviews and is interactively influenced by the number of adjectives used in the review or the review’s entropy. Both datasets show that individual feature contributions vary from review to review, and individual joint contributions gradually decrease with the increase of feature values.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
LightGBM: A Highly Efficient Gradient Boosting Decision Tree
(2017) · HAL · Cited by 10,512
Geurts, P., Ernst, D., & Wehenkel, L. (2006) · Machine Learning · doi:10.1007/s10994-006-6226-1 · Cited by 9,300
17. A Value for n-Person Games
Shapley, L. S. (1953) · Contributions to the Theory of Games (AM-28), Volume II · doi:10.1515/9781400881970-018 · Cited by 6,950
Shapley, L. S. (1988) · The Shapley Value · doi:10.1017/cbo9780511528446.003 · Cited by 4,954
Gradient boosting machines, a tutorial
Natekin, A., & Knoll, A. (2013) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2013.00021 · Cited by 3,887
A sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts
Pang, B., & Lee, L. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1218990 · Cited by 3,301
Sequential Model-Based Optimization for General Algorithm Configuration
Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-25566-3_40 · Cited by 2,469
Consistent Individualized Feature Attribution for Tree Ensembles
Lundberg, S. M., Erion, G. G., & Lee, S.-I. (2018) · arXiv · doi:10.48550/arxiv.1802.03888 · Cited by 1,430
Ghose, A., & Ipeirotis, P. G. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.188 · Cited by 1,400
A boosted decision tree approach using Bayesian hyper-parameter optimization for credit scoring
Xia, Y., Liu, C., Li, Y., & Liu, N. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.02.017 · Cited by 769
Automated Text Analysis for Consumer Research
Humphreys, A., & Wang, R. J.-H. (2018) · Journal of Consumer Research · doi:10.1093/jcr/ucx104 · Cited by 636
Fang, B., Ye, Q., Kucukusta, D., & Law, R. (2016) · Tourism Management · doi:10.1016/j.tourman.2015.07.018 · Cited by 609
Extreme Gradient Boosting as a Method for Quantitative Structure–Activity Relationships
Sheridan, R. P., Wang, W. M., Liaw, A., Ma, J., & Gifford, E. M. (2016) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6b00591 · Cited by 544
Predicting the “helpfulness” of online consumer reviews
Singh, J. P., Irani, S., Rana, N. P., Dwivedi, Y. K., Saumya, S., & Kumar Roy, P. (2017) · Journal of Business Research · doi:10.1016/j.jbusres.2016.08.008 · Cited by 431
Perceived helpfulness of online consumer reviews: The role of message content and style
Schindler, R. M., & Bickart, B. (2012) · Journal of Consumer Behaviour · doi:10.1002/cb.1372 · Cited by 378
Pasting Small Votes for Classification in Large Databases and On-Line
Breiman, L. (1999) · Machine Learning · doi:10.1023/a:1007563306331 · Cited by 317
Siering, M., Muntermann, J., & Rajagopalan, B. (2018) · Decision Support Systems · doi:10.1016/j.dss.2018.01.004 · Cited by 301
Quality evaluation of product reviews using an information quality framework
Chen, C. C., & Tseng, Y.-D. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.08.023 · Cited by 281
Toward quality data: An attribute-based approach
Wang, R. Y., Reddy, M. P., & Kon, H. B. (1995) · Decision Support Systems · doi:10.1016/0167-9236(93)e0050-n · Cited by 252
Chua, A. Y. K., & Banerjee, S. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.08.057 · Cited by 231
Sentiment classification of Internet restaurant reviews written in Cantonese
Zhang, Z., Ye, Q., Zhang, Z., & Li, Y. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.12.147 · Cited by 230
Moore, S. G. (2015) · Journal of Consumer Research · doi:10.1093/jcr/ucv003 · Cited by 215
Linguistic features for review helpfulness prediction
Krishnamoorthy, S. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.12.044 · Cited by 201
Yin, D., Bond, S. D., & Zhang, H. (2017) · Journal of Marketing Research · doi:10.1509/jmr.13.0379 · Cited by 201
Which online reviews do consumers find most helpful? A multi-method investigation
Eslami, S. P., Ghasemaghaei, M., & Hassanein, K. (2018) · Decision Support Systems · doi:10.1016/j.dss.2018.06.012 · Cited by 192
Xiao, Z., Wang, Y., Fu, K., & Wu, F. (2017) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi6020057 · Cited by 189
Weathers, D., Swain, S. D., & Grover, V. (2015) · Decision Support Systems · doi:10.1016/j.dss.2015.07.009 · Cited by 188
Ren, G., & Hong, T. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2018.04.003 · Cited by 180
Helpfulness of product reviews as a function of discrete positive and negative emotions
Malik, M. S. I., & Hussain, A. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.03.053 · Cited by 178
'Helpfulness' in online communities: a measure of message quality
Otterbacher, J. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518848 · Cited by 171
Identifying helpful online reviews: A product designer’s perspective
Liu, Y., Jin, J., Ji, P., Harding, J. A., & Fung, R. Y. K. (2013) · Computer-Aided Design · doi:10.1016/j.cad.2012.07.008 · Cited by 164
An analysis of review content and reviewer variables that contribute to review helpfulness
Malik, M. S. I., & Hussain, A. (2017) · Information Processing & Management · doi:10.1016/j.ipm.2017.09.004 · Cited by 125
Aghakhani, N., Karimi, J., & Salehan, M. (2018) · International Journal of Electronic Commerce · doi:10.1080/10864415.2018.1441700 · Cited by 107
The effect of user-controllable filters on the prediction of online hotel reviews
Hu, Y., Chen, K., & Lee, P.-J. (2016) · Information & Management · doi:10.1016/j.im.2016.12.009 · Cited by 90
Bayesian Hyperparameter Optimization for Ensemble LearningPreprint
Lévesque, J.-C., Gagné, C., & Sabourin, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06394 · Cited by 80
Predicting the helpfulness of online reviews using a scripts-enriched text regression model
Ngo-Ye, T. L., Sinha, A. P., & Sen, A. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.11.029 · Cited by 60
Predicting the helpfulness of online customer reviews: The role of title features
Akbarabadi, M., & Hosseini, M. (2018) · International Journal of Market Research · doi:10.1177/1470785318819979 · Cited by 55
Chen, X., Sheng, J., Wang, X., & Deng, J. (2016) · Discrete Dynamics in Nature and Society · doi:10.1155/2016/9354519 · Cited by 37
Diversifying customer review rankings
Krestel, R., & Dokoohaki, N. (2015) · Neural Networks · doi:10.1016/j.neunet.2015.02.008 · Cited by 22
Mining Customer Requirement from Helpful Online Reviews
Zhang, Z., Qi, J., & Zhu, G. (2014) · International Conference on Enterprise Systems (ES) · doi:10.1109/es.2014.38 · Cited by 19
The Influence of Social Capital in an Online Community on Online Review Quality in China
Li, Q., Cui, J., & Gao, Y. (2015) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2015.74 · Cited by 9
Cited by
Kim, Y., & Kim, Y. (2022) · Sustainable Cities and Society · doi:10.1016/j.scs.2022.103677 · Cited by 348
Metadata
- Authors
- Meng, Y., Yang, N., Qian, Z., & Zhang, G.
- Venue
- Journal of Theoretical and Applied Electronic Commerce Research
- Publisher
- MDPI AG
- Published
- 2020-11-20
- Volume
- 16
- Issue
- 3
- Pages
- 466-490
- ISSN
- 0718-1876 (ISSN-L)
- OpenAlex
- W3107568551
- Cited by
- 302
- References
- 47
- FWCI
- 28.09
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.