The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics
Open accessAbstract
With the rapid growth of the Internet, the ability of users to create and publish content has created active electronic communities that provide a wealth of product information. However, the high volume of reviews that are typically published for a single product makes harder for individuals as well as manufacturers to locate the best reviews and understand the true underlying quality of a product. In this paper, we reexamine the impact of reviews on economic outcomes like product sales and see how different factors affect social outcomes such as their perceived usefulness. Our approach explores multiple aspects of review text, such as subjectivity levels, various measures of readability and extent of spelling errors to identify important text-based features. In addition, we also examine multiple reviewer-level features such as average usefulness of past reviews and the self-disclosed identity measures of reviewers that are displayed next to a review. Our econometric analysis reveals that the extent of subjectivity, informativeness, readability, and linguistic correctness in reviews matters in influencing sales and perceived usefulness. Reviews that have a mixture of objective, and highly subjective sentences are negatively associated with product sales, compared to reviews that tend to include only subjective or only objective information. However, such reviews are rated more informative (or helpful) by other users. By using Random Forest-based classifiers, we show that we can accurately predict the impact of reviews on sales and their perceived usefulness. We examine the relative importance of the three broad feature categories: “reviewer-related” features, “review subjectivity” features, and “review readability” features, and find that using any of the three feature sets results in a statistically equivalent performance as in the case of using all available features. This paper is the first study that integrates econometric, text mining, and predictive modeling techniques toward a more complete analysis of the information captured by user-generated online reviews in order to estimate their helpfulness and economic impact.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
(2001) · RePEc: Research Papers in Economics · Cited by 27,577
A Tutorial on Support Vector Machines for Pattern Recognition
Burges, C. J. C. (1998) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009715923555 · Cited by 16,429
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
The Effect of Word of Mouth on Sales: Online Book Reviews
Chevalier, J. A., & Mayzlin, D. (2006) · Journal of Marketing Research · doi:10.1509/jmkr.43.3.345 · Cited by 6,003
Hennig-Thurau, T., Gwinner, K. P., Walsh, G., & Gremler, D. D. (2004) · Journal of Interactive Marketing · doi:10.1002/dir.10073 · Cited by 5,916
Chaiken, S. (1980) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.39.5.752 · Cited by 5,516
(2024) · Physics Subject Headings (PhySH) · doi:10.29172/7c2a6982-6d72-4cd8-bba6-2fccb06a7011 · Cited by 3,857
Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
Peter, P., & Turney (2002) · Cited by 3,650
Research works printed but not linked: 6
- Dellarocas, Exploring the Value of Online Product Ratings in Revenue Forecasting: The Case of Motion Pictures
- Ghose, Designing Ranking Systems for Consumer Reviews: The Impact of Review Subjectivity on Product Sales and Review Quality
- Weimer, Predicting the Perceived Quality of Web Forum Posts
- 10.1007/978-3-540-68636-1_54 · doi:10.1007/978-3-540-68636-1_54
- Shen, Essays on Online Reviews: The Strategic Behaviors of Online Reviewers to Compete for Attention, and the Temporal Pattern of Online Reviews
- Yahia, Reviewing the Reviewers: Characterizing Biases and Competencies Using Socially Meaningful Attributes
Cited by
Sentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2017) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7687-1_907 · Cited by 3,260
A survey on opinion mining and sentiment analysis: Tasks, approaches and applications
Ravi, K., & Ravi, V. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.06.015 · Cited by 1,306
Lin, M., Prabhala, N. R., & Viswanathan, S. (2013) · Management Science · doi:10.1287/mnsc.1120.1560 · Cited by 1,299
Goh, K.-Y., Heng, C.-S., & Lin, Z. (2013) · Information Systems Research · doi:10.1287/isre.1120.0469 · Cited by 1,228
Guo, Y., Barnes, S. J., & Jia, Q. (2017) · Tourism Management · doi:10.1016/j.tourman.2016.09.009 · Cited by 1,039
What makes a useful online review? Implication for travel product websites
Liu, Z., & Park, S. (2015) · Tourism Management · doi:10.1016/j.tourman.2014.09.020 · Cited by 963
What can big data and text analytics tell us about hotel guest experience and satisfaction?
Xiang, Z., Schwartz, Z., Gerdes, J. H., & Uysal, M. (2015) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2014.10.013 · Cited by 953
Burtch, G., Ghose, A., & Wattal, S. (2013) · Information Systems Research · doi:10.1287/isre.1120.0468 · Cited by 864
Self-citationGoh, K. Y., Heng, C. S., & Lin, Z. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2048614 · Cited by 799
Mine Your Own Business: Market-Structure Surveillance Through Text Mining
Netzer, O., Feldman, R., Goldenberg, J., & Fresko, M. (2012) · Marketing Science · doi:10.1287/mksc.1120.0713 · Cited by 750
Uniting the Tribes: Using Text for Marketing Insight
Berger, J., Humphreys, A., Ludwig, S., Moe, W. W., Netzer, O., & Schweidel, D. A. (2020) · Journal of Marketing · doi:10.1177/0022242919873106 · Cited by 742
Ghose, A., Ipeirotis, P. G., & Li, B. (2012) · Marketing Science · doi:10.1287/mksc.1110.0700 · Cited by 649
Self-citationHow Online Product Reviews Affect Retail Sales: A Meta-analysis
Floyd, K., Freling, R., Alhoqail, S., Cho, H. Y., & Freling, T. (2014) · Journal of Retailing · doi:10.1016/j.jretai.2014.04.004 · Cited by 622
Fang, B., Ye, Q., Kucukusta, D., & Law, R. (2016) · Tourism Management · doi:10.1016/j.tourman.2015.07.018 · Cited by 609
Helpfulness of Online Consumer Reviews: Readers' Objectives and Review Cues
Baek, H., Ahn, J., & Choi, Y. (2012) · International Journal of Electronic Commerce · doi:10.2753/jec1086-4415170204 · Cited by 593
Asymmetric effects of online consumer reviews
Park, S., & Nicolau, J. L. (2015) · Annals of Tourism Research · doi:10.1016/j.annals.2014.10.007 · Cited by 588
Salehan, M., & Kim, D. J. (2016) · Decision Support Systems · doi:10.1016/j.dss.2015.10.006 · Cited by 577
The evolution of sentiment analysis—A review of research topics, venues, and top cited papers
Mäntylä, M. V., Graziotin, D., & Kuutila, M. (2018) · Computer Science Review · doi:10.1016/j.cosrev.2017.10.002 · Cited by 558
Korfiatis, N., García-Bariocanal, E., & Sánchez-Alonso, S. (2012) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2011.10.003 · Cited by 548
Spinning gold: The financial returns to stakeholder engagement
Henisz, W. J., Dorobantu, S., & Nartey, L. J. (2014) · Strategic Management Journal · doi:10.1002/smj.2180 · Cited by 546
A review of natural language processing techniques for opinion mining systems
Sun, S., Luo, C., & Chen, J. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.10.004 · Cited by 542
Manipulation of online reviews: An analysis of ratings, readability, and sentiments
Hu, N., Bose, I., Koh, N. S., & Liu, L. (2012) · Decision Support Systems · doi:10.1016/j.dss.2011.11.002 · Cited by 530
How Is the Mobile Internet Different? Search Costs and Local Activities
Ghose, A., Goldfarb, A., & Han, S. P. (2013) · Information Systems Research · doi:10.1287/isre.1120.0453 · Cited by 526
Self-citationFilieri, R., McLeay, F., Tsui, B., & Lin, Z. (2018) · Information & Management · doi:10.1016/j.im.2018.04.010 · Cited by 477
Understanding the determinants of online review helpfulness: A meta-analytic investigation
Hong, H., Xu, D., Wang, G. A., & Fan, W. (2017) · Decision Support Systems · doi:10.1016/j.dss.2017.06.007 · Cited by 470
Babić Rosario, A., de Valck, K., & Sotgiu, F. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00706-1 · Cited by 462
Product fit uncertainty in online markets: nature, effects, and antecedents
Hong, Y. (., & Pavlou, P. A. (2014) · Information Systems Research · doi:10.1287/isre.2014.0520 · Cited by 453
Predicting the “helpfulness” of online consumer reviews
Singh, J. P., Irani, S., Rana, N. P., Dwivedi, Y. K., Saumya, S., & Kumar Roy, P. (2017) · Journal of Business Research · doi:10.1016/j.jbusres.2016.08.008 · Cited by 431
City University of Hong Kong, Cheung, C., Sia, C.-L., City University of Hong Kong, Kuan, K., & City University of Hong Kong (2012) · Journal of the Association for Information Systems · doi:10.17705/1jais.00305 · Cited by 407
Hu, N., Koh, N. S., & Reddy, S. K. (2014) · Decision Support Systems · doi:10.1016/j.dss.2013.07.009 · Cited by 406
Lee, E.-J., & Shin, S. Y. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2013.10.050 · Cited by 380
The effectiveness of managing social media on hotel performance
Kim, W. G., Lim, H., & Brymer, R. A. (2015) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2014.10.014 · Cited by 377
Social Influence Effects in Online Product Ratings
Sridhar, S., & Srinivasan, R. (2012) · Journal of Marketing · doi:10.1509/jm.10.0377 · Cited by 375
Artificial intelligence in E-Commerce: a bibliometric study and literature review
Bawack, R. E., Wamba, S. F., Carillo, K. D. A., & Akter, S. (2022) · Electronic Markets · doi:10.1007/s12525-022-00537-z · Cited by 372
Why people hate your app: making sense of user feedback in a mobile app store
Fu, B., Lin, J., Li, L., Faloutsos, C., Hong, J., & Sadeh, N. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2488202 · Cited by 370
Yin, D., Mitra, S., & Zhang, H. (2016) · Information Systems Research · doi:10.1287/isre.2015.0617 · Cited by 365
Sentiment Analysis: Mining Opinions, Sentiments, and Emotions
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286 · Cited by 362
A systematic literature review: Opinion mining studies from mobile app store user reviews
Genc-Nayebi, N., & Abran, A. (2017) · Journal of Systems and Software · doi:10.1016/j.jss.2016.11.027 · Cited by 358
Helpfulness of Online Product Reviews as Seen by Consumers: Source and Content Features
Li, M., Huang, L., Tan, C.-H., & Wei, K.-K. (2013) · International Journal of Electronic Commerce · doi:10.2753/jec1086-4415170404 · Cited by 352
Jain, P. K., Pamula, R., & Srivastava, G. (2021) · Computer Science Review · doi:10.1016/j.cosrev.2021.100413 · Cited by 326
Zhang, D., Zhou, L., Kehoe, J. L., & Kilic, I. Y. (2016) · Journal of Management Information Systems · doi:10.1080/07421222.2016.1205907 · Cited by 315
The effect of online reviews on product sales: A joint sentiment-topic analysis
Li, X., Wu, C., & Mai, F. (2019) · Information & Management · doi:10.1016/j.im.2018.04.007 · Cited by 315
Exploiting social context for review quality prediction
Lu, Y., Tsaparas, P., Ntoulas, A., & Polanyi, L. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772761 · Cited by 306
What Makes an Online Review More Helpful: An Interpretation Framework Using XGBoost and SHAP Values
Meng, Y., Yang, N., Qian, Z., & Zhang, G. (2020) · Journal of Theoretical and Applied Electronic Commerce Research · doi:10.3390/jtaer16030029 · Cited by 302
Siering, M., Muntermann, J., & Rajagopalan, B. (2018) · Decision Support Systems · doi:10.1016/j.dss.2018.01.004 · Cited by 301
Social Media, Traditional Media, and Music Sales1
Dewan, S., & Ramaprasad, J. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.1.05 · Cited by 298
The Hidden Cost of Accommodating Crowdfunder Privacy Preferences: A Randomized Field Experiment
Burtch, G., Ghose, A., & Wattal, S. (2015) · Management Science · doi:10.1287/mnsc.2014.2069 · Cited by 298
Self-citationUtilizing big data analytics for information systems research: challenges, promises and guidelines
Müller, O., Junglas, I., Brocke, J. V., & Debortoli, S. (2016) · European Journal of Information Systems · doi:10.1057/ejis.2016.2 · Cited by 281
Social commerce research: Definition, research themes and the trends
Lin, X., Li, Y., & Wang, X. (2017) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2016.06.006 · Cited by 263
Extrinsic versus Intrinsic Rewards for Contributing Reviews in an Online Platform
Khern-am-nuai, W., Kannan, K., & Ghasemkhani, H. (2018) · Information Systems Research · doi:10.1287/isre.2017.0750 · Cited by 260
Understanding the Impact of Online Reviews on Hotel Performance: An Empirical Analysis
Phillips, P., Barnes, S., Zigan, K., & Schegg, R. (2017) · Journal of Travel Research · doi:10.1177/0047287516636481 · Cited by 257
Understanding User-Generated Content and Customer Engagement on Facebook Business Pages
Yang, M., Ren, Y., & Adomavicius, G. (2019) · Information Systems Research · doi:10.1287/isre.2019.0834 · Cited by 257
Kim, W. G., Li, J. (., & Brymer, R. A. (2016) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2016.03.001 · Cited by 255
Whose online reviews to trust? Understanding reviewer trustworthiness and its impact on business
Banerjee, S., Bhattacharyya, S., & Bose, I. (2017) · Decision Support Systems · doi:10.1016/j.dss.2017.01.006 · Cited by 253
Content marketing in e-commerce platforms in the internet celebrity economy
Geng, R., Wang, S., Chen, X., Song, D., & Yu, J. (2020) · Industrial Management & Data Systems · doi:10.1108/imds-05-2019-0270 · Cited by 205
A Structured Analysis of Unstructured Big Data by Leveraging Cloud Computing
Liu, X., Singh, P. V., & Srinivasan, K. (2016) · Marketing Science · doi:10.1287/mksc.2015.0972 · Cited by 184
Reputation Transferability in Online Labor Markets
Kokkodis, M., & Ipeirotis, P. G. (2016) · Management Science · doi:10.1287/mnsc.2015.2217 · Cited by 166
Self-citationEconomics of Free Under Perpetual Licensing: Implications for the Software Industry
Niculescu, M. F., & Wu, D. J. (2014) · Information Systems Research · doi:10.1287/isre.2013.0508 · Cited by 151
Online Product Reviews-Triggered Dynamic Pricing: Theory and Evidence
Feng, J., Li, X., & Zhang, X. (. (2019) · Information Systems Research · doi:10.1287/isre.2019.0852 · Cited by 117
Do fit opinions matter? The impact of fit context on online product returns
Wang, Y., Ramachandran, V., & Liu Sheng, O. R. (2021) · Information Systems Research · doi:10.1287/isre.2020.0965 · Cited by 72
Curbing shopping cart abandonment in C2C markets — an uncertainty reduction approach
Tang, H., & Lin, X. (2019) · Electronic Markets · doi:10.1007/s12525-018-0313-6 · Cited by 56
Wang, Y.-Y., Luse, A., Townsend, A. M., & Mennecke, B. E. (2015) · Information Systems and e-Business Management · doi:10.1007/s10257-014-0269-9 · Cited by 54
Your Hometown Matters: Popularity-Difference Bias in Online Reputation Platforms
Kokkodis, M., & Lappas, T. (2020) · Information Systems Research · doi:10.1287/isre.2019.0895 · Cited by 48
Whose Voice Do We Hear in the Marketplace? Evidence from Consumer Complaining Behavior
Raval, D. (2020) · Marketing Science · doi:10.1287/mksc.2018.1140 · Cited by 47
Generating Product Descriptions from User Reviews
Novgorodov, S., Guy, I., Elad, G., & Radinsky, K. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313532 · Cited by 41
How Verb Tense Shapes Persuasion
Packard, G., Berger, J., & Boghrati, R. (2023) · Journal of Consumer Research · doi:10.1093/jcr/ucad006 · Cited by 36
Metadata
- Authors
- Ghose, A., & Ipeirotis, P. G.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2011-10
- Volume
- 23
- Issue
- 10
- Pages
- 1498-1512
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2098173428
- Cited by
- 1,400
- References
- 55
- FWCI
- 127.29
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.