The Value of Multidimensional Rating Systems: Evidence from a Natural Experiment and Randomized Experiments
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Online product ratings offer information on product quality. Scholars have recently proposed the potential of designing multidimensional rating systems to better convey information on multiple dimensions of products. This study investigates whether and how multidimensional rating systems affect consumer satisfaction (measured by product ratings), based on both observational data and two randomized experiments. Our identification strategy of the observational study hinges on a natural experiment on TripAdvisor when the website started to allow consumers to rate multiple dimensions of the restaurants, as opposed to only providing an overall rating, in January 2009. We further obtain rating data on the same set of restaurants from Yelp, which controls for the unobserved restaurant quality over time and allows us to identify the causal effect using a difference-in-differences approach. Results from the econometric analyses show that ratings in a single-dimensional rating system have a downward trend and a higher dispersion, whereas ratings in a multidimensional rating system are significantly higher and convergent. Findings from two randomized experiments suggest that the multidimensional rating system helps consumers find products that better fit their preferences and increases the confidence of their choices. We also show that the observed results cannot be explained by the priming effect due to rating system interface or a list of other alternative explanations. The combined evidence from the natural experiment and randomized experiments support the view that the multidimensional rating system enhances rating informativeness and provide implications for designing online rating systems that help consumers match their preferences with product attributes. Data and the online appendix are available at https://doi.org/10.1287/mnsc.2017.2852 . This paper was accepted by Anandhi Bharadwaj, information systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Cognitive Model of the Antecedents and Consequences of Satisfaction Decisions
Oliver, R. L. (1980) · Journal of Marketing Research · doi:10.1177/002224378001700405 · Cited by 14,494 · cited 2×
“…literature to understand system adoption (e.g., Bhattacherjee 2001, Brown et al. 2012, Lin et al. 2012, Brown et al. 2014, Diehl and Poynor 2010, Venkatesh and Goyal 2010) and consumer satisfaction (e.g., Anderson and Sullivan 1993, Churchill and Suprenant 1982, Kim et al. 2009, Oliver 1980).”
Understanding Information Systems Continuance: An Expectation-Confirmation Model1
Bhattacherjee, A. (2001) · MIS Quarterly · doi:10.2307/3250921 · Cited by 8,767 · cited 1×
“Expectation-confirmation theory (ECT) is widely used in the IS and marketing literature to understand system adoption (e.g., Bhattacherjee 2001, Brown et al. 2012, Lin et al. 2012, Brown et al. 2014, Diehl and Poynor 2010, Venkatesh and Goyal 2010) and consumer satisfaction (e.g., Anderson and…”
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
The Effect of Word of Mouth on Sales: Online Book Reviews
Chevalier, J. A., & Mayzlin, D. (2006) · Journal of Marketing Research · doi:10.1509/jmkr.43.3.345 · Cited by 6,003 · cited 2×
“Much of the prior work has focused on the effect of online product reviews on sales (e.g., Godes and Mayzlin 2004, Chevalier and Mayzlin 2006, Liu 2006, Dellarocas et al. 2007, Duan et al. 2008, Forman et al. 2008) and antecedents to review characteristics (e.g., Goes et al. 2014, Hong et al. 2016,…”
Hennig-Thurau, T., Gwinner, K. P., Walsh, G., & Gremler, D. D. (2004) · Journal of Interactive Marketing · doi:10.1002/dir.10073 · Cited by 5,916 · cited 1×
“Related to this point, several studies have established the negativity bias (Sundaram et al. 1998, Hennig-Thurau et al. 2004)—i.e., consumers may put more weight on negative attributes of the product and ignore positive attributes (Hu et al. 2006).”
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2008) · doi:10.2307/j.ctvcm4j72 · Cited by 5,051
An Investigation into the Determinants of Customer Satisfaction
Churchill, G. A., & Surprenant, C. (1982) · Journal of Marketing Research · doi:10.2307/3151722 · Cited by 2,914
Using Online Conversations to Study Word-of-Mouth Communication
Godes, D., & Mayzlin, D. (2004) · Marketing Science · doi:10.1287/mksc.1040.0071 · Cited by 2,601
Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud
Luca, M., & Zervas, G. (2016) · Management Science · doi:10.1287/mnsc.2015.2304 · Cited by 1,263 · cited 1×
“…are well known for having different dimensions of quality (e.g., food, service, and ambiance) and have attracted significant attention in recent academic literature (e.g., Anderson and Magruder 2012, Dai et al. 2012, Gu et al. 2012, Luca and Zervas 2016, Mangold et al. 1999, Huang et al. 2016).”
Kim, D. J., Ferrin, D. L., & Rao, H. R. (2009) · Information Systems Research · doi:10.1287/isre.1080.0188 · Cited by 990 · cited 1×
“…literature to understand system adoption (e.g., Bhattacherjee 2001, Brown et al. 2012, Lin et al. 2012, Brown et al. 2014, Diehl and Poynor 2010, Venkatesh and Goyal 2010) and consumer satisfaction (e.g., Anderson and Sullivan 1993, Churchill and Suprenant 1982, Kim et al. 2009, Oliver 1980).”
Research Commentary —Too Big to Fail: Large Samples and the p -Value Problem
Lin, M., Lucas, H. C., & Shmueli, G. (2013) · Information Systems Research · doi:10.1287/isre.2013.0480 · Cited by 972
On Product Uncertainty in Online Markets: Theory and Evidence1
Dimoka, A., Hong, Y., & Pavlou, P. A. (2012) · MIS Quarterly · doi:10.2307/41703461 · Cited by 682
Self-citationGhose, A., Ipeirotis, P. G., & Li, B. (2012) · Marketing Science · doi:10.1287/mksc.1110.0700 · Cited by 649
Product fit uncertainty in online markets: nature, effects, and antecedents
Hong, Y. (., & Pavlou, P. A. (2014) · Information Systems Research · doi:10.1287/isre.2014.0520 · Cited by 453 · cited 4×
“Therefore, when making a decision, consumers face two types of uncertainty: product quality uncertainty on the vertical quality dimension and product fit uncertainty on the horizontal quality/preference dimension (Hong and Pavlou 2014).”
InfluentialSelf-citation
Metadata
- Authors
- Chen, P.-Y., Hong, Y., & Liu, Y.
- Venue
- Management Science
- Published
- 2018-10
- Volume
- 64
- Issue
- 10
- Pages
- 4629-4647
- ISSN
- 0025-1909 (ISSN-L)
- 1526-5501
- OpenAlex
- W2612141741
- Cited by
- 166
- References
- 14
- FWCI
- 23.06
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.