Aggregation of consumer ratings: an application to Yelp.com
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Because consumer reviews leverage the wisdom of the crowd, the way in which they are aggregated is a central decision faced by platforms. We explore this “rating aggregation problem” and offer a structural approach to solving it, allowing for (1) reviewers to vary in stringency and accuracy, (2) reviewers to be influenced by existing reviews, and (3) product quality to change over time. Applying this to restaurant reviews from Yelp.com, we construct an adjusted average rating and show that even a simple algorithm can lead to large information efficiency gains relative to the arithmetic average.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
The Effect of Word of Mouth on Sales: Online Book Reviews
Chevalier, J. A., & Mayzlin, D. (2006) · Journal of Marketing Research · doi:10.1509/jmkr.43.3.345 · Cited by 6,003 · cited 1×
“Chevalier and Mayzlin (2006) find predictive power of consumer rating on book sales.”
Incentives and Prosocial Behavior
Bénabou, R., & Tirole, J. (2006) · American Economic Review · doi:10.1257/aer.96.5.1652 · Cited by 3,357
Using Online Conversations to Study Word-of-Mouth Communication
Godes, D., & Mayzlin, D. (2004) · Marketing Science · doi:10.1287/mksc.1040.0071 · Cited by 2,601
Doing Good or Doing Well? Image Motivation and Monetary Incentives in Behaving Prosocially
Ariely, D., Bracha, A., & Meier, S. (2009) · American Economic Review · doi:10.1257/aer.99.1.544 · Cited by 1,753 · cited 3×
“6 Finally, our model of social incentives is related to the vast literature on information cascade and observational learning such as Banerjee (1992), Bikhchandani et al. (1992), and more recently, Alevy et al.”
InfluentialA Theory of Social Custom, of Which Unemployment May be One Consequence
Akerlof, G. A. (1980) · The Quarterly Journal of Economics · doi:10.2307/1885667 · Cited by 1,648
Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud
Luca, M., & Zervas, G. (2016) · Management Science · doi:10.1287/mnsc.2015.2304 · Cited by 1,263 · cited 1×
“For an analysis of filtered reviews, see Luca and Zervas (2016).”
Self-citationPromotional Reviews: An Empirical Investigation of Online Review Manipulation
Mayzlin, D., Dover, Y., & Chevalier, J. (2014) · American Economic Review · doi:10.1257/aer.104.8.2421 · Cited by 937 · cited 2×
“Mayzlin et al. (2014) have documented evidence for review manipulation on hotel booking platforms (i.e. Expedia.com and Tripadvisor.com).”
Social Influence Bias: A Randomized Experiment
Muchnik, L., Aral, S., & Taylor, S. J. (2013) · Science · doi:10.1126/science.1240466 · Cited by 892 · cited 2×
“8 The second incentive is the reviewer’s social incentive that may generate a positive or negative correlation across ratings (Muchnik et al. 2013).”
Ghose, A., Ipeirotis, P. G., & Li, B. (2012) · Marketing Science · doi:10.1287/mksc.1110.0700 · Cited by 649
Cited by
Competing with complementors: An empirical look at Amazon.com
Zhu, F., & Liu, Q. (2018) · Strategic Management Journal · doi:10.1002/smj.2932 · Cited by 546
Crowds Can Effectively Identify Misinformation at Scale
Martel, C., Allen, J., Pennycook, G., & Rand, D. G. (2024) · Perspectives on Psychological Science · doi:10.1177/17456916231190388 · Cited by 84
Your Hometown Matters: Popularity-Difference Bias in Online Reputation Platforms
Kokkodis, M., & Lappas, T. (2020) · Information Systems Research · doi:10.1287/isre.2019.0895 · Cited by 48
Designing Online Marketplaces: Trust and Reputation Mechanisms
Luca, M. (2016) · NBER Working Paper Series · doi:10.3386/w22616 · Cited by 36
Self-citation
Metadata
- Authors
- Dai, W., Jin, G., Lee, J., & Luca, M.
- Venue
- Quantitative Marketing and Economics
- Published
- 2017-12-29
- Volume
- 16
- Issue
- 3
- Pages
- 289-339
- ISSN
- 1570-7156 (ISSN-L)
- 1573-711X
- OpenAlex
- W2786862269
- Cited by
- 96
- References
- 11
- FWCI
- 17.47
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Aggregation of consumer ratings: an application to Yelp.com. https://app.cochat.ai/papers/10.1007/s11129-017-9194-9
- The paper
- Dai, W., Jin, G., Lee, J., & Luca, M. (2018). Aggregation of consumer ratings: an application to Yelp.com. Quantitative Marketing and Economics. https://doi.org/10.1007/s11129-017-9194-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.