The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Research Note—When Do Consumers Value Positive vs. Negative Reviews? An Empirical Investigation of Confirmation Bias in Online Word of Mouth
Abstract
In the online word-of-mouth literature, research has consistently shown that negative reviews have a greater impact on product sales than positive reviews. Although this negativity effect is well documented at the product level, there is less consensus on whether negative or positive reviews are perceived to be more helpful by consumers. A limited number of studies document a higher perceived helpfulness for negative reviews under certain conditions, but accumulating empirical evidence suggests the opposite. To reconcile these contradictory findings, we propose that consumers can form initial beliefs about a product on the basis of the product’s summary rating statistics (such as the average and dispersion of the product’s ratings) and that these initial beliefs play a vital role in their subsequent evaluation of individual reviews. Using a unique panel data set collected from Apple’s App Store, we empirically demonstrate confirmation bias—that consumers have a tendency to perceive reviews that confirm (versus disconfirm) their initial beliefs as more helpful, and that this tendency is moderated by their confidence in their initial beliefs. Furthermore, we show that confirmation bias can lead to greater perceived helpfulness for positive reviews (positivity effect) when the average product rating is high, and for negative reviews (negativity effect) when the average product rating is low. Thus, the mixed findings in the literature can be a consequence of confirmation bias. This paper is among the first to incorporate the important role of consumers’ initial beliefs and confidence in such beliefs (a fundamental dimension of metacognition) into their evaluation of online reviews, and our findings have significant implications for researchers, retailers, and review websites.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2001) · RePEc: Research Papers in Economics · Cited by 27,577
A Theory of Cognitive Dissonance
Festinger, L. (1957) · doi:10.1515/9781503620766 · Cited by 24,241
A Theory of Cognitive Dissonance
(2017) · Macat Library eBooks · doi:10.4324/9781912282432 · Cited by 18,122
Baumeister, R. F., Bratslavsky, E., Finkenauer, C., & Vohs, K. D. (2001) · Review of General Psychology · doi:10.1037/1089-2680.5.4.323 · Cited by 7,678
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267
The Effect of Word of Mouth on Sales: Online Book Reviews
Chevalier, J. A., & Mayzlin, D. (2006) · Journal of Marketing Research · doi:10.1509/jmkr.43.3.345 · Cited by 6,003 · cited 4×
“Notably, empirical studies have usually found that negative ratings hurt sales to a greater extent than positive ratings help sales in diverse product categories (Basuroy et al. 2003, Cao et al. 2011, Chevalier and Mayzlin 2006).”
InfluentialSocial psychology: handbook of basic principles
(2008) · Choice Reviews Online · doi:10.5860/choice.45-3496 · Cited by 5,473
Causal Inference without Balance Checking: Coarsened Exact Matching
Iacus, S. M., King, G., & Porro, G. (2012) · Political Analysis · doi:10.1093/pan/mpr013 · Cited by 3,563
What Makes a Helpful Online Review? A Study of Customer Reviews on Amazon.Com1
Mudambi, S. M., & Schuff, D. (2010) · MIS Quarterly · doi:10.2307/20721420 · Cited by 2,490
Parducci, A., & Helson, H. (1965) · The American Journal of Psychology · doi:10.2307/1421107 · Cited by 2,475
Confirmation, disconfirmation, and information in hypothesis testing
Klayman, J., & Ha, Y.-W. (1987) · Psychological Review · doi:10.1037/0033-295x.94.2.211 · Cited by 2,094
Forman, C., Ghose, A., & Wiesenfeld, B. (2008) · Information Systems Research · doi:10.1287/isre.1080.0193 · Cited by 1,695
Cem: Coarsened Exact Matching in Stata
Blackwell, M., Iacus, S., King, G., & Porro, G. (2009) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0900900402 · Cited by 1,689
The Technique of Clear Writing.
Gunning, R. C. (1968) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,641
Ghose, A., & Ipeirotis, P. G. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.188 · Cited by 1,400
Feeling validated versus being correct: A meta-analysis of selective exposure to information
Hart, W., Albarracín, D., Eagly, A. H., Brechan, I., Lindberg, M. J., & Merrill, L. (2009) · Psychological Bulletin · doi:10.1037/a0015701 · Cited by 1,292
Cheung, M. Y., Luo, C., Sia, C. L., & Chen, H. (2009) · International Journal of Electronic Commerce · doi:10.2753/jec1086-4415130402 · Cited by 1,286
What makes a helpful online review? a study of customer reviews on amazon.com
Mudambi, S. M., & Schuff, D. (2010) · MIS Quarterly · doi:10.5555/2017447.2017457 · Cited by 1,281
Why are you telling me this? An examination into negative consumer reviews on the Web
Sen, S., & Lerman, D. (2007) · Journal of Interactive Marketing · doi:10.1002/dir.20090 · Cited by 1,245
DUAN, W., GU, B., & WHINSTON, A. (2008) · Journal of Retailing · doi:10.1016/j.jretai.2008.04.005 · Cited by 1,223
Not all emotions are created equal: The negativity bias in social–emotional development
Vaish, A., Grossmann, T., & Woodward, A. (2008) · Psychological Bulletin · doi:10.1037/0033-2909.134.3.383 · Cited by 1,191 · cited 2×
“…example, in controlled experiments where participants’ initial beliefs are absent as they evaluate individual reviews (e.g., Sen and Lerman 2007, Zhang et al. 2010), a negativity effect is likely, given our evolutionary conditioning to be more alert to risks in the environment (Vaish et al. 2008).”
A hypothesis-confirming bias in labeling effects
Darley, J. M., & Gross, P. H. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.44.1.20 · Cited by 1,173
How Critical are Critical Reviews? The Box Office Effects of Film Critics, Star Power, and Budgets
Basuroy, S., Chatterjee, S., & Ravid, S. A. (2003) · Journal of Marketing · doi:10.1509/jmkg.67.4.103.18692 · Cited by 913
When Online Reviews Meet Hyperdifferentiation: A Study of the Craft Beer Industry
Clemons, E. K., Gao, G. G., & Hitt, L. M. (2006) · Journal of Management Information Systems · doi:10.2753/mis0742-1222230207 · Cited by 827
Anxious or Angry? Effects of Discrete Emotions on the Perceived Helpfulness of Online Reviews1
Yin, D., Bond, S. D., & Zhang, H. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.2.10 · Cited by 757
Self-citationThe Value of Social Dynamics in Online Product Ratings Forums
Moe, W. W., & Trusov, M. (2011) · Journal of Marketing Research · doi:10.1509/jmkr.48.3.444 · Cited by 672
How Does the Variance of Product Ratings Matter?
Sun, M. (2012) · Management Science · doi:10.1287/mnsc.1110.1458 · Cited by 663
Cao, Q., Duan, W., & Gan, Q. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.11.009 · Cited by 640
Reliable Estimation of Generalized Linear Mixed Models using Adaptive Quadrature
Rabe-Hesketh, S., Skrondal, A., & Pickles, A. (2002) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0200200101 · Cited by 613
Born Unequal: A Study of the Helpfulness of User-Generated Product Reviews
Pan, Y., & Zhang, J. Q. (2011) · Journal of Retailing · doi:10.1016/j.jretai.2011.05.002 · Cited by 610
The cognitive-affective crossfire: When self-consistency confronts self-enhancement.
Swann, W. B., Griffin, J. J., Predmore, S. C., & Gaines, B. (1987) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.52.5.881 · Cited by 608
Korfiatis, N., García-Bariocanal, E., & Sánchez-Alonso, S. (2012) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2011.10.003 · Cited by 548
When does electronic word-of-mouth matter? A study of consumer product reviews
Zhang, J. Q., Craciun, G., & Shin, D. (2010) · Journal of Business Research · doi:10.1016/j.jbusres.2009.12.011 · Cited by 541
Estimating Demand for Mobile Applications in the New Economy
Ghose, A., & Han, S. P. (2014) · Management Science · doi:10.1287/mnsc.2014.1945 · Cited by 399
Attitude, ego-involvement, and change
Sherif, C. W., & Sherif, M. (1967) · Wiley eBooks · Cited by 393
Unpacking attitude certainty: Attitude clarity and attitude correctness.
Petrocelli, J. V., Tormala, Z. L., & Rucker, D. D. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.92.1.30 · Cited by 321
11. The role of metacognition in social judgment
Petty, R. E., Briñol, P., Tormala, Z. L., & Wegener, D. T. (2007) · Dialnet (Universidad de la Rioja) · Cited by 307
Confirmatory and diagnosing strategies in social information gathering.
Yaacov Trope, B., & Bassok, M. (1982) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.43.1.22 · Cited by 282
Qiu, L., Pang, J., & Lim, K. H. (2012) · Decision Support Systems · doi:10.1016/j.dss.2012.08.020 · Cited by 279
Smith, R. E., & Swinyard, W. R. (1988) · Journal of Advertising · doi:10.1080/00913367.1988.10673118 · Cited by 231
Alba, J. W., Broniarczyk, S. M., Shimp, T. A., & Urbany, J. E. (1994) · Journal of Consumer Research · doi:10.1086/209394 · Cited by 216
Consumer conviction and commitment: An appraisal‐based framework for attitude certainty
Rucker, D. D., Tormala, Z. L., Petty, R. E., & Briñol, P. (2014) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2013.07.001 · Cited by 202
Why Is the Crowd Divided? Attribution for Dispersion in Online Word of Mouth
He, S. X., & Bond, S. D. (2015) · Journal of Consumer Research · doi:10.1086/680667 · Cited by 168
Park, J., Konana, P., Gu, B., Kumar, A., & Raghunathan, R. (2013) · Information Systems Research · doi:10.1287/isre.2013.0492 · Cited by 123
A multilevel multinomial logit model for the analysis of graduates’ skills
Grilli, L., & Rampichini, C. (2006) · Statistical Methods & Applications · doi:10.1007/s10260-006-0039-z · Cited by 80
Critical Thinking in Psychology
Sternberg, R. J., & Halpern, D. F. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511804632 · Cited by 59
The Recipe for the Perfect Review? An Investigation into the Determinants of Review Helpfulness
Scholz, M., & Dorner, V. (2013) · Business & Information Systems Engineering · doi:10.1007/s12599-013-0259-3 · Cited by 44
Fischer, P. A., Fischer, J., Weisweiler, S., & Frey, D. (2010) · British Journal of Social Psychology · doi:10.1348/014466610x499668 · Cited by 41
Cited by
Understanding the determinants of online review helpfulness: A meta-analytic investigation
Hong, H., Xu, D., Wang, G. A., & Fan, W. (2017) · Decision Support Systems · doi:10.1016/j.dss.2017.06.007 · Cited by 470
Kim, A., Moravec, P. L., & Dennis, A. R. (2019) · Journal of Management Information Systems · doi:10.1080/07421222.2019.1628921 · Cited by 316
The effect of online reviews on product sales: A joint sentiment-topic analysis
Li, X., Wu, C., & Mai, F. (2019) · Information & Management · doi:10.1016/j.im.2018.04.007 · Cited by 315
How do electronic word of mouth practices contribute to mobile banking adoption?
Shankar, A., Jebarajakirthy, C., & Ashaduzzaman, M. (2020) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2019.101920 · Cited by 279
Expl(AI)ned: The Impact of Explainable Artificial Intelligence on Users’ Information Processing
Bauer, K., von Zahn, M., & Hinz, O. (2023) · Information Systems Research · doi:10.1287/isre.2023.1199 · Cited by 261
Metadata
- Authors
- Yin, D., Mitra, S., & Zhang, H.
- Venue
- Information Systems Research
- Published
- 2016-03
- Volume
- 27
- Issue
- 1
- Pages
- 131-144
- ISSN
- 1047-7047 (ISSN-L)
- 1526-5536
- OpenAlex
- W2278526461
- Cited by
- 365
- References
- 48
- FWCI
- 67.64
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.