The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Stimulating Online Reviews by Combining Financial Incentives and Social Norms
Open accessAbstract
In hopes of motivating consumers to provide larger volumes of useful reviews, many retailers offer financial incentives. Here, we explore an alternative approach, social norms. We inform individuals about the volume of reviews authored by peers. We test the effectiveness of using financial incentives, social norms, and a combination of both strategies in motivating consumers. In two randomized experiments, one in the field conducted in partnership with a large online clothing retailer based in China and a second on Amazon Mechanical Turk, we compare the effectiveness of each strategy in stimulating online reviews in larger numbers and of greater length. We find that financial incentives are more effective at inducing larger volumes of reviews, but the reviews that result are not particularly lengthy, whereas social norms have a greater effect on the length of reviews. Importantly, we show that the combination of financial incentives and social norms yields the greatest overall benefit by motivating reviews in greater numbers and of greater length. We further assess treatment-induced self-selection and sentiment bias by triangulating the experimental results with findings from an observational study. The online appendix is available at https://doi.org/10.1287/mnsc.2016.2715 . This paper was accepted by Chris Forman, information systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deci, E. L., Koestner, R., & Ryan, R. M. (1999) · Psychological Bulletin · doi:10.1037/0033-2909.125.6.627 · Cited by 7,176 · cited 2×
“For example, a great deal of research has highlighted that offering individuals payments can undermine their intrinsic motivation to perform a task (Deci et al. 1999).”
Social Influence: Compliance and Conformity
Cialdini, R. B., & Goldstein, N. J. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142015 · Cited by 6,077
(2004) · Choice Reviews Online · doi:10.5860/choice.41-3182 · Cited by 4,690
The Constructive, Destructive, and Reconstructive Power of Social Norms
Schultz, P. W., Nolan, J. M., Cialdini, R. B., Goldstein, N. J., & Griskevicius, V. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01917.x · Cited by 3,643
Self-citationThe handbook of psychological testing
(1993) · Choice Reviews Online · doi:10.5860/choice.31-1802 · Cited by 3,534
The Digitization of Word of Mouth: Promise and Challenges of Online Feedback Mechanisms
Dellarocas, C. (2003) · Management Science · doi:10.1287/mnsc.49.10.1407.17308 · Cited by 3,433
A Room with a Viewpoint: Using Social Norms to Motivate Environmental Conservation in Hotels
Goldstein, N. J., Cialdini, R. B., & Griskevicius, V. (2008) · Journal of Consumer Research · doi:10.1086/586910 · Cited by 3,409
Self-citationCialdini, R. B., Kallgren, C. A., & Reno, R. R. (1991) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60330-5 · Cited by 3,143
Social norms and energy conservation
Allcott, H. (2011) · Journal of Public Economics · doi:10.1016/j.jpubeco.2011.03.003 · Cited by 2,802 · cited 3×
“…incentives (Khern-am-nuai and Kannan 2014; Stephen et al. 2012; Wang et al. 2012) and social norms (Gerber and Rogers 2009; Ferraro and Price 2013; Allcott 2011) in isolation, we offer a first consideration of the relative and joint effects of financial incentives and social norms on motivating…”
Effects of Group Pressure Upon the Modification and Distortion of Judgments
Asch, S. E. (1961) · Documents of Gestalt Psychology · doi:10.1525/9780520313514-017 · Cited by 2,644
What Makes a Helpful Online Review? A Study of Customer Reviews on Amazon.Com1
Mudambi, S. M., & Schuff, D. (2010) · MIS Quarterly · doi:10.2307/20721420 · Cited by 2,490
Customer Satisfaction and Word of Mouth
Anderson, E. W. (1998) · Journal of Service Research · doi:10.1177/109467059800100102 · Cited by 2,103
Prosocial Organizational Behaviors
Brief, A. P., & Motowidlo, S. J. (1986) · The Academy of Management Review · doi:10.2307/258391 · Cited by 2,085
Normative social influence is underdetected
Nolan, J. M., Schultz, P. W., Cialdini, R. B., Goldstein, N. J., & Griskevicius, V. (2008) · Personality and Social Psychology Bulletin · doi:10.1177/0146167208316691 · Cited by 1,772
Self-citationCostly Punishment Across Human Societies
Henrich, J., McElreath, R., Barr, A., Ensminger, J., Barrett, C., Bolyanatz, A., Cardenas, J. C., Gurven, M., Gwako, E., Henrich, N., et al. (2006) · Science · doi:10.1126/science.1127333 · Cited by 1,771
The Social Psychology of Groups.
Hare, A. P., Thibaut, J. W., & Kelley, H. H. (1960) · American Sociological Review · doi:10.2307/2092954 · Cited by 1,528
Markets, Religion, Community Size, and the Evolution of Fairness and Punishment
Henrich, J., Ensminger, J., McElreath, R., Barr, A., Barrett, C., Bolyanatz, A., Cardenas, J. C., Gurven, M., Gwako, E., Henrich, N., et al. (2010) · Science · doi:10.1126/science.1182238 · Cited by 1,387
What makes a helpful online review? a study of customer reviews on amazon.com
Mudambi, S. M., & Schuff, D. (2010) · MIS Quarterly · doi:10.5555/2017447.2017457 · Cited by 1,281
Handbook of Psychological Testing
Kline, P. (2013) · Routledge eBooks · doi:10.4324/9781315812274 · Cited by 1,194
A Randomized, Controlled Trial of Financial Incentives for Smoking Cessation
Volpp, K. G., Troxel, A. B., Pauly, M. V., Glick, H. A., Puig, A., Asch, D. A., Galvin, R., Zhu, J., Wan, F., DeGuzman, J., et al. (2009) · New England Journal of Medicine · doi:10.1056/nejmsa0806819 · Cited by 836
Effort for Payment: A Tale of Two Markets
Heyman, J., & Ariely, D. (2004) · Psychological Science · doi:10.1111/j.0956-7976.2004.00757.x · Cited by 827
Are financial incentives related to performance? A meta-analytic review of empirical research.
Jenkins, G. D., Mitra, A., Gupta, N., & Shaw, J. D. (1998) · Journal of Applied Psychology · doi:10.1037/0021-9010.83.5.777 · Cited by 789
Aral, S., & Walker, D. (2011) · Management Science · doi:10.1287/mnsc.1110.1421 · Cited by 786
Is altruism part of human nature?
Hoffman, M. L. (1981) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.40.1.121 · Cited by 746
On Product Uncertainty in Online Markets: Theory and Evidence1
Dimoka, A., Hong, Y., & Pavlou, P. A. (2012) · MIS Quarterly · doi:10.2307/41703461 · Cited by 682
Self-citationCao, Q., Duan, W., & Gan, Q. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.11.009 · Cited by 640
Using Nonpecuniary Strategies to Influence Behavior: Evidence from a Large-Scale Field Experiment
Ferraro, P. J., & Price, M. K. (2013) · Review of Economics and Statistics · doi:10.1162/rest_a_00344 · Cited by 629
The labor economics of paid crowdsourcing
Horton, J. J., & Chilton, L. B. (2010) · Proceedings of the 11th ACM conference on Electronic commerce · doi:10.1145/1807342.1807376 · Cited by 601
The Effects of Presentation Formats and Task Complexity on Online Consumers’ Product Understanding1
Jiang, Z. (., & Benbasat, I. (2007) · MIS Quarterly · doi:10.2307/25148804 · Cited by 585
Descriptive Social Norms and Motivation to Vote: Everybody's Voting and so Should You
Gerber, A. S., & Rogers, T. (2009) · The Journal of Politics · doi:10.1017/s0022381608090117 · Cited by 561
Financial incentives and the "performance of crowds"
Mason, W., & Watts, D. J. (2009) · Proceedings of the ACM SIGKDD Workshop on Human Computation · doi:10.1145/1600150.1600175 · Cited by 520
Social Comparisons and Contributions to Online Communities: A Field Experiment on MovieLens
Chen, Y., Harper, F. M., Konstan, J., & Li, S. X. (2010) · American Economic Review · doi:10.1257/aer.100.4.1358 · Cited by 495
Rick, S. I., Cryder, C. E., & Loewenstein, G. (2008) · Journal of Consumer Research · doi:10.1086/523285 · Cited by 435
Financial Incentives and Student Achievement: Evidence from Randomized Trials *
Fryer, R. G. (2011) · The Quarterly Journal of Economics · doi:10.1093/qje/qjr045 · Cited by 416
How Intrinsic Motivation is Crowded out and in
FREY, B. S. (1994) · Rationality and Society · doi:10.1177/1043463194006003004 · Cited by 398
Low-Quality Product Review Detection in Opinion Summarization
Liu, J., Cao, Y., Lin, C.-Y., Huang, Y., & Zhou, M. (2007) · Cited by 394
The Hidden Cost of Accommodating Crowdfunder Privacy Preferences: A Randomized Field Experiment
Burtch, G., Ghose, A., & Wattal, S. (2015) · Management Science · doi:10.1287/mnsc.2014.2069 · Cited by 298
Self-citationAvery, C., Resnick, P., & Zeckhauser, R. (1999) · American Economic Review · doi:10.1257/aer.89.3.564 · Cited by 267
Gallus, J. (2017) · Management Science · doi:10.1287/mnsc.2016.2540 · Cited by 262
Extrinsic versus Intrinsic Rewards for Contributing Reviews in an Online Platform
Khern-am-nuai, W., Kannan, K., & Ghasemkhani, H. (2018) · Information Systems Research · doi:10.1287/isre.2017.0750 · Cited by 260
Altruism or psychological escape: Why does empathy promote prosocial behavior?
Stocks, E. L., Lishner, D. A., & Decker, S. K. (2009) · European Journal of Social Psychology · doi:10.1002/ejsp.561 · Cited by 255
Anderson, S. P., Strömberg, D., & Waldfogel, J. (2015) · Cited by 244
Do Incentive Hierarchies Induce User Effort? Evidence from an Online Knowledge Exchange
Goes, P. B., Guo, C., & Lin, M. (2016) · Information Systems Research · doi:10.1287/isre.2016.0635 · Cited by 242
Seuntjens, T. G., Zeelenberg, M., van de Ven, N., & Breugelmans, S. M. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000031 · Cited by 212
Prompting healthier eating: Testing the use of health and social norm based messages.
Robinson, E., Fleming, A., & Higgs, S. (2014) · Health Psychology · doi:10.1037/a0034213 · Cited by 193
Aral, S., & Walker, D. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1564856 · Cited by 174
Bias and Reciprocity in Online Reviews: Evidence From Field Experiments on Airbnb
Fradkin, A., Grewal, E., Holtz, D., & Pearson, M. (2015) · Proceedings of the Sixteenth ACM Conference on Economics and Computation · doi:10.1145/2764468.2764528 · Cited by 163
A Dollar for Your Thoughts: Feedback-Conditional Rebates on eBay
Cabral, L., & Li, L. (2015) · Management Science · doi:10.1287/mnsc.2014.2074 · Cited by 160
User-Generated Content and Social Media
Luca, M. (2015) · Handbook of media economics · doi:10.1016/b978-0-444-63685-0.00012-7 · Cited by 151
Hennessey, B. A., & Zbikowski, S. M. (1993) · Creativity Research Journal · doi:10.1080/10400419309534485 · Cited by 142
Using Non-Pecuniary Strategies to Influence Behavior: Evidence from a Large Scale Field Experiment
Ferraro, P. J., & Price, M. (2011) · National Bureau of Economic Research · doi:10.3386/w17189 · Cited by 135
Finding a needle in a haystack of reviews: cold start context-based hotel recommender system
Levi, A., Mokryn, O., Diot, C., & Taft, N. (2012) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/2365952.2365977 · Cited by 127
The Effects of Presentation Formats and Task Complexity on Online Consumers’ Product Understanding
Jiang, Z. J. (2007) · National University of Singapore · Cited by 122
Leveraging Philanthropic Behavior for Customer Support: The Case of user Support Forums1
Jabr, W., Mookerjee, R. V., Tan, Y., & Mookerjee, V. S. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.1.09 · Cited by 113
On Product Uncertainty in Online Markets: Theory and EvidencePreprint
Dimoka, A., Hong, Y., & Pavlou, P. A. (2011) · SSRN Electronic Journal · Cited by 87
Self-citationA Laboratory Study of Behavioral Contagion
Grosser, D., Polansky, N. A., & Lippitt, R. (1951) · Human Relations · doi:10.1177/001872675100400201 · Cited by 52
Bonus, Disclosure, and Choice: What Motivates the Creation of High-Quality Paid Reviews?
Wang, J., Ghose, A., & Ipeirotis, P. G. (2012) · Cited by 49
Undermining the Undermining Effect of Reward on Sustained Interest1
Cialdini, R. B., Eisenberg, N., Green, B. L., Rhoads, K. V. L., & Bator, R. J. (1998) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1998.tb01705.x · Cited by 33
The Digitization of Word-of-Mouth: Promise and Challenges of Online Feedback
Dellarocas, C. N. (2004) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 27
Stephen, A. T., Bart, Y., du Plessis, C., & Gonçalves, D. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2125526 · Cited by 23
Gallus, J. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2579118 · Cited by 10
Research works printed but not linked: 9
- Barnes R, 1949, Motion and Time Study
- Barragues J, 2016, Probability and Statistics: A Didactic Introduction, 10.1201/b16436 · doi:10.1201/b16436
- Ipeirotis P (2010) Demographics of Mechanical Turk. Working paper, New York University, New York. http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1585030.
- Jacques E, 1951, Human Relations, 4, 115
- Khern-am-nuai W, Kannan K (2016) Extrinsic versus intrinsic rewards to participate in a crowd context: An analysis of a review platform. Working paper, Purdue University, West Lafayette, IN. http://ssrn.com/abstract=2496528.
- Liu J, 2007, Proc. Joint Conf. Empirical Methods Natural Language Processing Comput. Natural Language Learn., 334
- Pagano R, 2012, Cengage Learning
- Stephen A, 2012, NA–Advances in Consumer Research, 40, 228
- Wang J, 2012, Internat. Conf. Inform. Systems (ICIS 2012)
Cited by
Making sense of recommendations
Yeomans, M., Shah, A., Mullainathan, S., & Kleinberg, J. (2019) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2118 · Cited by 459
The impact of social nudges on user-generated content for social network platforms
Zeng, Z., Dai, H., Zhang, D. J., Zhang, H., Zhang, R., Xu, Z., & Shen, Z.-J. M. (2023) · Management Science · doi:10.1287/mnsc.2022.4622 · Cited by 76
Monetary Incentive and Stock Opinions on Social Media
Chen, H., Hu, Y. J., & Huang, S. (2019) · Journal of Management Information Systems · doi:10.1080/07421222.2019.1598686 · Cited by 76
Jung, J., Bapna, R., Golden, J. M., & Sun, T. (2020) · Information Systems Research · doi:10.1287/isre.2019.0873 · Cited by 71
Your Hometown Matters: Popularity-Difference Bias in Online Reputation Platforms
Kokkodis, M., & Lappas, T. (2020) · Information Systems Research · doi:10.1287/isre.2019.0895 · Cited by 48
Metadata
- Authors
- Burtch, G., Hong, Y., Bapna, R., & Griskevicius, V.
- Venue
- Management Science
- Published
- 2018-05
- Volume
- 64
- Issue
- 5
- Pages
- 2065-2082
- ISSN
- 0025-1909 (ISSN-L)
- 1526-5501
- OpenAlex
- W2530539196
- Cited by
- 405
- References
- 61
- FWCI
- 41.92
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.